JP2007041225A - Image composition device, method, program and electronic musical instrument - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image composition technique capable of shortening processing time when changing a composite image obtained by combining two or more hierarchical images. <P>SOLUTION: An image composition device is provided with: a hierarchical image storage means (PICT) for storing two or more hierarchical images having the order of priority; a composite image storage means (TOTAL) for storing composite images obtained by combining two or more hierarchical images; a hierarchy number storage means (PICT_CHK) for storing a hierarchy number of a hierarchical image adopted for the composite image for each pixel; and an image composition means for combining two or more hierarchical images according to the order of priority and letting the composite image storage means store the composited image, and also for letting the layer number storage means store the hierarchy number of the hierarchical image adopted for the composite image for each pixel. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to image composition.

  FIG. 13 is a flowchart showing the image composition processing. For example, a case will be described in which five hierarchical images PICT1 to PICT5 are combined to generate a combined image Total. Images PICT1 to PICT5 and Total correspond to an image memory area. When the images of each layer are arranged in order of priority, the first layer image PICT1, the second layer image PICT2, the third layer image PICT3, the fourth layer image PICT4, and the fifth layer image PICT5 are arranged in this order. . The first hierarchical image PICT1 has a transparent color COLOR1. The second hierarchical image PICT2 has a transparent color COLOR2. The third hierarchical image PICT3 has a transparent color COLOR3. The fourth hierarchical image PICT4 has a transparent color COLOR4. The fifth hierarchical image PICT5 has a transparent color COLOR5. If a transparent color is set in a certain hierarchical image, a hierarchical image having a lower priority order is displayed. A case where a two-dimensional image of a rectangular area is synthesized will be described. The rectangular area has an upper left coordinate (x, y) and a lower right coordinate (x + w, y + h).

  In step S1301, y is set to the variable j and x is set to the variable i. Next, in step S1302, it is determined whether or not the first hierarchical image PICT1 [j] [i] is the transparent color COLOR1. PICT1 [j] [i] represents pixel data of coordinates (i, j). If it is not the transmission color COLOR1, the process proceeds to step S1303. If it is the transmission color COLOR1, the process proceeds to step S1304. In step S1303, pixel data of the first hierarchical image PICT1 [j] [i] is set in the composite image Total [j] [i]. Thereafter, the process proceeds to step S1311.

  In step S1304, it is determined whether or not the second hierarchical image PICT2 [j] [i] is the transparent color COLOR2. PICT2 [j] [i] represents pixel data at coordinates (i, j). If it is not the transmission color COLOR2, the process proceeds to step S1305, and if it is the transmission color COLOR2, the process proceeds to step S1306. In step S1305, pixel data of the second hierarchical image PICT2 [j] [i] is set in the composite image Total [j] [i]. Thereafter, the process proceeds to step S1311.

  In step S1306, it is determined whether or not the third hierarchical image PICT3 [j] [i] is the transparent color COLOR3. PICT3 [j] [i] represents pixel data of coordinates (i, j). If it is not the transmission color COLOR3, the process proceeds to step S1307, and if it is the transmission color COLOR3, the process proceeds to step S1308. In step S1307, the pixel data of the third hierarchical image PICT3 [j] [i] is set in the composite image Total [j] [i]. Thereafter, the process proceeds to step S1311.

  In step S1308, it is determined whether the fourth hierarchical image PICT4 [j] [i] is the transparent color COLOR4. PICT4 [j] [i] represents pixel data of coordinates (i, j). If it is not the transmission color COLOR4, the process proceeds to step S1309, and if it is the transmission color COLOR4, the process proceeds to step S1310. In step S1309, pixel data of the fourth hierarchical image PICT4 [j] [i] is set in the composite image Total [j] [i]. Thereafter, the process proceeds to step S1311.

  In step S1310, the pixel data of the fifth hierarchical image PICT5 [j] [i] is set in the composite image Total [j] [i]. Thereafter, the process proceeds to step S1311.

  In step S1311, the variable i is incremented (added by 1). Next, in step S1312, it is determined whether the variable i is equal to x + w. If they are equal, the process proceeds to step S1313. If they are not equal, the process returns to step S1302, and the same processing is repeated.

  In step S1313, the variable j is incremented. Next, in step S1314, it is determined whether the variable j is equal to y + h. If they are equal, the process ends. If they are not equal, the process returns to step S1302 to repeat the same process.

  Japanese Patent Application Laid-Open No. 2004-228561 describes a method in which an arbitrary switch image is freely moved by an operator's operation, and the switch images are grouped and displayed in a superimposed manner.

  Patent Document 2 below describes an apparatus for synthesizing images by synchronizing partial images generated by each node computer.

JP-A-9-128196 JP 2003-323635 A

  In FIG. 13, a plurality of storage areas PICT1 to PICT5 having the same size as the display area of the final display device and a final composite image storage area Total having the same size are prepared, and the storage areas PICT1 to PICT5 are prioritized. The contents to be displayed are stored in the respective storage areas PICT1 to PICT5 according to the priority order.

  When changing the entire screen, first prepare the data of each layer, specify a specific value as the transparent color, determine whether each data is a value to be displayed or not, whether it is a transparent color, Checking from the storage area with a high priority for each pixel, if there is content to be displayed in a hierarchy of a certain priority, the content is stored in the final composite image storage area Total, and the priority lower than that The data is synthesized by a method that does not check the data of the rank hierarchy.

  If there is a change in the display content, the composite image is created by checking the data of each layer of the changed area. However, when data of a certain hierarchy is changed, it is necessary to decide whether or not to change the data of the composite image storage area Total in consideration of the priority of the hierarchy. Therefore, it takes a long time to generate a composite image.

  An object of the present invention is to provide an image composition technique capable of shortening the processing time when changing a composite image obtained by combining a plurality of hierarchical images.

  An image composition apparatus according to the present invention comprises: a hierarchical image storage means for storing a plurality of hierarchical images having a priority order; a composite image storage means for storing a composite image obtained by combining the plurality of hierarchical images; And a hierarchy number storage means for storing the hierarchy number of the hierarchy image adopted in the composite image, and the plurality of hierarchy images are combined according to the priority order and stored in the composite image storage means, Image synthesis means for storing, in the hierarchy number storage means, a hierarchy number of the hierarchy image adopted for the synthesized image for each pixel.

  Further, the image composition method of the present invention is a hierarchical image storage means for storing a plurality of hierarchical images having a priority order, a composite image storage means for storing a composite image obtained by combining the plurality of hierarchical images, An image composition method of an image composition apparatus, comprising: a layer number storage unit for storing a layer number of the layer image adopted for the composite image for each pixel, wherein the plurality of layer images according to the priority order Are combined and stored in the composite image storage means, and the layer number storage means stores the hierarchical number of the hierarchical image adopted in the composite image for each pixel.

  Since the hierarchical number storage means stores the hierarchical number, when a certain hierarchical image is changed, it can be easily determined whether or not the change needs to be reflected in the composite image, and the composite image can be changed in a short time. Can be done.

  FIG. 1 is a block diagram illustrating a configuration example of an electronic musical instrument having an image composition device according to an embodiment of the present invention. A CPU 105, a ROM 106, a RAM 107, a touch sensor 109, and a waveform generator 111 are connected to the bus 101. The panel 102 includes a display device 103 and a switch 104 and is connected to the CPU 105. The display device 103 is, for example, a liquid crystal display device (LCD). The switch 104 is an operator that can be operated by the performer.

  The ROM 106 stores computer programs and various data. The RAM 107 has a work area for the CPU 105. The CPU 105 executes the computer program stored in the ROM 106 to perform the processes shown in the flowcharts of FIGS.

  The MIDI interface 110 is an interface for inputting / outputting MIDI data to / from the outside. The communication interface 115 is an interface for transmitting / receiving data to / from a communication network. The switch 104 has a timbre selection switch or the like, and can select a timbre or the like. The keyboard 108 has a white key and a black key, and is a performance operator for the player to perform a performance operation. The touch sensor 109 detects the key pressing speed of the keyboard 108.

  The CPU 105 detects a key pressing operation (key on), a key releasing operation (key off), a key pressing speed (velocity), and the like according to a performance operation of the keyboard 108. The waveform generation unit 111 reads out and generates a musical sound waveform (musical sound signal) from the waveform memory 112 according to the performance operation described above, and outputs it to the DA converter 113. The DA converter 113 converts the musical sound waveform from a digital format to an analog format and outputs it to the sound system 114. A sound is produced by the sound system 114.

  The ROM 106 stores automatic performance data. When the start of automatic performance is instructed by the switch 104, the CPU 105 reads out automatic performance data and supplies it to the waveform generator 111. The waveform generator 111 generates a musical sound signal, and an automatic performance is produced by the sound system 114.

  FIG. 2 is a diagram showing the hierarchical image storage areas PICT1 to PICTn, the composite image storage area TOTAL, and the hierarchical number storage area PICT_CHK stored in the RAM 107. The storage areas PICT1 to PICTn, TOTAL, and PICT_CHK can store data having the same number of pixels as the display area of the display device 103. When the hierarchical image storage areas are arranged in order of priority, the first hierarchical image storage area PICT1, the second hierarchical image storage area PICT2, the third hierarchical image storage area PICT3, and the fourth hierarchical image storage area PICT4. ,... Becomes the nth hierarchical image storage area PICTn. That is, the first hierarchical image storage area PICT1 has the lowest priority, and the nth hierarchical image storage area PICTn has the highest priority. The image data in the hierarchical image storage areas PICT1 to PICTn can be expressed as 0xffff (hexadecimal number) for the transparent color (transparent color) in pixel units. When a transparent color is set for a pixel of a certain hierarchical image, a pixel of the hierarchical image having a lower priority is displayed. The composite image storage area TOTAL stores a composite image obtained by combining the hierarchical images in the hierarchical image storage areas PICT1 to PICTn. The hierarchy number storage area PICT_CHK stores the hierarchy number adopted for the composite image in the composite image storage area TOTAL for each pixel. The composite image in the composite image storage area TOTAL is displayed on the display device 103.

  FIG. 3 is a flowchart showing an initialization process performed by the CPU 105. A case where a two-dimensional image of a rectangular area is initialized will be described. In the rectangular area, the upper left coordinates are (0, 0), and the lower right coordinates are (x + w, y + h).

  In step S301, 0 is set to variables j and i. Next, in step S302, 1 is set to the hierarchy number storage area PICT_CHK [j] [i]. PICT_CHK [j] [i] represents a hierarchical number adopted at the coordinates (i, j) of the composite image. The hierarchy number 1 means the hierarchy number of the hierarchy image in the first image image storage area PICT1 having the lowest priority. Then, 0xffff (hexadecimal number) is set as transparent color data in the hierarchical image storage areas PICT1 [j] [i] to PICTn [j] [i]. PICT1 [j] [i] to PICTn [j] [i] represent pixel data of coordinates (i, j) in the first to nth hierarchical image storage areas.

  Next, in step S303, the variable i is incremented. Next, in step S304, it is determined whether or not the variable i is equal to x + w. If they are equal, the process proceeds to step S305, and if they are not equal, the process returns to step S302 and the same process is repeated.

  In step S305, the variable j is incremented. Next, in step S306, it is determined whether or not the variable j is equal to y + h. If they are equal, the process ends. If they are not equal, the process returns to step S302 and the same process is repeated.

  FIG. 4 is a flowchart showing data setting processing of the hierarchical image storage areas PICT1 to PICTn performed by the CPU 105. One hierarchical image is set in order from the first hierarchical image storage area PICT1 having a low priority to the nth hierarchical image storage area PICTn having a high priority. A case where data is set in the p-th hierarchical image storage area PICTp will be described. The setting data of the p-th hierarchical image is pic_dat_p [l] [m]. A case where two-dimensional image data of a rectangular area is set will be described. The rectangular area has an upper left coordinate (x, y) and a lower right coordinate (x + w, y + h).

  In step S401, y is set to the variable j, x is set to the variable i, and 0 is set to the variables l and m. Next, in step S402, it is determined whether or not the p-th layer image setting data pic_dat_p [l] [m] is equal to 0xffff (hexadecimal number) that is transparent color data. If not equal, the process proceeds to step S403, and if equal, the process proceeds to step S404.

  In step S403, the p-th hierarchical image setting data pic_dat_p [l] [m] is set in the p-th hierarchical image storage area PICTp [j] [i]. Then, the hierarchy number p is set in the hierarchy number storage area PICT_CHK [j] [i]. That is, it means that the pixel data of the p-th hierarchical image is adopted for the pixel at the coordinates (i, j) of the composite image. Thereafter, the process proceeds to step S404.

  In step S404, the variables i and m are incremented. Next, in step S405, it is determined whether the variable m is equal to w. If they are equal, the process proceeds to step S406. If they are not equal, the process returns to step S402 and the same process is repeated.

  In step S406, the variables j and l are incremented. Next, in step S407, it is determined whether the variable l is equal to h. If they are equal, the set processing for one layer image is terminated, and if they are not equal, the process returns to step S402 and the same processing is repeated.

  As described above, by changing the variable p from 1 to n in order, data can be set from the first hierarchical image storage area PICT1 to the nth hierarchical image storage area PICTn. Thereby, the hierarchical number employed for the pixel at the coordinates (i, j) of the composite image is set in the hierarchical image storage area PICT_CHK [j] [i].

  FIG. 5 is a flowchart showing image composition processing performed by the CPU 105. A case where a two-dimensional image of a rectangular area is synthesized will be described. In the rectangular area, the upper left coordinates are (0, 0), and the lower right coordinates are (x + w, y + h).

  In step S501, 0 is set to variables j and i. Next, in step S502, the hierarchy number of the hierarchy number storage area PICT_CHK [j] [i] is set to the hierarchy number p. Then, data of the p-th hierarchical image storage area PICT [p] [j] [i] is set in the composite image storage area TOTAL [j] [i]. TOTAL [j] [i] represents pixel data of coordinates (i, j) of the composite image. PICT [p] [j] [i] is the same as PICTp [j] [i].

  In step S503, the variable i is incremented. Next, in step S504, it is determined whether the variable i is equal to x + w. If they are equal, the process proceeds to step S505, and if they are not equal, the process returns to step S502 and the same process is repeated.

  In step S505, the variable j is incremented. Next, in step S506, it is determined whether the variable j is equal to y + h. If they are equal, the image composition process is terminated, and if they are not equal, the process returns to step S502 and the same process is repeated.

  Through the above processing, an image obtained by combining the hierarchical images of n hierarchical image storage areas PICT1 to PICTn can be stored in the composite image storage area TOTAL. In addition, the hierarchical number of the hierarchical image adopted for the composite image in the composite image storage area TOTAL for each pixel can be stored in the hierarchical number storage area PICT_CHK.

  FIG. 6 is a flowchart showing the hierarchical image change process performed by the CPU 105. A case where the image data in the p-th hierarchical image storage area PICTp is changed will be described. The change data of the p-th hierarchical image is pic_dat_p [l] [m]. A case where the two-dimensional image data of the rectangular area is changed will be described. The rectangular area has an upper left coordinate (x, y) and a lower right coordinate (x + w, y + h).

  In step S601, y is set to the variable j, x is set to the variable i, and 0 is set to the variables l and m.

  In step S602, the p-th hierarchical image change data pic_dat_p [l] [m] is set in the p-th hierarchical image storage area PICTp [j] [i]. Next, in step S603, an image composition process when changing the hierarchical image is performed. Details of this processing will be described later with reference to FIG.

  Next, in step S604, the variables i and m are incremented. Next, in step S605, it is determined whether the variable m is equal to w. If they are equal, the process proceeds to step S606, and if they are not equal, the process returns to step S602 and the same process is repeated.

  In step S606, the variables j and l are incremented. Next, in step S607, it is determined whether the variable l is equal to h. If they are equal, the change process is terminated, and if they are not equal, the process returns to step S602 and the same process is repeated.

  FIG. 7 is a flowchart showing the image composition processing at the time of changing the hierarchical image in step S603 of FIG. In step S701, it is determined whether or not the hierarchical number of the hierarchical number storage area PICT_CHK [j] [i] is equal to or lower than the hierarchical number p. If it is equal to or lower than the hierarchy number p, the hierarchy image having the same or lower priority than the hierarchy number p is adopted as the composite image, and the process advances to step S702.

  On the other hand, when the number is larger than the layer number p, the layer image having a higher priority than the layer number p is adopted as the composite image, and the processing returns to FIG. 6 without doing anything. In this case, since it is not necessary to perform the processing of steps S702 to S708, the processing time can be shortened.

  In step S702, it is determined whether or not the p-th hierarchical image storage area PICT [p] [j] [i] is the same as 0xffff (hexadecimal number) that is transparent color data. If they are not the same, the process proceeds to step S703, and if they are the same, the process proceeds to step S704.

  In step S703, the hierarchy number p is set in the hierarchy number storage area PICT_CHK [j] [i]. Then, the pixel data of the p-th hierarchical image storage area PICT [p] [j] [i] is set in the composite image storage area TOTAL [j] [i]. Thereafter, the process returns to the process of FIG.

  In step S704, it is determined whether or not the hierarchy number of the hierarchy number storage area PICT_CHK [j] [i] is the same as the hierarchy number p. If they are the same, the process proceeds to step S705. If they are not the same, it means that the data of the layer number p is a transparent color before and after the change, so that the composite image at this pixel position is not changed, and the processing returns to FIG. 6 without doing anything. Thereby, processing can be further omitted and processing time can be shortened.

  In step S705, it is determined whether or not the (p-1) th hierarchical image storage area PICT [p-1] [j] [i] is the same as 0xffff (hexadecimal number) that is the transparent color data. If they are not the same, the process proceeds to step S706, and if they are the same, the process proceeds to step S707.

  In step S706, the hierarchy number p-1 is set in the hierarchy number storage area PICT_CHK [j] [i]. Then, the pixel data of the (p−1) -th hierarchical image storage area PICT [p−1] [j] [i] is set in the composite image storage area TOTAL [j] [i]. Thereafter, the process returns to the process of FIG.

  In step S707, it is determined whether or not the (p-2) th hierarchical image storage area PICT [p-2] [j] [i] is the same as 0xffff (hexadecimal number) that is the transparent color data. If they are not the same, the process proceeds to step S708.

  In step S708, the hierarchy number p-2 is set in the hierarchy number storage area PICT_CHK [j] [i]. Then, pixel data of the (p-2) -th hierarchical image storage area PICT [p-2] [j] [i] is set in the composite image storage area TOTAL [j] [i]. Thereafter, the process returns to the process of FIG.

  When it is determined in step S707 that they are the same, the p-3 to first layer images are processed in the same manner as described above. By processing in order from a hierarchical image with a high priority to a hierarchical image with a low priority, a hierarchical image with a high priority can be preferentially set in the composite image storage area TOTAL.

  As described above, one hierarchical image is changed, the hierarchical number of the hierarchical number storage area PICT_CHK and the hierarchical number of the changed hierarchical image are compared for each pixel, and the composite image storage area TOTAL is synthesized according to the comparison result. The hierarchical number of the image and hierarchical number storage area PICT_CHK is changed for each pixel.

  When the hierarchical number of the changed hierarchical image has higher priority than the hierarchical number of the hierarchical number storage area PICT_CHK, the hierarchical number of the composite image in the composite image storage area TOTAL and the hierarchical number storage area PICT_CHK is changed, and the hierarchical number of the changed hierarchical image However, when the priority order is lower than the hierarchical number of the hierarchical number storage area PICT_CHK, the composite image in the composite image storage area TOTAL and the hierarchical number of the hierarchical number storage area PICT_CHK are not changed.

  When changing the p-th hierarchical image, the hierarchical number of the hierarchical number storage area PICT_CHK and the hierarchical number p of the changed hierarchical image are compared for each pixel, and if larger than the hierarchical number p, steps S702 to S708 are performed. Therefore, the processing time can be shortened.

  According to the present embodiment, a hierarchical number storage area PICT_CHK having the same size as the synthesized image storage area TOTAL is prepared, and the hierarchical number employed in the synthesized image is stored in each pixel area of the hierarchical number storage area PICT_CHK.

  Specifically, when changing the entire screen, as shown in FIG. 4, first, data is set in the first hierarchical image storage area PICT1 having the lowest priority, and the hierarchical number storage area PICT_CHK is set. A numerical value 1 indicating the lowest hierarchy number is set. Next, the priority is raised one by one, and data of each hierarchy is set. At this time, the pixel having data to be displayed changes the value of the hierarchy number storage area PICT_CHK to a value indicating the hierarchy. At the stage where data for all layers has been set, it is determined which data is used for each pixel in accordance with the layer number stored in the layer number storage area PICT_CHK, and a composite image is created.

  As shown in FIG. 6, when the display content is changed, the layer number of the currently displayed data is changed by looking at the layer number corresponding to the position of the pixel where the layer number storage area PICT_CHK is changed. If the priority order is higher than the hierarchical number of the data having the, the composite image is not changed. When the hierarchy number of the currently displayed data is lower than the hierarchy number of the changed data, the value of the hierarchy number storage area PICT_CHK and the value of the composite image storage area TOTAL are changed. Change the display according to the content. When the data of the hierarchical image storage areas PICT1 to PICTn is deleted and becomes transparent color, the hierarchical number of the data and the value of the hierarchical number storage area PICT_CHK are checked, and when the data is not displayed If only the data of each hierarchy is deleted and displayed, the data of the hierarchy of lower priority than the displayed data is checked in the order of higher priority, and the hierarchy number of the hierarchy number storage area PICT_CHK And the data of the composite image storage area TOTAL are changed and displayed. As a result, it is possible to reduce the check of whether there is a transparent color at the time of synthesizing each hierarchical image, and to shorten the time required for the image synthesizing process (particularly at the time of partial change).

  FIG. 8 is a diagram illustrating an example of a hierarchical image having a high priority, and FIG. 9 is a diagram illustrating an example of a composite image obtained by combining the hierarchical image of FIG. 8 and a hierarchical image having a lower priority. The hierarchical image having a high priority in FIG. 8 is an image of lyrics displayed during automatic performance or the like. The hierarchical image having a low priority is, for example, an image of a contrabass instrument. The composite image in FIG. 9 is an image obtained by combining a contrabass image on the background of the lyrics image in FIG. When it is desired to change the background image (contrabass) with the progress of the automatic performance song, it is necessary to always display the high priority lyrics, song titles, time signature information, etc. in FIG. The values of the combined image storage area TOTAL and the hierarchical number storage area PICT_CHK of the background image are changed without changing the values of the combined image storage area TOTAL and the hierarchical number storage area PICT_CHK. When the background image is a complex image such as an orchestra divided into a plurality of hierarchies, the greater the hierarchy, the greater the effect of shortening the processing time in the processing when changing some of the hierarchies.

  FIG. 10 is a diagram illustrating an example of a hierarchical image having a low priority, and FIG. 11 is a diagram illustrating an example of a composite image obtained by combining the hierarchical image of FIG. 10 and a hierarchical image having a higher priority. The hierarchical image having a low priority in FIG. 10 is an image of the entire song data, and the song data can be edited. A hierarchical image having a high priority is an image of song data to be edited, for example, an image of song data to be newly inserted into the entire song data. The synthesized image in FIG. 11 is an image obtained by synthesizing the edited music data image in front of the entire music data in FIG. In the background of the edited music data image, the entire music data is displayed. As the entire song data, the latest song data is displayed according to editing or the like. However, the synthetic music storage area TOTAL and the hierarchy number storage area PICT_CHK are not changed in the image portion of the entire music data that overlaps the edited music data image. Conversely, when only the image of the edited music data is updated, there is no change in the entire music data that becomes the background image.

  FIG. 12 is a diagram illustrating an example of a composite image obtained by combining a plurality of hierarchical images, and illustrates an example of a mixer screen. The mixer screen reflects and displays information instructed by the operation of the switch 104 in FIG. 1 or MIDI data input via the MIDI interface 110, for example, effects, reverb level, chorus level, pan, volume, etc. indicate. When not reflecting in the output as sound, “OFF” is displayed on the forefront like “VOLUME” of “RIGHT2”. “OFF” is an image indicating that the specific function is invalid. The “OFF” image is a hierarchical image with a high priority, and the other images are background hierarchical images with a lower priority. When the switch 104 or the like is operated, the composite image of the portion of the high priority hierarchical image “OFF” is not changed, but the composite image of the portion of the background low priority hierarchical image is changed.

  As described above, according to the present embodiment, since the hierarchical number storage area PICT_CHK stores the hierarchical number, when a certain hierarchical image is changed, it is easily determined whether or not the change needs to be reflected in the composite image. It is possible to make a determination and change the composite image in a short time.

  This embodiment can be realized by the computer of the CPU 105 executing a program. Also, means for supplying a program to a computer, for example, a computer-readable recording medium such as a CD-ROM recording such a program, or a transmission medium such as the Internet for transmitting such a program is also applied as an embodiment of the present invention. Can do. A computer program product such as a computer-readable recording medium in which the above program is recorded can also be applied as an embodiment of the present invention. The above program, recording medium, transmission medium, and computer program product are included in the scope of the present invention. As the recording medium, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

It is a block diagram which shows the structural example of the electronic musical instrument which has an image composition apparatus by embodiment of this invention. It is a figure which shows the hierarchy image storage area PICT1-PICTn memorize | stored in RAM, the synthetic | combination image storage area TOTAL, and the hierarchy number storage area PICT_CHK. It is a flowchart which shows the initialization process which CPU performs. It is a flowchart which shows the data setting process of the hierarchy image storage area PICT1-PICTn which CPU performs. It is a flowchart which shows the image composition process which CPU performs. It is a flowchart which shows the hierarchy image change process which CPU performs. It is a flowchart which shows the image composition process at the time of the hierarchy image change of step S603 of FIG. It is a figure which shows the example of the hierarchy image with a high priority. It is a figure which shows the example of the synthesized image which synthesize | combined the hierarchy image of FIG. 8, and the hierarchy image with a lower priority than it. It is a figure which shows the example of the hierarchy image with a low priority. It is a figure which shows the example of the synthesized image which synthesize | combined the hierarchical image of FIG. 10, and the hierarchical image with a higher priority than it. It is a figure which shows the example of the synthesized image which synthesize | combined the several hierarchy image. It is a flowchart which shows an image composition process.

Explanation of symbols

101 Bus 102 Panel 103 Display Device 104 Switch 105 CPU
106 ROM
107 RAM
108 Keyboard 109 Touch Sensor 110 MIDI Interface 111 Waveform Generator 112 Waveform Memory 113 DA Converter 114 Sound System 115 Communication Interface

Claims (10)

Hierarchical image storage means for storing a plurality of hierarchical images having priorities;
Combined image storage means for storing a combined image obtained by combining the plurality of hierarchical images;
Hierarchical number storage means for storing a hierarchical number of the hierarchical image adopted in the composite image for each pixel;
According to the priority order, the plurality of hierarchical images are combined and stored in the combined image storage unit, and the hierarchical number of the hierarchical image adopted for the combined image for each pixel is stored in the hierarchical number storage unit. An image composition device comprising image composition means.   Further, the one hierarchical image is changed, the hierarchical number of the hierarchical number storage means and the hierarchical number of the changed hierarchical image are compared for each pixel, and the composite image storage means is synthesized according to the comparison result. The image synthesizing apparatus according to claim 1, further comprising an image changing unit that changes an image and a hierarchy number of the hierarchy number storage unit for each pixel.   The image changing means changes the composite image of the composite image storage means and the hierarchy number of the hierarchy number storage means when the hierarchical number of the changed hierarchical image has a higher priority than the hierarchy number of the hierarchy number storage means, 3. The image composition according to claim 2, wherein when the hierarchical number of the changed hierarchical image has a lower priority than the hierarchical number of the hierarchical number storage means, the composite image of the composite image storage means and the hierarchical number of the hierarchical number storage means are not changed. apparatus. The hierarchical image can express a transparent color in pixel units,
4. The image synthesizing apparatus according to claim 3, wherein the image synthesizing unit and the image changing unit display a pixel of a hierarchical image having a lower priority when a pixel of a certain hierarchical image is a transparent color. An image composition device according to claim 4,
An electronic musical instrument comprising: a display device for displaying a composite image of the composite image storage means.   6. The electronic musical instrument according to claim 5, wherein the image synthesizing unit synthesizes a hierarchical image of lyrics and a hierarchical image of musical instruments having a lower priority.   6. The electronic musical instrument according to claim 5, wherein the image synthesizing unit synthesizes a hierarchical image of the entire music data and a hierarchical image of the edited music data having a higher priority.   6. The electronic musical instrument according to claim 5, wherein the image synthesizing unit synthesizes the hierarchical image of the mixer and the hierarchical image of the image indicating the invalidity of the specific function having a higher priority. Hierarchical image storage means for storing a plurality of hierarchical images having a priority order, a composite image storage means for storing a composite image obtained by combining the plurality of hierarchical images, and a pixel-by-pixel adopted in the composite image An image synthesizing method of an image synthesizing apparatus having a hierarchy number storage unit for storing a hierarchy number of the hierarchy image
According to the priority order, the plurality of hierarchical images are combined and stored in the combined image storage unit, and the hierarchical number of the hierarchical image adopted for the combined image for each pixel is stored in the hierarchical number storage unit. An image composition method having an image composition step.   A program for causing a computer to execute the steps of the image composition method according to claim 9.

Images