JP2005165255A - Method of composing music by image data - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method of composing music by image data. <P>SOLUTION: A moving image is obtained by using a photographing apparatus. The moving image is analyzed to obtain an image parameter. The image parameter is compared with reference values stored in a data bank. At least one musical node signal is determined in accordance with a comparison result. At least one musical note signal is played by a sound production module and a sound amplifier. Or several musical note signals are composed into music after collected and are played by the sound production module and the sound amplifier. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

The present invention relates to a method of creating music with electronic equipment. Furthermore, the present invention relates to a method for making notes and music by analyzing and comparing captured dynamic images.
This application claims priority of Taiwan application number 92134150 filed on December 4, 2003.

  Since mobile phones, pocket personal computers (PCs), personal digital assistants (PDAs), portable PCs, etc. have been applied in wireless communications and the Internet, these electronic products having convenient and efficient functions for mobile communications have been developed. , Has become very common in everyday life.

  With regard to mobile phone communication functions, manufacturers that previously appealed to users by emphasizing communication quality have changed the emphasis on mobile phones. In particular, the second and third generations of communication systems have greatly developed, and not only mobile phones with multiple functions are used for communication, but also multi-function wireless communication, downloading of phone ringtones, graphics It includes a wide range of usage, such as uploading / downloading images, music, or videos, as a large album or audio / video management tool. In addition to the mini-size digital camera built into the mobile phone, as a function to capture the image of the photo / image sensor or lens, it became a basic tool for capturing images by using these additional functions. These features are also inevitably required for new generation mobile phones.

  At least one object of the present invention is to provide a method of creating music using image data. The captured dynamic image or still image is analyzed and compared to determine the note signal. Then, a note signal is played using the sound generation module and the performance device. As a result, the user is enjoyed during the image shooting.

  At least another object of the present invention is to provide a method for creating music using image data. The captured dynamic image or still image is analyzed and compared to determine the note signal. After collecting a large number of note signals, the music composition module composes these note signals into music. Then, music is played using the sound generation module and the performance device. As a result, the user is further enjoyed while using the electronic device.

  The present invention provides a method of creating music using image data. In step 1, a dynamic image is obtained by an image capturing device. In step 2, the captured dynamic image is analyzed to obtain image parameters. In step 3, the obtained image parameters are compared with a number of reference values stored in the data bank to obtain at least one note signal. In step 4, a note signal is sent out.

  According to a preferred embodiment of the present invention, the above-described steps for analyzing the dynamic image and obtaining the image parameters include a dynamic image after obtaining the dynamic image to obtain a large number of still images. It includes taking out part of an image. Then, an image parameter is obtained from any one of these still image data. At that time, for example, still image data is processed by averaging processing. This averaging process is to calculate the average pixel value from any dynamic image or the average luminance of the still image.

  According to the embodiment of the present invention, it is possible to play a musical note signal sent out using a sound amplifying device such as a speaker. Alternatively, after collecting a large number of note signals in the memory, the note signals are composed into music using a music composition device, and the music is played with a sound amplification device.

  The present invention also provides another method of creating music using image data. In step 1, a still image is obtained by an image capturing device. In step 2, the captured still image is analyzed to obtain a number of image parameters. In step 3, at least one note signal is obtained by comparing one of the obtained image parameters with a number of reference values stored in the data bank. After that, a note signal is sent out.

  According to an embodiment of the present invention, the foregoing steps for analyzing still images and obtaining image parameters include analyzing still image pixel values in any single row or any single column, or any of Intensity analysis for a single row or any single column is included.

  Since the present invention uses a method of converting an image into music, the captured dynamic image is divided into several still images. Compare the pixel value or brightness of any still image with a reference value in the data bank to convert the dynamic image to audio data and improve the enjoyment effect for the user.

  FIG. 1 is a process diagram that schematically illustrates a process of creating music from image data, in accordance with an embodiment of the present invention. In step S102, a dynamic image is captured by the image capturing device. At that time, as those skilled in the art will appreciate, the imaging device may be a mobile phone, a palm / pocket PC, a portable PC, a digital camera, a digital video, or a webcam for use with a computer, but is limited. It is not something.

  In step S120, the captured dynamic image is analyzed to obtain an image parameter. The analysis technique includes obtaining a large number of still images based on dynamic images (step S104) and obtaining image parameters from the still images (step S106). In step 104 for obtaining a large number of still images based on a dynamic image, the dynamic image can be divided into a number of still images at different times, as will be appreciated by a skilled person. In step S106 for obtaining image parameters, a technique of averaging any one of the still images can be taken. For example, the average pixel value or the average luminance is calculated for any still image. However, it is not limited to this.

  In step S108, the image parameter is compared with a large number of reference values stored in the data bank. According to the comparison result, at least one note signal or rhythm signal is obtained, the note signal at this time being like a note signal produced by an instrument or a note signal mixed from various different instruments. The rhythm signal can also be a percussion instrument signal made with a percussion instrument such as a drum. A note signal can be created at the same time along with the rhythm signal during the comparison process. This method is known to those skilled in the art and the data bank may be a music data bank, but is not limited. For example, the reference value is provided in the image capturing device, and the user of the image capturing device may set the user's preference.

  In the embodiment, when comparing an image parameter and a reference value, for example, an image parameter can be arranged between two adjacent reference values to determine a note signal. However, the present invention is not limited to this method alone.

  In step S110, a note signal can be sent out and converted to an audio signal, for example, by an audio generation module. The audio signal can be played by the audio amplifying device.

  In the embodiment, the process between steps S102 and S108 can be repeated many times to obtain several note signals to be stored in the memory device (step S112). A memory device can be incorporated into the image capturing device, but is not limited to this method. In step S114, the music note module can be used to compose the note signal into music. For example, the sound generation module converts the music into a sound signal, and the sound signal is played by the sound amplifying device (step S116).

  FIG. 2 is a process diagram that schematically illustrates a process for creating music from image data, in accordance with another embodiment of the present invention. In FIG. 2, a still image is captured using an image capturing device (step S202).

  In step S204, the still image is analyzed to obtain several image parameters. As will be appreciated by those skilled in the art, image parameters can then be obtained, for example, by analyzing single row or single column pixel values of a still image, or by analyzing the luminance of a single row or single column of a still image. It is done.

  In the embodiment, after obtaining the image parameter, one of the image parameters is selected and compared with the reference value stored in the data bank (step S206). In step S208, a note signal or rhythm signal can be obtained according to the comparison result. This note signal is like a note signal obtained with an instrument or a mixed note signal from several different instruments. The rhythm signal can be a percussion instrument signal by a percussion instrument such as a drum. In this comparison result, a note signal can be created together with the rhythm signal at the same time. When the image parameter is compared with the reference value, for example, the note signal can be determined by arranging the image parameter between two adjacent reference values. However, the present invention is not limited to this method alone.

  In step S210, a note signal is sent out and can be converted into an audio signal by an audio generation module, for example. Then, this audio signal can be played by an audio amplification device.

  In the embodiment, the process between step S202 and step S208 is repeated several times to obtain several note signals and store them in the memory device (step S212). At S214, the note signal can be composed into music using the music creation module. Then, for example, the sound generation module converts the music into a sound signal, and plays the sound signal using the sound amplifying device (step S216).

  In summary, the present invention can capture a dynamic image and divide it into several still images. Then, the dynamic image information can be converted into audio information by comparing the pixel value or luminance of any still image with a reference value in the data bank. As a result, the effect of entertaining the user can be improved.

  It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the present invention without departing from the spirit or scope of the invention. In view of the above, the present invention covers modifications and variations of the present invention as long as they fall within the scope of the claims and the equivalents.

The accompanying drawings are provided to provide a further understanding of the invention and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.
FIG. 4 is a process diagram that schematically illustrates a process for creating music from image data, in accordance with one embodiment of the present invention. FIG. 6 is a process diagram schematically illustrating a process for creating music with image data, in accordance with another embodiment of the present invention.

Claims (8)

  It consists of capturing dynamic images, analyzing dynamic images to obtain image parameters, comparing multiple reference values with image parameters to obtain at least one audio signal, and sending out the audio signal A method of creating music from image data.   The step of analyzing a dynamic image includes capturing a portion of the dynamic image to obtain a number of still images and obtaining image parameters from any of the still images. The method according to 1.   It consists of capturing a still image, analyzing the still image to obtain a plurality of image parameters, taking one of the image parameters and comparing it with a reference value to obtain at least one audio signal, and sending out the audio signal A method of creating music with image data characterized by.   4. The method of claim 3, wherein analyzing the still image includes analyzing pixel values or luminance from any single row or any single column of the still image.   4. A method according to claim 1 or 3, wherein the image parameters include averaged pixel values or averaged luminance.   4. A method according to claim 1 or 3, further comprising repeating the step of creating a plurality of audio signals, wherein the audio signals are organized into music for performance.   The method according to claim 1 or 3, wherein the audio signal includes a note signal or a rhythm signal.   8. The method of claim 7, wherein the note signal is a signal produced from one instrument or mixed from multiple instruments.