JPH08227297A - Mapping method for sound data and display device - Google Patents

Abstract

PURPOSE: To provide a mapping method for the sound data and a display device in which the sound data are become easy to use for a user of the sound data. CONSTITUTION: This method is constituted of a step extracting an image word capable of showing an image provided in a sound, a step allocating the image word to image axes having the directions showing the strength of the image, a step deciding the values of the sound data in respective axes and a step mapping the sound data to an image space having one or plural image axes.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for handling sound data.

[0002]

2. Description of the Related Art When data is classified, searched and evaluated, a key is usually added to the data. For example, in the case of sales data, a product code is used as a key, and in the case of financial data, an account number is used as a key, and retrieval and analysis are performed. Even in sound data, a search is performed by adding a certain type of key.

[0003] For example, the sound data includes "Musi".
Since names such as "c01" and "tree shade" are added, a search can be performed using this name as a key. Sometimes you can get the desired sound data by searching only the name, but in reality, all sound
You will listen to the data. In addition, if it is music data, "jazz", "rock and roll", "pops",
Classification based on genres such as "sound effects" is possible. Also in this case, in order to obtain the optimum sound data, it is necessary to audition all the sound data belonging to the relevant genre. Then, the sound data can be classified based on a physical quantity such as playing time. However, even if this classification method is adopted, a large amount of sound data will be listened to in order to obtain the sound data suitable for the place of use.

Sound data may also be classified in relation to objects and scenes. If you classify the sound data according to the relationship with the object, you will find "sound of waves", "voice of birds",
You can think of categories such as "car sounds". In addition, in relation to the scene, it can be classified into categories such as "the noise of the city", "fits the scenery of the family", "fits the scenery of the mountains when dusk approaches".

[0005]

The sound data is
It is widely used for BGM in dramas and movies, sound effects for game software, and for presentations at various events. Therefore, it is necessary to classify the sound data so that appropriate sound data can be appropriately used.

However, in the conventional classification method, the sound data can be searched only by the key determined by the classifier, and the classifier's standard is imposed on the user of the sound data. Therefore, there is a problem in that the user of sound data may not be able to search even one piece of data and thus lack convenience. A first object of the present invention is to provide a method for classifying sound data so that it is easy for a user of the sound data to use.

[0007] Further, "a quiet song that fits the landscape of a family and a quiet song that fits the landscape of mountains near dusk" are similar songs and should be classified into the same category, but in the past, In many cases, they were classified into different categories. A second object of the present invention is to provide a classification criterion suitable for sound data.

Further, in the conventional classification method based on the relation with an object or a scene, it is necessary to specify a specific object or scene, so that a new sound that does not belong to any category is added.
There was the complexity of having to create a new category each time the data emerged. A third object of the invention is to provide a method of mapping all sound data within a fixed framework.

Further, when selecting a desired sound using the sound data search result, it is necessary to listen to all the sounds in the conventionally classified categories, so that the number of sound data is large, This was especially inconvenient when the sound output time was long. A fourth object of the present invention is to provide a method of giving different evaluation criteria to sound data in the same category.

By the way, the user may request "a song with a little more uptempo" or "a song with a little more dynamic" when searching for sound data. However, conventionally, even if a sound data close to the target sound data is found, a secondary search based on the sound data cannot be performed. A fifth object of the present invention is to provide a sound data display device capable of expressing a "slightly more uptempo song" or a "slightly more dynamic song" as compared with certain sound data.

Further, the spread of multimedia computers has increased the number of users who are unfamiliar with presentations and title development. For such users, guidelines for using sound materials are provided,
You cannot know the actual sound just by reading the guidelines. A sixth object of the present invention is to provide a sound data display device having an interface for facilitating sound understanding, especially for a beginner user who searches for sound data by referring to guidelines. is there.

[0012]

According to the invention, the above-mentioned object is achieved by the means described in the claims.

That is, the invention of claim 1 comprises the steps of extracting an image word that can represent an image of a sound, allocating the image word to an image axis having a direction representing the strength of the image, and the sound thereof. A sound data mapping method comprising the steps of determining the value of the sound data on each image axis based on the image of the, and mapping the sound data to an image space having one or more image axes. is there.

In the invention of claim 2, the extracting step is a sound data mapping method for extracting color as an image word, and in the invention of claim 3, the allocating step preliminarily defines the image word. A sound data mapping method for classifying and assigning one image axis to a similar image word with respect to a sound image, wherein the determining step uses the listener test result for the sound data. This is a sound data mapping method that determines the value of data.

According to a fifth aspect of the present invention, there is provided a device for displaying the sound data mapped in the image space by the method, wherein the means for selecting a desired image word and the image axis corresponding to the image word. And a means for displaying sound data with the coordinate axis as the coordinate axis.

According to a sixth aspect of the present invention, means for storing sound data having a value on the image axis and each sound data are arranged in an image space formed by one or more image axes. However, the sound data display device has means for displaying the sound data and means for receiving the designation of the symbol and listening to the sound data.

Further, the invention of claim 7 assigns an area of the image axis or an area of the image space to the search key of the sound data, and receives the designation of the search key, and the sound included in the area or the area. It is a sound data display device provided with means for marking data symbols.

Further, the invention of claim 8 includes means for presenting an explanation of the use of a sound material, and means for receiving a designation of a predetermined term appearing in the explanation and extracting sound data related to the term. , A means for displaying the extracted sound data in an image space, and a sound data display device.

According to a ninth aspect of the present invention, with respect to a sound data search key, a means for displaying a sound explanation corresponding to a predetermined combination and a designation of the combination are received, and the corresponding sound data is retrieved. It is a display device for sound data, which is provided with a means for searching.

[0020]

According to the first aspect of the present invention, the sound data is mapped on the image space having the image word as the axis, and the sound and the image are linked to perform the mapping of the sound data.

According to the second aspect of the present invention, the sound data is easily mapped using the image space as a medium, and the sound data is mapped by associating a color that is familiar to anyone with the sound.

According to the third aspect of the present invention, the sound data is mapped in advance so that the image words of the same kind are set as the same classification category with respect to the image of the sound so that the image axis capable of accurately expressing the property of the sound data is determined. It

According to the invention of claim 4, since the listener test result is used without imposing the classifier's criterion on the user of the sound data, the sound data is mapped in a format very close to that of the sound data user. Is done.

According to the fifth aspect of the invention, the sound data mapped in the image space is displayed along the image axis selected by the user of the sound data.

According to the sixth aspect of the invention, a scale value indicating the position on the image axis is given to the sound data. The sound data is arranged in the image space according to this scale value. Although the sound data is displayed by symbols, when any symbol is designated by using a pointing device or the like, the sound data corresponding to the symbol is output as a sound.

According to the seventh aspect of the present invention, the search by the search key is performed based on the area or region of the search key in the image space. At the time of search, by referring to the scale value of the sound data of the search target,
It may be determined whether or not the scale value is included in the search key area or region, or the sound data symbol is superposed on the search key area or region as it is in the image space. It may be determined whether or not it is included in the area or the area. Here, the area of the search key is not limited to a geometrical figure such as an ellipse or a quadrangle, and a cloud shape or the like may be considered. Also, AND or OR conditions may be adopted for a plurality of search keys. The sound data hit by the search is marked by means such as color coding or blinking.

According to the eighth aspect of the invention, the specific sound data is extracted from the description of the use of the sound material. If this sound data is expressed in the image space by a predetermined interface, the arrangement manner of the individual sound data in the image space can be visually understood, so that the image space is applied to the secondary search. Can be utilized.

In the ninth aspect of the present invention, the user is provided with a textual note and other explanations as to what sound data is extracted by the search in combination with the search keys. You can search for the corresponding sound data by specifying the combination of search keys that seems to be the most suitable. Furthermore, it is possible to map hit sound data to the image space.

[0029]

FIG. 1 is a diagram showing an embodiment of the present invention. In the sound data mapping method shown in FIG. 1, first, in order to capture a sound as an image,
An image word is extracted (S10). Specifically "red"
“Bright”, “happy” and “dark” are illustrated as image words.

Next, each image word is associated with an axis in the image space (S11). Here, for the image of sound, one axis is assigned to the similar image word. For example, since “bright” and “fun” can be regarded as the same type, the same image axis Y is assigned. Also,
“Bright” and “dark” can be regarded as being similar in general concept, but since they are completely different concepts in terms of sound image, the image axes are individually assigned.

Then, a listener test is conducted to determine the value of the sound data on each image axis X, Y, Z (S12). For example, after collecting 100 testers and listening to the sound data, the number of testers who felt that the sound data was “red” can be determined as the value on the image axis X. Here, the sound data is not limited to music data, that is, melody data, and naturally includes tone color data such as the tone color of a whistle and the tone color of a string.

When the values on the respective image axes X, Y and Z are determined, the sound data is mapped on the image space (S13). For example, the value of the image axis X of “red” is “60”, and the value of the image axis Y of “bright” is “1”.
If it is 0'and the value of the "dark" image axis Z is '12', the sound data can be mapped to the point (60, 10, 12) on the xyz space coordinates.

Table 1 exemplifies the classified image words.
Here, 19 representative image words suitable for expressing sound data are classified into five categories from a large number of image words, and each is associated with the first to fifth axes. For example, “fun”, “pleasant”, “light”
"Bright" is similar and is assigned to the first axis.

[0034]

[Table 1]

The classification is performed from the viewpoint of the image of the sound, not according to the meaning and contents listed in a general Japanese dictionary. Therefore, it is "bright" in the Japanese dictionary.
Although the opposite word of "is" is described as "dark", from the viewpoint of the image of sound, the opposite word of "bright" does not necessarily become "dark".

By the way, the sound data can be mapped in a five-dimensional space using these five axes, but in the application system, all of them may be used, or a part of the five axes may be used. You may use. In particular, when displaying on a screen, it is easier to see if converted to a low-dimensional space.

FIG. 2 is a diagram showing a display example of each mapped sound data. FIG. 2 is a low-order image space where the second axis in Table 1 is the X-axis and the fourth axis is the Y-axis, as a result of the user selecting two image words “friendly” and “clean”. The sound data is displayed above. Thus, if the image space is two-dimensional, the mapped sound data can be easily visualized.

FIG. 3 shows an example of a screen in which music data symbols (hereinafter, also referred to as buttons) are displayed in a two-dimensional space using two scales of "bright" and "friendly".
On this screen, the user can preview the song data corresponding to the button by designating the button displayed in the two-dimensional space.

In the figure, each button indicated by reference numeral (a) represents one piece of music data. Clicking this button with a mouse etc. changes its color,
The title of the song corresponding to the clicked button is displayed in the frame indicated by the symbol (b), and the performance starts. The user can send commands such as stop, play, pause, rewind, and advance to the display device from the control panel indicated by the reference numeral (c). If the user wants the designated song data as a result of the audition, the user can copy the song data to the user disc by clicking the "SAVEAS" button. By the way,
Is an example in which the first axis in Table 1 is the X axis and the second axis is the Y axis. In addition, "dynamic", "cool",
You can also choose an axis such as "heavy".

The operation of the above display device will be described with reference to the flowchart of FIG. As shown in the figure, after the display device displays the map screen (S40), the display device waits for input. Here, when there is a click input from the user (S41), the display device acquires the coordinates (S4).
2). Then, the pointer indicating the music data corresponding to the acquired coordinates is traced (S43) to obtain the music data corresponding to the clicked button. Then, the music data is D / A converted to output a sound (S44). When the user likes the song, the song data is copied in response to an instruction from the user (S45). When receiving an instruction to change the coordinate space based on the image axis (S46), a predetermined map screen is displayed (S40).

The functions of the database management system can be used in the processing (S42, 43, 44) after the step of acquiring the button coordinates in FIG. The music data stored in the database can be defined by the structure shown in FIG. 5, for example. The illustrated music data has additional data including a music title, a scale value for each image axis, and a pointer to actual data. The position where this music data is displayed as a button on the screen can be determined by referring to the corresponding scale value.

Next, an interface for searching music data using a key will be described. Here, the type of music data, the target who receives the music data,
Alternatively, a search key is given for the scene where the music data is used. FIG. 6 is a diagram showing an example of the key setting screen. From the setting screen shown in the figure, the user can select four types of keys of "Academic system", "Seminar system", "Report system", and "Promotion system". Also, three types of keys can be selected as the target person: 'top (president or executive)', 'company (businessman)', and'general (unspecified person) '. In addition, as the scene, three kinds of keys of “opening”, “text”, and “ending” can be selected.

Here, it is assumed that the AND conditions of three keys of "promotion system", "company", and "text" are adopted. Then, for example, as shown in FIG.
The button corresponding to the hit song data is displayed on the map screen in different colors, and the name of the music data and the playing time are displayed in the window on the right side of the map screen. Here, it is considered that the user can obtain desired data with high probability by clicking the buttons of different colors. Even if the hit music data is "slightly different", you can find the optimum music data by specifying a button around the button with a different color and performing a secondary search.

Various technical means can be applied to the music data search method using the search key. For example, a method of searching and extracting music data by assigning an area for the scale value to the search key can be considered. Specifically, if the area of the light axis is assigned to "0 to ∞" for the search key "promotion system", music data whose brightness scale value is a negative number is not a search candidate. This search process can be performed quickly and easily by referring to the additional data shown in FIG.

As another search method, a method of assigning an area on the map screen to the search key can be considered. In this case, the button that overlaps the allocation area can be extracted as it is. FIG. 8 is an explanatory diagram of the allocation area. In FIG. 8, the area A is the search key X and the search key Y is the search key Y.
Is assigned to the area B, and the search key Z is assigned to the area C. In this case, when the OR condition of the search keys X, Y, Z is adopted, the button overlapping any one of the areas A, B, C is displayed in a different color.

FIG. 9 shows an example of a guidebook display screen. The display device can provide a guidebook as shown to a user who is unfamiliar with title creation. In the figure, [3. How to use sound] is presented. In the [(1) Music] column, [Characteristics], [
Explanations are given on "presenting scenes", "basic design policy", "presentation type and music", and other items. Then, the sentence includes a term corresponding to the search key of the music data. If music data is linked to this term, it is possible to search music data from the guidebook. Then, by displaying the hit music data on the map screen, it is possible to listen to the music data close to the hit music data by secondary search.

FIG. 10 is a part of the guidebook explaining how to select appropriate music according to the type of presentation. This guidebook is explained in the form of a table, and the table is divided into some blocks to indicate the type of music data. When any block in the table is clicked on with a mouse or the like, the corresponding music data is searched. This search may be performed by ANDing the search key for the type arranged in the vertical direction of the table and the search key for the target person arranged in the horizontal direction of the table.

When the search is completed, as shown in FIG.
A new window will open with a control panel for playing the hit music data. The user can specify the name of the music data and listen to the music here, but by clicking the "MAP display" button in the upper right of the control panel, the map screen as shown in FIG. 12 is displayed. You can also let it. Even on this map screen, the hit music data is displayed in different colors.

[0049]

As described above, according to the first aspect of the invention, the sound data can be mapped with the image word as a reference. According to the second aspect of the invention, it is possible to perform mapping in which the sound data and the color are associated with each other.
According to the third aspect of the invention, similar image words can be assigned to the same image axis. According to the invention of claim 4,
You can make a convenient mapping for users of sound data. In the invention of claim 5, the sound data mapped in a desired format can be presented to the user of the sound data.

Further, in the invention of claim 6, the sound data can be auditioned by designating the symbol, and in the invention of claim 7, the sound data can be searched using the image space, and the invention of claim 8 or 9. Then, you can display the sound data searched based on the text description such as a guidebook on the map screen to perform a secondary search.

As described above, according to the present invention, it is possible to numerically express the image of music which has been considered impossible in the past, and it is possible to express "the expression on the user side and the expression on the system side when searching for a sound". "Mismatch" is resolved. And
Unique search methods such as "a little lighter song" and "sound effect when a button is pressed" are also possible. Also, for users who are unfamiliar with title development, sound data can be searched by a sensory expression such as "a song suitable for the opening of a presentation for executives".

By using the present invention in a search system, a composition support system, and a music evaluation system, the art of music can be treated in an engineering manner. From the above, it can be said that the present invention is a very important technique as the basis of a system for supporting music and composition which will become easier and easier.

[Brief description of drawings]

FIG. 1 is a diagram showing an embodiment of the present invention.

FIG. 2 is a diagram showing a display example of mapped sound data.

FIG. 3 is a diagram showing an example of a screen of a display device according to the present invention.

FIG. 4 is a flowchart illustrating an operation example of a display device.

FIG. 5 is a diagram showing an example of a data structure of music data.

FIG. 6 is a diagram showing an example of a screen of a display device according to the present invention.

FIG. 7 is a diagram showing a screen example of a display device according to the present invention.

FIG. 8 is a diagram illustrating an area assigned to a search key.

FIG. 9 is a diagram showing an example of a screen of a display device according to the present invention.

FIG. 10 is a diagram showing an example of a screen of the display device according to the present invention.

FIG. 11 is a diagram showing an example of a screen of the display device according to the present invention.

FIG. 12 is a diagram showing an example of a screen of a display device according to the present invention.

─────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] September 12, 1995

[Procedure Amendment 1]

[Document name to be corrected] Drawing

[Name of item to be corrected] Figure 3

[Correction method] Change

[Correction content]

[Figure 3]

[Procedure Amendment 2]

[Document name to be corrected] Drawing

[Name of item to be corrected] Figure 6

[Correction method] Change

[Correction content]

[Figure 6]

[Procedure 3]

[Document name to be corrected] Drawing

[Name of item to be corrected] Figure 7

[Correction method] Change

[Correction content]

[Figure 7]

[Procedure amendment 4]

[Document name to be corrected] Drawing

[Correction target item name] Figure 9

[Correction method] Change

[Correction content]

[Figure 9]

[Procedure Amendment 5]

[Document name to be corrected] Drawing

[Name of item to be corrected] Fig. 10

[Correction method] Change

[Correction content]

[Figure 10]

[Procedure correction 6]

[Document name to be corrected] Drawing

[Name of item to be corrected] Fig. 11

[Correction method] Change

[Correction content]

FIG. 11

[Procedure Amendment 7]

[Document name to be corrected] Drawing

[Name of item to be corrected] Fig. 12

[Correction method] Change

[Correction content]

[Fig. 12]

Claims (9)

[Claims] 1. A step of extracting an image word capable of representing an image of a sound, a step of allocating the image word to an image axis having a direction representing the strength of the image, and an image having the sound, A sound data mapping method comprising: determining a value of sound data on each image axis; and mapping sound data to an image space having one or more image axes. 2. The sound data mapping method according to claim 1, wherein the extracting step extracts a color as an image word. 3. The sound data mapping method according to claim 1, wherein said allocating step classifies the image words in advance and allocates one image axis to the image words of the same kind with respect to the image of the sound. 4. The method for mapping sound data according to claim 1, wherein the determining step determines the value of the sound data using a listener test result. 5. An apparatus for displaying sound data mapped to an image space by the method, comprising means for selecting a desired image word, and an image axis corresponding to the image word as coordinate axes.
A device for displaying sound data, comprising: means for displaying sound data. 6. A means for storing sound data having a value on an image axis, and each sound data is arranged in an image space formed by one or a plurality of image axes and displayed as a symbol. A sound data display device comprising means and means for receiving a designation of a symbol and listening to the sound data. 7. A search key for sound data,
7. A sound data display device according to claim 6, further comprising means for allocating an area of the image axis or an area of the image space and for receiving a designation of a search key to mark a symbol of sound data included in the area or area. . 8. A means for presenting an explanation of the use of a sound material, a means for receiving a designation of a predetermined term appearing in the explanation, extracting sound data related to the term, and extracting the extracted sound data. 7. A sound data display device as claimed in claim 6, comprising means for displaying in image space. 9. A search key for sound data,
8. The sound data display device according to claim 7, further comprising: a unit for displaying a sound description corresponding to a predetermined combination; and a unit for receiving the designated combination and searching for the corresponding sound data.