JP2003099435A - Multimedia document preparing method, device and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily edit voice data by utilizing a template having a retrieving key word. SOLUTION: The method uses templates which are models for preparing a multimedia document where document description of the reproduction order of musics, reproducing time, etc., can be performed and uses a theme which is the set of the templates. The templates are described in a multimedia description language and become the multimedia documents by describing reference to voice data. At least one key word is set respectively to the templates in the theme, and the system retrieves the voice data corresponding to a selected theme by using the key word. The multimedia documents are prepared by describing reference to the voice data obtained as a retrieval result in respective templates.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia document creation method, apparatus,
And about the media.

[0002]

2. Description of the Related Art With the widespread use of CDs and the like, the digitization of voice data is progressing, and music editing using an MD capable of digital recording / playback has also been performed. Also,
In recent years, the spread of audio data compression methods such as MP3 has enabled audio data editing using high-quality and highly-compressed digital audio data.

As a result, it has been practiced to store voice data in a memory card and reproduce the voice data with a lightweight portable voice player. In such a situation
The user edits the voice data he wants and MD
Or save it to a memory card and play it on a mobile player or car stereo.

[0004]

However, it is troublesome for the user to actually edit the desired voice data and save it in the MD or the memory card. This is because it takes a lot of work to search for desired voice data from a large amount of voice data owned by the user and store them in the MD or the memory card. Further, conventionally, for example, Japanese Patent Laid-Open No. 2000-0785.
Japanese Patent Laid-Open No. 2000-057, a technique of adding metadata by voice to detect a favorite scene of a moving image as disclosed in Japanese Patent Laid-Open No.
As disclosed in Japanese Patent No. 753, there is a technique capable of defining reproduction of only song data desired by a user from a large amount of song data, but there is no technique for simplifying audio data editing itself.

The present invention has been made in view of the above problems relating to voice data editing, and an object thereof is to facilitate voice data editing by using a template having a search keyword. It also aims at automating audio data editing using audio data retrieval technology and, as a result, creating multimedia documents.

[0006]

In order to achieve the above object, an audio data editing apparatus according to one aspect of the present invention has the following configuration. That is, a voice data editing device using a voice data editing template capable of reproducing and describing voice data, and selecting a template group according to the theme from a theme designated by a user, a template group selecting step, and a template A voice data search step of searching the voice data to be reproduced and described in the template from the keyword set in step 1, and a reproduction data creation step of reproducing and describing the searched voice data in the template and creating the reproduction data. And a media recording step of writing the created reproduction data into a recording medium, the audio data editing device.

[0007]

BEST MODE FOR CARRYING OUT THE INVENTION Here, an embodiment in which voice data editing is actually performed using a personal computer or a dedicated device will be described.

FIG. 1 is a block diagram showing a system configuration in the embodiment. In FIG. 1, a data input / output device 100 is a device that inputs and outputs data. The input device 101 is a device for inputting instructions and data from a user, and includes a keyboard and a pointing device such as a mouse. The storage device 102 is a device that stores binary data and metadata, and a hard disk or the like is usually used. The display device 103 is a device that displays a GUI or an image, and a CRT, a liquid crystal display, or the like is generally used.

Reference numeral 104 denotes a CPU, which is involved in all the processes of the above-described components. The ROM 105 and the RAM 106 are
The CPU 104 is provided with a program, data, a work area and the like necessary for the processing. Further, the control program necessary for the processing of the flowcharts of FIG.
Or stored in the ROM 105. If it is stored in the storage device 102, it is once read into the RAM 106 and then executed.

Regarding the system configuration, there are various components other than those described above, but since they are not the main subject of the present invention, the description thereof will be omitted.

Voice data editing means selecting a plurality of voice data of one's liking from a large amount of voice data,
It means rearranging them in any order and making them playable (creation of multimedia documents). After editing, it is often saved in a recording disk medium or the like. In the audio data editing according to the present invention, it is possible to prepare a template for audio data editing, use the template to automatically create a multimedia document, and save it in a recording medium.

FIG. 2 is a diagram showing an outline of the template. The template is mainly described in a multimedia description language such as SMIL, and reproduction description such as reproduction order of audio data or partial reproduction can be performed. The template 201 has a voice data search keyword 202. Then, the link to the voice data matching the keyword can be described in the template itself.

Specifically, for example, when the template keyword includes the word "morning" and the voice data keyword also includes the same word "morning", it is determined that the voice data matches the template. The link destination is described in the template. As a result, the template 201 becomes the multimedia document 204.
Becomes

In FIG. 3, a plurality of templates are collected,
It is a figure showing how one big theme is being created. As described above, usually, a plurality of templates are often used.

(Embodiment 1) This embodiment describes a voice data search by metadata using an application on a personal computer or a dedicated device, a voice data editing method therefor, and a multimedia document creating method. It also describes how to save the audio data on the recording medium after editing. The term "metadata" means data relating to data, and in this embodiment, it means information such as a keyword for audio data, a composer name, and a singer name.

FIG. 4 is a diagram showing the contents of the metadata added to the audio data. For example, in this embodiment,
The metadata is described in the XML language and includes a "title",
It includes information such as "composer", "lyricist", "singer", "lyrics", "genre", and "keyword". Of course, it goes without saying that you can have more information than this. The metadata is added to the end of the audio data as shown in FIG. Of course, other than this, metadata may be written in the header part, or the metadata may be held as a separate file.

Further, as shown in FIG. 5, it is also possible to divide one audio data file into "prelude", "phrase 1", etc., and give each of them metadata. At this time, the audio data file is divided in units of time, and the divided time is described in each metadata (for example, in the metadata 502, <Ti
me> 0: 20-3: 11 </ Time> etc.).

FIG. 6 is a flow chart for explaining how to actually perform the audio data editing and the multimedia document creating method.

In step S601, the user selects a theme to be edited from a plurality of themes prepared by the application. In S602, the application side sets the storage device 1 of FIG. 1 based on the selected theme.
From 04, the template group as shown in FIG. 3 is read out. S
In 603, the keyword is read from one template in the read template group and stored in the RAM 106.

In step S604, one of the audio data stored in the storage device 104 is read out, the metadata attached to the audio data is read out and stored in the RAM 106. Then, the keyword of the template read in the RAM 106 is compared with the metadata of the audio data.
At this time, the keyword of the template and the content of the lyrics are also compared.

In step S605, in the step of judging the result of comparison in step S604, if the keyword of the template and the metadata of the audio data match, step S60.
If not, the process proceeds to S607.

In step S606, a description for reproduction (a reference to the sound data is described) is written in the template so that the matched sound data can be reproduced. In S607, in the process of determining whether the operation of S604 has been executed for all the audio data in the storage device 104, if the operation has been executed for all the audio data, the process proceeds to S608, and if not executed. For example, new voice data is read, and the process returns to S604.

Step S608 is a process for judging whether or not the incorporation of the audio data into all the templates in the theme has been completed. If the incorporation of the audio data has been completed for all the templates, all the templates are combined into one, which is output as a multimedia document, and the audio data editing is completed. If there is a template for which voice data has not yet been incorporated, the process returns to S603 to read a new template.

FIG. 7 is a flow chart for explaining a method of saving the edited multimedia document and the audio data referred to in the edited multimedia document in a storage medium.

In step S701, a recording medium for storing the edited multimedia document and audio data is selected. The recording medium is, for example, an MD or a memory card. If it is a memory card, also specify its capacity.

In step S702, the capacities of the edited multimedia document and audio data are compared with the capacities of the recording media to determine which is larger. If the volumes of the edited multimedia document and audio data are larger, the process proceeds to S703. If the recording medium has a larger capacity, the process proceeds to S705. S
703 is a multimedia document and audio data,
This is a step of determining whether to divide and save the data in a plurality of storage media. If you want to divide into multiple
Proceed to 705. If the data is not divided and stored in one medium, the process proceeds to S704.

Step S704 is a step of deleting the audio data and the reproduction description thereof for the amount exceeding the capacity of the recording medium. For example, 70M on a 64MB memory card
When the multimedia document B and the voice data are stored, the voice data closest to the difference of 6 MB is detected, and the voice data and the reproduction description in the multimedia document are deleted. In S705,
Write multimedia documents and audio data to recording media.

As described above, the user can edit the audio data only by selecting the theme, and can save the data in a recording medium such as an MD or a memory card. Of course, the singer name may be designated and edited instead of the theme such as "drive". In this embodiment, the voice data is retrieved from the storage device, but the voice data may be retrieved from the Web. Further, by using the metadata added to a part of the voice data as shown in FIG. 5, it is possible to create a digest version in which only one phrase of the music is collected.

(Embodiment 2) In this embodiment, a method for automatically executing audio data editing by simply inserting a recording medium into a personal computer or a dedicated device will be described.

FIG. 8 shows a state in which a theme (word such as “drive”) for selecting a template is stored in a disk medium such as a memory card or MD. Of course, you may store not only the theme but the template itself.

FIG. 9 is a flow chart for explaining a state in which a memory card is actually inserted and audio data is automatically edited and stored in a recording medium.

In step S901, the memory card is inserted into the input / output device 100 shown in FIG. In S902, the capacity of the memory card is checked and the theme in the memory card is read. In S903, a template group according to the theme is read. In S904, as in the first embodiment, the audio data is searched and the description for reproduction is written in the template. S
At 905, the created multimedia document and the audio data referred to therein are written in the memory card.

As described above, by simply inserting the memory card into the personal computer or the dedicated device, the multimedia document and the audio data referred to therein can be automatically stored in the memory card. In this example,
Although a memory card is used, it goes without saying that a disc medium such as an MD may be used.

(Embodiment 3) In this embodiment, as a method for searching voice data, a method using voice recognition or music tone will be described.

FIG. 10 is a flow chart for explaining a voice data search method using voice recognition. Since the parts other than the search method are exactly the same as those in the first embodiment, the description will be simplified.

In S1001, a theme is selected. S1
In 002, a template group according to the theme is read. In S1003, one of the audio data in the storage device 104 is read. In step S1004, the lyrics of the read voice data are voice-recognized and converted into text.

In step S1005, the keyword of the template is compared with the voice-recognized lyrics. In S1006, it is determined whether the results of the comparison in S1005 match. If they match, the process proceeds to S1007. If they do not match, the work ends. S1007
Then, the audio data that matches the template is incorporated into the template to create a multimedia document.

As described above, the voice data can be searched by recognizing the voice data.
It is also possible to search for voice data having a similar tone based on the tone of the voice data.

[0039]

As described above, according to the present invention, it is possible to create a multimedia document by automatically editing voice data after setting a theme or inserting a recording medium. Is. As a result, it is possible to easily perform the audio data editing work that has been conventionally complicated, and to create a multimedia document.

[Brief description of drawings]

FIG. 1 is a block diagram showing a system configuration of a multimedia document creation device according to an embodiment.

FIG. 2 is a schematic diagram of a template used for creating a multimedia document in the embodiment.

FIG. 3 is a schematic diagram of a theme (group of templates) used for creating a multimedia document in the embodiment.

FIG. 4 is a diagram illustrating metadata added to audio data according to Example 1 of the embodiment.

FIG. 5 is a diagram illustrating that metadata is added to the divided audio data according to the first example of the embodiment.

FIG. 6 is a flowchart for explaining audio data editing in the first example of the embodiment.

FIG. 7 is a flowchart for explaining saving to a recording medium in Example 1 of the exemplary embodiment.

FIG. 8 is a diagram showing how a theme is stored in a recording medium according to Example 2 of the embodiment.

FIG. 9 is a flowchart illustrating the audio data editing in the second example of the embodiment.

FIG. 10 is a flow chart diagram explaining audio data editing in Example 3 of the embodiment.

[Explanation of symbols]

100 data input / output device 101 Input device 102 storage device 103 display device 104 CPU 105 ROM 106 RAM

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G10L 15/00 G10L 3/00 551G G11B 27/034 G11B 27/02 K F term (reference) 5B058 CA23 KA04 KA08 KA11 YA16 5B075 ND14 ND16 ND36 NK02 NK04 PP13 PQ05 UU36 UU37 5B082 GA08 5D015 KK02 5D110 AA08 AA19 AA27 BB01 BB20 CA06 CA07 CB04 CB06 CC04 CJ06 DA02 DB05 DC05 DE01 EA12

Claims (31)

[Claims] 1. A method for supporting the creation of a multimedia document to be played back by a music player or the like, which is a template for creating a multimedia document in which document description such as song order and playback time can be described. A template and the process of using a theme, which is a set of templates, a process of becoming a multimedia document by describing a reference to audio data, and a template in a theme has one or more keywords each. It is set, and the system uses the keyword to search the audio data that corresponds to the theme, and in each template, describe the reference to the audio data obtained from the search results, and create a multimedia document. Multimedia doki characterized by creating Instrument creation method. 2. The multimedia document creating method according to claim 1, wherein a plurality of themes are prepared by the system, and the user can select an arbitrary theme from the plurality of themes. 3. The template is a data description language,
Alternatively, the multimedia document creating method according to claim 1, wherein the method is described in an incomplete data description language. 4. The multimedia document creating method according to claim 3, wherein the data description language is described in XML. 5. The multimedia document creation method according to claim 3, wherein the data description language is described in SMIL. 6. The multimedia document creating method according to claim 3, wherein the data description language is described in XHTML. 7. The multimedia document creating method according to claim 3, wherein the data description language is described in HTML. 8. The multimedia document creation method according to claim 3, wherein the data description language is described in SGML. 9. The multimedia document creation method according to claim 1, wherein one or more keywords to be used when searching voice data are set in the template. 10. The template is stored in advance in a recording medium.
How to create the described multimedia document. 11. The multimedia document creating method according to claim 1, wherein the theme is stored in advance in a recording medium. 12. The method for creating a multimedia document according to claim 1, wherein all the steps are automatically performed after inserting the recording medium by using a template and a theme stored in the recording medium. The multimedia document creating method according to claim 1. 13. The multimedia document creation method according to claim 1, wherein metadata is used for voice data search in the voice data search step. 14. The multimedia document creation method according to claim 13, wherein the metadata is described in a data description language. 15. The multimedia document creating method according to claim 14, wherein the data description language is described in XML. 16. The multimedia document creation method according to claim 14, wherein the data description language is described in HTML. 17. The multimedia document creating method according to claim 14, wherein the data description language is described in SGML. 18. The metadata is added to the end of the audio data file.
How to create the described multimedia document. 19. The metadata is audio data,
14. The method of claim 13, wherein the multimedia document is stored in another file. 20. The multimedia document creation method according to claim 13, wherein the metadata is described in a header portion of audio data. 21. The multimedia document creating method according to claim 13, wherein the metadata is also added to divided data obtained by dividing an audio data file by a time unit. 22. The multimedia document creating method according to claim 1, wherein voice recognition is used for voice retrieval in the voice data retrieval step. 23. The multimedia document creating method according to claim 1, wherein the reproduction audio data in the multimedia document output step is audio data. 24. The multimedia document creating method according to claim 1, wherein the reproduction audio data in the multimedia document output step is described in a data description language. 25. The multimedia document creation method according to claim 23, wherein the data description language is described in XML. 26. The multimedia document creating method according to claim 23, wherein the data description language is described in SMIL. 27. The multimedia document creation method according to claim 23, wherein the data description language is described in XHTML. 28. The multimedia document creating method according to claim 23, wherein the data description language is described in HTML. 29. The multimedia document creation method according to claim 23, wherein the data description language is described in SGML. 30. An apparatus using the method for creating a multimedia document according to any one of claims 1 to 29. 31. A storage medium using the multimedia document creation method according to claim 1. Description: