JPH08160989A - Sound data link editing method - Google Patents

Abstract

PURPOSE: To regard sound data as a link source node and to sets a link for part of a medium where the time of the data or the data are recorded at the time of link setting. CONSTITUTION: In the link data setting process, the sound data for setting link data are reproduced and test data having the same contents with the sound data are displayed; and link setting candidate data are displayed with an indication of an editor to the text data, a link is set by selecting candidate data by the editor, and link tables 801-806 are generated. In a link data display process, the sound data are reproduced and the text data having the same contents with the sound data are displayed; and linked data candidates are displayed with the indication of the editor to the text data, candidate data are selected by the editor, and the selected data are displayed.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a presentation system using multimedia information, and more particularly to data link editing between sound data and other data to be linked.

[0002]

2. Description of the Related Art As a method for displaying or outputting multimedia information to an output device in response to a user's request, see Nikkei Computer Supplement, "Software, User Interface in the Multimedia Age" (1989. 7.28), p.
There are 63 hypertexts. Hypertext refers to a method of structuring information and utilizing it. Computers usually treat documents as data files. It's just a list of sequential data. However, when read by humans, words or sentences are used as a unit. Documents and books also have boundaries such as headings, chapters, paragraphs, and notes. And without these divisions or structures, the meaning is meaningless. Hypertext defines relationships based on structure and meaning, and handles those relationships. In other words, hypertext is composed of two points: (1) structured document (2) structure and relation access program. The hypertext program also includes the following functions. (A) Document editing: Define and describe nodes that are appropriately separated documents. (B) Link management: Define links that are relationships between nodes. (C) Tour: Follow links to view documents.

As a computer system adopting the hypertext as described above, there is an Apple hyper card. This system provides a "button" to a user as an element that realizes a tour that displays other linked nodes from at least one node.
The “button” is used to register the action that occurs after clicking it with the mouse, and is arranged and displayed in a transparent or visible state on the output device. That is, the “button” plays a role of an anchor indicating a mark indicating a reference point and a reference point, which is a division of nodes. By clicking the "button" with the mouse, the user refers to the link defined in the "button" from the currently displayed node, performs a tour, and displays the linked node.

[0004]

In the case of the above-mentioned hyper card, (1) if the node related by the link is text data or image data, the "button" is specified by specifying the area to which the link is set with the mouse. Can be set. However, when the node is sound data, it becomes necessary to set the "button" not for the area but for the time or a part of the medium on which the sound data is recorded. Not not. (2) When text data is used as a link source node, a "button" is set for a word or phrase having a link so that the user can recognize that the link is set. Even when the image data is used as the link source node, the user is made aware that the link is set by setting a "button" in the image area having the link.
However, when the sound data is used as the node of the link source, it does not provide a means for making the user recognize that the link is set. (3) The setting of the button that causes the link operation on the hyper card must be set at the time of building the application, and therefore the display order is fixed. With the means for calling the link operation by such a button, it is not possible to set a link and display a link destination node for data such as sound data that requires time consideration. There are three problems.

It is an object of the present invention to provide a means for setting a sound data as a link source node and setting a link for a time of the sound data or a part of a medium on which the sound data is recorded. It is in. Another object of the present invention is to provide a means for indicating to a user that a link has been set to sound data when the linked sound data is played.
Another object of the present invention is to provide means for realizing link setting and link destination node display without depending on time, even with time-related data such as sound data.

[0006]

To achieve the above object, the present invention provides a presentation including a display device, an input device, a central processing unit, a memory, a sound board, a speaker, and an external storage device. A sound data link editing method in a system, wherein the external storage device includes at least sound data, image data, material data composed of text data, and text data corresponding to the sound data and having exactly the same contents, A data table consisting of a sound data name and a text data name corresponding to the reproduction start / end time is stored in advance, the sound data is reproduced and the corresponding text data is displayed on the display device, and the displayed text data is displayed. On the other hand, when the link setting is input by the editor's instruction, The input time of the link setting input falls between the playback time and the end time when the input time of the setting input is measured and the linked material data candidates are displayed and the displayed material data candidate is selected. A link table is created based on the data in the data table corresponding to the sound data and the selected material data name. Furthermore, the created link table is stored in advance in the external storage device, sound data is reproduced, and corresponding text data is displayed on the display device, and the displayed text data is instructed by an editor. When the link destination data display command is input, measure the input time of the link destination data display command,
The link table is referred to based on the measured input time, a link destination data candidate list is displayed on the display device,
When the displayed link destination data candidate is selected, the selected link destination data is output.

A sound data link editing method in a presentation system comprising a display device, an input device, a central processing unit, a memory, a sound board, a speaker, and an external storage device. Is at least sound data, image data, material data consisting of text data, text data corresponding to the sound data and having exactly the same contents, and text data corresponding to the sound data name and its reproduction start / end time. A data table consisting of names is stored in advance, sound data is played back, a link setting command issuance button is displayed on the display device, and a link setting is made by the editor instructing the link setting command issuance button during sound data playback. Input of the link setting input when input When the displayed material data candidate is selected, the input time of the link setting input corresponds to the sound data that falls between the playback time and the end time. A link table is created based on the data in the data table and the selected material data name. Furthermore, the link table created in advance is stored in the external storage device, sound data is reproduced, and a link data display command issue button is displayed on the display device.
When a link destination data display command is input by the editor designating the link destination data display command issue button during sound data reproduction, the input time of the link destination data display command is measured, and the measured input time Based on the above, the link table is referred to, the link destination data candidate list is displayed on the display device, and when the displayed link destination data candidate is selected, the selected link destination data is output.

Further, there is provided a sound data link editing method in a presentation system comprising a display device, an input device, a central processing unit, a memory, a sound board, a speaker and an external storage device, wherein the external storage device is provided. Stores at least sound data, image data, and text data in advance, reproduces the sound data, displays a continuous waveform of the sound data on the display device, and displays the continuous sound data. When the link setting input is made by the editor instructing an arbitrary time point of the waveform, the amplitude of the waveform at the instructed time point is changed to an amplitude exceeding the link amplitude boundary value, and the input time of the link setting input is changed. While measuring, display the linked material data candidates, and select the displayed material data candidate. And time, so as to create a linked table by material data name which the amplitude is selected as the sound data name has been changed. Furthermore, the created link table is stored in advance in the external storage device, the sound data with the amplitude changed is reproduced, and the changed amplitude portion of the sound data is detected,
The link table is referred to based on the amplitude portion, the link destination data candidate list is displayed on the display device, and when the displayed link destination data candidate is selected, the selected link destination data is output. ing.

[0009]

According to the present invention, the sound data link editing system described above reproduces the sound data for setting the link data and displays the text data having the same content as the sound data at the time of the link data setting processing, and the text data corresponding to the text data is displayed. According to the editor's instruction, the link setting candidate data can be displayed and selected to perform the link setting, and the link can be easily set to the sound data. Also, during the link data display process,
Playing sound data and displaying text data with the same content as that sound data, and displaying linked data candidates, selecting candidates, and displaying selected data according to the editor's instructions for the text data. The data linked to the sound data can be easily displayed. Also, during the link data setting process, the sound data that sets the link data is played,
The link setting command issue button is displayed on the display device, and the editor can instruct the button to display the link setting candidate data and select it to perform the link setting, which facilitates linking to the sound data. Can be set to. Also, during the link data display process, the sound data that sets the link data is played, a link destination data display command issuance button is displayed on the display device, and the editor instructs the button to display the data candidates to be linked. , Can select the candidate, display the selected data, and can easily display the data linked to the sound data. Also, during the link data setting process, the sound data that sets the link data is played,
The sound data waveform is displayed on the display device, and the editor designates an arbitrary time point of the waveform to change the amplitude at that time point to display the link setting candidate data, select it, and perform the link setting. The sound data can be linked easily. Also, during the link data display processing, the sound data that sets the link data is played back, and when a changed amplitude is detected in the sound data, candidates for data to be linked, selection of candidates, and display of selected data may be displayed. The data linked to the sound data can be easily displayed. As a result, setting of a link and display of a link destination node can be realized without depending on time.

[0010]

Embodiments of the present invention will now be described in detail with reference to the drawings. FIG. 1 is a system configuration diagram of a sound data link editing system. In FIG. 1, 101 is a display device, 102 is a central processing unit, 103 is a sound board that controls the reproduction of sound data, 104 is a memory that contains a program that controls the sound data link editing system, and 105 is an input device that includes a pointing device. , 106 are speakers for outputting sound data, 10
Reference numeral 7 is an external storage device.

FIG. 2 is a detailed view of the memory 104 and the external storage device 107 shown in FIG. In FIG. 2, the external storage device 107 has a sound correspondence text data 201.
And a link data table 202 and material data 203. The sound-corresponding text data 201 is text data having exactly the same content as the sound data, and is displayed in synchronization with the sound data reproduction. The link data table 202 is a data table that defines the relationship between the sound data and the linked data. Material data 203
Is data used for link editing, and is composed of at least image data, sound data, and text data. The memory 104 is a link data setting process 204
And the program of the link data display processing 205 are stored. The link data setting process 204 is performed by the sound data 203 and the sound-corresponding text data 20.
The link data table 202 is processed by using
Is output. On the other hand, the link data display processing 205 performs processing using the sound-corresponding text data 201, the link data table 202, and the material data 203, and outputs the result to the display device 101.

FIG. 3 is a data table defining the sound data corresponding text data 201 and the sound data shown in FIG. In FIG. 3, 301 is a file name for storing sound data, 302 is a time when the reproduction of the sound data is started, 303 is a time when the reproduction of the sound data is ended, and 304 is text data corresponding to the sound data. Indicates the file name in which is stored. The data table shown in FIG. 3 associates sound data with sound-corresponding text data. FIG. 4 shows the sound-corresponding text data described in FIG. Reference numeral 401 represents a file name in which the text data corresponding to sound is stored, and 402 represents the content of the stored text data.

First, the link setting process 204 will be described.

FIG. 5 is a processing flowchart of the link data setting processing 204 shown in FIG. In FIG. 5, first, the sound data for setting the link data is reproduced (step 5001), and while the sound data is reproduced (step 5002), the text data corresponding to the sound data is output to the display device (step). 5003). Further, while the text data corresponding to the sound is displayed (step 5004), the link setting command of the editor is issued (clicking the displayed text data with the mouse), and when the command is accepted (step 5005), the sound data is displayed. And the output of the text data corresponding to the sound are temporarily stopped, that is, the sound is put into the pause state, the movement of the text data is stopped (step 5006), and the text data corresponding to the sound for which the link setting command is accepted is extracted (step 5007). Change the display color of the text data (step 50)
08). Next, the editor is made to specify the material data of the link destination (which will be described later with reference to FIG. 7) (step 5009), and a link table is created using the specified material data of the link destination and the reproduction start time of the sound data for which the link setting command is accepted. It is created (step 5010) and the output of sound data and text data is restarted (step 5011).

FIG. 6 shows an example of a screen displayed to the editor. In FIG. 6, reference numeral 601 denotes sound-corresponding text data displayed on the display device 101, 602 denotes a pointing device for selecting sound-corresponding text data for setting a link, and 603 denotes sound data provided by the speaker 106. FIG. 7 is a window for displaying a list of linkable material data when the editor selects the link destination data from the material data. In FIG. 7, reference numeral 701 denotes a display area for a file name in which the sound data of the link source is stored, and 702 denotes a display area for the contents of the sound data.
Reference numeral 03 denotes an area for displaying a list of linkable material data and a user's link setting instruction, 704 a button for issuing a link destination data selection instruction, and 705 a button for issuing a list display window display end instruction. . The material data list display area 703 displays at least the file name storing the material data and the type of the data. When the editor selects the button 705 for issuing the display end command of the list display window, only the process of ending the display of the list display window is performed. When the editor selects the button 704 for issuing a link destination data selection command, a link table creation process for associating the link destination data selected by the user in 703 with the sound data is performed.

FIG. 8 is a link table for managing the relationship between sound data and link destination data. 801 is a sound data reproduction start time, 802 is a sound data reproduction end time, 803 is a file name storing the sound data, and 804 is a file storing sound corresponding text data corresponding to the sound data indicated by 803. Reference numeral 805 indicates the number of link destination data set in the sound data indicated by 803, and 806 indicates a file name storing the same number of link destination data as the number of link destination data indicated by 805.

Next, the link data display process will be described. FIG. 9 is a flowchart of the process performed in the link data display process 205 described in FIG. In FIG. 9, the sound data is reproduced (step 9001), and while the sound data is reproduced (step 9002),
The sound corresponding text data corresponding to the sound data being reproduced is displayed (step 9003). When the user issues a link destination data display command (clicks the displayed text data with the mouse) by selecting the displayed sound-compatible text data using a pointing device (step 9004), the sound data is reproduced. The display of the text data corresponding to the sound is temporarily stopped, that is, the sound is put in the pause state, the movement of the text data is stopped (step 9005), and the time when the display command is accepted is measured (step 900).
6). Next, a link destination data candidate list is displayed from the measured time and the link table (step 9007), and the user is made to select the link destination data to be displayed. When the user's instruction to select the link destination data is accepted (step 9008), the selected link destination data is displayed on the display device (step 9009), and the reproduction of the sound data and the display of the sound-corresponding text data are resumed (step 9009). 9010). When the display command is accepted, the clock stops once, and when the display of the linked data ends, the clock restarts.

FIG. 10 is an example of a screen displaying a link destination data candidate list in a menu format when the user issues a link destination data display command. In this example, 1001 indicates a sound corresponding text data, and 1002 indicates a pointing device which issues a link destination data display command by selecting the sound corresponding text data.
Reference numeral 003 denotes a menu bar that is displayed when a link destination data display command is issued and lists the file names storing the link destination data set in the sound data.
Reference numeral 004 indicates sound data. When the user selects the link destination data listed in the menu bar, the corresponding link destination data is displayed.

11 and 12 are screen examples different from the screen example of FIG. 10, and are screens when a window for displaying a list of linked data candidate lists is displayed when the user issues a linked data display command. Here is an example. In FIG. 11, 1101 indicates sound-corresponding text data, 1102 indicates a pointing device which issues a link destination data display command by selecting sound-corresponding text data, and 1103 indicates sound data. When the user selects the sound-compatible text data 1101 with the pointing device 1102, the link destination data candidate list list display window shown in FIG. 12 is displayed. FIG. 12 is the link destination data candidate list list display window described in FIG. 11, and is displayed on the screen of FIG.
In FIG. 12, reference numeral 1201 denotes a display area of a file name storing sound data for which a user's link destination data display command is received, and 1202 a display of a file name storing sound corresponding text data corresponding to the sound data displayed at 1201. Area 1203 is at least 1
An area for receiving a file name storing the link destination data set in the sound data displayed in 201 and the type of the data and a link destination data display command is set to 120
Reference numeral 4 denotes a button for confirming the display command received by the link destination data selected by the user in 1203 and displaying the link destination data, and 1205 a button for canceling the display of the link destination data candidate list list display window. When the output (display) of the linked data is completed, a series of next data, in this case, m0103. The next data of msc is m0402. msc is output.

Next, a second embodiment will be described with reference to FIGS. The second embodiment is an example in which text data corresponding to sound data is not displayed in the link data setting process and the link data display process. First, the link data setting process will be described. FIG. 13 is a flowchart of a process of setting link data in sound data based on the reproduction start time of sound data without using sound-compatible text data. In FIG. 13, the sound data is reproduced (step 1301), and while the sound data is reproduced (step 1302), the editor issues a link setting command (see FIG. 14 and its description).
When it is accepted (step 1303), the reproduction of the sound data is temporarily stopped (step 1304), and the time at which the editor's link setting command is accepted is measured (step 1305). The sound data for which the link setting command is accepted is determined based on this measurement result. Next, the sound corresponding text data corresponding to the sound data for which the editor's link setting command is received is extracted (step 130).
6) The display color of the text data is changed (step 1307). These steps 1306 and 1307 are performed as internal processing, and no display is performed on the display device. Further, the link destination data is selected from the material data (step 1308). This selection is similar to that shown in FIG. 7 and its description above. A link table is created from the reproduction start time of the sound data and the material data selected in step 1308 (step 1
309). This creation is similar to that shown in FIG. 8 and its description.

FIG. 14 shows an example of a screen display when the link data is set in the sound data without displaying the text data corresponding to the sound. Reference numeral 1401 denotes a link setting command issue button for the editor to issue a link setting command, and 1402 denotes sound data.

Next, the link data display process will be described. FIG. 15 is a flowchart of a process for causing the user to issue a display instruction of the link destination data set in the sound data without displaying the sound-corresponding text data and displaying the corresponding link destination data. In FIG. 15, first, the sound data is reproduced (step 1
501), while the sound data is being reproduced (step 1502), when the user issues a link destination data display command (see FIG. 16 and its description) and accepts it (step 1503), the sound data is temporarily reproduced. The processing is stopped (step 1504), and the time when the display command is accepted is measured (step 1505). Next, the link destination data candidate list is displayed from the link table based on the measured time (step 1506), and when the user's link destination data selection command is accepted (step 1507), the link destination data selected by the user is displayed. (Step 150
8). Then, the reproduction of the temporarily stopped sound data is restarted (step 1509). The method of displaying the linked data candidate list is the same as that described in FIG.

FIG. 16 shows an example of a display screen in which the user issues a display command for the link destination data set in the sound data while the sound-corresponding text data is not displayed. Reference numeral 1601 denotes a link destination data display instruction issue button for the user to issue a link destination data display instruction.
02 indicates sound data. When the user selects the link destination data display command issue button, a list of the link destination data set in the sound data being reproduced at that time is displayed.

Next, as a third embodiment, an embodiment in which the link data setting for the sound data is performed by using the amplitude of the sound data will be described. The system configuration for setting the link data for the sound data using the amplitude of the sound data is the same as the system configuration shown in FIG. FIG. 17 is a detailed diagram of a memory and an external storage device necessary for setting the link data for the sound data by using the amplitude of the sound data. In FIG. 17, the external storage device 107 includes a link data table 1701 and material data 1702. The memory 104 stores a program for link data setting processing 1703 and a program for link data display processing 1704. In the link data setting process 1703,
The link data table 1701 is created by using the sound data 1702 and the material data 1702 that becomes the link destination data.
Is output. On the other hand, the link data display processing 1704 performs processing using the link data table 1701 and the material data 1702, and outputs the result to the display device 101.

FIG. 18A is a diagram of the amplitude of the sound data, and FIG. 18B is a diagram of the amplitude after setting the link data to the sound data. 180 in FIG.
1 indicates a continuous amplitude (continuous waveform) of sound data. In FIG. 18B, reference numeral 1802 indicates the continuous amplitude of sound data, and 1803 indicates the amplitude of link-set sound data at the time of link setting. The setting of the link data to the sound data is performed after the process of setting the amplitude of the sound data at the designated time point to exceed the certain amplitude value (link amplitude boundary value) 1804.

First, the link setting process will be described.
FIG. 19 shows the link data setting process 1 described in FIG.
703 is a detailed flowchart of 703. In FIG. 19, first, sound data is reproduced (step 1901). While playing the sound data (step 190
2) Display the waveform of sound data (step 19)
03). Then, the link setting command by the editor is issued by clicking an arbitrary time point on the waveform of the sound data, and when it is accepted (step 190).
4) The reproduction of the sound data and the display of the waveform of the sound data are temporarily stopped (step 1905), and the amplitude of the reproduced sound data at the time of receiving the link setting command is set to an amplitude exceeding the above-mentioned link amplitude boundary value ( Step 1906). The time point in the sound data in which the link data is set by the process of step 1906 will be referred to as a link anchor hereinafter. This time point is indicated by an amplitude above the link amplitude boundary value above. Next, the material data to be the link destination data is selected (similar to the contents described in FIG. 12) (step 1907), and a link table that associates the selected material data with the link anchor is created (step 1908). The reproduction of the sound data and the display of the waveform of the sound data are restarted (step 1909).

FIG. 20 is a table showing the number of link anchors set in the sound data. The process of creating this table is performed in step 1908 described in FIG. In FIG. 20, reference numeral 2001 indicates a file name storing sound data, and reference numeral 2002 indicates the number of set link anchors.

FIG. 21 shows Step 1 described in FIG.
It is a figure showing the link table created in 908. Figure 2
In No. 1, 2101 is a file name storing sound data, 2102 is a link anchor number indicating which link anchor has been set since the start of sound data reproduction, and 2103 is a link associated with the link anchor indicated by 2102. Indicates the file name that stores the destination data. The combination of the link anchor number 2102 and the link destination data file name exists in correspondence with the number of link anchors included in the table shown in FIG.

Next, the link data display process will be described. FIG. 22 is a flowchart of the link data display processing described in FIG. First, the sound data is reproduced (step 2201), and the anchor counter for counting the number of link anchors detected during the reproduction of the sound data is initialized (step 2202). Then, while the sound data is being reproduced (step 2203), if a link anchor is detected (step 2204), the link table is referred to (step 2205), and the link destination data file name corresponding to the link anchor number indicated by the link counter. Is displayed (see FIG. 23 and its description below) (step 2
206), the anchor counter is incremented by 1 (step 2207). Further, when the user uses the link destination data file name displayed in step 2206 to request the link destination data display (step 2208), the reproduction of the sound data is temporarily stopped (step 2209), and the link destination data requested by the user is displayed. Display (Step 221
0) When the display is completed, the reproduction of the temporarily stopped sound data is resumed (step 2211).

FIG. 23 shows step 2 of FIG.
It is an example of a display screen when the process of 206 is performed. Figure 2
3, reference numeral 2301 indicates a display area of the link destination data file name corresponding to the link anchor number indicated by the link counter at the time of the processing of step 2206, and 2302 indicates the sound data in which the link data is set. The link destination data is displayed by the user selecting the link destination data file name displayed in the link destination data file name display area 2301.

Next, as a fourth embodiment, an embodiment of a system for notifying a user of link setting when a link is set in sound data will be described. The system configuration diagram for notifying the user of the sound data link setting is the same as the system configuration of FIG. FIG. 24 is a diagram showing details of the external storage device and the memory described in the system configuration diagram for notifying the user of the link setting. FIG.
2, 2401 indicates an information sound for notifying a user of link setting, 2402 indicates a link data table, 2403 indicates material data, 2404 indicates link data setting processing, and 2405 indicates link data display processing. The link data setting process 2404 is shown in FIG.
The same processing as the link data setting processing 1703 described in 7 is performed.

25A and 25B are flowcharts of the link data display processing 2405 described in FIG. 25A and 25B, when a sound data reproducing command is received (step 2501), it is checked by referring to the link table whether or not there is a link anchor in the sound data to be reproduced (step 2502). If there is a link anchor (step 2503), the link information area is turned on (step 2504) and the anchor counter is initialized (step 2505). Next, the sound data is reproduced (step 2506), and while the sound data is reproduced (step 2507), if a link anchor is detected (step 2508), the link table is referred to (step 2509), and the anchor counter is set. Increment one count (step 2510) and present the link information sound (step 2511). When the user's link destination data display request is accepted (step 2512), the reproduction of the sound data is temporarily stopped (step 2513), the link destination data requested by the user is displayed (step 2514), and the link information area is turned off. (Step 2515). Then, the reproduction of the interrupted sound data is restarted (step 25).
16).

FIG. 26 is a transition diagram of the screen of the display device when the processing shown in FIGS. 25A and 25B is being executed. In FIG. 26A, reference numeral 2601 indicates a state in which the link information area indicating that the link anchor exists in the sound data to be reproduced is on. In FIG. 26B, 2602 shows a state in which information sound is presented when a link anchor is detected. In FIG. 26C, reference numeral 2603 indicates a reproduction state of sound data in which the link anchor is set. In FIG. 26D, 2604 indicates a state where the link information area is off.

Next, a fifth embodiment will be described.

FIG. 27 shows another embodiment of the link data display processing (205) shown in FIG. 2, the link data display processing (1704) shown in FIG. 17, and the link data display processing (2405) shown in FIG. . In the link data display processing (205) shown in FIG. 2, the link data processing (1704) shown in FIG. 17, and the link data display processing (2405) shown in FIG. 24, sound data to which a link is set is reproduced. At this time, a means for allowing the user to select whether or not to display the link destination data indicated by the link is provided, and the display is performed according to the selection.
The described flow chart displays the link destination data indicated by the link when the sound data to which the link is set is reproduced, except for the step of allowing the user to select the display. In FIG. 27, the sound data is reproduced (step 2701), and while the reproduction is being performed (step 2702), when the reproduction start time of the sound data for which the link is set or the link anchor set for the sound data is detected. (Step 270
3), referring to the link table (step 2704),
The linked data is displayed (step 2705).

[0036]

According to the present invention, (1) at the time of link data setting processing, text data having the same content as that of sound data for setting the link data is displayed, and the link setting is performed using the text data. Since it is possible to set the link only by listening to the sound data, it is possible to reduce the work load of the editor as compared with the case of setting the link only by listening to the sound data. Also, it becomes possible to accurately specify the place where the link is set. (2) When text data having the same content as the sound data to be played back is displayed in synchronization with the playback of the sound data and the sound data to which the link is set is played back,
Since the display form of the corresponding text data is changed,
When the sound data to which the link is set is reproduced, the user can make a display request for the linked data associated with the sound data. (3) During the link data setting process, only the sound data is reproduced, and at the same time, the link setting command issue button is displayed, and the setting process is performed by instructing the button,
At the time of link data display processing, only the sound data is played back, at the same time a link destination data display command issue button is displayed, and the display processing can be performed by instructing the button, and the link data setting and display is performed based on the voice information. Can be done. (4) By setting the link data setting process with the amplitude of the sound data, it is not necessary to change the link setting even if the frequency of the sound data is changed and the reproduction time of the sound data is changed. (5) Since the link data setting process is performed by changing the amplitude of the sound data, it is not necessary to divide the sound data and store it in a file. Further, since the link data setting process is performed by changing the amplitude of the sound data, the link operation can be performed by detecting the place where the amplitude of the sound data is large, and the link operation to the sound data can be performed regardless of the time. it can.

[Brief description of drawings]

FIG. 1 is a system configuration diagram of a sound data link editing system to which the present invention is applied.

FIG. 2 is a diagram showing a memory and an external storage device in detail.

FIG. 3 is a diagram showing a data table defining sound data corresponding text data and sound data.

FIG. 4 is a diagram showing text data corresponding to sound.

FIG. 5 is a diagram showing a flowchart of link data setting processing.

FIG. 6 is a diagram showing an example of a screen displayed to an editor.

FIG. 7 is a diagram showing a window for displaying a list of material data to be linked data.

FIG. 8 is a diagram showing a link table for managing the relationship between sound data and link destination data.

FIG. 9 is a diagram showing a flowchart of link data display processing.

FIG. 10 is a diagram showing an example of a screen displaying a linked data candidate list in a menu format.

FIG. 11 is a diagram showing an example of a screen immediately before a window for displaying a list of linked data candidate lists is displayed.

FIG. 12 is a diagram showing a link destination data candidate list list display window.

FIG. 13 is a diagram showing a flowchart of a process for setting link data in sound data based on a reproduction start time of sound data according to the second embodiment.

FIG. 14 is a diagram showing an example of a screen display when the link data is set in the sound data without displaying the sound-corresponding text data in the second embodiment.

FIG. 15 is a flowchart of a process of causing the user of the second embodiment to issue a command to display the link destination data set in the sound data without displaying the sound-corresponding text data, and displaying the corresponding link destination data. FIG.

FIG. 16 is a diagram showing an example of a display screen for issuing a display instruction of link destination data set to sound data to a user of the second embodiment without displaying sound-corresponding text data.

FIG. 17 is a diagram showing in detail a memory and an external storage device necessary for performing link data setting for sound data using the amplitude of the sound data in the third embodiment.

FIG. 18 is a diagram showing the amplitude of sound data according to the third embodiment and the amplitude of sound data after link data is set to the sound data.

FIG. 19 is a diagram showing a detailed flowchart of link data setting processing in the third embodiment.

FIG. 20 is a diagram showing a table showing the number of link anchors set in the sound data of the third embodiment.

FIG. 21 is a diagram showing a link table created in the third embodiment.

FIG. 22 is a diagram showing a flowchart of link data display processing in the third embodiment.

FIG. 23 is a diagram showing an example of a link data display screen in the link data display processing of the third embodiment.

FIG. 24 is a diagram showing in detail an external storage device and a memory in the system for notifying the user of the link setting of the fourth embodiment.

FIG. 25A is a diagram showing a part of a flowchart of a link data display process of the fourth example.

FIG. 25B is a diagram showing another part of the flowchart of the link data display process in the fourth example.

FIG. 26 is a diagram showing a transition of a screen of the display device when executing the link data display process of the fourth embodiment.

FIG. 27 is a diagram showing a flowchart of link data display processing in the fifth embodiment.

[Explanation of symbols]

 101 display device (display) 102 central processing unit 103 sound board 104 memory 105 input device 106 speaker 107 external storage device

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Takaaki Yamada 1099, Ozenji, Aso-ku, Kawasaki-shi, Kanagawa Incorporated company Hitachi, Ltd. Systems Development Laboratory

Claims (10)

[Claims] 1. A sound data link editing method in a presentation system comprising a display device, an input device, a central processing unit, a memory, a sound board, a speaker, and an external storage device, the external storage device. Is at least sound data, image data, material data consisting of text data, text data corresponding to the sound data and having exactly the same contents, and text corresponding to the sound data name and its reproduction start / end time. When a data table consisting of data names is stored in advance, sound data is played back, and corresponding text data is displayed on the display device, and a link setting is input to the displayed text data by an editor's instruction. , The input time of the link setting input is measured, and the linked material When data candidates are displayed, when the displayed material data candidate is selected, the data in the data table corresponding to the sound data in which the input time of the link setting input falls between the playback time and the end time is selected. A sound data link editing method characterized in that a link table is created according to material data names. 2. A sound data link editing method in a presentation system comprising a display device, an input device, a central processing unit, a memory, a sound board, a speaker, and an external storage device, the external storage device. Is at least sound data, image data, material data consisting of text data, text data corresponding to the sound data and having exactly the same contents, and text corresponding to the sound data name and its reproduction start / end time. A data table consisting of data names is stored in advance, sound data is played back, a link setting command issuance button is displayed on the display device, and a link is issued by the editor instructing the link setting command issuance button during sound data playback. When setting input is made, when the link setting input is made When the displayed material data candidates are selected, the input time of the link setting input corresponds to the sound data that falls between the playback time and the end time. A sound data link editing method, characterized in that a link table is created based on the data in the data table and the selected material data name. 3. A sound data link editing method in a presentation system comprising a display device, an input device, a central processing unit, a memory, a sound board, a speaker, and an external storage device, the external storage device. The material data consisting of at least sound data, image data, and text data is stored in advance, the sound data is reproduced, and a continuous waveform of the sound data is displayed on the display device. When the link setting input is made by the editor instructing an arbitrary time point of the waveform to be changed, the amplitude of the waveform at the instructed time point is changed to an amplitude exceeding the link amplitude boundary value, and the input time of the link setting input is changed. Is displayed and the material data candidates of the link destination are displayed, and the displayed material data candidate is selected. When in, the sound data link editing, characterized in that the amplitude creates a link table by material data name selected as the sound data name has been changed. 4. A sound data link editing method in a presentation system comprising a display device, an input device, a central processing unit, a memory, a sound board, a speaker, and an external storage device, wherein the external storage device. Is at least sound data, image data, material data consisting of text data, text data corresponding to the sound data and having exactly the same contents, and text corresponding to the sound data name and its reproduction start / end time. A data table consisting of data names and a link table according to claim 1 or claim 2 are stored in advance, sound data is reproduced, and corresponding text data is displayed on the display device, and the displayed text data is displayed. The link data display command is input according to the editor's instructions. At this time, the input time of the link destination data display command is measured, the link table is referred to based on the measured input time, the link destination data candidate list is displayed on the display device, and the displayed link destination data candidate is displayed. A sound data link editing method, wherein the selected link destination data is output when is selected. 5. A sound data link editing method in a presentation system comprising a display device, an input device, a central processing unit, a memory, a sound board, a speaker, and an external storage device, the external storage device. Is at least sound data, image data, material data consisting of text data, text data corresponding to the sound data and having exactly the same contents, and text corresponding to the sound data name and its reproduction start / end time. A data table consisting of data names and a link table according to claim 1 or claim 2 are stored in advance, sound data is reproduced, and corresponding text data is displayed on the display device, and the displayed text data is displayed. The link data display command is input according to the editor's instructions. When the input time of the link destination data display command is measured, the link table is referred to based on the measured input time, and the obtained link destination data is output. . 6. A sound data link editing method in a presentation system comprising a display device, an input device, a central processing unit, a memory, a sound board, a speaker, and an external storage device, the external storage device. Is at least sound data, image data, material data consisting of text data, text data corresponding to the sound data and having exactly the same contents, and text corresponding to the sound data name and its reproduction start / end time. A data table consisting of data names and a link table according to claim 1 or 2 are stored in advance, sound data is reproduced, and a link destination data display command issue button is displayed on the display device. The editor designates the link data display command issue button Therefore, when the link destination data display command is input, the input time of the link destination data display command is measured, the link table is referred to based on the measured input time, and the link destination data candidate list is displayed on the display device. A method for editing a sound data link, which comprises displaying and displaying the selected link destination data when the displayed link destination data candidate is selected. 7. A sound data link editing method in a presentation system comprising a display device, an input device, a central processing unit, a memory, a sound board, a speaker, and an external storage device, the external storage device. Is at least sound data, image data, material data consisting of text data, text data corresponding to the sound data and having exactly the same contents, and text corresponding to the sound data name and its reproduction start / end time. A data table consisting of data names and a link table according to claim 1 or 2 are stored in advance, sound data is reproduced, and a link destination data display command issue button is displayed on the display device. The editor designates the link data display command issue button Therefore, when the link destination data display command is input, the input time of the link destination data display command is measured, the link table is referred to based on the measured input time, and the obtained link destination data is output. A sound data link editing method characterized by the above. 8. A sound data link editing method in a presentation system comprising a display device, an input device, a central processing unit, a memory, a sound board, a speaker, and an external storage device, the external storage device. The sound data including at least the sound data having the amplitude changed according to claim 3, material data including image data and text data, and the link table according to claim 3 are stored in advance, and the amplitude is changed. The sound data that has been changed, the changed amplitude portion of the sound data is detected, the link table is referred to based on the changed amplitude portion, a link destination data candidate list is displayed on the display device, and the displayed link destination is displayed. When a data candidate is selected, the selected link destination data is output. Sound data link editing how. 9. A sound data link editing method in a presentation system comprising a display device, an input device, a central processing unit, a memory, a sound board, a speaker, and an external storage device, the external storage device. The sound data including at least the sound data having the amplitude changed according to claim 3, material data including image data and text data, and the link table according to claim 3 are stored in advance, and the amplitude is changed. Sound data link which reproduces sound data, detects a changed amplitude portion of the sound data, refers to the link table based on the amplitude portion, and outputs the obtained link destination data. How to edit. 10. The sound data link editing method according to claim 8, wherein it is determined whether or not a link is set to the sound data to be played back, and the result of the determination is displayed on the display device prior to playing back the sound data. A sound data link editing method characterized by being displayed in.