JPH0644060A - Program development supporting method and device therefor - Google Patents

Abstract

PURPOSE:To provide a program development supporting method and the device capable of retreiving, content-confirming and editing of picture data and voice data to be inserted simultaneously with the editing of a program. CONSTITUTION:In a multi-media computer provided with a CRT display 10, a voice output device 11 and a mouse 14, simultaneously with editing the program 30 using an editer 31, the picture data and the voice data stored in a secondary storage device 15 are retreived using a browser by a data base program 20 and the contents of the selected picture data and the voice data are confirmed and edited by a picture editing program 21 or a voice editing program 23. After the content-confirmation and the editing of the voice data and the picture data, all or a part of the picture data and the voice data and the corresponding instructions are inserted to the prescribed positions of the program 30.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION This invention relates to digital computers, and more particularly to
The present invention relates to a so-called multimedia computer that handles visual data and auditory data, displays an image of the visual data, and outputs audio of the auditory data.

[0002]

2. Description of the Related Art Development of a program for processing visual data and auditory data has been conventionally performed as follows. The case of handling auditory data will be described below.
A program developer uses a program (editor) for program editing to create a program. If there is a part in the program that requires voice output, add a voice output command to that part, save the program, and terminate the temporary editor.

Next, the program developer starts the database program, searches the database for auditory data corresponding to the voice output command, selects one of them, and terminates the database program. Further, the voice output program is activated, the selected auditory data is displayed on the voice display device, the content is confirmed, and the voice output program is ended. At this time, the auditory data may be edited and a part of the auditory data may be extracted and used.

Next, the program developer activates the editor again, edits the program, and inserts the selected auditory data corresponding to the audio output command. At this time, the auditory data may be edited and a part of the auditory data may be extracted and used. The above procedure
The same applies to the case of handling visual data.

[0005]

Conventionally, the development of a program for processing visual data and auditory data has been performed in the past.
Since the procedure has been performed as described above, it takes time and effort to develop the program. In other words, the contents of visual data and auditory data to be inserted and changed cannot be confirmed at the same time as editing the program, so that it takes time to search and select target data. It takes time and labor to insert the selected data and the corresponding instruction into the program. There is a problem that the contents of the data cannot be checked and inserted into the program at one time.

Therefore, the visual data and the auditory data are searched at the same time as the program is edited, and the contents are displayed as an image or output as voice, and the visual data and the auditory data can be edited. There is a demand for a program development support tool that can insert a program into a program.

The program development support method and apparatus of the present invention have been made in view of the above problems.
Visual data and auditory data can be searched at the same time as program editing, and the contents can be displayed as an image or output as audio, and visual data and auditory data can be edited. You can also insert that data and the corresponding instructions into your program,
As a result, it is an object of the present invention to provide a program development support method and apparatus that can save the time and effort for program development.

[0008]

In order to achieve the above object, a program development support method and apparatus of the present invention reproduce visual information and / or auditory information in a browser and reproduce the reproduced visual information. It is characterized in that a program code corresponding to information and / or auditory information or information selected for either one is generated.

The visual information is characterized in that a section is designated and reproduced. The auditory information is reproduced by designating a section. The program code changes according to a programming language in which the program code is written.

A means for reproducing visual information and / or auditory information in the browser, and a program code corresponding to the reproduced visual information and / or auditory information and / or information selected for one of them. It is characterized by having means.

[0011]

[Function] While the program is being edited, the browser is used to search the database, the visual data and the auditory data are selected, the contents of the selected visual data and auditory data are displayed as an image or output by voice, and further selected. By editing the visual data and the auditory data, the visual data and the auditory data to be used are searched, selected, confirmed, and edited simultaneously with the editing of the program. Also, the visual data and the auditory data that have been searched, selected, confirmed, and edited, and the corresponding commands are inserted into the program to facilitate the editing of the program.

[0012]

EXAMPLE A first example of the present invention will be described below. FIG. 1 is a diagram showing the configuration of a program development support device 1 of the present invention. The program development support apparatus 1 is implemented on a high-level programming language, for example, a computer (not shown) that processes LISP and its peripheral devices. In FIG. 1, a CRT display 10 is connected to a computer,
It is a display device for displaying the contents of visual data. The audio output device 11 is a circuit that is connected to a computer, includes a D / A converter, an audio amplifier, etc., and outputs the content of auditory data from the speaker 12.

Here, the visual data refers to general information that appeals to human vision, such as video information and graphic information, and the auditory data refers to PCM-encoded voice waveforms, musical scores automatically played by a computer, and the like. , Refers to general information that appeals to human hearing. The I / O 13 is a circuit that interfaces a computer with a mouse 14, a keyboard (not shown), and the like. The secondary storage device 15 is a storage device that is connected to a computer and stores information, such as a hard disk storage device.

The database program 20 is software for searching visual data and auditory data stored in the secondary storage device 15. Image editing program 2
1 is software that edits the visual data retrieved by the database program 20. The image output program 22 is software that performs processing for outputting the visual data edited by the image editing program 21 via the CRT display 10. The voice editing program 23 is software that edits the auditory data retrieved by the database program 20. The audio output program 24 is software that performs processing for outputting the visual data edited by the image editing program 23 via the audio output device 11 and the speaker 12.

The program 30 is a program to be processed by the program development support method and apparatus of the present invention. The editor 31 is software that edits the program 30. The arrow in FIG. 1 indicates the flow of data, and the part marked with * in the figure indicates software.

FIG. 2 is a diagram for explaining the browser 32 which is controlled by the database program 20 and is displayed on the screen of the CRT display 10 when the editor 31 is activated. A browser is a window used to interactively search a database. The contents of the program 30 are displayed in a window on the screen of the CRT display 10 provided separately from the browser. FIG. 3 is a diagram illustrating a procedure for selecting auditory data (music data) using the browser 32.

The operation of the program development support device 1 will be described below. Here, a case will be described in which the auditory data is searched, selected, the content is confirmed, and edited, and the auditory data and the corresponding command are inserted into the program 30. First, the program developer uses the editor 31
Is started and the program 30 is edited. Next, the part of the program 30 for outputting audio is designated. This designation is performed by pressing (clicking) a predetermined line of the program 30 displayed on the CRT display 10 for a short time on a button provided on the mouse 14 and inputting control information to the computer. However, the control information may not be input from the mouse 14, and may be input from the keyboard, for example.

Next, the program developer operates the mouse 14 and clicks to input the selection information into the computer, and from the genre selection window of the browser 32 shown in FIG. Select the type, here music. Here, in the genre selection window,
For example, types of sounds such as natural sound, music, and human voice are displayed in a list and can be selected. The genre selection information is input to the database program 20. Upon receiving this information, the database program 20 retrieves the auditory data stored in the secondary storage device 15, and the composer (artist) list shown in FIG.
Display in the artist selection window of.

Next, the program developer selects the composer of the target music (auditory data) in the artist selection window. The selection method and the operation of the database program 20 here are the same as those described in the selection of the type of voice. Next, the program developer
The target music (auditory data) is selected in the song name selection window of the browser 32 shown in (C). The selection method here is the same as that described in the selection of the type of voice. The database program 20 inputs the auditory data (music data A) selected as described above to the voice editing program 23.

Next, the program developer uses the window (PL) for starting the voice output of the browser 32 shown in FIG.
AY) is clicked with the mouse 14 and control information for outputting a voice output is input to the computer. This control information is input to the voice editing program 23, and the voice editing program 23 receiving this control information is the voice output program 2
Input the auditory data A into 4. The audio output program 24 to which the auditory data A is input outputs the content of the auditory data A via the audio output device 11 and the speaker 12.
At the same time, the information indicating the elapsed time from the start of outputting the voice that is currently being output is input to the database program 20 via the voice editing program 23.

The database program 20 to which the elapsed time information has been input indicates the position in the auditory data A of the voice output at that point in the elapsed time display window shown in FIG. Not shown). When the program developer stops the above audio output,
The output stop window (STOP) shown in (D) is clicked with the mouse 14, and the control information for stopping the voice output is input to the voice editing program 23. The voice editing program 23 to which this control information is input controls the voice output program 24 and stops the voice output.

Next, the program developer uses the auditory data A
Set the range to use. This setting is performed by clicking the elapsed time display window.
That is, the program developer starts the use range of the auditory data A in the elapsed time display window (here, 15 seconds).
And click the end point (here 45 seconds) with the mouse 14,
Enter the information specifying the usage range into the computer. The voice editing program 23, to which the range designation information is input, cuts out the range of the auditory sense data A. This operation is shown in Figure 3.
It shows in (D).

Music data A whose range is specified as described above
In order to confirm the above portion, the PLAY window is clicked with the mouse 14 and the control information for outputting the voice output is input to the computer. The voice editing program 23, to which this information is input, inputs the data of 15 to 45 seconds from the beginning of the auditory sense data A to the voice output program 24, and outputs voice through the voice output device 11 and the speaker 12. The display of the elapsed time at this time is also performed within the designated range as described above.

Next, the program developer clicks the program window shown in FIG. 2E with the mouse 14 to insert the auditory data A and the corresponding command into the program 30. The instruction is inserted in the line of the program 30 designated as described above, and the auditory sense data A is inserted in the location indicated by the argument of the instruction. Specifically, when the program 30 is written in LISP,
In the line of the designated program 30, for example, the following commands (setg sound1 (take A)) (PLAY sound1 from 15) (PLAY sound1 to 45) are inserted, and (setg sound1 (take A)).
Aural data A is inserted at the position indicated by A)).
In addition, (PLAY sound1 from 15)
Indicates the start point of the specified range of auditory data, and (PLAY
sound1 to 45) also indicates the end point. When this command is executed, the contents within the specified range of the auditory data are output as voice.

This completes the procedure for inserting the auditory data into the program 30. Aural data other than music can also be inserted by the same procedure. The above operation can be performed any number of times, arbitrary auditory data, and visual data until the editing of the program 30 is completed. Further, the above-mentioned procedures may be performed before or after each other. Also,
The auditory data and the visual data may not be cut out. The configuration of the browser 32 is not limited to the one described here. Further, each part constituting the program development support device 1 may be replaced with another means having an equivalent function.

The above procedure is for searching visual data,
The same applies when the auditory data and the command corresponding thereto are inserted into the program 30 by selecting, confirming the contents, and editing. In this case, the visual data is displayed in another window as shown in FIG. 4, and the visual data is cut out two-dimensionally. In FIG. 4, four coordinates (70, 70), (15
0, 70), (70, 140), and (150, 140) are shown in the case of being cut out.

In addition, when the visual data is inserted and the command corresponding thereto is inserted, each command for the auditory data is, for example, (setg image1 (take B)) (PLAY image1). Here, B is the file name of the visual data. The visual data is (setg image1 (ta
ke B)) is inserted in the position specified by the command, and when this command is executed, the entire contents of the visual data are displayed as an image on the CRT display 10. The visual data and the auditory data are not necessarily inserted in the program 30, and the visual data and the auditory data stored in the secondary storage device 15 are read every time the corresponding instruction is executed. You may.

FIG. 5 is a flow chart showing the procedure of selecting the auditory data described above. In FIG. 5, in step 00 (S00), the program developer specifies the genre of auditory data. In step 01 (S01), the program developer specifies an artist. In step 02 (S02), the program developer selects music (auditory data). This completes the selection of auditory data using the browser 32.

FIG. 6 is a flowchart showing a procedure for editing the selected voice information and inserting it into the program 30. In FIG. 6, in step 10 (S10), the program developer edits the auditory data.
In step 11 (S11), the program developer clicks on the PROG window shown in FIG. 2 (E).
In step 12 (S12), the voice editing program 23 inserts the edited auditory data and the corresponding command into the program.

FIG. 7 is a flowchart for explaining an example of a procedure for developing a multimedia program using the program development support method and apparatus of the present invention.
In FIG. 7, in step 20 (S20), the program developer uses the editor 31
Edit. In step 21 (S21), the program developer designates a predetermined portion in the program 30 as an instruction insertion position. In step 22 (S22), the program developer searches for the target auditory data or visual data. The procedure in this step is S0 above.
This corresponds to the procedure of 0 to S02.

In step 23 (S23), the program developer confirms the content of the auditory data or visual data selected by the above search. Step 24
In (S24), the program developer determines whether or not to use the selected auditory data or visual data. When using it, it progresses to the procedure of S25, and when not using, it progresses to the procedure of S20. Step 25 (S2
In 5), the program developer edits the selected auditory or visual data and inserts it into the program 30. The procedure at this step corresponds to the procedure at S10 to S12.

In step 25 (S25), the program developer judges whether or not the editing of the program 30 is completed. If not completed, the procedure proceeds to step S20. If completed, the program 30 is saved and the editor 31 To finish.

The second embodiment will be described below. While LISP was used as the programming language in the first embodiment, PROLOG is used in the second embodiment. PRO
When LOG is used, the instruction inserted in the program 30 changes, and the instruction conforms to the PROLOG language specification. In the processing of the multimedia computer, the programming language to be used may differ depending on the type of data to be handled, so it is necessary to insert an instruction matching the programming language of the portion where the instruction corresponding to the inserted data is inserted. .

The program development support method and apparatus of the present invention can take various configurations other than those described above. The embodiments described herein are exemplary. In particular, the data handled is not limited to auditory and visual data,
For example, other types of data such as data regarding a person may be used. In addition, the programming language that describes the program is not limited to the above, and for example, PASCAL
Other programming languages may be used.

[0035]

As described above, according to the program development support method and apparatus of the present invention, visual data and auditory data can be searched at the same time as program editing, and the contents can be displayed as images or output as voice. It is possible to edit visual data and auditory data, and to insert the data and the corresponding instructions into a program, which saves time and effort for developing the program. It is possible to provide a program development support method and an apparatus therefor.

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration of a program development support device of the present invention.

FIG. 2 is a diagram illustrating a browser controlled by a database program and displayed on a screen of a CRT display when an editor is activated.

FIG. 3 is a diagram illustrating a procedure for selecting auditory data using a browser.

FIG. 4 is a diagram showing a method of cutting out an image display of the contents of visual data.

FIG. 5 is a flowchart showing a procedure for selecting auditory data.

FIG. 6 is a flowchart showing a procedure for editing selected voice information and inserting it into a program.

FIG. 7 is a flowchart illustrating an example of a procedure for developing a multimedia program using the program development support method and apparatus of the present invention.

[Explanation of symbols]

 1 ... Program development support device 10 ... CRT display 11 ... Voice output device 12 ... Speaker 13 ... I / O 14 ... Mouse 15 ... Secondary storage device 20 ... Database program 21 ... Image editing program 22 ... Image output program 23 ... Voice editing program 24 ... Voice output program 30 ... Program 31 ... Editor

Claims (5)

[Claims] 1. A method for reproducing visual information and / or auditory information in a browser and generating a program code corresponding to the reproduced visual information and / or auditory information and / or information selected for one of the reproduced visual information and auditory information. Characteristic program development support method. 2. The program development support method according to claim 1, wherein a section is specified in the visual information, the section is reproduced, and a program code is generated. 3. The program development support method according to claim 1, wherein a section is specified in the auditory information, the section is reproduced, and a program code is generated. 4. The program development supporting method according to claim 1, claim 2 or claim 3, wherein the program code is generated corresponding to a programming language in which the program code is described. How to help. 5. A means for reproducing visual information and / or auditory information in a browser, and a program code corresponding to the reproduced visual information and / or auditory information and / or information selected for one of them. A program development support device having means.