JPH11134350A - Information processor and method therefor and information medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize a further interactive function by using an operation which can be sensed from a WWW browser side. SOLUTION: Buttons 2, 2, 2,... corresponding to various music are displayed on a WWW browser 1. After a log clear button 3 is pressed for temporarily eliminating records, the buttons 2, 2, 2,... are successively pressed in an arbitrary timing so that the corresponding musical sound can be reproduced, and this operation and the operation time interval can be successively recorded. When a log play button 4 is pressed, the musical sound is reproduced according to the order of the operation based on the recorded operation and time interval. The operation and the time information accompanied with the operation are recorded so that time sequential information can be treated. Only the reproduction of the musical sound can be operated without being accompanied with any recording by operating controllers 5, 5, 5,....

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus and an information processing apparatus which can record and reproduce time-series information using a browsing application, which is used on the WWW (World Wide Web) on the Internet. The present invention relates to a processing method and an information medium.

[0002]

2. Description of the Related Art At present, browsing applications that are capable of handling a plurality of types of data such as texts, images, sounds, and the like collectively are widely used. Such applications are available on the WWW on the Internet.
Since the above is often used when browsing a homepage described by an HTML (Hyper-text Markup Language) file, it is called a WWW browser. WW
Some W browsers are designed to support a plurality of OSs (Operation Systems).

[0003] Such a WWW browser reads a specified file, for example, in accordance with the description of an input URL (Uniform Resource Locators). If an address on the Internet is described as the URL, the file is searched and read on the Internet. Similarly, a local storage medium such as W
It is also possible to specify the hard disk of the personal computer on which the WW browser is running.

If the file read by the WWW browser is an HTML format file, it is displayed on the WWW browser according to the description of the file. HT read
If there is an instruction to read image data in the ML file, the image data is automatically read and displayed on the browser. Similarly, if there is an instruction to read audio data, the audio data is automatically read and the audio data is reproduced.

[0005] The WWW browser can read other files different from the HTML format. For example, U
If the file read according to the description of the RL is image data, the image data is directly displayed on the WWW browser, and if the audio data is read, the audio data is reproduced.

[0006] Further, by reading the HTML file in which a predetermined description is made into the WWW browser, various controls by the user with respect to the WWW browser are realized. For example, based on the description of the HTML file, W
An operation unit such as a button corresponding to a predetermined control can be appropriately arranged on the WW browser. By devising and setting the control, interactive operation by the user on the WWW browser can be realized. For example, the user can control the display of the image file and the reproduction of the audio file by operating the buttons arranged in this manner.

[0007] Further, the WWW browser can store a history of processing performed in the past for a certain period of time. The history is stored by recording the URL accessed in the past as a log. By specifying the URL stored in the history, the user can read a file accessed in the past without re-entering the URL one by one. This is called a history function.

[0008] As described above, the WWW browser has a very versatile function, and thus its use in a wider range of fields has been proposed.

[0009]

However, in the conventional WWW browser, with respect to an operation that can be sensed from the WWW browser, only the record of the operation is mainly used only by the function of the WWW browser. There was a problem that was.

This function is the history function described above, and is a reload function for specifying again the URL currently being accessed and forcibly rereading it. As described above, these can be moved to an arbitrary URL selected from the records (history) of a limited number of URLs traced in the past based on a user operation. Therefore, the contents of the history record
There was a problem that it stopped only at RL.

Accordingly, an object of the present invention is to provide an information processing apparatus which realizes a more interactive function by utilizing an operation which can be sensed from a WWW browser.
An information processing method and an information medium are provided.

[0012]

SUMMARY OF THE INVENTION In order to solve the above-mentioned problems, the present invention provides an information processing apparatus which performs processing in accordance with the description of a read HTML file, and a detecting means for detecting an operation. Time interval obtaining means for obtaining a time interval between the first detection by the detection means and the second detection by the detection means temporally adjacent to the first detection, the content of the operation and the time interval corresponding to the operation And a recording unit for recording in accordance with the order of operation.

According to another aspect of the present invention, there is provided an information processing method for performing a process in accordance with a description of a read HTML file. Step 1
And a time interval obtaining step of obtaining a time interval between the first detection and the second detection by a detection step temporally adjacent to the first detection, and the content of the operation and the time interval corresponding to the operation. Recording step of recording in order.

According to another aspect of the present invention, there is provided an information medium for providing a computer program, comprising: detecting means for detecting an operation; first detecting by the detecting means; A time interval acquisition unit for acquiring a time interval between the second detection by the adjacent detection unit and a recording unit for recording the content of the operation and the time interval corresponding to the operation in the order of the operations; This is an information medium that provides a computer program that can be read and executed by an information processing device configured to perform processing according to the description of an HTML file.

As described above, according to the present invention, the time interval between the first detection and the second detection based on the operation is obtained, and the content of the operation and the time interval are recorded in the order of the operation. Are recorded in chronological order, and the operation can be performed again based on the record.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below. According to the present invention, for an operation performed on the WWW browser that can be sensed from the WWW browser side, information on the sensed operation process is recorded and information on the time series of the operation process is recorded. As a result, it is possible to transmit information having a concept of a time series generated by a user's operation on a WWW browser, for example, on the Internet.

FIG. 1 shows an embodiment of the present invention.
This is an example in which the present invention is applied to a music sequencer for performing instrumental music using a WWW browser. In this music sequencer, recording and reproduction of musical sounds of percussion instruments are mainly performed. A plurality of buttons 2, 2, 2,... For reproducing and recording musical sounds of various percussion instruments are arranged on the WWW browser 1. Further, on the WWW browser 1, a log clear button 3 for deleting recorded contents and a log play button 4 for reproducing musical tones of respective musical instruments based on the recorded contents are arranged.

The WWW browser 1 is mounted on, for example, a personal computer and is executed on the personal computer. FIG. 2 shows an example of the configuration of the personal computer. In the personal computer 100, a controller 111 having both functions of a memory controller and a bus controller is provided to a local bus 105.
Is connected. In the controller 111, for example, an SRAM
112 consisting of DRAM and RA consisting of DRAM
M114 is connected. The CPU 113 is connected to the cache 112 via the processor bus 110.

Further, a hard disk 116 is connected to the local bus 105 via a hard disk controller 115 and, for example, a CRT or an LCD (Liquid Crystal) via a graphic controller 117.
The display 118 is connected. Further, the local bus 105 is connected to the extension bus 120 via the bus bridge 119.

An input / output controller 121 is connected to the extension bus 120. A necessary input / output device is appropriately connected to the input / output controller 121. As input / output devices connected to the input / output controller 121, input devices such as a keyboard 122 and a mouse 123, for example, a floppy drive and a C
A disk drive such as a D-ROM drive and a magneto-optical disk drive, and an output device such as a printer 125 are also exemplified.

A modem 126 is further connected to the extension bus 120. Via a modem 126, for example, it can be connected to a public telephone line 127. Modem 12
Instead of 6, a network adapter that can be connected to an external network may be connected. Furthermore, a sound source module 128 is connected to the extension bus 120. This sound module 128
Outputs sound under the control of the CPU 113 to drive the speaker 129.

When the personal computer 100 is started, a predetermined screen is displayed on the display 118 and a cursor which is moved by operating an input device such as the mouse 123 and the keyboard 122 is displayed.
The user can realize a desired function in the personal computer 100 by operating the cursor with the input device described above.

When a performance is recorded by the music sequencer of the WWW browser 1, the user first designates the log clear button 3 using the mouse 123, for example, and clicks the button (hereinafter, this button is called the mouse 123).
The operation of specifying and clicking with is described as "press the button.") After that, the button 2 corresponding to the desired tone
By pressing at a desired rhythm, that is, at a time interval, the musical tone is reproduced, and the performance, that is, the musical tone and the rhythm are recorded. The sound source files corresponding to each tone are
For example, it is stored in the hard disk 116 in advance.

The recording of the performance is made by the WWW browser 1 in a predetermined area on the RAM 114, for example.
When the log play button 4 is pressed, the recorded data is read from the RAM 114, and based on the read data, a musical tone is reproduced according to a time interval at the time of recording. The reproduction of the musical sound is performed by driving the speaker 129 based on the control of the CPU 113 for the sound source module 128.

In the configuration shown in FIG. 1 described above, pressing the buttons 2, 2, 2,... Immediately starts recording. Therefore, as shown in an example in FIG. 3, it is more preferable to add a configuration capable of confirming the tone color of each musical tone to the configuration in FIG. That is, the controllers 5, 5, 5,...
Is provided for each instrument. Controller 5
Comprises a play button 6 for instructing sound reproduction, a stop button 7 for stopping the reproduction, and a volume 8 for adjusting the volume of the reproduced sound. By pressing the play button 6, it is possible to reproduce only a desired musical sound without recording.

This music sequencer is a WWW browser 1
This is realized by reading a predetermined HTML file into. FIG. 4, FIG. 5, and FIG. 6 show an example of the contents of an HTML file described so as to realize the music sequencer, divided in the order of the figure numbers. This example corresponds to the music sequencer shown in FIG. 3 described above.

The tags <HTML> and </ HTML> described at the beginning and end of the file indicate that the file is an HTML file. The portion from the tag <BODY BACKGROUND = "back066.gif"> described in the middle of the file to the last tag </ BODY> is the portion related to the display of the music sequencer on the WWW browser 1 shown in FIG. This part is described using HTML.
Multiple lines starting with the tag <EMBED ...>
Tags <FORM> and </ FO, corresponding to the display of 5,5 ...
RM> correspond to buttons 2, 2, 2,... And buttons 3, 4.

The tag <SCRIPT LANG in the first half of the file
The part sandwiched between UAGE = "Javascript"> and </ SCRIPT> is a part that realizes the function of recording the operation with respect to the WWW browser 1 and accompanying the time information, and re-executing the recorded contents. is there. In this embodiment, the detection of the operation on the WWW browser 1 is performed by Java.
It is realized by a program described using a language called Script. As a method for acquiring information on the time intervals at which the buttons 2, 2, 2,.
A means for acquiring the current time in vaScript is used.

It should be noted that "JavaScript" was developed by Netscape in the United States, and Sun Micro in the United States.
This is the name of the script associated with systems.

FIG. 7 is a time chart showing an example of processing when the music sequencer according to the embodiment is operated. The vertical axis indicates the passage of time. User WWW
The operation on the browser 1, the lapse of time accompanying the operation, and the processing operation of the WWW browser 1 for the operation are shown in parallel. In the description, the processing in the horizontal direction is the same step to avoid complexity.

First, in step S10, the log clear button 3 is pressed, and the contents recorded so far are erased.
Then, the time when the log clear button 3 is pressed is newly recorded. It should be noted that the processing shown in FIG.
The processing is performed by the CPU 113 based on the program portion described by avaScript.

After a lapse of time a from step S10,
For example, the “bass_1” button 2 is pressed. Then
The WWW browser 1 detects the operation and “bass_
The tone corresponding to "1" is reproduced, and the information of the pressed button 2 and the time a elapsed from the previous operation are recorded (step S11). The elapsed time a is the time of the immediately preceding operation (in this case, the operation of pressing the log clear button 3) and the time of the current operation (in this case, the operation of pressing the “bass_1” button 2). Is obtained by calculating the difference between The operation and operation of step S11 are repeated, and recording is performed by the music sequencer.

That is, in step S12, the button 2 of the next instrument to be reproduced ("bass_2" in this example) is pressed, and the WWW browser 1 reproduces the musical tone corresponding to bass_2, and the pressed button 2 And the time b elapsed between step S11 and step S12 are added to the record. In the next step S13, "c
When the "owbell" button 2 is pressed, the corresponding musical sound is reproduced, and the information of the button 2 and the elapsed time c from the previous step S12 are added to the record. Similarly, in step S14, the “bass_2” button 2 is pressed and ba
The ss_2 music tone is played and the pressed button 2
And the elapsed time d from the previous step S13 are added to the record.

In this way, the user can arbitrarily select a musical tone by the buttons 2, 2, 2,... In an arbitrary order and at an arbitrary timing, and press the buttons 2, 2,.
By pressing the buttons 2,..., The corresponding musical sound is reproduced, and the contents of the performance are recorded in the order in which the buttons 2, 2, 2,.

In the above description, at the time of recording the performance, the reproduction of the corresponding musical sound is performed simultaneously, but this is not limited to this example. Instead of reproducing the corresponding musical sound, for example, a beep sound which is a built-in sound source (not shown) of the personal computer 100 can be emitted. Although the realism of the performance is diminished, since the sound source file does not need to be reproduced, it is expected that the performance recording itself can be performed comfortably. In this case, a corresponding sound source file may be used at the time of reproduction.

To reproduce the recorded performance, the log play button 4 is pressed (step S15). Then, the music is reproduced based on the recorded contents. First,
Based on the recording in step S11, a tone corresponding to "bass_1" is reproduced. After waiting for time b based on the recording in step S12, "bass_2" is reproduced (step S16). Similarly, after waiting for the time c based on the record in step S13, “cowbel
1 ”is reproduced (step S17), and after waiting for a time d based on the recording in step S14,“ ba ”
“ss_2” is reproduced (step S18). Thus, reproduction is performed based on the contents recorded until the log play button 4 is pressed in step S15.

FIG. 8 is a flowchart showing an example of a method for performing processing at the time interval based on the recorded time information during reproduction. First, the first step S20
Then, the time t1 at which a certain sound is reproduced is obtained. In the next step S21, the elapsed time x is added to this time t1 based on the record, and the time T is set. And
In the next step S22, the current time t2 is obtained, and in the following step S23, it is determined whether or not T <t2. If T <t2, the process proceeds to step S
22 and the current time t2 is obtained again. Thus, the current time t2 is repeatedly referred to until the time T. In this way, after time t1, processing can be vacated for the recorded elapsed time x.

In the above description, buttons 2, 2, 2,...
The musical tone generated by the musical instrument is associated with each of the above, but this is not limited to this example. Button 2, 2,
.. May be associated with a human voice. At this time, by associating the 50 Japanese sounds with the buttons 2, 2, 2,..., Recording and reproduction of conversation can be performed in a pseudo manner. Further, the buttons 2, 2, 2,... Can correspond to animal voices, general noises, and the like.

In the above description, the music sequencer is HTM
Although described in an L file, the display of the music sequencer on the WWW browser 1 is constituted by buttons corresponding to musical sounds.
This is not limited to this example.

For example, an image file prepared in advance is described in an HTML file so as to be displayed, and a graphical display imitating an actual musical instrument is performed on the WWW browser 1. The display is performed in advance, for example, on the hard disk 116.
This is done by the image file stored in. Modem 1
Alternatively, it may be obtained from an external network via. With respect to this display, a range is set for each musical tone, and the set portion is designated by, for example, the mouse 123 and clicked, thereby reproducing the musical tone and recording the performance. In addition, even if it is a simple button display, the keys of the keyboard 122 can be assigned to the buttons 2, 2, 2,. In this case, it is suitable for use in expressing keyboard musical instruments and the like.

For example, the description of the music sequencer is
This can be performed in the RML (Virtual Reality Modeling Language) format. This VRML is a description language designed to uniformly handle three-dimensional information on the Internet WWW.

FIG. 9 shows an example of the display of the music sequencer described in VRML on the WWW browser 1. For example, when the music sequencer is a drum machine mainly for rhythm performance, a drum set three-dimensionally represented as a three-dimensional object by VRML is
It is described as being arranged in a three-dimensional virtual reality space. Based on this description, a drum set is displayed on the WWW browser 1 supporting VRML as shown in FIG. Then, a reproduction sound corresponding to each object such as a bass drum, a snare drum, and a tom tom, which constitutes the drum set, is associated with the drum set.

The user can select, for example, the striking surfaces 2 ', 2', 2 ',.
By clicking and designating with the mouse 123, the reproduction of the corresponding musical sound and the recording of the performance can be performed. V
In RML, the user can freely set the viewpoint with respect to the display. For example, it is possible to set the viewpoint at the position where the drum is actually hit. By doing so, it becomes possible to perform the input and recording operation of the drum sequence with a feeling closer to the situation during the actual performance.

Furthermore, each part of the drum set can be assigned to each of a plurality of keys of the keyboard 122, and an image imitating a stick can be displayed on the screen. When the user operates the keyboard 122, the stick is displayed so as to strike the hitting surfaces 2 ', 2', 2 ',... Corresponding to the assignment to the keyboard 122, and the performance is recorded. It is possible.

Furthermore, in the above, one embodiment of the present invention has been described as being implemented locally on the personal computer 100, but this is not limited to this example. The performance record data is filed and, for example, the modem 1
26, it can be transmitted to the outside via the public telephone line 127. A network adapter may be used instead of the modem, and the data may be directly transmitted to an external network.

The transmitted performance record file is supplied to, for example, a server on the Internet and stocked.
The stocked file is given a unique URL. Therefore, based on the URL, the stocked file can be referred to or downloaded from another WWW browser 1 that can communicate with the server. For example, in the other WWW browser 1, the above-described FIG.
By reading the HTML file according to the embodiment shown in FIG. 6 to FIG. 6, it is possible to reproduce the performance based on the stored performance recording file. Of course, H
The TML file can be supplied from a server.

Therefore, the other WWW browser 1
Thus, it is possible to perform another performance recording while playing back the performance recording file referenced or downloaded from the server. Then, the performance recording file created by the other WWW browser 1 is transmitted to the server and stored. As a result, it becomes possible to integrate a plurality of performance record files to perform a larger-scale performance, or to perform a work contest or the like.

Although it has been described above that the sound source files corresponding to the respective musical instruments are stored in the hard disk 116 of the personal computer 100 in advance, the present invention is not limited to this example. For example, when the personal computer 100 can communicate with an external network, a necessary sound source file can be downloaded from a server on the network as appropriate. Of course, the sound source file may be obtained from the predetermined disk recording medium via the disk drive 124 each time.

In the above description, the sound corresponding to each musical instrument is obtained by reproducing a predetermined sound source file. However, the present invention is not limited to this example. For example, sound reproduction is performed by MIDI (Musical Instrument Digital Interface).
e) Can be performed based on standards. For example, if a sound source (MIDI sound source) compliant with the MIDI standard is connected to or incorporated in the personal computer 100, predetermined MIDI data is supplied to the MIDI sound source to specify the MIDI data. Sound can be played.

The MIDI data corresponding to each musical instrument is assigned to the buttons 2, 2, 2,... By pressing the buttons 2, 2, 2,..., The assigned MIDI data is supplied to the MIDI sound source, whereby a desired musical sound is reproduced. Recording of the performance is performed by recording the above-mentioned time interval and the MIDI data. According to this, each personal computer 100 equipped with the WWW browser 1 can use this music sequencer without having a sound source file.

As described above, the data stored in the memory (RAM 114) needs to be filed in order to transmit or store the performance record via a network. On the WWW, the above-mentioned JavaScript as a language executable from the WWW browser 1 as a client is used from the viewpoint of security.
End users are not allowed to access the hard disk as a local environment. In order to file the performance record on the memory, a system called COOKIE, which is a mechanism in which the WWW server mutually exchanges information to specify the WWW browser 1, can be used.

In the above description, the present invention is applied to a music sequencer, but the present invention is not limited to this example. In other words, there are operations on the WWW browser 1 that can be detected by JavaScript, in addition to the buttons created by HTML. For example, HT
Similar processing can be performed on anchors and links in the ML. The HTML file created in this way is used as a home page on the Internet by WWW
By placing it on the server, it is possible to know which part and how long another user has displayed on the WWW browser, and it is possible to make detailed access records. At this time, if the above-mentioned COOKIE is used, processing can be performed between different pages.

In the above description, the present invention is realized by using JavaScript, but this is not limited to this example. For example, J as a programming language
ava (Java is a US Sun Microsystem)
(a trademark of Ems Inc.), or an application called a plug-in that is used in combination with the WWW browser 1 to realize various functions. Further, it is also possible to realize a plurality of programs in cooperation.

[0054]

As described above, according to the present invention, there is an effect that an operation on a WWW browser treated as individual information can be recorded together with time-series information.

Further, since the operation on the WWW browser can be recorded in time sequence, the recorded data can be re-executed in accordance with the time sequence at the time of recording.

Further, by using the recorded time-series information, there is an effect that the applied maliciousness of the WWW browser can be further expanded.

[Brief description of the drawings]

FIG. 1 is a schematic diagram illustrating an example of display of a music sequencer according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating an example of a configuration of a personal computer.

FIG. 3 is a schematic diagram illustrating an example of an expanded display of the music sequencer according to the embodiment of the present invention.

FIG. 4 is a schematic diagram showing an example of the contents of an HTML file described so as to realize the music sequencer according to the embodiment in a divided manner.

FIG. 5 is a schematic diagram in which an example of the contents of an HTML file described so as to realize the music sequencer according to the embodiment is divided.

FIG. 6 is a schematic diagram illustrating an example of the contents of an HTML file described so as to realize the music sequencer according to the embodiment;

FIG. 7 is a time chart showing an example of processing when the music sequencer according to the embodiment is operated.

FIG. 8 is a flowchart illustrating an example of a method of performing processing for a recorded time interval during reproduction.

FIG. 9 is a WWW of a music sequencer described in VRML.
FIG. 4 is a schematic diagram illustrating an example of display on a browser.

[Explanation of symbols]

1 WWW browser, 2 button, 3 log clear button, 4 log play button, 100
..Personal computer, 116 ... Hard disk drive, 118 ... Display, 122 ...
Keyboard, 123 Mouse, 126 Modem 128 Sound source module 129 Speaker

Claims (8)

[Claims] 1. An information processing apparatus adapted to perform a process in accordance with a description of a read HTML file, a detecting means for detecting an operation, a first detection by the detecting means, Time interval obtaining means for obtaining a time interval from the second detection by the detection means which is temporally adjacent, and recording means for recording the content of the operation and the time interval corresponding to the operation in the order of the operation An information processing apparatus comprising: 2. The information processing apparatus according to claim 1, wherein the content of the record is re-executed in a time series of the operation based on the recorded time interval. . 3. The information processing apparatus according to claim 2, wherein the time interval corresponding to the first operation is added to the time of re-execution of the first operation based on the record, and The re-performance time is the time of the re-performance, and the re-performance of the second operation performed next to the re-performance of the first operation based on the record is the time of the next re-performance by repeatedly referring to the current time. An information processing apparatus characterized in that the time interval is reproduced by judging whether or not the time interval is determined. 4. The information processing apparatus according to claim 1, wherein the operation is performed, a plurality of operation means provided corresponding to a plurality of musical tones, respectively, and An information processing apparatus further comprising: a tone reproducing means for respectively reproducing the plurality of musical tones based on the operation performed. 5. The information processing apparatus according to claim 4, further comprising a display unit for performing display corresponding to each of the plurality of musical tones, wherein each of the plurality of operation units is a part of the display by the display unit. An information processing apparatus characterized in that the information processing apparatus is associated with the information processing apparatus. 6. The information processing apparatus according to claim 1, further comprising a connection means for connecting to an external network, wherein the recording by said recording means is transmitted to said external network. Information processing device. 7. An information processing method adapted to perform a process according to a description of a read HTML file, a detection step of detecting an operation, a first detection by the detection step, A time interval obtaining step of obtaining a time interval between the detection and the second detection by the detection step that is temporally adjacent to the detection, and the content of the operation and the time interval corresponding to the operation in the order of the operation Recording step of recording. 8. An information medium for providing a computer program, comprising: detecting means for detecting an operation; a first detection by the detecting means; and a second detection by the detecting means temporally adjacent to the first detection. A time interval acquisition unit for acquiring a time interval for detection; and a recording unit for recording the content of the operation and the time interval corresponding to the operation in the order of the operation. An information medium that provides a computer program that can be read and executed by an information processing device configured to perform a corresponding process.