JP3563428B2 - Multimedia control device - Google Patents

Description

[0001]
[Industrial application fields]
The present invention relates to a multimedia control apparatus suitable for use in, for example, a musical educational toy.
[0002]
[Prior art]
Conventionally, various devices for controlling video and sound according to operation of an operator have been put into practical use. This type of device is called a video game or a TV game, and a shooting game that asks a player's reflexes is known. A video game includes a computer unit that generates a video signal corresponding to a game operation and a display that displays a video signal supplied from the computer unit. The computer unit sequentially reads image information and control information stored in a well-known ROM pack, for example, displays a still image as a screen background on the display, and moves a corresponding character on the still image according to a game operation. The video is displayed and sound effects are generated according to the movement.
[0003]
[Problems to be solved by the invention]
Now, in such a video game, the visual effect by the image is the main, and the acoustic effect often plays a secondary role. In addition, the game is inferior with the player, and in many cases, the game is progressed according to a predetermined story content. For this reason, there is a need for a multimedia control device that allows a game to proceed with the free idea of a player and that combines visual and acoustic effects. In particular, as an educational toy for infants, a multimedia control device that can combine visual effects and sound effects and develop a sense of sound and rhythm as a game is desired.
The present invention has been made in view of the above-described circumstances, and combines a visual effect and a sound effect, cultivates a sense of sound and rhythm as a game sensation, and further can learn a musical instrument tone and performance method. The object is to provide a media control device.
[0004]
[Means for Solving the Problems]
In the invention according to claim 1, a performance operator operated for performance,Selection means for selecting one of the characters corresponding to the musical instrument, and the character corresponding to the selected characterDepending on the performance pattern that represents the performance of the instrument,Predetermined section,After generatingThe predetermined section,Sounding means for generating an instrument sound corresponding to a performance operation on the performance operator when the performance operator is operated,chosenAn image control means for switching a plurality of image patterns representing a character, wherein when the sound generation means generates an instrument sound corresponding to the performance pattern, the performance control element is synchronized with the instrument sound. In the case where an instrument sound is generated in accordance with a performance operation, the image control means for displaying the character in a moving image so as to perform the instrument in synchronization with the performance operation on the performance operator, respectively. It is a feature.
[0005]
In the invention according to claim 2, a performance operator operated for performance;Selection means for selecting one of the characters corresponding to the musical instrument, and the character corresponding to the selected characterDepending on the performance pattern that represents the performance of the instrument,Predetermined section,After generatingThe predetermined section,Sounding means for generating an instrument sound corresponding to a performance operation on the performance operator when the performance operator is operated,chosenAn image control means for switching a plurality of image patterns representing a character, wherein when the sound generation means generates an instrument sound corresponding to the performance pattern, the performance control element is synchronized with the instrument sound. In the case where a musical instrument sound is generated in accordance with a performance operation, an image control means for displaying the character in a moving image so as to perform the musical instrument in synchronism with the performance operation for the performance operation element, and the performance operation element When a performance operation is performed, a performance determination unit that determines whether or not the performance represented by the performance pattern and the performance indicated by the operation on the performance operator are coincident, and a determination result by the performance determination unit is notified. And a notification means.
[0006]
[Action]
According to the present invention,After showing the example of performance by generating the instrument sound according to the performance pattern and displaying the animation of the character synchronized with the generated musical sound, the sound of the instrument sound and the animation display for performing the performance are displayed according to the performance operation. Done.
[0007]
【Example】
Embodiments of the present invention will be described below with reference to the drawings.
A. Summary of Examples
FIG. 1 is a diagram schematically illustrating a multimedia control apparatus according to an embodiment of the present invention. As shown in FIG. 1B, the multimedia control device 1 generates a video signal Vs and an audio signal As composed of stereo components of the L channel and the R channel, and is connected via a cable C. Supplied to the television receiver 20. The television receiver 20 reproduces a video in accordance with the video signal Vs, and generates a musical sound and a sound corresponding to the audio signal As from a speaker in synchronization with the video.
[0008]
As shown in FIG. 1 (a), the multimedia control device 1 includes a lid 1a that can be opened and closed and a tablet unit 1b. In addition, the figure (A) has shown the unfolded state, and the cover body 1a is mounted on the tablet part 1b in the accommodation state, and the apparatus 1 is equipped with the structure accommodated in a bowl shape. In FIG. 2A, reference numeral 2 denotes a ROM cassette, which stores a control program, automatic performance data and image patterns, or ADPCM data obtained by compression encoding voice and musical instrument sound, and the like. 3 is a picture book. The picture drawn on each page of the picture book 3 is stored in a form that substantially corresponds to the image pattern of the ROM cassette 2.
[0009]
Reference numeral 4 denotes a page detection sensor disposed on the upper portion of the lid 1a, which detects the presence or absence of a notch formed on each page of the picture book 3 and discriminates the currently opened page. Reference numeral 5 denotes a touch pen that generates magnetic flux. The magnetic flux generated by the touch pen 5 is detected by a pen position detection matrix 5a (see FIG. 2) laid on the back surface of the lid 1a and the upper surface of the tablet unit 1b, and determines where the pen 5 is currently located. Reference numeral 6 denotes a power switch for setting the device 1 on and off, and reference numeral 7 denotes a keyboard sheet placed on the tablet unit 1b. This keyboard sheet corresponds to the arrangement position of the pen position detection matrix 5 a, and the pitch and note length can be designated according to the pointing operation of the touch pen 5. Reference numeral 8 denotes a pad operated during rhythm performance, and reference numeral 9 denotes a joypad used as a selection operator. Reference numeral 10 denotes a microphone for voice input.
[0010]
B. Example configuration
Next, the configuration of the embodiment will be described with reference to FIG. In addition, the same number is attached | subjected to the part which is common in each part shown in FIG. 1, and the description is abbreviate | omitted. In FIG. 2, 5a is a pen position detection matrix laid on the back surface of the lid 1a and the upper surface of the tablet 1b. The matrix 5a detects a potential electromagnetically induced according to the magnetic flux of the touch pen 5, generates the pointing position data of the pen 5, and supplies this to the bus. A CPU 11 controls each part of the apparatus based on a control program read from the ROM cassette 2. The operation of the CPU 11 will be described later.
[0011]
A RAM 12 is used as a work area for the CPU 11 and temporarily stores various register data. A tone data input / output terminal 13 outputs MIDI data supplied from an external MIDI musical instrument to the bus, and sends MIDI data supplied from a tone synthesis unit 15 described later to an external sound source. A display control circuit 14 converts an image pattern read from the ROM cassette 2 into a video signal Vs in accordance with an image control signal supplied from the CPU 11 and outputs the video signal Vs. Reference numeral 20 denotes display means such as a television receiver for reproducing the video signal Vs.
[0012]
The tone synthesizing circuit 15 has a sound source configured by a well-known waveform memory reading method or calculation method, and supplies a tone signal synthesized with a tone according to performance data supplied from the CPU 11 to the next stage. Reference numeral 16 denotes a reverberation / volume control circuit that applies a reverb with a depth corresponding to the control signal supplied from the CPU 11 to the tone signal output from the tone synthesis circuit 15 and adjusts its volume. Reference numeral 17 denotes a microphone reverberation / volume control circuit that applies a reverberation having a depth corresponding to a control signal supplied from the CPU 11 to an audio signal input from the microphone 10 and adjusts its volume.
[0013]
A digital audio processing circuit 18 decodes ADPCM data read from the ROM cassette 2 under the instruction of the CPU 11 and generates an analog audio signal. The processing circuit 18 samples the audio input from the microphone 10 for a certain period of time, encodes it into ADPCM data, and writes it into a predetermined storage area of the RAM 12 via the bus under the control of the CPU 11. Reference numeral 19 denotes a mixer which mixes the outputs of the reverberation / volume control circuits 16 and 17 and the digital audio processing circuit 18 and converts the output into an audio signal As composed of stereo components of the L channel and the R channel and outputs it. An audio output terminal 21 supplies the L-channel and R-channel audio signals As to an external sound system such as the television receiver 20.
[0014]
C. Operation of the embodiment
Next, the operation of the embodiment having the above configuration will be described with reference to FIGS. Here, after the operation of the main routine is described with reference to FIGS. 3 and 4, the operation of icon processing called in the main routine will be described with reference to FIGS. 5 to 9.
[0015]
(1) Main routine operation
First, when the multimedia control device 1 according to this embodiment is turned on, the CPU 11 loads a predetermined control program from the ROM cassette 2 to start the main routine shown in FIG. 3, and proceeds to step Sa1. In step Sa1, various registers and flags stored in the RAM 3 are reset and initialized, and the process proceeds to the next step Sa2. In step Sa2, the CPU 11 sequentially reads the initial image pattern and the corresponding automatic performance data from the ROM cassette 2. The automatic performance data referred to here is pattern data for a predetermined measure for instructing the sound generation timing of each rhythm instrument sound corresponding to the specified rhythm type.
[0016]
Next, when proceeding to step Sa3, the CPU 11 transfers the initial image pattern and the automatic performance data thus read out to the display control circuit 14 and the musical tone synthesis circuit 15 via the bus. Thereby, the display control circuit 14 converts the initial image pattern into the video signal Vs and supplies it to the display means (television receiver) 20. On the other hand, the musical tone synthesis circuit 15 synthesizes musical tone signals for each rhythm instrument sound according to the automatic performance data. The tone signal is subjected to reverberation or volume control, and then supplied from the sound output terminal 21 to the sound system via the mixer 19. As a result, an automatic rhythm performance synchronized with the opening screen display is performed.
[0017]
Next, the CPU 11 proceeds to step Sa4 and determines whether or not the page of the picture book 3 set on the back surface of the lid 1a (see FIG. 1 (a)) has been turned. Here, if the output of the page detection sensor 4 does not change, it is assumed that the page is still the opening page, the determination result is “NO”, the process returns to step Sa3, and the above-described opening state is maintained. For example, when the “animal stage” page shown in FIG. 4 is opened, the page detection sensor 4 detects this. Thereby, the determination result of step Sa4 becomes “YES”, and the process of the CPU 11 proceeds to step Sa5.
[0018]
In step Sa5, the image pattern and automatic performance data of the corresponding page are sequentially read from the ROM cassette 2. Next, in step Sa6, the read image pattern and automatic performance data are transferred to the display control circuit 14 and the tone synthesis circuit 15, respectively. As a result, the “animal stage” screen similar to the picture book page shown in FIG. 4 is displayed as a still image, while the rhythm instrument sounds corresponding to the automatic performance data are synthesized and the stage opening performance is performed.
[0019]
Next, when the processing of the CPU 11 proceeds to step Sa7, it is determined whether or not the “icon” on the picture book page shown in FIG. On this page, “1 banana”, “2 bananas”, “3 bananas”, and “4 bananas” drawn at the bottom of the right page are icons EC to EC4. If none of the icons EC1 to EC4 are pointed, the determination result is “NO”, and the “Animal Stage” screen continues to be displayed along with the stage opening performance. On the other hand, when any of the icons EC1 to EC4 is pointed, the determination result here is “YES”, and the process proceeds to step Sa8.
[0020]
In step Sa8, an event corresponding to the icon type pointed to is executed. This event is a process in which a sense of sound, a sense of rhythm, and the like are learned in a game sense, and details thereof will be described later. Then, every time the event for each icon is completed, the CPU 11 advances the process to step Sa9, and repeats the above steps Sa6 to Sa8 until there is a page change.
As described above, in the main routine, an image corresponding to each page of the picture book 3 and a performance are reproduced in synchronization with each other, thereby realizing a multimedia that places importance on interactivity with a player.
[0021]
(2) Operation of icon processing routine
(1) Operation when icon EC1 is pointed
In the picture book page shown in FIG. 4, when the icon EC1 (“one banana”) is pointed with the touch pen 5, the pen position detection matrix 5a gives pointing position data to the CPU 11 accordingly. Thereby, the CPU 11 recognizes that the icon EC1 is pointed and activates the icon EC1 processing routine shown in FIG. 5, and advances the processing to step Sb1. Note that the pen tip of the touch pen 5 is provided with a micro switch, and when the pen tip is pressed against the pen position detection matrix 5a and the switch is turned on, the pointing position data is transferred to the CPU 11. It is captured.
[0022]
In step Sb1, a plurality of image data corresponding to the performance actions of the characters A to E of “elephant”, “flamingo”, “giraffe”, “crocodile” and “lion” are read from the ROM cassette 2, and the plurality of images are read. These characters A to E are displayed as moving images so as to perform percussion instrument performance as shown in FIG. In addition, the percussion instrument sounds (elephant: bass drum, flamingo: tambourine, giraffe: claves, crocodile: bongo, lion: cymbal) assigned to each character in synchronism with this percussion instrument performance are synthesized to create a “jungle band”. Start playing.
[0023]
Next, when proceeding to step Sb2, it is determined whether or not any of the characters A to E is pointed. Here, for example, it is assumed that the character A (“Elephant”) is pointed. If it does so, a judgment result will be "YES" and will progress to the following step Sb3. In step Sb3, the pointing character A, that is, the image of “elephant” is controlled to move forward one step on the screen, and the “tulip” displayed in front of the selected character has an open shape. Perform image control. In step Sb4, only the performance data corresponding to the character A (“Elephant”) is synthesized. In this case, the volume control is performed so that the volume of the “bass drum sound” that is the musical instrument of the character A (“Elephant”) is increased to enhance the solo.
[0024]
When the solo of the designated character is completed for the predetermined phrase in this way, the CPU 11 advances the process to step Sb5 to determine whether or not the reproduction has been completed (pointed) for all the characters A to E. Here, if the solos of all the characters A to E are not completed, the determination result is “NO”, and the above-described steps Sb1 to Sb4 are repeated. On the other hand, if the reproduction has been completed for all the characters A to E, the determination result is “YES”, and the flow proceeds to the next Step Sb6. In step Sb6, the rhythm pattern is updated in order to change the solo contents, assuming that the solos of the characters A to E have been completed.
[0025]
In step Sb7, it is determined whether or not all performance data of all rhythm patterns (for example, five types) stored in the ROM cassette 2 have been reproduced. If all types of rhythm patterns are not reproduced, the determination result is “NO”, and steps Sb1 to Sb6 are repeated again based on the rhythm patterns updated in step Sb6. When the solo for each character A to E is made for all the rhythm patterns, the determination result here is “YES”, and the CPU 11 returns the processing to the main routine described above.
[0026]
As described above, in the icon EC1 process, the animal (character) selected by the player advances one step on the screen, and the solo by the percussion instrument that the animal has is performed. At this time, the performance of the performance of the animal (character) is controlled in a moving image in synchronization with the performance sound, so that the visual effect and the acoustic effect as if the animal depicted in the picture book 3 is playing a percussion instrument. can get.
[0027]
(2) Operation when icon EC2 is pointed
In the picture book page shown in FIG. 4, when the player points the icon EC2 (“two bananas”) with the touch pen 5, the pen position detection matrix 5a provides pointing position data to the CPU 11 accordingly. Thereby, the CPU 11 recognizes that the icon EC2 is pointed and starts the icon EC2 processing routine shown in FIG. 6, and advances the process to step Sc1. In step Sc1, ADPCM data read from the ROM cassette 2 is supplied to the digital audio processing circuit 18 (see FIG. 2). As a result, voice reproduction is performed, and a narration instruction “Please touch a favorite animal” is given.
[0028]
Next, when proceeding to step Sc2, the CPU 11 waits until the player points any of the characters A to E in response to the narration instruction. Here, for example, when the character A (“Elephant”) is pointed by the player, the determination result is “YES”, and the process proceeds to the next step Sc3. In step Sc3, movement control is performed so that the image of the pointed “elephant” moves forward one step on the screen, and background image control is performed so that the “tulip” displayed in front of the “elephant” is opened. As a result, the image shown in FIG. 9 is displayed on the television receiver 20.
[0029]
In step Sc4, performance data of the percussion instrument corresponding to the designated character A is read out. In this case, the drum sound is played in a rhythm for one measure, and the performance operation of the character A is displayed in a moving image in synchronization with the performance. To do. Next, when this one-measure rhythm performance and moving image display is completed, the CPU 11 advances the process to step Sc5, transfers the ADPCM data read from the ROM cassette 2 to the digital audio processing circuit 18, and reads "pad with the same rhythm. Please give me a narration instruction. Further, in order to prompt the player to perform the pad operation, the narration “Ichini-san, yes” is reproduced by voice.
[0030]
Here, when the player hits the pad 8 (see FIG. 2) in response to this narration to cut the rhythm for one measure, the CPU 11 detects the pad operation in Step Sc6 and generates pad operation information. Subsequently, in step Sc7, while the performance operation of the character A is displayed as a moving image in accordance with the pad operation information, the drum sound is synthesized with the musical tone in synchronization with the pad operation information. That is, the character A is caused to perform a drum performance in response to the pad operation, and a drum sound is generated in synchronization with the operation. Next, when proceeding to step Sc8 (see FIG. 7), it is determined whether or not the appropriate rhythm pattern played in step Sc4 matches the pad operation timing by the player. If there is a predetermined error between the rhythm pattern and the pad operation timing, the determination result is “NO”, and the process proceeds to step Sc9.
[0031]
In step Sc9, the ADPCM data read from the ROM cassette 2 is transferred to the digital voice processing circuit 18 and voice synthesizes a narration “tap the pad again”. Thereafter, the CPU 11 repeats the above-described step Sc4 and subsequent steps. On the other hand, if the rhythm pattern matches the pad operation timing, the determination result in Step Sc8 is “YES”, and the process proceeds to Step Sc10. If the rhythm pattern matches the pad operation timing and the pad operation can be cleared, the fanfare sound is synthesized with a musical tone. In step Sc10, it is determined whether or not the pad operation has been cleared for all characters A to E. If it is not cleared, the determination result is “NO”, and the flow advances to next Step Sc11.
[0032]
In Step Sc11, for example, the next character B (“Flamingo”) is designated following the character A (“Elephant”) described above, and Step Sc3 and subsequent steps described above are repeated. When the pad operations related to all characters A to E are cleared, the determination result in step Sc10 is “YES”, and the flow proceeds to step Sc12. In step Sc12, image data corresponding to the performance actions of all the characters A to E, that is, "elephant", "flamingo", "giraffe", "crocodile" and "lion" are read from the ROM cassette 2, and these characters A to E are read. A video is displayed so that E plays a percussion instrument. Furthermore, in synchronism with this moving image display, the percussion instrument sound assigned to each character is synthesized with a musical tone and a “jungle band” is played.
[0033]
In this way, in the icon EC2 process, a percussion instrument participation event is made, and when the pad is hit so as to match the rhythm of the animal (character) selected according to the instruction of the narration, the character plays a performance specific to the instrument according to the pad operation. An action is performed, and the percussion instrument sound of the character is rhythmically generated. Then, when you hit one bar at the right time, a fanfare sounds and you move to the next character. For this reason, it is possible to cultivate an accurate sense of rhythm while playing like a game with multimedia that combines visual effects and acoustic effects.
[0034]
When the icon EC3 ("three bananas") shown in FIG. 4 is pointed, a percussion instrument participation event is performed in the same manner as the icon EC2 process. In the icon EC3 process, when a pad is hit so as to match the rhythm (two bars) of the animal (character) selected according to the narration instruction, the character will perform in response to the pad operation, and the corresponding percussion instrument sound will produce a rhythm sound. Is done. In this case as well, when a two-measure rhythm is carved in a timely manner, a fanfare sounds and the rhythm of the character can be cleared.
[0035]
Furthermore, when the icon EC4 (“4 bananas”) is pointed, a free performance event is executed. In this free performance event, any character is selected in a state in which all characters A to E are percussion ensemble ensemble, and the selected character performs according to the player's pad operation. Therefore, in these icon EC3 and EC4 processing, percussion instrument performance by actual pad operation is added to the visual effect as if the animal depicted in the picture book is playing the percussion instrument, and the sense of sound and rhythm are nurtured like a game. It becomes possible.
In the above embodiment, the musical instruments are all rhythmic musical instruments. However, the musical instrument sounds and image patterns are not limited to this. For example, as shown in FIG. 10, a wind instrument may be assigned to a character. Needless to say, stringed instruments and keyboard instruments may also be used.
[0036]
【The invention's effect】
As explained above, according to the present invention,After showing the example of performance by generating the instrument sound according to the performance pattern and displaying the animation of the character synchronized with the generated musical sound, the sound of the instrument sound and the animation display for performing the performance are displayed according to the performance operation. Since it is performed, it becomes possible to learn visually and auditorily the shape, tone color, and performance method of the instrument.
[Brief description of the drawings]
FIG. 1 is a diagram showing a schematic structure of a multimedia control device 1 according to the present invention.
FIG. 2 is a block diagram showing an electrical configuration of the embodiment.
FIG. 3 is a flowchart showing the operation of a main routine in the same embodiment.
FIG. 4 is a diagram showing an example of a picture book page in the same embodiment.
FIG. 5 is a flowchart showing an operation of an icon EC1 processing routine in the embodiment.
FIG. 6 is a flowchart showing an operation of an icon EC2 processing routine in the embodiment.
FIG. 7 is a flowchart showing an operation of an icon EC2 processing routine in the embodiment.
FIG. 8 is a diagram for explaining an operation of an icon EC1 processing routine in the embodiment;
FIG. 9 is a diagram for explaining an operation of an icon EC2 processing routine in the embodiment;
FIG. 10 is a diagram illustrating an example of an image pattern when a wind instrument is assigned to a character.
[Explanation of symbols]
2 ... ROM cassette (sound generation control means, image control means), 5 ... touch pen (instrument sound designation means), 5a ... pen position detection matrix (instrument sound designation means), 8 ... pad (performance operator), 11 ... CPU ( Musical instrument sound designating means, sound generation control means, image control means), 12... RAM, 14... Display control circuit (image control means), 15.

Claims (2)

A performance controller to be operated, and
A selection means for selecting one of the characters corresponding to the instrument;
Predetermined interval the instrument sound according to the performance pattern which represents the performance of the instrument corresponding to the selected character, after generating, when the predetermined interval, it said performance operators are performance operation, the performance relative to the performance operator Sound generation means for generating instrument sounds according to the operation;
Image control means for switching a plurality of image patterns representing a selected character, wherein the sounding means synchronizes with the instrument sound when the sound generation means generates an instrument sound according to the performance pattern; In the case where an instrument sound is generated in response to a performance operation on the operation element, image control means for displaying the character in a moving image so as to play the instrument in synchronization with the performance operation on the performance operation element is provided. A multimedia control device. A performance controller to be operated, and
A selection means for selecting one of the characters corresponding to the instrument;
Predetermined interval the instrument sound according to the performance pattern which represents the performance of the instrument corresponding to the selected character, after generating, when the predetermined interval, it said performance operators are performance operation, the performance relative to the performance operator Sound generation means for generating instrument sounds according to the operation;
Image control means for switching a plurality of image patterns representing a selected character, wherein the sounding means synchronizes with the instrument sound when the sound generation means generates an instrument sound according to the performance pattern; In the case where a musical instrument sound is generated in response to a performance operation on the operation element, in synchronization with the performance operation on the performance operation element, image control means for displaying the character in a moving image so as to perform the instrument,
A performance determination means for determining whether or not the performance represented by the performance pattern and the performance indicated by the operation on the performance operator are matched when the performance operator is operated;
A multimedia control apparatus comprising: notification means for notifying the determination result by the performance determination means.

Images