JPH10105369A - Image display control method and device therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To give variety to the changeover of a screen and to perform wide expressions by displaying images corresponding to image data at a display device and sounding musical sound corresponding to music data corresponding to the desired way of sounding. SOLUTION: When a user function is selected, a CPU 101 transfers the image data used for display from a program/data ROM 106 to a video display processor(VDP) 102. In the meantime, a sounding instruction for emitting music and effective sound is generated and outputted to a sound source processing circuit 104. Thereafter, the image data required for a controller 112 are read from the program/data ROM 106 and transferred to the VDP 102 and the sounding instruction is generated and outputted to the sound source processing circuit 104. In this case, image display data including the music data for which the data of the desired way of sounding are set are reproduced, the images corresponding to the image data are displayed at the display device and the musical sound corresponding to the music data are sounded corresponding to the data of the way of sounding.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for creating and combining image data and tone data, and displaying and producing the combined image data and tone data.

[0002]

2. Description of the Related Art Every time a scene changes in a role playing game of a video game, background music (hereinafter, referred to as background music).
BGM) can change together.

In a role playing game, a predetermined BGM is set in advance for each scene, and a BGM is set every time a scene changes.
GM also changes. Therefore, this preset B
No sound is produced except for GM.

[0004] In some video games, a "scene" and a "story" to be displayed on a screen are created, and music can be set in accordance with the scene and the story. The scene is made up of a combination of various parts such as a text display frame, a background, a character, and a balloon frame, and the user can select and combine any of these parts to create a desired one.

At the time of editing, a screen to be edited is specified, and a text display frame, background,
Select and set a character and a balloon frame. After the scene is completed, music to be matched with the scene is selected from pre-registered music and combined with scene data.

[0006] One scene is completed by combining and reproducing the scene data and music data.
This can be achieved by repeating the same task several times to create multiple scenes and playing them back with the story.

[0007]

As described above, in the conventional image display control of a video game, a predetermined BGM is set in advance for each scene, and the user sets the BGM for each scene. I couldn't do that.

[0008] In a video game in which a "scene" and a "story" to be displayed on a screen can be created and music set in accordance with the scene, a text display frame, background, Create your screen by selecting your favorite things from characters and balloon frames, etc. Then, select your favorite BGM from the preset songs and play it by combining the screen and BGM Met.

That is, the BGM can be simply set for the scene, and the BGM changes as the scene changes, and the change is poor. For example, when the scene ends, the BGM fades out, and the next BGM
It was not possible to make complicated settings such as fading in at the beginning of the game.

In addition, when creating a frame cartoon in editing a screen, a frame image is not displayed during the editing process, and a frame number must be specified when a frame to be edited is specified.

Therefore, it is necessary to confirm the frame number of the frame to be edited in advance. In order to confirm the frame number, the data had to be reproduced and displayed, which was difficult. Also, when confirming the quality of the entire frame image during the editing process, the editing process must be terminated, and the data must be reproduced and displayed.

[0012] An object of the present invention is to have a plurality of sounding data for controlling how music is switched to a scene, and to set the sounding data in image display data.
By changing the way the songs are switched, the switching of the screen is changed so that a wide variety of expressions can be performed.

In addition, when a frame comic is created in editing a screen, a frame-separated image can be displayed, a frame to be edited can be selected, and the quality of the entire frame-separated image can be confirmed. To make it easier to do.

[0014]

Means for Solving the Problems According to the present invention, the means of the first aspect for solving the above problems are as follows. It has a plurality of sounding data for controlling the connection of music when the image display data is switched.

[0015] Desired sound data is set in the music data in the image display data. By reproducing the image display data including the music data in which the desired sound data is set, an image corresponding to the image data is displayed on the display device, and the musical sound corresponding to the music data is generated according to the desired sound. Control. The operation of the first embodiment is as follows.

There are a plurality of ringing data for controlling how the music is connected when the image display data is switched, and the desired ringing data is set to the music data in the image display data.

By reproducing image display data including music data in which desired sound data is set, an image corresponding to the image data is displayed on a display device, and a musical sound corresponding to the music data is reproduced in the desired sound. It is controlled to sound according to the data.

The means of the second aspect is as follows. A plurality of screens corresponding to the image display data are provided in a plurality of first screen data. When the image display data is edited, the data of the first screen is displayed on the display device.

A desired one of a plurality of screens to be edited is designated from the first screens displayed on the display device.
The designated one desired screen is displayed as an editable image.

By editing an editable image and registering it as a desired one screen, it is possible to display the first screen during the editing processing and execute the editing processing. The operation of the second embodiment is as follows.

A plurality of first screen data corresponding to a plurality of screens corresponding to the image display data are provided. When editing the image display data, the data of the first screen is displayed on the display device.

A desired one of a plurality of screens to be edited is designated from the first screens displayed on the display device. One specified desired screen is displayed as an editable image.

By editing an editable image and registering it as a desired one screen, the first screen is displayed during the editing processing and the editing processing is executed. The means of the third aspect is as follows.

A ring that controls the connection of music when the data on the first screen, which is composed of a plurality of screens corresponding to the image display data, and the image display data are switched and the scene displayed on the display device changes. When editing image display data, the first screen is displayed on the display device.

A desired one of a plurality of screens to be edited is designated from the first screens displayed on the display device.
The designated one desired screen is displayed as an editable image.

The editing of the music including the setting of the desired ringing data to the music data in the image display data and the editing of the image are performed and registered as a desired one screen. By reproducing the image display data, it is possible to display an image corresponding to the image data on a display device and to control a tone corresponding to the music data to be generated according to the desired sounding data.

The operation of the third embodiment is as follows. Data on a first screen, which is composed of a plurality of screens corresponding to image display data, and ringing data for controlling the connection of songs when the scene displayed on the display device is changed by switching the image display data; When editing image display data, the first screen is displayed on the display device.

A desired one of a plurality of screens to be edited is designated from the first screens displayed on the display device. One specified desired screen is displayed on the display device as an editable image.

After the editing of the music including the setting of the desired ringing data to the music data in the image display data and the editing of the image are performed, they are registered as a desired one screen. By playing back the image display data, an image corresponding to the image data is displayed on the display device, and a tone corresponding to the music data is controlled so as to sound according to the desired sounding data.

[0030]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings.

First, the overall circuit configuration of a system to which the first embodiment of the present invention is applied will be described. FIG.
1 is an overall configuration diagram of a system to which a first embodiment of the present invention is applied.

In the system shown in FIG. 1, components other than the television 110 are configured in a housing (not shown). VDP (Video Display Processor) 1
Reference numeral 02 controls image processing related to sprites (objects), backgrounds, and the like.

In the present embodiment, a method (sprite method) of dividing an image into unit graphic elements and designating a drawing position, a drawing technique, and the like of each graphic element is used.

The VRAM (video RAM) 103 stores sprites (objects) and background image data and bitmap image data, which are the graphic elements. Note that the VRAM 103 is
Accessed from

The sound source processing circuit 104 generates sound data of musical tones generated together with images. Sound RAM
Reference numeral 105 stores tone waveform data processed by the sound source processing circuit 104 and their control data.

The program / data ROM 106 stores the CP
The program executed by U101 and various data used when executing the program are stored. CPU 101
Controls the VDP 102 and the tone generator 104 while using the work RAM 107 in accordance with this program.

The encoder 108 converts the RGB analog video signal sent from the VDP 102 into a TV standard video signal (NTSC signal). D / A converter 109
Converts the digital sound data sent from the sound source processing circuit 104 into an analog sound signal.

The television 110 reproduces a video signal output from the encoder 108 and a sound signal output from the D / A converter 109. The printer unit 111 prints an image displayed on the television 110.

The controller 112 has a function of moving a cursor displayed on the television 110 and the like.
The user is caused to perform various operations. The operation of the first embodiment of the present invention will be described.

The overall schematic operation of the circuit will be described. The CPU 101 includes a program / data ROM 106
By executing the program read from the
While using the AM 107, an instruction given by the controller 112 is detected, and the VDP 102, the sound source processing circuit 104, and the printer unit 111 are controlled.

The program / data ROM 106 stores image (graphic) data of graphic elements (partial images) of sprites (objects), bitmaps, and backgrounds constituting an image. Sprites (objects) are mainly used to represent moving (including shape changes) characters, bitmaps are used to represent characters that are fixedly placed on the screen, and backgrounds represent backgrounds. Parts to do.

As described above, the image display control device to which the first embodiment of the present invention is applied has various functions. Although a detailed description is omitted, for example, the function (mode) can be arbitrarily selected by clicking an icon displayed on the screen by the controller 112.

The CPU 101 allows the user to perform functions (modes).
Is selected, image (graphic) data to be used for display is displayed on the VDP 102 from the program / data ROM 106 in order to display a screen corresponding to the selected image on the television 110.
Transfer to On the other hand, it generates and outputs a sounding command to the sound source processing circuit 104 for emitting music, sound effects, and the like. Thereafter, in accordance with an operation performed by the user on the controller 112, necessary image (graphic) data is read from the program / data ROM 106 and transferred to the VDP 102, and a sound generation command is generated to generate a sound generation command for the sound source processing circuit 104. Output at any time.

The VDP 102 stores the image (graphic) data transferred from the CPU 101 in the VRAM 103 in a predetermined format for each type. Using image (graphic) data stored in the VRAM 103, an RGB analog video signal of an image to be displayed is generated for each scanning line.

The RGB analog video signal generated by the VDP 102 is output to the encoder 108. The encoder 108 converts the image represented by the video signal into the television 11
In order to display the video signal on the screen of No. 0, the video signal is converted into a video signal of the NTSC standard which is a television standard, and then output to the television 110. The television 110 draws an image on the screen by raster-scanning the screen.

A description will be given of a case where the detailed operation of the first embodiment of the present invention is applied to a video game capable of producing a frame cartoon. In this video game, scenes and music can be created for each frame, and by putting the created frame on the frame split screen, a frame cartoon can be created, and when the created frame cartoon is played, the frames are played in order, and at that time Music also sounds at the same time.

The overall flow will be described with reference to the main flowchart of FIG. In particular, when a power switch (not shown) is turned on, initialization such as clearing the contents of the registers in the CPU 101 and clearing the contents of the VRAM 103, the sound RAM 105, and the work RAM 107 is performed (S201).

In step S202, it is determined whether the controller 111 has instructed the editing mode or the reproduction mode. In the editing mode, an editing screen appears and editing can be performed. In the playback mode, by playing back the image display data,
The edited image and music are played.

Next, the editing process will be described in detail with reference to the flow of the editing process shown in FIGS. In the editing processing, necessary processing is performed by the CPU 101 executing a program stored in the program / data ROM 106.

First, the frame-divided image is written into the display image area of the VRAM 103 (S301). The frame-separated image has a format corresponding to one page of a comic frame-divided, and has a plurality of types.

When editing a scene, a frame number to be edited is input (S303), and a corresponding image is written in the display area (S305). When the frame image is displayed, a scene is created by selecting a background image, selecting a character, and the like (S306).

FIG. 5 shows an example of the frame editing screen. This frame editing screen is a screen on the assumption that a mouse is used as the controller 111, and can be edited by clicking a desired icon on the icon board.

When the scene is completed, if another frame is to be edited, the same operation is repeated. If another frame is not to be edited, the flow advances to step S309. In step S309, it is determined whether or not another object (music) is to be edited. If another object is to be edited, the frame split image is written in the display area of the image display data (S310), and the process proceeds to music editing. If another object is not edited, the process returns.

The structure of the image display data will be described later. When editing music, a frame number to be edited is input (S303). Then, the music is played based on the music number stored in advance at the designated frame number (S314).

If the user wants to change the tune by listening to the played tune, the user designates the number of the tune data of the desired tune from the tune data stored in the program / data ROM 106. The music data is rewritten (S316). The song can be changed any number of times by repeatedly specifying and rewriting the music number.

Here, the music information table will be described.
The data configuration of the song information table is as shown in FIG. 6, and is stored in the VRAM 103 or the like.

The music number is a serial number of data stored in the music information table. The song data designation stores the number of the song data stored in the program / data ROM 106 in the song information table.

The designation of how to play is a method of designating the connection between songs. For example, 0 means normal connection, 1 means ringing again, 2 if the song fades out, and the next If the song starts with a fade-in, if 3 the song fades out and ends,
The next song starts with fade-in from the middle of the song fade-out.

The description returns to the editing process. If it is not necessary to change the tune by listening to the tune played, the user then sets how to play the tune.

When it is desired to change the sounding method, a desired sounding number is designated from the sounding data stored in the program / data ROM 106, and a rewriting process of the sounding number in the music information table is performed. Do (S
318). The change of the ringing method can be performed any number of times by repeatedly specifying and rewriting the number of the ringing method.

After the music of the currently processed frame and the manner of sounding have been determined, when editing another frame, step S31 is performed.
Returning to step 1, when another frame is not edited, it is determined whether or not another object is edited (S 322). When another object is edited, the process returns to step S 301, and when another object is not edited, the process returns.

By performing the above processing, the scene and the music for each frame are completed, and the image display data is completed. Here, the image display data will be described.

FIG. 7 shows an example of the data structure of the image display data.
Shown in The image display data includes progress data for controlling the progress of the cartoon, image data that is data of an image created and edited, song designation data that is data of a song created and edited,
And a display area indicating a display position of a window or the like.

The above data are temporarily stored in a RAM (not shown) inside the CPU 101 and processed. The data configuration of the progress data is as shown in FIG.

A plurality of pieces of frame data to be displayed are stored in the progress data in the display order, and the frame data includes an image number, a music number, and a branch destination number created by the editing process.

The data structure of the image data is as shown in FIG. A plurality of images to be displayed are stored in the image data, and are specified by the image numbers of the progress data.

The data structure of the music designation table is as shown in FIG. The song designation table includes a song number data section and a ringing data section. The song number data section stores the song number, and the ringing data section stores the ringing number.

The music designation table is designated by the music number of the progress data. The writing process of the image display data is as shown in FIG. C of image display data
The storage from the PU 101 to the VRAM 103 is executed, for example, within each vertical blanking period, whereby the display screen can be changed every moment.

Next, the data format of the image display data will be described. FIG. 12 shows an example of the data format of the image display data, which is described in the C language.

The data format of the image display data will be described with reference to FIG. Words are pRomHinagata (template structure address specification) that directly specifies addresses, pTxWinText (text window character data address specification), pQAWinText (Q & A window character data address specification), pQA1Text (character data address specification for Q & A branch 1), pQA2Text (character data address specification for Q & A branch 2), pQA3Text (character data address specification for Q & A branch 3), pNextKoma1 (structure address specification of next frame for Q & A branch 1), pNextKoma2 (structure of next frame for Q & A branch 2) Address designation), pNextKoma3 (structure address designation of next frame for Q & A branch 3), TxWinPos (text window display position), wSysFlags (various system flags), and wThruNum (passing number).

Note that the Q & A is a question for asking a user a question as the story progresses on the screen, and allowing the story to branch into a number depending on the answer.

The various system flags will be described. FIG. 13 is a data configuration diagram of various system flags. Various system flags consist of 16 bits from bit 0 to bit 15, frame display time, text window type,
The number of branches, the Q & A window position, and the data type bit are provided.

By setting a flag for each bit,
Processing according to the flag is performed. Next, the pass number of the data format of the image display data will be described.

FIG. 14 is a diagram showing the data structure of the pass number. The pass number is displayed and sounded by designating the created music number and animation number. Of the 16 bits, the lower 8 bits specify the animation number, and the upper 8 bits specify the music number. As for the music number, 0 means music stop, and fff means continuation of the previous music.

The music number of the pass-through number specifies the type of music and the way of switching between songs as shown in the music information table of FIG. 6, so that the method of switching between songs can be changed.

Next, the reproduction processing will be described with reference to the reproduction processing flow shown in FIGS. First, N is incremented by 1 (S1501).

Then, the N-th data of the frame data stored in the RAM (not shown) inside the CPU 101 is designated (S1502), and the image corresponding to the image number of the frame data is written in the display area (S1503). .

The music number of the designated frame data is called (S1504), and if "0" (music stop), a music stop instruction is issued (S1506), and step S141 is performed.
No. 6, if "fff" (continues the previous song), go to step S1516; if it is a song number, go to step S14
07 (S1505).

The song data corresponding to the music number and the manner of sounding are called (S1507), and if the same as the previous song, an instruction for a new manner of sounding is issued for the same song. If the song changes, a song switching instruction (S1509). And give instructions on how to make a new sound.

After instructing how to sound, it is determined whether or not there is a branch (S1516). If there is no branch, it is determined whether or not to end. A determination is again made as to whether there is a branch.

If there is a branch, the branch number of the frame data is read, and it is determined whether the branch is "0" (S15).
19). If the branch is “0”, the process proceeds to step S1517. If the branch is other than “0”, the branch number is incremented to N (S1520), and the process returns to step S1502 to repeat the process.

As described above, the images, songs,
By allowing the user to edit the way of switching between songs, the way of switching between songs can be set freely, and by performing a reproduction process based on this image display data, it is possible to realize a BGM that changes.

Next, a second embodiment of the present invention will be described. The overall configuration and operation of the system according to the second embodiment of the present invention are the same as those of the first embodiment of the present invention. Can be selected.

The second embodiment of the present invention is also the first embodiment of the present invention.
Similar to the embodiment described above, a case where the present invention is applied to a video game capable of creating a frame cartoon will be described. The image editing process will be described. The editing processing other than the processing described below is the same as that of the first embodiment of the present invention.

The editing process is executed by the CPU 101 using the program /
By executing the program stored in the data ROM 106, necessary processing is performed. First, the frame split image is written to the display image area of the VRAM 103. The frame-separated image has a format corresponding to one page of a comic frame-divided, and has a plurality of types.

When an image is selected as an object to be edited, a frame-divided image is displayed. FIG. 17 shows an example of the frame division screen. This frame division screen is a screen on the assumption that a mouse is used as the controller 111, and can be edited by clicking a desired icon on the icon board.

By clicking a frame of the displayed frame-separated image, the image of the corresponding frame is written in the display area. When the image of the selected frame is displayed, a scene is created by selecting a background image, a character, and the like.

When the scene is completed, if another frame is to be edited, the same operation is repeated. If another frame is not to be edited, the music is edited or ended. As described above, since a frame to be edited can be quickly selected from the displayed frame-separated images, the editing operation becomes very easy.

Next, a third embodiment of the present invention will be described. The overall configuration and operation of the system according to the third embodiment of the present invention are the same as those of the first embodiment of the present invention. The system has a plurality of sounding data, and the sounding data is used in music editing processing. The information can be set in the information table, and a frame-separated image is displayed when an image is edited in the editing process, so that a frame to be edited can be selected.

The image editing process is the same as in the second embodiment, and the reproduction process and the music editing process are the same as in the first embodiment of the present invention. Therefore, in the image editing process, a frame to be edited can be quickly selected from the displayed frame-separated images, and the editing work is very easy to perform.
It is possible to create BGM that changes.

[0091]

According to the first embodiment of the present invention, there are a plurality of sound data for controlling how the music changes, and it is possible to specify the music data and the sound data at the time of the editing process.

At the time of the reproduction process, the music data and the ringing data are designated by the designated music number.
It is pronounced by the specified song and the specified sound. Therefore, by freely combining the song data and the sounding data, it is possible to create a BGM that changes.

In the second embodiment of the present invention, a frame-separated image can be displayed in the editing process. By displaying frame-by-frame images, you can quickly select the frame you want to edit from the displayed frame-by-frame images,
Work efficiency increases.

Further, the quality of the entire frame-separated image can be confirmed even during the editing, and the editing work becomes very easy. In the third embodiment of the present invention, there are a plurality of ringing data for controlling how the music changes, and when the editing process is performed, the song data and the ringing data are also specified. Images can be displayed.

Therefore, the music data and the sounding data can be freely combined, so that it is possible to create a BGM that changes. In addition, by displaying the frame-separated image, a frame to be edited can be quickly selected from the displayed frame-separated images, thereby increasing work efficiency. Further, the quality of the entire frame-separated image can be confirmed even during editing, and the editing operation becomes very easy.

[Brief description of the drawings]

FIG. 1 is an overall circuit diagram of a first embodiment of the present invention.

FIG. 2 is a main flowchart of the first embodiment of the present invention.

FIG. 3 is an editing process flow (1) according to the first embodiment of this invention;

FIG. 4 is a flowchart (part 2) of an editing process according to the first embodiment of this invention;

FIG. 5 is an example of a frame editing screen.

FIG. 6 is a music information table.

FIG. 7 is a data configuration of image display data.

FIG. 8 is a data configuration of progress data.

FIG. 9 is a data configuration of image data.

FIG. 10 is a data configuration of a music designation table.

FIG. 11 shows a process of writing image display data.

FIG. 12 is an example of a data format of image display data.

FIG. 13 shows the configuration of various system flags.

FIG. 14 shows a configuration of a pass number.

FIG. 15 is a reproduction processing flow (part 1) of the first embodiment of the present invention.

FIG. 16 is a reproduction processing flow (part 2) of the first embodiment of the present invention.

FIG. 17 is an example of a frame split image.

[Explanation of symbols]

 101 CPU 102 VDP 103 VRAM 104 Sound source processing circuit 105 Sound RAM 106 Program / data ROM 107 Work RAM 108 Encoder 109 D / A converter 110 TV 111 Printer 112 Controller

Continued on the front page. (72) Inventor Shohei Sakamoto 3-2-1 Sakaemachi, Hamura-shi, Tokyo Casio Computer Co., Ltd. Hamura Technical Center (72) Inventor Ryuji Usami 3-2-1, Sakaemachi, Hamura-shi, Tokyo Casio Computer Hamura Technical Center Co., Ltd.

Claims (6)

[Claims] 1. A method for controlling switching of music when continuously reproducing a plurality of image display data including image data and music data, comprising: a connection of music when the image display data is changed. A plurality of sounding data for controlling the sound, setting desired sounding data in the image display data, and playing back the image display data, thereby displaying an image corresponding to the image data on a display device and music. An image data control method, wherein a tone corresponding to data is generated according to the desired sounding data. 2. A method for controlling an edited image of image display data including image data and music data, wherein the first screen includes a plurality of screens corresponding to the image display data. When editing the image display data, displaying the first screen on a display device, and selecting a desired one of the plurality of screens to be edited from the first screen displayed on the display device. Image data control, wherein the designated one desired screen is displayed as an editable image, the editable image is edited, and registered as the desired one screen. Method. 3. A method for controlling editing and reproduction of image display data including image data and music data, wherein the first screen includes a plurality of screens corresponding to the image display data. A plurality of data, and a plurality of ringing data for controlling how the music is connected when the image display data is switched. When editing the image display data, displaying the first screen on a display device; Specifying a desired one of the plurality of screens to be edited from among the first screens displayed on the apparatus, displaying the specified desired one as an editable image; and displaying the image display data. Edit the song including the setting of the desired ringing data and edit the image, and register it as the desired one screen. By playing back the image display data, it is possible to correspond to the image data. Could tone corresponding to the music data in accordance with said desired sound way data and displays the image on the display device, the image data control method, characterized in that. 4. An image display device which edits and reproduces image display data including image data and music data, wherein the image and music of the image display data of the image display data and a screen corresponding to the image display data are provided. A plurality of different pieces of first screen data having a plurality of different configurations, and displaying a screen to be edited of the image display data, wherein the image display data and the first Screen data is selected and combined from the data of the image display data and the data constituting the composition of the music, and further edited, and further, the edited image display data and progress data for controlling the progress of the first screen data. Editing means for creating the image display data, the first screen data edited by the editing means, and the progress data created by the editing means. Editing data storage means for storing the image display data, the first screen data, and the progress data stored in the editing data storage means; and And a display means for displaying the image display data. 5. The method according to claim 1, wherein the data storage unit includes the image display data and the first screen data as the image of the image display data and data of how to play a song as data of a composition requirement of the song. The image display control device according to claim 4, wherein 6. The image display control device according to claim 4, wherein the editing unit displays the first screen data on the display unit.