JP3363390B2 - Editing device for lyrics subtitle data - Google Patents

Description

Description: BACKGROUND OF THE INVENTION [0001] 1. Field of the Invention [0002] The present invention relates to a rational technique for producing a lyric subtitle image that is indispensable to an image of a singing song. And an editing device for lyrics subtitle data which is a root when the color is changed according to music. 2. Description of the Related Art As a subtitle image of a singing song,
One of the prerequisites is easy to sing and easy to read poetry
Lyric subtitles laid out on the screen in appropriate phrases
The other condition is that the song
Singing while displaying lyric subtitles at a timing that is easy to sing
Smoothly change the subtitle display color to trace the part
It is to continue. Conventionally, keyboards and display devices
A series of subtitle videos by a personal computer equipped with
There was a device that can generate as a material. With this conventional device
Is a subtitle character by screen interactive text editing technology
To set the screen layout of
You. In the process of putting together the video material produced in this editing work as a video with subtitle color change change linked to the music progression, manually operated video editing equipment is used,
To match the timing with the song progression, adjust the display timing of the lyrics subtitle while actually listening to the playback sound of the recorded song, and also about the subtle movement when producing the subtitle color change video that encourages the lyrics progression The expression was made by manual operation. [0003] However, in a color change video editing operation performed by a manual operation such as tracing a subtitle video in time with music progression while listening to music, hand movements are directly reflected in the video. Therefore, a considerable amount of practice was required for each song, and it was necessary to start over and over again to obtain a highly complete color change video . So the lyrics change color
Subtitle video editing requires a considerable amount of skill,
For such a skilled person is a troublesome and troublesome work
There was . [0004] Further, when the font of the subtitles or the screen layout is changed, it is necessary to redo all of the same music, including the video editing work. SUMMARY OF THE INVENTION The present invention has been made in view of the above-described conventional problems, and has as its object to appropriately perform data editing work of color-changing lyric subtitles even without a specially skilled person. Another object of the present invention is to provide a rational lyrics subtitle data editing device that does not require recreating the color change related information of music and lyrics subtitles even if the subtitle font and screen layout are changed. A lyric subtitle data editing apparatus according to the present invention is specified by the following items (1) to (5). (1) An editing device for lyrics subtitle data including input means and processing means. (2) The input means can perform a layout operation of character information on the screen of the display means. (3) The processing means performs subtitle coordinate determination processing and subtitle time determination processing. (4) In the subtitle coordinate determination processing, the input character information is displayed on the display unit, and the character coordinate information determined based on the layout operation is stored in the storage unit in association with the character information. (5) The subtitle time determination process displays the input musical score information and character information on the display means, and based on the positional relationship with the musical score associated with the layout operation.
Singing time information for each character is generated and stored in the storage means. By storing score data and lyrics data with high synchronism with the performance sound in a database, the work to be manually performed in the process of visualizing the lyrics subtitles is generally familiar with a score. In addition to the work of editing the subtitles of the lyrics to set the screen layout of the lyrics subtitles, it is possible to combine the editing of the lyrics and the score to set the interlocking of the lyrics subtitles with the progression of the music. The video signals of the lyrics subtitles are automatically and collectively generated for each song in two work forms having the above-mentioned work. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A first embodiment of the present invention will be described below with reference to FIG. 1. 1 is a display device using a CRT display, 2 is an input device using a keyboard, 3 is a storage device using a hard disk, Is a video output device, 5 is a CPU
The processing device 6 represents a timer device. The subtitle editing of the lyrics data, which is a work process for satisfying the first condition of the lyrics subtitle video, will be described. In order to generate lyrics subtitles laid out on the screen in appropriate clause units that are easy to sing and easy to read poetic information. In
First, the character information of the lyrics is input, the lyrics data for each song is created, the lyrics data is displayed on the display device 1 using the subtitle character font, and the screen layout of the lyrics subtitle is displayed while checking the image 10 to be displayed. The subtitle editing of the lyrics data is performed by a processing function of adding information (caption coordinates) regarding the character layout as the subtitle to the lyrics data by the setting operation. In this case, the subtitle character font is stored in the storage device so that the font of the subtitle character can be changed as necessary. More specifically, a CRT using the keyboard 2
Lyrics data is input using a document creation function in an interactive manner with the screen of the display 1, and the lyrics document created for each song is stored on the hard disk 3 as a lyrics data file. Further, the subtitle image 10 of the lyrics data drawn using the subtitle character font pattern of the hard disk 3 is projected onto the CRT display 1, and the lyrics are subtitled, and edited using the subtitle layout function for each page. By performing appropriate subtitle editing using these functions, it is possible to obtain lyrics data with fixed subtitle coordinate information including page layout and subtitle layout. On the other hand, the input of the musical score data is performed by the keyboard
The pitch, length, etc. of each note should be entered in numerical form, and the content of the score is sufficient for the melody part for recognizing the singing progress, but the entire song including the prelude and interlude Is stored on the hard disk 3 as a musical score data file in music units expressing the time lapse. Next, an operation process for satisfying the second condition of the lyrics subtitle image will be described. The lyrics subtitle is displayed at an easy-to-sing timing in accordance with the progress of the music, and the sung portion is traced. In order to smoothly change the display color of subtitles, it is effective to use a musical score as a means of imaging the progress of music in the work of setting the link between the lyrics and the progress of music. To describe the music composition editing of the lyrics data, data necessary for expressing the music such as notes, rests, time signatures, tempos, etc. are input to create music data for each music piece, and the lyrics data and An image 11 obtained by synthesizing the musical score data is displayed on the display device 1. The horizontal axis of this screen is treated as time coordinates depending on the time signature, tempo, etc., and the song data progresses to the lyrics data by accurately arranging the lyrics data in character units corresponding to the notes on the score as the original music score It has a processing function of adding information (singing time) relating to interlocking with the song. More specifically, a combined edited image 11 obtained by combining and editing musical score data and lyrics data is converted to a CR.
The lyrics are moved right and left in units of characters so that the lyrics are displayed on the T display 1 and the lyrics can be arranged corresponding to the score, and various functions are provided by using various functions provided to efficiently arrange the lyrics at an arbitrary position. Edit. In this case, since the entire score cannot be displayed on one screen of the CRT display 1,
The next and previous scores are displayed in order by the page feed function to cover the whole music. If measures that are repeatedly sung are treated as common measures, the first lyrics 12,
The second lyrics 13 and the third lyrics 14 can be displayed side by side, and the efficiency of editing work can be improved. Utilizing these functions, the music data is synthesized and edited according to the original music score, and the lyrics data with the finalized lyrics time information for each character is created.
This is stored in the hard disk 3 again. In this way, based on the subtitle coordinate information in the character unit and the lyrics data in which the lyrics time information has been determined, the page group is assigned assuming the time progression of the music progressing from the prelude to the moment. The singing character that is displayed based on the singing time information of each displayed character by performing subtitle display at the optimal display timing of the page estimated from the singing time of the first character of Lyric subtitle video that continuously sends to the video output device 4 a drawing signal for imaging a series of subtitle developments appropriately linked to music progression, such as repainting of character colors that smoothly traces through Is provided. In this case, if the musical score data and the lyrics data, which are highly synchronized with the performance sound, are stored in the database, in addition to the work of editing the subtitles of the lyrics for setting the screen layout of the lyrics subtitles. To provide a production environment capable of automatically generating video signals of lyrics subtitles in units of music in two forms of work, which combines the work of synthesizing and editing lyrics and music to set the interlocking of the lyrics subtitles with the progress of music. In the process of visualizing the lyric subtitles, the work to be performed manually can be centralized to desk editing through a generally familiar and easily accepted medium such as a musical score. According to the work process utilizing the above processing functions, based on the subtitle coordinate information, the singing time information and the subtitle character font information added to the lyrics data, the optimal timing is set in accordance with the lapse of time from the start of the music. By executing a processing function of transmitting a drawing signal for displaying lyrics subtitles and a drawing signal for smooth color change expressing the singing progress of the subtitles to the video output device 4 continuously until the end of the music, The batch automatic generation processing of the lyrics subtitles is completed. A time base signal for managing time according to the value of the tempo representing the speed of the music is generated by the timer device 6. The time base signal for managing the passage of time reproduces the speed of the music and is output to the processing device 5 as a timing clock having a frequency dependent on the value of the tempo on the musical score. In this case, the tempo value is the number of quarter notes played in one minute, and if the number of timing clocks corresponding to quarter notes is 48, the number of times is 48 times the tempo value per minute. Is given by the timing clock. By using such a timing clock proportional to the tempo value as a time base signal for time management, lyrics subtitle images that are accurately linked to the speed of music given at an arbitrary tempo value are automatically and collectively generated. Processing is achieved. As shown in FIG. 4, the video output device 4 changes every moment in accordance with a drawing signal input from the processing device 5, that is, a write address and color information to a frame memory in which a video screen is imaged. The subtitle image on the frame memory is read out from the address counter by the readout address generated in the timing and scanning order for the video signal, and converted to the video signal by the video signal encoder, so that the lyrics subtitle image is converted to the video signal. May be obtained. In this case, as shown in FIG. 5, if the subtitle image signal obtained by reading the frame memory is preferentially mixed with the external video signal using a read address synchronized with the external video, The subtitles can be obtained as superimposed video signals. In the above-mentioned processing operation, if there is a time lag between a series of lyric subtitle images generated in real time according to the musical score data and music played according to the same musical score, it is due to a difference in tempo. Things. FIG. 2 shows a second embodiment of the present invention which solves this problem. That is, a metronome sound generating device 7 linked to the timer device 6 is provided to eliminate the above-mentioned difference in tempo, and the time base signal serving as a reference of the musical note data has a frequency 48 times the frequency of the metronome sound. It outputs as a timing clock and manages the progress tempo of the lyrics subtitle video using the quarter note on the musical score as 48 clocks. This is provided in order to further enhance the synchronism between the lyrics caption image generated in real time according to the input musical score data and the performance sound of the music, and is determined by an arbitrarily set tempo value. It generates a metronome sound with a time signature, and unifies and manages this metronome sound and a time base signal that is used as a reference for engraving the musical note length, and is played at a tempo that matches this metronome sound Lyric subtitle images that are completely synchronized with the music can be generated. The lyrics subtitle video generated in the above-described embodiment 2 is used to control the performance speed to enhance the synchronization, and is more synchronized with the music played at the tempo according to the metronome sound. It is highly likely. FIG. 3 shows a third embodiment of the present invention in which the synchronism is enhanced by inputting musical score data according to the performance. This replaces the timer device with an audio playback device 9 with a time code,
Music data corresponding to the tempo of the played music is obtained. A recording medium (tape) on which a time code is recorded together with a performance sound is reproduced by an audio reproducing device 9, and the time code obtained by this is recorded on a time base. It is intended to be used as a signal. In this case, it is possible to generate an effective lyrics caption image for a song that has already been recorded or a song with an unfixed tempo. That is, the musical score data is input based on the performance information obtained by playing the melody in real time with the MIDI keyboard 8 in accordance with the performance sound and the time code based on the accompaniment reproduction sound of the recorded recording tape. Automatically generates music score data based on melody performance information input via MIDI signal and playback time code from tape, and is completely synchronized with recorded accompaniment sounds. The obtained score data is obtained. It should be noted that even at the stage of generating the lyrics subtitle image, more complete synchronization is ensured by managing the time code reproduced from the audio reproducing device 9 as a time base signal. The video output device 4 converts an image of the drawing signal output from the processing device 5 into a video signal and outputs the video signal. The video output device 4 includes a VTR (video tape recorder),
In addition to outputting a video signal to be recorded on an LD (laser disk) or the like, encoding corresponding to a code system for various computer graphics video media such as CD (compact disk) graphics and CD-I. A function may be provided so that a digitally encoded video signal can be output. Alternatively, an external video may be input and a video signal in which lyrics and subtitles are superimposed on the video may be output. (1) Conventionally, a video editing device is
Use and listen to the music while listening to the music
Performing manual work such as tracing lyrics lyrics to progress music
The color change of the combined lyrics subtitles was being edited. This edit
Performing the work properly is very difficult and cumbersome,
He had to rely on long hours of work by the practitioner . On the other hand, in the present invention, the musical note position
The work of appending the lyrics characters according to the location
By performing on the screen, the music score between the lyrics subtitle and the music progression
Singing time information that defines the relationship between each character of the lyrics
Is added to the character information of the lyrics subtitle.
Anyone with basic knowledge of how to read
The editing work of the lyrics subtitle data can be performed appropriately.
Lyrics subtitle data that was easily and reasonably produced
Based on the lyrics and sing along with the music
You can easily change colors . (2) The lyrics subtitle data edited by the apparatus of the present invention is composed of a series of character information constituting the lyrics subtitle, and subtitle coordinate information defining the layout of the lyrics subtitle on the screen. And singing time information defining the musical time relationship between the lyrics caption and the music progression for each character of the lyrics. Therefore, the singing time information for each of the lyrics is not changed even if the font or screen layout of the existing subtitle data is changed for some reason.
Since it is specified for each character, there is no need to recreate the singing time information that is the basis of the color change video of the lyrics subtitle.
Therefore, the lyrics subtitle data edited by the apparatus of the present invention becomes general-purpose data suitable for various display output systems.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram of a lyric subtitle video batch automatic generation system and an example of an editing screen showing a first embodiment of the present invention. FIG. 2 is a block diagram of a lyric subtitle video batch automatic generation system showing a second embodiment of the present invention. FIG. 3 is a block diagram of a lyric subtitle video batch automatic generation system showing a third embodiment of the present invention. FIG. 4 is a block diagram illustrating an example of a video output device used in the present invention. FIG. 5 is a block diagram showing an example of a video output device with a superimpose function used in the present invention. [Description of Signs] 1 display device 2 input device 3 storage device 4 video output device 5 processing device 6 timer device 7 metronome sound generating device 8 MIDI keyboard 9 sound reproduction device 10 subtitle image of lyrics data 11 synthesized edited image

──────────────────────────────────────────────────の Continuing on the front page (51) Int.Cl. ⁷ identification symbol FI H04N 5/278 H04N 5/278 5/76 5/76 Z (58) Investigated field (Int.Cl. ⁷ , DB name) G10K 15/04 302 G09G 3/20 660 G09G 3/20 680 G09G 5/00 510 H04N 5/262 H04N 5/278 H04N 5/76 G10G 3/00

Claims (1)

(57) [Claim 1] An editing device for lyrics subtitle data comprising input means and processing means, wherein the input means is capable of performing a layout operation of character information on a screen of a display means. The processing means performs caption coordinate determination processing and caption time determination processing. In the caption coordinate determination processing, the input character information is displayed on the display means, and the character coordinate information determined based on the layout operation corresponds to the character information. The subtitle time determination processing is to display the input musical score information and character information on the display unit, and based on the positional relationship with the musical score correlated based on the layout operation. An apparatus for editing lyrics subtitle data that generates singing time information for each character and stores the information in a storage unit.