JP2004215126A - Multilanguage adaptive moving picture delivery system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a system which enables delivery of a moving picture selected by a user, by easily adding voice or subtitle text in an arbitrary language. <P>SOLUTION: A multilanguage adaptive moving picture delivery system 10 comprises a center server 12, a delivery server 14, and a client PC 16. The center server 12 comprises a moving picture file storage part 30; a voice file storage part 32, which stores voice files by the language; a subtitles text file storage part 34 which stores subtitles text files by language; a means of promoting the selection of a moving picture file, by sending a list to the client PC 16; a means of promoting selection of a specific language, by sending a form for selecting a language for a voice file and a subtitles file corresponding to the moving picture; and a means of streaming delivery of the moving picture file, the voice file, and the subtitles text file to the client PC 16 via the delivery server 14, when the information on specifying the language is sent. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a multilingual video distribution system, and more particularly to a system for streaming video data to a number of client terminals via a communication network (such as the Internet) together with audio data and caption text data in an arbitrary language.
[0002]
[Prior art]
In recent years, as high-speed and large-capacity communication lines such as ADSL and FTTH have become widespread, it has become possible for general users to receive video data such as movies over a relatively long period of time via the Internet and view them on a personal computer at home. Was.
In this case, by using the streaming distribution technique, the user can play back the video data simultaneously with the reception of the video data without waiting until the download of the video file is completed. Streaming distribution is generally a method that also contributes to copyright protection of moving images, since moving image data is erased at the same time as reproduction, and no copy remains on the client terminal side.
[0003]
[Problems to be solved by the invention]
By the way, when distributing a foreign-made video file to Japanese, it is usually necessary to prepare a video file in which original video data is combined with Japanese dubbed audio or subtitle text.
However, if this video is to be viewed by non-Japanese Chinese, Brazilian, Korean, etc., it will be necessary to individually create a video file that combines voice-over audio and subtitle text for each language. There is a need for complicated editing work.
In addition, when a large-volume moving image file is prepared for each language and distributed to each user, the capacity of the storage medium increases accordingly, and the cost increases.
[0004]
The present invention was devised in order to solve the above-mentioned problems of the conventional moving image distribution system, and easily adds a voice-over sound or subtitle text in an arbitrary language to a moving image selected by a user. It is intended to realize a system that can distribute the data.
[0005]
[Means for Solving the Problems]
In order to achieve the above object, a multilingual video distribution system according to claim 1 includes a server connected to a client terminal (a personal computer, a personal digital assistant, a mobile phone, or the like) via a communication network such as the Internet. A moving image distribution system comprising: a storage unit that stores a plurality of moving image files; a storage unit that stores an audio file for each language prepared for each moving image file; Storage means for storing subtitle text files prepared for each language prepared for each file; means for transmitting a list of video files to the client terminal to prompt selection of a specific video file; When the information for identifying the video file is transmitted, a file describing the language of the audio file and subtitle file corresponding to the video file is transmitted. Means for prompting the user to select a specific language, and, when information for specifying the language is transmitted from the client terminal, the location information (URL, etc.) of the corresponding moving image file, audio file, or subtitle text file is transmitted. Notifying means, and means for, when a distribution request for the moving image file, audio file, and subtitle text file is transmitted from the client terminal, performing streaming distribution of data of each file to the client terminal. And
[0006]
As described above, a plurality of audio files and subtitle text files in different languages are prepared for each moving image file on the server side, and the moving image file, the audio file, and the subtitle file selected by the user are streamed to the client terminal. Allows a user to view a moving image file with any combination of audio and subtitles. Therefore, a high effect can be expected especially as a language teaching material.
In addition, since the video file, the audio file, and the subtitle file are separated, it is not necessary to re-edit the video file for each combination of different languages, and a large-capacity video file is prepared for each language and stored in the storage device. There is no need to store them.
[0007]
3. The multilingual video distribution system according to claim 2, wherein the server describes a correspondence between the elapsed playback time of the video file and a character string included in a subtitle text file corresponding to the video file. A control file; and a means for distributing caption text data in accordance with the synchronization control file when distributing moving image data to the client terminal.
As a result, even if the moving image file and the subtitle text file are separately delivered to the client terminal, the contents of the moving image and the subtitle text can be reliably matched.
[0008]
BEST MODE FOR CARRYING OUT THE INVENTION
FIG. 1 is a conceptual diagram showing a basic configuration of a multilingual video distribution system 10 according to the present invention, and includes a center server 12, a streaming distribution server 14, and a client PC 16 of a user.
The client PC 16 is network-connected to the center server 12 via the Internet 18, and a Web browser program and a player program for receiving and reproducing streaming data are set up. The player program includes, for example, RealPlayer (registered trademark) and Windows (registered trademark) Media Player.
Although only one client PC 16 is illustrated in FIG. 1, many client PCs 16 can actually access the center server 12.
[0009]
The center server 12 has a Web server function, an authentication server function, a database server function, an application server function, and the like, and is actually configured by connecting a plurality of computers to a network.
The distribution server 14 is set up with a program for streaming distribution of moving image files, audio files, and text files to the client PC. The program corresponds to, for example, RealServer (registered trademark) or Windows (registered trademark) Media service.
Of course, by providing the center server 12 with the streaming distribution server function, the distribution server 14 can be omitted. Conversely, a plurality of distribution servers can be installed as needed.
[0010]
FIG. 2 is a block diagram illustrating a functional configuration of the moving image distribution system 10. The center server 12 includes a user corresponding unit 20, a control file processing unit 22, a file transfer unit 24, a Web file storage unit 26, A content database 28, a moving image file storage unit 30, an audio file storage unit 32, and a subtitle file storage unit 34 are provided.
The user corresponding unit 20, the control file processing unit 22, and the file transfer unit 24 are realized by a CPU of a computer constituting the center server 12 executing necessary processing according to an OS and an application program.
The Web file storage unit 26, the content database 28, the moving image file storage unit 30, the audio file storage unit 32, and the subtitle file storage unit 34 are stored in the hard disk of the computer.
[0011]
The moving image file storage unit 30 stores a large number of moving image files in an encoded state.
The audio file storage unit 32 stores encoded audio files in various languages corresponding to the respective moving image files.
The text storage unit 34 stores encoded subtitle text files in various languages corresponding to the respective moving image files.
The content database 28 describes the correspondence between each moving image file, audio file, and subtitle text file.
[0012]
The system 10 distributes one moving image file, an audio file in any language, and a subtitle text file in any language from the distribution server 14 to the client PC 16 by streaming, and the player program on the client PC 16 It is assumed that each data is reproduced and displayed in a synchronized state.
In this case, a moving image file with sound obtained by multiplexing moving image data with background sound data can be used, and a speech sound file for a specific language and text data for subtitles can be delivered together with the moving image file.
Alternatively, background audio data, speech audio data in a specific language, and subtitle text data can be distributed to the client PC 16 together with pure video data that does not include audio.
Furthermore, pure moving image data, audio data obtained by multiplexing background audio data and speech audio data in a specific language, and subtitle text data in a specific language can be delivered to the client PC 16.
[0013]
Next, the processing procedure in the moving image distribution system 10 will be described with reference to the flowchart of FIG.
First, the user accesses the Web site of the center server 12 from the client PC 16 via the Internet 18 and selects “Cinema Multilingual Learning Service” from the service menu.
Receiving this, the user corresponding unit 20 refers to the data stored in the content database 28, generates a list of moving image (movie) files that can be provided to the user at the present time, and transmits the list to the client PC 16.
On the other hand, when the user clicks and selects a specific moving image title listed in the list (S10), a language selection form 40 shown in FIG. 4 is transmitted from the user corresponding unit 20, and the audio and subtitle languages of the moving image are transmitted. Is requested to the user (S12).
[0014]
On the other hand, the user selects an arbitrary combination of languages.
For example, when “Japanese” is checked as the subtitle language, and “English” is checked as the audio language, and when the play button 42 is clicked, a sample video of the moving image is played in the play window 44. At the same time as the Japanese subtitle text is displayed below the playback window, the dialogue voice in English is played through the speaker of the client PC 16.
[0015]
When the user clicks the "OK" button after confirming the language combination (S14), the control file processing unit 22 generates a metafile according to the user's selection information and transmits the metafile to the client PC 16 via the user corresponding unit 20. (S16). In this metafile, a command for starting a player program and a URL (Uniform Resource Locator) for streaming distribution are described.
At the same time, the control file processing unit 22 generates a distribution control file (SMIL file or the like) in which storage locations and file names of the moving image file, audio file (English), and subtitle text file (Japanese) selected by the user are described. Is transmitted to the distribution server 14 via the file transfer unit 24 (S18).
Further, the control file processing unit 22 reads a synchronization control file (RealText file or the like) for synchronizing a frame constituting the moving image with the subtitle text from the content database 28 and sends the synchronization control file to the distribution server 14 via the file transfer unit 24. It is transmitted (S20).
[0016]
Upon receiving this, the distribution server 14 requests the center server 12 to transfer necessary files (S22).
When the moving image file, the audio file, and the subtitle text file are transmitted through the file transfer unit 24 of the center server 12 (S24), the distribution server 14 stores these files in a predetermined directory (S26).
[0017]
On the other hand, in the client PC 16, the Web browser activates the player for moving image reproduction according to the command described in the metafile (S30), and passes the URL for streaming distribution to the player.
The player receiving the request accesses the distribution server 14 via the Internet 18 and requests streaming distribution of necessary moving image data, audio data, and text data (S32).
On the other hand, the distribution server 14 distributes the relevant moving image file, audio file, and text file to the player of the client PC 16 by streaming according to a predetermined streaming protocol.
As a result, the moving image and the Japanese subtitles are reproduced and displayed on the display of the client PC 16, and the English audio is reproduced through the speaker.
[0018]
When distributing the moving image data and the subtitle text data to the client PC 16, the distribution server 14 can maintain the correspondence between the moving image frame and the subtitle text by referring to the synchronization control file.
That is, as shown in FIG. 5, the correspondence between the elapsed time of video playback and the subtitle text is described in the synchronization control file, and the distribution server 14 transmits the corresponding text data according to the elapsed time. Accordingly, as shown in FIG. 6, it is possible to synchronize each frame of the moving image with the subtitle text.
Incidentally, the arrangement of the subtitle text in the moving image playback window is set in the distribution control file (SMIL file) described above.
[0019]
When a background sound and a speech sound are recorded in a state separated from the beginning, as in a movie or a TV drama, the speech sound can be easily replaced with a dubbed sound in each language.
On the other hand, when a moving image and a sound of a play are recorded in a theater, the sound is recorded in a state where the background sound and the speech sound are mixed.
In this case, only the frequency band corresponding to the human voice is automatically detected, and the speech voice is separated and deleted by digital processing, and the speech voice recorded in another language using the voice actor may be prepared.
[0020]
In the above example, the moving image file storage unit 30, the audio file storage unit 32, and the subtitle file storage unit 34 are provided on the center server 12 side, and necessary files are transferred to the distribution server 14 based on user selection information. However, the moving image file storage unit 30, the audio file storage unit 32, and the subtitle file storage unit 34 may be provided on the distribution server 14 side.
In this case, the URL of the required file is notified from the center server 12 to the user's client PC 16, and based on the URL, the client PC 16 transmits a distribution request to the distribution server 14. The file will be streamed.
[0021]
【The invention's effect】
In the multilingual video distribution system according to claim 1, a plurality of audio files and subtitle text files in different languages are prepared on the server side for each video file, and the video file and the audio file selected by the user are prepared. By streaming the subtitle file to the client terminal, the user can view the moving image file with any combination of audio and subtitle.
In addition, since the video file, the audio file, and the subtitle file are separated, it is not necessary to re-edit the video file for each combination of different languages, and a large-capacity video file is prepared for each language and stored in the storage device. There is no need to store them.
[0022]
In addition, in the multilingual-compatible moving image distribution system according to claim 2, the server determines a correspondence between a reproduction elapsed time of the moving image file and a character string included in a subtitle text file corresponding to the moving image file. A synchronization control file describing the relationship, and a means for distributing subtitle text data according to the synchronization control file when distributing video data to the client terminal. , It is possible to reliably match the content of the moving image with the caption text.
[Brief description of the drawings]
FIG. 1 is a conceptual diagram showing a basic configuration of a multilingual video distribution system according to the present invention.
FIG. 2 is a block diagram showing a functional configuration of the moving image distribution system.
FIG. 3 is a flowchart showing a processing procedure in the moving image distribution system.
FIG. 4 is a layout diagram showing a language selection form.
FIG. 5 is an explanatory diagram showing a description example of a synchronization control file.
FIG. 6 is an explanatory diagram showing a procedure for synchronizing each frame of a moving image with subtitle text.
[Explanation of symbols]
10 Multilingual video distribution system 12 Center server 14 Streaming distribution server 16 Client PC
18 Internet 20 User support unit 22 Control file processing unit 24 File transfer unit 26 Web file storage unit 28 Content database 30 Video file storage unit 32 Audio file storage unit 34 Subtitle file storage unit 40 Language selection form 42 Play button 44 Play window

Claims (2)

A video distribution system including a server connected to a client terminal via a communication network,
The above server,
Storage means for storing a plurality of video files;
Storage means for storing language-specific audio files prepared for each video file;
Storage means for storing a subtitle text file prepared for each language prepared for each video file,
A means to send a list of video files to the client terminal and to select a specific video file,
Means for transmitting a form describing the language of the audio file and subtitle file corresponding to the video file when information for specifying the video file is transmitted from the client terminal, and prompting the user to select a specific language;
Means for notifying the location information of the corresponding video file, audio file, or subtitle text file when information specifying the language is transmitted from the client terminal;
Means for streaming distribution of data of each file to the client terminal when a distribution request for the moving image file, audio file, and subtitle text file is transmitted from the client terminal;
A multi-language compatible video distribution system characterized by comprising: The server includes a synchronization control file that describes a correspondence relationship between a playback elapsed time of the video file and a character string included in a subtitle text file corresponding to the video file,
2. The multilingual video distribution system according to claim 1, further comprising means for distributing subtitle text data according to the synchronization control file when distributing the video data to the client terminal.

Images