JP2008211491A - Closed-captioned video display system, server device, and terminal apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a closed-captioned video display system capable of easily displaying a closed-captioned video on a desired terminal through a network. <P>SOLUTION: The closed-captioned video display system includes a server device and a terminal apparatus which are mutually communicable through the network. The server device includes: a first storage means for storing subtitle data to be imparted to the video; a second storage means for storing a low-resolution video with resolution lower than that of the video; a generating means for generating a still picture by synthesizing a black burst signal with the subtitle data stored in the first storage means; a third storage means for storing the still picture; and a transmitting means for transmitting the low-resolution video and the still picture to the terminal apparatus. The terminal apparatus includes: a receiving means for receiving the low-resolution video and the still picture transmitted from the server device; a generating means for generating the video with the subtitles; and a display means for displaying the video with the subtitles. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a video display system with captions.

  Subtitles added to video created for broadcasting on TV etc. are displayed on the dedicated receiver by displaying the video with subtitles superimposed (superimposed) on the video (baseband video) actually broadcast. , Check typographical error, subtitle position, display time (display timing), etc.

  For example, in Patent Document 1, a step of inputting subtitle text, a step of calibrating the input subtitle text, and an editing step of setting a position, the number of characters, a display time, and the like for displaying the calibrated subtitle text on the video, Discloses a caption production device in which each device that performs input, proofreading, editing, and previewing is connected to a LAN so that the preview process of displaying the edited caption-added video and performing the final check can be performed almost simultaneously. .

  Patent Document 2 discloses a video display system that can easily correct, add, and delete subtitle data by superimposing the subtitle data on the playback image while synchronizing the subtitle data with the display image during playback of the video data. It is disclosed.

  The technologies disclosed in Documents 1 and 2 preview video with captions using a preview device installed at a predetermined location. For example, video with captions can be viewed on a general-purpose terminal such as a personal computer. It is not intended to be checked. Therefore, in the techniques disclosed in Patent Documents 1 and 2, it is not possible to easily check the video with captions when there is a free time, for example, at a convenient place.

  On the other hand, in recent years, with the development of computer networks such as the Internet, data stored in a server via a network can be easily displayed on a general-purpose terminal such as a personal computer.

  Patent Document 3 receives a decoded signal including a video signal, a still image having a display size smaller than the display size of the video, and position data indicating a composite position of the still image with respect to the video. A video synthesizing device for synthesizing a still image with a video based on the video is disclosed. In Patent Document 3, a still image such as a telop character having a display size smaller than the display size of a video is used in order to reduce the amount of data to be transmitted.

However, Patent Document 3 is a video composition device for generating a video with captions for actual broadcasting while changing the display position of the still image to be synthesized. The display position of the still image and the content of the still image It is not intended to check (for example, telop characters) and display time (display timing).
JP 2006-67536 A JP 11-75113 A JP 2003-153080 A

  As described above, conventionally, in order to check a typographical error in a subtitle, a subtitle display position, a display time (display timing), and the like, it is possible to easily display a video with subtitle on a desired terminal via a network. could not. For this reason, there is a problem that it is not possible to easily check subtitle typographical error, subtitle display position, display time (display timing), etc., for example, when there is free time. . If such a check can be performed at a convenient time and place, subtitles can be corrected quickly and the efficiency of subtitle production work can be improved.

  Therefore, in view of the above problems, the present invention easily displays subtitled video on a desired terminal via a network in order to check subtitle typographical error, subtitle display position, display time (display timing), and the like. An object of the present invention is to provide a video display system with captions that can be used.

The video display system with captions of the present invention includes a server device and a terminal device that can communicate with each other via a network,
The server device includes (a) first storage means for storing subtitle data to be added to the video, (b) second storage means for storing a low-resolution video having a lower resolution than the video, and (c). Generating means for generating a still image by combining a black burst signal and caption data stored in the first storage means; (d) third storage means for storing the still image; and (e A transmission means for transmitting the low-resolution video and the still image to the terminal device;
The terminal device (f) receiving means for receiving the low-resolution video and the still image transmitted from the server device; and (g) combining the low-resolution video and still image received by the receiving means; Generating means for generating a video with captions; and (h) display means for displaying the video with captions.

  Subtitled video for checking subtitle typographical error, subtitle display position, display time (display timing), and the like can be easily displayed on a desired terminal.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 shows a configuration example of a main part of a captioned video display system according to the present embodiment.

  The video display system with captions of FIG. 1 includes a server 1 and a plurality of (for example, three) terminals 2a to 2c, and the server 1 and the terminals 2a to 2c are connected to each other via a network 3 such as the Internet. Has been. The network 3 may be a private network such as a public network, a LAN (Local Area Network), and a WAN (Wide Area Network).

  Each of the terminals 2 a to 2 c includes a communication unit 21, a caption still image decoder 22, a low resolution video decoder 23, a playback control unit 24, a synthesis unit 25, a display unit 26, and an instruction input unit 27. The communication unit 21 and the display unit 26 may use browser functions included in each terminal. For example, by adding the functions of the caption still image decoder 22, the low resolution video decoder 23, the playback control unit 24, the synthesis unit 25, and the instruction input unit 27 to the browser, the functions on the terminal side in the video display system with captions are added. Can be realized.

  The server 1 includes a caption data storage unit 11, a low-resolution video storage unit 12, a black burst signal generation unit 13, a caption data control unit 14, an adder 15, a converter 16, an encoder 17, a caption still image storage unit 18, and a communication unit. 19 is included.

  The low-resolution video storage unit 12 stores video to which subtitles are added and which has a lower resolution (resolution) than the original video (hereinafter simply referred to as “low-resolution video”). . This video is encoded using MPEG (Moving Picture Expert Group) or the like and stored in the low resolution video storage unit 12.

  The subtitle data storage unit 11 stores subtitle data to be added to the video stored in the low resolution video storage unit 12.

  In the caption data, each caption text to be given to the video (converted from sound or the like in each scene into characters or symbols) and the display start time of the caption text (for example, the caption text from the start of playback of the video) Display time of the subtitle text), the display end time of the subtitle text (for example, the time of display of the subtitle text from the start of playback of the video), or the display time of the subtitle text (for example, the subtitle text Control information such as the display position of the subtitle text and the display position of the subtitle text. The caption data is, for example, caption data in the NAB (National Association of Broadcasters) format.

  The black burst signal generation unit 13 generates a black burst signal and outputs it to the adder 15. The black burst signal is a video signal of a “black” screen and includes a synchronization signal.

  The caption data control unit 14 includes a counter or timer that measures the time from the start of playback of a video to which captions are added. The subtitle data control unit 14 reads out the subtitle data stored in the subtitle data storage unit 11, the counter value or timer value (time from the start of playback of the video to which the subtitle is added), and each subtitle in the subtitle data Based on the control information associated with the text, each subtitle text is converted into a video signal between the display start time of the subtitle text and the display time (from the display start time to the display end time) and output. To do. In other words, the caption data control unit 14 outputs the caption video signal while synchronizing with the caption video.

  The adder 15 superimposes the subtitle video signal output from the subtitle data control unit 14 on the signal output from the black burst signal generation unit 13, and the subtitle text is converted into the subtitle text as shown in FIG. A still image to be displayed at the display position specified by the control information of the caption text is generated. Under the control of the caption data control unit 14, the adder 15 causes each caption text to be displayed for the number of frames necessary for display during the display time from the display start time specified by the control information of the caption text. A still image (caption still image) is generated. For example, the adder 15 superimposes the subtitle video signal on the VBI (Virtual Blanking Interval) in the black burst signal. Note that a caption still image corresponding to a time section in which no caption is displayed in the playback time from the start of playback to the end of playback of the video to which caption is added is a black burst signal itself.

  The time-series caption still image generated by the adder 15 (time-series caption still image synchronized with the time from the start of playback of the video stored in the low-resolution video storage unit 12) is converted into an analog signal by the conversion unit 16. The signal is converted into a digital signal in a format conforming to the standard of digital broadcasting (ARIB (Association of Radio Industries and Businesses)).

  The digital signal output from the conversion unit 16 is encoded by the encoder 17 using JPEG or the like, and stored in the caption still image storage unit 16.

  The caption still image storage unit 16 stores time-series caption still image data generated as described above.

  The communication unit 17 receives subtitle still image data stored in the subtitle still image storage unit 16 and low resolution video stored in the low resolution video storage unit 12 in response to a request from any of the terminals 2a to 2c. Data is transmitted to the requesting terminal via the network 3.

  The low-resolution video has a lower resolution than the original video and is compression-coded using MPEG or the like. Subtitle still images are also compressed and encoded using JPEG or the like. As described above, since the amount of data of the low-resolution video and the subtitle still image is greatly reduced, there is no problem even if the data is transmitted and received via the network.

  Terminals 2a to 2c (hereinafter collectively referred to as terminal 2) first receive subtitle still image data and low-resolution video data transmitted from the communication unit 17 of the server 1 at the communication unit 21. .

  The playback control unit 24 temporarily stores the received caption still image data and low resolution video data, controls the caption still image decoder 22 and the low resolution video decoder 23, and synchronizes with the low resolution video in time series. Play subtitle still images.

  That is, the low resolution video decoder 23 reproduces a video by decoding the low resolution video data temporarily stored in the reproduction control unit 24 based on the control from the reproduction control unit 24, and outputs the video to the synthesis unit 25. The subtitle still image decoder 22 reproduces a time-series still image by decoding the time-series subtitle still image data temporarily stored in the reproduction control unit 24 based on the control from the reproduction control unit 24, To 25.

  As shown in FIG. 2, the synthesizer 25 subtitles still images output from the subtitle still image playback unit 22 (FIG. 2 (a)) to the low resolution video output from the low resolution video playback unit 23 (FIG. 2 (a)). b)) is superimposed, and as shown in FIG. 2C, a captioned video in which captions are superimposed on the video is generated and output to the display unit 26.

  The display unit 26 displays the captioned video output from the synthesis unit 25.

  The subtitled video displayed on the display unit 26 is superimposed on the subtitle text in the subtitle data stored in the subtitle data storage unit 11 and the subtitle developed on the image according to the control information.

  Therefore, the user of the terminal 2 can check the subtitle text such as typographical and omission, the position of the subtitle, the display timing, the control information thereof, and the like by viewing the video with subtitles displayed on the display unit 26.

  When the user looks at the video with subtitles displayed on the display unit 26 and finds an error in a typographical error or omission, a subtitle display position, a display timing, or the like, the subtitle having such an error is displayed. In order to record the time position, an instruction indicating that an error has been detected is input from the instruction input unit 27. The playback control unit 24 includes a counter or timer for measuring the time from the start of playback of video data. The reproduction control unit 24 receives an instruction indicating that an error has been detected, and records a counter value or a timer value when the instruction is received.

  The data file in which the time position (counter value or timer value) in which the error is detected is recorded is stored in the playback control unit 24. After the check of the video with subtitles is completed, the playback control unit 24 passes through the communication unit 21. Send to server 1.

  The communication unit 17 of the server 1 stores the received file in which the error-detected time position is recorded in the caption still image storage unit 16 or a storage unit provided separately.

  The subtitle text and control information in the subtitle data stored in the subtitle data storage unit 11 can be corrected by referring to this file later.

  As described above, according to the above-described embodiment, in order to check a typographical error of a caption, a display position of the caption, a display time (display timing), and the like, a video with caption can be easily transmitted to a desired terminal via a network. Can be displayed. Since it is possible to easily display video with subtitles for checking subtitle typographical error, subtitle display position, display time (display timing), etc. on the desired terminal, subtitle correction can be performed quickly, The efficiency of subtitle production work is also improved.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

The figure which showed the structural example of the principal part of the video display system with a caption concerning embodiment of this invention. The figure for demonstrating operation | movement until a video with a caption is produced | generated by synthesize | combining a low resolution image and a caption still image in the terminal device of a video display system with a caption.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Server, 2a-2c ... Terminal, 3 ... Network, 11 ... Subtitle data storage part, 12 ... Low-resolution video storage part, 13 ... Black burst signal generation part, 14 ... Subtitle data control part, 15 ... Adder, 16 ... Conversion unit, 17 ... Encoder, 18 ... Subtitle still image storage unit, 19, 21 ... Communication unit, 22 ... Subtitle still image decoder, 23 ... Low resolution video decoder, 24 ... Playback control unit, 25 ... Composition unit, 26 ... Display unit, 27 ... instruction input unit

Claims (3)

A video display system with subtitles including a server device and a terminal device that can communicate with each other via a network,
The server device
First storage means for storing subtitle data to be added to the video;
Second storage means for storing a low-resolution video having a lower resolution than the video;
Generating means for generating a still image by combining the black burst signal and the caption data stored in the first storage means;
Third storage means for storing the still image;
Transmitting means for transmitting the low-resolution video and the still image to the terminal device;
Comprising
The terminal device
Receiving means for receiving the low-resolution video and the still image transmitted from the server device;
Generating means for synthesizing the low-resolution video and still image received by the receiving means, and generating a video with subtitles;
Display means for displaying the subtitled video;
A video display system with captions, comprising: First storage means for storing subtitle data to be added to the video;
Second storage means for storing a low-resolution video having a lower resolution than the video;
Generating means for generating a still image by combining the black burst signal and the caption data stored in the first storage means;
Third storage means for storing the still image;
Transmitting means for transmitting the low-resolution video and the still image to the terminal device;
A server apparatus comprising: Receiving means for receiving a still image generated by combining caption data to be added to the video and a black burst signal, and a low-resolution video having a lower resolution than the video;
Generating means for synthesizing the low-resolution video and still image received by the receiving means, and generating a video with subtitles;
Display means for displaying the subtitled video;
A terminal device comprising:

Images