JP4124416B2 - Semi-automatic subtitle program production system - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a semi-automatic subtitle program production system that effectively combines a manual production function and an automatic production function.
[0002]
[Summary of Invention]
The semi-automatic subtitle program production system of the present invention effectively manipulates the video, audio, and time code of a TV material program recorded in a disc recording / reproducing apparatus, and transcribes subtitle text for speech and background sound. A function that efficiently inputs additional information data, an automatic caption program data production function that automatically creates caption screens and assigns timing using these texts and data, and editing / previews that edit and preview caption program data Function.
[0003]
This semi-automatic subtitle program production system is a subtitle program production system that can also handle subtitle production of various programs such as programs without electronic manuscripts and programs with a high background sound level. As a subtitle broadcast program production system that is expected to expand, a great effect is expected.
[0004]
[Prior art]
As a technology for producing subtitled programs offline in the presence of digitized manuscripts for news and narration-based documentary programs, the present inventors have developed “automatic summarization”, “automatic synchronization”, “automatic screen creation technology” Research on themes etc., and built an “automatic caption production system” that aggregates the results of previous research. A patent application has already been filed for these points (for example, JP 2000-270263, JP 2000-324395, etc.).
[0005]
As a result of evaluation of this automatic caption production system by caption producers and persons with hearing impairments, it has been confirmed that there are certain performance and functions. However, many problems still remain for practical use.
[0006]
In particular, there is a high demand for expansion of the target program range, and expansion into programs such as dramas and varieties such as programs without electronic manuscripts. However, from the viewpoint of the functions and performance of the current automatic caption production system, the TV program field that can produce captions is quite limited, and there are limits to automatic functions. It must be covered in the range of production, preview, and correction.
[0007]
In the actual subtitle production site, many specialists with advanced technical skills and knowledge are involved, and subtitle production has a lot of such human abilities.
[0008]
On the other hand, under the situation where rapid expansion of subtitle programs is required, it is not sufficient for subtitle production workers to rely solely on such specialists, and it is only enough for non-expert word processor work. However, a system that can share one end of work is desirable.
[0009]
[Problems to be solved by the invention]
However, in order to solve the problem, not only the caption production system based on automatic processing, but also a total system that includes the creation of electronic text for captions including manual work and preview / editing of caption screens, There is a need to consider program production efficiency.
[0010]
Therefore, as a goal of practical system development, 1) a system that can efficiently produce captions for various TV programs in terms of time, manpower, cost, etc. 2) Therefore, automatic caption production functions that are being researched And functions and configuration that effectively tie up manual caption production functions incorporating various support functions, and 3) improvement of system flexibility regarding work styles from the perspective of the person in charge of caption production. .
[0011]
In view of the above circumstances, the present invention is based on a new automatic caption production system in which each elemental automation technology has been enhanced based on the knowledge obtained from system evaluation of an automatic caption production system developed so far. At the same time, it aims to provide a more practical semi-automatic subtitle program production system that efficiently supports manual subtitle production by subtitle program producers.
[0012]
[Means for Solving the Problems]
In order to achieve the above object, according to the present invention, in claim 1, the video and audio of a TV material program recorded in advance on a recording medium is controlled to be reproduced at an arbitrary low speed in a speech section, and the transmission rate is changed. A playback control function for controlling playback at a speed suitable for transcription by performing pitch control in accordance with the playback control function. Including subtitle text transcribed for the audio of the program being played and the start and end timing of speech separation Subtitle text Accept input Subtitle text transcription, The subtitle text is divided into blocks from the pause time obtained from the audio of the program, and timing is given, so that timing is given to the display unit subtitle sentence in which the subtitle text is divided according to a predetermined division rule. Creating closed caption program data While playing back the video and audio of the automatic caption program data production part and the program, Subtitle text Created based on Subtitle program data And the sound waveform Display for preview Playback / display function and subtitles program For editing data Operation is predetermined A subtitle program editing / preview unit having an edit control function for receiving an operation input of an operation key, controlling an operation associated with the operated operation key, and editing the subtitle program data. Yes.
[0013]
In a second aspect of the present invention, in the semi-automatic caption production system according to the first aspect, a main screen serving as a man-machine interface in the caption text transcription unit includes a video display area for displaying a video currently being worked on, and a video display area. Subtitle text display area for displaying the corresponding subtitle text in the transcript, images at regular intervals or cut changes corresponding to the video being worked on, and the subtitle text that has been transcribed corresponding to each image And at least a list display area in which a waveform relating to the sound that is the basis for transcription of each subtitle text is displayed on the timeline, and a control area for each area. It is characterized by supporting the text transcription work.
[0014]
3. The semi-automatic subtitle program production system according to claim 1 or 2, wherein the main screen serving as a man-machine interface in the subtitle program editing / preview section displays a video currently being edited / previewed. Area, subtitle text display area for displaying the written subtitle text corresponding to this video, images at regular intervals or cut changes corresponding to the video being edited / previewed, and each image At least a list display area in which the corresponding written subtitle text and the waveform related to the sound on which the subtitle text is transcribed are listed on the timeline, and a control area for each area. The main screen supports the subtitle text editing / preview work of the operator.
[0015]
According to the present invention having the above-described configuration, it is possible to construct a caption program production system that can handle caption production of various programs such as a program without an electronic manuscript and a program with a high background sound level. As a subtitle broadcast program production system that is expected to expand, it is expected to have a great effect.
[0016]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 is a block diagram showing an embodiment of a semi-automatic subtitle program production system according to the present invention.
[0017]
As shown in the figure, the semi-automatic subtitle program production system 100 includes a basic GUI system unit 10, a disc recording / playback unit 20, a subtitle text transcription unit 30, an automatic subtitle program data production unit 40, A subtitle program editing / preview section 50 is provided.
[0018]
The basic GUI system unit 10 performs man-machine interface, internal system interface and control, and external data input / output control as one component of the caption program production system shown in FIG. The subtitle program production system 100 also has an interface / control function of an automatic subtitle program data creation function, and controls the subtitle program production system 100 that performs efficient subtitle production of various programs.
[0019]
The disc recording / reproducing unit 20 compresses and records the video / audio of the material program supplied from the program material VTR (for example, digital video tape recorder) 60, if necessary, and reproduces the recorded video / audio. Used to do. This program material VTR 60 has a function of reproducing and outputting video, audio, and their time code (TC) from the program material VTR tape in which the program material is recorded. (TC) is recorded in the disc recording / reproducing unit 20.
[0020]
<Subtitle text transcription unit 30>
The subtitle text transcription unit 30 is a function for listening to the audio of the material program, inputting the text of the subtitle text and additional data, and effectively supporting manual work by utilizing the video / audio of the material program Specifically, it includes a disk recording / playback control function 31, an information display function 32, a data creation control function 33, a data creation screen display function 34, and a main video display function 35.
[0021]
The disc recording / reproducing (DSKVTR) control function 31 includes operation keys corresponding to each function, and performs recording control for causing the disc recording / reproducing unit 20 to record the video / audio of the material program. Perform playback control to play back video and audio. In particular, the speech section performs arbitrary low-speed playback, and performs a pitch control according to the speed change rate, and also has a speech speed conversion function at a speed suitable for transcription and making the pitch almost unchanged.
[0022]
The information display function 32 visually displays various types of information related to the video / audio of the material program, the transcription text, etc. on the timeline in order to support manual operations for transcription and input of additional information data.
[0023]
The data creation control function 33 includes operation keys for input operations such as a written text and speech pause time data, and performs corresponding operations.
[0024]
The data creation screen display function 34 displays a screen for displaying / editing the created text / input data and performs a corresponding operation.
[0025]
The main video display function 35 displays an image of the current work position as a preview screen.
[0026]
<Automatic caption program data production section 40>
The automatic caption program production system 40 includes an automatic text summarization function 41, a display unit caption creation function 42, and a timing detection / assignment function 43. Details of the automatic caption program data production unit 40 will be described later.
[0027]
<Subtitle program data editing / preview section 50>
The subtitle program data editing / preview unit 50 is for manually editing / previewing subtitle program data automatically produced by the automatic subtitle program data production unit 40 based on the created transcription and additional information data. Special functions are provided for effective manual work support through advanced use of video / audio of material programs and subtitle program data.
[0028]
The disc recording / playback / subtitle data control function 51 is a dedicated operation key for special display operation for supporting editing / preview work such as designated time, subtitle page, subtitle block, etc. for automatically generated subtitle program data and recorded video / audio. And have a corresponding action.
[0029]
The information display / caption timing control function 52 visually displays various information such as a video of a material program, subtitle text, and a waveform related to audio on the timeline in order to support manual operations for editing subtitle program data.
[0030]
In particular, for subtitle program data, a timing change support screen is displayed, and an operation corresponding to this screen can be executed.
[0031]
The caption data editing function 53 includes a dedicated operation key for editing caption data in units of pages, and is configured to execute an operation for editing caption data in pages.
[0032]
The caption data / video display function 54 includes operation keys for displaying designated caption data superimposed on the video, and is configured to be able to execute an operation corresponding to each operation key.
[0033]
The preview key function 55 includes operation keys necessary for selecting a preview format, such as partial preview and through preview, and is configured to execute an operation corresponding to each operation key.
[0034]
<Details of Functional Configuration of Semi-automatic Subtitle Program Production System 100>
Next, processing executed by the semi-automatic subtitle program production system 100 having the above-described configuration will be described in detail for each of the subtitle text transcription unit 30, the automatic subtitle program data production unit 40, and the subtitle program editing / preview unit 50. .
[0035]
≪Processing in subtitle text transcription unit 30≫
The main work in the subtitle text transcription unit 30 is to listen to the speech of the program, transcribe its contents, and convert the start / end timing and the speaker (speaker) into data for each break.
[0036]
Therefore, as a support function for facilitating transcription in this function, it is fundamental that an operator can correctly listen to the speech of the program and transcribe it at his own pace. It is important to be easy to hear and to transcribe, to easily understand the speaker and timing, and to be able to easily modify the transcription data. As described above, the subtitle text transcription unit 30 of the system 100 includes various manual work support functions.
[0037]
The caption text transcription unit 30 has a function of editing a caption text file (XML).
[0038]
Here, the caption text refers to data composed of a range time (IN TIME, OUT TIME), a speaker, and a caption text.
[0039]
As an editing aid, using the MPEG / AVI video file stored in the disc recording / playback unit 20, audio listening, timing adjustment, and subtitle position adjustment can be performed.
[0040]
FIG. 2 shows the configuration of the main screen used in the caption text transcription unit 30. Using the main screen 301 shown in the figure, editing of subtitle text and operation of each auxiliary function are performed. The screen size is preferably, for example, 1280 × 1024 (number of pixels).
[0041]
The main screen 301 is roughly divided into four areas: a menu area 302, an editing area 303, a list area 304, and a control area 305.
[0042]
The menu area 302 is an area for calling various functions, and calls various functions by executing items prepared in the menu bar and the tool bar.
[0043]
The edit area 303 is an area for inputting subtitle data and editing the subtitle text after the input. As shown in the upper part of FIG. 3, a time frame (IN TIME, OUT TIME) area 303A, a speaker area A list is displayed as a pair of input data in 303B and caption text area 303C.
[0044]
Further, the input content is displayed in the data input area (input area 303F) in the lower part of FIG. Using this area, for example, each work is performed for each speaker.
[0045]
“IN TIME and OUT TIME” are set from the IN TIME / OUT TIME setting area 303D of the page. If it is included within the time set on the previous page, it is determined with the same value as the time on the previous page.
[0046]
The “speaker” setting is selected from the speakers registered in advance in the “speaker registration” area 303E of the menu.
[0047]
The transcription “text” is input in the page text input area 303F.
[0048]
Among the add / insert buttons, an “add” button 303G adds the contents of the input areas 303D, 303E, and 303F to the end of the input list. The “insert” button 303H inserts the input content next to the pair of data selected in the input list.
[0049]
The “cut” button 303J and the “copy” button 303K are used to cut / copy one unit selected in the input list. Further, the “Paste” button 303L is used to paste one unit recorded by the cut / copy function to the location next to the location selected in the input list.
[0050]
As shown in FIG. 4, the list area 304 is an area for displaying an image and subtitle text being created corresponding to the image, and displays an image list at regular intervals or cut changes from the MPEG / AVI video file. An image area 304A to be displayed, a caption text area 304B to display the caption text that is the content of the input text, a waveform area 304C to display a waveform corresponding to speech audio corresponding to the caption text being created, and a waveform area 304C A time line area 304D for displaying a time line serving as a time index of the list area 304 such as a waveform displayed in FIG. This list area 304 effectively supports the input of the transcription operator.
[0051]
In the list area 304, a playback position cursor 304E such as an MPEG / AVI video file is displayed. By changing the playback position 304E, the timing on the timeline for performing the transcription work such as the playback position of the image is changed. Is possible.
[0052]
Specific functions of the list area 304 are as follows. As described above, in this list area 304, still images formed from video files, caption texts as edit data, and waveforms are displayed in a list on the timeline. The width displayed on one screen is 120 seconds, 60 seconds, or 30 seconds selected by “Option” of “Tool (T)”.
[0053]
“Image” is an image extracted from a video file at regular intervals or a cut change. The image size is 160 × 120, and the interval is 20 seconds when the overall width is 120 seconds, 10 seconds when it is 60 seconds, and 5 seconds when it is 30 seconds.
[0054]
“Subtitle text” displays the content of the text input in the editing area 303. The width of the frame represents the time width. Omitted when the text is too narrow to display the full text.
[0055]
When the frame portion of the speaker area 304F is changed by dragging, the width (time width) of one subject is changed, and when the frame of the body portion 304B is changed by dragging, two border lines are changed. Changes can be made.
[0056]
When the inside of the frame is double-clicked, if the editing area 303 is not in the middle of editing, it is possible to move to a position where the content specified in the input list 304 can be displayed.
[0057]
“Waveform” is a waveform obtained by processing a sound signal (including music and sound effects) recorded in a video file and displaying it as shown in FIG. This is a support function that can visually determine the position of speech and poses. In addition, as a waveform, in order to clarify the speech section and the pause section, the waveform may be shaped into a rectangular waveform and displayed.
[0058]
The IN TIME / OUT TIME editing unit sets a minimum unit for reading a time code from a video file. When importing, values less than the set value are truncated. The “setting” in this case is 1 frame / 5 frames / 10 frames / 15 frames / 1 second.
[0059]
The width of one screen of the list display sets how much time is displayed in the list area 304 of the main screen. In this case, “setting” is 30 seconds / 60 seconds / 120 seconds, and the images are also set at intervals of 5 seconds, 10 seconds, and 20 seconds accordingly.
[0060]
On the other hand, the control area 305 is an area for controlling MPEG / AVI video, and includes an MPEG / AVI video display area 305A, a time frame extraction button, an MPEG / AVI playback start / stop button, and the like. Yes. In the control area 305, an interface related to reproduction of a video file is prepared. The size of the video is 640 × 480.
[0061]
Specific functions of the control area 305 include, for example, a time code display unit 305B, a play / stop button 305C, a play position track bar 305D, a MARK IN button 305E, a MARK OUT button 305F, and a repeat play button 305G. And a speech speed conversion button 305H, a << 5 sec / 5 sec >> button, and the like.
[0062]
The time code displayed on the time code display unit 305B is a time obtained by adding the time at the playback position of the video file with reference to the initial time input when a new project is created. Note that the playback position of the video file is handled with 29.97 frames as one second.
[0063]
The “play / stop” button 305C starts and stops playback of video. Even if the “Stop” button is executed, the video does not disappear.
[0064]
The playback position track bar 305D indicates which part of the current video file is being played back. It is also possible to change the playback position by moving the track bar.
[0065]
The “MARK IN” button 305E copies the current video time to the IN TIME field in the editing area. The “MARK OUT” button 305F copies the current time of the video to the OUT TIME field in the editing area.
[0066]
The “repetitive playback” button 305G repeatedly creates images in the IN TIME and OUT TIME periods of the editing area.
[0067]
The end is made by clicking a “stop” button 305C or a “MARK IN” button 305E.
[0068]
The “speech speed conversion” button 305H is used to adjust the speed of sound when playing back video.
[0069]
The “<< 5 seconds / 5 seconds >>” button 305J is used to move the video playback position forward / backward for 5 seconds.
[0070]
Next, the procedure of the transcription process executed by the caption text transcription unit 30 having the above configuration will be specifically described with reference to the flowchart of FIG.
[0071]
When the operator presses the “PLAY” button and video reproduction is started, first, the utterance timing is searched (step ST11).
[0072]
When the “start writing” button is pressed at the confirmation point of the utterance, this becomes the start point of the speech section (step ST12).
[0073]
Rewinding is performed for a certain time, slow reproduction is started, and a transcription operation is executed (steps ST13 and ST14). When the end of speech is recognized, the end point of speech is searched by appropriately rewinding (step ST15).
[0074]
When the “end of writing” button is pressed at the end point of utterance (end point), the process proceeds to the normal reproduction mode (step ST16).
[0075]
After the end of the transcription, script, term check and summary support are executed and background sound information is registered (steps ST17 and ST18).
[0076]
When the text creation process ends, the process proceeds to the process of the automatic caption program data production unit 40 (step ST19).
[0077]
As shown in each of the steps above, after completing a complete transcript, check the text script, terminology, and if necessary, perform summary support to correct the required text, then background sound information Check the information and register information. After registration, the text creation-related work is terminated, and the process proceeds to the automatic caption program data production unit 40.
[0078]
As described above, this embodiment presents a transcription support for a new semi-automatic subtitle program production system, and has the following advantages.
[0079]
In other words, by recording video material, video, audio, and time code of TV material programs on a disk recording / playback device that is easy to operate non-linearly, and effectively operating and processing them, transcription of subtitle text and background sounds are added to speech. Information data can be input efficiently.
[0080]
In addition, the transcription itself must be done manually, which depends on the knowledge and ability of people. Can be supported.
[0081]
When analyzing work such as transcription, the VTR tape that normally records TV material programs is appropriately operated to reproduce video and audio, and the speech in the audio is transcribed as text. Recording is done using codes, but in the process, complicated VTR operations such as cueing of the corresponding speech part, playback at a speed suitable for transcription of the speech part, repeated playback, confirmation of the end point of the speech part, etc. Done. In this regard, the speed of speech can be reduced or increased according to the ability of the transcription operator to apply the speech speed conversion technology, so the transcription can be done easily and the timing can be adjusted easily. Can be.
[0082]
<< Processing of Automatic Subtitle Program Data Production Unit 40 >>
FIG. 6 is a flowchart that is speeded up by applying a timing detection method instead of the speech recognition method as an example of the processing procedure of timing addition to the display subtitle sentence executed in the automatic subtitle program data production unit 40.
[0083]
First, the pause start timing and duration are obtained from the audio data. The suitability is verified and necessary corrections are made (step ST21 in FIG. 6). It should be noted that the pause time detection function does not perform voice recognition processing, but starts and ends the time at which the level continues below a specified level, for example, from the level and duration of the voice supplied from the material VTR and its time code. The code is detected and executed by a method such as a block, cepstrum, or flux method.
[0084]
Next, the caption text is divided into blocks in a relatively long pause (for example, 2 seconds or more), and the start and end timings are given as block text sentences (steps ST22 and ST23).
[0085]
Next, the duration of the block text sentence is divided by the total number of readings (calculation estimation) to obtain the average reading speed in the range (step ST24).
[0086]
Next, each block text sentence is divided into display unit subtitle sentences with a middle length pause or the like as a line feed point (step ST25). In this case, a predetermined division rule is applied.
[0087]
Next, the timing corresponding to the beginning and end of each divided subtitle sentence is calculated and assigned based on the start / end timing and pause timing of the block text sentence, and the average reading speed. In this case, the number of characters, the character type method, or the pronunciation number method is applied (step ST26).
[0088]
Then, the display time of each display unit subtitle is checked, and if necessary, the end timing is corrected (step ST27).
[0089]
In this way, timing is given to the display unit subtitle sentence by automatic processing, and automatic subtitle program data is created.
[0090]
≪Processing of subtitle program data editing / preview section 50≫
The caption program data created as described above is completed as a final caption program by editing / preview processing by the caption program data editing / preview section 50. The work in this function involves previewing the completed subtitle program data by an operator who has specialized knowledge, and modifying it if necessary. Preview format, subtitle content, line feed / page break, timing, which is easy for the operator to check A function to support easy editing and editing is included.
[0091]
Here, in the following description, caption program data composed of transmission / erasure time, caption text, and management information is provisionally referred to as caption material.
[0092]
As an editing aid, the MPEG image file can be used to adjust timing and subtitle position. Note that subtitle material editing is input and output only for text broadcast NAB format files. This file becomes an input / output format of other “page list”, “page use”, and “digital format conversion”.
[0093]
FIG. 7 shows the configuration of the main screen used in the caption program editing / preview unit 50. This main screen is used for editing caption material. This main screen is used to edit subtitle material and operate each auxiliary function. The screen size is 1280 × 1024.
[0094]
The main screen 501 is roughly divided into three areas: a menu area 502, an editing area 503, and a list area 504.
[0095]
The menu area 502 is a part for calling various functions, and various functions can be called by executing items prepared in the menu bar and the tool bar.
[0096]
The edit area 503 includes a video area 503A as shown in FIG. The video area 503A is composed of an area for displaying a video reproduced from an MPEG / AVI file stored in the system, and an area for displaying a subtitle text input using character input software. It can also be used to adjust the position of text and images. In normal preview, this editing area 503 is used for confirmation. It is also possible to perform operations such as playback stop, IN TIME and OUT TIME capture, and repeat playback. The size of the image in the video area 503A is 640 × 480.
[0097]
A time code display area 503B shown in FIG. 7 is a portion for displaying the time code, and the position of the image being reproduced is reproduced as 29.97 frames per second.
[0098]
The “play” button 503D is used to start playback of the video, and the “stop” button 503C is used to stop playback of the video. Note that even if the “stop” button 503C is pressed, the video is only stopped and the video itself does not disappear from the screen.
[0099]
The playback position track bar 503E indicates which part of the video file is currently being played back. The playback position can be changed by moving the track bar.
[0100]
The “MARK IN” button 503F is a button for copying the current video time to the IN TIME field of the editing area. The “MARK OUT” button 503G is a button for copying the current time of the video to the OUT TIME field in the editing area.
[0101]
The “repetitive playback” button 503H is used to repeatedly create images in the IN TIME and OUT TIME periods of the editing area.
[0102]
The end is performed by operating the “stop” button 503B or the “MARK IN” button.
[0103]
The “<< 5 seconds / 5 seconds >>” button 503J is a button for advancing / returning the reproduction position of the video file by 5 seconds. When it is executed during repeated playback, it switches to normal playback.
[0104]
As described above, the editing area 503 also serves as a video section in addition to performing input of subtitle data and editing after the input, and is also used when performing a preview on the video area 503A. “Previous page” and “Subsequent page” are areas for displaying subtitles of pages before and after the subtitle data page currently displayed in the center.
[0105]
In this case, in the editing area 503, new characters are input using the frame cursor displayed on the video area 503A. The color size of the input character is the content set in the upper right list box.
[0106]
In addition, it is possible to designate a range of a character once input, and to delete / copy / move or change attributes (color, size, box, etc.).
[0107]
“IN TIME / OUT TIME” sets the IN TIME / OUT TIME of the page. With the “MARK IN” button 503F and the “MARK OUT” button 503G, the playback timing of the video file can be captured as “IN TIME / OUT TIME”.
[0108]
The foreground color / background color / character size area 503L sets the foreground color / background color / character size of a character to be newly input in the editing area 503.
[0109]
The mesh area 503M is used to set whether to display a reference line as a guideline for the character input position on the image.
[0110]
The “add page” button 503N is used to add a new page at the end of the material being edited and display the page as an editing target. The “insert page” button 503P is used to insert a new page before or after the currently edited page and display the page as an editing target. The “delete page” button 503Q is used to delete the page currently being edited. Note that a confirmation operation is entered when page deletion is executed.
[0111]
The “through preview” button 503R is used when previewing is started until a preview immediately before the “end preview” button 503S is executed.
[0112]
The “partial preview” button 503T starts preview from the page before the current target page, and ends preview after OUT TIME of the next page. It is also possible to end with the “end preview” button on the way.
[0113]
The “Full Screen Preview” button performs the same operation as “Through Preview” using all monitors. The “end preview” button cancels the current preview.
[0114]
FIG. 9 shows the configuration of the list area 504.
[0115]
A list area 504 is an area for displaying an image and a created subtitle text corresponding to the image. An image area 504A for displaying a list of images at regular intervals or cut from an MPEG / AVI video file. A subtitle text area 504B for displaying the subtitle text that is the content of the subtitle text, a waveform area 504C for displaying a waveform related to the speech sound corresponding to the created subtitle text, and a time index of the waveform displayed in the waveform area 504C; And a timeline area 504D in which a timeline is displayed. The list area 504 effectively assists the editing / preview worker.
[0116]
The width displayed on one screen in the list area 504 is 120 seconds, 60 seconds, or 30 seconds selected by “Option” of “Tool (T)”.
[0117]
“Image” is an image extracted from a video file at regular intervals or at different cuts and displayed. The image size is 160 × 120, and the interval is 20 seconds when the overall width is 120 seconds, 10 seconds when it is 60 seconds, and 5 seconds when it is 30 seconds.
[0118]
“Subtitle text” displays the content of the text input in the editing area 503. The width of the frame represents the time width. It is omitted when the width is narrow and the text cannot be displayed.
[0119]
If the frame of the page number area 504F is changed by dragging, change the width (time width) of one target, and if the frame of the body part is changed by dragging, change the two borders. Do.
[0120]
If the editing area 503 is not in the middle of editing when the inside of the frame is double-clicked, the page specified in the input list is changed to the page to be edited.
[0121]
“Waveform” displays a waveform obtained by processing an audio signal (including music and sound effects) recorded in a video file. In addition, as a waveform, in order to clarify the speech section and the pause section, the waveform may be shaped into a rectangular waveform and displayed.
[0122]
The editing unit of IN TIME / OUT TIME sets a minimum unit for reading a time code from the video film. When importing, values less than the set value are truncated. In this case, “setting” is 1 frame / 5 frames / 10 frames / 15 frames / 1 second.
[0123]
The width of one screen of the list display sets how much time is displayed in the list area of the main screen. In this case, “setting” is 30 seconds / 60 seconds / 120 seconds, and the images are also set at intervals of 5 seconds, 10 seconds, and 20 seconds accordingly.
[0124]
As described above, according to this embodiment, it is possible to construct a function / configuration effectively tying up the automatic caption production function that is being researched and the manual caption production function that incorporates various support functions. It is possible to provide a system that can efficiently produce captions for TV programs in terms of time, manpower, and cost. Therefore, the system flexibility regarding the work form from the viewpoint of the caption production worker is improved.
[0125]
【The invention's effect】
As described above, according to the present invention, a new automatic caption production system in which each automated element technology is enhanced based on the knowledge obtained from the system evaluation of the automatic caption production system developed so far. It becomes possible to provide a semi-automatic subtitle program production system with higher practicality that efficiently supports manual subtitle production by subtitle program producers.
[0126]
Moreover, the semi-automatic subtitle program production system of the present invention can also handle subtitle production of various programs such as a program without an electronic manuscript and a program with a high background sound level. As a subtitle broadcast program production system that is expected to expand, it can be expected to have a great effect.
[Brief description of the drawings]
FIG. 1 is a block diagram showing an embodiment of a semi-automatic subtitle program production system according to the present invention.
FIG. 2 is an explanatory diagram showing a configuration of a main screen used in a caption text transcription unit constituting a semi-automatic caption program production system according to the present invention.
FIG. 3 is an explanatory diagram showing a configuration of an editing area on the main screen shown in FIG. 2;
4 is an explanatory diagram showing a configuration of a list area of the main screen shown in FIG. 2. FIG.
FIG. 5 is a flowchart showing a processing procedure of a caption text transcription unit constituting a semi-automatic caption program production system according to the present invention.
FIG. 6 is a flowchart illustrating an example of a processing procedure for giving timing to a display subtitle sentence executed in an automatic subtitle program data production unit;
FIG. 7 is an explanatory diagram showing a configuration of a main screen used in a caption program editing / preview section that constitutes a semi-automatic caption program production system according to the present invention.
8 is an explanatory diagram showing a configuration of an editing area of the main screen shown in FIG.
FIG. 9 is an explanatory diagram showing a configuration of a list area of the main screen shown in FIG. 7;
[Explanation of symbols]
10 Basic GUI System Department
20 Disc recording / playback unit
30 Subtitle text transcription
31 Disc recording / playback control function
32 Information display function
33 Data creation control function
34 Data creation screen display function
35 Main video display function
40 Automatic caption program data production department
41 Automatic text summarization function
42 Display unit subtitle creation function
43 Timing detection / grant function
50 Subtitle Program Editing / Preview
51 Disc recording / playback / subtitle data control function
52 Information Display / Subtitle Timing Control Function
53 Caption data editing function
54 Caption data / video display function
55 Preview function
60 Program material VTR
100 Semi-automatic subtitle program production system

Claims (3)

Video and audio of TV material programs recorded in advance on a recording medium are controlled at any low speed during the speech period, and at a speed suitable for transcription by controlling the pitch according to the gear ratio. controlling the have the playback control function, the input of the subtitle text containing the start and end timings of the reproduction control function by Ri caption text and speech separator which caused written to the audio of the program to be reproduced A subtitle text transcript that accepts
The subtitle text is divided into blocks from the pause time obtained from the audio of the program, and timing is given, so that timing is given to the display unit subtitle sentence in which the subtitle text is divided according to a predetermined division rule. Automatic caption program data production section for creating closed caption program data,
To reproduce the video and audio of the program, and to display the subtitle program data created based on the subtitle text and the waveform related to the audio for preview, and to edit the subtitle program data operation receives an operation input of the operation keys that are determined in advance, and controls the operation associated with said operation key is operated, caption program editing and preview portion having an edit control function for editing the subtitle program data When,
A semi-automatic subtitle program production system characterized by having The semi-automatic caption production system according to claim 1,
The main screen serving as a man-machine interface in the subtitle text transcription part is:
A video display area that displays the video currently being worked on, a text display area for subtitles that displays the subtitle text that is being transcribed corresponding to this video, and a fixed interval or cut change corresponding to the video that is being worked on, etc. A list display area on the timeline of the subtitles corresponding to each image, the subtitle text transcribed corresponding to each image, and the waveform related to the sound that is the basis of the transcription of each subtitle text, and for each area And at least a control area, and this main screen supports the subtitle text transcription work of the worker.
This is a semi-automatic subtitle program production system. In the semi-automatic subtitle program production system according to claim 1 or 2,
The main screen serving as a man-machine interface in the caption program editing / preview section is
A video display area for displaying the video currently being edited / previewed, a subtitle text display area for displaying the written subtitle text corresponding to the video, and a fixed interval corresponding to the video being edited / previewed. List display that lists images on each time or cut, transcript text for each subtitle corresponding to each image, and waveform related to audio that is the basis for transcription of each subtitle text. It has at least an area and a control area for each area, and this main screen supports the operator's subtitle text editing and preview work.
This is a semi-automatic subtitle program production system.

Images