JP2010157961A - Caption creation system and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily create a caption while enjoying it. <P>SOLUTION: A caption creation system comprises: a motion picture playback region R1 for playing back and displaying motion picture data; a time-line display area TL for displaying a time-line of the motion picture data being played back in the motion picture playback region R1; and a caption editing region R6 for registering a caption to a caption setting box BX allocated inside the time-line display area. A period of time to display the caption registered to the caption setting box is specified from front and rear end positions of a time of the time-line display area, and information specifying the period of time for display is stored in a caption data storage section in association with the registered caption. By allocating the caption setting box inside the time-line display area, it can be easily determined whether or not the period of time playing back the caption is appropriate. One caption data item can be created by a plurality of persons, so that it is enough for each person to register only a part of caption comprehensible for the person, and it is possible to be participated in caption creation at ease with a sense of play. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a caption creation system and program.

  In recent years, video content such as movies and broadcast programs has been rapidly digitized, and digitized video content has been delivered to viewers through digital broadcasting and Internet distribution. In addition, with the spread of the Internet, there are many video sharing sites on the Internet, and other users can watch videos (video content) uploaded to the video sharing sites on their terminals (personal computers: personal computers). Can be done. For this type of content such as broadcast or distributed video content, content previously created by integrating moving image data and subsidiary data is used. As the secondary data, for example, there is a caption super corresponding to moving image data.

  As described above, in the content in which the moving image data and the subsidiary data such as caption super are integrated, the moving image data and the caption super are superimposed to create one video master. The subsidiary data (caption super) captured by the video master is handled as image data. Accordingly, once the video master is created, the contents of the subsidiary data such as subtitle super are corrected. In other words, for example, when the reworking of the subtitle super occurs, the original subtitle super data is read out, the necessary portion is corrected, and the corrected subtitle super is superimposed on the moving image data again to create the video master again.

  Also, since the caption super is required to be described in a language that can be understood by the viewer of the video content, it is necessary to prepare a caption super that is translated for each country when it is distributed around the world. Then, the subtitle super of each language is superimposed on the moving image data, and video content (video master) for each language is created, managed, and distributed.

  Therefore, if 10 types of subtitle super are prepared (including the case where a plurality of subtitles are prepared in the same language), 10 types of video content will be created. It will contain video data with much larger capacity. Although the contents of the ten moving image data are all the same, the same moving image data is included in each video content, and there is a problem that a large storage capacity is required. When the data is corrected, there is a possibility that the identity of the moving image data portion in the video content for each language cannot be secured.

  In order to solve the problem, for example, a technique disclosed in Patent Document 1 has been proposed. The invention disclosed in Patent Document 1 is based on secondary data such as subtitle super, synchronization data for synchronizing with moving image data (predetermined frames constituting moving image data as a reproduction start point and a reproduction end point of moving image data). Code) to store the secondary data and video data as separate files, and at the time of playback, match the playback timing of the video data and subtitle super on the basis of the data for synchronization To play. As a result, on the user terminal that intends to view the video content, during playback of the moving image data specified by the synchronization data, the caption super, which is secondary data associated therewith, is played back.

  Therefore, in the invention disclosed in Patent Document 1, when the content of subtitle super is corrected, it is only necessary to change the file of the corresponding subtitle super, and it is not necessary to perform the superimposing process again on the video data. , Work is easy. Further, since only one moving image data needs to be stored, the storage capacity is reduced and management is also prepared.

  However, in the above prior art, a person (requester) who wants to distribute moving image data (video content) makes a request to a person who creates subsidiary data such as a translator, and the created subsidiary data file Is assumed to be a system that distributes video together with video data. Therefore, it is assumed that the translator who creates the subtitle super data that is the secondary data is also a limited specific person. That is, when the subsidiary data is subtitle super, one or a plurality of subtitle super files are created by a specific person or a plurality of persons, and the subtitle super file thus created is stored on a predetermined server (a server on which video data is registered). It is suitable for distributing moving image data with subtitle supervision to the user via the Internet or the like. As described above, since a limited number of people create a caption subtitle, the technique of Patent Document 1 has no problem.

  However, in the invention disclosed in Patent Document 1 described above, the secondary data for constructing the caption subtitle is for reproducing the moving image data from its head, creating a translation, and synchronizing with the moving image data. Are sequentially registered in association with subtitles, which are translated sentences, for which synchronized data (commands for specifying start and end frames of video data for specifying the section in which subtitle super is being played (displayed)) is created Since the system is adopted, there is a problem in that it lacks flexibility at the time of creation, and requires specialized knowledge on moving image data / video content to some extent, such as registration of synchronization data, and has poor operability.

  Furthermore, when a system that once uploads video content including subtitle super on the site and then corrects (including addition / deletion) a part of the content of the subtitle super is disclosed in Patent Document 1 There was a problem that it was not possible to cope with the technology alone.

  Furthermore, the technique disclosed in Patent Document 1 does not integrate the secondary data such as the conventional subtitle super and the moving image data, and is different in that it is stored in separate files. It was the same as the previous distribution service in that the secondary data (subtitle super) was created in advance, released, and distributed.

  On the other hand, the present invention provides an unspecified general user (can be limited to some extent by member registration, etc.) as a creator of a translation to be displayed on the caption super as a service using a new Internet or the like. When a general user uses it to create a translation (subtitle super) for the video data for the part that he / she knows (the part he wants to create), the subtitle super for the video data is finally completed. In this way, we devised a system in which unspecified general users collaborate to create subtitle super. However, there is a problem that the technique of Patent Document 1 is not sufficient to realize such a system.

  In order to solve the above problems, the present invention provides (1) a moving image display unit for reproducing and displaying moving image data (corresponding to “moving image reproduction region R1” in the embodiment), and moving image data being reproduced on the moving image display unit A timeline display area for displaying the timeline, means for assigning a subtitle setting box in the timeline display area, and text input means for registering subtitles in the assigned subtitle setting box ("Subtitle Editing" in the embodiment) And a period for displaying the subtitle registered in the subtitle setting box from the both end positions of the subtitle setting box in the time flow direction of the timeline display area, and specifying the display period Information (time, frame, etc.) to be associated with the registered subtitles and stored in the subtitle data storage unit.

  The timeline display area displays the timeline of the moving image data being played back, and the currently playing portion is indicated by a scale line (SK in the embodiment) or a tip portion extending like a band like an indicator It is shown by. Then, in the timeline display area, a subtitle setting box is set in a portion where the subtitle is created, and the subtitle is registered there. The period for reproducing the registered subtitle is automatically set according to the positions of both ends of the subtitle setting box. Therefore, the user can intuitively recognize the period during which the subtitle registered therein is displayed from the both end positions of the subtitle setting box in the timeline display area. In addition, the setting of the caption setting box is, for example, confirming the movie drawn on the movie display unit, and specifying the beginning and end of the movie (frame) for which a certain caption is displayed is displayed. You can do it. This first and last designation can be made by clicking the corresponding position in the timeline display area. That is, since the subtitle setting period is specified by the subtitle setting box, the setting and the period recognition (confirmation) can be easily performed.

  Further, since the subtitle setting box can be set at an arbitrary position, the user only needs to set the subtitle setting box during the period in which the subtitle is registered. That is, it is not necessary to set subtitles over the entire period of the moving image data, and only a part that can be understood and a part that is desired to be created can be partially created and registered, so that subtitles can be easily created. In this caption creation system, a user in a remote place can access a server having the above functions and create captions using a communication / network such as the Internet.

  (2) Subtitles input by the text input means may be displayed in the corresponding subtitle setting box. In this way, it is possible to easily find a place where subtitles are not registered (forgotten) simply by setting the subtitle setting box. Furthermore, since the length of the caption setting box corresponds to the length of the display period of the caption registered therein, it is necessary to reduce the number of characters to be registered in the short caption setting box. Therefore, the user can recognize the number of valid characters that can be registered (the number of characters that the viewer can read and understand when playing subtitles) from the length of the subtitle setting box. For example, the user can register many subtitles. If the character goes out of the box or fills the box, you can understand that it is better to reduce it because there are too many characters.

  (3) As an editing function, it is good to provide at least one of the function which changes a position to the both ends of the said subtitle setting box, and the function which changes the registered subtitle.

  (4) Reading the caption for the moving image data stored in the caption data storage unit and information for specifying a period for displaying the caption, displaying the caption setting box in the timeline display area, and displaying the caption When subtitles are registered in the setting box, a function for displaying subtitles in the subtitle setting box and a person other than the person who registered the subtitles add a new subtitle setting box in the timeline display area And a function for registering subtitles in the subtitle setting box (added / existing one). In this way, a single caption can be created by a plurality of people, and a better caption can be easily constructed. In addition, at the time of the first release, even if it is content that is incomplete as video data with only subtitles or subtitle super, it is gradually It is possible to provide services such as getting closer to completion, and each user can be involved in creating subtitles as if they were playing. it can.

  (5) It is preferable to provide a function (copy function) for reading out the caption for the moving image data and information for specifying a period for displaying the caption and storing the information as a file for another caption data. In this way, another subtitle can be created using a part of the already created subtitle, so the burden of creation is reduced. Further, when translating into different languages, the burden of setting work for the subtitle setting box can be omitted by using the set subtitle setting box. Then, by looking at the created caption setting box, it is possible to easily determine whether or not it is appropriate from the length and the setting position, and by modifying it, it is possible to create a caption suitable for one's own sense. In addition, by using subtitle data in which subtitles are created in a part of the moving image, it is possible to create subtitle data for the user by creating the remaining subtitles. Therefore, the work load is reduced as compared with the case of newly creating from the beginning.

  (6) It is preferable to perform a speech recognition process on the sound output by reproducing the moving image data, detect a conversation break, and assign the caption setting box based on the break. In this way, since the subtitle setting box can be allocated over the entire moving image data for the time being, the work burden of subtitle setting box allocation is reduced. Of course, it is not necessary to register the subtitles in all the set subtitle setting boxes, and it is only necessary to register the subtitles only in the parts that the user can understand and the parts that he / she wants to create. Further, by providing a function for correcting the set caption setting box, fine adjustment can be performed after automatic setting.

  (7) It is preferable to provide a function of registering text data obtained by performing the voice recognition processing as a caption in the caption setting box. This is preferable because subtitles made up of text in the same language as that reproduced with moving image data are registered, which is useful for translation processing when creating subtitles in another language.

  (8) A program according to the present invention includes a moving image display means for reproducing and displaying moving image data, a time line display area for displaying a time line of moving image data being reproduced on the moving image display portion, and the time line display area. , Means for assigning a subtitle setting box, text input means for registering subtitles in the assigned subtitle setting box, and registered in the subtitle setting box from both end positions of the subtitle setting box in the time flow direction of the timeline display area. This is a program for specifying a period for displaying a closed caption, and for functioning as a means for associating the information for specifying the displayed period with the registered caption and storing it in the caption data storage unit.

  The present invention uses a subtitle setting box and assigns the subtitle setting box in the timeline display area, so that it is possible to easily determine whether or not the subtitle playback period is appropriate, and to set the subtitle setting box appropriately. This makes it easy to create subtitles. In addition, when a single subtitle data can be created by a plurality of people, each person can register a subtitle of an understandable part and can easily participate in subtitle creation as if it were a play.

It is a figure showing one suitable embodiment of this system. It is a figure which shows the example of a display of the moving image with a caption. It is a figure which shows an example of the display screen at the time of selecting the "original moving image detail" tab in case the subtitle is not provided. It is a figure which shows an example of the display screen at the time of selecting the "other subtitles of this moving image" tab when the subtitle is not provided. It is a figure which shows an example of a caption provision screen. It is a figure which shows an example of a caption description input screen. It is a figure which shows an example of the display screen at the time of selecting the "subtitle description" tab. It is a figure which shows an example of the display screen at the time of selecting a "subtitle content" tab. It is a figure which shows an example of the display screen at the time of selecting the "other subtitles of this moving image" tab.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. In the present invention, it is possible to use a communication / network such as the Internet to create a translated sentence or the like that constitutes a caption superuser through collaborative work with participation of ordinary people. As shown in FIG. 1, a user terminal 1 used by each user can access a subtitle creation and provision server 10 via the Internet 2. Various video data servers 3 are also connected to the Internet 2. The moving image data server 3 and the caption creation / providing server 10 may be configured by physically the same server or different servers. The moving image data server 3 may be a server of various moving image sharing sites or a server storing other moving image data.

  The subtitle creation and provision server 10 includes a communication interface 11 for connecting to the Internet 2 to transmit and receive data, a control unit 12 that executes predetermined processing, and a subtitle data storage unit that stores the generated subtitle data. 13. Further, the subtitle creation and provision server 10 may include a moving image data storage unit that stores moving image (video) data to be distributed. Specific functions of each processing unit will be described later.

  The user operates the user terminal 1, accesses the subtitle creation and provision server 10 via the Internet 2, and inputs subtitle super data to be given to the video data stored in the video data server 3. The input subtitle super data is stored in the subtitle data storage unit 13. For example, when the caption creation providing server 10 receives a viewing request for a moving image (video content) with caption from the user terminal 1, the moving image data server 3 storing the moving image data of the requested video content is recognized. Then, the stored moving image data is distributed to the user terminal 1, and the subtitle super stored in the subtitle data storage unit 13 is distributed to the user terminal 1 in synchronization therewith. Thereby, on the display screen of the display device of the user terminal 1, as shown in FIG. 2, the moving image data is reproduced and displayed in the moving image reproduction region R1, and the secondary data display region prepared under the moving image reproduction region R1. The read subtitle (text data) is displayed in R2. In addition, since the technique disclosed in Patent Document 1 can be used for the function of reproducing / drawing and outputting the moving image data and subtitles in synchronization, detailed description thereof will be omitted.

  Next, the functions of the control unit 12 will be described while describing each process for inputting specific subtitle data. First, the subtitle creation and provision server 10 is for realizing a subtitle creation and provision function as one function in a video providing (playback) site that provides a video with subtitles. Therefore, a user who wants to create subtitles first accesses such a site, and selects a video for which he / she wants to create subtitles from the displayed list. Note that the moving image data to be displayed in the list may be stored in a storage unit (moving image data storage unit) in the subtitle creation and provision server 10, or may be stored in another server such as the moving image data server 3. . A technique for displaying a list of moving image data to be processed or displaying a list selected from the displayed data and displaying it on the display screen of the display device of the user terminal 1 is conventionally known. The detailed description thereof will be omitted.

  If a processing target moving image for creating captions is selected in this way, a screen having a display layout as shown in FIG. 3 is drawn on the display mask of the user terminal 1, for example. That is, a moving image reproduction area R1 for reproducing a moving image (video) is prepared in the upper left, and a secondary data display area R2 for reproducing subtitles is prepared under the moving image reproduction area R1. If there is a subtitle associated with the moving image data being reproduced in the moving image reproduction region R1 in the subsidiary data display region R2, the subtitle (text) corresponding to the moving image being reproduced is output. In the case of new registration, since there is no associated subtitle, a new creation button area B2 in which "Create a new caption for this video" is prepared as shown in the figure, and this new creation button area B2 Click to go to the caption assignment screen.

  Below this secondary data display area R2, a narrow reproduction operation button display area R3 is prepared. The reproduction operation button display area R3 instructs to play / pause the moving picture drawn in the moving picture reproduction area R1 by clicking the operation button ("triangle mark" in the figure) B1 provided at the left end. be able to. The indicator portion IB shown in the playback operation button display area R3 indicates the download status of the video data to be drawn in the video playback area R1. Further, by operating the pointing device and clicking an appropriate position of the indicator portion IB with a pointer, a moving image is reproduced from the portion corresponding to the clicked position. Since these functions are also generally known techniques, a specific description including the internal processing is omitted.

  A related information display area R4 is prepared on the right side of the moving image reproduction area R1. In the related information display area R4, information about the other part selected from the four tabs prepared at the upper end as shown in the figure is displayed. The four tabs are “subtitle description”, “subtitle content”, “other subtitles of this video”, and “original video details”. Note that information displayed in the related information display area R4 when each tab is selected will be described later as appropriate. In addition, when no subtitle is given, there is no information to be presented about the subtitle, so the “Subtitle Description” tab and the “Subtitle Content” tab are inactive, and the tab can be selected by clicking. I can't do it.

  First, as shown in FIG. 3, in the related information display area R4 when the original moving image detail tab is selected, the explanatory text originally added to the moving image for which the caption is to be created is displayed. That is, when registering moving image data in a predetermined server, not only moving image data is registered, but there are many cases where an explanatory text for explaining / explaining the content of the moving image is associated and registered. When such an explanatory text is registered, the explanatory text is read and displayed in the related information display area R4. Accordingly, when there is no such explanatory text, the display is blank.

  Further, when the “other subtitles of this moving image” tab is selected when no subtitles are given, the display as shown in FIG. 4 is performed. That is, when no caption is added to the selected video data, the control unit 12 displays a message “There is no caption for this video yet” in the related information display area R4 as shown in the figure. A new creation button area B2 ′ in which “Create a new caption for this moving image” is displayed. Then, when this new creation button area B2 ′ is clicked, a transition is made to the caption provision screen.

  Further, the control unit 12 accesses the subtitle data storage unit 13 and searches for other subtitle data provided for a moving image including the same part as the selected moving image or a related moving image. The result is displayed as a list with “recommended subtitled video” below the related information display area R4. Display information for displaying the list includes a representative diagram (first frame or the like) representing a moving image and text information such as a title. When the video with the subtitles listed is clicked, the control unit 12 reproduces the video data in synchronism with the subtitles.

  When recognizing that the newly created button area B2 or B2 ′ has been clicked, the control unit 12 transitions to a caption providing screen. As shown in FIG. 5, the subtitle assignment screen includes a subtitle area setting area R5 and a subtitle editing area below the moving image reproduction area R1, the secondary data display area R2, the reproduction operation button display area R3, and the related information display area R4. A layout in which the region R6 is arranged is taken.

  The caption area setting area R5 is arranged at the lower end of the enlarged timeline display area TL including the currently reproduced portion and the enlarged timeline display area TL, and the currently reproduced (displayed) frame position in the entire moving image. An indicator I for specifying is provided. The enlarged timeline display area TL enlarges / reduces the display area of the subtitle area setting area R5 by moving the slider S prepared at the right end of the subtitle area setting area R5 up and down. In the present embodiment, a caption setting box (caption input area) BX can be set in the enlarged timeline display area TL according to the timeline. This subtitle setting box BX is for defining the period (timing) during which the set subtitle is displayed, and corresponds to the square frame (box) of the subtitle setting box BX from the front end position to the rear end position. During the time, the subtitle (text) registered in the subtitle setting box BX is continuously displayed.

  This subtitle setting box BX is specified (set) by operating the pointing device and clicking the desired position in the enlarged timeline display area TL (for example, left clicking on the pointing device) to set the front end position. When the pointing device is moved in a state (while the button of the pointing device is being pressed) and the button is released at a desired position, the rear end position is set at the released position. Of course, the positions before and after the caption setting box BX may be specified by other methods. In any case, if the user can designate the front and rear end positions of the caption setting box BX by designating a desired position in the enlarged timeline display area TL by operating the pointing device, the designation is easy and intuitive. This is preferable.

  Furthermore, in the enlarged timeline display area TL, the frame portion of the moving image currently being reproduced in the moving image reproduction region R1 is displayed as the scale line SK. Therefore, the moving image reproduced in the moving image reproduction region R1 is viewed. However, by confirming the scale line SK, the front and rear end positions of the caption setting box BX can be easily specified.

  Then, when the front and rear end positions of the caption setting box BX are set in this way, the control unit 12 recognizes time data (elapsed time from the start of reproduction of the moving image) of the front and rear end positions and responds to the time data. Identify the frame of the video data. These data are stored in association with the caption setting box BX. Specifically, a record number (for example, assigned in the order of creation) for specifying the caption setting box BX and the reproduction start time / end time of the caption are associated with each other and stored in the moving image data storage unit 13. In addition, text data to be reproduced as actual subtitles (specified by processing to be described later) is also registered in association with this data.

  In the present embodiment, the designation of the caption setting box BX can be designated with an arbitrary size with respect to an arbitrary position in the enlarged timeline display area TL. Subtitles can be made at locations where the subtitle setting box BX is set. Therefore, as shown in the figure, the subtitle setting box BX can be set in a perforated state with a space in the front and rear. Moreover, a function may be provided in which a new subtitle setting box BX is set there by clicking on a blank portion that is perforated and does not have the subtitle setting box BX set therein. The front and rear end positions in this case can be the boundary with the front and rear caption setting boxes BX.

  As described above, since it is permitted to set a subtitle setting box with a hole, the user can register the subtitle data for the subtitle of the portion he / she wants to create. This eliminates the need for the user to create subtitles for all parts of the moving image data, thus reducing the work load. In addition, subtitles for the remaining part can be created separately by adding to the created subtitle data or by quoting (copying) the subtitle data. In this case, since the subtitles of the additional part can be performed by other people, the user can easily create subtitles, and the subtitle super is gradually completed by a plurality of participants. New services can be provided.

  The input of subtitles (text data) to be drawn as an actual subtitle super is performed using the subtitle editing area R6. That is, when text data is input to the caption editing area R6, the caption data is registered for one active caption setting box BX among one or more caption setting boxes BX. Here, for the caption setting box BX that becomes active, for example, when the caption setting box BX is newly set as described above, the caption setting box BX is activated. Further, when the already-set subtitle setting box BX is clicked and selected, the subtitle setting box BX becomes active. When the subtitle setting box BX is clicked in this way, the control unit 12 draws a frame corresponding to the clicked position on the timeline in the moving image reproduction region R1, and also displays the cursor line SK in the enlarged timeline display area TL. Draw at the clicked position. By performing such control, the subtitle input operation can be performed while watching the moving image corresponding to the text data of the subtitle to be currently input.

  When text data is input to the caption editing area R6, the control unit 12 registers the input text data in the caption data storage unit 13 in association with the currently active caption setting box BX, and expands the text data. The text data is drawn at predetermined positions in the active caption setting box BX, the secondary data display area R2, and the related information display area R4 in the timeline display area TL. In the related information display area R4, a square subtitle data display frame corresponding to each subtitle setting box BX is prepared, and text data and a time (start time and end time) for drawing the text data are drawn in the subtitle data display frame. To come. In addition, a “delete” button is prepared at the right end of the subtitle data display frame, and when the control unit 12 recognizes that the “delete” button has been clicked, data related to the corresponding subtitle setting box BX are collectively displayed. To delete.

  Therefore, when registration of subtitles proceeds, as shown in FIG. 5, subtitle data display frames are displayed side by side for each timeline in the related information display area R4, and the timeline is also displayed in the enlarged timeline display area TL. Text data to be displayed in the subtitles are displayed side by side. In the enlarged timeline display area TL, the part currently reproduced in the moving image reproduction area R1 is displayed, but the caption data display frame output in the related information display area R4 is provided at the right end of the area. By moving the slider up and down, you can see the part of the subtitle that is not currently being played back, which is helpful for creating the current subtitle. Furthermore, when there is a blank box among the subtitle setting boxes BX in the enlarged timeline display area TL, a specific subtitle is not input although a frame for displaying the subtitle super is secured. Means. Therefore, confirming that there is no blank in the set caption setting box BX can suppress forgetting to register the caption. Of course, once the subtitle setting box BX with the subtitles input is selected, the input subtitles (text data) are output to the subtitle editing area R6, so that the output text can be edited such as addition / deletion / change. By performing the processing, the input data can be changed.

  In addition, a character decoration palette P is prepared. A character input in the subtitle editing area R6 is designated, and a predetermined button for the character decoration palette P is clicked to decorate the character (color).・ Change and set the size.

  When the subtitle input process (STEP 1) ends, the process proceeds to a subtitle information input process (STEP 2). As shown in FIG. 5, the transition to the subtitle information input process is as shown in FIG. 6 by preparing a button B3 drawn “STEP2 input subtitle information” at the bottom of the subtitle input screen and clicking it. This is realized by making a transition to the “subtitle information input processing screen” shown. Of course, it can also be switched by a method such as a predetermined command input or selection from a menu list.

  As shown in FIG. 6, in the subtitle information input process, information about the subtitles input in the previous input process, that is, “subtitle title”, “subtitle description”, “subtitle language”, “nickname”, “lock presence / absence” "Password". The “subtitle title” is a title for identifying and identifying the subtitle created by itself. “Subtitle explanation” is a sentence for introducing subtitles. "Subtitle language" is selected from those listed in the pull-down menu. “Nickname” registers the name of the user to be disclosed on the net. When the created subtitles are distributed, the name of the creator (“nickname” registered here) is also disclosed so that the third party can know who created the subtitles. Thus, by using the nickname as a search key, a third party can easily find and watch subtitles of his / her favorite author, and reference / use it when creating other subtitle data.

  “Lock / Unlock” is selected by clicking one of them. When “lock” is selected, third-party editing of the created caption data is not permitted. On the other hand, when “lock free” is selected, third-party editing of subtitle data is permitted. In other words, the registered subtitle data is read, and a new subtitle setting box BX is additionally set during the timeline of the unset portion in the enlarged timeline display area, or an existing (set) subtitle setting box BX is selected. You can edit the created subtitles. In addition, by attaching a “password”, a function is also provided so that only a limited number of people who know the password can edit it even if it is unlocked.

  Then, by clicking a “decision” button provided at the bottom of the caption information input processing screen, the contents of each registered data are confirmed and registered in the caption data storage unit 13. As a result, a series of caption registration processing (STEP 1 & 2) is completed, and captions are assigned to the first selected moving image data.

  Therefore, when this moving image data is selected with the addition of the caption data, the above-described four tabs (“Subtitle Description”, “Subtitle Content”, “ “Other subtitles” and “Original video details”) can all be selected.

  Then, when the “Subtitle Description” tab is selected, as shown in FIG. 7, the related information display area R4 draws the caption description, that is, the description of the assigned caption itself. That is, the control unit 12 reads and outputs the “subtitle title” and “subtitle description” data input on the subtitle information input processing screen and stored in the subtitle data storage unit 13. In addition, it recognizes either “lock / lock free” and also outputs the status. In the example of FIG. 7, since it is “lock free”, the description (that it can be edited) is also notified. Further, in the related information display area R4 displayed in the “Subtitle Description” tab, a “Subtitle Edit” button B6 is prepared. When this “Subtitle Edit” button B6 is clicked, the subtitles shown in FIG. Transit to the input screen and input (edit) subtitles. In the “locked” state, when a user other than the creator is watching, the “subtitle editing” button may be controlled so that it cannot be clicked.

  When the “subtitle content” tag is selected, the control unit 12 reads the subtitles associated with the selected moving image data, and arranges the subtitles for each timeline in the order of reproduction as shown in FIG. indicate. In addition, when moving image data is reproduced in the moving image reproduction area R1, the control unit 12 changes the background color of the subtitle being reproduced.

  Further, when the “other subtitles of this video” tag is selected for the video with subtitle data attached, the subtitle data provided for the same video is displayed in the related information display area R4 as shown in FIG. A list of will be displayed. When an arbitrary one is clicked from the displayed list, the clicked subtitle is reproduced together with the moving image.

  In addition, as described above, a person different from the person who first created the caption data reads out and updates the lock-free caption data, so that a plurality of persons can jointly create one caption data. Then, using the read subtitle data, the read person can create new subtitle data and register it as another file. That is, the subtitle data registered in the subtitle data storage unit 13 is copied, and appropriately corrected data is registered as new subtitle data. In this case, the author (nickname) of the read subtitle data that is the base is also registered in association with it, and when reproducing, the author name of the copy source is also displayed. In the present embodiment, a message “This subtitle was copied and edited from“ XXXXX ”” is drawn on the video playback area R1, and the location of “XXXXXX” is drawn. The nickname is inserted in the drawing.

  By using the caption creation / providing server 10 of the present embodiment, the following service (system) can be provided. In other words, when publishing a video (video content), it is published in the state of incomplete subtitle content such as only video data or only a part of subtitle super, or in the first place, as with video sharing sites One or a plurality of unspecified users other than the video data provider can subsequently add subtitles to the video data distributed in the absence of video. A third party can view moving image data with subtitles by a service that distributes the subtitles and moving image data provided in this manner while synchronizing them.

  Focusing on the process of creating subtitles, the present embodiment is a new service using the Internet and the like, as a creator of subtitles displayed on the subtitle supermarket. The general user can create subtitles for the video data for the part that he can understand (the part he wants to create), so that the subtitle super for the video data is finally Unfinished general users can collaborate to create a subtitle super.

  In addition, by using the above function for creating new caption data by copying, it is possible to easily create captions using another language by translation. That is, subtitles are drawn in accordance with the occurrence of sound in the video data. Therefore, even if the languages are different, the timelines playing a certain subtitle are the same. Therefore, in the subtitle data for the same original moving image data, the subtitle setting box BX created in a certain language can be used in the same way for other subtitle data. Therefore, when the subtitles that have been created are read out, the subtitle setting box BX that is set there is used, subtitles composed of translated sentences in a predetermined language are sequentially registered in the subtitle setting box BX, and stored as a separate file Now you can create subtitles in different languages. In this case, as subtitle creation processing, setting processing of the subtitle setting box BX can be omitted, so that workability is improved. In addition, the timeline in which each set subtitle is drawn is determined by subtitle setting set by another person by looking at the subtitle setting box BX allocated in the timeline in the enlarged timeline display area TL. You can easily understand whether the box is correct (can be used as it is). Moreover, since the displayed time is proportional to the length of the caption setting box BX, it can be determined whether or not it is also visually suitable. As described above, since the suitability can be easily determined, a caption setting box set by another person can be easily used. If it is determined that the subtitle setting box BX is not suitable, one or both of the front end position and the rear end position of the subtitle setting box BX may be corrected.

  Further, as described above, the length of the caption setting box BX is proportional to the drawing time as it is. Therefore, when the subtitle setting box BX is short, the subtitle registered there disappears in a short time. Therefore, if the number of characters is too large in such a case, the viewer may lose the subtitle before reading the entire subtitle. Therefore, in order to prevent the occurrence of such a situation, it is preferable to limit the number of characters that can be registered according to the length (display time) of the caption setting box BX. Even if there is no restriction on the number of characters, if the length of the subtitle setting box BX is short, when a large number of characters are input in the subtitle editing area R6, all the input characters are displayed in the corresponding subtitle setting box BX. It will not be displayed. Therefore, since the input characters are displayed in the corresponding subtitle setting box BX, it is possible to easily check whether the number of characters is too large for the reproduction (drawing) time.

  The subtitle is not limited to text data described in a language different from the language of the voice in which the translated text, that is, the moving image data is generated, and may be text data in the same language as the voice. That is, there may be a usage form in which the audio of the moving image data is Japanese and the subtitles are also Japanese. Accordingly, it has a function of reproducing moving image data, performing voice recognition processing, setting a caption setting box BX for each conversation, and registering text data obtained as a result of the recognition processing in the set caption setting box BX. And good. This is preferable because the subtitle setting box BX is allocated to each portion that is producing sound during the actual reproduction of the moving image data, and therefore the subtitle setting box can be allocated easily and accurately. And since the sentences that actually occur are automatically registered, the person who creates the translation can translate while looking at the original language that is recognized by the voice, so only the voice that is actually generated Compared with the one that translates from, workability is improved.

DESCRIPTION OF SYMBOLS 1 User terminal 2 Internet 3 Movie data server 10 Subtitle creation providing server 11 Communication interface 12 Control unit 13 Subtitle data storage unit

Republished 02/037841

Claims (8)

A video display section for reproducing and displaying the video data;
A timeline display area for displaying the timeline of the video data being played in the video display section,
In the timeline display area, a means for assigning a caption setting box,
Text input means for registering subtitles in the assigned subtitle setting box;
The period for displaying the subtitle registered in the subtitle setting box is specified from both end positions of the subtitle setting box in the time flow direction of the timeline display area, the information for specifying the display period, and the registered Means for associating subtitles and storing them in a subtitle data storage unit;
A subtitle creation system characterized by comprising:   2. The caption generation system according to claim 1, wherein the caption input by the text input means is displayed in a corresponding caption setting box. As an editing function,
3. The caption creation system according to claim 1, further comprising at least one of a function of changing positions at both ends of the caption setting box and a function of changing registered captions. Read the information specifying the caption and the period for displaying the caption for the video data stored in the caption data storage unit, and display the caption setting box in the timeline display area. When subtitles are registered, a function to display subtitles in the subtitle setting box,
A function that allows a person other than the person who registered the caption to newly add a caption setting box in the timeline display area;
A function for registering subtitles in the subtitle setting box;
The subtitle creating system according to claim 1, further comprising:   5. The information processing apparatus according to claim 1, further comprising: a function of reading out information specifying the subtitles of the moving image data and a period for displaying the subtitles and storing the information as a file of another subtitle data. Subtitle creation system described.   6. A voice recognition process is performed on audio output by reproducing the moving image data, a conversation break is detected, and the subtitle setting box is allocated based on the break. The closed caption production system according to any one of the items.   7. The caption creation system according to claim 6, further comprising a function of registering text data obtained by performing the speech recognition processing as a caption in the caption setting box. Computer
Movie display means for reproducing and displaying movie data,
A timeline display area that displays the timeline of the video data being played in the video display area,
In the timeline display area, means to assign a subtitle setting box,
Text input means for registering subtitles in the assigned subtitle setting box,
The period for displaying the subtitle registered in the subtitle setting box is specified from both end positions of the subtitle setting box in the time flow direction of the timeline display area, the information for specifying the display period, and the registered A program for causing subtitles to be associated and stored in a subtitle data storage unit.

Images