CN103067775A - Subtitle display method for audio/video terminal, audio/video terminal and server - Google Patents
Subtitle display method for audio/video terminal, audio/video terminal and server Download PDFInfo
- Publication number
- CN103067775A CN103067775A CN2013100330454A CN201310033045A CN103067775A CN 103067775 A CN103067775 A CN 103067775A CN 2013100330454 A CN2013100330454 A CN 2013100330454A CN 201310033045 A CN201310033045 A CN 201310033045A CN 103067775 A CN103067775 A CN 103067775A
- Authority
- CN
- China
- Prior art keywords
- audio
- captions
- video
- target language
- languages
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention is suitable for the technical field of images and provides a subtitle display method for an audio/video terminal, the audio/ video terminal and an audio/video server. According to the method, the audio/video terminal acquires audio/video program information and a language type of a target language subtitle and sends the audio/video program information and the language type of the target language subtitle to the audio/video server; when the audio/video server searches the target language subtitle in a subtitle database, the audio/video terminal receives the target language subtitle fed back by the audio/video server; and the audio and video terminal plays the target language subtitle. According to the subtitle display method, the audio and video program information and the target language subtitle are analyzed, and the corresponding subtitle is searched in the subtitle database of the audio/video server according to a user demand; if no corresponding resource is searched, other language subtitles are translated and stored into the database of the server; and if a corresponding resource is searched, the target language subtitle is acquired and played; and therefore, the experience that a user watches audio and video programs is enhanced.
Description
Technical field
The invention belongs to the digital television techniques field, relate to a kind of caption presentation method, audio-video terminal and server of audio-video terminal.
Background technology
At present, nearly all audio/video program all can use captions.Captions are that the voice content with audio/video program shows in the captions mode, can help the weak spectators of hearing to understand programme content.In addition, captions also can be used for translation foreign language program, allow the spectators that do not understand this foreign language, can hear the vocal cords of original work, understand simultaneously programme content.
In films and television programs, the captions that program is corresponding are attached among the program, perhaps the manual loading subtitle file.For without captions, captions language kind obstacle, can't obtain corresponding subtitle file, can't the loading caption file situation, the user just can not enjoy the facility that captions bring.
For the captions in the audio/video program, generally can be plug-in captions, interior extension captions and embedded captions.If have language kind obstacle between the captions that user and program dispose, for plug-in captions, can replace by searching on the internet corresponding captions resource, but cumbersome, and may lack corresponding resource.For interior extension captions, if when making, provide corresponding languages, can switch languages.For embedded captions, when making, do not provide corresponding languages, then can't replace captions.
For the captions of audio/video program, if when there is language kind obstacle in the captions that user and program dispose, the mode of solution is generally: for plug-in captions, can provide multilingual as far as possible captions; For interior extension captions, can only when making, provide more multilingual; For embedded captions, can't change languages.No matter be plug-in captions, interior extension captions or embedded captions, all can't perfectly solve language kind obstacle.
Summary of the invention
In order to solve the problems of the technologies described above, the purpose of the embodiment of the invention is to provide a kind of caption presentation method of audio-video terminal.
The embodiment of the invention is achieved in that a kind of caption presentation method of audio-video terminal, said method comprising the steps of:
Audio-video terminal obtains the languages type of audio/video program information and target language captions, and the languages type of described audio/video program information and target language captions is sent to audio/video server;
When audio/video server when caption database searches the target language captions, audio-video terminal receives the target language captions of described audio/video server feedback;
Audio-video terminal is play described target language captions.
Further, described method also comprises:
When audio/video server searches existing languages captions corresponding to audio/video program information but its languages when being different from the target language captions in caption database, audio-video terminal shows that according to the Search Results of audio/video server feedback the languages tabulation of existing languages captions is for user selection;
Audio-video terminal receives the languages selection instruction of the existing languages captions of user's input;
Audio-video terminal obtain from audio/video server user selection existing languages captions subtitle file and play described subtitle file.
Further, described method also comprises:
When audio/video server does not search captions corresponding to audio/video program information in caption database, analyze in the audio/video flow whether comprise captions;
When comprising captions in the audio/video flow, play described audio frequency and video and therefrom extract captions;
The captions that extract are sent to audio/video server.
Further, described method also comprises step:
The existing languages captions of basis that audio-video terminal reception audio/video server sends or the caption translating of extraction become the subtitle file of target language captions;
The caption translating that audio-video terminal is play the existing languages captions of described basis or extraction becomes the subtitle file of target language captions.
Further, described method also comprises:
Receive the user to the modification editor input of subtitle file;
To be modified edited subtitle file and upload to audio/video server.
Further, described method also comprises:
Receive the user by the subtitle language translation of microphone input;
Described subtitle language translation is uploaded to audio/video server, and described subtitle language translation is identified as the text subtitle translation.
Another purpose of the present invention is to provide a kind of audio-video terminal, and described audio-video terminal comprises:
Programme information and languages type acquisition module are used for obtaining the languages type of audio/video program information and target language captions, and the languages type of described audio/video program information and target language captions is sent to audio/video server;
Captions query requests module is used for sending audio frequency and video captions query requests to audio/video server
Target language captions receiver module, be used for when audio/video server when caption database searches the target language captions, receive the target language captions that described audio/video server feeds back;
Target language captions playing module is used for playing described target language captions.
Further, described audio-video terminal also comprises:
Existing languages subtitle list display module, be used for searching existing languages captions corresponding to audio/video program information but its languages when being different from the target language captions when audio/video server in caption database, according to the Search Results of audio/video server feedback, show that the languages tabulation of existing languages captions is for user selection;
Languages selection instruction receiver module is for the languages selection instruction of the existing languages captions that receive user's input.
Further, described audio-video terminal also comprises:
The audio/video flow analysis module, be used for when audio/video server when caption database does not search captions corresponding to audio/video program information, whether comprise captions in the analysis audio/video flow;
The captions extraction module is used for when audio/video flow comprises captions, plays described audio frequency and video and therefrom extracts captions;
Extract the captions sending module, the captions that are used for extracting send to audio/video server.
Further, described audio-video terminal also comprises:
Subtitle file is revised editor module, is used for receiving the user to the modification editor input of subtitle file;
Revise transmission module on the captions, be used for to be modified edited subtitle file and upload to audio/video server;
Further, described subtitle file is revised editor module and is also comprised the microphone input module, is used for receiving the user by the subtitle language translation of microphone input, and described subtitle language translation is uploaded to audio/video server.
Another object of the present invention is to provide a kind of audio/video server, described server comprises:
The captions receiving element is used for the original caption information of receiving terminal and translation request;
The caption translating unit, being used for original captions information translation is the multilingual text subtile;
Memory cell is used for storage audio frequency and video captions;
Query unit is used for the request according to audio-video terminal, the searching of performance objective captions;
The caption information transmission unit is used for the translation request according to terminal, sends corresponding audio frequency and video captions.
Preferably, described server also comprises
Revise the captions receiver module, be used for receiving and revised editor's subtitle file by the user, described subtitle file comprises that the user carries out the audio file of subtitle language translation;
The speech modification recognition unit is used for the audio file of described subtitle language translation is identified as the text subtitle translation;
The captions confirmation unit is used for confirming that it is formal caption translating text that the user submits the caption translating of revision to.
Preferably, described query unit also comprises a plurality of languages table data generation units, is used for inquiring about and generate a plurality of existing languages caption information of alternative target language captions when audio/video server does not find corresponding target language captions.
In the present invention, analyze according to audio/video program information and target language captions, in the caption database of audio/video server, search corresponding captions according to user's request, if without corresponding resource, other languages captions are translated, and deposit to server database, if corresponding resource is arranged then obtain and play this target language captions.Like this, just improve the user and watched the experience of audio/video program.
Description of drawings
Fig. 1 is the flow chart that caption presentation method first embodiment of audio-video terminal of the present invention provides;
Fig. 2 is the flow chart that caption presentation method second embodiment of audio-video terminal of the present invention provides;
Fig. 3 is the flow chart that caption presentation method the 3rd embodiment of audio-video terminal of the present invention provides;
Fig. 4 is the flow chart that extracts the method for captions among Fig. 3 in video;
Fig. 5 is the structural representation that audio-video terminal the 4th embodiment of the present invention provides;
Fig. 6 is the structural representation that audio/video server the 5th embodiment of the present invention provides.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, is not intended to limit the present invention.
Fig. 1 shows the caption presentation method flow process of the audio-video terminal that first embodiment of the invention provides, and details are as follows:
In step S101, audio-video terminal obtains the languages type of audio/video program information and target language captions, and the languages type of described audio/video program information and target language captions is sent to audio/video server.The languages type of described target language captions can be the languages type information of user's request, perhaps according to the captions languages type information of its acquiescence of audio/video program acquisition of information.
By guaranteeing that server is fed back captions and the user is watched video to be complementary, as embodiments of the invention, obtain audio/video program information and comprise: need obtain video name, the video duration, the director acts the leading role, the information such as artist are if TV play need be obtained current video and be which collection information.Described languages type is as being Chinese, English, Japanese, Korean etc.
In step S102, when audio/video server when caption database searches the target language captions, audio-video terminal receives the target language captions of described audio/video server feedback.
In step S103, audio-video terminal is play described target language captions.
What deserves to be explained is, the caption presentation method of the audio-video terminal that provides in the present embodiment is can't provide in the captions situation of meeting consumers' demand at original audio-video document, audio-video terminal is to the process of audio/video server request captions, carry the captions of meeting consumers' demand when original audio-video document can provide, then play-over audio frequency and video and carry captions and get final product.
In the present embodiment, the audio frequency and video original document that audio-video terminal is play lacks captions or the captions that provide can't satisfy in user's the situation of demand, by connecting with audio/video server, obtain the caption that is stored in audio/video server, the user controls audio-video terminal and obtains quickly and easily captions, improved the experience that the user watches audio/video program.
Fig. 2 shows the flow process of the caption presentation method of the audio-video terminal that second embodiment of the invention provides, and details are as follows:
In step S201, audio-video terminal obtains the languages type of audio/video program information and target language captions, and the languages type of described audio/video program information and target language captions is sent to audio/video server.
In step S202, audio/video server is searched in caption database.
In step S203, judge whether the captions that audio/video program information is corresponding? when having captions corresponding to audio/video program information, execution in step S204, otherwise execution in step S206.
In step S204, audio/video server is to audio-video terminal feedback target languages captions.
In step S205, audio-video terminal is play described target language captions.When searching captions corresponding to audio/video program information, carry out the demonstration that this step has just been finished captions.
In step S206, whether comprise captions in the audio/video flow that the analysis audio-video terminal is play, when not comprising captions, then this method can't provide captions, when comprising captions, execution in step S207.
In step S207, when comprising captions in the audio/video flow, from the described audio/video program of playing, extract captions.
In step S208, the captions that extract are sent to audio/video server.
In step S209, audio/video server sends the subtitle file that becomes the target language captions according to the caption translating of described extraction to audio-video terminal.
In step S210, audio-video terminal is play the subtitle file that described caption translating according to extracting becomes the target language captions.
What deserves to be explained is that described caption database can be independent of audio/video server, and as one independently the caption translating cloud server provide the audio frequency and video translation service for audio-video terminal.
Fig. 3 shows the flow process of the caption presentation method of the audio-video terminal that third embodiment of the invention provides, and details are as follows:
In step S301, audio-video terminal obtains the languages type of audio/video program information and target language captions, and the languages type of described audio/video program information and target language captions is sent to audio/video server.
In step S302, in the caption database of audio/video server, search for.
In step S303, judge whether the captions that audio/video program information is corresponding, when having captions corresponding to audio/video program information, execution in step S304, otherwise execution in step S310.
In step S304, judged whether the target language captions? when in the caption database of audio/video server the target language captions being arranged, execution in step S305, otherwise execution in step S307.
In step S305, audio-video terminal receives the target language captions of described audio/video server feedback.
In step S306, audio-video terminal is play described target language captions.When searching captions corresponding to audio/video program information, carry out the demonstration that this step has just been finished captions.
In step S307, audio-video terminal shows that according to the Search Results of audio/video server feedback the languages tabulation of the existing languages captions (for example captions of other languages) of audio/video server is for user selection.
In step S308, audio-video terminal receives the languages selection instruction of the existing languages captions of user's input.
In step S309, audio-video terminal obtain from audio/video server user selection existing languages captions subtitle file and play described subtitle file.
In step S310, comprise captions in the audio/video flow that the analysis audio-video terminal is play? when not comprising captions, then this method can't provide captions, when comprising captions, and execution in step S311.
In step S311, when comprising captions in the audio/video flow, play described audio frequency and video and therefrom extract captions.
In step S312, the captions that extract are sent to audio/video server.
In step S313, audio/video server sends the subtitle file that basis has the languages captions or becomes the target language captions according to the caption translating of described extraction to audio-video terminal.
In step S314, audio-video terminal is play the subtitle file that described caption translating according to extracting becomes the target language captions.
As embodiments of the invention, on the basis of the second above embodiment and the 3rd embodiment, the caption presentation method of this audio-video terminal can also comprise step: receive the user to the modification editor input of subtitle file; To be modified edited subtitle file and upload to audio/video server.By above-mentioned steps, the user can edit subtitle file, thereby has further guaranteed the correctness of subtitle file.And the user can also identify subtitle file, thereby whether correct captions carry out mark audio/video server end can carry out correctness verification (for example carrying out verification by the staff) for uncertain.
As another embodiment of the present invention, the user can also input the captions voiced translation by microphone, and at this moment, described method also comprises: receive the user by the subtitle language translation of microphone input; Described subtitle language translation is uploaded to audio/video server, and described subtitle language translation is identified as the text subtitle translation.
In the present invention, because translation may be inaccurate, the user can carry out edit-modify to subtitle file, and the subtitle file behind the editor can be uploaded in the audio/video server, thereby the accuracy that has improved the subtitle file translation can increase again recreational and social functions.And the user is when watching program, by subtitle file is identified, or edited by the staff more afterwards, do not watch program thereby do not affect the user.
When the user watches audio/video program, when there is language kind obstacle in the captions that carry with audio/video program, call this system.Because no matter which kind of audio-video source (local audio frequency and video, online audio frequency and video, TV program) and captions why type (plug-in captions, interior extension captions and embedded captions), final captions all can cooperate audio frequency and video to show.The embodiment of the invention is carried out image sampling when showing, by image character identification, obtain in progress captions, institute is obtained captions upload onto the server.And audio/video server carries out the intelligence translation to captions, and translation result feeds back to audio-video terminal and shows.
Server end deposits former captions and newly-generated captions in the caption database in, saves as plug-in subtitle file.Caption data allows user's mark and revises mistake.Other users without captions or there is language kind obstacle, can directly get existing caption data in the caption database according to audio/video information when watching identical audio frequency and video, need not again to translate, and can use by off-line.
Fig. 4 shows the flow process of the method for captions of extracting that the embodiment of the invention provides in video, details are as follows:
In step S401, according to the captions feature, when one section captions begins to show, record its time started stamp.
A complete captions are comprised of sentence captions, and every captions are all by showing that zero-time, displaying contents, three key points of demonstration duration form.It is most important to obtain correct displaying contents and timestamp.Captions general features: the captions of same video, relatively fixing in the viewing area on the screen (how below video).Captions are shown as light black surround (as: wrongly written or mispronounced character black surround) more, and the captions font is in many ways just easy to identify, and captions show when dialogue or other sound are arranged that generally one section captions captions within showing duration can not change.
In step S402, get one-frame video data and obtain this section subtitle strings by optical character identification (OCR) mode.
In step S403, character string is uploaded to audio/video server carries out the intelligence translation.Certainly being not limited to audio/video server here, also can be other cloud servers that intelligent translation service is provided, and independently provides intelligent translation service by it.
In step S404, translation result is back to user side, and shows.
What deserves to be explained is, above-mentioned steps S402 to S403 obtains character string at audio-video terminal, the screen image data copied in image buffers view data or captions that this programme can certainly be only obtains Subtitle Demonstration at audio-video terminal, and described view data uploaded to audio/video server, in audio/video server, adopt optical character identification (OCR) mode to obtain this section subtitle strings, and described character string is stored in the database of high in the clouds, simultaneously to the captions of audio-video terminal feedback through the translation of audio/video server intelligence.
In step S404, when former captions finished to show, going back recordable time was the blanking time, and this blanking time is fed back to audio/video server.
Because therefore the unavoidably wrong appearance of meeting of caption translating allows and encourages competent user to correct and improve translation result, be necessary.The surely time update owing to differ in watching the program process is so can advanced row labels process.
Fig. 5 shows the structure that audio-video terminal the 4th embodiment of the present invention provides, and this audio-video terminal comprises programme information and languages type acquisition module 51, target language captions receiver module 52 and target language captions playing module 53, captions query requests module 60.
This programme information and languages type acquisition module 51 are used for obtaining the languages type of audio/video program information and target language captions, and pass through the 60 transmission captions requests of captions query requests module, and the languages type of described audio/video program information and target language captions is sent to audio/video server; When audio/video server when caption database searches the target language captions, target language captions receiver module 52 receives the target language captions of described audio/video server feedback; Target language captions playing module 53 is play described target language captions.
As embodiments of the invention, described audio-video terminal also comprises: existing languages subtitle list display module 57 and languages selection instruction receiver module 58.Should existing languages subtitle list display module 57 in caption database, search existing languages captions corresponding to audio/video program information but its languages when being different from the target language captions when audio/video server, according to the Search Results of audio/video server feedback, show that the languages tabulation of existing languages captions is for user selection; Languages selection instruction receiver module 58 receives the languages selection instruction of the existing languages captions of user's input; After this languages selection instruction sent to audio/video server, target language captions receiver module 52 received the target language captions of described audio/video server feedback, and target language captions playing module 53 is play described target language captions.
As embodiments of the invention, described audio-video terminal also comprises: audio/video flow analysis module 54, captions extraction module 55 and extraction captions sending module 56.When this audio/video flow analysis module 54 fails to search captions corresponding to audio/video program information when audio/video server in caption database, analyze in the audio/video flow whether comprise captions; Captions extraction module 55 extracts captions from the described audio/video program of playing when comprising captions in the audio/video flow; Extract captions sending module 56 captions that extract are sent to audio/video server, the captions of extraction described here can be that the captions of character string forms also can be the files of the captions of picture format.Then, target language captions receiver module 52 receives the target language captions of described audio/video server feedback, and target language captions playing module 53 is play described target language captions.
In order to guarantee the correctness of captions, described audio-video terminal also comprises: subtitle file is revised editor module 62 and is revised transmission module 63 on the captions.This subtitle file is revised editor module 62 and is received the user to the modification editor input of subtitle file; Transmission module 63 will be modified edited subtitle file and upload to audio/video server on the modification captions.
As another embodiment of the present invention, this subtitle file is revised editor module 62 and is also comprised the voice edition module 61 that can pass through microphone input editing modification, this voice edition module 61 receives the user by the subtitle language translation of microphone input, and by transmission module 63 on the described modification captions translation of described subtitle language being uploaded to audio/video server, audio/video server is with described subtitle language translation or be identified as the text subtitle translation.
The existence of caption database is very useful, when the user does not have captions and subtitle language obstacle, can obtain first data from database, if there are not data just to translate processing.The resource acquisition of database and captions optimization is mainly in the following manner: 1, captions and the former captions through system's translation all deposit database automatically in.2, when the user has the captions resource, can directly upload to database.3, the user can the Update Table storehouse in the captions mistake, optimize translation.To with existing captions need not the translation, but in the database without the audio frequency and video of corresponding subtitle data, upload after caption information can being obtained, translate in case of necessity to deposit in database.
Fig. 6 shows the structure that audio/video server the 5th embodiment of the present invention provides, and this audio/video server comprises: captions receiving element 70, caption translating unit 71, captions transmission unit 72.
This captions receiving element 70 is used for receiving the original caption information and translation request of audio-video terminal; It is the multilingual text subtile that caption translating unit 71 is used for original captions information translation; The translation request that captions transmission unit 72 is used for according to terminal sends corresponding audio frequency and video captions.
Preferably, described audio/video server also comprises memory cell 78, and described memory cell 78 storages are through the caption information of caption translating unit 71 translations.
Preferably, described audio/video server also comprises query unit 79, and described query unit 79 is according to the request of audio-video terminal, the searching of performance objective captions, and by 72 feedback searches of captions transmission unit to caption information.Further, described query unit 79 also comprises a plurality of languages table data generation units 80, be used for when audio/video server does not find corresponding target language captions, inquiring about and generate a plurality of existing languages caption information of alternative target language captions, and feed back to audio-video terminal.
Preferably, described audio/video server also comprises and revises captions receiver module 74 and captions confirmation unit 76, speech modification recognition unit 75.
Revise captions receiver module 74 and revised editor's subtitle file for receiving by the user, described subtitle file comprises that the user carries out the audio file of subtitle language translation; Speech modification recognition unit 75 is used for the audio file of described subtitle language translation is identified as the text subtitle translation; Captions confirmation unit 76 is used for confirming that it is formal caption translating text that the user submits the caption translating of revision to; The captions of confirming through captions confirmation unit 76 will be updated in the memory cell 78.
In sum, when audio frequency and video that the user views and admires user's audio frequency and video during without captions of having an aphasis particularly, the present invention analyzes according to audio/video program information and target language captions, in the caption database of audio/video server, search corresponding captions according to user's request, if without corresponding resource, with other languages captions or obtain the own captions of video by the OCR mode and translate, and deposit to server database, if corresponding resource is arranged then obtain and play this target language captions; Owing to may there be the stiff or wrong situation of translation in the process of captions automatic translation, the function that the present invention also provides the user to proofread and correct voluntarily, this calibration function can be that the user proofreaies and correct by text editing also can be by voiced translation, and identifying voice is that text is proofreaied and correct again; Preferably, after caption translating is proofreaied and correct by the user, just issue the caption translating of corrigendum after also need to being confirmed by the staff.Like this, just improve the user and watched the experience of audio/video program.
The above only is preferred embodiment of the present invention, not in order to limiting the present invention, all any modifications of doing within the spirit and principles in the present invention, is equal to and replaces and improvement etc., all should be included within protection scope of the present invention.
Claims (14)
1. the caption presentation method of an audio-video terminal is characterized in that, said method comprising the steps of:
Audio-video terminal obtains the languages type of audio/video program information and target language captions, and the languages type of described audio/video program information and target language captions is sent to audio/video server;
When audio/video server when caption database searches the target language captions, audio-video terminal receives the target language captions of described audio/video server feedback;
Audio-video terminal is play described target language captions.
2. the caption presentation method of audio-video terminal according to claim 1, it is characterized in that, described when audio/video server when caption database searches the target language captions, audio-video terminal receives in the target language captions step of described audio/video server feedback, also comprises:
When audio/video server searches existing languages captions corresponding to audio/video program information but its languages when being different from the target language captions in caption database, audio-video terminal shows that according to the Search Results of audio/video server feedback the languages tabulation of existing languages captions is for user selection;
Audio-video terminal receives the languages selection instruction of the existing languages captions of user's input;
Audio-video terminal obtain from audio/video server user selection existing languages captions subtitle file and play described subtitle file.
3. the caption presentation method of audio-video terminal according to claim 1, it is characterized in that, described when audio/video server when caption database searches the target language captions, audio-video terminal receives after the target language captions step of described audio/video server feedback, and described method also comprises:
When audio/video server does not search captions corresponding to audio/video program information in caption database, analyze in the audio/video flow whether comprise captions;
When comprising captions in the audio/video flow, play described audio frequency and video and therefrom extract captions;
The captions that extract are sent to audio/video server.
4. the caption presentation method of audio-video terminal according to claim 3 is characterized in that, described captions with extraction send to after the audio/video server step, and described method also comprises step:
The existing languages captions of basis that audio-video terminal reception audio/video server sends or the caption translating of extraction become the subtitle file of target language captions;
The caption translating that audio-video terminal is play the existing languages captions of described basis or extraction becomes the subtitle file of target language captions.
5. the caption presentation method of audio-video terminal according to claim 4, it is characterized in that, after the caption translating that described audio-video terminal is play the existing languages captions of described basis or extraction became the subtitle file step of target language captions, described method also comprised:
Receive the user to the modification editor input of subtitle file;
To be modified edited subtitle file and upload to audio/video server.
6. the caption presentation method of audio-video terminal according to claim 5, it is characterized in that, after the caption translating that described audio-video terminal is play the existing languages captions of described basis or extraction became the subtitle file step of target language captions, described method also comprised:
Receive the user by the subtitle language translation of microphone input;
Described subtitle language translation is uploaded to audio/video server, and described subtitle language translation is identified as the text subtitle translation.
7. an audio-video terminal is characterized in that, described audio-video terminal comprises:
Programme information and languages type acquisition module are used for obtaining the languages type of audio/video program information and target language captions, and the languages type of described audio/video program information and target language captions is sent to audio/video server;
Captions query requests module is used for sending audio frequency and video captions query requests to audio/video server;
Target language captions receiver module, be used for when audio/video server when caption database searches the target language captions, receive the target language captions that described audio/video server feeds back;
Target language captions playing module is used for playing described target language captions.
8. audio-video terminal according to claim 7 is characterized in that, described audio-video terminal also comprises:
Existing languages subtitle list display module, be used for searching existing languages captions corresponding to audio/video program information but its languages when being different from the target language captions when audio/video server in caption database, according to the Search Results of audio/video server feedback, show that the languages tabulation of existing languages captions is for user selection;
Languages selection instruction receiver module is for the languages selection instruction of the existing languages captions that receive user's input.
9. audio-video terminal according to claim 7 is characterized in that, described audio-video terminal also comprises:
The audio/video flow analysis module, be used for when audio/video server when caption database does not search captions corresponding to audio/video program information, whether comprise captions in the analysis audio/video flow;
The captions extraction module is used for when audio/video flow comprises captions, plays described audio frequency and video and therefrom extracts captions;
Extract the captions sending module, the captions that are used for extracting send to audio/video server.
10. audio-video terminal according to claim 7 is characterized in that, described audio-video terminal also comprises:
Subtitle file is revised editor module, is used for receiving the user to the modification editor input of subtitle file;
Revise transmission module on the captions, be used for to be modified edited subtitle file and upload to audio/video server.
11. audio-video terminal according to claim 10, it is characterized in that, described subtitle file is revised editor module and is also comprised the voice edition module, be used for receiving the user by the subtitle language translation of microphone input, and by transmission module on the described modification captions described subtitle language translation uploaded to audio/video server.
12. an audio/video server is characterized in that, described server comprises:
The captions receiving element is used for the original caption information of receiving terminal and translation request;
The caption translating unit, being used for original captions information translation is the multilingual text subtile;
The caption information transmission unit is used for the translation request according to terminal, sends corresponding audio frequency and video captions;
Memory cell is used for storage audio frequency and video captions;
Query unit is used for the request according to audio-video terminal, the searching of performance objective audio frequency and video captions.
13. audio/video server as claimed in claim 12, it is characterized in that, described server comprises revises the captions receiver module, is used for receiving and is revised editor's subtitle file by the user, and described subtitle file comprises that the user carries out the audio file of subtitle language translation;
The speech modification recognition unit is used for the audio file of described subtitle language translation is identified as the text subtitle translation;
The captions confirmation unit is used for confirming that it is formal caption translating text that the user submits the caption translating of revision to.
14. audio/video server as claimed in claim 13 is characterized in that, described query unit also comprises:
A plurality of languages table data generation units are used for inquiring about and generate a plurality of existing languages caption information of alternative target language captions when audio/video server does not find corresponding target language captions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013100330454A CN103067775A (en) | 2013-01-28 | 2013-01-28 | Subtitle display method for audio/video terminal, audio/video terminal and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013100330454A CN103067775A (en) | 2013-01-28 | 2013-01-28 | Subtitle display method for audio/video terminal, audio/video terminal and server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103067775A true CN103067775A (en) | 2013-04-24 |
Family
ID=48110208
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2013100330454A Pending CN103067775A (en) | 2013-01-28 | 2013-01-28 | Subtitle display method for audio/video terminal, audio/video terminal and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103067775A (en) |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103442194A (en) * | 2013-08-23 | 2013-12-11 | 四川长虹电器股份有限公司 | 3D glass device system capable of enabling user to select subtitles and achieving method thereof |
| CN103561217A (en) * | 2013-10-14 | 2014-02-05 | 深圳创维数字技术股份有限公司 | Method and terminal for generating captions |
| CN103905693A (en) * | 2014-04-10 | 2014-07-02 | 中央电视台 | Program production method and device |
| CN104104986A (en) * | 2014-07-29 | 2014-10-15 | 小米科技有限责任公司 | Audio frequency and subtitle synchronizing method and device |
| CN104219459A (en) * | 2014-09-30 | 2014-12-17 | 上海摩软通讯技术有限公司 | Video language translation method and system and intelligent display device |
| CN104244107A (en) * | 2014-08-26 | 2014-12-24 | 中译语通科技（北京）有限公司 | Video caption restoring method based on caption detection and recognition |
| CN104244081A (en) * | 2014-09-26 | 2014-12-24 | 可牛网络技术（北京）有限公司 | Video provision method and device |
| CN104301771A (en) * | 2013-07-15 | 2015-01-21 | 中兴通讯股份有限公司 | Method and device for adjusting playing progress of video file |
| CN104410924A (en) * | 2014-11-25 | 2015-03-11 | 广东欧珀移动通信有限公司 | Method and device for displaying multimedia subtitles |
| CN105187746A (en) * | 2015-09-01 | 2015-12-23 | Tcl海外电子（惠州）有限公司 | Television set and language storage method of television set |
| CN105704538A (en) * | 2016-03-17 | 2016-06-22 | 广东小天才科技有限公司 | Method and system for generating audio and video subtitles |
| CN105791971A (en) * | 2014-12-26 | 2016-07-20 | 深圳Tcl数字技术有限公司 | Method and device for switching stream media audios |
| CN105848005A (en) * | 2016-03-28 | 2016-08-10 | 乐视控股（北京）有限公司 | Video subtitle display method and video subtitle display device |
| CN105848004A (en) * | 2016-05-16 | 2016-08-10 | 乐视控股（北京）有限公司 | Caption playing method and caption playing device |
| CN105898619A (en) * | 2015-12-08 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Video caption recommending method, system, terminal and server |
| CN105979402A (en) * | 2016-04-13 | 2016-09-28 | 乐视控股（北京）有限公司 | Multi-subtitle playing method and system |
| CN106303303A (en) * | 2016-08-17 | 2017-01-04 | 北京金山安全软件有限公司 | Method and device for translating subtitles of media file and electronic equipment |
| CN107154173A (en) * | 2017-04-06 | 2017-09-12 | 苏州爱灵格教育科技有限公司 | A kind of interactive learning methods and system |
| CN107277613A (en) * | 2017-05-31 | 2017-10-20 | 深圳Tcl新技术有限公司 | Caption presentation method, terminal and computer-readable recording medium |
| CN107484002A (en) * | 2017-08-25 | 2017-12-15 | 四川长虹电器股份有限公司 | The method of intelligent translation captions |
| CN107682739A (en) * | 2017-09-20 | 2018-02-09 | 成都视达科信息技术有限公司 | The generation method and system of a kind of languages captions of video |
| CN108156480A (en) * | 2017-12-27 | 2018-06-12 | 腾讯科技（深圳）有限公司 | A kind of method, relevant apparatus and the system of video caption generation |
| RU2668721C1 (en) * | 2017-04-17 | 2018-10-02 | Общество с ограниченной ответственностью "Образовательные технологии" | Method for displaying subtitles in the process of playing media content (options) |
| CN109005444A (en) * | 2017-06-07 | 2018-12-14 | 纳宝株式会社 | Content providing server, content providing terminal and content providing |
| CN109309777A (en) * | 2018-08-15 | 2019-02-05 | 罗勇 | It repeats scene image and is grouped platform |
| CN109889741A (en) * | 2019-02-28 | 2019-06-14 | 努比亚技术有限公司 | Caption presentation method, storage medium and mobile terminal |
| CN109920428A (en) * | 2017-12-12 | 2019-06-21 | 杭州海康威视数字技术股份有限公司 | A kind of notes input method, device, electronic equipment and storage medium |
| CN109963092A (en) * | 2017-12-26 | 2019-07-02 | 深圳市优必选科技有限公司 | A kind of processing method of subtitle, device and terminal |
| CN110213665A (en) * | 2019-04-26 | 2019-09-06 | 深圳市亿联智能有限公司 | The method and multimedia system for supporting multilingual network subtitle to show on the set-top box |
| CN111356025A (en) * | 2018-12-24 | 2020-06-30 | 深圳Tcl新技术有限公司 | Multi-subtitle display method, intelligent terminal and storage medium |
| CN111757187A (en) * | 2020-07-07 | 2020-10-09 | 深圳市九洲电器有限公司 | Multi-language subtitle display method, device, terminal equipment and storage medium |
| CN112672213A (en) * | 2020-12-18 | 2021-04-16 | 努比亚技术有限公司 | Video information processing method and device and computer readable storage medium |
| CN112765460A (en) * | 2021-01-08 | 2021-05-07 | 北京字跳网络技术有限公司 | Conference information query method, device, storage medium, terminal device and server |
| CN112887806A (en) * | 2021-01-25 | 2021-06-01 | 当趣网络科技(杭州)有限公司 | Subtitle processing method, subtitle processing device, electronic equipment and subtitle processing medium |
| CN113286176A (en) * | 2021-05-19 | 2021-08-20 | 中山亿联智能科技有限公司 | STB IPTV AI intelligent translation system |
| CN115484478A (en) * | 2021-05-31 | 2022-12-16 | 上海哔哩哔哩科技有限公司 | Subtitle processing method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101505397A (en) * | 2009-02-20 | 2009-08-12 | 深圳华为通信技术有限公司 | Method and system for audio and video subtitle synchronous presenting |
| JP2010170191A (en) * | 2009-01-20 | 2010-08-05 | Yahoo Japan Corp | Search method based on meta-information of tv program, search system, and search term generator |
| CN201585058U (en) * | 2009-12-21 | 2010-09-15 | 深圳市同洲电子股份有限公司 | Digital television receiving terminal, front server and subtitle system |
| CN102291542A (en) * | 2011-08-26 | 2011-12-21 | 深圳Tcl新技术有限公司 | Multilingual subtitle setting method and device thereof |
| CN102625180A (en) * | 2011-01-26 | 2012-08-01 | 鸿富锦精密工业（深圳）有限公司 | Television apparatus and method for searching subtitles of television program |
-
2013
- 2013-01-28 CN CN2013100330454A patent/CN103067775A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010170191A (en) * | 2009-01-20 | 2010-08-05 | Yahoo Japan Corp | Search method based on meta-information of tv program, search system, and search term generator |
| CN101505397A (en) * | 2009-02-20 | 2009-08-12 | 深圳华为通信技术有限公司 | Method and system for audio and video subtitle synchronous presenting |
| CN201585058U (en) * | 2009-12-21 | 2010-09-15 | 深圳市同洲电子股份有限公司 | Digital television receiving terminal, front server and subtitle system |
| CN102625180A (en) * | 2011-01-26 | 2012-08-01 | 鸿富锦精密工业（深圳）有限公司 | Television apparatus and method for searching subtitles of television program |
| CN102291542A (en) * | 2011-08-26 | 2011-12-21 | 深圳Tcl新技术有限公司 | Multilingual subtitle setting method and device thereof |
Cited By (42)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104301771A (en) * | 2013-07-15 | 2015-01-21 | 中兴通讯股份有限公司 | Method and device for adjusting playing progress of video file |
| CN103442194A (en) * | 2013-08-23 | 2013-12-11 | 四川长虹电器股份有限公司 | 3D glass device system capable of enabling user to select subtitles and achieving method thereof |
| CN103561217A (en) * | 2013-10-14 | 2014-02-05 | 深圳创维数字技术股份有限公司 | Method and terminal for generating captions |
| CN103905693A (en) * | 2014-04-10 | 2014-07-02 | 中央电视台 | Program production method and device |
| CN104104986A (en) * | 2014-07-29 | 2014-10-15 | 小米科技有限责任公司 | Audio frequency and subtitle synchronizing method and device |
| CN104104986B (en) * | 2014-07-29 | 2017-08-22 | 小米科技有限责任公司 | The synchronous method and device of audio and captions |
| CN104244107B (en) * | 2014-08-26 | 2017-08-08 | 中译语通科技（北京）有限公司 | A kind of video caption restoring method based on local-caption extraction with identification |
| CN104244107A (en) * | 2014-08-26 | 2014-12-24 | 中译语通科技（北京）有限公司 | Video caption restoring method based on caption detection and recognition |
| CN104244081B (en) * | 2014-09-26 | 2018-10-16 | 可牛网络技术（北京）有限公司 | The providing method and device of video |
| CN104244081A (en) * | 2014-09-26 | 2014-12-24 | 可牛网络技术（北京）有限公司 | Video provision method and device |
| CN104219459A (en) * | 2014-09-30 | 2014-12-17 | 上海摩软通讯技术有限公司 | Video language translation method and system and intelligent display device |
| CN104410924B (en) * | 2014-11-25 | 2018-03-23 | 广东欧珀移动通信有限公司 | A kind of multimedia titles display methods and device |
| CN104410924A (en) * | 2014-11-25 | 2015-03-11 | 广东欧珀移动通信有限公司 | Method and device for displaying multimedia subtitles |
| CN105791971A (en) * | 2014-12-26 | 2016-07-20 | 深圳Tcl数字技术有限公司 | Method and device for switching stream media audios |
| CN105187746A (en) * | 2015-09-01 | 2015-12-23 | Tcl海外电子（惠州）有限公司 | Television set and language storage method of television set |
| CN105898619A (en) * | 2015-12-08 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Video caption recommending method, system, terminal and server |
| CN105704538A (en) * | 2016-03-17 | 2016-06-22 | 广东小天才科技有限公司 | Method and system for generating audio and video subtitles |
| CN105848005A (en) * | 2016-03-28 | 2016-08-10 | 乐视控股（北京）有限公司 | Video subtitle display method and video subtitle display device |
| CN105979402A (en) * | 2016-04-13 | 2016-09-28 | 乐视控股（北京）有限公司 | Multi-subtitle playing method and system |
| CN105848004A (en) * | 2016-05-16 | 2016-08-10 | 乐视控股（北京）有限公司 | Caption playing method and caption playing device |
| CN106303303A (en) * | 2016-08-17 | 2017-01-04 | 北京金山安全软件有限公司 | Method and device for translating subtitles of media file and electronic equipment |
| CN107154173A (en) * | 2017-04-06 | 2017-09-12 | 苏州爱灵格教育科技有限公司 | A kind of interactive learning methods and system |
| RU2668721C1 (en) * | 2017-04-17 | 2018-10-02 | Общество с ограниченной ответственностью "Образовательные технологии" | Method for displaying subtitles in the process of playing media content (options) |
| CN107277613A (en) * | 2017-05-31 | 2017-10-20 | 深圳Tcl新技术有限公司 | Caption presentation method, terminal and computer-readable recording medium |
| CN109005444A (en) * | 2017-06-07 | 2018-12-14 | 纳宝株式会社 | Content providing server, content providing terminal and content providing |
| CN107484002A (en) * | 2017-08-25 | 2017-12-15 | 四川长虹电器股份有限公司 | The method of intelligent translation captions |
| CN107682739A (en) * | 2017-09-20 | 2018-02-09 | 成都视达科信息技术有限公司 | The generation method and system of a kind of languages captions of video |
| CN109920428A (en) * | 2017-12-12 | 2019-06-21 | 杭州海康威视数字技术股份有限公司 | A kind of notes input method, device, electronic equipment and storage medium |
| CN109963092A (en) * | 2017-12-26 | 2019-07-02 | 深圳市优必选科技有限公司 | A kind of processing method of subtitle, device and terminal |
| CN108156480A (en) * | 2017-12-27 | 2018-06-12 | 腾讯科技（深圳）有限公司 | A kind of method, relevant apparatus and the system of video caption generation |
| CN109309777A (en) * | 2018-08-15 | 2019-02-05 | 罗勇 | It repeats scene image and is grouped platform |
| CN109309777B (en) * | 2018-08-15 | 2019-05-10 | 上海极链网络科技有限公司 | It repeats scene image and is grouped platform |
| CN111356025A (en) * | 2018-12-24 | 2020-06-30 | 深圳Tcl新技术有限公司 | Multi-subtitle display method, intelligent terminal and storage medium |
| WO2020135192A1 (en) * | 2018-12-24 | 2020-07-02 | 深圳Tcl新技术有限公司 | Multi-subtitle display method, intelligent terminal and storage medium |
| CN109889741A (en) * | 2019-02-28 | 2019-06-14 | 努比亚技术有限公司 | Caption presentation method, storage medium and mobile terminal |
| CN110213665A (en) * | 2019-04-26 | 2019-09-06 | 深圳市亿联智能有限公司 | The method and multimedia system for supporting multilingual network subtitle to show on the set-top box |
| CN111757187A (en) * | 2020-07-07 | 2020-10-09 | 深圳市九洲电器有限公司 | Multi-language subtitle display method, device, terminal equipment and storage medium |
| CN112672213A (en) * | 2020-12-18 | 2021-04-16 | 努比亚技术有限公司 | Video information processing method and device and computer readable storage medium |
| CN112765460A (en) * | 2021-01-08 | 2021-05-07 | 北京字跳网络技术有限公司 | Conference information query method, device, storage medium, terminal device and server |
| CN112887806A (en) * | 2021-01-25 | 2021-06-01 | 当趣网络科技(杭州)有限公司 | Subtitle processing method, subtitle processing device, electronic equipment and subtitle processing medium |
| CN113286176A (en) * | 2021-05-19 | 2021-08-20 | 中山亿联智能科技有限公司 | STB IPTV AI intelligent translation system |
| CN115484478A (en) * | 2021-05-31 | 2022-12-16 | 上海哔哩哔哩科技有限公司 | Subtitle processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103067775A (en) | Subtitle display method for audio/video terminal, audio/video terminal and server | |
| US8620139B2 (en) | Utilizing subtitles in multiple languages to facilitate second-language learning | |
| CN109275046B (en) | Teaching data labeling method based on double video acquisition | |
| CN100485686C (en) | Video viewing support system and method | |
| KR101644789B1 (en) | Apparatus and Method for providing information related to broadcasting program | |
| US11301644B2 (en) | Generating and editing media | |
| CN106791913A (en) | Digital television program simultaneous interpretation output intent and system | |
| US9576581B2 (en) | Metatagging of captions | |
| CN102378050A (en) | Broadcast system using text to speech conversion | |
| KR20040039432A (en) | Multi-lingual transcription system | |
| US10176254B2 (en) | Systems, methods, and media for identifying content | |
| US20110138418A1 (en) | Apparatus and method for generating program summary information regarding broadcasting content, method of providing program summary information regarding broadcasting content, and broadcasting receiver | |
| KR101293301B1 (en) | System and method for serching images using caption of moving picture in keyword | |
| KR101478918B1 (en) | Apparatus and method for correcting caption subtitle | |
| CN101465068A (en) | Method for the determination of supplementary content in an electronic device | |
| CN103984772A (en) | Method and device for generating text retrieval subtitle library and video retrieval method and device | |
| JP2010021632A (en) | Content information reproducing apparatus, content information reproducing system, content information reproducing method, content information reproducing program, recording medium therefor and information processing apparatus | |
| US9008492B2 (en) | Image processing apparatus method and computer program product | |
| CN103747277A (en) | Multimedia program identification method and device | |
| US20170139904A1 (en) | Systems and methods for cloud captioning digital content | |
| CN105681890A (en) | Caption display method and device for video playing terminal | |
| CN109905756B (en) | Television caption dynamic generation method based on artificial intelligence and related equipment | |
| KR20100030379A (en) | Broadcast receiver for displaying description of terminology included in digital captions and method for processing digital captions applying the same | |
| CN111078982A (en) | Electronic page retrieval method, electronic device and storage medium | |
| KR20190105287A (en) | Method and apparatus for recommending captions through machine learning |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130424 |