CN113569700A - Method and system for generating dubbing materials through foreign language videos - Google Patents
Method and system for generating dubbing materials through foreign language videos Download PDFInfo
- Publication number
- CN113569700A CN113569700A CN202110833978.6A CN202110833978A CN113569700A CN 113569700 A CN113569700 A CN 113569700A CN 202110833978 A CN202110833978 A CN 202110833978A CN 113569700 A CN113569700 A CN 113569700A
- Authority
- CN
- China
- Prior art keywords
- video
- foreign language
- generating
- user
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Abstract
The invention discloses a method for generating dubbing materials through foreign language videos, which comprises the following steps: (1) a user uploads an original video to a website server; (2) a user carries out online clipping on an original video on a website server and reserves a required video segment; (3) the website server separates the voice and the background from the video clip and automatically identifies the caption to the voice; (4) the user edits the identified subtitles on line; (5) the user saves the obtained dubbing material on the web server.
Description
Technical Field
The present invention relates to computer video processing, and more particularly to a method and system for generating dubbing materials from foreign language video.
Background
As an innovative foreign language learning method, foreign language teaching software and web sites provide learners with a special video clip, which is generally taken from a classical foreign language original movie or tv series, and the like, and the video clip has been previously separated from voices and backgrounds and can also provide Chinese and foreign language subtitles. The learner of the foreign language can personally dub the video clip and learn dubbed contents in this way. Compared with the passive and listening-based traditional foreign language learning mode, the active and immersive foreign language learning mode can effectively improve the participation sense of the learner and enable the learner to more effectively master foreign language materials contained in the dubbing content.
However, preparing such dubbing materials for teaching requires a professional skilled in foreign language and video processing techniques to consume a lot of time for editing video materials, separating original voices, generating foreign language subtitles, and the like, and is expensive, time-consuming, and difficult to generate in large quantities.
Accordingly, those skilled in the art have endeavored to develop a technique for obtaining a large amount of such dubbing materials at a relatively low cost and relatively quickly.
Disclosure of Invention
In view of the above-mentioned drawbacks of the prior art, the present invention provides a technique for obtaining a large amount of foreign language dubbing materials quickly at a low cost.
In order to achieve the above object, the present invention firstly provides a method for generating dubbing materials through foreign language video, comprising the steps of: (1) a user uploads an original video to a website server; (2) a user carries out online clipping on an original video on a website server and reserves a required video segment; (3) the website server separates the voice and the background from the video clip and automatically identifies the caption to the voice; (4) the user edits the identified subtitles on line; (5) the user saves the obtained dubbing material on the web server.
Further, the website server invokes the ffmpeg tool to clip the original video.
Further, the method also comprises the step of removing the video watermark.
Further, the website server calls the ffmpeg tool to remove the video watermark.
Further, the website server calls a speeter tool to separate the voice and the background from the video clip, and automatically identifies the subtitles for the voice.
The invention provides a system for generating dubbing materials through foreign language videos, which comprises a website server and a client, wherein the client is used for a user to upload an original video to the website server; the website server comprises a video clipping module, a subtitle generating module and a subtitle editing module, wherein the video clipping module is used for a user to clip an original video on line so as to obtain a required video segment; the caption generating module is used for separating the voice and the background from the video clip and automatically identifying the caption to the voice; and the subtitle editing module is used for the user to edit the identified subtitles on line.
Further, the video clipping module invokes the ffmpeg tool to clip the original video.
Further, the system also comprises a watermark removing module used for removing the video watermark.
Further, the watermark removing module calls an ffmpeg tool to remove the video watermark.
Further, the subtitle generating module calls a spelter tool to separate the voice and the background from the video clip, and automatically identifies the subtitle for the voice.
The invention adopts the open-source ffmpeg and speeter tools, can automatically separate the voice and identify the caption, can enable the user to edit the video and the caption on line, does not need professional foreign language teachers and video processing professionals, has low cost, and can obtain a large amount of available video materials in a short time.
Namely, the most important point of the present application lies in the idea of constructing the scheme: the user can make the dubbing materials by himself, and the interestingness is increased for the user, so that the foreign language learning becomes a recreational thing, and the user is more active, and meanwhile, the user can learn the foreign language silently in the material making process and teach through lively activities; and for developers, materials do not need to be made by themselves, so that labor cost and time cost are greatly saved, the materials are more diversified, different requirements of different users can be met, and multiple purposes can be achieved.
The conception, the specific structure and the technical effects of the present invention will be further described with reference to the accompanying drawings to fully understand the objects, the features and the effects of the present invention.
Drawings
FIG. 1 is a flow chart of a preferred embodiment of the present invention;
FIG. 2 is a schematic view of an operation interface for a user to upload videos in a preferred embodiment of the present invention;
FIG. 3 is a schematic diagram of an operation interface for a user to clip a video online via a web server according to a preferred embodiment of the present invention;
FIG. 4 is a schematic diagram of an operation interface of the user removing the video watermark through the website server in a preferred embodiment of the invention
Fig. 5-6 are schematic diagrams illustrating the operation of the website service for automatically recognizing the subtitles and performing online editing on the subtitles according to a preferred embodiment of the invention.
Detailed Description
The technical contents of the preferred embodiments of the present invention will be more clearly and easily understood by referring to the drawings attached to the specification. The present invention may be embodied in many different forms of embodiments and the scope of the invention is not limited to the embodiments set forth herein.
As shown in the flowchart of fig. 1, first, the present invention adopts UGC (User Generated Content), that is, a manner of User-created Content, to upload a material by a User. The website provides a video uploading function for the user to upload the original video to the website server by himself, as shown in fig. 2.
The user can use the ffmpeg tool to clip the uploaded material online through the website server to obtain the required video clip, as shown in fig. 3. And further, the video watermark of the fixed position can be removed according to the corresponding time interval by using the ffmpeg tool, as shown in fig. 4.
And separating out the voice and the background by adopting a Spleeter tool, automatically identifying the subtitles by the voice, and editing the identified subtitles on line by a user, as shown in figures 5-6. And after the verification of the website, the applicable complete dubbing material is finally obtained.
According to the invention, through a UGC mode, a user uploads a video by himself, a large amount of video materials can be obtained for a website, and customized video materials can be obtained for the user.
The invention adopts the open-source ffmpeg and speeter tools, can automatically separate the voice and identify the caption, can enable the user to edit the video and the caption on line, does not need professional foreign language teachers and video processing professionals, has low cost, and can obtain a large amount of available video materials in a short time.
The foregoing detailed description of the preferred embodiments of the invention has been presented. It should be understood that numerous modifications and variations could be devised by those skilled in the art in light of the present teachings without departing from the inventive concepts. Therefore, the technical solutions available to those skilled in the art through logic analysis, reasoning and limited experiments based on the prior art according to the concept of the present invention should be within the scope of protection defined by the claims.
Claims (10)
1. A method for generating dubbing materials through foreign language video, comprising the steps of:
(1) a user uploads an original video to a website server;
(2) a user carries out online clipping on an original video on a website server and reserves a required video segment;
(3) the website server separates the voice and the background from the video clip and automatically identifies the caption to the voice;
(4) the user edits the identified subtitles on line;
(5) the user saves the obtained dubbing material on the web server.
2. The method of generating dubbing materials through foreign language video as claimed in claim 1, wherein the web server calls ffmpeg tool to clip the original video.
3. The method of generating dubbing material in foreign language video according to claim 2, further comprising the step of removing the video watermark.
4. The method of generating dubbing materials through foreign language video as claimed in claim 3, wherein the web server calls ffmpeg tool to remove the video watermark.
5. The method of generating dubbing materials through foreign language video as claimed in claim 4, wherein the web server calls a speeter tool to separate the voice and background from the video clip and automatically recognizes the subtitle to the voice.
6. A system for generating dubbing materials through foreign language videos is characterized by comprising a website server and a client, wherein the client is used for a user to upload original videos to the website server; the website server comprises a video clipping module, a subtitle generating module and a subtitle editing module, wherein the video clipping module is used for a user to clip an original video on line so as to obtain a required video segment; the caption generating module is used for separating the voice and the background from the video clip and automatically identifying the caption to the voice; and the subtitle editing module is used for the user to edit the identified subtitles on line.
7. The system for generating dubbing materials through foreign language video of claim 6, wherein the video clipping module calls ffmpeg tool to clip the original video.
8. The system for generating dubbing material in foreign language video according to claim 7, further comprising a watermark removal module for removing the video watermark.
9. The system for generating dubbing material through foreign language video of claim 8, wherein the watermark removal module calls ffmpeg tool to remove the video watermark.
10. The system for generating dubbing materials through foreign language video according to claim 9, wherein the subtitle generating module calls a speeter tool to separate the voice and the background from the video clip and automatically recognizes the subtitle for the voice.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110833978.6A CN113569700A (en) | 2021-07-23 | 2021-07-23 | Method and system for generating dubbing materials through foreign language videos |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110833978.6A CN113569700A (en) | 2021-07-23 | 2021-07-23 | Method and system for generating dubbing materials through foreign language videos |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113569700A true CN113569700A (en) | 2021-10-29 |
Family
ID=78166531
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110833978.6A Pending CN113569700A (en) | 2021-07-23 | 2021-07-23 | Method and system for generating dubbing materials through foreign language videos |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113569700A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107071512A (en) * | 2017-01-16 | 2017-08-18 | 腾讯科技（深圳）有限公司 | A kind of dubbing method, apparatus and system |
| CN107682739A (en) * | 2017-09-20 | 2018-02-09 | 成都视达科信息技术有限公司 | The generation method and system of a kind of languages captions of video |
| WO2019164535A1 (en) * | 2018-02-26 | 2019-08-29 | Google Llc | Automated voice translation dubbing for prerecorded videos |
| CN112702659A (en) * | 2020-12-24 | 2021-04-23 | 成都新希望金融信息有限公司 | Video subtitle processing method and device, electronic equipment and readable storage medium |
-
2021
- 2021-07-23 CN CN202110833978.6A patent/CN113569700A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107071512A (en) * | 2017-01-16 | 2017-08-18 | 腾讯科技（深圳）有限公司 | A kind of dubbing method, apparatus and system |
| CN107682739A (en) * | 2017-09-20 | 2018-02-09 | 成都视达科信息技术有限公司 | The generation method and system of a kind of languages captions of video |
| WO2019164535A1 (en) * | 2018-02-26 | 2019-08-29 | Google Llc | Automated voice translation dubbing for prerecorded videos |
| CN112702659A (en) * | 2020-12-24 | 2021-04-23 | 成都新希望金融信息有限公司 | Video subtitle processing method and device, electronic equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111582241B (en) | Video subtitle recognition method, device, equipment and storage medium | |
| CN110166818B (en) | Method for generating audio/video to be matched, computer equipment and storage medium | |
| WO2018227761A1 (en) | Correction device for recorded and broadcasted data for teaching | |
| CN113014732B (en) | Conference record processing method and device, computer equipment and storage medium | |
| CN113691836B (en) | Video template generation method, video generation method and device and electronic equipment | |
| CN106331893A (en) | Real-time subtitle display method and system | |
| CN110505498A (en) | Processing, playback method, device and the computer-readable medium of video | |
| CN110832583A (en) | System and method for generating a summary storyboard from a plurality of image frames | |
| CN104598644A (en) | User fond label mining method and device | |
| CN110750996B (en) | Method and device for generating multimedia information and readable storage medium | |
| CN112511818B (en) | Video playing quality detection method and device | |
| CN104484420A (en) | Method and device for making intelligent teaching system courseware | |
| CN113392273A (en) | Video playing method and device, computer equipment and storage medium | |
| CN112289347A (en) | Stylized intelligent video editing method based on machine learning | |
| CN112800263A (en) | Video synthesis system, method and medium based on artificial intelligence | |
| CN111353439A (en) | Method, device, system and equipment for analyzing teaching behaviors | |
| Matamala | The ALST project: technologies for audio description | |
| Dawson | Interlingual live subtitling: a research-informed training model for interlingual respeakers to improve access for a wide audience | |
| KR20190108467A (en) | System for Instructional visual content using Automatically convert images from electronic documents | |
| CN113705300A (en) | Method, device and equipment for acquiring phonetic-to-text training corpus and storage medium | |
| CN113569700A (en) | Method and system for generating dubbing materials through foreign language videos | |
| Matamala | The ALST project: Technologies for audiovisual translation | |
| Ohnishi et al. | Prototype design of playback and search system for lecture video content using google cloud api | |
| CN114064968A (en) | News subtitle abstract generating method and system | |
| CN112652329B (en) | Text realignment method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211029 |
|
| RJ01 | Rejection of invention patent application after publication |