CN102087668A - Method for automatically obtaining audio and video subtitles and lyrics and fast locating, searching and individually displaying - Google Patents
Method for automatically obtaining audio and video subtitles and lyrics and fast locating, searching and individually displaying Download PDFInfo
- Publication number
- CN102087668A CN102087668A CN2011100396217A CN201110039621A CN102087668A CN 102087668 A CN102087668 A CN 102087668A CN 2011100396217 A CN2011100396217 A CN 2011100396217A CN 201110039621 A CN201110039621 A CN 201110039621A CN 102087668 A CN102087668 A CN 102087668A
- Authority
- CN
- China
- Prior art keywords
- lyrics
- captions
- video
- audio
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Reverberation, Karaoke And Other Acoustics (AREA)
Abstract
The invention provides a method for automatically obtaining audio and video subtitles and lyrics and fast locating, searching and individually displaying, consisting of a connecting controlling module, a characteristic value extracting module, a subtitles and lyrics finding module, a subtitles and lyrics downloading module, a subtitles and lyrics locating and searching module and a subtitles and lyrics displaying module. Via the system, the users can extract the characteristic values of audio and video resources, and then connect the audio and video resources to Internet, find the subtitles or lyrics files corresponding to the resources, download the files to a local memory and analyze the contents of the files, and then synchronously display the analyzed subtitles or lyrics along the playing of the audio and video. The method provided by the invention can fast and exactly find the subtitles or lyrics files of the audio and video resources.
Description
Affiliated technical field
The present invention relates to internet, audio frequency and video broadcast field, relate in particular to a kind of audio frequency and video captions and the lyrics and quick retrieval by window and personalized method that shows obtained automatically.
Background technology
The function that audio frequency and video are play synchronously displaying lyrics or captions makes people can see the captions or the lyrics of this audio-video document in playing audio-video, and this function has become one of indispensable function of audio frequency and video playout software and player.Existing sychronization captions or lyrics Presentation Function technology generally all are in playing audio-video document, the search and the captions or the lyrics file of this audio file name-matches, thus reach the purpose of synchronous demonstration.
Synchronously displaying subtitle or lyrics information, playout software or player need be searched for captions or the lyrics file of the same name with audio-video document title to be shown, if search, and then synchronously displaying subtitle or lyrics information; Otherwise, then do default treatment.Yet having following situation is that prior art is insurmountable, as: it is to have identical name that a lot of audio-video documents are arranged, and different captions or lyrics content are but arranged.For example: " friend " this first song, there is Zhou Huajian to sing, there is Zang Tianshuo to sing, also have that Zhang Zhenyue sings or the like.In this case, with " friend .mp3 " corresponding synchronous lyrics file " " more than one of friend .lrc, and filename all is the same, and playout software will search a plurality of captions of the same name or lyrics file, and prior art can not effectively be differentiated for this file of the same name; The situation of the careless name of audio-video document can't find corresponding captions or lyrics file by prior art, can't show synchronously.
Summary of the invention
At above-mentioned these problems, designed a kind of audio frequency and video captions and the lyrics and quick retrieval by window and personalized method that shows obtained automatically.This method has been used the audio and video characteristic value, no matter how audio-video document is changed, how compression, file name to change, eigenwert can both be unique the sign audio frequency and video, just can obtain the audio frequency and video captions and the lyrics by these characteristics, the unmatched problem of audio frequency and video and captions or the lyrics can not occur with high as far as possible accuracy.
In order to realize above-mentioned invention, technical scheme of the present invention realizes as follows:
A kind of audio frequency and video captions and the lyrics and quick retrieval by window and personalized method that shows obtained automatically, its design feature is, it is by link control module, the eigenwert extraction module, the captions and the lyrics are searched module, captions and lyrics download module, captions and lyrics retrieval by window module, captions and lyrics display module are formed.
Link control module: when the inquiry captions of audio frequency and video or the lyrics, be responsible for being connected to audio frequency and video captions and lyrics server and the audio/video information storehouse of putting on record.
The eigenwert extraction module: extraction will be inquired about the audio and video characteristic value of the captions or the lyrics.
The captions and the lyrics are searched module: use the audio and video characteristic value of extracting as condition, in audio/video information is put the storehouse on record, inquire about,, represent that this audio/video information puts on record if record is arranged, extract the audio frequency and video title of standard so, can find the captions or the lyrics according to this title; If there is not record, represent that this audio/video information do not put on record, so eigenwert is deposited in the audio/video information storehouse of putting on record, and stamp the mark that does not have the captions or the lyrics, edit in order to operating personnel.
Captions and lyrics download module: locking audio frequency and video captions or lyrics file are provided with according to download file are downloaded in the assigned catalogue of local storage.
Captions and lyrics retrieval by window module: when audio frequency and video are play, use this module from captions or lyrics file, to extract the captions or the lyrics according to time point, when the user drags time shaft, the captions corresponding with time point on the time shaft or the lyrics also need to move, this module can adopt exclusive algorithm to retrieve the captions or the lyrics of time point on the corresponding time shaft fast at the captions and the lyrics file of different-format.
Captions and lyrics display module: this module is according to the captions or the lyrics of captions and the locking of lyrics retrieval by window module, show when audio frequency and video are play, the captions or the lyrics can be adjusted attributes such as font size, font name, font color, display position when showing.
The utility model carries out the step of online audio frequency and video downloading and playing:
Referring to Fig. 1, the present invention searches module 3, captions and lyrics download module 4, captions and lyrics retrieval by window module 5, captions and lyrics display module 6 by link control module 1, eigenwert extraction module 2, captions and the lyrics and forms.Realization is accurately obtained the audio frequency and video captions and the lyrics.
Referring to Fig. 2, use the present invention to obtain the flow process of audio frequency and video captions and the lyrics and demonstration:
1. extract eigenwert by eigenwert extraction module 1 in different ways at video and audio frequency.
2. be connected to audio frequency and video captions and lyrics server and the audio/video information storehouse of putting on record by link control module 2.
3. search module 3 by the captions and the lyrics and take the eigenwert as the condition query audio/video information storehouse of putting on record, if do not inquire corresponding record, deposit the characteristic value information of audio frequency and video in the audio frequency and video information bank of putting on record, and stamp the mark that does not have the captions or the lyrics, edit in order to operating personnel; If inquire corresponding record, extract the audio frequency and video title of standard, according to this title locking captions or lyrics file.
4. will search the captions or the lyrics file of module 3 lockings by the captions and the lyrics by captions and lyrics download module 4, be provided with in the assigned catalogue that is saved on the local storage according to downloading.
5. when captions or lyrics demonstration, at first retrieve the captions or the lyrics according to the time point on the time shaft, give captions and 6 demonstrations of lyrics display module then by captions and lyrics retrieval by window module 5; When time shaft is dragged by the user, the corresponding captions or the lyrics also need to move, use exclusive algorithm by captions and lyrics retrieval by window module 5, the captions or the lyrics of time point on the corresponding time shaft are located in retrieval fast, and give captions and 6 demonstrations of lyrics display module.
Description of drawings
Fig. 1 is a structural drawing of the present invention;
Fig. 2 carries out the process flow diagram that audio frequency and video captions or the lyrics obtain and show for the present invention;
Embodiment
Referring to Fig. 1, the present invention searches module 3, captions and lyrics download module 4, captions and lyrics retrieval by window module 5, captions and lyrics display module 6 by link control module 1, eigenwert extraction module 2, captions and the lyrics and forms.Realization is to the accurate extracting of the audio and video resources captions and the lyrics.Improved user's sight.
Referring to Fig. 2, prepare to grasp the captions and the lyrics of audio and video resources and show with the present invention:
By eigenwert extraction module 1 when search be video caption the time, the video features value is to utilize the feature that changes between each consecutive frame, calculate the correlativity between consecutive frame, select difference between adjacent some frames to change maximum or difference and change minimum or meet the certain characteristics of determining rule, the eigenwert that described characteristic block is encoded and formed; When search be the audio frequency lyrics time, the audio frequency characteristics value is to calculate according to the wave form varies of audio sound to get, after the processing the such as no matter waveform of audio sound compresses, format conversion, loud minor adjustment, noise reduction, its wave form varies rule is constant, use distinctive algorithm computation to go out the eigenwert of this audio file according to this characteristic, by above explanation, can determine audio frequency and video of the unique sign of eigenwert, obtain the captions or the lyrics of audio frequency and video by eigenwert, can guarantee high as far as possible accuracy.
2. be connected to network automatically by link control module 2, and land the audio/video information storehouse of putting on record, for the captions of audio and video resources, the inquiry of the lyrics are prepared.
3. to search module 3 be condition with the eigenwert that the audio-frequency information storehouse of putting on record is inquired about for the captions and the lyrics.If do not inquire corresponding record, deposit the characteristic value information of audio frequency and video in the audio frequency and video information bank of putting on record, and stamp the mark that does not have the captions or the lyrics, edit in order to operating personnel; If inquire corresponding record, extract the audio frequency and video title of standard, according to this title locking captions or lyrics file.
4. will search the captions or the lyrics file of module 3 lockings by the captions and the lyrics by captions and lyrics download module 4, be provided with in the assigned catalogue that is saved on the local storage according to downloading.
5. when captions or lyrics demonstration, at first retrieve the captions or the lyrics according to the time point on the time shaft, give captions and 6 demonstrations of lyrics display module then by captions and lyrics retrieval by window module 5; When time shaft is dragged by the user, the corresponding captions or the lyrics also need to move, use exclusive algorithm by captions and lyrics retrieval by window module 5, the captions or the lyrics of time point on the corresponding time shaft are located in retrieval fast, and give captions and 6 demonstrations of lyrics display module.
Claims (2)
1. one kind is obtained audio frequency and video captions and the lyrics and quick retrieval by window and the personalized method that shows automatically, it is characterized in that, said method comprising the steps of:
First step: the eigenwert of extracting audio frequency and video;
Second step: be connected to audio frequency and video captions and lyrics server and the audio/video information storehouse of putting on record;
Third step: take the eigenwert as the condition query audio/video information storehouse of putting on record, locking captions or lyrics file;
The 4th step: captions or lyrics file with locking download in the assigned catalogue on the local storage;
The 5th step:, when audio frequency and video are play, show the captions or the lyrics according to captions or the lyrics file downloaded.
2. one kind is obtained audio frequency and video captions and the lyrics and quick retrieval by window and the personalized method that shows automatically, it is characterized in that described method comprises:
The eigenwert extraction module extracts the eigenwert of audio frequency and video in different ways at video format and audio format;
Link control module be responsible for to connect audio frequency and video captions and lyrics server and the audio/video information storehouse of putting on record;
The captions and the lyrics are searched module, in audio/video information is put the storehouse on record, are condition with the audio and video characteristic value, and inquiry has or not put on record record and locking captions or lyrics file;
Captions or lyrics captions and lyrics download module with the captions or the lyrics file of locking, are provided with in the assigned catalogue that downloads on the local storage according to downloading;
Captions and lyrics retrieval by window module at the captions or the lyrics without form, use exclusive algorithm according to the retrieval of the time point on the time shaft location captions or the lyrics;
Captions and lyrics display module show the captions or the lyrics when audio frequency and video are play, and can set font title, font size, font color, display position.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100396217A CN102087668A (en) | 2011-02-17 | 2011-02-17 | Method for automatically obtaining audio and video subtitles and lyrics and fast locating, searching and individually displaying |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100396217A CN102087668A (en) | 2011-02-17 | 2011-02-17 | Method for automatically obtaining audio and video subtitles and lyrics and fast locating, searching and individually displaying |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102087668A true CN102087668A (en) | 2011-06-08 |
Family
ID=44099477
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011100396217A Pending CN102087668A (en) | 2011-02-17 | 2011-02-17 | Method for automatically obtaining audio and video subtitles and lyrics and fast locating, searching and individually displaying |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102087668A (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102802044A (en) * | 2012-06-29 | 2012-11-28 | 华为终端有限公司 | Video processing method, terminal and subtitle server |
| CN102843431A (en) * | 2012-08-29 | 2012-12-26 | 广东好帮手电子科技股份有限公司 | Vehicle-mounted online music system and control method thereof |
| CN103139635A (en) * | 2011-12-05 | 2013-06-05 | 英顺源（上海）科技有限公司 | System and method used for providing subtitle translation during playing of video |
| CN103179093A (en) * | 2011-12-22 | 2013-06-26 | 腾讯科技（深圳）有限公司 | Matching system and method for video subtitles |
| CN103324685A (en) * | 2013-06-03 | 2013-09-25 | 大连理工大学 | Search method for video fragments of Japanese online video corpora |
| CN103678381A (en) * | 2012-09-17 | 2014-03-26 | 腾讯科技（深圳）有限公司 | Caption processing method, device and system |
| CN103731609A (en) * | 2012-10-11 | 2014-04-16 | 百度在线网络技术（北京）有限公司 | Video playing method and system |
| WO2014059863A1 (en) * | 2012-10-18 | 2014-04-24 | 腾讯科技（深圳）有限公司 | Subtitle querying method, electronic device and storage medium |
| CN103763480A (en) * | 2014-01-24 | 2014-04-30 | 三星电子（中国）研发中心 | Method and equipment for obtaining video dubbing |
| CN104135628A (en) * | 2013-05-03 | 2014-11-05 | 安凯(广州)微电子技术有限公司 | Video editing method and terminal |
| CN104391924A (en) * | 2014-11-21 | 2015-03-04 | 南京讯思雅信息科技有限公司 | Mixed audio and video search method and system |
| CN104410924A (en) * | 2014-11-25 | 2015-03-11 | 广东欧珀移动通信有限公司 | Method and device for displaying multimedia subtitles |
| TWI508541B (en) * | 2012-11-23 | 2015-11-11 | Htc Corp | Method of displaying music lyrics and device using the same |
| CN105068795A (en) * | 2015-07-20 | 2015-11-18 | 上海幻电信息科技有限公司 | Bullet screen effect-based development method and device |
| CN103294683B (en) * | 2012-02-24 | 2016-09-14 | 腾讯科技（深圳）有限公司 | A kind of video file captions automatic patching system and method |
| CN108205546A (en) * | 2016-12-16 | 2018-06-26 | 北京酷我科技有限公司 | The matching system and method for a kind of song information |
| CN108882051A (en) * | 2017-05-15 | 2018-11-23 | 北京嘀嘀无限科技发展有限公司 | A kind of acquisition methods and device of plug-in subtitle |
| CN112040163A (en) * | 2020-08-21 | 2020-12-04 | 上海阅目科技有限公司 | Hard disk video recorder supporting audio analysis |
-
2011
- 2011-02-17 CN CN2011100396217A patent/CN102087668A/en active Pending
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103139635A (en) * | 2011-12-05 | 2013-06-05 | 英顺源（上海）科技有限公司 | System and method used for providing subtitle translation during playing of video |
| CN103179093A (en) * | 2011-12-22 | 2013-06-26 | 腾讯科技（深圳）有限公司 | Matching system and method for video subtitles |
| CN103294683B (en) * | 2012-02-24 | 2016-09-14 | 腾讯科技（深圳）有限公司 | A kind of video file captions automatic patching system and method |
| CN102802044A (en) * | 2012-06-29 | 2012-11-28 | 华为终端有限公司 | Video processing method, terminal and subtitle server |
| CN102843431A (en) * | 2012-08-29 | 2012-12-26 | 广东好帮手电子科技股份有限公司 | Vehicle-mounted online music system and control method thereof |
| CN103678381A (en) * | 2012-09-17 | 2014-03-26 | 腾讯科技（深圳）有限公司 | Caption processing method, device and system |
| CN103731609A (en) * | 2012-10-11 | 2014-04-16 | 百度在线网络技术（北京）有限公司 | Video playing method and system |
| CN103731609B (en) * | 2012-10-11 | 2019-04-26 | 百度在线网络技术（北京）有限公司 | A kind of video broadcasting method and system |
| WO2014059863A1 (en) * | 2012-10-18 | 2014-04-24 | 腾讯科技（深圳）有限公司 | Subtitle querying method, electronic device and storage medium |
| US9456175B2 (en) | 2012-10-18 | 2016-09-27 | Tencent Technology (Shenzhen) Company Limited | Caption searching method, electronic device, and storage medium |
| CN103778131A (en) * | 2012-10-18 | 2014-05-07 | 腾讯科技（深圳）有限公司 | Caption query method and device, video player and caption query server |
| CN103778131B (en) * | 2012-10-18 | 2017-02-22 | 腾讯科技（深圳）有限公司 | Caption query method and device, video player and caption query server |
| TWI508541B (en) * | 2012-11-23 | 2015-11-11 | Htc Corp | Method of displaying music lyrics and device using the same |
| CN104135628A (en) * | 2013-05-03 | 2014-11-05 | 安凯(广州)微电子技术有限公司 | Video editing method and terminal |
| CN103324685B (en) * | 2013-06-03 | 2016-08-10 | 大连理工大学 | The approach for video retrieval by video clip of Japanese Online Video language material |
| CN103324685A (en) * | 2013-06-03 | 2013-09-25 | 大连理工大学 | Search method for video fragments of Japanese online video corpora |
| CN103763480A (en) * | 2014-01-24 | 2014-04-30 | 三星电子（中国）研发中心 | Method and equipment for obtaining video dubbing |
| CN103763480B (en) * | 2014-01-24 | 2017-08-25 | 三星电子（中国）研发中心 | Obtain the method and apparatus that video is dubbed |
| CN104391924A (en) * | 2014-11-21 | 2015-03-04 | 南京讯思雅信息科技有限公司 | Mixed audio and video search method and system |
| CN104410924A (en) * | 2014-11-25 | 2015-03-11 | 广东欧珀移动通信有限公司 | Method and device for displaying multimedia subtitles |
| CN104410924B (en) * | 2014-11-25 | 2018-03-23 | 广东欧珀移动通信有限公司 | A kind of multimedia titles display methods and device |
| CN105068795A (en) * | 2015-07-20 | 2015-11-18 | 上海幻电信息科技有限公司 | Bullet screen effect-based development method and device |
| CN108205546A (en) * | 2016-12-16 | 2018-06-26 | 北京酷我科技有限公司 | The matching system and method for a kind of song information |
| CN108205546B (en) * | 2016-12-16 | 2021-01-12 | 北京酷我科技有限公司 | Song information matching system and method |
| CN108882051A (en) * | 2017-05-15 | 2018-11-23 | 北京嘀嘀无限科技发展有限公司 | A kind of acquisition methods and device of plug-in subtitle |
| CN108882051B (en) * | 2017-05-15 | 2021-07-23 | 北京嘀嘀无限科技发展有限公司 | Method and device for acquiring plug-in subtitle |
| CN112040163A (en) * | 2020-08-21 | 2020-12-04 | 上海阅目科技有限公司 | Hard disk video recorder supporting audio analysis |
| CN112040163B (en) * | 2020-08-21 | 2023-07-07 | 上海阅目科技有限公司 | Hard disk video recorder supporting audio analysis |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102087668A (en) | Method for automatically obtaining audio and video subtitles and lyrics and fast locating, searching and individually displaying | |
| CN105120304B (en) | Information display method, apparatus and system | |
| US10333876B2 (en) | Method and system for communicating between a sender and a recipient via a personalized message including an audio clip extracted from a pre-existing recording | |
| CN103179093B (en) | The matching system and method for video caption | |
| CN102640149B (en) | Melody commending system, signal conditioning package and information processing method | |
| KR101582436B1 (en) | Methods and systems for syschronizing media | |
| US20130294746A1 (en) | System and method of generating multimedia content | |
| US7733214B2 (en) | System and methods for the remote measurement of a person's biometric data in a controlled state by way of synchronized music, video and lyrics | |
| US10560410B2 (en) | Method and system for communicating between a sender and a recipient via a personalized message including an audio clip extracted from a pre-existing recording | |
| CN105074697B (en) | For inferring the accumulation of the real-time crowdsourcing data of the metadata about entity | |
| US20100262909A1 (en) | Method of Displaying Music Information in Multimedia Playback and Related Electronic Device | |
| US10560657B2 (en) | Systems and methods for intelligently synchronizing events in visual content with musical features in audio content | |
| US10178365B1 (en) | System and method for combining audio tracks with video files | |
| CN102214193A (en) | Information processing device, client device and server device | |
| CN103714108A (en) | Information processing system, information processing device, and information processing method | |
| KR101492249B1 (en) | System for providing customized advertisement and contents | |
| US20200137011A1 (en) | Method and system for communicating between a sender and a recipient via a personalized message including an audio clip extracted from a pre-existing recording | |
| CN110047515A (en) | A kind of audio identification methods, device, equipment and storage medium | |
| CN100501738C (en) | Searching method, system and apparatus for playing media file | |
| WO2011146510A2 (en) | Metadata modifier and manager | |
| CN103207917A (en) | Method for marking multimedia content and method and system for generating recommended content | |
| TWI407322B (en) | Multimedia identification system and method, and the application | |
| CN109359203B (en) | Method and device for processing motion trail video | |
| US20130247085A1 (en) | Method for generating video markup data on the basis of video fingerprint information, and method and system for providing information using same | |
| CN106775567B (en) | Sound effect matching method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20110608 |