CN107222772A - A kind of method and device for realizing captions processing - Google Patents

A kind of method and device for realizing captions processing Download PDF

Info

Publication number
CN107222772A
CN107222772A CN201610162189.3A CN201610162189A CN107222772A CN 107222772 A CN107222772 A CN 107222772A CN 201610162189 A CN201610162189 A CN 201610162189A CN 107222772 A CN107222772 A CN 107222772A
Authority
CN
China
Prior art keywords
data
superposition
processing
subtitle
subtitle superposition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610162189.3A
Other languages
Chinese (zh)
Inventor
孙博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201610162189.3A priority Critical patent/CN107222772A/en
Priority to PCT/CN2017/075418 priority patent/WO2017162010A1/en
Publication of CN107222772A publication Critical patent/CN107222772A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • H04N21/4858End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/152Multipoint control units therefor

Abstract

A kind of method and device for realizing captions processing, including:Judge whether caption data changes;When caption data changes, subtitle superposition processing is carried out to caption data, subtitle superposition data are obtained;When caption data does not change, captions processing is carried out according to the judgement whether superposition of data belongs to key frame.Present invention method, when not changed by caption data, captions processing is carried out according to the judgement whether superposition of data belongs to key frame, the performance consumption of subtitle superposition processing, improves the terminal way of video conference processing when reducing video conference processing.

Description

A kind of method and device for realizing captions processing
Technical field
Present document relates to but be not limited to video conference field, it is espespecially a kind of realize captions processing method and device.
Background technology
Video conference is that real-time, the interactive multimedia held in local and distal end with TV mode is led to Letter mode, is to pass through transmission channel in two places or two or more place using Vision Technology and equipment to hold meeting A kind of means of communication of view.With the development of development of Mobile Internet technology, video conference is widely made In the several scenes in live and work, no matter where, can be by end of video conference End participates in meeting, improves the operating efficiency of user, saves the traveling expense caused due to attending a meeting, into A kind of conferencing received by increasing user.Subtitle superposition processing is one of video conference Basic function, during video communication, pass through on the video images superposition terminal name, meeting title, The caption data such as banner and related introduction word, can effectively lift the effect of meeting of video conference, be one Plant the supplementary means of communication interaction.At present, subtitle superposition processing is usually required to superposition of data individual element Point processing, performance consumption is very big;Such as, a media server is in the feelings handled without subtitle superposition Under condition, the video of 100 tunnel terminals can be handled;But, carry out after subtitle superposition processing, due to captions Overlap-add procedure consumes the performance of media server, therefore media server can only handle 80 tunnel terminals Video.
The performance consumption of reduction subtitle superposition processing can improve the terminal way of the processing of video conference, carry The operating efficiency of high conference system;By improving the processing way of video conference, video conference can be reduced Cost.In correlation technique, the performance consumption for reducing subtitle superposition mainly uses following two modes:One Planting is:The algorithm of subtitle superposition processing is optimized, for example, when subtitle superposition is handled, will one by one Pixel progress processing in superposition of data is optimized for:Using predetermined number pixel as pixel groups, with Pixel groups carry out subtitle superposition processing for processing unit to the pixel in superposition of data;There is a method in which It is:By accurate calculation superposition of data to reduce the regional extent of superposition of data, due to subtitle superposition performance The size consumed with superposition of data is directly proportional, therefore accurate calculation superposition of data can reduce pixel processing Performance consumption.
Correlation technique reduces the performance consumption of subtitle superposition processing, still, subtitle superposition to a certain extent The performance consumption of processing still influences the terminal way that video conference is handled, and video conference cost is still higher.
The content of the invention
The following is the general introduction of the theme to being described in detail herein.This general introduction is not to limit claim Protection domain.
The embodiment of the present invention provides a kind of method and device for realizing subtitle superposition, can reduce video conference The performance consumption that subtitle superposition is handled during processing.
The embodiments of the invention provide a kind of method for realizing captions processing, including:
Judge whether caption data changes;
When caption data changes, subtitle superposition processing is carried out to caption data, subtitle superposition number is obtained According to;When caption data does not change, captions are carried out according to the judgement whether superposition of data belongs to key frame Processing.
Optionally, the judgement for whether belonging to key frame according to superposition of data, which carries out captions processing, to be included:
When the superposition of data belongs to key frame, subtitle superposition processing is carried out to the caption data, obtained The subtitle superposition data;
When the superposition of data is not belonging to key frame, if the rate of change of the superposition of data is more than the first threshold Value, subtitle superposition processing is carried out to the caption data, obtains the subtitle superposition data;If described The rate of change of superposition of data be less than or equal to first threshold when, read storage in preceding subtitle superposition data;
The rate of change of the superposition of data includes:The variance value or time domain of the spatial domain encoding and decoding of superposition of data The change ratio of pixel of encoding and decoding.
Optionally, the judgement for whether belonging to key frame according to superposition of data, which carries out captions processing, to be included:
When the superposition of data belongs to key frame, the subtitle superposition processing is carried out to the caption data, Obtain the subtitle superposition data;
When the subtitle superposition data are not belonging to key frame, according to predetermined interval reading storage in preceding captions Superposition of data.
Optionally, before judging whether caption data changes, this method also includes:
Storage is with judging that the time whether caption data changes is recent preceding folded by captions Plus the subtitle superposition data obtained are handled as described in preceding subtitle superposition data.
Optionally, storage includes in preceding subtitle superposition data:It is stored in default memory cache region In preceding subtitle superposition data.
Optionally, carrying out subtitle superposition processing includes:Subtitle superposition is carried out using pixel groups as processing unit; And/or,
The superposition of data of accurate calculation, subtitle superposition is carried out according to the superposition of data of accurate calculation.
On the other hand, present invention method also provides a kind of device for realizing captions processing, including: Judging unit and processing unit;Wherein,
Judging unit is used for, and judges whether caption data changes;
Processing unit includes:First processing module and Second processing module;Wherein,
First processing module is used for, when caption data changes, and caption data is carried out at subtitle superposition Reason, obtains subtitle superposition data;
Second processing module is used for, when caption data does not change, whether belongs to pass according to superposition of data The judgement of key frame carries out captions processing.
Optionally, Second processing module is used for,
When the caption data does not change and the superposition of data belongs to key frame, to the captions number According to the subtitle superposition processing is carried out, the subtitle superposition data are obtained;
When the caption data does not change and the superposition of data is not belonging to key frame, if described folded The rate of change of addend evidence is more than first threshold, and subtitle superposition processing is carried out to the caption data, obtains institute State subtitle superposition data;If the rate of change of the superposition of data is less than or equal to first threshold, read Storage in preceding subtitle superposition data;
The rate of change of the superposition of data includes:The variance value or time domain of the spatial domain encoding and decoding of superposition of data The change ratio of pixel of encoding and decoding.
Optionally, Second processing module is used for,
When the caption data does not change and the superposition of data belongs to key frame, to the captions number According to the subtitle superposition processing is carried out, the subtitle superposition data are obtained;
When the caption data does not change and the superposition of data is not belonging to key frame, between default Every reading storage in preceding subtitle superposition data.
Optionally, device also includes memory cell, judges whether caption data changes it for described Before, storage with judge recently preceding time that whether caption data change by subtitle superposition at The subtitle superposition data obtained are managed as described in preceding subtitle superposition data.
Optionally, device also includes memory cell, default memory cache region is arranged on, for storing It is described in preceding subtitle superposition data.
Optionally, first processing module is used for, when caption data changes,
Using pixel groups as processing unit to caption data progress subtitle superposition, and/or accurate calculation Superposition of data, carries out subtitle superposition to the caption data according to the superposition of data of accurate calculation, obtains institute State subtitle superposition data.
Compared with correlation technique, technical scheme includes:Judge whether caption data changes; When caption data changes, subtitle superposition processing is carried out to caption data, subtitle superposition data are obtained; When caption data does not change, captions processing is carried out according to the judgement whether superposition of data belongs to key frame. Whether present invention method, when not changed by caption data, belong to pass according to superposition of data The judgement of key frame carries out captions processing, the performance consumption of subtitle superposition processing when reducing video conference processing, Improve the terminal way of video conference processing.
After reading and understanding accompanying drawing and being described in detail, it can be appreciated that other aspects.
Brief description of the drawings
Fig. 1 embodiment of the present invention realizes the flow chart of the method for captions processing;
Fig. 2 embodiment of the present invention realizes the structured flowchart of the device of captions processing;
Fig. 3 is subtitle superposition processing priority contrast schematic diagram in correlation technique;
Fig. 4 applies the method flow diagram of example for the present invention.
Embodiment
For the object, technical solutions and advantages of the present invention are more clearly understood, below in conjunction with accompanying drawing Embodiments of the invention are described in detail.It should be noted that in the case where not conflicting, this Shen Please in embodiment and the feature in embodiment can mutually be combined.
Fig. 1 embodiment of the present invention realizes the flow chart of the method for captions processing, as shown in figure 1, including:
Step 100, judge whether caption data changes;
When caption data changes, step 101 is performed;When caption data does not change, step is performed Rapid 102;
Step 101, to caption data carry out subtitle superposition processing, obtain subtitle superposition data;
Step 102, the judgement for whether belonging to according to superposition of data key frame carry out captions processing.
It should be noted that common knowledge of the definition of key frame for those skilled in the art, to key frame Judgement for those skilled in the art conventional techniques.
Optionally, in the embodiment of the present invention, word is carried out according to the judgement whether superposition of data belongs to key frame Curtain processing includes:
When superposition of data belongs to key frame, subtitle superposition processing is carried out to caption data, subtitle superposition is obtained Data;
When superposition of data is not belonging to key frame, if the rate of change of superposition of data is more than first threshold, to word Curtain data carry out subtitle superposition processing, obtain subtitle superposition data;If the rate of change of superposition of data is less than Or during equal to first threshold, read storage in preceding subtitle superposition data;
Here, the rate of change of superposition of data includes:The variance values of the spatial domain encoding and decoding of superposition of data or when The change ratio of pixel of domain encoding and decoding.
It should be noted that first threshold can be set according to actual conditions;With time domain encoding and decoding If exemplified by change ratio of pixel, video conference to definition require it is high, can set compared with previous frame When a pixel changes in superposition of data, current superposition of data, i.e., captions are carried out to caption data and folded Plus processing, obtain subtitle superposition data;If requiring relatively low to definition, 3 percent can be set A numerical value between to 10 is as first threshold, and the size of first threshold is according to video conference pair Image request is set, and can be adjusted.
Optionally, the judgement for whether belonging to key frame according to superposition of data, which carries out captions processing, to be included:
When superposition of data belongs to key frame, subtitle superposition processing is carried out to caption data, subtitle superposition is obtained Data;
When subtitle superposition data are not belonging to key frame, according to predetermined interval reading storage in preceding subtitle superposition Data.
It should be noted that predetermined interval can be set according to actual conditions, mainly and video conference Relevant to image request, video conference is higher to image request, and predetermined interval is bigger;It is general it is default between Every could be arranged to image spacing of 3 frames to 7 frame ins, it can be adjusted according to actual conditions.
Before judging whether caption data changes, present invention method also includes:
Storage is with judging that the time whether caption data changes is recent preceding folded by captions Plus the subtitle superposition data that processing is obtained are as in preceding subtitle superposition data.
Optionally, storage includes in preceding subtitle superposition data:It is stored in default memory cache region In preceding subtitle superposition data.
It should be noted that a kind of of subtitle superposition data stores Jie before memory cache region is simply stored in Matter, hard disk, other storage regions of internal memory etc. can serve as the storage location in preceding subtitle superposition data.
In present invention method, carrying out subtitle superposition processing includes:Processing unit is used as using pixel groups Carry out subtitle superposition;And/or,
The superposition of data of accurate calculation, subtitle superposition is carried out according to the superposition of data of accurate calculation.
It should be noted that in present invention method, judging whether captions send conversion, captions are folded Plus handle and read can implementing in preceding subtitle superposition data etc. by central processing unit for storage, correlation letter Breath can be stored in storage medium.
When present invention method is not changed by caption data, whether belonged to according to superposition of data The judgement of key frame carries out captions processing, and the performance of subtitle superposition processing disappears when reducing video conference processing Consumption, improves the terminal way of video conference processing;On the other hand, video conference cost is due to video council Discussing the raising of the terminal way of processing also further reduces.
Fig. 2 embodiment of the present invention realizes the structured flowchart of the device of captions processing, as shown in Fig. 2 including: Judging unit and processing unit;Wherein,
Judging unit is set to, and judges whether caption data changes;
Processing unit includes:First processing module and Second processing module;Wherein,
First processing module is set to, when caption data changes, and subtitle superposition is carried out to caption data Processing, obtains subtitle superposition data;
Whether Second processing module is set to, when caption data does not change, belonged to according to superposition of data The judgement of key frame carries out captions processing.
Optionally, Second processing module is arranged to,
When caption data does not change and superposition of data belongs to key frame, captions are carried out to caption data and folded Plus processing, obtain subtitle superposition data;
When caption data does not change and superposition of data is not belonging to key frame, if the change of superposition of data Rate is more than first threshold, and subtitle superposition processing is carried out to caption data, obtains subtitle superposition data;If The rate of change of superposition of data be less than or equal to first threshold when, read storage in preceding subtitle superposition data;
The rate of change of superposition of data includes:The variance value or time domain of the spatial domain encoding and decoding of superposition of data compile solution The change ratio of pixel of code.
Optionally, Second processing module is arranged to,
When caption data does not change and superposition of data belongs to key frame, captions are carried out to caption data and folded Plus processing, obtain subtitle superposition data;
When caption data does not change and superposition of data is not belonging to key frame, read and deposit according to predetermined interval Storage in preceding subtitle superposition data.
Device of the embodiment of the present invention also includes memory cell, and memory cell is set to whether judge caption data Before changing, storage is with judging that recently preceding time that whether caption data change passes through The subtitle superposition data that subtitle superposition processing is obtained are as in preceding subtitle superposition data.
Memory cell of the embodiment of the present invention can be arranged on default memory cache region.
Optionally, first processing module of the embodiment of the present invention is set to, when caption data changes,
Using pixel groups as processing unit to the superposition of caption data progress subtitle superposition, and/or accurate calculation Data, carry out subtitle superposition to caption data according to the superposition of data of accurate calculation, obtain subtitle superposition number According to.
The inventive method is clearly described in detail below by way of using example, is only used for using example State the embodiment of the present invention, the protection domain being not intended to limit the present invention.
Using example
This application example to make content of the embodiment of the present invention apparent, to caption data, superposition of data, Subtitle superposition data and the background data being related to are briefly described, and Fig. 3 folds for captions in correlation technique Plus processing priority contrast schematic diagram, as shown in figure 3, the region of horizontal stripe is background data region, a left side is oblique Line region is that superposition of data region, twill left to right region are caption data region, image right or so twill friendship Fork region is subtitle superposition data area;Background data is total background that video conference is shown, captions are folded Plus background data is not processed during processing, the caption data that left side is shown carries out captions with superposition of data Overlap-add procedure obtains the subtitle superposition data of right side display.
Fig. 4 applies the method flow diagram of example for the present invention, as shown in figure 4, including:
Step 400, default memory cache region are used as the region for being stored in preceding subtitle superposition data;
Step 401, be stored in default memory cache region before the moment pass through what subtitle superposition processing was obtained Subtitle superposition data are as in preceding subtitle superposition data;
Here, include at the preceding moment:At the time of with judging that the time whether caption data changes is nearest;
Step 402, judge whether caption data changes;
When caption data changes, step 403 is performed;When caption data does not change, step is performed Rapid 404;
This application example, caption data change including:The content of caption data is converted, for example, Become " 456 " by " 123 ";
Step 403, to caption data carry out subtitle superposition processing, obtain subtitle superposition data;
Step 404, the judgement for whether belonging to according to superposition of data key frame carry out captions processing.
Subtitle superposition processing is carried out to caption data, subtitle superposition data are obtained;Caption data does not become During change, captions processing is carried out according to the judgement whether superposition of data belongs to key frame.
Optionally, in the embodiment of the present invention, word is carried out according to the judgement whether superposition of data belongs to key frame Curtain processing includes:
When superposition of data belongs to key frame, subtitle superposition processing is carried out to caption data, subtitle superposition is obtained Data;
When superposition of data is not belonging to key frame, if the rate of change of superposition of data is more than first threshold, to word Curtain data carry out subtitle superposition processing, obtain subtitle superposition data;If the rate of change of superposition of data is less than Or during equal to first threshold, read storage in preceding subtitle superposition data;
Here, the rate of change of superposition of data includes:The variance values of the spatial domain encoding and decoding of superposition of data or when The change ratio of pixel of domain encoding and decoding.
Optionally, the judgement for whether belonging to key frame according to superposition of data, which carries out captions processing, to be included:
When superposition of data belongs to key frame, subtitle superposition processing is carried out to caption data, subtitle superposition is obtained Data;
When subtitle superposition data are not belonging to key frame, according to predetermined interval reading storage in preceding subtitle superposition Data.This application example, predetermined interval is 5 frames, i.e., after being handled using subtitle superposition, enter every 5 frames Row once reads the performance consumption handled in preceding subtitle superposition data, reduction subtitle superposition of storage.
This application example, read storage in preceding subtitle superposition data, to video conference handle performance Consumption can almost be disregarded, therefore when carrying out the part captions processing, word when reducing video conference processing The performance consumption of curtain overlap-add procedure, improves the terminal way of video conference processing.
One of ordinary skill in the art will appreciate that all or part of step in the above method can pass through program To instruct related hardware (such as processor) to complete, described program can be stored in computer-readable storage In medium, such as read-only storage, disk or CD.Alternatively, all or part of above-described embodiment Step can also use one or more integrated circuits to realize.Correspondingly, it is each in above-described embodiment Module/unit can be realized in the form of hardware, for example, its corresponding function is realized by integrated circuit, It can also be realized, for example, be stored in by computing device in memory in the form of software function module Program/instruction realize its corresponding function.The present invention is not restricted to the hardware and software of any particular form Combination.”.
Although disclosed herein embodiment as above, described content is only to readily appreciate the present invention And the embodiment used, it is not limited to the present invention.Technology people in any art of the present invention Member, do not depart from disclosed herein spirit and scope on the premise of, can be in the form of implementation and thin Any modification and change, but the scope of patent protection of the present invention are carried out on section, still must be with appended right The scope that claim is defined is defined.

Claims (12)

1. a kind of method for realizing captions processing, it is characterised in that including:
Judge whether caption data changes;
When caption data changes, subtitle superposition processing is carried out to caption data, subtitle superposition number is obtained According to;When caption data does not change, captions are carried out according to the judgement whether superposition of data belongs to key frame Processing.
2. according to the method described in claim 1, it is characterised in that described whether to be belonged to according to superposition of data Carrying out captions processing in the judgement of key frame includes:
When the superposition of data belongs to key frame, subtitle superposition processing is carried out to the caption data, obtained The subtitle superposition data;
When the superposition of data is not belonging to key frame, if the rate of change of the superposition of data is more than the first threshold Value, subtitle superposition processing is carried out to the caption data, obtains the subtitle superposition data;If described The rate of change of superposition of data be less than or equal to first threshold when, read storage in preceding subtitle superposition data;
The rate of change of the superposition of data includes:The variance value or time domain of the spatial domain encoding and decoding of superposition of data The change ratio of pixel of encoding and decoding.
3. according to the method described in claim 1, it is characterised in that described whether to be belonged to according to superposition of data Carrying out captions processing in the judgement of key frame includes:
When the superposition of data belongs to key frame, the subtitle superposition processing is carried out to the caption data, Obtain the subtitle superposition data;
When the subtitle superposition data are not belonging to key frame, according to predetermined interval reading storage in preceding captions Superposition of data.
4. according to the method in claim 2 or 3, it is characterised in that described to judge that caption data is It is no change before, this method also includes:
Storage is with judging that the time whether caption data changes is recent preceding folded by captions Plus the subtitle superposition data obtained are handled as described in preceding subtitle superposition data.
5. according to the method in claim 2 or 3, it is characterised in that the storage in preceding captions Superposition of data includes:Be stored in default memory cache region in preceding subtitle superposition data.
6. the method according to any one of claims 1 to 3, it is characterised in that the carry out captions Overlap-add procedure includes:Subtitle superposition is carried out using pixel groups as processing unit;And/or,
The superposition of data of accurate calculation, subtitle superposition is carried out according to the superposition of data of accurate calculation.
7. a kind of device for realizing captions processing, it is characterised in that including:Judging unit and processing unit; Wherein,
Judging unit is used for, and judges whether caption data changes;
Processing unit includes:First processing module and Second processing module;Wherein,
First processing module is used for, when caption data changes, and caption data is carried out at subtitle superposition Reason, obtains subtitle superposition data;
Second processing module is used for, when caption data does not change, whether belongs to pass according to superposition of data The judgement of key frame carries out captions processing.
8. device according to claim 7, it is characterised in that the Second processing module is used for,
When the caption data does not change and the superposition of data belongs to key frame, to the captions number According to the subtitle superposition processing is carried out, the subtitle superposition data are obtained;
When the caption data does not change and the superposition of data is not belonging to key frame, if described folded The rate of change of addend evidence is more than first threshold, and subtitle superposition processing is carried out to the caption data, obtains institute State subtitle superposition data;If the rate of change of the superposition of data is less than or equal to first threshold, read Storage in preceding subtitle superposition data;
The rate of change of the superposition of data includes:The variance value or time domain of the spatial domain encoding and decoding of superposition of data The change ratio of pixel of encoding and decoding.
9. device according to claim 7, it is characterised in that the Second processing module is used for,
When the caption data does not change and the superposition of data belongs to key frame, to the captions number According to the subtitle superposition processing is carried out, the subtitle superposition data are obtained;
When the caption data does not change and the superposition of data is not belonging to key frame, between default Every reading storage in preceding subtitle superposition data.
10. device according to claim 8 or claim 9, it is characterised in that described device also includes depositing Storage unit, for it is described judge whether caption data changes before, storage be with judging caption data The preceding subtitle superposition data for handling acquisition by subtitle superposition of the no time changed recently are used as It is described in preceding subtitle superposition data.
11. device according to claim 8 or claim 9, it is characterised in that described device also includes depositing Storage unit, is arranged on default memory cache region, described in preceding subtitle superposition data for storing.
12. the device according to any one of claim 7~9, it is characterised in that first processing Module is used for, when caption data changes,
Using pixel groups as processing unit to caption data progress subtitle superposition, and/or accurate calculation Superposition of data, carries out subtitle superposition to the caption data according to the superposition of data of accurate calculation, obtains institute State subtitle superposition data.
CN201610162189.3A 2016-03-21 2016-03-21 A kind of method and device for realizing captions processing Pending CN107222772A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610162189.3A CN107222772A (en) 2016-03-21 2016-03-21 A kind of method and device for realizing captions processing
PCT/CN2017/075418 WO2017162010A1 (en) 2016-03-21 2017-03-02 Method and apparatus for realizing caption processing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610162189.3A CN107222772A (en) 2016-03-21 2016-03-21 A kind of method and device for realizing captions processing

Publications (1)

Publication Number Publication Date
CN107222772A true CN107222772A (en) 2017-09-29

Family

ID=59899312

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610162189.3A Pending CN107222772A (en) 2016-03-21 2016-03-21 A kind of method and device for realizing captions processing

Country Status (2)

Country Link
CN (1) CN107222772A (en)
WO (1) WO2017162010A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109982027A (en) * 2019-02-26 2019-07-05 视联动力信息技术股份有限公司 A kind of method of adjustment, the device and system of Subtitle Demonstration parameter

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112203151B (en) * 2020-10-09 2022-05-17 北京字跳网络技术有限公司 Video processing method and device, electronic equipment and computer readable storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1218574C (en) * 2001-10-15 2005-09-07 华为技术有限公司 Interactive video equipment and its caption superposition method
CN101500127A (en) * 2008-01-28 2009-08-05 德信智能手机技术(北京)有限公司 Method for synchronously displaying subtitle in video telephone call
CN101790049A (en) * 2010-02-25 2010-07-28 深圳市茁壮网络股份有限公司 Newscast video segmentation method and system
CN101895694A (en) * 2010-07-23 2010-11-24 中兴通讯股份有限公司 Subtitle superimposition method and device
JP2012142881A (en) * 2011-01-06 2012-07-26 Kddi Corp Caption editing device, caption editing method, and computer program

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109982027A (en) * 2019-02-26 2019-07-05 视联动力信息技术股份有限公司 A kind of method of adjustment, the device and system of Subtitle Demonstration parameter

Also Published As

Publication number Publication date
WO2017162010A1 (en) 2017-09-28

Similar Documents

Publication Publication Date Title
CN109783178B (en) Color adjusting method, device, equipment and medium for interface component
US8917764B2 (en) System and method for virtualization of ambient environments in live video streaming
US10467734B2 (en) Group management method, terminal, and storage medium
CN110392282B (en) Video frame insertion method, computer storage medium and server
CN108769776B (en) Title subtitle detection method and device and electronic equipment
CN106303157B (en) Video noise reduction processing method and video noise reduction processing device
WO2021175054A1 (en) Image data processing method, and related apparatus
US7868898B2 (en) Methods and apparatus for efficiently accessing reduced color-resolution image data
US7982805B2 (en) Detecting video format information in a sequence of video pictures
CN109121000A (en) A kind of method for processing video frequency and client
US20230362328A1 (en) Video frame insertion method and apparatus, and electronic device
WO2002080525A3 (en) System and method for performing segmentation-based enhancements of a video image
US20180268864A1 (en) Detecting and correcting whiteboard images while enabling the removal of the speaker
CN107222772A (en) A kind of method and device for realizing captions processing
CN101533511B (en) Background image updating method and device thereof
CN104469133A (en) Image processing method and device
US11562772B2 (en) Video processing method, electronic device, and storage medium
US20150242988A1 (en) Methods of eliminating redundant rendering of frames
US10623683B1 (en) Methods and apparatus for improving image retention
CN111835937A (en) Image processing method and device and electronic equipment
CN109859328B (en) Scene switching method, device, equipment and medium
CN100594723C (en) Image processor having frame speed conversion and its method
CN112911299B (en) Video code rate control method and device, electronic equipment and storage medium
AU2008264173A1 (en) Splitting a single video stream into multiple viewports based on face detection
CN112199149A (en) Interface rendering method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170929

WD01 Invention patent application deemed withdrawn after publication