CN112040331A - Subtitle detour superposition display platform and method - Google Patents
Subtitle detour superposition display platform and method Download PDFInfo
- Publication number
- CN112040331A CN112040331A CN201911220909.7A CN201911220909A CN112040331A CN 112040331 A CN112040331 A CN 112040331A CN 201911220909 A CN201911220909 A CN 201911220909A CN 112040331 A CN112040331 A CN 112040331A
- Authority
- CN
- China
- Prior art keywords
- subtitle
- image
- equipment
- display platform
- image frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4884—Data services, e.g. news ticker for displaying subtitles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
- H04N21/8133—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/278—Subtitling
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Circuits (AREA)
Abstract
The invention relates to a subtitle bypassing and overlapping display platform and a method, wherein the platform comprises: the data extraction equipment is used for extracting data of the played video of each film to obtain each component image frame of the played video; the caption acquisition equipment is used for searching each caption corresponding to the timestamp corresponding to each image frame; the content superposition device is used for superposing each subtitle searched by the subtitle acquisition device at a non-reference position of the received component image frame based on the reference position of the component image frame; the content superimposing apparatus is further configured to prohibit superimposition of each subtitle searched by the subtitle obtaining apparatus at a reference position of the constituent image frame. The subtitle bypassing and overlapping display platform and the method have wide application and are convenient for appreciation. Because the overlapped caption can bypass the important area of the playing of the film, the caption can be displayed without influencing the appreciation and the watching of the content of the film.
Description
Technical Field
The invention relates to the field of subtitle manufacturing, in particular to a subtitle bypassing and overlapping display platform and a method.
Background
Film production (or called movie production) refers to the process of producing a movie. The nature of the movie determines the size and type of work team required during production.
The production of a general commercial film can be roughly divided into three steps: the work before shooting comprises drawing ideas, writing stories, grading synopsis, directing a sign, listing budgeting, composing a script, seeing an outdoor scene, finding actors and determining the members of a production group. And secondly, performing shooting in an intensive operation mode under the direction of a director, and executing production supervision expenditure, shooting progress and all administrative matters. And thirdly, the work after shooting comprises splicing, dubbing music, designing subtitles, making trailers, developing pre-film propaganda and the like.
In the shooting process, the director should have a detailed lens plan and draw up the shooting sequence to obtain a rapid development under the pressure of light variation and actor domination. For the selection of the camera and lens, the arrangement of the light arrangement, the splicing and the music arrangement, the staff and the director need to be closely matched to achieve the required effect, so that a movie is the creation of a group and is also an artwork for the director to hide the personal view under various tensions.
Disclosure of Invention
In order to solve the technical problems in the related art, the invention provides a subtitle bypassing and overlapping display platform, which can adaptively select a subtitle overlapping display area according to the real-time changing playing content of a film, thereby meeting the watching requirements of audiences on the content of the film and the subtitle content.
For this reason, the present invention needs to have at least the following important points:
(1) in the playing of the film, a bypass superposition display mechanism for playing the related subtitles in a non-foreground image area is selected, so that the user does not influence the watching of the content of the film when watching the subtitles;
(2) on the basis of targeted image processing, foreground and background stripping is performed on the processed image corresponding to each component image frame of the film, so that the reliability of area positioning of the corresponding component image frame is improved.
According to an aspect of the present invention, there is provided a subtitle bypassing superposition display platform, including:
the data extraction equipment is used for extracting data of the played video of each film to obtain each component image frame of the played video;
the caption acquisition equipment is used for searching each caption corresponding to the timestamp corresponding to each image frame;
the content superposition equipment is respectively connected with the subtitle acquisition equipment and the data extraction equipment and is used for superposing each subtitle searched by the subtitle acquisition equipment at the non-reference position of the composition image frame based on the reference position of the received composition image frame;
the content superposition device is also used for prohibiting superposition of each subtitle searched by the subtitle acquisition device at the reference position of the composition image frame;
the contrast processing equipment is connected with the data extraction equipment and used for receiving each image frame of the played video and executing contrast improvement processing on the received image near each road pile to obtain a contrast processed image;
the sharpening processing device is connected with the contrast processing device and is used for carrying out sharpening processing on the received contrast processing image so as to obtain a corresponding current sharpened image;
the filtering processing device is connected with the sharpening processing device and is used for executing maximum filtering processing on the received current sharpened image to obtain a current filtered image;
the foreground detection device is connected with the filtering processing device and used for receiving the current filtering image and stripping a foreground image area and a background image area from the current filtering image based on a preset gray threshold value;
and the area positioning device is respectively connected with the foreground detection device and the data extraction device and is used for determining a position which is consistent with the relative position in the image frame corresponding to the current filtering image based on the relative position of the background image area in the current filtering image to be used as a reference position.
According to another aspect of the present invention, there is also provided a subtitle bypassing superposition display method, which includes using the subtitle bypassing superposition display platform as described above to bypass the character displayed in superposition to the foreground-related area during the playing of the movie.
The subtitle bypassing and overlapping display platform and the method have wide application and are convenient for appreciation. Because the overlapped caption can bypass the important area of the playing of the film, the caption can be displayed without influencing the appreciation and the watching of the content of the film.
Detailed Description
Embodiments of the subtitle bypass overlay display platform and method of the present invention will be described in detail below.
Subtitles (subtitles) refer to non-video contents such as a dialog in a television, a movie, or a stage work, which are displayed in a text form, and also generally refer to a text for post-processing of a movie. The commentary and various characters appearing below the movie screen or the television screen, such as the film title, the credits, the lyrics, the dialogues, the captions and the explanatory words are called subtitles according to the introduction of people, the place name and the year. Subtitles for movies and television works generally appear below the screen, whereas subtitles for drama works may appear on both sides or above the stage.
Currently, in various movie playing applications, a subtitle superimposition display function for user comments is set, and in the current subtitle superimposition display mode, subtitles are placed on the top several pixel rows of a movie picture for superimposition display, and specific movie playing contents are not considered, so that displayed subtitles easily block important areas of a movie.
In order to overcome the defects, the invention builds a subtitle bypassing and overlapping display platform and a method thereof, and can effectively solve the corresponding technical problem.
The subtitle bypassing and overlapping display platform shown according to the embodiment of the invention comprises:
the data extraction equipment is used for extracting data of the played video of each film to obtain each component image frame of the played video;
the caption acquisition equipment is used for searching each caption corresponding to the timestamp corresponding to each image frame;
the content superposition equipment is respectively connected with the subtitle acquisition equipment and the data extraction equipment and is used for superposing each subtitle searched by the subtitle acquisition equipment at the non-reference position of the composition image frame based on the reference position of the received composition image frame;
the content superposition device is also used for prohibiting superposition of each subtitle searched by the subtitle acquisition device at the reference position of the composition image frame;
the contrast processing equipment is connected with the data extraction equipment and used for receiving each image frame of the played video and executing contrast improvement processing on the received image near each road pile to obtain a contrast processed image;
the sharpening processing device is connected with the contrast processing device and is used for carrying out sharpening processing on the received contrast processing image so as to obtain a corresponding current sharpened image;
the filtering processing device is connected with the sharpening processing device and is used for executing maximum filtering processing on the received current sharpened image to obtain a current filtered image;
the foreground detection device is connected with the filtering processing device and used for receiving the current filtering image and stripping a foreground image area and a background image area from the current filtering image based on a preset gray threshold value;
and the area positioning device is respectively connected with the foreground detection device and the data extraction device and is used for determining a position which is consistent with the relative position in the image frame corresponding to the current filtering image based on the relative position of the background image area in the current filtering image to be used as a reference position.
Next, a detailed structure of the subtitle bypassing superimposition display platform according to the present invention will be further described.
The subtitle bypassing and overlapping display platform further comprises:
and the display equipment is respectively connected with the sharpening processing equipment and the filtering processing equipment and is used for displaying various working parameters of the sharpening processing equipment and various working parameters of the filtering processing equipment.
In the subtitle bypassing and overlapping display platform:
the display device is a liquid crystal display screen.
In the subtitle bypassing and overlapping display platform:
the display equipment is an LED display screen.
The subtitle bypassing and overlapping display platform further comprises:
and the touch screen is used for receiving input information of the user according to the operation of the user.
In the subtitle bypassing and overlapping display platform:
the touch screen is integrated on the display device.
In the subtitle bypassing and overlapping display platform:
the display device, the sharpening device, the filtering device and the touch screen are all integrated on one integrated circuit board.
In the subtitle bypassing and overlapping display platform:
the area positioning device, the foreground detection device and the data extraction device share the same parameter configuration interface.
In the subtitle bypassing and overlapping display platform:
the parameter configuration interface is one of an IIC control interface or a serial control interface.
Meanwhile, in order to overcome the defects, the invention also provides a subtitle bypassing and overlapping display method, which comprises the step of using the subtitle bypassing and overlapping display platform to enable characters displayed in an overlapping mode to bypass the area related to the foreground in the playing process of the film.
In addition, image filtering, namely, suppressing the noise of the target image under the condition of keeping the detail features of the image as much as possible, is an indispensable operation in image preprocessing, and the effectiveness and reliability of subsequent image processing and analysis are directly affected by the quality of the processing effect.
Due to the imperfections of the imaging system, the transmission medium, and the recording device, the digital images are often contaminated by various noises during the formation, transmission, and recording processes thereof. In addition, noise may also be introduced into the resulting image at some point in the image processing when the input image object is not as expected. These noises often appear as an isolated pixel or block of pixels on the image that causes a strong visual effect. In general, the noise signal is not correlated with the object to be studied-it appears in the form of useless information, disturbing the observable information of the image. For digital image signals, the noise table is more or less extreme values, and the extreme values act on the real gray values of image pixels through addition and subtraction to cause bright and dark point interference on the image, so that the image quality is greatly reduced, and the follow-up work of image restoration, segmentation, feature extraction, image identification and the like is influenced. Two basic issues must be considered to construct an effective noise suppression filter: the noise in the target and the background can be effectively removed; meanwhile, the shape, the size and the specific geometric and topological structure characteristics of the image target can be well protected.
One of the commonly used image filtering modes is a non-linear filter, generally speaking, when the signal spectrum and the noise spectrum are mixed or when the signal contains non-superimposed noise, such as noise caused by system nonlinearity or the presence of non-gaussian noise, etc.), the conventional linear filtering techniques, such as fourier transform, while filtering out noise, always blur the image details (such as edges, etc.) in some way, thereby causing the positioning accuracy of the image linear features and the extractability of the features to be reduced. The nonlinear filter is based on a nonlinear mapping relation of an input signal, a specific noise can be mapped to be zero approximately, the main characteristic of the signal is reserved, and therefore the nonlinear filter can overcome the defects of the linear filter to a certain extent.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: Read-Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A subtitle detour superimposition display platform, comprising:
the data extraction equipment is used for extracting data of the played video of each film to obtain each component image frame of the played video;
the caption acquisition equipment is used for searching each caption corresponding to the timestamp corresponding to each image frame;
the content superposition equipment is respectively connected with the subtitle acquisition equipment and the data extraction equipment and is used for superposing each subtitle searched by the subtitle acquisition equipment at the non-reference position of the composition image frame based on the reference position of the received composition image frame;
the content superposition device is also used for prohibiting superposition of each subtitle searched by the subtitle acquisition device at the reference position of the composition image frame;
the contrast processing equipment is connected with the data extraction equipment and used for receiving each image frame of the played video and executing contrast improvement processing on the received image near each road pile to obtain a contrast processed image;
the sharpening processing device is connected with the contrast processing device and is used for carrying out sharpening processing on the received contrast processing image so as to obtain a corresponding current sharpened image;
the filtering processing device is connected with the sharpening processing device and is used for executing maximum filtering processing on the received current sharpened image to obtain a current filtered image;
the foreground detection device is connected with the filtering processing device and used for receiving the current filtering image and stripping a foreground image area and a background image area from the current filtering image based on a preset gray threshold value;
and the area positioning device is respectively connected with the foreground detection device and the data extraction device and is used for determining a position which is consistent with the relative position in the image frame corresponding to the current filtering image based on the relative position of the background image area in the current filtering image to be used as a reference position.
2. The subtitle bypass overlay display platform of claim 1, wherein the platform further comprises:
and the display equipment is respectively connected with the sharpening processing equipment and the filtering processing equipment and is used for displaying various working parameters of the sharpening processing equipment and various working parameters of the filtering processing equipment.
3. The subtitle bypass overlay display platform of claim 2, wherein:
the display device is a liquid crystal display screen.
4. The subtitle bypass overlay display platform of claim 2, wherein:
the display equipment is an LED display screen.
5. The subtitle bypass overlay display platform of claim 2, wherein the platform further comprises:
and the touch screen is used for receiving input information of the user according to the operation of the user.
6. The subtitle bypass overlay display platform of claim 5, wherein:
the touch screen is integrated on the display device.
7. The subtitle bypass overlay display platform of claim 6, wherein:
the display device, the sharpening device, the filtering device and the touch screen are all integrated on one integrated circuit board.
8. The subtitle bypass overlay display platform of claim 7, wherein:
the area positioning device, the foreground detection device and the data extraction device share the same parameter configuration interface.
9. The subtitle bypass overlay display platform of claim 8, wherein:
the parameter configuration interface is one of an IIC control interface or a serial control interface.
10. A method of subtitle bypassing overlay display, the method comprising using a subtitle bypassing overlay display platform according to any one of claims 1-9 to bypass the character displayed in the overlay to the foreground-related region during the playing of the film.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911220909.7A CN112040331A (en) | 2019-12-03 | 2019-12-03 | Subtitle detour superposition display platform and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911220909.7A CN112040331A (en) | 2019-12-03 | 2019-12-03 | Subtitle detour superposition display platform and method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN112040331A true CN112040331A (en) | 2020-12-04 |
Family
ID=73576716
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911220909.7A Withdrawn CN112040331A (en) | 2019-12-03 | 2019-12-03 | Subtitle detour superposition display platform and method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112040331A (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090273711A1 (en) * | 2008-04-30 | 2009-11-05 | Centre De Recherche Informatique De Montreal (Crim) | Method and apparatus for caption production |
CN101917557A (en) * | 2010-08-10 | 2010-12-15 | 浙江大学 | Method for dynamically adding subtitles based on video content |
CN109118434A (en) * | 2017-06-26 | 2019-01-01 | 南京东大智能化系统有限公司 | A kind of image pre-processing method |
-
2019
- 2019-12-03 CN CN201911220909.7A patent/CN112040331A/en not_active Withdrawn
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090273711A1 (en) * | 2008-04-30 | 2009-11-05 | Centre De Recherche Informatique De Montreal (Crim) | Method and apparatus for caption production |
CN101917557A (en) * | 2010-08-10 | 2010-12-15 | 浙江大学 | Method for dynamically adding subtitles based on video content |
CN109118434A (en) * | 2017-06-26 | 2019-01-01 | 南京东大智能化系统有限公司 | A kind of image pre-processing method |
Non-Patent Citations (1)
Title |
---|
李卓: "复杂背景下的图像分割算法研究及应用", 《中国优秀硕士学位论文全文数据库(电子期刊)信息科技辑》 * |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7796139B1 (en) | Methods and apparatus for displaying a frame with contrasting text | |
Yang et al. | Automatic lecture video indexing using video OCR technology | |
US9667887B2 (en) | Lens distortion method for broadcast video | |
US20060251335A1 (en) | Image processing method, apparatus, and program | |
US20120206624A1 (en) | Image processing method, image processing apparatus, and electronic camera | |
US20100080481A1 (en) | 3D Depth Generation by Local Blurriness Estimation | |
KR20090043416A (en) | Surveillance camera apparatus for detecting and suppressing camera shift and control method thereof | |
US20120249837A1 (en) | Methods and Systems for Real-Time Image-Capture Feedback | |
US9111352B2 (en) | Automated detection and correction of stereoscopic edge violations | |
GB2438689A (en) | Method of detecting correction methods for feature images | |
CN112040331A (en) | Subtitle detour superposition display platform and method | |
CN114202519A (en) | Video flicker determination method, device, equipment and storage medium | |
CN111726572B (en) | Instruction signal triggering-based associated personnel locking platform and method | |
US11233985B2 (en) | Method for video quality detection and image processing circuit using the same | |
CN111160340B (en) | Moving object detection method and device, storage medium and terminal equipment | |
US9607365B1 (en) | Systems and methods for enhancing quality of image media | |
US9807339B2 (en) | Frame rate conversion system | |
CN116168233A (en) | Blackboard writing restoration method based on grid image patch classification | |
EP3959644A1 (en) | Method, system, and computer-readable medium for removing flare in images | |
CN110876081A (en) | Automatic audio intensity modifying method | |
JP2007285868A (en) | Luminance gradient detection method, flaw detection method, luminance gradient detector and flaw detector | |
EP3101839A1 (en) | Method and apparatus for isolating an active participant in a group of participants using light field information | |
JP3216359B2 (en) | Display control device for child image | |
CN108717684B (en) | High-speed horizontal moving object image sequence splicing method and system based on array camera | |
CN109688426B (en) | Multimedia data editing method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WW01 | Invention patent application withdrawn after publication | ||
WW01 | Invention patent application withdrawn after publication |
Application publication date: 20201204 |