CN112040331A - Subtitle detour superposition display platform and method - Google Patents

Subtitle detour superposition display platform and method Download PDF

Info

Publication number
CN112040331A
CN112040331A CN201911220909.7A CN201911220909A CN112040331A CN 112040331 A CN112040331 A CN 112040331A CN 201911220909 A CN201911220909 A CN 201911220909A CN 112040331 A CN112040331 A CN 112040331A
Authority
CN
China
Prior art keywords
subtitle
image
equipment
display platform
image frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201911220909.7A
Other languages
Chinese (zh)
Inventor
黄德莲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201911220909.7A priority Critical patent/CN112040331A/en
Publication of CN112040331A publication Critical patent/CN112040331A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4884Data services, e.g. news ticker for displaying subtitles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8126Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/278Subtitling

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Circuits (AREA)

Abstract

The invention relates to a subtitle bypassing and overlapping display platform and a method, wherein the platform comprises: the data extraction equipment is used for extracting data of the played video of each film to obtain each component image frame of the played video; the caption acquisition equipment is used for searching each caption corresponding to the timestamp corresponding to each image frame; the content superposition device is used for superposing each subtitle searched by the subtitle acquisition device at a non-reference position of the received component image frame based on the reference position of the component image frame; the content superimposing apparatus is further configured to prohibit superimposition of each subtitle searched by the subtitle obtaining apparatus at a reference position of the constituent image frame. The subtitle bypassing and overlapping display platform and the method have wide application and are convenient for appreciation. Because the overlapped caption can bypass the important area of the playing of the film, the caption can be displayed without influencing the appreciation and the watching of the content of the film.

Description

Subtitle detour superposition display platform and method
Technical Field
The invention relates to the field of subtitle manufacturing, in particular to a subtitle bypassing and overlapping display platform and a method.
Background
Film production (or called movie production) refers to the process of producing a movie. The nature of the movie determines the size and type of work team required during production.
The production of a general commercial film can be roughly divided into three steps: the work before shooting comprises drawing ideas, writing stories, grading synopsis, directing a sign, listing budgeting, composing a script, seeing an outdoor scene, finding actors and determining the members of a production group. And secondly, performing shooting in an intensive operation mode under the direction of a director, and executing production supervision expenditure, shooting progress and all administrative matters. And thirdly, the work after shooting comprises splicing, dubbing music, designing subtitles, making trailers, developing pre-film propaganda and the like.
In the shooting process, the director should have a detailed lens plan and draw up the shooting sequence to obtain a rapid development under the pressure of light variation and actor domination. For the selection of the camera and lens, the arrangement of the light arrangement, the splicing and the music arrangement, the staff and the director need to be closely matched to achieve the required effect, so that a movie is the creation of a group and is also an artwork for the director to hide the personal view under various tensions.
Disclosure of Invention
In order to solve the technical problems in the related art, the invention provides a subtitle bypassing and overlapping display platform, which can adaptively select a subtitle overlapping display area according to the real-time changing playing content of a film, thereby meeting the watching requirements of audiences on the content of the film and the subtitle content.
For this reason, the present invention needs to have at least the following important points:
(1) in the playing of the film, a bypass superposition display mechanism for playing the related subtitles in a non-foreground image area is selected, so that the user does not influence the watching of the content of the film when watching the subtitles;
(2) on the basis of targeted image processing, foreground and background stripping is performed on the processed image corresponding to each component image frame of the film, so that the reliability of area positioning of the corresponding component image frame is improved.
According to an aspect of the present invention, there is provided a subtitle bypassing superposition display platform, including:
the data extraction equipment is used for extracting data of the played video of each film to obtain each component image frame of the played video;
the caption acquisition equipment is used for searching each caption corresponding to the timestamp corresponding to each image frame;
the content superposition equipment is respectively connected with the subtitle acquisition equipment and the data extraction equipment and is used for superposing each subtitle searched by the subtitle acquisition equipment at the non-reference position of the composition image frame based on the reference position of the received composition image frame;
the content superposition device is also used for prohibiting superposition of each subtitle searched by the subtitle acquisition device at the reference position of the composition image frame;
the contrast processing equipment is connected with the data extraction equipment and used for receiving each image frame of the played video and executing contrast improvement processing on the received image near each road pile to obtain a contrast processed image;
the sharpening processing device is connected with the contrast processing device and is used for carrying out sharpening processing on the received contrast processing image so as to obtain a corresponding current sharpened image;
the filtering processing device is connected with the sharpening processing device and is used for executing maximum filtering processing on the received current sharpened image to obtain a current filtered image;
the foreground detection device is connected with the filtering processing device and used for receiving the current filtering image and stripping a foreground image area and a background image area from the current filtering image based on a preset gray threshold value;
and the area positioning device is respectively connected with the foreground detection device and the data extraction device and is used for determining a position which is consistent with the relative position in the image frame corresponding to the current filtering image based on the relative position of the background image area in the current filtering image to be used as a reference position.
According to another aspect of the present invention, there is also provided a subtitle bypassing superposition display method, which includes using the subtitle bypassing superposition display platform as described above to bypass the character displayed in superposition to the foreground-related area during the playing of the movie.
The subtitle bypassing and overlapping display platform and the method have wide application and are convenient for appreciation. Because the overlapped caption can bypass the important area of the playing of the film, the caption can be displayed without influencing the appreciation and the watching of the content of the film.
Detailed Description
Embodiments of the subtitle bypass overlay display platform and method of the present invention will be described in detail below.
Subtitles (subtitles) refer to non-video contents such as a dialog in a television, a movie, or a stage work, which are displayed in a text form, and also generally refer to a text for post-processing of a movie. The commentary and various characters appearing below the movie screen or the television screen, such as the film title, the credits, the lyrics, the dialogues, the captions and the explanatory words are called subtitles according to the introduction of people, the place name and the year. Subtitles for movies and television works generally appear below the screen, whereas subtitles for drama works may appear on both sides or above the stage.
Currently, in various movie playing applications, a subtitle superimposition display function for user comments is set, and in the current subtitle superimposition display mode, subtitles are placed on the top several pixel rows of a movie picture for superimposition display, and specific movie playing contents are not considered, so that displayed subtitles easily block important areas of a movie.
In order to overcome the defects, the invention builds a subtitle bypassing and overlapping display platform and a method thereof, and can effectively solve the corresponding technical problem.
The subtitle bypassing and overlapping display platform shown according to the embodiment of the invention comprises:
the data extraction equipment is used for extracting data of the played video of each film to obtain each component image frame of the played video;
the caption acquisition equipment is used for searching each caption corresponding to the timestamp corresponding to each image frame;
the content superposition equipment is respectively connected with the subtitle acquisition equipment and the data extraction equipment and is used for superposing each subtitle searched by the subtitle acquisition equipment at the non-reference position of the composition image frame based on the reference position of the received composition image frame;
the content superposition device is also used for prohibiting superposition of each subtitle searched by the subtitle acquisition device at the reference position of the composition image frame;
the contrast processing equipment is connected with the data extraction equipment and used for receiving each image frame of the played video and executing contrast improvement processing on the received image near each road pile to obtain a contrast processed image;
the sharpening processing device is connected with the contrast processing device and is used for carrying out sharpening processing on the received contrast processing image so as to obtain a corresponding current sharpened image;
the filtering processing device is connected with the sharpening processing device and is used for executing maximum filtering processing on the received current sharpened image to obtain a current filtered image;
the foreground detection device is connected with the filtering processing device and used for receiving the current filtering image and stripping a foreground image area and a background image area from the current filtering image based on a preset gray threshold value;
and the area positioning device is respectively connected with the foreground detection device and the data extraction device and is used for determining a position which is consistent with the relative position in the image frame corresponding to the current filtering image based on the relative position of the background image area in the current filtering image to be used as a reference position.
Next, a detailed structure of the subtitle bypassing superimposition display platform according to the present invention will be further described.
The subtitle bypassing and overlapping display platform further comprises:
and the display equipment is respectively connected with the sharpening processing equipment and the filtering processing equipment and is used for displaying various working parameters of the sharpening processing equipment and various working parameters of the filtering processing equipment.
In the subtitle bypassing and overlapping display platform:
the display device is a liquid crystal display screen.
In the subtitle bypassing and overlapping display platform:
the display equipment is an LED display screen.
The subtitle bypassing and overlapping display platform further comprises:
and the touch screen is used for receiving input information of the user according to the operation of the user.
In the subtitle bypassing and overlapping display platform:
the touch screen is integrated on the display device.
In the subtitle bypassing and overlapping display platform:
the display device, the sharpening device, the filtering device and the touch screen are all integrated on one integrated circuit board.
In the subtitle bypassing and overlapping display platform:
the area positioning device, the foreground detection device and the data extraction device share the same parameter configuration interface.
In the subtitle bypassing and overlapping display platform:
the parameter configuration interface is one of an IIC control interface or a serial control interface.
Meanwhile, in order to overcome the defects, the invention also provides a subtitle bypassing and overlapping display method, which comprises the step of using the subtitle bypassing and overlapping display platform to enable characters displayed in an overlapping mode to bypass the area related to the foreground in the playing process of the film.
In addition, image filtering, namely, suppressing the noise of the target image under the condition of keeping the detail features of the image as much as possible, is an indispensable operation in image preprocessing, and the effectiveness and reliability of subsequent image processing and analysis are directly affected by the quality of the processing effect.
Due to the imperfections of the imaging system, the transmission medium, and the recording device, the digital images are often contaminated by various noises during the formation, transmission, and recording processes thereof. In addition, noise may also be introduced into the resulting image at some point in the image processing when the input image object is not as expected. These noises often appear as an isolated pixel or block of pixels on the image that causes a strong visual effect. In general, the noise signal is not correlated with the object to be studied-it appears in the form of useless information, disturbing the observable information of the image. For digital image signals, the noise table is more or less extreme values, and the extreme values act on the real gray values of image pixels through addition and subtraction to cause bright and dark point interference on the image, so that the image quality is greatly reduced, and the follow-up work of image restoration, segmentation, feature extraction, image identification and the like is influenced. Two basic issues must be considered to construct an effective noise suppression filter: the noise in the target and the background can be effectively removed; meanwhile, the shape, the size and the specific geometric and topological structure characteristics of the image target can be well protected.
One of the commonly used image filtering modes is a non-linear filter, generally speaking, when the signal spectrum and the noise spectrum are mixed or when the signal contains non-superimposed noise, such as noise caused by system nonlinearity or the presence of non-gaussian noise, etc.), the conventional linear filtering techniques, such as fourier transform, while filtering out noise, always blur the image details (such as edges, etc.) in some way, thereby causing the positioning accuracy of the image linear features and the extractability of the features to be reduced. The nonlinear filter is based on a nonlinear mapping relation of an input signal, a specific noise can be mapped to be zero approximately, the main characteristic of the signal is reserved, and therefore the nonlinear filter can overcome the defects of the linear filter to a certain extent.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: Read-Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. A subtitle detour superimposition display platform, comprising:
the data extraction equipment is used for extracting data of the played video of each film to obtain each component image frame of the played video;
the caption acquisition equipment is used for searching each caption corresponding to the timestamp corresponding to each image frame;
the content superposition equipment is respectively connected with the subtitle acquisition equipment and the data extraction equipment and is used for superposing each subtitle searched by the subtitle acquisition equipment at the non-reference position of the composition image frame based on the reference position of the received composition image frame;
the content superposition device is also used for prohibiting superposition of each subtitle searched by the subtitle acquisition device at the reference position of the composition image frame;
the contrast processing equipment is connected with the data extraction equipment and used for receiving each image frame of the played video and executing contrast improvement processing on the received image near each road pile to obtain a contrast processed image;
the sharpening processing device is connected with the contrast processing device and is used for carrying out sharpening processing on the received contrast processing image so as to obtain a corresponding current sharpened image;
the filtering processing device is connected with the sharpening processing device and is used for executing maximum filtering processing on the received current sharpened image to obtain a current filtered image;
the foreground detection device is connected with the filtering processing device and used for receiving the current filtering image and stripping a foreground image area and a background image area from the current filtering image based on a preset gray threshold value;
and the area positioning device is respectively connected with the foreground detection device and the data extraction device and is used for determining a position which is consistent with the relative position in the image frame corresponding to the current filtering image based on the relative position of the background image area in the current filtering image to be used as a reference position.
2. The subtitle bypass overlay display platform of claim 1, wherein the platform further comprises:
and the display equipment is respectively connected with the sharpening processing equipment and the filtering processing equipment and is used for displaying various working parameters of the sharpening processing equipment and various working parameters of the filtering processing equipment.
3. The subtitle bypass overlay display platform of claim 2, wherein:
the display device is a liquid crystal display screen.
4. The subtitle bypass overlay display platform of claim 2, wherein:
the display equipment is an LED display screen.
5. The subtitle bypass overlay display platform of claim 2, wherein the platform further comprises:
and the touch screen is used for receiving input information of the user according to the operation of the user.
6. The subtitle bypass overlay display platform of claim 5, wherein:
the touch screen is integrated on the display device.
7. The subtitle bypass overlay display platform of claim 6, wherein:
the display device, the sharpening device, the filtering device and the touch screen are all integrated on one integrated circuit board.
8. The subtitle bypass overlay display platform of claim 7, wherein:
the area positioning device, the foreground detection device and the data extraction device share the same parameter configuration interface.
9. The subtitle bypass overlay display platform of claim 8, wherein:
the parameter configuration interface is one of an IIC control interface or a serial control interface.
10. A method of subtitle bypassing overlay display, the method comprising using a subtitle bypassing overlay display platform according to any one of claims 1-9 to bypass the character displayed in the overlay to the foreground-related region during the playing of the film.
CN201911220909.7A 2019-12-03 2019-12-03 Subtitle detour superposition display platform and method Withdrawn CN112040331A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911220909.7A CN112040331A (en) 2019-12-03 2019-12-03 Subtitle detour superposition display platform and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911220909.7A CN112040331A (en) 2019-12-03 2019-12-03 Subtitle detour superposition display platform and method

Publications (1)

Publication Number Publication Date
CN112040331A true CN112040331A (en) 2020-12-04

Family

ID=73576716

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911220909.7A Withdrawn CN112040331A (en) 2019-12-03 2019-12-03 Subtitle detour superposition display platform and method

Country Status (1)

Country Link
CN (1) CN112040331A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090273711A1 (en) * 2008-04-30 2009-11-05 Centre De Recherche Informatique De Montreal (Crim) Method and apparatus for caption production
CN101917557A (en) * 2010-08-10 2010-12-15 浙江大学 Method for dynamically adding subtitles based on video content
CN109118434A (en) * 2017-06-26 2019-01-01 南京东大智能化系统有限公司 A kind of image pre-processing method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090273711A1 (en) * 2008-04-30 2009-11-05 Centre De Recherche Informatique De Montreal (Crim) Method and apparatus for caption production
CN101917557A (en) * 2010-08-10 2010-12-15 浙江大学 Method for dynamically adding subtitles based on video content
CN109118434A (en) * 2017-06-26 2019-01-01 南京东大智能化系统有限公司 A kind of image pre-processing method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李卓: "复杂背景下的图像分割算法研究及应用", 《中国优秀硕士学位论文全文数据库(电子期刊)信息科技辑》 *

Similar Documents

Publication Publication Date Title
US7796139B1 (en) Methods and apparatus for displaying a frame with contrasting text
Yang et al. Automatic lecture video indexing using video OCR technology
US9667887B2 (en) Lens distortion method for broadcast video
US20060251335A1 (en) Image processing method, apparatus, and program
US20120206624A1 (en) Image processing method, image processing apparatus, and electronic camera
US20100080481A1 (en) 3D Depth Generation by Local Blurriness Estimation
KR20090043416A (en) Surveillance camera apparatus for detecting and suppressing camera shift and control method thereof
US20120249837A1 (en) Methods and Systems for Real-Time Image-Capture Feedback
US9111352B2 (en) Automated detection and correction of stereoscopic edge violations
GB2438689A (en) Method of detecting correction methods for feature images
CN112040331A (en) Subtitle detour superposition display platform and method
CN114202519A (en) Video flicker determination method, device, equipment and storage medium
CN111726572B (en) Instruction signal triggering-based associated personnel locking platform and method
US11233985B2 (en) Method for video quality detection and image processing circuit using the same
CN111160340B (en) Moving object detection method and device, storage medium and terminal equipment
US9607365B1 (en) Systems and methods for enhancing quality of image media
US9807339B2 (en) Frame rate conversion system
CN116168233A (en) Blackboard writing restoration method based on grid image patch classification
EP3959644A1 (en) Method, system, and computer-readable medium for removing flare in images
CN110876081A (en) Automatic audio intensity modifying method
JP2007285868A (en) Luminance gradient detection method, flaw detection method, luminance gradient detector and flaw detector
EP3101839A1 (en) Method and apparatus for isolating an active participant in a group of participants using light field information
JP3216359B2 (en) Display control device for child image
CN108717684B (en) High-speed horizontal moving object image sequence splicing method and system based on array camera
CN109688426B (en) Multimedia data editing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20201204