CN113905269A - Method and device for realizing video monitoring OSD subtitle and clock detection by using OCR technology - Google Patents

Method and device for realizing video monitoring OSD subtitle and clock detection by using OCR technology Download PDF

Info

Publication number
CN113905269A
CN113905269A CN202111170501.0A CN202111170501A CN113905269A CN 113905269 A CN113905269 A CN 113905269A CN 202111170501 A CN202111170501 A CN 202111170501A CN 113905269 A CN113905269 A CN 113905269A
Authority
CN
China
Prior art keywords
video monitoring
information
time
osd
ocr
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111170501.0A
Other languages
Chinese (zh)
Inventor
赵伟伟
孙靖宇
后欣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Qishu Intelligent System Co ltd
Original Assignee
Nanjing Qishu Intelligent System Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Qishu Intelligent System Co ltd filed Critical Nanjing Qishu Intelligent System Co ltd
Priority to CN202111170501.0A priority Critical patent/CN113905269A/en
Publication of CN113905269A publication Critical patent/CN113905269A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331Caching operations, e.g. of an advertisement for later insertion during playback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4884Data services, e.g. news ticker for displaying subtitles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8547Content authoring involving timestamps for synchronizing content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a method and a device for realizing video monitoring OSD subtitle and clock detection by using an OCR technology. The method for realizing video monitoring OSD subtitle and clock detection by using OCR technology comprises the following steps: the method comprises the steps of obtaining a video monitoring information list, obtaining a real-time video stream, carrying out screenshot on the video stream, simultaneously obtaining time of a local server or an NTP server, splitting the screenshot again according to GA/T751-2008 standard, identifying the screenshot by an OCR engine, simultaneously comparing and judging the identified time and the server time, and carrying out detection and judgment on identified address information and equipment basic information. The invention applies OCR recognition to the detection of the video monitoring OSD subtitles, thereby being capable of efficiently solving the detection of the video monitoring OSD subtitles with lower cost. In addition, the method for judging the position of the OSD subtitles is realized by a picture splitting mode.

Description

Method and device for realizing video monitoring OSD subtitle and clock detection by using OCR technology
Technical Field
The invention relates to the technical field of computers, in particular to a method and a device for realizing video monitoring OSD subtitle and clock detection by using an OCR technology.
Background
With the development of video monitoring technology, the number of video monitoring is continuously increased, and the video monitoring OSD subtitle and hour hand management is insufficient. The traditional video monitoring operation and maintenance system cannot accurately control OSD subtitles and hour hands, only can directly connect the devices SDK for management, and is high in management cost.
Disclosure of Invention
The invention aims to overcome the defects in the prior art and provides a method and a device for realizing video monitoring OSD caption and clock detection by using an OCR technology.
The technical scheme of the invention is as follows:
the method for realizing video monitoring OSD subtitle and clock detection by using OCR technology comprises the following steps:
the GB platform docking module acquires a video monitoring information list from the video networking platform through a GB/T28181-2016 protocol;
acquiring real-time video stream of video monitoring through a video networking platform according to the acquired video monitoring information list;
the video stream screenshot module performs frame extraction on the acquired real-time video stream, intercepts a picture and outputs a picture screenshot;
splitting the acquired screenshot into three screenshots, namely an upper right region, a lower right region and a lower right region according to the specification of an OSD subtitle in the GA/T751-2008 standard, wherein each screenshot contains position information of the subtitle in a default manner;
the three screenshots are transmitted into an OCR recognition engine module for recognition, and recognition results are cached respectively;
respectively detecting and judging subtitle information according to the OCR recognition result, comparing and judging the recognition result of the lower right region with the administrative division and the installation address corresponding information of the equipment, and comparing and judging the information of the lower left region with the equipment installation direction and the equipment PTZ information corresponding information of the equipment;
and judging the time format according to the result of OCR recognition of the upper right corner time area.
The video monitoring information list comprises equipment numbers, equipment names, administrative regions to which the equipment belongs, equipment installation addresses, equipment installation directions and equipment installation PTZ information.
Preferably, when the obtained real-time video stream is subjected to frame extraction and a picture is captured, a picture screenshot is output; and acquiring current standard time information through the NTP service module.
The upper right area is a time information area, the lower right area is an administrative division and an address area, and the lower left area is an additional information area.
Preferably, when the time format is judged according to the result of OCR recognition of the upper right corner time area; and comparing with the NTP time to check whether the time is within the allowable error range.
Preferably, the recognition result analysis module collects and outputs the detection results to form the detection results, and the detection results are displayed in a unified manner by the result display module.
Utilize OCR technique to realize video monitoring OSD caption and clock detection's device, include:
GB platform butt joint module: the device is responsible for acquiring a device list and acquiring a real-time video stream through a GB/T28181-2016 protocol;
video stream screenshot module: the system is responsible for intercepting pictures from a video stream and splitting and capturing the pictures according to the OSD requirement of GA/T751-2008;
NTP service module: the network node is responsible for providing NTP service and acquiring NTP service standard time;
an OCR recognition engine module: the system is responsible for identifying text information in the picture and outputting the text information through a structured text;
the identification result analysis module: the OCR recognition device is responsible for carrying out matching analysis on OCR recognition results and related information of equipment and outputting detection results;
and a result display module: the server is responsible for uniformly displaying the identified result in a web page mode;
a data storage module: and storing the uniformly displayed data.
The invention has the beneficial effects that: the invention applies OCR recognition to the detection of the video monitoring OSD subtitles, thereby being capable of efficiently solving the detection of the video monitoring OSD subtitles with lower cost. In addition, the method for judging the position of the OSD subtitles is realized by a picture splitting mode.
Drawings
FIG. 1 is a flow chart of a method for implementing video monitoring OSD caption and clock detection by using OCR technology;
FIG. 2 is a schematic diagram of the OSD caption request in GA/T751-2008 standard;
FIG. 3 is a schematic view of monitoring frame segmentation;
fig. 4 is a frame diagram of a device for realizing video monitoring OSD caption and clock detection by using the OCR technology.
Detailed Description
For a better understanding of the invention, reference will now be made to the following examples and accompanying drawings.
Example 1:
as shown in fig. 1 to 4, the method for implementing video monitoring OSD subtitle and clock detection by using OCR technology includes the following steps:
s01, the GB platform docking module acquires a video monitoring information list from the video networking platform through a GB/T28181-2016 protocol;
s02, acquiring real-time video stream of video monitoring through a video networking platform according to the acquired video monitoring information list;
s03, the video stream screenshot module frames the acquired real-time video stream and intercepts the picture, and outputs a picture screenshot;
s04, splitting the acquired screenshot into three screenshots, namely an upper right region, a lower right region and a lower right region according to the specification of the OSD subtitle in the GA/T751-2008 standard, wherein each screenshot contains the position information of the subtitle in a default manner;
s05, transmitting the three screenshots into an OCR recognition engine module for recognition, and caching the recognition results respectively;
s06, respectively detecting and judging subtitle information according to the OCR recognition result, comparing and judging the recognition result of the lower right region with the administrative division and the installation address corresponding information of the equipment, and comparing and judging the information of the lower left region with the equipment installation direction and the equipment PTZ information corresponding information of the equipment;
and S07, judging the time format according to the result of the OCR recognition of the upper right corner time area.
Specifically, the video monitoring information list includes a device number, a device name, an administrative area to which the device belongs, a device installation address, a device installation direction, and device installation PTZ information.
Because the image of the video monitoring is greatly influenced by light, certain interference exists on the recognition effect of the OCR, the images can be respectively captured in three time periods of morning, noon and evening for the video monitoring, and the readiness of the OSD can be comprehensively judged according to the captured image of each time period.
Preferably, step S03 is performed simultaneously; step S03' is performed: and acquiring current standard time information through the NTP service module.
Specifically, as shown in fig. 2, the upper right area is a time information area, the lower right area is an administrative division and address area, and the lower left area is an additional information area.
Preferably, step S06 is executed while step S06': and comparing with the NTP time to check whether the time is within the allowable error range.
Preferably, the recognition result analysis module collects and outputs the detection results to form the detection results, and the detection results are displayed in a unified manner by the result display module.
Example 2:
as shown in fig. 4, the apparatus for implementing video monitoring OSD caption and clock detection by using OCR technology includes:
GB platform butt joint module: the device is responsible for acquiring a device list and acquiring a real-time video stream through a GB/T28181-2016 protocol;
video stream screenshot module: the system is responsible for intercepting pictures from a video stream and splitting and capturing the pictures according to the OSD requirement of GA/T751-2008;
NTP service module: the network node is responsible for providing NTP service and acquiring NTP service standard time;
an OCR recognition engine module: the system is responsible for identifying text information in the picture and outputting the text information through a structured text;
the identification result analysis module: the OCR recognition device is responsible for carrying out matching analysis on OCR recognition results and related information of equipment and outputting detection results;
and a result display module: the server is responsible for uniformly displaying the identified result in a web page mode;
a data storage module: and storing the uniformly displayed data.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, so any modifications, equivalents or improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims (7)

1. The method for realizing video monitoring OSD subtitle and clock detection by using OCR technology is characterized by comprising the following steps: the method comprises the following steps: the GB platform docking module acquires a video monitoring information list from the video networking platform through a GB/T28181-2016 protocol;
acquiring real-time video stream of video monitoring through a video networking platform according to the acquired video monitoring information list;
the video stream screenshot module performs frame extraction on the acquired real-time video stream, intercepts a picture and outputs a picture screenshot;
splitting the acquired screenshot into three screenshots, namely an upper right region, a lower right region and a lower right region according to the specification of an OSD subtitle in the GA/T751-2008 standard, wherein each screenshot contains position information of the subtitle in a default manner;
the three screenshots are transmitted into an OCR recognition engine module for recognition, and recognition results are cached respectively;
respectively detecting and judging subtitle information according to the OCR recognition result, comparing and judging the recognition result of the lower right region with the administrative division and the installation address corresponding information of the equipment, and comparing and judging the information of the lower left region with the equipment installation direction and the equipment PTZ information corresponding information of the equipment;
and judging the time format according to the result of OCR recognition of the upper right corner time area.
2. The method for implementing video monitoring OSD caption and clock detection by using OCR technology as claimed in claim 1, wherein: the video monitoring information list comprises equipment numbers, equipment names, administrative regions to which the equipment belongs, equipment installation addresses, equipment installation directions and equipment installation PTZ information.
3. The method for implementing video monitoring OSD caption and clock detection by using OCR technology as claimed in claim 1, wherein: when the obtained real-time video stream is subjected to frame extraction and a picture is captured, outputting a picture screenshot; and acquiring current standard time information through the NTP service module.
4. The method for implementing video monitoring OSD caption and clock detection by using OCR technology as claimed in claim 1, wherein: the upper right area is a time information area, the lower right area is an administrative division and an address area, and the lower left area is an additional information area.
5. A method for implementing video monitoring OSD caption and clock detection using OCR technology as recited in claim 3 wherein: judging the time format according to the OCR recognition result of the upper right corner time area; and comparing with the NTP time to check whether the time is within the allowable error range.
6. The method for implementing video monitoring OSD caption and clock detection by using OCR technology as claimed in claim 5, wherein the method comprises the following steps: and the recognition result analysis module collects and outputs the detection results to form detection results, and the detection results are displayed in a unified manner by the result display module.
7. Utilize OCR technique to realize video monitoring OSD caption and clock detection's device, its characterized in that: the method comprises the following steps:
GB platform butt joint module: the device is responsible for acquiring a device list and acquiring a real-time video stream through a GB/T28181-2016 protocol;
video stream screenshot module: the system is responsible for intercepting pictures from a video stream and splitting and capturing the pictures according to the OSD requirement of GA/T751-2008;
NTP service module: the network node is responsible for providing NTP service and acquiring NTP service standard time;
an OCR recognition engine module: the system is responsible for identifying text information in the picture and outputting the text information through a structured text;
the identification result analysis module: the OCR recognition device is responsible for carrying out matching analysis on OCR recognition results and related information of equipment and outputting detection results;
and a result display module: the server is responsible for uniformly displaying the identified result in a web page mode;
a data storage module: and storing the uniformly displayed data.
CN202111170501.0A 2021-10-08 2021-10-08 Method and device for realizing video monitoring OSD subtitle and clock detection by using OCR technology Pending CN113905269A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111170501.0A CN113905269A (en) 2021-10-08 2021-10-08 Method and device for realizing video monitoring OSD subtitle and clock detection by using OCR technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111170501.0A CN113905269A (en) 2021-10-08 2021-10-08 Method and device for realizing video monitoring OSD subtitle and clock detection by using OCR technology

Publications (1)

Publication Number Publication Date
CN113905269A true CN113905269A (en) 2022-01-07

Family

ID=79190350

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111170501.0A Pending CN113905269A (en) 2021-10-08 2021-10-08 Method and device for realizing video monitoring OSD subtitle and clock detection by using OCR technology

Country Status (1)

Country Link
CN (1) CN113905269A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111126378A (en) * 2019-11-18 2020-05-08 杭州亿圣信息技术有限公司 Method for extracting video OSD and reconstructing coverage area
CN111612088A (en) * 2020-05-28 2020-09-01 北京轨道交通路网管理有限公司 Method and device for detecting image of superimposed character
CN111818277A (en) * 2020-06-24 2020-10-23 重庆山淞信息技术有限公司 Character superposition method and device for video image, computer equipment and storage medium
CN111898605A (en) * 2020-08-28 2020-11-06 四川长虹网络科技有限责任公司 Set top box information detection method and system based on image OCR recognition
CN112232354A (en) * 2020-11-23 2021-01-15 中国第一汽车股份有限公司 Character recognition method, device, equipment and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111126378A (en) * 2019-11-18 2020-05-08 杭州亿圣信息技术有限公司 Method for extracting video OSD and reconstructing coverage area
CN111612088A (en) * 2020-05-28 2020-09-01 北京轨道交通路网管理有限公司 Method and device for detecting image of superimposed character
CN111818277A (en) * 2020-06-24 2020-10-23 重庆山淞信息技术有限公司 Character superposition method and device for video image, computer equipment and storage medium
CN111898605A (en) * 2020-08-28 2020-11-06 四川长虹网络科技有限责任公司 Set top box information detection method and system based on image OCR recognition
CN112232354A (en) * 2020-11-23 2021-01-15 中国第一汽车股份有限公司 Character recognition method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
EP2688296B1 (en) Video monitoring system and method
WO2017041366A1 (en) Method and device for image recognition
CN107133578B (en) Facial expression recognition method and system based on file transmission
CN111428083A (en) Video monitoring warning method, device, equipment and storage medium
CN101500128B (en) Method and apparatus for loading additional information on display image of network camera device terminal
CN109413760B (en) Wireless connection method and device
WO2021093653A1 (en) Security method, apparatus and system easy to access by user
CN107484002A (en) The method of intelligent translation captions
CN110740289B (en) System and method for acquiring alarm
CN111753743A (en) Face recognition method and system based on gatekeeper
CN116580362B (en) Transmission operation cross-system fusion data acquisition method and digital asset processing system
CN114419502A (en) Data analysis method and device and storage medium
CN113905269A (en) Method and device for realizing video monitoring OSD subtitle and clock detection by using OCR technology
US11265594B2 (en) Data processing method and device, storage medium, electronic device
CN110830763A (en) Monitoring video inspection method and device
CN106775701B (en) Client automatic evidence obtaining method and system
CN115147752A (en) Video analysis method and device and computer equipment
CN112685128B (en) Live image pornography detection and image filtering method
CN110381022B (en) Data acquisition method and system applied to video network
CN110381038B (en) Information verification method and system based on video network
KR20180033954A (en) Safety Management Method and System for a Gas Facilities with Analog Gauge using the Image Processing
TWI482470B (en) Digital signage playback system, real-time monitoring system, and real-time monitoring method thereof
CN113158842A (en) Identification method, system, device and medium
CN115373550B (en) Method, system and chip for obtaining interaction information
CN109409104B (en) Interface display method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination