CN110730355A - Video image processing method and device - Google Patents
Video image processing method and device Download PDFInfo
- Publication number
- CN110730355A CN110730355A CN201910840631.7A CN201910840631A CN110730355A CN 110730355 A CN110730355 A CN 110730355A CN 201910840631 A CN201910840631 A CN 201910840631A CN 110730355 A CN110730355 A CN 110730355A
- Authority
- CN
- China
- Prior art keywords
- video image
- watermark
- video
- image
- user information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/835—Generation of protective data, e.g. certificates
- H04N21/8358—Generation of protective data, e.g. certificates involving watermark
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Editing Of Facsimile Originals (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The present disclosure provides a video image processing method and device, relating to the technical field of computer images, wherein the method comprises the following steps: inquiring user information of the video image, wherein the user information is used for generating a watermark pattern; acquiring original information of the video image; wherein the original information of the video at least comprises: size, encoding format of the video image; generating a watermark image comprising a watermark image according to the user information and the original information of the video; the size and the encoding format of the watermark image are the same as those of the video image; and overlaying the watermark image into the video image.
Description
Technical Field
The present disclosure relates to the field of computer image technologies, and in particular, to a video image processing method and apparatus.
Background
In some security scenarios, such as the core department of a commercial institution and the security department related to national confidentiality, the internal local area network and the internet are in an isolated state, and external interfaces such as usb ports and serial ports of related devices are also physically closed. Therefore, the confidential files cannot be flowed out through a network, a peripheral and the like.
Although this method can effectively protect data files, it has a certain limitation to the protection of video files. This is because video files can be streamed by taking pictures and recording videos, and since portable devices such as smartphones are highly popular, it is not uncommon for a secret to be revealed by obtaining videos by taking pictures and recording videos.
Disclosure of Invention
The embodiment of the disclosure provides a video image processing method and device, which can solve the problem that the current portable devices such as smart phones are highly popularized, and the video is acquired in modes such as photographing and recording, so that the secret leakage is caused. The technical scheme is as follows:
according to a first aspect of the embodiments of the present disclosure, there is provided a video image processing method, including:
inquiring user information of the video image, wherein the user information is used for generating a watermark pattern;
acquiring original information of the video image; wherein the original information of the video at least comprises: size, encoding format of the video image;
generating a watermark image comprising a watermark image according to the user information and the original information of the video; the size and the encoding format of the watermark image are the same as those of the video image;
and overlaying the watermark image into the video image.
In one embodiment, the user information includes at least one of: hardware information of the device, currently logged-in user name, system time and place.
In one embodiment, the hardware information of the device includes: CPU serial number and/or hard disk serial number.
In one embodiment, the watermark image is a plain watermark or a dark-line watermark.
In one embodiment, before querying the user information of the video image, the method further comprises:
monitoring a decoder starting program, and if the decoder starting program is monitored, triggering the step of inquiring the user information of the video image.
According to a second aspect of the embodiments of the present disclosure, there is provided a video image processing apparatus including:
the query unit is used for querying user information of the video image, wherein the user information is used for generating a watermark graph;
an acquisition unit for acquiring original information of the video image; wherein the original information of the video at least comprises: size, encoding format of the video image;
the generating unit is used for generating a watermark image comprising a watermark image according to the user information and the original information of the video; the size and the encoding format of the watermark image are the same as those of the video image;
and the superposition unit is used for superposing the watermark image to the video image.
In one embodiment, the user information includes at least one of: hardware information of the device, currently logged-in user name, system time and place.
In one embodiment, the hardware information of the device includes: CPU serial number and/or hard disk serial number.
In one embodiment, the watermark image is a plain watermark or a dark-line watermark.
In an embodiment, the apparatus further includes a monitoring unit, configured to monitor a decoder start-up program before querying the user information of the video image, and trigger a step of querying the user information of the video image if the decoder start-up program is monitored.
In the present disclosure, a video image output by a video player may be captured, and a watermark pattern generated according to specific information may be synthesized with the video image, so that the video image played by the video player includes the watermark pattern, where the specific information for generating the watermark pattern refers to related information, such as a device code, a name, an address, and the like, that can be found for a user viewing the video image.
Therefore, each frame of video image shot by the user through modes of video recording, picture taking and the like comprises the watermark image, once the user spreads the shot video to other people, the user playing the video can be found according to the watermark image in the leaked video image. The method not only can play a role in deterring the intended divulging person, but also can trace the divulging person through the watermark pattern after the divulging action occurs.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flowchart of a video image processing method provided by an embodiment of the present disclosure;
fig. 2 is a schematic diagram of video image processing provided by the embodiment of the present disclosure;
fig. 3 is a schematic diagram of video image processing provided by the embodiment of the present disclosure;
fig. 4 is a block diagram of a video image processing apparatus provided in an embodiment of the present disclosure;
fig. 5 is a block diagram of a video image processing apparatus according to an embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The embodiment of the present disclosure provides a video image processing method, as shown in fig. 1, the video image processing method includes the following steps:
the user information includes at least one of: hardware information of the device, currently logged-in user name, system time and place.
The hardware information of the device includes: CPU serial number and/or hard disk serial number.
102, acquiring original information of the video image; wherein the original information of the video at least comprises: size, encoding format of the video image;
103, generating a watermark image comprising a watermark pattern according to the user information and the original information of the video; the size and the encoding format of the watermark image are the same as those of the video image;
wherein, the watermark image is a plain text watermark or a dark stripe watermark.
And step 104, overlaying the watermark image to the video image.
Taking a Windows system as an example for explanation, as shown in fig. 2 and fig. 3, the processing flow is as follows:
step 1, after the application program is started, the hook main process (exe format file) can load a hook library (DLL format file) into the process of the started application program.
The hook main process is responsible for loading a hook library (dll format file) into each process.
It should be noted that the hook library is set in advance and is used for determining whether each process is a player process.
The functions of the hook main process and the hook library are both ensured by a Windows hook mechanism.
Step 2, the hook library judges whether the process is a player process according to the starting parameters of the process; if so, starting an injection library (a file in dll format) and injecting the injection library into the player process.
Specifically, after the dll is loaded into the Player process, a process start parameter can be obtained through an Application Programming Interface (API), for example, the Windows self-contained Player WMPlayer has a start parameter of "C: \\ Program Files (x86) \ Windows Media Player \ WMPlayer.
And 3, operating the injection library in the player process, monitoring a decoder starting program, if the decoder starting program is found, indicating that the decoder is started, and executing the step 4.
And 4, injecting the video image output by the library interception decoder, and overlapping the watermark image which is generated in advance and comprises the watermark image in the video image.
Specifically, the following describes the operation steps of the player process:
firstly, a player acquires a video source;
secondly, the player separates the video and audio information in the video source through a source separator and provides the video information to a video decoder;
thirdly, the video decoder decodes the video information to generate a video image and sends the video image to the video renderer;
fourth, the video renderer renders the received video images to an output device, such as a display or the like.
It should be noted that, after the injecting library is injected into the player process and the decoder is detected to be started, first, through an interface provided by the operating system, hardware information (cpu serial number, hard disk serial number), a currently logged user name, system time, location, and the like of the device are queried to obtain user information required for generating a watermark pattern, such as a hardware serial number (hardware identifier), a logged user name, system time, location, and the like; then, the original information of the video, such as the size and the encoding format (nv12, yuv422, etc.) of the output video image, is read from the decoder, and then, a watermark image including a watermark pattern is generated based on the user information and the original information of the video, and it can be understood that the size and the encoding format of the image are the same as those of the decoder output image.
It should be noted that, through the interface provided by the operating system, the hardware information (cpu serial number, hard disk serial number), the currently logged-in user name, system time, location, and the like of the device are queried, which is guaranteed by the characteristics of the operating system.
And 5, outputting the video image with the superposed watermark image to a video renderer in the injection storage.
And 6, rendering the received video image with the superimposed watermark image to output equipment by the video renderer.
In this way, each frame of video image in the video viewed by the user from the input device is the video image superimposed with the watermark image.
It should be noted that the watermark image may be a plain watermark or a dark watermark. It can be understood that the watermark images in the present disclosure are superimposed during the video playing process, and do not modify the video source itself.
In addition, even in the same video source, when the logged-in user name, or the playing device, or the playing place, or the playing time is changed, the generated watermark images are different.
Therefore, if the video is leaked, the user name, the place, the video watching time and other information of the divulger can be obtained only by obtaining the video image superposed with the watermark image, and then the divulger can be quickly traced back, and the effective warning effect can be provided for other users.
In practical applications, the processing flow in the block of fig. 2 may be implemented by Media Foundation, and the present disclosure may be improved based on the Media Foundation.
The video decoder based on the MediaFoundation platform is essentially a COM component, and the COM component is created by a CoCreateInstance function, which is a Windows system characteristic guarantee.
Coccreateinstance function prototype:
STDAPI CoCreateInstance(
REFCLSID rclsid,// class identifier of Com object Created (CLSID)
LPUNKNOWN pUnkOuter,// pointer to interface IUnknown
DWORD dwClsContext,// running context for executable code
REFEID riid,// interface identifier of Com object created
LPVOID ppv// used for receiving pointer variable pointing to Com object interface address
)；
Wherein rclsid represents the unique identification of creating the COM component, ppv is the object of the created COM component, and the creation process of all components in the process can be monitored by injecting a CoCreateInstance function.
When the system creates the decoder component, the proxy class compatible with the COM component interface of the decoder is created to replace the original COM component and is provided for the player, all calls to the decoder of the subsequent player can be captured through the proxy class, and therefore behavior monitoring of the decoder is achieved.
The proxy class provides a corresponding interface of the decoder, the proxy class has a function of the real-time proxy class called when the system calls the function of the decoder, and the proxy class transmits corresponding parameters to the decoder to realize real function calling.
This process is called proxy injection.
The encoder implemented interface contains two virtual functions:
STDMETHODIMP SetOutputType(DWORD dwOutputStreamID,IMFMediaType*pType,DWORD dwFlags)；
STDMETHODIMP ProcessMessage(MFT_MESSAGE_TYPE eMessage,ULONG_PTRulParam)；
wherein, in the process of the SetOutputType function call, the video format data (such as video size, etc.) can be inquired through the pType parameter.
The ProcessMessage function generates final video image data, and the message parameter stores image data in a fixed format (NV12, YV12, etc.). And overlaying the generated watermark image with the generated watermark image, then covering the image data stored in the eAccess parameter, and rendering the data to an output device to realize the real-time overlaying function of the watermark.
Media Foundation is a new generation of multimedia application library launched by microsoft on Windows Vista, and aims to provide a unified multimedia video solution for Windows platform, and developers can play video or sound files, transcode multimedia file formats, or encode a series of pictures into video, etc. through Media Foundation. Windows Media Player, etc. is written using the Media Foundation framework.
Fig. 4 discloses a video image processing apparatus, the apparatus 40 comprising:
an inquiring unit 401, configured to inquire user information of the video image, where the user information is used to generate a watermark pattern;
an obtaining unit 402, configured to obtain original information of the video image; wherein the original information of the video at least comprises: size, encoding format of the video image;
a generating unit 403, configured to generate a watermark image including a watermark pattern according to the user information and original information of the video; the size and the encoding format of the watermark image are the same as those of the video image;
an overlaying unit 404, configured to overlay the watermark image into the video image.
In one embodiment, the user information includes at least one of: hardware information of the device, currently logged-in user name, system time and place.
In one embodiment, the hardware information of the device includes: CPU serial number and/or hard disk serial number.
In one embodiment, the watermark image is a plain watermark or a dark-line watermark.
Fig. 5 discloses a video image processing apparatus, the apparatus 50 comprising:
an inquiring unit 501, configured to inquire user information of the video image, where the user information is used to generate a watermark pattern;
an obtaining unit 502, configured to obtain original information of the video image; wherein the original information of the video at least comprises: size, encoding format of the video image;
a generating unit 503, configured to generate a watermark image including a watermark pattern according to the user information and original information of the video; the size and the encoding format of the watermark image are the same as those of the video image;
an overlaying unit 504, configured to overlay the watermark image into the video image.
In one embodiment, the user information includes at least one of: hardware information of the device, currently logged-in user name, system time and place.
In one embodiment, the hardware information of the device includes: CPU serial number and/or hard disk serial number.
In one embodiment, the watermark image is a plain watermark or a dark-line watermark.
And a monitoring unit 505, configured to monitor a decoder start-up program before querying the user information of the video image, and trigger a step of querying the user information of the video image if the decoder start-up program is monitored.
Based on the video image processing method described in the embodiment corresponding to fig. 1, an embodiment of the present disclosure further provides a computer-readable storage medium, for example, the non-transitory computer-readable storage medium may be a Read Only Memory (ROM), a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. The storage medium stores computer instructions for executing the video image processing method described in the embodiment corresponding to fig. 1, which is not described herein again.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
Claims (10)
1. A method for video image processing, the method comprising:
inquiring user information of the video image, wherein the user information is used for generating a watermark pattern;
acquiring original information of the video image; wherein the original information of the video at least comprises: size, encoding format of the video image;
generating a watermark image comprising a watermark image according to the user information and the original information of the video; the size and the encoding format of the watermark image are the same as those of the video image;
and overlaying the watermark image into the video image.
2. The video image processing method according to claim 1, wherein the user information includes at least one of: hardware information of the device, currently logged-in user name, system time and place.
3. The video image processing method according to claim 1, wherein the hardware information of the device includes: CPU serial number and/or hard disk serial number.
4. The video image processing method according to claim 1, wherein the watermark image is a plain watermark or a dark-line watermark.
5. The video image processing method according to claim 1, wherein before querying user information of the video image, the method further comprises:
monitoring a decoder starting program, and if the decoder starting program is monitored, triggering the step of inquiring the user information of the video image.
6. A video image processing apparatus, characterized in that the apparatus comprises:
the query unit is used for querying user information of the video image, wherein the user information is used for generating a watermark graph;
an acquisition unit for acquiring original information of the video image; wherein the original information of the video at least comprises: size, encoding format of the video image;
the generating unit is used for generating a watermark image comprising a watermark image according to the user information and the original information of the video; the size and the encoding format of the watermark image are the same as those of the video image;
and the superposition unit is used for superposing the watermark image to the video image.
7. The video image processing apparatus according to claim 5, wherein the user information includes at least one of: hardware information of the device, currently logged-in user name, system time and place.
8. The video image processing apparatus according to claim 6, wherein the hardware information of the device includes: CPU serial number and/or hard disk serial number.
9. The video image processing apparatus according to claim 6, wherein the watermark image is a plain watermark or a dark-line watermark.
10. The video image processing apparatus according to claim 6, further comprising a monitoring unit, configured to monitor a decoder start-up procedure before querying the user information of the video image, and trigger the step of querying the user information of the video image if the decoder start-up procedure is monitored.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910840631.7A CN110730355A (en) | 2019-09-06 | 2019-09-06 | Video image processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910840631.7A CN110730355A (en) | 2019-09-06 | 2019-09-06 | Video image processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110730355A true CN110730355A (en) | 2020-01-24 |
Family
ID=69217862
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910840631.7A Pending CN110730355A (en) | 2019-09-06 | 2019-09-06 | Video image processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110730355A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114598938A (en) * | 2022-03-30 | 2022-06-07 | 合肥高维数据技术有限公司 | Video invisible watermark embedding method and system based on GPU |
| CN115396742A (en) * | 2022-07-11 | 2022-11-25 | 浙江大华系统工程有限公司 | Video watermark superposition method and device, computer equipment and storage medium |
| CN117556395A (en) * | 2024-01-10 | 2024-02-13 | 北京天空卫士网络安全技术有限公司 | System application watermark generation method and device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101917611A (en) * | 2010-08-31 | 2010-12-15 | 北京德博正业科技有限公司 | Video output device capable of tracking propagating sources |
| CN105872704A (en) * | 2015-12-15 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Video playing control method and device |
| CN107423629A (en) * | 2017-04-12 | 2017-12-01 | 李晓妮 | A kind of anti-method and system divulged a secret with tracing of fileinfo output |
| CN109727180A (en) * | 2019-01-03 | 2019-05-07 | 成都宇飞信息工程有限责任公司 | A kind of screen message leakage traceability system and retroactive method |
| CN109743641A (en) * | 2019-01-23 | 2019-05-10 | 武汉烽火众智智慧之星科技有限公司 | The method and system of monitor video superposition watermark |
| CN110198492A (en) * | 2019-04-28 | 2019-09-03 | 腾讯科技（深圳）有限公司 | A kind of watermark adding method of video, device, equipment and storage medium |
-
2019
- 2019-09-06 CN CN201910840631.7A patent/CN110730355A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101917611A (en) * | 2010-08-31 | 2010-12-15 | 北京德博正业科技有限公司 | Video output device capable of tracking propagating sources |
| CN105872704A (en) * | 2015-12-15 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Video playing control method and device |
| CN107423629A (en) * | 2017-04-12 | 2017-12-01 | 李晓妮 | A kind of anti-method and system divulged a secret with tracing of fileinfo output |
| CN109727180A (en) * | 2019-01-03 | 2019-05-07 | 成都宇飞信息工程有限责任公司 | A kind of screen message leakage traceability system and retroactive method |
| CN109743641A (en) * | 2019-01-23 | 2019-05-10 | 武汉烽火众智智慧之星科技有限公司 | The method and system of monitor video superposition watermark |
| CN110198492A (en) * | 2019-04-28 | 2019-09-03 | 腾讯科技（深圳）有限公司 | A kind of watermark adding method of video, device, equipment and storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114598938A (en) * | 2022-03-30 | 2022-06-07 | 合肥高维数据技术有限公司 | Video invisible watermark embedding method and system based on GPU |
| CN115396742A (en) * | 2022-07-11 | 2022-11-25 | 浙江大华系统工程有限公司 | Video watermark superposition method and device, computer equipment and storage medium |
| CN117556395A (en) * | 2024-01-10 | 2024-02-13 | 北京天空卫士网络安全技术有限公司 | System application watermark generation method and device |
| CN117556395B (en) * | 2024-01-10 | 2024-04-19 | 北京天空卫士网络安全技术有限公司 | System application watermark generation method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110730355A (en) | Video image processing method and device | |
| EP3557864A1 (en) | Method and apparatus for image display using privacy masking | |
| Xu et al. | Stealthy video capturer: a new video-based spyware in 3g smartphones | |
| US20170127151A1 (en) | Method and Device for Protecting Video Digital Copyrights | |
| US10461944B2 (en) | Challenge-response method and associated computing device | |
| WO2016026532A1 (en) | User authentication using a randomized keypad over a drm secured video path | |
| KR102340358B1 (en) | Software development kit for capturing graphical image data | |
| US10339283B2 (en) | System and method for creating, processing, and distributing images that serve as portals enabling communication with persons who have interacted with the images | |
| WO2017215148A1 (en) | File protection method and device | |
| CN112307528B (en) | Safe processing method and device for electronic document | |
| CN109840058A (en) | Cloud game collecting method and system | |
| WO2013006497A2 (en) | Thwarting unauthorized content copying using media tracking code | |
| CN109255249B (en) | Image generation method, image generation apparatus, image display method, image display apparatus, and storage medium | |
| US7738677B2 (en) | Efficient application of video marking technologies | |
| KR101564421B1 (en) | Device and method of processing videos | |
| CN112492248B (en) | Video verification method and device | |
| CN111866514B (en) | Method and device for compressing video and decompressing video | |
| CN114245053A (en) | Video watermark generation method and device | |
| CN114004726A (en) | Watermark display method, watermark display device, computer equipment and storage medium | |
| CN113438549A (en) | Processing method and device for adding watermark to video | |
| CN105898459A (en) | Play method and device and mobile terminal equipment based on Android platform | |
| CN112434327A (en) | Information protection method and device and electronic equipment | |
| CN107085689B (en) | Method and device for carrying out encryption protection on picture resources in Flash | |
| CN111885395B (en) | Video monitoring method, device and system | |
| KR20180059104A (en) | Method and apparatus for protecting image at 3d contents service |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200124 |
|
| RJ01 | Rejection of invention patent application after publication |