CN106454368A - Method for superposing watermark in video image and device thereof - Google Patents
Method for superposing watermark in video image and device thereof Download PDFInfo
- Publication number
- CN106454368A CN106454368A CN201610919875.0A CN201610919875A CN106454368A CN 106454368 A CN106454368 A CN 106454368A CN 201610919875 A CN201610919875 A CN 201610919875A CN 106454368 A CN106454368 A CN 106454368A
- Authority
- CN
- China
- Prior art keywords
- watermark
- video
- nal unit
- superimposed
- superposition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Editing Of Facsimile Originals (AREA)
Abstract
The invention discloses a method for superposing a watermark in a video image and a device thereof. After a media forwarding server receives video code streams requested by a decoding end, an NAL unit including a superposing watermark identifier is searched in the video code streams; and the NAL unit including the superposing watermark identifier is decoded, watermark superposing is performed on the video image obtained through decoding, and then the video image after completion of watermark superposing is coded into a new NAL unit again to be forwarded to the decoding end. The device comprises a searching module and a watermark superposing module. According to the method and the device, tracking and leak stopping can be effectively performed in outflow of the video image, and the superposing watermark identifier is arranged so that correct decoding of the illegally intercepted video code streams can be prevented.
Description
Technical field
The invention belongs to field of video monitoring, in more particularly, to a kind of video image, it is superimposed the method and device of watermark.
Background technology
With the development of Video Supervision Technique, video monitoring is widely used in all trades and professions, special at some
Field of video monitoring in, people increasingly pay attention to it is common practice to folded in video image to the security of video image
The watermark of add operation person's name, so when video image outflows can by video image in the watermark information of operator's name chase after
Investigate and let people, for preventing the outflow of sensitive video frequency image.
The method that prior art is superimposed watermark in video image be decoding end by way of software decodes to video
Image is superimposed watermark after being decoded, that is, decoding end after the video code flow receiving coding side transmission, first to receiving
Video code flow carries out packet and unpacks, spells frame, decoding, the video and graph compound watermark then decoding being obtained, then will be superimposed water
Video image after print is delivered to display device and is shown.
Although prior art can be superimposed watermark in video image, it is necessary that prior art is superimposed watermark in video image
Decoded by software and realize, be superimposed watermark therefore when video image is by wall in hard solution it is impossible in video image.In addition such as
Fruit is decoded after decoding end directly intercepts video code flow by other softwares, then passing through to decode the video image obtaining is to compile
The raw video image that code end generates, is not superimposed watermark, and therefore prior art cannot be completely secured the safety of video image.
Content of the invention
It is an object of the invention to provide being superimposed the method and device of watermark in a kind of video image, existed with solving prior art
Video image passes through hard to solve during upper wall it is impossible to superposition watermark and directly intercept coding side in decoding end and send in video image
Video code flow after be decoded, the video image obtaining is not superimposed the problem of watermark.
To achieve these goals, technical solution of the present invention is as follows：
A kind of method being superimposed watermark in video monitoring image, is applied to video monitoring system, described video monitoring system
Including media forwarding server and decoding end, the method for superposition watermark in described video monitoring image, including：
After media forwarding server receives the video code flow that decoding end is asked, search bag from described video code flow
Include the NAL unit of superposition watermark identifier；
The NAL unit including superposition watermark identifier is decoded, the video image that decoding is obtained carries out watermark superposition,
Then it is re-encoded as after new NAL unit being transmitted to decoding end by completing the video image after watermark superposition.
Further, described media forwarding server is set up watermark information mapping table, described decoding is obtained
Video image carries out watermark superposition, including：
Source IP address/port numbers according to video code flow and purpose IP address/port, inquire about watermark information mapping relations
Table, obtains the corresponding watermark information of decoding end；
Watermark superposition is carried out using the video image that the corresponding watermark information of decoding end obtains to decoding.
Further, described video monitoring system includes video management server, and described media forwarding server sets up water
Official seal ceases mapping table, including：
IP address and the end that decoding end receives video code flow is obtained from the INVITE that video management server sends
Slogan, and the watermark information of decoding end subscriber；
IP address and the port numbers that coding side sends video code flow are obtained from the ACK message that video server sends；
The IP address of video code flow is sent according to the coding side getting and port numbers, decoding end receive the IP of video code flow
Address and port numbers, and the watermark information of decoding end subscriber, generate the IP address comprising coding side and decoding end and port numbers
And the mapping table of the watermark information of decoding end subscriber.
Preferably, the NAL unit of described superposition watermark identifier encapsulates the video image needing to be superimposed watermark location, described
Superposition watermark identifier is arranged on the head of NAL unit, and described lookup includes being superimposed the NAL unit of watermark identifier, including：
NRI field in detection nal unit header, if the value of NRI field is superposition watermark identifier, judges this NAL
Unit includes the NAL unit being superimposed watermark identifier for head.
Preferably, the NAL unit of described superposition watermark identifier encapsulates the video image needing to be superimposed watermark location, described
Superposition watermark identifier is arranged on the head of NAL unit, and described lookup includes being superimposed the NAL unit of watermark identifier, including：
TYPE field in detection nal unit header, if the value of TYPE field is superposition watermark identifier, judging should
NAL unit includes the NAL unit being superimposed watermark identifier for head.
The invention allows for being superimposed the device of watermark in a kind of video monitoring image, it is applied to video monitoring system, institute
State video monitoring system and include media forwarding server and decoding end, in described video monitoring image, be superimposed the device of watermark, bag
Include：
Searching modul, for, after media forwarding server receives the video code flow that decoding end is asked, regarding from described
The NAL unit including being superimposed watermark identifier is searched in frequency code stream；
Watermark superposition module, for being decoded to the NAL unit including superposition watermark identifier, the video that decoding is obtained
Image carries out watermark superposition, then is re-encoded as after new NAL unit being transmitted to by completing the video image after watermark superposition
Decoding end.
Further, described media forwarding server is set up watermark information mapping table, described watermark superposition module
The video image that decoding is obtained carries out watermark superposition, and execution is following to be operated：
Source IP address/port numbers according to video code flow and purpose IP address/port, inquire about watermark information mapping relations
Table, obtains the corresponding watermark information of decoding end；
Watermark superposition is carried out using the video image that the corresponding watermark information of decoding end obtains to decoding.
Further, described video monitoring system includes video management server, and described media forwarding server sets up water
Official seal ceases mapping table, including：
IP address and the end that decoding end receives video code flow is obtained from the INVITE that video management server sends
Slogan, and the watermark information of decoding end subscriber；
IP address and the port numbers that coding side sends video code flow are obtained from the ACK message that video server sends；
The IP address of video code flow is sent according to the coding side getting and port numbers, decoding end receive the IP of video code flow
Address and port numbers, and the watermark information of decoding end subscriber, generate the IP address comprising coding side and decoding end and port numbers
And the mapping table of the watermark information of decoding end subscriber.
Preferably, the NAL unit of described superposition watermark identifier encapsulates the video image needing to be superimposed watermark location, described
Superposition watermark identifier is arranged on the head of NAL unit, and described searching modul is searched the NAL unit including being superimposed watermark identifier, held
Row is following to be operated：
NRI field in detection nal unit header, if the value of NRI field is superposition watermark identifier, judges this NAL
Unit includes the NAL unit being superimposed watermark identifier for head.
Preferably, the NAL unit of described superposition watermark identifier encapsulates the video image needing to be superimposed watermark location, described
Superposition watermark identifier is arranged on the head of NAL unit, and described searching modul is searched the NAL unit including being superimposed watermark identifier, held
Row is following to be operated：
TYPE field in detection nal unit header, if the value of TYPE field is superposition watermark identifier, judging should
NAL unit includes the NAL unit being superimposed watermark identifier for head.
The present invention proposes the method and device being superimposed watermark in a kind of video image, is carrying out video image by IPC
It would be desirable to the video image of superposition watermark location is individually packaged into a NAL unit during coding, media forwarding server is to this
NAL unit is superimposed with the watermark information of decoding end subscriber after being decoded, then again by the video image after superposition watermark again
It is sent to decoding end after coding, so that decoding end is directly decoded after receiving video code flow, the video image that obtains
Middle it has been superimposed the watermark information comprising videoconference client user name.Solve video image in prior art and pass through the upper wall of hard solution
When it is impossible to superposition watermark and being decoded after decoding end directly intercepts video code flow, the video obtaining in video image
Image is not superimposed the problem of watermark.When coding side encodes, the video image needing to be superimposed watermark location is carried out individually
Encapsulation, and superposition watermark identifier is set, and carry out watermark superposition when media forwarding server forwards video code flow, regarding
During the outflow of frequency image, can effectively carry out tracing leak stopping, and due to being provided with superposition watermark identifier, be prevented from illegally intercepting and regard
Being correctly decoded of frequency code stream.
Brief description
Fig. 1 is the structural representation of the present embodiment video monitoring system；
Fig. 2 is the flow chart of the method being superimposed watermark in video image of the present invention；
Fig. 3 is the schematic diagram of the present embodiment nal unit header form；
Fig. 4 is the agreement flow chart during the present embodiment video connection establishment.
Specific embodiment
With reference to the accompanying drawings and examples technical solution of the present invention is described in further details, following examples are not constituted
Limitation of the invention.
The structural representation of the present embodiment video monitoring system, as shown in figure 1, include coding side, video management server
VM, media forwarding server MS, decoding end.The present embodiment coding end equipment can be web camera IPC or analog video camera
And encoder；Decoding end equipment includes decoder DC and videoconference client PC.Video monitoring client terminal needs to obtain certain shooting
During the video image of machine IPC, send a request to video management server, video management server and corresponding video camera first
IPC, media forwarding server, decoder carry out setting up the protocol negotiation of video connection, after the completion of protocol negotiation, video camera IPC
Video code flow after video image is encoded is sent to media forwarding server, and video codes are circulated by media forwarding server
Issue the corresponding decoder of this videoconference client, decoder obtains required video after the video code flow receiving is decoded
Image, shows on videoconference client.
The technical program media forwarding server, when forwarding video code flow, is first decoded, needs in view image
The region of superposition watermark carries out watermark superposition, sends after then recompiling again.The technical program needs using in video image
The corresponding video code flow in region of watermark to be superimposed sends after being marked, thus media forwarding server be capable of identify that corresponding
Video code flow, carries out watermark superposition after it is decoded.To the corresponding video in region needing superposition watermark in video image
Code stream is marked, the method for mark can be marked in NAL head it is also possible in NAL load data start bit
Put and be marked.
Taking be marked in NAL head to be as a example described in detail below.
The method being superimposed watermark in a kind of video image of the present embodiment, as shown in Fig. 2 include：
The video code flow that step S1, reception decoding end are asked, reads video code flow nal unit header.
The method being superimposed watermark in the present embodiment video image is not limited by concrete Video coding mode, goes for
H.263, H.264, H.265, the various video coded system such as MPEG2, MPEG4, for the ease of description, the present embodiment is with H.264
Illustrate as a example coding.
In h .264, syntax elements are organized into sequence (frame group), image (frame), piece (slice), macro block altogether
(Block), five levels of sub-macroblock.And function H.264 is divided into two-layer, respectively video coding layer (VCL) and network carries
Take layer (NAL), wherein, VCL is responsible for effectively representing the content of video data, and NAL be then responsible for will be video data formatting and carry
For header, to ensure the transmission that video data is suitable on various channels and storage medium, that is, VCL data is by after compressed encoding
Video data sequences, after VCL data will be encapsulated in NAL unit, just can be used to transmit or store, VCL data is with piece
It is encapsulated in NAL for unit.
The NAL head (NALHeader) by a byte for each NAL unit and load data (RBSP) group of several bytes
Become, wherein the form of NAL head is as shown in figure 3, F (forbidden_zero_bit) is to forbid position, when Network Recognition this element is deposited
In bit-errors, 1 can be set to, so that recipient loses this unit.NRI (nal_ref_idc) is important class letter,
It is used to refer to the importance rate of this NAL unit, value is bigger, represent that current NAL unit is more important.TYPE is type identification, uses
In the type pointing out load data in this NAL unit.
The video image of the superposition setting watermark location is individually encapsulated in a NAL unit the present embodiment coding side,
The piece that multiple macro blocks compositions at the video image place of watermark location will be superimposed individually is encapsulated in a NAL unit, and
This nal unit header setting superposition watermark identifier, to identify this NAL unit in subsequent step, carries out watermark superposition.
Specifically, it is possible to use NRI field in nal unit header or TYPE field are arranging superposition watermark identifier.Example
As by the NRI field setting 11 in nal unit header, represented the video image that this NAL is independent encapsulation superposition watermark location
NAL；Or TYPE field is set to 11000, represent the NAL of the video image that this NAL is independent encapsulation superposition watermark location.
The present embodiment coding side IPC, in recorded video image, can give tacit consent to the video figure directly to superposition watermark location
As individually being encapsulated it is also possible to decide whether to superposition watermark bit according to setting up entrained message in video connection procedure
The video image put individually is encapsulated.
In actual application, videoconference client asks the video code flow of IPC to have two kinds of situations, and a kind of situation is live,
Another kind of situation is playback.No matter which kind of situation, is required for setting up the process of video connection, and is setting up after video connects, matchmaker
Body forwarding server all can obtain the video code flow of the coding side that decoding end is asked, and subsequently can read video code flow NAL mono-
First head.
It is easily understood that if superposition watermark identifier is arranged on the original position of load data, this step needs to read
Take is the original position of load data in video code flow NAL unit, and searches load data in NAL unit in step s 2
Original position includes being superimposed the NAL unit of watermark identifier, also can reach same technique effect, below repeat no more.
Step S2, lookup head include being superimposed the NAL unit of watermark identifier.
Video image due to being superimposed watermark location is individually encapsulated in a NAL unit, and the head bag of this NAL unit
Include superposition watermark identifier, therefore can judge whether wrap in nal unit header by reading video code flow nal unit header
The watermark identifier containing superposition.
Check the NRI field of nal unit header, or TYPE field, if it find that superposition watermark identifier, then judging should
NAL unit is the NAL unit of the video image of independent encapsulation superposition watermark location, needs it is decoded, execution superposition water
The operation of print.
And for not including being superimposed the NAL unit of watermark identifier in head, then directly forward according to normal flow process.
Step S3, the NAL unit that head is included be superimposed with watermark identifier are decoded, to the video image that obtains of decoding
Carry out watermark superposition, then be re-encoded as after new NAL unit being transmitted to decoding by completing the video image after watermark superposition
End.
Each frame video image that the present embodiment media forwarding server MS forwards, all includes to head being superimposed watermark mark
The NAL unit known is decoded, and the video image that decoding is obtained carries out watermark superposition, then will complete regarding after watermark superposition
Frequency image is re-encoded as new NAL unit, and is transmitted to decoding end.
Decoding end is directly decoded after receiving video code flow, has been superimposed and comprises video visitor in the video image obtaining
The watermark information of family end subscriber name.
Below taking live application as a example, the method for the present invention is illustrated in further details, as shown in figure 4, specifically
Agreement flow process be：
When videoconference client PC needs the video image obtaining IPC, send the video request message carrying IPC numbering to regarding
Frequency management server VM.
Video management server VM, according to the mapping table of pre-configured videoconference client PC and decoder DC, looks into
Find out decoder DC corresponding with this videoconference client PC, then send Invite message to this decoder DC, ask foundation to regard
Frequency connects.
Decoder DC responds 200OK message to video management server VM, carries in the SDP field of this 200OK message
Decoder DC receives IP address and the port numbers of video code flow.
Video management server VM sends INVITE request message to media forwarding server MS, and takes in SDP field
Receive IP address and the port numbers of video code flow with watermark information and decoder DC.Wherein, the present embodiment watermark information is video
User name during client rs PC login video management server VM or the watermark information of unified any setting, for example
LOGO using unit.Specifying information in SDP field is as follows：
V=0
O=H3C 00 IN IP4 192.168.254.46
I=admin------ watermark information, i.e. the name of operator
C=IN IP4 192.168.254.46------DC receives the IP address of video code flow
M=video 16244 udp 105------DC receives the port numbers of video code flow
A=fmtp:105 H264-TS/90000 resolution=D1 DecoderTag=h3c-v3
A=recvonly
M=audio 16244 udp 0
A=fmtp:0 G711U-TS/8000
A=recvonly
Media forwarding server MS responds 200OK message to video management server VM, and carries media in SDP field
Forwarding server MS receives and sends address and the port numbers of video code flow.
Video management server VM sends INVITE request message to IPC, carries watermark symbol position in SDP field.IPC
After this watermark symbol position is detected, watermark can be enabled, the video image of watermark location is individually encapsulated in a NAL unit.
Wherein, the specifying information of SDP field is：
V=0
O=H3C 00 IN IP4 192.168.254.46
F=1------1 represents and enables watermark, and the image of watermark location needs separately encoded
C=IN IP4 192.168.254.46
M=video 16244 udp 105
A=fmtp:105 H264-TS/90000 resolution=D1 DecoderTag=h3c-v3
A=recvonly
M=audio 16244 udp 0
A=fmtp:0 G711U-TS/8000
A=recvonly
IPC sends 200OK response message to video management server VM, carries IPC and send video code flow in SDP field
IP address and port numbers.
Video management server VM responds ACK message to decoder DC, media forwarding server MS, IPC respectively, and is returning
IP address and the port numbers that IPC sends video code flow are carried in the SDP field of ACK message that media forwarding server MS should be given.
Carry in the SDP field of the INVITE that media forwarding server MS sends according to video management server VM
Watermark information and decoder DC receive the ACK message that the IP address of video code flow and port numbers, video management server VM send
SDP field in the IPC that carries send IP address and the port numbers of video code flow, generate the IP address that IPC sends video code flow
With port numbers, decoder DC receive the watermark information mapping pass between the IP address of video code flow and port numbers and watermark information
It is table, this mapping table is as shown in the table：
Table 1
Wherein source address is the IP address of IPC, and source port number sends the port numbers of video code flow for IPC, and destination address is
The IP address of DC, destination slogan receives the port numbers of video code flow for DC, and watermark information logs in video tube for videoconference client
User name during reason server can also be other marks.When using unified watermark information, watermark can also need not be set
Information MAP relation table, is decoded to the NAL unit of superposition watermark identifier, the video image that decoding is obtained carries out unifying water
Print superposition.Using user name as watermark information, be conducive to tracing the video image of leakage leak out from which user (because
The watermark of this user is had on video image).
It should be noted that media forwarding server can be according to INVITE request message SDP of video management server
The watermark information carrying in field, to know the concrete watermark information needing superposition, to set up the mapping table of table 1；Can also be directly
The user name setting up video connection to video management server inquiry to set up the mapping table of table 1.Meanwhile, this watermark information mapping
Relation table also not necessarily to be set up by media forwarding server it is also possible to individually separately set device to set up this mapping table, only need to
Media forwarding server and video management server obtain corresponding information.By above-mentioned agreement flow process, the present embodiment IPC
Video connection establishment and media forwarding server MS and decoder between completes, and media forwarding server MS generates IPC and sends out
Send the IP address of video code flow and port numbers, decoder DC receive the IP address of video code flow and port numbers and watermark information it
Between mapping table.
The present embodiment IPC, after the completion of video connection establishment, according to the watermark symbol position detecting, enables watermark, will set
The piece of multiple macro block compositions that the video image of fixed superposition watermark location is located individually is encapsulated in a NAL unit, and
Setting superposition watermark identifier in this nal unit header.Then this NAL unit is sent to media forwarding server MS.This enforcement
Example superposition watermark location sets when IPC being configured by video management server VM, after the setup can be as needed
It is modified by video management server VM.
If it should be noted that H.264 coded system is not, but during other coded system, the present embodiment can lead to
Cross similar method, the value of specific fields in video code flow head is set to be superimposed watermark identifier, difference is to regarding
In frequency code stream head, different concrete fields is configured.For example, when coded system be H.265 when, NAL unit head H.265
Portion is made up of two bytes, and wherein the second of first character section to the 7th is TYPE field, and the present embodiment can be by TYPE word
Section is set to be superimposed watermark identifier, for example, be set to be superimposed watermark identifier 110000 by TYPE field.By said method, this reality
Applying example can be to realize being superimposed watermark to the video code flow using different coding mode.
The present embodiment media forwarding server MS, after the video code flow receiving IPC transmission, detects in nal unit header
NRI or TYPE field, if the value of NRI field or TYPE field be superposition watermark identifier, from the IP packet header of video code flow
In parse source IP address/port numbers and purpose IP address/port numbers, and the IP address/port numbers with parsing and mesh
IP address/port numbers send the IP address of video code flow with the IPC generating and port numbers, decoder DC receive video code flow
Mapping table between IP address and port numbers and watermark information is mated, and uses the watermark information matching to this NAL
Decode the video image obtaining in unit and carry out watermark superposition, be then re-encoded as completing the video image after watermark superposition
It is sent to corresponding decoder DC after new NAL unit.
By said method, the video code flow that the present embodiment media forwarding server MS sends to IPC is folded after being decoded
Plus the watermark information of videoconference client user name, then it is transmitted to decoder DC after being recompiled, decoder DC is receiving
Directly it is decoded to after video code flow, in the video image obtaining, be superimposed the watermark letter comprising videoconference client user name
Breath.Solve video image in prior art and pass through hard solution during upper wall it is impossible to be superimposed watermark in video image and in decoding
End is decoded after directly intercepting video code flow, the raw video image that the video image obtaining generates for coding side, not folded
The problem of watermarking, can effectively prevent the outflow of video image.
It should be noted that when the video image of the same IPC of multiple videoconference client program requests, media forwarding server
MS only needs to the NAL unit needing to be superimposed watermark once be decoded, then according to each different video consumer end subscriber
After being superimposed different watermarks, then it is transmitted to different decoder DC, thus realizing different to each after being recompiled respectively
The different watermarks of superposition of video consumer end subscriber, be only superimposed this use in the video image that each video consumer end subscriber gets
The purpose of family watermark.
Above example taking fact is as a example illustrated, when practicality is for playback, because coding side acquiescence adopts this
Bright mode is provided with superposition watermark identifier in NAL head, then media forwarding server will read video code flow NAL unit head
Portion, searches head and includes being superimposed the NAL unit of watermark identifier, the NAL unit that head is included be superimposed with watermark identifier is carried out
Decoding, the video image that decoding is obtained carries out watermark superposition, then recompiles completing the video image after watermark superposition
It is transmitted to decoding end after the NAL unit of Cheng Xin.The process that implements repeats no more here.
With said method accordingly, it is superimposed the device of watermark in a kind of video monitoring image of the present embodiment, be applied to video
Monitoring system, described video monitoring system includes media forwarding server and decoding end, is superimposed watermark in this video monitoring image
Device, including：
Searching modul, for, after media forwarding server receives the video code flow that decoding end is asked, regarding from described
The NAL unit including being superimposed watermark identifier is searched in frequency code stream；
Watermark superposition module, for being decoded to the NAL unit including superposition watermark identifier, the video that decoding is obtained
Image carries out watermark superposition, then is re-encoded as after new NAL unit being transmitted to by completing the video image after watermark superposition
Decoding end.
The device being superimposed watermark in the present embodiment video monitoring image can be single hardware device, or media forward
A part in server, repeats no more here.
The present embodiment media forwarding server is set up watermark information mapping table, and watermark superposition module obtains to decoding
Video image carry out watermark superposition, execution is following to be operated：
Source IP address/port numbers according to video code flow and purpose IP address/port, inquire about watermark information mapping relations
Table, obtains the corresponding watermark information of decoding end；
Watermark superposition is carried out using the video image that the corresponding watermark information of decoding end obtains to decoding.
With said method accordingly, the present embodiment media forwarding server sets up watermark information mapping table, including：
IP address and the end that decoding end receives video code flow is obtained from the INVITE that video management server sends
Slogan, and the watermark information of decoding end subscriber；
IP address and the port numbers that coding side sends video code flow are obtained from the ACK message that video server sends；
The IP address of video code flow is sent according to the coding side getting and port numbers, decoding end receive the IP of video code flow
Address and port numbers, and the watermark information of decoding end subscriber, generate the IP address comprising coding side and decoding end and port numbers
And the mapping table of the watermark information of decoding end subscriber.
It should be noted that the present embodiment watermark information mapping table set up in media forwarding server it is also possible to
Individually separately set device to set up this mapping table, such as set up in the searching modul of this device, searching modul only need to turn to media
Send out server and video management server obtains corresponding information and can set up this mapping table.
In the present embodiment, the NAL unit of superposition watermark identifier encapsulates the video image needing to be superimposed watermark location, superposition
Watermark identifier can be arranged on the head of NAL unit it is also possible to be arranged on the original position of load data, is preferably provided at NAL
The head of unit.
When being arranged on the head of NAL unit, searching modul corresponds to the following two kinds working method respectively：
Mode one, described searching modul searches the NAL unit including being superimposed watermark identifier, and execution is following to be operated：
NRI field in detection nal unit header, if the value of NRI field is superposition watermark identifier, judges this NAL
Unit includes the NAL unit being superimposed watermark identifier for head.
Mode two, described searching modul searches the NAL unit including being superimposed watermark identifier, and execution is following to be operated：
TYPE field in detection nal unit header, if the value of TYPE field is superposition watermark identifier, judging should
NAL unit includes the NAL unit being superimposed watermark identifier for head.
Above example only in order to technical scheme to be described rather than be limited, without departing substantially from the present invention essence
In the case of god and its essence, those of ordinary skill in the art work as and can make various corresponding changes and change according to the present invention
Shape, but these corresponding changes and deformation all should belong to the protection domain of appended claims of the invention.
Claims (10)
1. a kind of method being superimposed watermark in video monitoring image, is applied to video monitoring system, described video monitoring system bag
Include media forwarding server and decoding end it is characterised in that in described video monitoring image be superimposed watermark method, including：
After media forwarding server receives the video code flow that decoding end is asked, search from described video code flow and include folding
The NAL unit of watermarking mark；
The NAL unit including superposition watermark identifier is decoded, the video image that decoding is obtained carries out watermark superposition, then
It is re-encoded as after new NAL unit being transmitted to decoding end by completing the video image after watermark superposition.
2. it is superimposed the method for watermark in video image according to claim 1 it is characterised in that described media forward service
Device is set up watermark information mapping table, and the described video image that decoding is obtained carries out watermark superposition, including：
Source IP address/port numbers according to video code flow and purpose IP address/port, inquire about watermark information mapping table,
Obtain the corresponding watermark information of decoding end；
Watermark superposition is carried out using the video image that the corresponding watermark information of decoding end obtains to decoding.
3. it is superimposed the method for watermark in video image according to claim 2 it is characterised in that described video monitoring system
Including video management server, described media forwarding server sets up watermark information mapping table, including：
IP address and the port numbers that decoding end receives video code flow are obtained from the INVITE that video management server sends,
And the watermark information of decoding end subscriber；
IP address and the port numbers that coding side sends video code flow are obtained from the ACK message that video server sends；
The IP address of video code flow is sent according to the coding side getting and port numbers, decoding end receive the IP address of video code flow
And port numbers, and the watermark information of decoding end subscriber, generate the IP address comprising coding side and decoding end and port numbers and
The mapping table of the watermark information of decoding end subscriber.
4. it is superimposed the method for watermark in video image according to claim 1 it is characterised in that described superposition watermark identifier
NAL unit encapsulate the video image needing to be superimposed watermark location, described superposition watermark identifier is arranged on the head of NAL unit
Portion, described lookup includes being superimposed the NAL unit of watermark identifier, including：
NRI field in detection nal unit header, if the value of NRI field is superposition watermark identifier, judges this NAL unit
Include the NAL unit being superimposed watermark identifier for head.
5. it is superimposed the method for watermark in video image according to claim 1 it is characterised in that described superposition watermark identifier
NAL unit encapsulate the video image needing to be superimposed watermark location, described superposition watermark identifier is arranged on the head of NAL unit
Portion, described lookup includes being superimposed the NAL unit of watermark identifier, including：
TYPE field in detection nal unit header, if the value of TYPE field is superposition watermark identifier, judges that this NAL is mono-
Unit includes the NAL unit being superimposed watermark identifier for head.
6. it is superimposed the device of watermark in a kind of video monitoring image, be applied to video monitoring system, described video monitoring system bag
Include media forwarding server and decoding end it is characterised in that being superimposed the device of watermark in described video monitoring image, including：
Searching modul, for after media forwarding server receives the video code flow that decoding end is asked, from described video codes
The NAL unit including being superimposed watermark identifier is searched in stream；
Watermark superposition module, for being decoded to the NAL unit including superposition watermark identifier, the video image that decoding is obtained
Carry out watermark superposition, then be re-encoded as after new NAL unit being transmitted to decoding by completing the video image after watermark superposition
End.
7. it is superimposed the device of watermark in video image according to claim 6 it is characterised in that described media forward service
Device is set up watermark information mapping table, and the video image that described watermark superposition module obtains to decoding carries out watermark superposition,
Execution is following to be operated：
Source IP address/port numbers according to video code flow and purpose IP address/port, inquire about watermark information mapping table,
Obtain the corresponding watermark information of decoding end；
Watermark superposition is carried out using the video image that the corresponding watermark information of decoding end obtains to decoding.
8. it is superimposed the device of watermark in video image according to claim 7 it is characterised in that described video monitoring system
Including video management server, described media forwarding server sets up watermark information mapping table, including：
IP address and the port numbers that decoding end receives video code flow are obtained from the INVITE that video management server sends,
And the watermark information of decoding end subscriber；
IP address and the port numbers that coding side sends video code flow are obtained from the ACK message that video server sends；
The IP address of video code flow is sent according to the coding side getting and port numbers, decoding end receive the IP address of video code flow
And port numbers, and the watermark information of decoding end subscriber, generate the IP address comprising coding side and decoding end and port numbers and
The mapping table of the watermark information of decoding end subscriber.
9. it is superimposed the device of watermark in video image according to claim 6 it is characterised in that described superposition watermark identifier
NAL unit encapsulate the video image needing to be superimposed watermark location, described superposition watermark identifier is arranged on the head of NAL unit
Portion, described searching modul searches the NAL unit including being superimposed watermark identifier, and execution is following to be operated：
NRI field in detection nal unit header, if the value of NRI field is superposition watermark identifier, judges this NAL unit
Include the NAL unit being superimposed watermark identifier for head.
10. it is superimposed the device of watermark in video image according to claim 1 it is characterised in that described superposition watermark mark
The NAL unit known encapsulates the video image needing to be superimposed watermark location, and described superposition watermark identifier is arranged on the head of NAL unit
Portion, described searching modul searches the NAL unit including being superimposed watermark identifier, and execution is following to be operated：
TYPE field in detection nal unit header, if the value of TYPE field is superposition watermark identifier, judges that this NAL is mono-
Unit includes the NAL unit being superimposed watermark identifier for head.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610919875.0A CN106454368B (en) | 2016-10-21 | 2016-10-21 | Method and device for superposing watermarks in video image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610919875.0A CN106454368B (en) | 2016-10-21 | 2016-10-21 | Method and device for superposing watermarks in video image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106454368A true CN106454368A (en) | 2017-02-22 |
| CN106454368B CN106454368B (en) | 2020-02-18 |
Family
ID=58176580
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610919875.0A Active CN106454368B (en) | 2016-10-21 | 2016-10-21 | Method and device for superposing watermarks in video image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106454368B (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107690052A (en) * | 2017-08-14 | 2018-02-13 | 浙江宇视科技有限公司 | A kind of method and device of video monitoring image superposition watermark |
| CN108174137A (en) * | 2017-12-28 | 2018-06-15 | 浙江宇视科技有限公司 | The method and device taken on the sly is prevented in a kind of overlay video watermark |
| CN109996028A (en) * | 2017-12-29 | 2019-07-09 | 浙江宇视科技有限公司 | Monitoring display equipment and watermark adding method |
| CN110012296A (en) * | 2018-11-21 | 2019-07-12 | 杭州基尔区块链科技有限公司 | A kind of snap information hidden method for MP4 video code flow |
| CN110337045A (en) * | 2019-06-04 | 2019-10-15 | 青岛海信网络科技股份有限公司 | The system and two dimensional code adding method of a kind of pair of video source addition two dimensional code |
| CN110619590A (en) * | 2019-08-22 | 2019-12-27 | 杭州名淘教育科技有限公司 | Online education resource recommendation system based on social media |
| CN110874456A (en) * | 2018-08-31 | 2020-03-10 | 浙江大学 | Watermark embedding method, watermark extracting method, watermark embedding device, watermark extracting device and data processing method |
| CN111131654A (en) * | 2018-10-30 | 2020-05-08 | 浙江宇视科技有限公司 | Watermark embedding method and device and coder-decoder |
| CN111200762A (en) * | 2018-11-20 | 2020-05-26 | 慧盾信息安全科技（苏州）股份有限公司 | Watermarking and tracing system and method based on real-time online video sharing and browsing |
| CN111586361A (en) * | 2020-05-19 | 2020-08-25 | 浙江大华技术股份有限公司 | Image processing method and related device |
| CN112153237A (en) * | 2019-06-27 | 2020-12-29 | 山东华软金盾软件股份有限公司 | Protection method and system for watermark gateway |
| CN112383836A (en) * | 2020-10-19 | 2021-02-19 | 深圳市九洲电器有限公司 | Video verification system and method |
| CN114553452A (en) * | 2020-11-25 | 2022-05-27 | 华为技术有限公司 | Attack defense method and protection equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101022550A (en) * | 2006-12-26 | 2007-08-22 | 北京闪动科技有限公司 | Flow media digital watermark information embedding method |
| CN101325702A (en) * | 2008-07-25 | 2008-12-17 | 清华大学 | System for real time embedding visible watermark into flow medium as well as server terminal and client terminal thereof |
| CN102685470A (en) * | 2011-03-07 | 2012-09-19 | 航天信息股份有限公司 | Video digital watermark embedding method and video digital water embedding device directing at AVS (audio video standard) video format |
| US20120272327A1 (en) * | 2011-04-22 | 2012-10-25 | Samsung Electronics Co., Ltd. | Watermarking method and apparatus for tracking hacked content and method and apparatus for blocking hacking of content using the same |
| CN103152578A (en) * | 2013-03-25 | 2013-06-12 | 中国传媒大学 | H.264 video watermark embedding and extraction method based on mixed coding/decoding |
-
2016
- 2016-10-21 CN CN201610919875.0A patent/CN106454368B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101022550A (en) * | 2006-12-26 | 2007-08-22 | 北京闪动科技有限公司 | Flow media digital watermark information embedding method |
| CN101325702A (en) * | 2008-07-25 | 2008-12-17 | 清华大学 | System for real time embedding visible watermark into flow medium as well as server terminal and client terminal thereof |
| CN102685470A (en) * | 2011-03-07 | 2012-09-19 | 航天信息股份有限公司 | Video digital watermark embedding method and video digital water embedding device directing at AVS (audio video standard) video format |
| US20120272327A1 (en) * | 2011-04-22 | 2012-10-25 | Samsung Electronics Co., Ltd. | Watermarking method and apparatus for tracking hacked content and method and apparatus for blocking hacking of content using the same |
| CN103152578A (en) * | 2013-03-25 | 2013-06-12 | 中国传媒大学 | H.264 video watermark embedding and extraction method based on mixed coding/decoding |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107690052A (en) * | 2017-08-14 | 2018-02-13 | 浙江宇视科技有限公司 | A kind of method and device of video monitoring image superposition watermark |
| CN107690052B (en) * | 2017-08-14 | 2020-07-28 | 浙江宇视科技有限公司 | Method and device for overlaying watermark on video monitoring image |
| CN108174137A (en) * | 2017-12-28 | 2018-06-15 | 浙江宇视科技有限公司 | The method and device taken on the sly is prevented in a kind of overlay video watermark |
| CN109996028A (en) * | 2017-12-29 | 2019-07-09 | 浙江宇视科技有限公司 | Monitoring display equipment and watermark adding method |
| CN110874456A (en) * | 2018-08-31 | 2020-03-10 | 浙江大学 | Watermark embedding method, watermark extracting method, watermark embedding device, watermark extracting device and data processing method |
| CN110874456B (en) * | 2018-08-31 | 2022-04-26 | 浙江大学 | Watermark embedding method, watermark extracting method, watermark embedding device, watermark extracting device and data processing method |
| CN111131654A (en) * | 2018-10-30 | 2020-05-08 | 浙江宇视科技有限公司 | Watermark embedding method and device and coder-decoder |
| CN111131654B (en) * | 2018-10-30 | 2022-07-19 | 浙江宇视科技有限公司 | Watermark embedding method and device and coder-decoder |
| CN111200762A (en) * | 2018-11-20 | 2020-05-26 | 慧盾信息安全科技（苏州）股份有限公司 | Watermarking and tracing system and method based on real-time online video sharing and browsing |
| CN110012296A (en) * | 2018-11-21 | 2019-07-12 | 杭州基尔区块链科技有限公司 | A kind of snap information hidden method for MP4 video code flow |
| CN110012296B (en) * | 2018-11-21 | 2021-08-17 | 杭州基尔区块链科技有限公司 | Rapid information embedding method for MP4 video code stream |
| CN110337045A (en) * | 2019-06-04 | 2019-10-15 | 青岛海信网络科技股份有限公司 | The system and two dimensional code adding method of a kind of pair of video source addition two dimensional code |
| CN110337045B (en) * | 2019-06-04 | 2021-12-14 | 海信集团有限公司 | System for adding two-dimensional code to video source and two-dimensional code adding method |
| CN112153237A (en) * | 2019-06-27 | 2020-12-29 | 山东华软金盾软件股份有限公司 | Protection method and system for watermark gateway |
| CN110619590A (en) * | 2019-08-22 | 2019-12-27 | 杭州名淘教育科技有限公司 | Online education resource recommendation system based on social media |
| CN111586361B (en) * | 2020-05-19 | 2021-10-15 | 浙江大华技术股份有限公司 | Image processing method and related device |
| CN111586361A (en) * | 2020-05-19 | 2020-08-25 | 浙江大华技术股份有限公司 | Image processing method and related device |
| CN112383836A (en) * | 2020-10-19 | 2021-02-19 | 深圳市九洲电器有限公司 | Video verification system and method |
| CN114553452A (en) * | 2020-11-25 | 2022-05-27 | 华为技术有限公司 | Attack defense method and protection equipment |
| CN114553452B (en) * | 2020-11-25 | 2023-06-02 | 华为技术有限公司 | Attack defense method and protection equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106454368B (en) | 2020-02-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106454368A (en) | Method for superposing watermark in video image and device thereof | |
| US11163897B2 (en) | Method and apparatus for image display using privacy masking | |
| CN106982355B (en) | A kind of video monitoring system and anti-leak server of anti-image leakage | |
| CN107690052B (en) | Method and device for overlaying watermark on video monitoring image | |
| US8126810B2 (en) | Apparatus and method of flexible and common IPMP system for providing and protecting content | |
| CN105491337B (en) | Network Video Surveillance Device-General cut-in method and device based on SDK level of abstraction | |
| CN104735457A (en) | Video encryption and decryption method based on H.264 code | |
| TW201709732A (en) | Method and system for efficient encryption, transmission, and decryption of video data | |
| EP3050300B1 (en) | Hybrid codec scalable video | |
| CN108111303A (en) | A kind of secure connection method of intelligent home gateway | |
| CN106998475A (en) | Video transmission path tracking and device | |
| CN105007465A (en) | Cipher-text H264 video live-broadcasting and on-demand platform based on live555 frame and ffmpeg library | |
| CN105009578B (en) | Multi-layer video stream decoding method and equipment | |
| CN106454814A (en) | GTP tunnel communication system and method | |
| CN116527314A (en) | Image and video secure transmission method, device, medium and equipment | |
| CN111200762B (en) | Watermarking and tracing system and method based on real-time online video sharing and browsing | |
| TWI820064B (en) | Securing digital data transmission in a communication network | |
| CN205510240U (en) | High -definition network video character superimposer | |
| CN108810475B (en) | Android video monitoring device based on Onvif standard and Sip protocol | |
| CN117278762B (en) | Safe traceable video coding and decoding system | |
| CN105306902B (en) | A kind of end-to-end HD video secure transmission system and method based on 4G networks | |
| CN106257890A (en) | Transmission storehouse naming scheme and Identity Management | |
| CN110337045B (en) | System for adding two-dimensional code to video source and two-dimensional code adding method | |
| EP1694067A1 (en) | Streaming system | |
| CN100544428C (en) | Coding/decoding apparatus with watermark encrypting |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |