CN107566837A - The time labeling method and system of video - Google Patents
The time labeling method and system of video Download PDFInfo
- Publication number
- CN107566837A CN107566837A CN201710765863.1A CN201710765863A CN107566837A CN 107566837 A CN107566837 A CN 107566837A CN 201710765863 A CN201710765863 A CN 201710765863A CN 107566837 A CN107566837 A CN 107566837A
- Authority
- CN
- China
- Prior art keywords
- image
- time
- video signal
- mark
- adjustment parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Image Analysis (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The time labeling method and system of present invention offer video, the time labeling method of the video, including：The Image Coding of the association in time information for including the image is generated for each image in source video signal；Adjustment parameter is obtained, described image coded modulation into the geometry controlled by adjustment parameter, to generate the time of the image in source video signal mark；And the time of each image and the image is marked to generate time marking video signal in synthesis source video signal.The time labeling method and system of video provided by the invention may be implemented in without to existing vision signal transmission or processing system change in the case of, track video processing in each image original time related information.
Description
Technical field
The present invention relates to the time labeling method and system of video frequency signal processing, more particularly to a kind of video.
Background technology
Vision signal is made up of the image string for defining the continuous expression of reproduction time order, generally with data flow
Form is in equipment room or transmission over networks.There are some video stream formats (such as H.264) to have recorded every width in encoded data stream
The reproduction time information of image, also there are some video stream formats (such as YUV) not have then.Generally when acquisition vision signal
The video stream format that have recorded temporal information need to be depended on during middle each image correct time information.Nonetheless, if regarding
The encoding and decoding or frame rate adjustment etc. again of (or not knowing whether to occur) to vision signal occur in the transmitting procedure of frequency signal
Reason, then will be difficult to accurately to track each image in video and correspond to specific original time information.
There are certain methods at present to attempt treated vision signal and its corresponding unprocessed
Raw video signal be aligned in time domain, and then from corresponding to raw video signal per frame temporal information in know processing after
Corresponding temporal information in vision signal per frame.Unfortunately industry is come real mostly using the method by video registration algorithm
The alignment in current domain, specifically, i.e., by certain unique algorithm extraction characteristic from image, for reference picture and treat
Altimetric image respectively spatial domain, time domain an a small range to the difference of characteristic carry out minimize calculate realize spatial domain and
Time domain registration, so as to realize the alignment in time domain.Referring to ITU-T recommendations J.144, J.244, J.247, J.341.Nonetheless
Ground spends a large amount of computing costs, also can only probably understand the frame correlation time information in processing rear video signal.And when original
When content in beginning vision signal does not have acute variation, this kind of optimization process minimized based on difference will be difficult to restrain.Eventually
It is the specific temporal information that can not accurately learn every frame.
The content of the invention
The defects of present invention is in order to overcome above-mentioned prior art to exist, there is provided the time labeling method and system of a kind of video
It may be implemented in the case of being changed without the transmission to existing vision signal or the system of processing, track video processing
The original time related information of middle each image.
According to an aspect of the present invention, there is provided a kind of time labeling method of video, including：To be every in source video signal
Width image generates the Image Coding of the association in time information for including the image；Adjustment parameter is obtained, described image is encoded
The geometry controlled by adjustment parameter is modulated into, to generate the time of the image in source video signal mark；And close
The time of each image and the image is marked to generate time marking video signal into source video signal.
Alternatively, the geometry modulated includes one or more rectangular areas, and the width of the rectangular area and it is high by
The width of the image of the adjustment parameter and/or the source video signal and high control.
Alternatively, the rectangular area includes a rectangular shaped rim, and the rectangular shaped rim has the line controlled by adjustment parameter
It is wide.
Alternatively, the rectangular area is offset from the angle point of image by default angle point offset.
Alternatively, the adjustment parameter is the pixel quantity that a point in described image coding includes.
Alternatively, the geometry modulated includes multiple rectangular areas, identical being filled with the plurality of rectangular area
Filled with different described image codings or the plurality of rectangular area in described image coding, the plurality of rectangular area
Blank map picture is combined into an Image Coding.
Alternatively, the acquisition adjustment parameter, described image coded modulation into the geometry controlled by adjustment parameter,
Also included the step of the time of the image in source video signal mark with generating：Generate one or more localization regions, institute
State one or more localization regions and be used for position of the auxiliary positioning Image Coding in described image.
Alternatively, described image coding is between two localization regions.
Alternatively, described image coding and the line of centres of three localization regions are rectangle.
Alternatively, the width of the localization region or length are as the adjustment parameter..
Alternatively, the acquisition adjustment parameter, described image coded modulation into the geometry controlled by adjustment parameter,
Also included the step of the time of the image in source video signal mark with generating：Whether the feedback for receiving an external device (ED) may be used
Mark to be to adjust the value of adjustment parameter increase by 1 or reduce 1 between recognition is punctual, it is described it is punctual between mark marked in the time
Generated before by with time mark identical mode.
Alternatively, the area of the time mark is less than or equal to 5% of single image area in the source video.
Alternatively, the time of each image and image mark is regarded with generating time mark in the synthesis source video signal
The step of frequency signal, also includes：The luminance component and color of the image of the source video signal are obtained using luminance-chrominance image form
Spend component；Time mark is converted into light and shade luminance bit picture figure；According to the time, the geological information of mark is added to institute
In the luminance component for stating image, keep the chromatic component of described image constant, by the luminance component of superposition and the chromatic component
To form the image with time mark, the sequence with the image of time mark forms the time marking video for synthesis
Signal.
Alternatively, the association in time information includes the frame number of each image, sampling time in the source video signal
It is one or more in stamp, time-varying information.
Alternatively, described image coding includes：Bar code, two-dimensional bar code, figure, image, text, form of painting, binary system
It is one or more in Bit String.
According to another aspect of the invention, a kind of time Mk system of video is also provided, including：One code device, use
Each image generates the Image Coding of the association in time information for including the image in for source video signal；One regulation dress
Put, for obtaining adjustment parameter, described image coded modulation into the geometry controlled by adjustment parameter, to generate the source
The time mark of image in vision signal；And a synthesizer, for synthesizing each image and the figure in source video signal
The time of picture is marked to generate time marking video signal.
The time labeling method and system of video provided by the invention cause each image in time marking video signal
The original time related information of the image has been merged in content, when in use between marking video signal pass through transmission of video and processing
Afterwards, in the case where being changed without the transmission to existing vision signal or the system of processing, so that it may which realization respectively saves from system
The original time related information of each image is traced into vision signal at point or end points.
Brief description of the drawings
Its example embodiment is described in detail by referring to accompanying drawing, above and other feature and advantage of the invention will become
It is more obvious.
Fig. 1 shows the flow chart of the time labeling method of video according to embodiments of the present invention.
Fig. 2 shows the DFD of the time labeling method of video according to a first embodiment of the present invention.
Fig. 3 shows the rectangle two-dimensional bar code time mark geometry schematic diagram of first embodiment of the invention.
Fig. 4 shows the DFD of the time labeling method of video according to a second embodiment of the present invention.
Fig. 5 shows the surrounding bar code arrowband time mark geometry schematic diagram of third embodiment of the invention.
Fig. 6 shows the luminance component schematic diagram of image in the video of the synthesis of third embodiment of the invention.
Fig. 7 to Figure 14 shows that some times mark of the present invention forms legend.
Figure 15 shows the time mark recognition experimental data contrast of first and third embodiment of the invention.
Embodiment
Example embodiment is described more fully with referring now to accompanying drawing.However, example embodiment can be with a variety of shapes
Formula is implemented, and is not understood as limited to embodiment set forth herein；On the contrary, these embodiments are provided so that the present invention will
Fully and completely, and by the design of example embodiment comprehensively it is communicated to those skilled in the art.Identical is attached in figure
Icon note represents same or similar structure, thus will omit repetition thereof.
The defects of in order to overcome above-mentioned prior art to exist, the present invention provide a kind of time labeling method of video and are
System.Referring first to Fig. 1, Fig. 1 shows the flow chart of the time labeling method of video according to embodiments of the present invention.Fig. 1 is for showing
Go out 3 steps：
Step S101. is the image that each image generates the association in time information for including the image in source video signal
Coding.
Specifically, the association in time information described in step S101 includes the frame volume of each image in source video signal
Number, it is sampling time stamp, one or more in time-varying information.Image Coding can broadly refer in a two-dimensional manner
The coding of display, for example, it can be bar code, two-dimensional bar code, figure, image, text, form of painting or binary bits string.
In step S101, the source video signal of external device (ED) transmission can be received, is that each image is given birth in source video signal
After the Image Coding for the association in time information for including the image into one, the image of exportable source video signal, the institute of the image
The data structure for stating described image coding composition corresponding to association in time information and the image is the sequence flows signal of unit.
Step S102. obtains adjustment parameter, described image coded modulation into the geometry controlled by adjustment parameter, with
Generate the time mark of the image in the source video signal.
Specifically, the image of the source video signal of step S102 obtaining steps S101 outputs, the time of the image
After the data structure of described image coding composition is the sequence flows signal of unit corresponding to related information and the image, by every width figure
The described image coded modulation of picture into controlled with adjustment parameter time mark.Afterwards, export by the image in source video signal,
Time mark corresponding to the association in time information of the image, the image, time mark geological information composition data knot
Structure is the sequence flows signal of unit.
More specifically, time mark generates as follows：Adjustment parameter is obtained, Image Coding is modulated into using one
The geometry of adjustment parameter control.Further, the geometry modulated includes at least one rectangular area, the rectangle region
Image Coding is filled with domain, and the width of the rectangular area and height are by the image of adjustment parameter and/or the source video signal
Wide and high control.The rectangular area may also include a rectangular shaped rim, and the rectangular shaped rim has the line width controlled by adjustment parameter.
Image Coding is filled in rectangular shaped rim, and rectangular shaped rim can be used for separate image coding and image.The rectangular area can be by default
Angle point offset offset from the angle point of image.An Image Coding can be filled only with one rectangular area, can also
Repeat to fill the multiple copies of same Image Coding by pattern, also allow an Image Coding to spread on same piece image
Such multiple rectangular area in.
Further, the adjustment parameter described in step S102 can represent the picture that a code-point in Image Coding includes
Prime number amount.The predeterminable adjustment parameter is 3.In a preference, the adjustment parameter can also be adjusted.For example, step
S102 can receive an external device (ED) feedback whether can distinguish surely the time mark with adjust the value of the adjustment parameter increase by 1 or
Reduce 1.Mark is marked prior to the time and generated between punctual, and is generated by with time mark identical mode.Further
Ground, no matter how adjustment parameter adjusts, and the area of time mark need to be less than or equal to single image area in the source video
5%.
In some change case, geometry that step S102 is modulated into includes one or more rectangular areas, this
Or encoded in multiple rectangular areas filled with identical described image for follow-up repeatedly recognition.One or more rectangular areas can
Limit the image-region of the image synthesis of a supply source vision signal, and the width of the rectangular area and it is high by the adjustment parameter and/
Or width and the high control of the image of the source video signal.
Localization region is also generated in step S102, for auxiliary positioning rectangular area.In certain embodiments, rectangular area
Between two localization regions.Two rectangular areas can share localization region.In some other embodiments, three localization regions
The line of centres with rectangular area is rectangle with the position in locating rectangle region.Preferably, the localization region is square, institute
The length of side of localization region is stated as the adjustment parameter.Localization region is also not necessarily limited to square shape, for example, localization region can be with
It is irregular shaped region, the length or width of localization region can be used as the adjustment parameter.The rectangular area and the positioning area
There is interval between domain.One end of the rectangular area can also be provided with a localization region.
In a preference of the present embodiment, when including four rectangular areas, four rectangular areas regard positioned at supply source
The surrounding of the image-region of the rectangle of the image synthesis of frequency signal, in image, is covered on image, rectangular outer and image
Outer rim overlaps.Four localization regions are located at four corner points of the image-region of the rectangle of the image synthesis of supply source vision signal.
In another example when including two rectangular areas, two rectangular areas can be parallel to each other or be mutually perpendicular to, and be located at supply source video
At two sides of the four edges of the image-region of the rectangle of the image synthesis of signal, it is covered on image, outer rim and image outer rim
Overlap.When two rectangular areas are mutually perpendicular to, a localization region is located at the rectangle of the image synthesis of supply source vision signal
One corner point of image-region.In other change case, it can only include a rectangular area, will not be described here.
Fig. 7 to Figure 14 be may be referred to modulate the geometry of time mark.
The time of each image and the image is marked to generate time marking video in step S103. synthesis source video signals
Signal.
Specifically, in step S103, obtained using luminance-chrominance image form the source video signal image it is bright
Spend component and chromatic component.Luminance-chrominance image form can include YUV, YCrCb.Then, time mark is converted into
Light and shade luminance bit picture figure.According to the time, the geological information of mark is added in the luminance component of described image, described in holding
The chromatic component of image is constant, and the luminance component of superposition is synthesized to be formed with time mark with the chromatic component
Image, the sequence with the image of time mark form the time marking video signal.
Further, step S103 also exports the time marking video letter by the image sequence of the source video signal
Number, and the geological information of the association in time information and time mark of the synchronism output per two field picture.
In certain embodiments, it is two-dimensional bar code that the present invention, which can preset Image Coding, and predetermined two-dimensional bar code
Type and associated adjustment parameter, meanwhile, can preset the time mark adjustment parameter.The time in time marking video signal
Mark is applied in the luminance component for the image for having covered source video signal, and area deficiency is damaged to the luminance component of image
5%.Time marking video signal can pass through external video processing device or network carries out various codings, transmission, further decoding etc.
After reason, the time for remaining able to be partitioned into from the vision signal after processing in image marks and obtains the geometry spy of time mark
Reference is ceased, and the association in time information encoded in time mark is extracted using corresponding two-dimensional bar code recognizer.
The present invention can pass through the time labeling process with automation two ways completion vision signal by hand.Manual mode is
Start pre-set image type of coding and associated adjustment parameter before marking operation (such as two-dimensional bar code type and associated adjustment ginseng
Number), the default time mark adjustment parameter, then by existing vision signal file import video time Mk system,
Video timestamp signal is preserved into sequence of video images file or is sent to video encoder preservation into Video coding file.
The video signal input terminal of the time Mk system of video can also be connected to by the present invention by automating mode
To receive real-time sequence of video images on one video signal acquisition device, by the video time of the time Mk system of video
Marking signal output end is linked into the video signal input terminal of external video apparatus or application network as video source, at this moment outside
The vision signal of video-unit or the processing of application network can with time mark.Optionally, by video timestamp system
The synchronous time mark auxiliary signal output end of system is linked into corresponding external monitoring devices, and at this moment external monitoring devices can
To monitor the real-time time related information and time mark geometric properties information in raw video signal.Optionally, will be in outside
The control and regulation parameter feedback for playing one or more video timestamp extraction elements of monitoring in system is signally attached to
The adjustment parameter signal receiving end of video timestamp system, at this moment video timestamp system can real-time reception regulation ginseng
Number feedback, and video timestamp is adjusted in real time.
The time Mk system of above-mentioned video as shown in Figures 2 and 4, can include a code device 210, a regulation dress
Put 220 and a synthesizer 230.Code device 210 is used to be that each image generation one includes the image in source video signal
Association in time information Image Coding.Adjusting means 220 is used to obtaining adjustment parameter, image in the source video signal
Width and height, described image coded modulation into the geometry controlled by adjustment parameter, to generate the source video signal
In image time mark.One synthesizer 230 is used to synthesize the time of each image and image mark in source video signal
Remember to generate time marking video signal.
Several specific embodiments of the present invention are described below in conjunction with the accompanying drawings.
First embodiment
First embodiment provided by the invention is described with reference to Fig. 2 to Fig. 3.Fig. 2 shows real according to the present invention first
Apply the DFD of the time labeling method of the video of example.When Fig. 3 shows the rectangle two-dimensional bar code of first embodiment of the invention
Between mark geometry schematic diagram, that is, in Fig. 7 the simple two-dimensional strip pattern time mark.
In the time Mk system of the video of first embodiment, time labeling method is operated using manual mode.Such as Fig. 2
Shown, time mark by default adjustment parameter by adjusting the generation of two-dimensional bar code coding image.It can preset using QR bis-
Barcode types are tieed up, and are encoded with 21 points.It is 3 (namely two-dimentional to preset time mark adjustment control adjustment parameter
3 pixels are a little represented in bar code).The video file of video file Y4M forms is used in first embodiment, its resolution ratio is
1080p, frame per second are that 24 frames are per second.Code device 210 passes through QR-1Level- using the frame number of each image as temporal information
Q encodes the Image Coding for making binaryzation.
As shown in Figure 3 601 be the origin of coordinates of image, and 602 be the skew angle point of Image Coding, and 603 be Image Coding
Line width is the frame of 1 point, and 604 be the luminance component (Y-component is such as taken in YUV image) of video image, and 605 be 21 points
QR-1Level-Q two-dimensional bar codes, controlling to adjust parameter s, (in the present embodiment, its value is the pixel for 3) being used for controlling 1 point to represent
Number.
Adjusting means 220 increases the frame that 1 point is line width as shown in Figure 3, in the surrounding of Image Coding, rear using default
Control and regulation parameter s (being defaulted as 3) be amplified, by fixed-corner offset P (20,20) translate after, make binaryzation
Time marks.The geological information that synthesizer 230 as shown in Figure 2 marks association in time information, time is (for example, the time marks
Width, height, frame line width etc.) be saved in journal file, time mark is directly superimposed to the Y-component of image as shown in Figure 3
In, keep the UV component datas of image constant, make time marking video signal, and the time mark for saving as Y4M forms regards
Frequency file.
In the time marking video file for preserving out in the first embodiment, in the Y-component in each YUV image
Fixed position has been superimposed the square area that a length of side is s × (21+2), wherein containing a QR-1 for encoding frame number
Two-dimensional bar code.
In the first embodiment, caused video file can carry out various video processing bag through other video applications
Include：Frame rate adjustment, scaling, with other Video Composition editors, coding, network transmission, decoding, denoising, image enhaucament, still can be with
Using a two-dimensional bar code reading device, extract real-time goes out the original frame number of every two field picture at the arbitrary node of Video processing
And current time mark position and the geological information of size, the interior details for monitor video processing provide beneficial auxiliary
Information.
" circle " point (qr distinguishes sample) in Figure 15 is to apply the present embodiment to carry out at through different resolution diminution
The recognition accuracy rate statistics sample point in the experiment of time mark is distinguished after reason again.During experiment using 3 pixels it is wide two
Dimension bar code code-point (controlling to adjust parameter s=3) 21 point QR two-dimensional bar codes of generation make time mark and are added to one section of 600 breadth
In the vision signal of high 1080 pixel image of 1920 pixels, after a variety of various sizes of video diminution processing, one two is sent into
Bar code reader is tieed up, recognition data when collecting each minification carry out distinguishing accuracy rate statistics, and the qr obtained in figure knows
Read sample point.Abscissa is that video is wide (P) by the mean pixel of the two-dimensional bar code code-point in time mark after Scaling, is existed
Sub-pix width is represented with floating number.Ordinate is the recognition accuracy rate (A) of time mark, and 1 is all distinguishes successfully, and 0 is complete
Portion's recognition failure.Dotted line in figure distinguishes the S type matched curves of sample for qr, and its mathematic(al) representation is：
After two-dimensional bar code code-point mean pixel is wide is less than 2.0 pixel, the recognition accuracy rate of two-dimensional bar code reduces rapidly；When
Accuracy rate is distinguished during less than after 1.5 pixels and is reduced to only 50%.
Second embodiment
Second embodiment provided by the invention is described with reference to Fig. 4.Fig. 4 is shown according to a second embodiment of the present invention
The DFD of the time labeling method of video.
In the time Mk system according to the video of the second embodiment of the present invention, time labeling method is using automatic side
Formula works.As shown in figure 4, code device 210 connects the external video harvester conduct of collection YUV image vision signal in real time
Source video signal, step S101 as shown in Figure 1 generate association in time information and volume in real time for every two field picture of source video signal
Code image.The step S102 of adjusting means 220 as shown in Figure 1 generates time mark in real time, and optionally, when also receiving outside
Between mark extraction monitoring device 400 feed back error signal as regulation adjustment parameter control signal.For example, when in 5 second time
When time mark recognition incorrect integration is more than 10 times, time mark shape regulation adjustment parameter is added 1 (when the area of time mark
When need to be equal to 5% of single image area in the source video, the adjustment parameter geometric form that influence time does not mark of regulation
Shape).The step S103 of synthesizer 230 as shown in Figure 1 the time mark be fused to made among the image of source video signal when
Between marking video signal, be sent to external video processing device or Video processing network 300, and optionally, while the time
Related information, the geometric data of time mark are sent to external auxiliary information monitoring device from auxiliary signal passage real-time synchronization
500.External video processing device or Video processing network 300 alternatively, in processing procedure or processing after vision signal
Give external time-stamp extraction monitoring device 400.
In second embodiment, caused time marking video signal can be through external video processing device or Video processing net
Network, which carries out various video processing, to be included：Frame rate adjustment, scaling, with other Video Composition editors, coding, network transmission, decode, go
Make an uproar, image enhaucament, the external time-stamp extraction monitoring device for including a two-dimensional bar code reading device still can be used to exist
Extract real-time goes out the original frame number and current time mark position and chi of every two field picture at the arbitrary node of Video processing
Very little geological information.Optionally, can phase between external auxiliary information monitoring device and external time-stamp extraction monitoring device
The mutually geological information of association in time information contained in confirmation time mark and time mark, is at video process apparatus or video
Manage network and beneficial auxiliary information is provided.
3rd embodiment
3rd embodiment provided by the invention is described with reference to Fig. 5 and Fig. 6.Fig. 5 shows third embodiment of the invention
The surrounding bar code arrowband time mark geometry schematic diagram.Fig. 6 is shown in the video of the synthesis of third embodiment of the invention
The luminance component schematic diagram of image, that is, the surrounding Bar time mark listed in Fig. 8.
Similar with second embodiment in the time Mk system of the video of 3rd embodiment, time labeling method can adopt
Worked with automated manner.Unlike first embodiment and second embodiment, in the third embodiment, when code device uses
Between stamp be used as association in time information, and generate coded image by bar code code-128.
In the third embodiment, the scheme for the time mark geometry that adjusting means uses is as shown in Figure 5.Geometric element
501 signals are used the coded image of code-128 generations by code device according to timestamp, are respectively placed in by replicating, rotating
The position of four coded image areas 502,509,507,505.This four coded image areas are just in source video signal
On four sides of image, i.e., the minimum rectangle size comprising this four coded image areas is exactly equal to image in source video signal
Size.
Such as Fig. 5, the time of 3rd embodiment is marked in geometry scheme, and four coded image areas junction places four
Individual solid rectangle is as localization region 504,508,510,506.Localization region 504,508,510,506 and coded image are placed
One section of narrow blank is suitably filled between region 502,509,507,505 to show isolation.When generating time mark, Mei Geding
Position region 504,508,510,506 it is wide and high all equal, when the length of side of localization region 504,508,510,506 can be used as regulation
Between mark geometry adjustment parameter.
Such as Fig. 5, in the time mark geometry scheme in 3rd embodiment, inside that four coded image areas surround
Rectangular area 503 is transparent region, and the picture material in source video signal will be placed when being synthesized with source video signal.
The time mark that Fig. 5 illustrates directly is superimposed upon image in source video signal by the synthesizer in 3rd embodiment
Luminance component (i.e. Y-component) on, the banding frame region of surrounding is respectively by four localization regions 504,508,510,506, four
Individual coded image area 502,509,507,505 covers, and inner rectangular region 503 is then unmodified luminance component image
Content.The luminance component (Y-component) of vision signal with time mark is as shown in Figure 6.(i.e. UV points of the chromatic component of image
Amount) do not make an amendment.
" triangle " point (bar distinguishes sample) in Figure 15 is to apply the present embodiment to carry out at through different resolution diminution
The recognition accuracy rate statistics sample point in the experiment of time mark is distinguished after reason again.Using the bar that 3 pixels are wide during experiment
Code width (controlling to adjust parameter s=3) generation code-128 bar codes make time mark and are added to one section of 600 pixel of breadth 1920
In the vision signal of high 1080 pixel image, after a variety of various sizes of video diminution processing, time mark recognition dress is sent into
Put, recognition data when collecting each minification carry out distinguishing accuracy rate statistics, obtain the bar recognition sample points in figure.It is horizontal
Coordinate is that video is wide (P) by the pixel of the bar code in time mark after Scaling, sub-pix width be present and is represented with floating number.
Ordinate is the recognition accuracy rate (A) of time mark, and 1 is all distinguishes successfully, and 0 fails for all recognition.Solid line in figure is
Close to the staircase curve of bar recognition samples, its mathematic(al) representation is：
After bar code pixel wide is less than 0.5 pixel, the recognition accuracy rate of bar code reduces rapidly.Compared to two-dimensional strip pattern
Time mark, the Bar time mark nonshrink small deformation ability it is stronger.Compared to first embodiment and second embodiment,
Localization region in three embodiments is distributed in the corner of image, using the teaching of the invention it is possible to provide the more shape information of correct time mark.
The time labeling method and system of video provided by the invention cause each image in time marking video signal
The original time related information of the image has been merged in content, when in use between marking video signal pass through transmission of video and processing
Afterwards, in the case where being changed without the transmission to existing vision signal or the system of processing, so that it may which realization respectively saves from system
The original time related information of each image is traced into vision signal at point or end points.
The illustrative embodiments of the present invention are particularly shown and described above.It should be understood that the invention is not restricted to institute
Disclosed embodiment, on the contrary, it is intended to cover comprising various modifications within the scope of the appended claims and equivalent put
Change.
Claims (15)
- A kind of 1. time labeling method of video, it is characterised in that including：The Image Coding of the association in time information for including the image is generated for each image in source video signal；Adjustment parameter is obtained, described image coded modulation into the geometry controlled by adjustment parameter, is regarded with generating the source The time mark of image in frequency signal；AndThe time of each image and the image is marked to generate time marking video signal in synthesis source video signal.
- 2. time labeling method as claimed in claim 1, it is characterised in that the geometry modulated includes one or more Rectangular area, and the width of the rectangular area and height are by the wide and high of the image of the adjustment parameter and/or the source video signal Control.
- 3. time labeling method as claimed in claim 2, it is characterised in that pressed from the angle point of image default in the rectangular area Angle point offset is offset.
- 4. time labeling method as claimed in claim 2, it is characterised in that the adjustment parameter is in described image coding The pixel quantity that one code-point includes.
- 5. time labeling method as claimed in claim 2, it is characterised in that the geometry modulated includes multiple rectangle regions Domain, it is different described filled with being filled with identical described image coding, the plurality of rectangular area in the plurality of rectangular area Blank map picture in Image Coding or the plurality of rectangular area is combined into an Image Coding.
- 6. time labeling method as claimed in claim 2, it is characterised in that the acquisition adjustment parameter, described image is compiled Code is modulated into the geometry controlled by adjustment parameter, the step of mark with generating the time of the image in the source video signal Also include：One or more localization regions are generated, one or more of localization regions are used for auxiliary positioning Image Coding in the figure Position as in.
- 7. time labeling method as claimed in claim 6, it is characterised in that described image coding is located at two positioning areas Between domain.
- 8. time labeling method as claimed in claim 6, it is characterised in that described image encodes and three localization regions The line of centres be rectangle.
- 9. time labeling method as claimed in claim 6, it is characterised in that the width or length of the localization region are as institute State adjustment parameter.
- 10. time labeling method as claimed in claim 1, it is characterised in that the acquisition adjustment parameter, described image is compiled Code is modulated into the geometry controlled by adjustment parameter, the step of mark with generating the time of the image in the source video signal Also include：Receive the feedback of an external device (ED) whether can distinguish it is punctual between mark to adjust the value of adjustment parameter increase by 1 or reduce 1, it is described it is punctual between mark generated before the time marks by with time mark identical mode.
- 11. time labeling method as claimed in claim 1, it is characterised in that the area of the time mark is less than or equal to institute State 5% of single image area in source video.
- 12. time labeling method as claimed in claim 1, it is characterised in that each image in the synthesis source video signal And the time mark of the image is also included with generating the step of time marking video signal：The luminance component and chromatic component of the image of the source video signal are obtained using luminance-chrominance image form；Time mark is converted into light and shade luminance bit picture figure；According to the time, the geological information of mark is added in the luminance component of described image, keeps the colourity point of described image Measure constant, the luminance component of superposition is synthesized with the chromatic component to form the image with time mark, when having Between the sequence of image that marks form the time marking video signal.
- 13. the time labeling method as described in any one of claim 1 to 12, it is characterised in that the association in time packet Include one or more in the frame number of each image in the source video signal, sampling time stamp, time-varying information.
- 14. the time labeling method as described in any one of claim 1 to 12, it is characterised in that described image coding includes：Bar It is one or more in code, two-dimensional bar code, figure, image, text, form of painting, binary bits string.
- A kind of 15. time Mk system of video, it is characterised in that including：One code device, for generating the figure of the association in time information for including the image for each image in source video signal As coding；One adjusting means, adjustment parameter is obtained, described image coded modulation into the geometry controlled by adjustment parameter, with life Time into the image in the source video signal marks；AndOne synthesizer, regarded for synthesizing the time of each image and image mark in source video signal with generating time mark Frequency signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710765863.1A CN107566837B (en) | 2017-08-30 | 2017-08-30 | The time labeling method and system of video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710765863.1A CN107566837B (en) | 2017-08-30 | 2017-08-30 | The time labeling method and system of video |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107566837A true CN107566837A (en) | 2018-01-09 |
| CN107566837B CN107566837B (en) | 2019-05-07 |
Family
ID=60978602
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710765863.1A Active CN107566837B (en) | 2017-08-30 | 2017-08-30 | The time labeling method and system of video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107566837B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108235119A (en) * | 2018-03-15 | 2018-06-29 | 联想(北京)有限公司 | Method for processing video frequency and device, electronic equipment and computer-readable medium |
| CN115665422A (en) * | 2022-10-24 | 2023-01-31 | 昆易电子科技(上海)有限公司 | Video data transmission method, system, injection method and electronic equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105340283A (en) * | 2013-08-09 | 2016-02-17 | 索尼公司 | Transmission apparatus, transmission method, reception apparatus, reception method, encoding apparatus, and encoding method |
| US20170078663A1 (en) * | 2015-09-11 | 2017-03-16 | Beamr Imaging Ltd. | Video Coding Apparatus and Method |
-
2017
- 2017-08-30 CN CN201710765863.1A patent/CN107566837B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105340283A (en) * | 2013-08-09 | 2016-02-17 | 索尼公司 | Transmission apparatus, transmission method, reception apparatus, reception method, encoding apparatus, and encoding method |
| US20170078663A1 (en) * | 2015-09-11 | 2017-03-16 | Beamr Imaging Ltd. | Video Coding Apparatus and Method |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108235119A (en) * | 2018-03-15 | 2018-06-29 | 联想(北京)有限公司 | Method for processing video frequency and device, electronic equipment and computer-readable medium |
| CN115665422A (en) * | 2022-10-24 | 2023-01-31 | 昆易电子科技(上海)有限公司 | Video data transmission method, system, injection method and electronic equipment |
| CN115665422B (en) * | 2022-10-24 | 2024-08-02 | 昆易电子科技(上海)有限公司 | Video data transmission method, system, injection method and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107566837B (en) | 2019-05-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20170293992A1 (en) | Image code for processing information and device and method for generating and parsing same | |
| US11423243B2 (en) | Systems and methods for generating and reading intrinsic matrixed bar codes | |
| US5946414A (en) | Encoding data in color images using patterned color modulated image regions | |
| US10334285B2 (en) | Apparatus, system and method | |
| US10360651B1 (en) | Compatible adaptive video watermarking | |
| US7997491B2 (en) | Thin film transistor liquid crystal display barcodes | |
| US8958628B2 (en) | Image scaling | |
| JP6316910B2 (en) | Reference card for scene-based metadata capture | |
| CN107615330A (en) | For robust signaling and synchronous sparse modulation | |
| CN107566837B (en) | The time labeling method and system of video | |
| EP1044432A1 (en) | Improved image conversion and encoding techniques | |
| CN108513134A (en) | According to the method and apparatus of decoded image data reconstructed image data | |
| MXPA06001533A (en) | Machine readable data. | |
| US20110194726A1 (en) | Embedded Message Extraction For Visible Watermarking | |
| CN106686333A (en) | Method for producing video added watermarks for Android equipment | |
| CN107736032A (en) | Reception device, method of reseptance, transmitting device and transmission method | |
| CN103428575B (en) | Encoding and decoding control method of information overlaid in media stream or media file images | |
| CN110334647A (en) | A kind of parameter format method based on image recognition | |
| US8243985B2 (en) | Bit pattern design for visible watermarking | |
| CN107247984B (en) | Coding method of visual two-dimensional code | |
| US11216662B2 (en) | Efficient transmission of video over low bandwidth channels | |
| CN105025361A (en) | Real-time station caption eliminating method | |
| CN114549270A (en) | Anti-shooting monitoring video watermarking method combining depth robust watermarking and template synchronization | |
| US8300882B2 (en) | Data adaptive message embedding for visible watermarking | |
| US20210203994A1 (en) | Encoding data in a source image with watermark image codes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |