CN104185081B - The method of time is shown in the image played using real-time transport protocol packet - Google Patents
The method of time is shown in the image played using real-time transport protocol packet Download PDFInfo
- Publication number
- CN104185081B CN104185081B CN201410172125.2A CN201410172125A CN104185081B CN 104185081 B CN104185081 B CN 104185081B CN 201410172125 A CN201410172125 A CN 201410172125A CN 104185081 B CN104185081 B CN 104185081B
- Authority
- CN
- China
- Prior art keywords
- time
- client
- media server
- rtp packet
- timestamp
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000012937 correction Methods 0.000 claims description 36
- 230000005540 biological transmission Effects 0.000 claims description 11
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 239000000654 additive Substances 0.000 claims description 4
- 230000000996 additive effect Effects 0.000 claims description 4
- 235000013399 edible fruits Nutrition 0.000 claims 1
- 238000004891 communication Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 238000010276 construction Methods 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
Abstract
Disclose the method that the time is shown in the image played using real-time transport protocol (RTP) packet, which comprises played from client to media server request image；Real-time streaming protocol (RTSP) packet is exchanged between client and media server；It will include that the first RTP packet stabbed at the first time is sent to client by media server, record has the first time of the first picture frame in first time stamp；Current time will be set as by client at the first time, and current time is shown on the first picture frame；Client is sent by the 2nd RTP packet including the second timestamp by media server, record has the second time of the time difference between the time and first time of the second picture frame of instruction in the second timestamp；Current time is set by the addition result at the first time with the second time by client, and current time is shown on the second picture frame.
Description
This application claims Korea Spro 10-2013-0057957 submitted on May 22nd, 2013 in Korean Intellectual Property Office
The disclosure of the equity of state's patent application, this application is hereby incorporated by reference in its entirety.
Technical field
One or more embodiments of the invention is related to a kind of in the image played using real-time transport protocol (RTP) packet
The method for showing the time.
Background technique
Building automation system (BAS) includes building facility, field device (sensor etc.), is connected to hardware to control
The controller of hardware processed and last soft to monitor and control the building of building facility and field device with controller cooperation
Part.BAS purpose be to make building amenity, rapid treatment facility alarm generation and reduce energy consumption and cost.In BAS,
Supervision camera for the environment around monitoring is installed around building facility, wherein the timestamp of each packet is used to show
Show the time that the image of supervision camera is reproduced, and timestamp is used to the time difference between display picture frame.
Come in the presence of real-time send media data (such as real time media broadcast or video conference information) through internet or interior
The high demand of networking driving media data, and have been proposed implementing transport protocol (RTP) to meet in a network to broadband
Request, and many media apparatus are used for RTP recently.32 of correct time of the RTP packet including not indicating image
Timestamp, but 32 timestamps are able to use family and know that the relative time sampled between two or more image streams closes
System.RTCP Real-time Transport Control Protocol (RTCP) is used as monitoring RTP data transmission state or sending information associated with the session
Agreement, RTCP packet include Network Time Protocol (NTP) timestamp and RTP timestamp, wherein can be obtained by NTP timestamp
Obtain absolute time information.If client needs to show correct time information, it is recommended to use RTCP packet.However, many media
Server is since the limitation of bandwidth etc. may seldom provide RTCP packet, in the case, by the timestamp meter that RTP packet is used only
The relative time calculated between packet is poor, to show the time quantum of the most media being reproduced.For example, when media are reproduced in total
At 30 minutes, according to image stream display reproduction time difference (5 minutes, 10 minutes etc.).
As the media server used for safety, digital video recorder (DVR) or network video recorder
(NVR) image that record is captured by supervision camera when an event occurs, and in the following image for playing these records, it can
It can need to know the absolute time of each image in the image of these records.Each record should be known using RTCP packet
The absolute time of image, but if media server does not provide RTCP packet, need to obtain using only the RTP in client
The research of absolute time.
Summary of the invention
One or more embodiments of the invention includes such method: when in the figure for storing monitored cameras capture
When transmitting image between media server and building automation system (BAS) server of picture, display uses implementation transport protocol
(RTP) time for the image that packet plays uses RTP packet to calculate and show in building automation system (BAS) server
The correct time of the image of broadcasting.
Additional aspect will be set forth in part in the description which follows, and this part will be apparent from the description, or
Person can be learnt by the practice of the embodiment of presentation.
One or more embodiment according to the present invention, a method of the time of display image, wherein as by media
Server plays described image, the matchmaker according to real-time transport protocol (RTP) packet for the method that the request of client sends image
Body server stores the image captured by supervision camera, which comprises by client, broadcasts to media server request image
It puts；Real-time streaming protocol (RTSP) packet is exchanged between client and media server；It will include at the first time by media server
First RTP packet of stamp is sent to client, records the first time for having the first picture frame in stamp at the first time；It will be from by client
The first time that stamp is read at the first time is set as current time, and current time is shown on the first picture frame；By media
The 2nd RTP packet including the second timestamp is sent client by server, and record has the second image of instruction in the second timestamp
The second time of time difference between the time and first time of frame；By client, will be read at the first time and from the second timestamp
The addition result of the second time taken is set as current time, and current time is shown on the second picture frame.
First RTP packet can be the picture frame for being sent to client from media server for the first time.
Media server can be converted at the first time based on the second and be recorded in the first time based on the second and stabbed at the first time
In.
Client can set current time for the first time being stored in stamp at the first time based on the second, and in the first figure
As showing current time on frame.
First RTP packet can be the current image frame from the multiple images frame that media server is sent to client.
Media server can be based on the second time of frequency conversion, and the second time based on frequency was recorded in for the second time
On stamp, the second time indicated the time difference between the time and first time of the second picture frame.
Client can will be converted to the second time based on the second based on the second time that frequency is stored in the second timestamp,
The current time of the second picture frame will be set as with the additive value of the second time at the first time, and display should on the second picture frame
Current time.
The method may also include that if the second time is less than the capacity for the second time stamp setting, by media services
The extended field in the 2nd RTP packet is set null value by device；If the second time was more than the capacity for the second time stamp setting,
It is determined and is overlapped by media server；When overlap occurs, the second time after correction is generated by media server；Pass through matchmaker
Body server determine the second time after correction whether be more than for the capacity of the second time stamp setting, if after correction second when
Between be more than for the second time stamp setting capacity, then generate again correction after the second time；It will include the by media server
2nd RTP packet of two timestamps is sent to client, and record has the second time after correction or corrects again in the second timestamp
The second time afterwards.
The second time after correction can be the second time subtract capacity for the second time stamp setting as a result, school again
The second time that the second time after just can be after correction subtracts as the capacity of the second time stamp setting, and the after correction
Two times were less than the result until the capacity for the second time stamp setting.
The method may also include that if the second time after correcting is less than the capacity for the second time stamp setting, lead to
It crosses media server and sets the first value for the extended field in the 2nd RTP packet；It will include the second time by media server
2nd RTP packet of stamp is sent to client, and record has the second time after correction in the second timestamp.
The method may also include that if client detects that the extended field in the 2nd RTP packet is not null value, by visitor
Family end, determination overlap；By client, confirm that the extended field in the 2nd RTP packet is arranged to the first value；By client,
It will be set as current time for the addition result of the second time and first time after the capacity of the second time stamp setting, correction,
And current time is shown on the second picture frame.
The method may also include that if the second time after correcting is more than the capacity for the second time stamp setting, by
The extended field in the 2nd RTP packet is set second value by media server；The after correcting again is generated by media server
Two times；Client is sent by the 2nd RTP packet including the second timestamp by media server, is recorded in the second timestamp
The second time after having correction again.
The second time that the second time after correcting again can be after correction subtracts as the capacity of the second time stamp setting
The second time after correction is less than the result until capacity for the second time stamp setting.
The method may also include that the head that the final number of subtraction is recorded in the 2nd RTP packet by media server expands
It opens up in field.
The method may also include that if client detects that the extended field in the 2nd RTP packet is not null value, by visitor
The determination of family end overlaps；Confirm that the extended field in the 2nd RTP packet is arranged to second value by client；By client,
The final number of subtraction is read from the head extended field in the 2nd RTP packet；It will be corresponding with the final number of subtraction by client
For the second time stamp setting capacity, correct again after the second time and the addition result of first time be set as current when
Between, and current time is shown on the second picture frame.
Detailed description of the invention
From with reference to the accompanying drawing to the description of embodiment, these and or other aspects will be apparent and it is more readily appreciated that
In the accompanying drawings:
Fig. 1 is the block diagram for the system for showing the time for the image for using RTP packet to play；
Fig. 2 shows the configurations of RTP packet；
Fig. 3 is signal flow diagram of the display according to an embodiment of the present invention using the method for the time of the image of RTP packet broadcasting；
Fig. 4 is the flow chart of the countermeasure of media server when overlapping in Fig. 3；
Fig. 5 is the flow chart of the countermeasure of client when overlapping in Fig. 3.
Specific embodiment
The present invention allow it is various types of be altered or modified and formal various changes, will show in detail in the accompanying drawings
Specific embodiment is described in detail out and in the description.However, it should be understood that specific embodiment does not limit the invention to specifically
Open form, and various modifications, equivalent or replacement the form being included in spirit and technical scope of the invention.Following
In description, it is not described in detail known function or construction, in order to avoid make the present invention fuzzy due to unnecessary details.
Although such as term of " first " and " second " can be used to describe various elements, these elements are not by term
Limitation.Term can be used to come particular element and another part classification.
The term used in this application is only used for description specific embodiment, without limiting the present invention with any intention.It is single
The expression of number form formula includes the expression of plural form, unless they are differed considerably from one another within a context.In this application, Ying Li
The term of solution such as " comprising " and " having " is used to refer to feature, quantity, step, operation, element, part or its group implemented
The presence of conjunction, without excluding depositing for other one or more features, quantity, step, operation, element, part or combinations thereof in advance
Or addition.
In order to understand the present invention, label is disclosed, and use specific term in the exemplary embodiment being shown in the accompanying drawings
To describe exemplary embodiment of the present invention.However, the present invention is not limited by these specific terms, and the present invention may include this
The all components that field those of ordinary skill can normally occur.This hair can be indicated using functional block and various processing steps
It is bright.These functions can be realized fastly by the hardware and/or software configuration of the various quantity for executing specific function.For example, this
The direct circuit construction that various functions are realized under the control of one or more processors or other control devices can be used in invention,
For example, memory, processing logic, look-up table etc..The sheet performed various functions with software programming or software element is able to use
The component of invention is similar, the various calculations that the available combination with data structure, processing, thread and/or other program components is realized
Method realizes the present invention by programming or scripting language (such as C, C++, Java or compilation).It is handled using in one or more
The algorithm executed in device is come in terms of realizing functionality.In addition, the present invention can be used for electronic environment setting, signal processing and/
Or the prior art of data processing.The term of such as " machinery ", " element ", " device " and " construction " can be widely used, and
It is not limited to mechanical and physique.Term may include a series of meaning of software threads associated with processor.
It reference will now be made in detail to embodiment now, the example of embodiment is shown in the accompanying drawings, the table always of the identical label in attached drawing
Show similar elements.In this regard, the present embodiments may have different forms, and it is not necessarily to be construed as being restricted to set forth herein retouch
It states.Therefore, below only by reference to description embodiment to explain various aspects of the invention.As used herein, term
"and/or" includes any and all combination for the project that one or more correlations are listed.
Fig. 1 is the block diagram for the system for showing the time of the image played using real-time transport protocol (RTP) packet.Reference
Fig. 1, system may include at least one supervision camera 100, the media server 200 as safety device and as client
Building automation system (BAS) server, wherein media server 200 includes that storage is captured by least one supervision camera 100
Image digital video recorder (DVR) or network video recorder (NVR).At least one supervision camera 100, media services
Device 200 and BAS server 300 are connected to each other in a manner of wiredly and/or wirelessly by network, to execute data communication.
At least one supervision camera 100 is installed in around facility, to shoot ambient enviroment and send the image of capture
To media server 200.BAS server 300 can request image to play to media server 200, and monitor from media server
200 real-time receptions to the image captured by least one supervision camera 100.
At this point, media server 200 and BAS server 300 send and receive image data according to RTP communication procedure.When
When media server 200 sends image data to BAS server 300 in real time, RTP be used to smoothly need the figure of wide bandwidth
As the real-time Transmission of data.
Before media server 200 sends RTP packet to as the BAS server 300 of client, media server
200 and BAS server 300 exchanges real-time streaming protocol (RTSP) packet.RTSP packet is indicated in media server 200 and BAS server
The control information (description, setting, broadcasting etc.) exchanged between 300 is to initialize RTP communication.By exchanging RTSP packet, BAS service
Device 300 is authenticated by media server 200, and is sent and received by RTSP packet and received image data from media server 200
Required information before.Finally, being sent to media services from BAS server 300 by PLAY order before receiving RTP packet
Device 200, wherein BAS server 300 sends media server 200 for the image request time by PLAY order.Media services
The image data for the time requested by BAS server 300 or the figure with the time immediate time of request can be transmitted in device 200
As data are as RTP packet.That is, BAS server 300 can not receive the image data of the time of request.
Fig. 2 shows the configurations of RTP packet.Referring to Fig. 2, RTP packet includes 32 timestamps 21, which reacts
The sampling instances of RTP data octets.As soon as whenever having sent a picture frame, media server 200 calculates previous (first)
Time difference between picture frame and currently (second) image are true, frequency (Hz) will be converted to the time difference, frequency (Hz) will be recorded in
In the timestamp 21 of each RTP packet, BAS server 300 is sent by RTP packet.BAS server 300 is by receiving each RTP packet
To form a picture frame, wherein BAS server 300 is calculated between previous image frame and current image frame based on picture frame
Frequency (Hz) is converted to Coordinated Universal Time(UTC) (UTC: instruction absolute time or current time) by the time difference, and being played on
Elapsed time value is shown in image.That is, can perceive when using the timestamp 21 of each RTP packet in RTP packet
Between elapsed time or the elapsed time between the picture frame being made of multiple RTP packets.
However, in order to obtain the correct time value of picture frame, BAS server 300 should receive reality from media server 200
When transmission control protocol (RTCP) wrap.The offer of RTCP packet sends and receives or controls external information relevant to RTP image stream
Method.More specifically, the function as RTCP packet, firstly, notice believes the absolute time (UTC) of the image stream sent
The total quantity of breath and RTP timestamp and the image packet of transmission.Secondly, by the shake of the image stream received, packet loss and estimating
The communication delay value of meter is sent to sender.Third notifies the letter of title, e-mail address of image stream sender etc.
Breath.4th, when source of media leaves session, which is notified to another party.5th, the RTCP packet of extension is provided.RTCP packet
Not actual image information, for controlling the additional information of RTP data, and since RTP packet needs wide bandwidth, because
This sends RTCP packet only to account for entire 0.5% amount for sending data volume.The percentage can according to circumstances change, and matchmaker
The transmission percentage of the control RTCP packet of body server 200.As described above, RTCP packet carries RTP timestamp and absolute time
(UTC).If client (including 300) periodically receives absolute time, which can get currently being played
The correct time of picture frame.However, many media servers (including 200) may due to bandwidth etc. limitation and seldom provide
RTCP packet, in such a case, client are not easy to obtain the correct time of picture frame.
Therefore, according to an embodiment of the invention, in order to overcome the limitation, firstly, when BAS server 300 requests media to take
When business device 200 sends image, media server 200 is based on second conversion current time, records in the timestamp 21 of the first RTP packet
Current time based on the second, and BAS server 300 is sent by the first RTP packet.According to RTP communication procedure, random value is inserted into
In the timestamp 21 of first RTP packet.Since random value is replaced by current time value, meet RTP communication procedure.Therefore, BAS
Server 300 can obtain current time from the timestamp 21 of the first RTP packet received.
Second, when sending next RTP packet, media server 200 stabs 21 turns based on the first time of transmission based on frequency
Change the time difference with previous image frame, the time difference based on frequency be recorded in the timestamp 21 of next image frame, and will under
One picture frame is sent to BAS server 300.
When receiving RTP packet from media server 200 every time, BAS server 300 will all be recorded in each RTP packet
Time difference based on second of the frequency conversion between previous image frame and current image frame in timestamp 21 continues conversion
Time difference is added to the current time being recorded in the timestamp of the first RTP packet received, thus when obtaining accurately current
Between.
According to RTP communication procedure, since the capacity being arranged for timestamp 21 is 32 bits (232- 1=4294967295), because
Certainly there is limitation in the expression of this time.That is, may in the value of the timestamp 21 received from media server 200
There is overlapping phenomenon.In other words, it is possible to which the value that the timestamp 21 of each RTP packet occurs continues to increase showing of then reducing rapidly
As.When overlap occurs, BAS server 300 is calculated between picture frame by using the algorithm in BAS server 300 and is increased
Time value.
However problem is, media server 200 may not record any image in the given time, rather than all
Time in persistently record image.When non-registering time interval is 47721 seconds or is longer, overlap.When non-registering
When time interval is 95443 seconds or is longer, also overlap.This is because being 32 bits for the capacity that timestamp 21 is arranged.BAS
Server 300 cannot know the value for not recording time interval for leading to overlapping.Therefore, it will now be described according to embodiments of the present invention
, accurate intra-record slack byte is notified to BAS server 300 by media server 200, in BAS server 300 accurately
The method for showing image play time.
Fig. 3 is signal flow diagram of the display according to an embodiment of the present invention using the method for the time of the image of RTP packet broadcasting.
The description carried out referring to Figures 1 and 2 is not repeated herein.
Referring to Fig. 3, in operation S100, BAS server 300 requests media server 200 to play with image.
In operation S110 and S120, RTSP packet is exchanged between media server 200 and BAS server 300, as being used for
The control information of RTP communication between initial media server 200 and BAS server 300.
After the exchange for completing RTSP packet, in operation S130, media server 200 will include the first of stamp at the first time
RTP packet is sent to BAS server 300, and the first time of the first picture frame is had recorded in first time stamp.First RTP packet can
To be the picture frame for being sent to BAS server 300 from first server 200 for the first time.In the case, media server 200
It is converted at the first time based on the second, and the first time based on the second is recorded in the timestamp 21 of the first RTP packet.First RTP packet
It can be the current image frame from the multiple images frame that media server 200 is sent to BAS server 300.In the case,
It can be the time difference between the time of current image frame and the time of previous image frame at the first time, media server 200 can
It is converted at the first time based on frequency (Hz), and the first time based on frequency is recorded in the timestamp 21 of the first RTP packet.
It, will be from the first time from the BAS server 300 that media server 200 receives the first RTP packet in operation S140
The first time that stamp is read is set as current time, and current time is shown on the first picture frame.First RTP packet can be
The picture frame received by 300 first time of BAS server from media server 200.In the case, BAS server 300 is based on
The first time that second will be stored in stamp at the first time is set as current time and shows current time on the first picture frame.The
One RTP packet can be by BAS server 300 from the current image frame in the multiple images frame that media server 200 receives.?
In this case, can be between the time for the current image frame converted based on frequency and the time of previous image frame at the first time
Time difference, BAS server 300 will can be converted at the first time the first time based on the second, by the previous time and this first when
Between additive value be set as current time, and show current time on the first picture frame.
In operation S150, the 2nd RTP packet including the second timestamp is sent BAS server by media server 200
300, there is the second time of the time difference between the time and first time of the second picture frame of instruction in record in the second timestamp.
2nd RTP packet can be second of picture frame that BAS server 300 is sent to from media server 200.In the case, matchmaker
Body server 200 indicates the of the time difference between the time of the second picture frame and the time of the first picture frame based on frequency conversion
Two times, and the second time based on frequency is recorded in the timestamp 21 of the 2nd RTP packet.2nd RTP packet can be from media
Server 200 is sent to the current image frame in the multiple images frame of BAS server 300.In the case, the second time can be with
It is the time difference between the time of current image frame and the time of previous image frame, media server 200 can be based on frequency (Hz)
It converted for the second time, and the second time based on frequency is recorded in the timestamp 21 of the 2nd RTP packet.
It, will be from the second time from the BAS server 300 that media server 200 receives the 2nd RTP packet in operation S160
The addition result for stabbing the second time and first time read is set as current time, and current time is shown in the second image
On frame.2nd RTP packet can be by second of the picture frame received from media server 200 of BAS server 300.In this feelings
Under condition, when the second time based on frequency for storing in the second timestamp is converted to second based on the second by BAS server 300
Between, current time is set by the addition result of the second time and first time based on the second, and current time is shown
On two picture frames.2nd RTP packet can be by BAS server 300 from the multiple images frame that media server 200 receives
Current image frame.In the case, the second time can be time and the previous image of the current image frame based on frequency conversion
Second time can be converted to the second time based on the second by the time difference between the time of frame, BAS server 300, when will be previous
Between with the additive value of the second time based on the second be set as current time, and show current time on the second picture frame.
Fig. 4 is the flow chart of the countermeasure of media server 200 when overlapping in Fig. 3.It does not repeat to join herein
The description carried out according to Fig. 1 to Fig. 3.
Referring to Fig. 4, in operation S160, the determination of media server 200 is recorded in the second timestamp of the 2nd RTP packet
Whether the second time was greater than for the capacity of the second time stamp setting.According to RTP communication procedure, the capacity being arranged for timestamp 21 is
32 bits (232- 1=4294967295).In addition, the second time indicated current (second) picture frame and previous (first) picture frame
Between time difference.
If the second time is bigger than the capacity for the second time stamp setting, in operation S170, media server 200 is determined
It overlaps.If the second time is smaller than the capacity for the second time stamp setting, media server 200 will be in the 2nd RTP packet
Extension (X) field be set as null value.
In operation S180, as capacity (2 for the second time stamp setting will be subtracted from the second time32- 1=
4294967295) as a result, media server 200 generate correction after the second time.
After the generation for completing the second time after correction, media server 200 is after operation S190 determines correction
Whether the time is bigger than the capacity for the second time stamp setting.
If the second time after correction is less than the capacity for the second time stamp setting, media server 200 is being operated
Extension (X) field in the 2nd RTP packet is set the first value (for example, zero (0)) by S200.Referring to Fig. 2, RTP pack arrangement includes X
Field 22, when X field 22 is arranged to second value, the instruction of X field 22 record in head extended field 23 has additional information.
After setting the first value for the X field 22 in the 2nd RTP packet, media server 200 will be wrapped in operation S210
The 2nd RTP packet for including the second timestamp is sent to BAS server 300, when record has second after correcting in the second timestamp
Between.
On the contrary, if correction after the second time be still greater than as the capacity of the second time stamp setting, media server
200 X field 22 is arranged in the 2nd RTP packet as second value (for example, 1) in operation S220.When X field 22 is arranged to
When two-value, the instruction of X field 22 record in head extended field 23 has additional information.
In operation S230, media server 200 is by subtracting from the second time after correction as the second time stamp setting
Capacity (232- 1=4294967295) generate the second time corrected again, it is second that the second time after correction, which is less than,
Until the capacity of time stamp setting.The second time instruction after correction is subtracted from the second time as the capacity of the second time stamp setting
It is primary as a result, the second time instruction corrected again from the second time subtract for the second time stamp setting capacity twice or more
Multiple result.
After the generation of the second time for completing to correct again, media server 200 operate S240 will be from second when
Between subtract the final number of the capacity for the second time stamp setting and be recorded in the head extended field 23 of the 2nd RTP packet.
After completing for the final number of subtraction to be recorded in an extended field 23, media server 200 is being operated
The 2nd RTP packet including the second timestamp is sent BAS server 300 by S250, and record has school again in the second timestamp
The second time after just.
Fig. 5 is the flow chart when overlapping in Fig. 3 as the countermeasure of the BAS server 300 of client.?
This does not repeat the description carried out referring to figs. 1 to Fig. 4.
Referring to Fig. 5, in operation S260, BAS server 300 is determined from the 2nd RTP packet that media server 200 receives
Extended field whether be null value.
If the extended field in the 2nd RTP packet is not null value, BAS server 300 is determined in operation S270 occurs weight
It is folded.As described above, if the time of current (second) picture frame received be less than previous (first) picture frame time,
The determination of BAS server 300 overlaps.
In case of overlapping, then BAS server 300 is in operation S280 by checking the X field 22 in the 2nd RTP packet
Value, to determine that X field 22 is arranged to the first value or second value.
If X field 22 is arranged to the first value, BAS server 300 will be the second time stamp setting in operation S290
Capacity (232- 1=4294967295), the second time after correction and the addition result of first time be set as current time,
And current time is shown on the second picture frame.
On the contrary, BAS server 300 is in operation S300 from the 2nd RTP packet if X field 22 is arranged to second value
Head extended field 23 read subtraction final number.
Later, BAS server 300 operation S310 by it is corresponding with the final number of subtraction be the second time stamp setting
Capacity ((232- 1=4294967295) × subtraction final number), correction after the second time and first time addition result
It is set as current time, and current time is shown on the second picture frame.
The present embodiment according to the present invention, when sending images to BAS server 300 from media server 200, even if
RTCP packet is provided not from media server 200 to BAS server 300, BAS server 300 can also be (logical by using RTP packet
Spend the RTP packet only easily time difference between perceptual image frame) show the accurate play time of each image.
As described above, with the prior art (when transmitting image between media server and BAS server, using by BAS
The RTP packet that server receives only can easily between perceptual image frame time difference) compare, it is according to the present invention above to implement
Example one or more of, even if not to BAS server provide RTCP packet, can also be calculated using only the RTP packet received with
The correct time of the just played image of display.
The present invention can also be implemented as the computer-readable code in computer readable recording medium.Computer-readable record
Medium is any data storage device for the data that can be read by computer system after can storing.Computer readable recording medium
Example include read-only memory (ROM), random access memory (RAM), CD-ROM, tape, floppy disk, optical data storage devices
And carrier wave (such as being transmitted by the data of internet).Computer readable recording medium can also be distributed on the computer of networking
In system, so that computer-readable code is stored and executed in a distributed fashion.In addition, for completing function journey of the invention
Sequence, code and code segment can simply be explained by the programming personnel for belonging to technical field.
In addition, the other embodiment of the present invention can also by medium (for example, computer-readable medium)/on for controlling
It makes at least one processing element and realizes the computer readable code/instructions of any of the above described embodiments to realize.Medium can correspond to
Allow any medium/media of the transmission of memory and/or computer-readable code.
Using including recording medium (magnetic storage medium (for example, ROM, floppy disk, hard disk etc.), optical recording medium (example
Such as, CD-ROM or DVD), the transmission medium of such as the Internet transmission medium) media example, computer-readable code can be with
Various ways are recorded on medium or are transmitted by medium.Therefore, one or more embodiments according to the present invention, media can
To be such definition and measurable structure for including or carry signal or information, the device of bit stream is such as carried.Medium
It can also be distributed network, so that computer-readable code is in a distributed fashion by storage/transmission and execution.In addition, processing elements
Part may include processor or computer processor, and processing element can be distributed and/or be included in single device.
It should be understood that exemplary embodiment described in the present invention is considered merely as describing significance, rather than in order to
The purpose of limitation.The description of features or aspect for each embodiment should be generally viewed as can be used in other embodiments its
His similar features or aspects.
Although one or more embodiments of the invention is described with reference to the accompanying drawings, those of ordinary skill in the art
It should be understood that in the case where not departing from the spirit and scope of the present invention being defined by the claims, it can be to carry out form of the present invention
With the various changes in details.
Can with by the way that the document of each reference individually and to be specifically incorporated in showing in the present invention and passes through
The document of each reference is totally incorporated in the present invention, identical mode is shown, by all references quoted in present invention text
It offers and is merged into the present invention, citation includes the document delivered, patent application and patent.
Claims (15)
1. a kind of method for the time for showing image, wherein send image according to the request of client as by media server
The realtime transmission protocol RTP packet of method play described image, the media server stores the image captured by supervision camera,
The described method includes:
By client, played to media server request image；
Real-time streaming protocol RTSP packet is exchanged between client and media server；
It will include that the first RTP packet of stamp at the first time be sent to client by media server, record in stamp has the at the first time
The first time of one picture frame；
By client, current time is set by the first time read from first time stamp, and current time is shown the
On one picture frame；
By media server, client is sent by the 2nd RTP packet including the second timestamp, record has finger in the second timestamp
Show the second time of the time difference between the time and first time of the second picture frame；
By client, current time is set by the addition result for the second time read at the first time and from the second timestamp,
And show current time on the second picture frame,
Wherein, the method also includes:
If the capacity that the second time was less than for the second time stamp setting, by media server by the extension in the 2nd RTP packet
Field is set as null value；
If the second time was more than the capacity for the second time stamp setting, the generation of overlapping is determined by media server；
When overlap occurs, the second time after correction is generated by media server.
2. the method for claim 1, wherein the first RTP packet is to be sent to client from media server for the first time
Picture frame.
3. method according to claim 2, wherein media server is converted based on the second at the first time and by first based on the second
Time is recorded in stamp at the first time.
4. method as claimed in claim 3, wherein client sets the first time being stored in stamp at the first time based on the second
It is set to current time, and shows current time on the first picture frame.
5. the method for claim 1, wherein the first RTP packet is the multiple figures for being sent to client from media server
As the current image frame in frame.
6. method as claimed in claim 5, wherein media server is based on the second time of frequency conversion, and will be based on frequency
The second time be recorded on the second timestamp, the second time indicate the second picture frame time and first time between time
Difference.
7. method as claimed in claim 6, wherein the second time that client will be stored in the second timestamp based on frequency
Be converted to the second time based on the second, by the first time and the second time additive value be set as the second picture frame it is current when
Between, and the current time is shown on the second picture frame.
8. the method as described in claim 1, further includes:
Determine whether the second time after correction is more than for the capacity of the second time stamp setting, if after correction by media server
The second time be more than for the second time stamp setting capacity, then generate again correction after the second time；
Client is sent by the 2nd RTP packet including the second timestamp by media server, record has school in the second timestamp
The second time after just or the second time after correcting again.
9. method according to claim 8, wherein the second time after correction is to subtract the second time to set for the second timestamp
The capacity set as a result, again correct after the second time be correction after the second time subtract as the appearance of the second time stamp setting
Amount, the second time after correction are less than the result until capacity for the second time stamp setting.
10. method according to claim 8, further includes:
If the second time after correction is less than the capacity for the second time stamp setting, by media server by the 2nd RTP packet
In extended field be set as the first value；
Client is sent by the 2nd RTP packet including the second timestamp by media server, record has school in the second timestamp
The second time after just.
11. method as claimed in claim 10, further includes:
If client detects that the extended field in the 2nd RTP packet is not null value, by client, determination overlaps；
Confirm that the extended field in the 2nd RTP packet is arranged to the first value by client；
It will be arranged by client for the addition result of the second time and first time after the capacity of the second time stamp setting, correction
For current time, and current time is shown on the second picture frame.
12. method according to claim 8, further includes:
If the second time after correction is more than the capacity for the second time stamp setting, by media server, by the 2nd RTP packet
In extended field be set as second value；
By media server, the second time after correcting again is generated；
Client is sent by the 2nd RTP packet including the second timestamp by media server, recording in the second timestamp has again
The second time after secondary correction.
13. method as claimed in claim 12, wherein the second time after correcting again is to subtract the second time after correction
For the capacity of the second time stamp setting, the second time after correction is less than the knot until capacity for the second time stamp setting
Fruit.
14. method as claimed in claim 13, further includes: by media server, the final number of subtraction is recorded in second
In head extended field in RTP packet.
15. method as claimed in claim 14, further includes:
If client detects that the extended field in the 2nd RTP packet is not null value, by client, determination overlaps；
Confirm that the extended field in the 2nd RTP packet is arranged to second value by client；
By client, the final number of subtraction is read from the head extended field in the 2nd RTP packet；
By client by it is corresponding with the final number of subtraction be the second time stamp setting capacity, again correct after second when
Between and the addition result of first time be set as current time, and current time is shown on the second picture frame.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR10-2013-0057957 | 2013-05-22 | ||
| KR1020130057957A KR101974077B1 (en) | 2013-05-22 | 2013-05-22 | Method for display time in the image being played using RTP packet |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104185081A CN104185081A (en) | 2014-12-03 |
| CN104185081B true CN104185081B (en) | 2019-04-19 |
Family
ID=51965768
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410172125.2A Active CN104185081B (en) | 2013-05-22 | 2014-04-25 | The method of time is shown in the image played using real-time transport protocol packet |
Country Status (2)
| Country | Link |
|---|---|
| KR (1) | KR101974077B1 (en) |
| CN (1) | CN104185081B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102540459B1 (en) | 2016-12-22 | 2023-06-05 | 한화비전 주식회사 | Method and Device for media streaming between server and client using RTP/RTSP standard protocol |
| CN107580264A (en) * | 2017-08-29 | 2018-01-12 | 青岛海信电器股份有限公司 | Multimedia resource play handling method and device |
| CN110971588B (en) * | 2019-10-18 | 2022-06-03 | 浙江华创视讯科技有限公司 | Time processing method, device and system for cross-time-zone conference system and computer equipment |
| CN112565224B (en) * | 2020-11-26 | 2022-08-19 | 北京经纬恒润科技股份有限公司 | Video processing method and device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006014299A (en) * | 2004-06-22 | 2006-01-12 | Lg Electronics Inc | Synchronizing method of video/audio data of mobile communication terminal |
| CN101371488A (en) * | 2006-11-09 | 2009-02-18 | 华为技术有限公司 | Synchronization method and system between different media flows |
| CN101465996A (en) * | 2008-12-31 | 2009-06-24 | 华为技术有限公司 | Method, equipment and system for displaying network television time |
| CN101540897A (en) * | 2008-03-21 | 2009-09-23 | 中国科学院声学研究所 | Interactive television program stream time stamp issuing mechanism for cable TV network |
| WO2011113315A1 (en) * | 2010-03-17 | 2011-09-22 | 中兴通讯股份有限公司 | Stream media live service system and implementation method thereof |
| CN102355605A (en) * | 2011-11-11 | 2012-02-15 | 烽火通信科技股份有限公司 | Live time-shift processing method of IPTV (Internet Protocol Television) set-top box |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100916505B1 (en) * | 2008-02-20 | 2009-09-08 | 한국전자통신연구원 | Method and apparatus for svc video and aac audio synchronization using ntp |
| KR20090126734A (en) | 2008-06-05 | 2009-12-09 | 에스케이씨앤씨 주식회사 | Multimedia messaging service method for voip terminals |
| JP2011029969A (en) * | 2009-07-27 | 2011-02-10 | Mitsubishi Electric Corp | Video monitor display device and video monitoring system |
| KR20110090596A (en) * | 2010-02-04 | 2011-08-10 | 삼성전자주식회사 | Method and apparatus for correcting interarrival jitter |
-
2013
- 2013-05-22 KR KR1020130057957A patent/KR101974077B1/en active IP Right Grant
-
2014
- 2014-04-25 CN CN201410172125.2A patent/CN104185081B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006014299A (en) * | 2004-06-22 | 2006-01-12 | Lg Electronics Inc | Synchronizing method of video/audio data of mobile communication terminal |
| CN101371488A (en) * | 2006-11-09 | 2009-02-18 | 华为技术有限公司 | Synchronization method and system between different media flows |
| CN101540897A (en) * | 2008-03-21 | 2009-09-23 | 中国科学院声学研究所 | Interactive television program stream time stamp issuing mechanism for cable TV network |
| CN101465996A (en) * | 2008-12-31 | 2009-06-24 | 华为技术有限公司 | Method, equipment and system for displaying network television time |
| WO2011113315A1 (en) * | 2010-03-17 | 2011-09-22 | 中兴通讯股份有限公司 | Stream media live service system and implementation method thereof |
| CN102355605A (en) * | 2011-11-11 | 2012-02-15 | 烽火通信科技股份有限公司 | Live time-shift processing method of IPTV (Internet Protocol Television) set-top box |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104185081A (en) | 2014-12-03 |
| KR20140137251A (en) | 2014-12-02 |
| KR101974077B1 (en) | 2019-08-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220303599A1 (en) | Synchronizing Program Presentation | |
| JP5086285B2 (en) | Video distribution system, video distribution apparatus, and synchronization correction processing apparatus | |
| CN104185081B (en) | The method of time is shown in the image played using real-time transport protocol packet | |
| EP2866451A1 (en) | Method and apparatus for IP video signal synchronization | |
| JP4544435B2 (en) | Video quality estimation apparatus, video quality estimation method and program | |
| JP2002084338A (en) | Data transmitter, data receiver and data communication system | |
| CN109714622A (en) | A kind of video data handling procedure, device and electronic equipment | |
| US11101917B2 (en) | Optimizing delay-sensitive network-based communications with latency guidance | |
| CN110062268A (en) | A kind of audio-video sends and receives processing method and processing device with what screen played | |
| TW201249185A (en) | Method for dynamic adaptation of the reception bitrate and associated receiver | |
| WO2016068760A1 (en) | Video stream synchronization | |
| EP2814259A1 (en) | Method, system, capturing device and synchronization server for enabling synchronization of rendering of multiple content parts, using a reference rendering timeline | |
| US7123618B2 (en) | Data transmitting apparatus and data receiving apparatus | |
| CN113542896B (en) | Video live broadcast method, equipment and medium of free view angle | |
| CN105934952B (en) | Method and apparatus for sending and receiving media data in multimedia system | |
| JP2018207152A (en) | Synchronization controller and synchronization control method | |
| US20220294555A1 (en) | Optimizing delay-sensitive network-based communications with latency guidance | |
| JP2010258894A (en) | Video receiving apparatus, method of receiving video, and program | |
| US20190191195A1 (en) | A method for transmitting real time based digital video signals in networks | |
| US20210329348A1 (en) | Memory management in advanced television systems committee (atsc) 3.0 system | |
| US20140082680A1 (en) | Content distribution server system and method for controlling the same | |
| Park et al. | Short-term reliable protocol for low latency video transmission | |
| KR20080075315A (en) | Apparatus and method for compensating video image by inserting p frame | |
| CN115225542A (en) | Video information processing method and device, electronic equipment and storage medium | |
| JP2014075749A (en) | Imaging apparatus, imaging method, program, storage medium, information processing device, information processing method, program, and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C53 | Correction of patent of invention or patent application | ||
| CB02 | Change of applicant information |
Address after: Gyeongnam Changwon City, South Korea Applicant after: HANWHA TECHWIN Co.,Ltd. Address before: Gyeongnam Changwon City, South Korea Applicant before: Samsung Techwin Co.,Ltd. |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: APPLICANT; FROM: SAMSUNG TAI KEWEI CO., LTD. TO: HANWHA TECHWIN CO., LTD. Free format text: CORRECT: ADDRESS; FROM: |
|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Gyeongnam Changwon City, South Korea Applicant after: HANWHA AEROSPACE Co.,Ltd. Address before: Gyeongnam Changwon City, South Korea Applicant before: HANWHA TECHWIN Co.,Ltd. |
|
| TA01 | Transfer of patent application right |
Effective date of registration: 20190301 Address after: Gyeonggi Do city of South Korea Applicant after: HANWHA TECHWIN Co.,Ltd. Address before: Gyeongnam Changwon City, South Korea Applicant before: HANWHA AEROSPACE Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: Gyeonggi Do city of South Korea Patentee after: Hanhua Vision Co.,Ltd. Address before: Gyeonggi Do city of South Korea Patentee before: HANWHA TECHWIN Co.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder |