CN110769264A - Multimedia transmission method, apparatus, medium, and system thereof - Google Patents
Multimedia transmission method, apparatus, medium, and system thereof Download PDFInfo
- Publication number
- CN110769264A CN110769264A CN201910925382.1A CN201910925382A CN110769264A CN 110769264 A CN110769264 A CN 110769264A CN 201910925382 A CN201910925382 A CN 201910925382A CN 110769264 A CN110769264 A CN 110769264A
- Authority
- CN
- China
- Prior art keywords
- transmission
- multimedia
- node
- transmission node
- initial acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/222—Secondary servers, e.g. proxy server, cable television Head-end
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/232—Content retrieval operation locally within server, e.g. reading video streams from disk arrays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application relates to the field of communication and discloses a multimedia transmission method, a device, a medium and a system thereof. The multimedia transmission method comprises the following steps: the transmission node determines whether the transmission node stores at least one part of the target multimedia requested by the transmission request according to the received transmission request; under the condition that the transmission node is determined not to store at least one part of the target multimedia, determining whether at least one transmission node except the transmission node stores at least one part of the target multimedia in a first transmission path corresponding to a first initial acquisition device of the target multimedia, wherein the transmission node is positioned in the first transmission path; in the case where it is determined that at least one of the transfer nodes other than the transfer node stores at least a portion of the target multimedia, at least a portion of the target multimedia is acquired from the transfer node storing the at least a portion of the target multimedia.
Description
Technical Field
The present application relates to the field of multimedia processing, and in particular, to a multimedia transmission method, an apparatus, a medium, and a system thereof.
Background
In the existing national standard GB/T28181 (safety precaution video monitoring networking system information transmission, exchange, control technical requirements), a request for on-demand or live broadcasting of audio and video is sent from an upper level to a lower level, and audio and video data transmission of an RTP Protocol (Real-time Transport Protocol) is performed after an upper and lower level auto-negotiation transmission Protocol. In this way, a connection needs to be established for each request at the subordinate, such as NVR (Network Video Recorder) or IPC (IP CAMERA), where audio and Video data is to be transmitted.
Disclosure of Invention
The embodiment of the application provides a multimedia transmission method, a device, a medium and a system thereof.
In a first aspect, an embodiment of the present application provides a multimedia transmission method for a transmission node in a multimedia transmission system, where the multimedia transmission system includes multiple levels of transmission nodes and multiple initial acquisition devices, where the multiple initial acquisition devices have respective corresponding transmission paths, and a multimedia on the initial acquisition device can be transmitted on each level of transmission nodes in the corresponding transmission paths;
the transmission method comprises the following steps:
the transmission node determines whether the transmission node stores at least one part of the target multimedia requested by the transmission request according to the received transmission request;
under the condition that the transmission node is determined not to store at least one part of the target multimedia, determining whether at least one transmission node except the transmission node stores at least one part of the target multimedia in a first transmission path corresponding to a first initial acquisition device of the target multimedia, wherein the transmission node is positioned in the first transmission path;
in the case where it is determined that at least one of the transfer nodes other than the transfer node stores at least a portion of the target multimedia, at least a portion of the target multimedia is acquired from the transfer node storing the at least a portion of the target multimedia.
In a possible implementation of the first aspect, the transmission method further includes:
in the case where it is determined that the transmission node stores a part of the target multimedia, determining whether at least one transmission node other than the transmission node stores a remaining part of the target multimedia in the first transmission path, wherein the part and the remaining part constitute the target multimedia; and is
In a case where it is determined that at least one of the transfer nodes other than the transfer node stores the remaining portion of the target multimedia, the remaining portion is acquired from the transfer node storing the remaining portion.
In a possible implementation of the first aspect, the transmission method further includes:
in the event that it is determined that there is no transmission node in the first transmission path that stores at least a portion of the target multimedia, the target multimedia is acquired from the first initial acquisition device over the first transmission path.
In a possible implementation of the first aspect, the transmission method further includes:
sending the target multimedia to the device sending the transmission request; and is
In case the target multimedia is not stored in the transfer node, the transmitted target multimedia or a part of the target multimedia is stored in the transfer node.
In a possible implementation of the first aspect, the transmission method further includes:
the transmission node receives a live broadcast request of the multimedia collected by the second initial acquisition equipment;
the transmission node acquires a multimedia stream requesting live broadcast from the second initial acquisition equipment through a second transmission path corresponding to the second initial acquisition equipment;
and the transmission node sends the acquired multimedia stream requesting the live broadcast to the sending equipment of the live broadcast request.
In a possible implementation of the first aspect, each initial obtaining device is connected to a transmission node at the lowest level in a corresponding transmission path, and the transmission node obtains, from the second initial obtaining device through a second transmission path corresponding to the second initial obtaining device, a multimedia stream requested to be live broadcast, including:
and the transmission node acquires the multimedia stream requesting the live broadcast from a lower transmission node of the transmission node in the second transmission path.
In a possible implementation of the first aspect, the sending, by the transmission node, the acquired multimedia stream requesting live broadcasting to the sending device of the live broadcasting request includes:
and the transmission node stores the acquired multimedia stream with the preset size for a preset time period and then forwards the multimedia stream to the sending equipment of the live broadcast request.
In one possible implementation of the first aspect, the transmission node in the multimedia transmission system is associated with an administrative area, and the level of the transmission node corresponds to the level of the administrative area associated with the transmission node.
In one possible implementation of the above first aspect, the method satisfies at least one of:
the transmission node is a proxy server;
the initial acquisition equipment is a network camera or a network hard disk video recorder;
the multimedia is monitoring audio and video information.
In a second aspect, an embodiment of the present application provides a transmission node in a multimedia transmission system, where the multimedia transmission system includes multiple levels of the transmission node and multiple initial acquisition devices, where the multiple initial acquisition devices have respective corresponding transmission paths, and a multimedia on the initial acquisition device can be transmitted on each level of the transmission node in the corresponding transmission path;
the transmission node includes:
a receiving module for receiving a transmission request;
a first determining module, configured to determine, according to the transmission request, whether the transmission node stores at least a part of the target multimedia requested by the transmission request;
a second determining module, configured to determine, when it is determined that the transmission node does not store at least a part of the target multimedia, whether at least one transmission node other than the transmission node stores at least a part of the target multimedia in a first transmission path corresponding to a first initial acquisition device of the target multimedia, where the transmission node is located in the first transmission path;
an obtaining module, configured to, if it is determined that at least one of the transmission nodes other than the transmission node stores at least a portion of the target multimedia, obtain at least a portion of the target multimedia from the transmission node storing at least a portion of the target multimedia.
In a third aspect, an embodiment of the present application provides a machine-readable medium, on which instructions are stored, and when the instructions are executed on a machine, the instructions cause the machine to perform the first aspect and the multimedia transmission method in each possible implementation of the first aspect.
In a fourth aspect, an embodiment of the present application provides a system, including:
a memory to store instructions for execution by one or more processors of a system; and
the processor is one of the processors of the system, and is configured to execute the first aspect and the multimedia transmission method in each possible implementation of the first aspect.
Drawings
Fig. 1 illustrates a schematic diagram of a multimedia transmission system, according to some embodiments of the present application;
fig. 2 illustrates a schematic workflow diagram of a transmission node in the multimedia transmission system of fig. 1, according to some embodiments of the present application;
fig. 3 illustrates a schematic workflow diagram of a transmission node in the multimedia transmission system of fig. 1, according to some embodiments of the present application;
fig. 4 illustrates a schematic workflow diagram of a transmission node in the multimedia transmission system of fig. 1, according to some embodiments of the present application;
fig. 5 illustrates a schematic workflow diagram of a transmission node in the multimedia transmission system of fig. 1, according to some embodiments of the present application;
fig. 6 illustrates a schematic workflow diagram of a transmission node in the multimedia transmission system of fig. 1, according to some embodiments of the present application;
fig. 7 illustrates a schematic structural diagram of a transmission node in the multimedia transmission system shown in fig. 1, according to some embodiments of the present application;
FIG. 8 illustrates a block diagram of a system, according to some embodiments of the present application;
fig. 9 is a block diagram illustrating a system on a chip (SoC), according to some embodiments of the present application.
DETAILED DESCRIPTION OF EMBODIMENT (S) OF INVENTION
The illustrative embodiments of the present application include, but are not limited to, a blockchain-based IP address prefix authentication method and apparatus.
It will be appreciated that as used herein, the term module may refer to or include an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and/or memory that executes one or more software or firmware programs, a combinational logic circuit, and/or other suitable hardware components that provide the described functionality, or may be part of such hardware components.
It is to be appreciated that in various embodiments of the present application, the processor may be a microprocessor, a digital signal processor, a microcontroller, or the like, and/or any combination thereof. According to another aspect, the processor may be a single-core processor, a multi-core processor, the like, and/or any combination thereof. (before a specific embodiment, terms to be explained may be explained)
Embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
A multimedia transmission system 100 is disclosed according to some embodiments of the present application. Fig. 1 shows a schematic diagram of the system 100. As shown in fig. 1, the system 100 includes three levels of transmission nodes and a plurality of initial acquisition devices, and if the multimedia transmission system 100 is applied to transmission of audio and video of IPC or NVR in a video surveillance network, the transmission nodes are associated with administrative areas. For example, the primary transmission node a1 is a provincial transmission node, the secondary transmission nodes B1 and B2 are city transmission nodes, the tertiary transmission nodes C1-C4 are county transmission nodes, and a plurality of initial acquisition devices P11, P12, P21, and the like are managed under each county transmission node.
It is to be understood that although the multimedia transmission system 100 in fig. 1 only shows three levels of transmission nodes, and only one level a1, two level B1 and B2, and four level three transmission nodes C1-C4 are shown, in other embodiments, in the multimedia transmission system, the number of levels of transmission nodes and the number of transmission nodes per level may be set according to actual needs, for example, more than three levels of transmission nodes may be set, and a plurality of level one transmission nodes, such as a2, A3, … …, An, any number of level two transmission nodes may be set under each level one transmission node, any number of level three transmission nodes may be set under the level two transmission nodes, any number of level four transmission nodes may be set under the level three transmission nodes, and so on. In addition, the number of the initial acquisition devices connected to the lowest level transport node in the multimedia transmission system 100 may also be set according to actual needs, and is not limited herein.
Furthermore, it is understood that the transmission nodes in the multimedia transmission system 100 are merely divided according to functions, and in an actual setting, different nodes may be disposed on different physical devices, and may also be disposed on the same physical device, for example, the physical device may be a server, a laptop computer, a desktop computer, a tablet computer, a mobile phone, a wearable device, a head-mounted display, a mobile email device, a portable game console, a portable music player, a reader device, a television with one or more processors embedded or coupled therein, or other electronic devices capable of accessing a network. For example, in some embodiments, the transmission node is a proxy server, the proxy server has a video storage and forwarding function, and according to the situation, all or part of the transmitted multimedia information such as audio and video can be set by each transmission node, and the storage duration is set.
The initial acquisition device can be a network video recorder NVR or a network camera IPC. It is to be understood that, in other embodiments, the transmission node of the present application is not necessarily a proxy server, and may be any computing device with multimedia storage and forwarding functions, which is not limited herein. The initial acquisition device may also be not limited to NVR or IPC, and may be any user terminal capable of acquiring multimedia information, such as a camera, or a cloud server storing the multimedia information of the user.
The following describes a multimedia-on-demand implementation of the multimedia transmission system 100, according to some embodiments of the present application.
For the video-on-demand request of the user, for example, a certain user requests to play the video and audio in the time period t1-t2 of a certain initial acquisition device (such as P22) in the multimedia transmission system 100 through a user terminal, the transmission request sent by the user terminal may indicate the requested video information, for example, the video information may include identification information of the requested initial acquisition device, identification information of each transmission node in the corresponding transmission path, and a time period of the requested video for transmission, specifically, may include an identification of P22 and a time period t1-t2 of the requested video for transmission, and correspond to identifications of transmission nodes a1, B1, and C2 in the transmission path of the initial acquisition device P22. Alternatively, the video information may include names of administrative areas corresponding to the transmission nodes and time periods of videos requested to be transmitted, for example, the video information may include: IPC/NVR P22, t1-t2 time slot of prefecture C2 under city B2, province a 1. It can be understood that the video request may not include the transmission path information, but only include the information of the initial acquisition device, and each transmission node stores the transmission path corresponding to each initial acquisition device, and after receiving the transmission request, the transmission node determines the corresponding transmission path according to the stored information.
After receiving the transmission request of the user terminal, the transmission request is sent to the transmission node of the administrative area. For example, if the user terminal is located in province a1, the transmission request is sent to transmission node a1, if the user terminal is located in city B1, the transmission request is sent to transmission node B1, or if the user terminal is located in county C2, the transmission request is sent to transmission node C2. It can here be decided according to XX to which node a transmission request is sent. If the transmission request is sent to the city level transmission node B1, after receiving the transmission request, the B1 may determine whether the audio/video of the P22 requested by the transmission request in the time period t1-t2 is stored in the B1, and according to the determination result, there may be the following three processing manners:
1) if the B1 stores the audio and video of P22 at t1-t2, the audio and video is sent to a user terminal sending a transmission request, if B1 does not store the audio and video of P22 at t1-t2, whether transmission nodes A1 and C2 on a transmission path corresponding to B1 store the audio and video of P22 at t1-t2 is determined, if at least one of A1 and C2 stores the audio and video of P22 at t1-t2, the audio and video information is obtained from the transmission node A1 or C2 storing the audio and video of P22 at t1-t2, and is sent to the user terminal sending the transmission request, and if the transmission nodes on the transmission path do not have the audio and video of P22 at t1-t2, the B1 can directly obtain the requested video from P22. If the audio and video data of t1-t2 are not stored on the P22, information requesting the absence of video is sent to the user terminal sending the transmission request.
2) If the B1 stores the audios and videos of the P22 at t1-t2, the audio and video data is sent to the user terminal sending the transmission request, and if the B1 does not store the audios and videos of the P22 at t1-t2 but stores a part of the audios and videos, for example, the audios and videos of the P22 at t3-t4(t1< t2< t3< t4) time period, the B1 may determine whether the audios and videos of other time periods (for example, t1-t2, t3-t4) are stored on the C2 or the a 1. When it is determined that videos in other time periods are stored in the C2 or the A1, obtaining videos in the corresponding time periods from the C2 or the A1, and then sending the videos in the whole time period from t1 to t2 to the user terminal sending the transmission request; upon determining that the C2 or a1 does not store the video of the remaining period or stores the partial video of the remaining period, the B1 acquires the video of the remaining period directly from the P22. If the audio and video data of t1-t2 are not stored on the P22, information requesting the absence of video is sent to the user terminal sending the transmission request.
3) If the B1 stores the audio and video of the P22 at t1-t2, the audio and video are sent to the user terminal sending the transmission request, and if the B1 does not store the audio and video of the P22 at t1-t2, the requested video is directly obtained from the P22. If the audio and video data of t1-t2 are not stored on the P22, information requesting the absence of video is sent to the user terminal sending the transmission request.
A multimedia live implementation of the multimedia transmission system 100 is described below, according to some embodiments of the present application.
For an audio/video live broadcast request of a user, for example, a certain user requests, through a user terminal, an audio/video shot by a certain initial acquisition device (such as P22) in the live broadcast multimedia transmission system 100, the audio/video live broadcast request may include a device identifier of the requested initial acquisition device P22 and a transmission path corresponding to P22, for example, the audio/video live broadcast request may include an identifier of P22 and identifiers of transmission nodes a1, B1, and C2 in the transmission path corresponding to the initial acquisition device P22. Or the video information may include names of administrative areas corresponding to the transmission nodes, for example, the video information may include: IPC/NVR P22, prefecture C2, City B2, province A1. It can be understood that the video request may not include the transmission path information, but only include the information of the initial acquisition device, and each transmission node stores the transmission path corresponding to each initial acquisition device, and after receiving the transmission request, the transmission node determines the corresponding transmission path according to the stored information.
After receiving the live broadcast request of the user terminal, the live broadcast request is sent to the transmission node of the administrative region. For example, if the user terminal is located in province a1, the live request will be sent to transfer node a1, or if the user terminal is city B1, the live request will be sent to transfer node B1, or if the user terminal is county level C2, the live request will be sent to transfer node C2. Here it can be decided from XX to which node the live request is sent. If a live broadcast request is sent to the city level transmission node a1, the audio and video requested to be live broadcast can be sent to the user terminal in the following two ways:
1) the A1 acquires the audio and video collected by the P22 in real time through the C2 and the B1 in turn, and then the audio and video is forwarded to the user terminal sending the live broadcast request through the A1. At this time, the transmission node may be an http server. P22 may be a webcam. It is to be understood that in the embodiments of the present application, the transmitting node is not limited to using an http server.
2) The A1 sequentially obtains the audios and videos collected by the P22 through the C2 and the B1, and each or one of the C2, the B1 and the A1 can be set to store the received audios and videos with preset size or preset time interval for a preset time period and then forward the stored audios and videos. For example, the a1 is set to store the received audio and video with the size of every 5M (or every 10 seconds) for 5 seconds and then send the stored audio and video to the user terminal, or the C2, B1 and a1 are set to store the received audio and video with the size of every 5M (or every 10 seconds) for 5 seconds and then forward the stored audio and video. In this way, the user can see a playback of 5M (or every 10 seconds) audiovisual while watching the live broadcast. At this time, the transmission node may be a streaming server. It is to be understood that in the embodiments of the present application, the transmission node is not limited to using a streaming server.
As can be seen from the above description, in the multimedia transmission system 100 of the present application, when the multimedia information on each initial acquisition device is requested or broadcast, the multimedia information needs to pass through the transmission node on the transmission path corresponding to each initial acquisition device, and does not need to directly establish a connection with the initial acquisition device, so that the transmission pressure of the initial acquisition device is greatly reduced, and when the access amount of the initial acquisition device is high, the problem that the transmission connection cannot be established can be effectively solved, and the stability of multimedia information transmission is improved. For example, for the national standard GB/T28181, direct communication transmission between the upper layer and the lower domain (i.e., the initial acquisition device) is shielded, the problem of high concurrent deadlock/no response of the lower domain and unreliable transmission of UDP (User datagram protocol) across network segments or public networks is solved, and robustness and stability of interaction between the upper and lower domains are improved.
In addition, it is understood that the multimedia information in the present application may be any multimedia information, for example, the multimedia information may be audio and video information, or may be separate video information, separate audio information, or separate image information, which is not limited herein. The multimedia transmission system 100 described above is also not limited to use in the field of video surveillance. The transmission node is not necessarily associated with the administrative domain, but may be provided purely to reduce the transmission connection pressure of the initial acquisition device.
Based on the above description, the main workflow of each transmission node in the multimedia transmission system 100 when receiving a transmission request on demand is described in detail below.
According to some embodiments of the present application, in combination with the above description of the multimedia transmission system 100, specific details are still applicable in the following processes, and are not repeated herein for avoiding repetition, and the on-demand work flow of each transmission node in the system is shown in fig. 2, and specifically includes:
1) a transmitting node (e.g., B1) receives a transmission request (200) sent by a user terminal. For example, the transmission request requests initial acquisition of audio and video in a time period t1-t2 on the device P22.
2) The transmitting node B1 determines whether audio/video requested by the transmission request is stored on the transmitting node B1 (202).
3) Under the condition that the audio and video requested by the transmission request is determined to be stored in the transmission node B1, sending the acquired audio and video to a user terminal sending the transmission request (210); in the case where it is determined that the audio/video requested by the transmission request is not stored on the transmission node B1, it is determined whether the requested audio/video is stored on other transmission nodes (e.g., a1 and C2) on the corresponding transmission path (204).
4) Under the condition that other transmission nodes (such as A1 or C2) on a corresponding transmission path are determined to store the audios and videos in a time period t1-t2 on P22, the requested audios and videos are obtained from the transmission nodes storing the audios and videos (206), and the obtained audios and videos are sent to a user terminal sending a transmission request (210); under the condition that other transmission nodes (such as A1 or C2) on the corresponding transmission path are determined not to store the audios and videos in the time period t1-t2 on the P22, the requested audios and videos are directly acquired from the P22 (208), and the acquired audios and videos are sent to the user terminal sending the transmission request (210).
According to some other embodiments of the present application, in combination with the above description of the multimedia transmission system 100, specific details are still applicable in the following processes, and are not repeated herein for avoiding repetition, and a working process of requesting by each transmission node in the system is shown in fig. 3, and specifically includes:
1) a transmitting node (e.g., B1) receives a transmission request (300) sent by a user terminal. For example, the transmission request requests initial acquisition of audio and video in a time period t1-t2 on the device P22.
2) The transmitting node B1 determines whether the audio/video requested by the transmission request is stored on the transmitting node B1, such as audio/video for a time period t1-t2 on P22 (302).
3) Under the condition that the audio and video requested by the transmission request is determined to be stored in the transmission node B1, sending the acquired audio and video (312) to a user terminal sending the transmission request; in the event that it is determined that the requested audio video of the transfer request is not stored on transfer node B1, it is determined whether a portion of the requested audio video is stored on transfer node B1 (304), e.g., audio video within a time period t3-t4(t1< t2< t3< t4) over P22.
4) In the event that it is determined that a portion of the requested audio video is stored on transfer node B1, determining whether other transfer nodes (e.g., a1 and C2) on the transfer path store the remaining portion of the requested audio video (e.g., other time periods t1-t2, t3-t4) (306); if the other transmission nodes store the rest part of the requested audio and video, the rest part of the requested audio and video is obtained from the other transmission nodes (310), and if the other transmission nodes do not store the rest part of the requested audio and video, the requested audio and video is directly obtained from the P22 (308).
5) Sending the acquired audio and video to the user terminal sending the transmission request (312)
According to some other embodiments of the present application, in combination with the above description of the multimedia transmission system 100, specific details are still applicable in the following processes, and are not repeated herein for avoiding repetition, and the on-demand work flow of each transmission node in the system is shown in fig. 4, and specifically includes:
1) a transmitting node (e.g., B1) receives a transmission request (400) sent by a user terminal. For example, the transmission request requests initial acquisition of audio and video in a time period t1-t2 on the device P22.
2) The transmitting node B1 determines whether audio/video requested by the transmission request is stored on the transmitting node B1 (402).
3) Under the condition that the audio and video requested by the transmission request is determined to be stored in the transmission node B1, sending the acquired audio and video to a user terminal sending the transmission request (404); and under the condition that the transmission node B1 is determined not to store the audio and video requested by the transmission request, directly acquiring the requested audio and video from the P22 (406), and transmitting the acquired audio and video to the user terminal which transmits the transmission request (404).
Based on the above description, the main workflow of each transmission node in the multimedia transmission system 100 when receiving a transmission request of a live broadcast is described in detail below.
According to some embodiments of the present application, in combination with the above description of the multimedia transmission system 100, specific details are still applicable in the following processes, and are not repeated herein for avoiding repetition, and a live broadcast workflow of each transmission node in the system is shown in fig. 5, and specifically includes:
1) transport node a1 receives a live request (500) sent by a user terminal. For example, the live request requests the live of the audio and video captured by the initial acquisition device P22.
2) The transmission node a1 sequentially passes through the transmission path, and the transmission nodes C2 and B1 connected between the transmission node and the initial acquisition device P22 acquire the audio and video collected by the initial acquisition device P22 in real time (502).
3) And the transmission node A1 forwards the acquired audio and video to the user terminal sending the live broadcast request in real time (504).
According to other embodiments of the present application, in combination with the above description of the multimedia transmission system 100, specific details are still applicable to the following processes, and are not repeated herein for avoiding repetition, and a live broadcast workflow of each transmission node in the system is shown in fig. 6, and specifically includes:
1) transport node a1 receives a live request (600) sent by a user terminal. For example, the live request requests the live of the audio and video captured by the initial acquisition device P22.
2) The transmission node a1 sequentially passes through the transmission path, and the transmission nodes C2 and B1 connected between the transmission node and the initial acquisition device P22 acquire the audio and video collected by the initial acquisition device P22 (602). In some embodiments, each or one of C2 and B1 may be configured to store the received audio/video with a predetermined size or a predetermined time interval for forwarding after a predetermined period of time. For example, the C2 is configured to store the received audio/video with the size of every 5M (or every 10 seconds) for 5 seconds and then send the stored audio/video to the B1, or both the C2 and the B1 are configured to store the received audio/video with the size of every 5M (or every 10 seconds) for 5 seconds and then forward the stored audio/video.
3) And the transmission node A1 forwards the acquired audio and video to the user terminal sending the live broadcast request (604). In some embodiments, the audio and video received by a1 in a predetermined size or at a predetermined time interval is stored for a predetermined period of time and then forwarded, for example, the received audio and video in the size of every 5M (or every 10 seconds) is stored for 5 seconds and then sent to the user terminal.
According to some embodiments of the present application, a structure of a transmission node in a multimedia transmission system of the present application is shown in fig. 7. The transmission node has various functions of the transmission node in the multimedia transmission system 100, and some details are not described herein for avoiding repetition. Specifically, as shown in fig. 7, the transmission node includes:
a receiving module 700, configured to receive a transmission request. For example, B1 receives a transfer request requesting initial acquisition of audio and video for a time period t1-t2 on device P22.
A first determining module 702 is configured to determine whether the transmitting node stores at least a part of the target multimedia requested by the transmission request according to the transmission request. For example, whether audio and video of a time period t1-t2 or a part of the time period (for example, t3-t4(t1< t2< t3< t4)) on P22 is stored is confirmed.
A second determining module 704, configured to determine, if the transmission node does not store at least a portion of the target multimedia, whether at least one transmission node other than the transmission node stores at least a portion of the target multimedia in a first transmission path corresponding to the first initial acquiring device of the target multimedia, where the transmission node is located in the first transmission path. For example, it is determined whether other transmission nodes a1 and C2 on the transmission path of the corresponding P22 store at least a portion of the requested audio video.
An obtaining module 706, configured to, in case it is determined that at least one of the transmitting nodes other than the transmitting node stores at least a portion of the target multimedia, obtain at least a portion of the target multimedia from the transmitting node storing at least a portion of the target multimedia. For example, if it is determined that a1 stores audio and video in the time period t1-t2 of P22, the audio and video is obtained from a1 and sent to the user terminal where the transmission request occurs.
Referring now to FIG. 8, shown is a block diagram of a system 800 in accordance with one embodiment of the present application. The system 800 may include one or more processors 801 coupled to a controller hub 803. For at least one embodiment, the controller hub 803 communicates with the processor 801 via a multi-drop bus such as a front-side bus (FSB), a point-to-point interface such as a quick channel interconnect (QPI), or similar connection 807. The processor 801 executes instructions that control data processing operations of a general type. In one embodiment, the controller hub 803 includes, but is not limited to, a Graphics Memory Controller Hub (GMCH) (not shown) and an input/output hub (IOH) (which may be on separate chips) (not shown), where the GMCH includes memory and graphics controllers and is coupled to the IOH.
The system 800 may also include a coprocessor 802 and memory 804 coupled to the controller hub 803. Alternatively, one or both of the memory and GMCH may be integrated within the processor, with the memory 804 and coprocessor 802 coupled directly to the processor 801 and controller hub 803, with the controller hub 803 in a single chip with the IOH. The memory 804 may be, for example, Dynamic Random Access Memory (DRAM), Phase Change Memory (PCM), or a combination of the two. In one embodiment, the coprocessor 802 is a special-purpose processor, such as a high-throughput MIC processor, a network or communication processor, compression engine, graphics processor, GPGPU, embedded processor, or the like. The optional nature of coprocessor 802 is represented in FIG. 8 by dashed lines.
In one embodiment, device 800 may further include a Network Interface (NIC) 806. Network interface 806 may include a transceiver to provide a radio interface for device 800 to communicate with any other suitable device (e.g., front end module, antenna, etc.). In various embodiments, the network interface 806 may be integrated with other components of the device 800.
The system 800 may further include an input/output (I/O) device 805. I/O805 may include: a user interface designed to enable a user to interact with the system 800; the design of the peripheral component interface enables peripheral components to also interact with the system 800; and/or sensors are designed to determine environmental conditions and/or location information associated with system 800.
It is noted that fig. 8 is merely exemplary. That is, although fig. 8 shows that the system 800 includes a plurality of devices, such as the processor 801, the controller hub 803, the memory 804, etc., in practical applications, a system using the methods of the present application may include only a portion of the devices of the system 800, and may include only the processor 801 and the NIC806, for example. The nature of the alternative device in fig. 8 is shown in dashed lines.
Referring now to fig. 9, shown is a block diagram of a SoC (System on Chip) 900 in accordance with one embodiment of the present application. In fig. 9, like parts have the same reference numerals. In addition, the dashed box is an optional feature of more advanced socs. In fig. 9, SoC 900 includes: an interconnect unit 950 coupled to the application processor 910; a system agent unit 980; a bus controller unit 990; an integrated memory controller unit 940; a set or one or more coprocessors 920 which may include integrated graphics logic, an image processor, an audio processor, and a multimedia processor; a Static Random Access Memory (SRAM) unit 930; a Direct Memory Access (DMA) unit 960. In one embodiment, coprocessor 920 includes a special-purpose processor, such as, for example, a network or communication processor, compression engine, GPGPU, a high-throughput MIC processor, embedded processor, or the like.
Embodiments of the mechanisms disclosed herein may be implemented in hardware, software, firmware, or a combination of these implementations. Embodiments of the application may be implemented as computer programs or program code executing on programmable systems comprising at least one processor, a storage system (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device.
Program code may be applied to input instructions to perform the functions described herein and generate output information. The output information may be applied to one or more output devices in a known manner. For purposes of this application, a processing system includes any system having a processor such as, for example, a Digital Signal Processor (DSP), a microcontroller, an Application Specific Integrated Circuit (ASIC), or a microprocessor.
The program code may be implemented in a high level procedural or object oriented programming language to communicate with a processing system. The program code can also be implemented in assembly or machine language, if desired. Indeed, the mechanisms described in this application are not limited in scope to any particular programming language. In any case, the language may be a compiled or interpreted language.
In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried by or stored on one or more transitory or non-transitory machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, the instructions may be distributed via a network or via other computer readable media. Thus, a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), including, but not limited to, floppy diskettes, optical disks, read-only memories (CD-ROMs), magneto-optical disks, read-only memories (ROMs), Random Access Memories (RAMs), erasable programmable read-only memories (EPROMs), electrically erasable programmable read-only memories (EEPROMs), magnetic or optical cards, flash memory, or a tangible machine-readable memory for transmitting information (e.g., carrier waves, infrared digital signals, etc.) using the internet in an electrical, optical, acoustical or other form of propagated signal. Thus, a machine-readable medium includes any type of machine-readable medium suitable for storing or transmitting electronic instructions or information in a form readable by a machine (e.g., a computer).
In the drawings, some features of the structures or methods may be shown in a particular arrangement and/or order. However, it is to be understood that such specific arrangement and/or ordering may not be required. Rather, in some embodiments, the features may be arranged in a manner and/or order different from that shown in the illustrative figures. In addition, the inclusion of a structural or methodical feature in a particular figure is not meant to imply that such feature is required in all embodiments, and in some embodiments, may not be included or may be combined with other features.
It should be noted that, in the embodiments of the apparatuses in the present application, each unit/module is a logical unit/module, and physically, one logical unit/module may be one physical unit/module, or may be a part of one physical unit/module, and may also be implemented by a combination of multiple physical units/modules, where the physical implementation manner of the logical unit/module itself is not the most important, and the combination of the functions implemented by the logical unit/module is the key to solve the technical problem provided by the present application. Furthermore, in order to highlight the innovative part of the present application, the above-mentioned device embodiments of the present application do not introduce units/modules which are not so closely related to solve the technical problems presented in the present application, which does not indicate that no other units/modules exist in the above-mentioned device embodiments.
It is noted that, in the examples and descriptions of this patent, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the use of the verb "comprise a" to define an element does not exclude the presence of another, same element in a process, method, article, or apparatus that comprises the element.
While the present application has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present application.
Claims (12)
1. A multimedia transmission method for a transmission node in a multimedia transmission system, wherein the multimedia transmission system comprises a plurality of levels of transmission nodes and a plurality of initial acquisition devices, the plurality of initial acquisition devices have respective corresponding transmission paths, wherein multimedia on the initial acquisition devices can be transmitted on the transmission nodes at each level in the corresponding transmission paths;
the transmission method comprises the following steps:
the transmission node determines whether the transmission node stores at least one part of the target multimedia requested by the transmission request according to the received transmission request;
under the condition that the transmission node is determined not to store at least one part of the target multimedia, determining whether at least one transmission node except the transmission node stores at least one part of the target multimedia in a first transmission path corresponding to a first initial acquisition device of the target multimedia, wherein the transmission node is positioned in the first transmission path;
in the case where it is determined that at least one of the transfer nodes other than the transfer node stores at least a portion of the target multimedia, at least a portion of the target multimedia is acquired from the transfer node storing the at least a portion of the target multimedia.
2. The multimedia transmission method of claim 1, further comprising:
in the case where it is determined that the transmission node stores a part of the target multimedia, determining whether at least one transmission node other than the transmission node stores a remaining part of the target multimedia in the first transmission path, wherein the part and the remaining part constitute the target multimedia; and is
In a case where it is determined that at least one of the transfer nodes other than the transfer node stores the remaining portion of the target multimedia, the remaining portion is acquired from the transfer node storing the remaining portion.
3. The multimedia transmission method according to claim 1 or 2, further comprising:
in the event that it is determined that there is no transmission node in the first transmission path that stores at least a portion of the target multimedia, the target multimedia is acquired from the first initial acquisition device over the first transmission path.
4. The multimedia transmission method according to claim 1 or 2, further comprising:
sending the target multimedia to the device sending the transmission request; and is
In case the target multimedia is not stored in the transfer node, the transmitted target multimedia or a part of the target multimedia is stored in the transfer node.
5. The multimedia transmission method of claim 1, further comprising:
the transmission node receives a live broadcast request of the multimedia collected by the second initial acquisition equipment;
the transmission node acquires a multimedia stream requesting live broadcast from the second initial acquisition equipment through a second transmission path corresponding to the second initial acquisition equipment;
and the transmission node sends the acquired multimedia stream requesting the live broadcast to the sending equipment of the live broadcast request.
6. The multimedia transmission method according to claim 5, wherein each initial acquisition device is connected to a transmission node of the lowest level in the corresponding transmission path, and
the acquiring, by the transmission node, a multimedia stream requested to be live from the second initial acquisition device through a second transmission path corresponding to the second initial acquisition device includes:
and the transmission node acquires the multimedia stream requesting the live broadcast from a lower transmission node of the transmission node in the second transmission path.
7. The multimedia transmission method according to claim 5, wherein the transmitting node transmitting the acquired multimedia stream requesting the live broadcast to the sending device of the live broadcast request comprises:
and the transmission node stores the acquired multimedia stream with the preset size or the preset time interval for a preset time period and then forwards the multimedia stream to the sending equipment of the live broadcast request.
8. The multimedia transmission method according to any one of claims 1 to 7, wherein a transmission node in the multimedia transmission system is associated with an administrative area, and a level of a transmission node corresponds to a level of an administrative area associated with the transmission node.
9. The method for multimedia transmission according to any of claims 1 to 7, wherein at least one of the following is satisfied:
the transmission node is a proxy server;
the initial acquisition equipment is a network camera or a network hard disk video recorder;
the multimedia is monitoring audio and video information.
10. A transmission node in a multimedia transmission system, wherein the multimedia transmission system comprises multiple levels of the transmission node and multiple initial acquisition devices, the multiple initial acquisition devices have respective corresponding transmission paths, and multimedia on the initial acquisition devices can be transmitted on the transmission nodes at the levels in the corresponding transmission paths;
the transmission node includes:
a receiving module for receiving a transmission request;
a first determining module, configured to determine, according to the transmission request, whether the transmission node stores at least a part of the target multimedia requested by the transmission request;
a second determining module, configured to determine, when it is determined that the transmission node does not store at least a part of the target multimedia, whether at least one transmission node other than the transmission node stores at least a part of the target multimedia in a first transmission path corresponding to a first initial acquisition device of the target multimedia, where the transmission node is located in the first transmission path;
an obtaining module, configured to, if it is determined that at least one of the transmission nodes other than the transmission node stores at least a portion of the target multimedia, obtain at least a portion of the target multimedia from the transmission node storing at least a portion of the target multimedia.
11. A machine-readable medium having stored thereon instructions which, when executed on a machine, cause the machine to perform the method of multimedia transmission of any of claims 1 to 9.
12. A system, comprising:
a memory to store instructions for execution by one or more processors of a system; and
processor, being one of the processors of the system, for performing the multimedia transmission method of any of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910925382.1A CN110769264B (en) | 2019-09-27 | 2019-09-27 | Multimedia transmission method, apparatus, medium, and system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910925382.1A CN110769264B (en) | 2019-09-27 | 2019-09-27 | Multimedia transmission method, apparatus, medium, and system thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110769264A true CN110769264A (en) | 2020-02-07 |
| CN110769264B CN110769264B (en) | 2021-10-08 |
Family
ID=69330636
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910925382.1A Active CN110769264B (en) | 2019-09-27 | 2019-09-27 | Multimedia transmission method, apparatus, medium, and system thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110769264B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070204316A1 (en) * | 2006-02-24 | 2007-08-30 | Kabushiki Kaisha Toshiba | Video surveillance system |
| CN101715118A (en) * | 2008-09-23 | 2010-05-26 | 诺基亚西门子通信公司 | Method and system for a traffic management of video on demand services |
| CN103731753A (en) * | 2012-10-12 | 2014-04-16 | 上海聚力传媒技术有限公司 | Personal live video stream routing system and method |
| US20140211775A1 (en) * | 2013-01-28 | 2014-07-31 | Qualcomm Incorporated | Larger delay spread support for wifi bands |
| CN109686415A (en) * | 2018-12-21 | 2019-04-26 | 苏州爱医斯坦智能科技有限公司 | A kind of data transmission method, management platform, electronic equipment and storage medium |
| CN110012300A (en) * | 2018-01-04 | 2019-07-12 | 华为技术有限公司 | Net cast method and device |
-
2019
- 2019-09-27 CN CN201910925382.1A patent/CN110769264B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070204316A1 (en) * | 2006-02-24 | 2007-08-30 | Kabushiki Kaisha Toshiba | Video surveillance system |
| CN101715118A (en) * | 2008-09-23 | 2010-05-26 | 诺基亚西门子通信公司 | Method and system for a traffic management of video on demand services |
| CN103731753A (en) * | 2012-10-12 | 2014-04-16 | 上海聚力传媒技术有限公司 | Personal live video stream routing system and method |
| US20140211775A1 (en) * | 2013-01-28 | 2014-07-31 | Qualcomm Incorporated | Larger delay spread support for wifi bands |
| CN110012300A (en) * | 2018-01-04 | 2019-07-12 | 华为技术有限公司 | Net cast method and device |
| CN109686415A (en) * | 2018-12-21 | 2019-04-26 | 苏州爱医斯坦智能科技有限公司 | A kind of data transmission method, management platform, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110769264B (en) | 2021-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107566786B (en) | Method and device for acquiring monitoring video and terminal equipment | |
| JP6700344B2 (en) | Information exchange method, device, audio terminal, computer-readable storage medium and program | |
| CN102843442B (en) | Method for configuring networked cameras | |
| US20200084265A1 (en) | Detecting Virtual Private Network Usage | |
| CN104539977B (en) | Method for previewing and device is broadcast live | |
| CN105656680B (en) | Network camera control method and device | |
| US20130103660A1 (en) | Network connected media gateway for communication networks | |
| US20100281146A1 (en) | Dynamic domain name service system and automatic registration method | |
| US8386603B2 (en) | Information processing terminal device and network connection method | |
| EP2819407B1 (en) | System for automatic connection between NVR and IP camera | |
| CN110445723B (en) | Network data scheduling method and edge node | |
| CN111064804B (en) | Network access method and device | |
| CN111193900B (en) | Monitoring video sharing method and device and storage medium | |
| CN109522462B (en) | Cloud query method, device, equipment and storage medium based on block chain | |
| US20230239675A1 (en) | Application context relocation method and apparatus | |
| CN105592083B (en) | Method and device for terminal to access server by using token | |
| JP2012083891A (en) | Failover system, storage processor, and failover control method | |
| CN108964822B (en) | Method and system for acquiring network time in parallel by multiple schemes | |
| CN110769264B (en) | Multimedia transmission method, apparatus, medium, and system thereof | |
| US10498787B2 (en) | Communication apparatus, communication method, and program | |
| US9762627B2 (en) | Method of searching for and registering network device using HTTP and network registration service apparatus | |
| CN112217910A (en) | Video service access method, device, network equipment and storage medium | |
| KR101432039B1 (en) | Method for remote monitoring using IP camera | |
| CN111092958A (en) | Node access method, device, system and storage medium | |
| CN113285920B (en) | Service access method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |