CN112738056B - Encoding and decoding method and system - Google Patents
Encoding and decoding method and system Download PDFInfo
- Publication number
- CN112738056B CN112738056B CN202011553001.0A CN202011553001A CN112738056B CN 112738056 B CN112738056 B CN 112738056B CN 202011553001 A CN202011553001 A CN 202011553001A CN 112738056 B CN112738056 B CN 112738056B
- Authority
- CN
- China
- Prior art keywords
- encoding
- decoding
- host
- control signaling
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses a coding and decoding method and a coding and decoding system. The method comprises the following steps: the host computer sends the host computer analog signal to the encoding and decoding equipment; the encoding and decoding equipment transmits the host analog signal to a display device for display when encoding and decoding service is not performed; the host is connected with the display device through the encoding and decoding equipment; after receiving a target application request pointing to a target media resource, the host sends a control signaling to the encoding and decoding equipment according to the target application request; and the encoding and decoding equipment encodes and decodes the media stream of the target media resource according to the control signaling and processes the encoding and decoding result. Under the condition of lower host performance, the technical scheme can also perform efficient encoding and decoding operations, and solves the problem of insufficient encoding and decoding capability of the host.
Description
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to a coding and decoding method and system.
Background
The audio and video coding is a mode of converting the original audio and video format file into another audio and video format file through a specific coding technology, so that the audio and video coding is convenient to store and transmit; the audio and video decoding is to convert the audio and video format file into the original audio and video format through a specific decoding technology, so as to display the audio and video format file through a playing device.
The current audio and video coding and decoding technology mainly has the following two conditions:
firstly, the encoding and decoding of the audio and video are realized in a software mode, namely, a set of media library file is deployed on an operating system of a host computer, and encoding and decoding algorithms of the audio and video media are integrated, so that the encoding and decoding of the audio and video are realized. As shown in fig. 1a, a camera at the front end performs image acquisition, the acquired image is transmitted to a host a, a media library program running in the host a encodes the acquired image data in a specific encoding mode and encapsulates the encoded image data into IP (Internet Protocol, network protocol) packets, and then the IP packets are transmitted to a host B at the destination end through a network, and the media library program running in the host B decapsulates the received IP packets and restores the image data in a specific decoding mode and displays the image through a display.
Secondly, the encoding and decoding of the audio and video are realized in a hardware mode, namely, a coding and decoding chip is embedded in the host or a coding and decoding device is connected outside the host, so that the encoding and decoding of the audio and video are realized. As shown in fig. 1B, the camera at the front end collects images, the collected image data is transmitted into the host a, the host a transmits the image data to the encoding and decoding device for encoding, the encoded image data is IP-packetized and transmitted to the host B at the destination end through the network, the host B decapsulates the IP-packetized and transmits the IP-packetized to the encoding and decoding device for decoding and restoring, and the decoded image is displayed through the display.
The coding and decoding schemes of the two audios and videos are mostly realized based on an X86 platform, and particularly, a coding and decoding mode of software is adopted, so that a large amount of resources in a system are required to be occupied when coding and decoding operation is carried out, and high-performance terminal equipment is required to be configured. However, due to the diversity of terminal types, there are a large number of terminal processors with relatively low computing and processing power in practical applications, and efficient codec operation cannot be achieved. Therefore, how to implement efficient codec operation is a problem to be solved under the condition of low host performance.
Disclosure of Invention
The embodiment of the invention provides a coding and decoding method and a coding and decoding system, which are used for realizing efficient coding and decoding operation under the condition of lower host performance and solving the problem of insufficient coding and decoding capability of a host.
In a first aspect, an embodiment of the present invention provides a coding and decoding method, including:
the host computer sends the host computer analog signal to the encoding and decoding equipment;
the encoding and decoding equipment transmits the host analog signal to a display device for display when encoding and decoding service is not performed; the host is connected with the display device through the encoding and decoding equipment;
after receiving a target application request pointing to a target media resource, the host sends a control signaling to the encoding and decoding equipment according to the target application request;
And the encoding and decoding equipment encodes and decodes the media stream of the target media resource according to the control signaling and processes the encoding and decoding result.
In a second aspect, an embodiment of the present invention further provides a codec system, including: the system comprises a host, encoding and decoding equipment and a display device, wherein the host is connected with the display device through the encoding and decoding equipment;
the host is used for sending host analog signals to the encoding and decoding equipment, and sending control signaling to the encoding and decoding equipment according to the target application request after receiving the target application request pointing to the target media resource;
the encoding and decoding equipment is used for transmitting the host analog signal to the display device when encoding and decoding service is not performed, encoding and decoding the media stream of the target media resource according to the control signaling and processing encoding and decoding results;
the display device is used for displaying the analog signals sent by the encoding and decoding equipment.
In the technical scheme of the embodiment of the invention, the host sends the host analog signal to the encoding and decoding equipment, the encoding and decoding equipment transparently transmits the host analog signal to the display device for display when the encoding and decoding equipment does not perform encoding and decoding service, and after receiving the target application request pointing to the target media resource, the host sends the control signaling to the encoding and decoding equipment according to the target application request, and the encoding and decoding equipment performs encoding and decoding operation on the media stream of the target media resource according to the control signaling and performs corresponding processing on the encoding and decoding result. In the technical scheme, the host separates the business flow control and the encoding and decoding control of the host, so that the encoding and decoding operation on the media stream can independently run on a host platform, thereby realizing the efficient encoding and decoding operation under the condition of lower host performance and solving the problem of insufficient encoding and decoding capability of the host.
Drawings
FIG. 1a is a schematic diagram of a prior art audio/video codec using software;
FIG. 1b is a schematic diagram of a prior art audio/video codec using hardware;
fig. 2a is a flow chart of a coding and decoding method according to a first embodiment of the invention;
fig. 2b is a schematic diagram illustrating an application of a coding and decoding method according to a first embodiment of the present invention;
fig. 3a is a flow chart of a coding and decoding method in the second embodiment of the invention;
fig. 3b is a schematic diagram illustrating an application of a coding and decoding method according to a second embodiment of the present invention;
FIG. 3c is a schematic diagram showing a fusion result in a second embodiment of the present invention;
fig. 3d is a schematic diagram of an application scenario of a coding and decoding method in the second embodiment of the present invention;
fig. 4 is a schematic structural diagram of a codec system according to a third embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently, or at the same time. Furthermore, the order of the operations may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example 1
Fig. 2a is a flowchart of a coding and decoding method according to a first embodiment of the present invention, where the embodiment is applicable to a situation where efficient coding and decoding operations are implemented under a situation where the host performance is low.
As shown in fig. 2a, the encoding and decoding method provided in this embodiment specifically includes:
s110, the host transmits the host analog signal to the encoding and decoding equipment.
The host refers to a main body part of the computer device except for the input and output devices. The display means refers to an output device of a computer device, in particular a display. In this embodiment, the host is not directly connected to the display device, but is connected to the display device through the codec device, that is, the host is directly connected to the codec device, and the codec device is directly connected to the display device.
Host analog signals refer to analog signals sent by a host intended for display by a display device. The host analog signal may be output through any host analog signal interface, for example, may be HDMI (High-Definition Multimedia Interface, high definition multimedia interface), VGA (Video Graphics Array, video image array) interface, DVI (Digital Visual Interface, digital video interface), etc., which is not particularly limited in the embodiment of the present invention.
It should be noted that, since the host is directly connected to the display device through the codec device, the host analog signal is output from the host to the codec device, and is transmitted to the display device through the codec device for display.
The codec device refers to a device that can compress or decompress audio and video.
S120, the encoding and decoding equipment transparently transmits the host analog signal to a display device for display when encoding and decoding service is not performed; the host is connected with the display device through the encoding and decoding equipment.
The coding and decoding service refers to coding and/or decoding operations of audio and video by the coding and decoding equipment.
Transparent transmission means that during signal transmission, no processing is performed on the signal, but the received signal is sent out again. In the embodiment of the invention, transparent transmission specifically refers to directly sending the host analog signal received from the host to the display device without any processing of the host analog signal.
And the host sends the host analog signal to the encoding and decoding equipment, and when the encoding and decoding equipment receives the host analog signal, if the encoding and decoding service is not performed, the host analog signal is transmitted to the display device for display.
The codec device does not perform the codec service in two cases, one is that the codec device does not receive any control signaling related to the codec, and the other is that the codec device receives the control signaling indicating to start the codec operation and then receives the control signaling indicating to stop the codec operation.
S130, after receiving the target application request pointing to the target media resource, the host sends control signaling to the encoding and decoding equipment according to the target application request.
The target media resource refers to any resource for outputting a media stream, for example, an audio/video collector (such as a camera, etc.), wherein the media stream is audio/video data in a streaming mode.
The target application request refers to a request which is initiated by a user at a host side and corresponds to any one application program, and is used for indicating the coding and decoding equipment to perform coding and decoding service. By way of example, the target application request may be a request corresponding to the monitoring application, such as a monitoring start request, a video transmission request, etc.
The control signaling refers to signaling for controlling the codec device to perform an operation related to the codec, and may be, for example, signaling for instructing to start encoding, stop encoding, start decoding, stop decoding, transmit a result of encoding, and the like. The interface protocol format followed by the control signaling may be preset.
Alternatively, the host analog signal and the control signaling are sent to the codec device through different host interfaces, respectively. For example, the host and the codec device are connected to each other through an analog signal interface through which host analog signals are transmitted and a control signal interface through which control signals are transmitted, respectively.
In an alternative implementation of this embodiment, the host sends the host analog signal to the codec device, which may be specifically: the host sends the host analog signal to the codec device through an analog signal interface corresponding to the codec device, for example, the host sends the host analog signal to the codec device through an HDMI interface corresponding to the codec device.
In an optional implementation manner of this embodiment, the host sends the control signaling to the codec device, which may be specifically: the host sends control signaling to the encoding and decoding equipment according to a preset interface protocol through a control signal interface corresponding to the encoding and decoding equipment, for example, the host sends control signaling to the encoding and decoding equipment through a network port corresponding to the host and the encoding and decoding equipment. The interface protocol format followed by the control signaling is not specifically limited in this embodiment.
When a user initiates a target application request corresponding to a target media resource at a host side, the host responds to the target application request, generates control signaling according to the target application request, and sends the control signaling to the encoding and decoding equipment. For example, if the target application request is a monitor start request, the control signaling corresponds to a signaling indicating to start the decoding operation, and if the target application request is a monitor close request, the control signaling corresponds to a signaling indicating to stop the decoding operation.
And S140, the encoding and decoding equipment encodes and decodes the media stream of the target media resource according to the control signaling and processes the encoding and decoding result.
When receiving control signaling sent by a host, the encoding and decoding equipment analyzes the control signaling according to a preset interface protocol, and executes matching operation according to an analysis result. For example, if the codec device parses the control signaling to start decoding, then the media stream is requested from the corresponding target media resource, and the received media stream is decoded; and if the coding and decoding equipment analyzes the control signaling to start coding, requesting the media stream from the corresponding target media resource, and performing coding operation on the received media stream.
In an alternative embodiment, the encoding and decoding device encodes and decodes the media stream of the target media resource according to the control signaling and processes the encoding and decoding result, which may include: when the control signaling indicates the coding operation, the coding and decoding equipment performs the coding operation on the media stream of the target media resource according to the control signaling, and sends the coding result to the corresponding network node through the network.
The network node may be any network node in the network where the codec device is located, for example, may be a codec device, a computer host, a server, or the like. Note that in this embodiment, the codec device is registered in the network as well as the host, and belongs to one network node.
In this embodiment, the control signaling may indicate a destination address for sending the encoding result, so that the codec device may send the encoding result according to the destination address obtained by parsing the control signaling.
Optionally, the control signaling may also indicate to locally store the encoding result, so that the encoding and decoding device sends the encoding result to a host connected to the encoding and decoding device for local storage, and the embodiment is not limited specifically for transmitting the corresponding interface between the host and the encoding and decoding device with respect to the encoding result.
In an alternative embodiment, the encoding and decoding device encodes and decodes the media stream of the target media resource according to the control signaling and processes the encoding and decoding result, which may include: when the control signaling indicates decoding operation, the encoding and decoding equipment decodes the media stream of the target media resource according to the control signaling, fuses the decoding result with the host analog signal received currently, and sends the fusion result to the display device for display.
The host analog signal currently received refers to a host analog signal transmitted by a host received when the encoding and decoding device performs a decoding operation.
The fusion refers to an operation of processing multiple signals into one signal, in this embodiment, processing the host analog signal combining and decoding result into one signal displayed by the display device, specifically, processing a layer corresponding to the host analog signal and a decoded image into an image displayed by the display device.
When the encoding and decoding equipment decodes the received media stream according to the control signaling, the decoding result is fused with the host analog signal received at the current moment, and the fusion result is sent to the display device for display.
Optionally, the encoding and decoding device may fuse the decoding result with the host analog signal currently received, and may include: the encoding and decoding equipment fuses the decoding result with the host analog signal received currently according to the display requirement of the decoding result in the control signaling.
The control signaling may further include information on display requirements of the decoding result, for example, display size, display position, and the like. The display requirement information is determined according to a target application request initiated by a user, for example, the target application request is a request for adjusting the size of the monitoring display window or a request for adjusting the position of the monitoring display window.
Correspondingly, the encoding and decoding equipment can fuse the decoding result with the host analog signal received currently according to the display requirement of the decoding result in the control signaling, so that the display condition of the decoding result in the display device accords with the display requirement in the control signaling.
Optionally, in the case that the target media resource is directly connected to the codec device, the codec device may perform codec on the media stream of the target media resource according to the control signaling and process a codec result, which may include: the encoding and decoding equipment encodes and decodes the media stream directly sent by the target media resource according to the control signaling and processes the encoding and decoding result.
The target media resource is directly connected with the encoding and decoding device, namely, the encoding and decoding device can directly send data to the encoding and decoding device without transmitting data between the target media resource and the encoding and decoding device through other media, and the encoding and decoding device can directly send data to the encoding and decoding device, namely, the encoding and decoding device can directly request the target media resource and receive the corresponding media stream.
Under the condition that the target media resource is directly connected with the encoding and decoding equipment, after the encoding and decoding equipment receives the control signaling, the encoding and decoding equipment can perform corresponding encoding and decoding operation on the media stream directly sent by the target media resource according to the control signaling.
In a specific example, the target media resource is a camera, the camera is directly connected with the codec device, as shown in fig. 2b, the host is connected with the codec device through an HDMI and a network port, the codec device is connected with the display device and the camera, respectively, wherein the HDMI is used for transmitting host analog signals, and the network port is used for transmitting control signaling. The host computer sends the host computer analog signal to the encoding and decoding equipment through HDMI, the encoding and decoding equipment receives the host computer analog signal from the host computer, and when the encoding and decoding equipment does not carry out encoding and decoding business, the encoding and decoding equipment directly and transparently transmits the host computer analog signal to the display for displaying. After receiving the target application request directed to the camera, the host generates a control signaling according to the target application request, and sends the control signaling to the encoding and decoding equipment through the network port, after receiving the control signaling, the encoding and decoding equipment analyzes the control signaling according to a preset interface protocol, and if the analysis result is that the encoding and decoding operation is performed, the corresponding encoding and decoding operation is performed on the image data sent by the camera. Specifically, when the analysis result of the control signaling indicates the encoding operation, the encoding and decoding device requests the image data from the camera, and performs the encoding operation on the received image data, and after encoding is completed, the encoding result can be sent to the corresponding network node through the network according to the sending instruction in the control signaling; when the analysis result of the control signaling indicates decoding operation, the encoding and decoding equipment requests image data from the camera, decodes the received image data, fuses the decoding result with the host analog signal received currently according to the display indication in the control signaling, and sends the fusion result to the display for real-time picture display; when the analysis result of the control signaling indicates to stop encoding or decoding operation, the encoding and decoding equipment does not execute encoding and decoding service any more, and the host analog signal is directly transmitted to the display device for picture display.
In the technical scheme of the embodiment of the invention, the host sends the host analog signal to the encoding and decoding equipment, the encoding and decoding equipment transparently transmits the host analog signal to the display device for display when the encoding and decoding equipment does not perform encoding and decoding service, and after receiving the target application request pointing to the target media resource, the host sends the control signaling to the encoding and decoding equipment according to the target application request, and the encoding and decoding equipment performs encoding and decoding operation on the media stream of the target media resource according to the control signaling and performs corresponding processing on the encoding and decoding result. In the technical scheme, the host separates the business flow control and the encoding and decoding control of the host, so that the encoding and decoding operation on the media stream can independently run on a host platform, thereby realizing the efficient encoding and decoding operation under the condition of lower host performance and solving the problem of insufficient encoding and decoding capability of the host.
Example two
Fig. 3a is a flowchart of a coding and decoding method according to a second embodiment of the present invention. The embodiment is embodied on the basis of the foregoing embodiment, where, in a case where a media stream of a target media resource is forwarded by a streaming media server to a codec device, after receiving a target application request directed to the target media resource, the host may further include:
The host forwards the target application request to the streaming media server; the streaming media server determines a coding and decoding device matched with the target application request according to the target application request, and forwards the media stream of the target media resource to the matched coding and decoding device;
wherein, the host and the encoding and decoding equipment are respectively registered on the streaming media server;
further, the encoding and decoding device encodes and decodes the media stream of the target media resource according to the control signaling and processes the encoding and decoding result, which may include:
the encoding and decoding equipment encodes and decodes the media stream of the target media resource forwarded by the streaming media server according to the control signaling and processes the encoding and decoding result.
As shown in fig. 3a, the encoding and decoding method provided in this embodiment specifically includes:
s210, the host transmits the host analog signal to the encoding and decoding equipment.
S220, the encoding and decoding equipment transparently transmits the host analog signal to the display device for display when the encoding and decoding service is not performed; the host is connected with the display device through the encoding and decoding equipment.
S230, after receiving the target application request pointing to the target media resource, the host forwards the target application request to the streaming media server.
The streaming media server refers to a server which establishes communication connection with a plurality of media resources and is used for receiving and forwarding media streams of the media resources.
In the case where the media stream of the target media asset is forwarded by the streaming media server to the codec device, the host forwards the received target application request directed to the target media asset to the streaming media server.
S240, the streaming media server determines the encoding and decoding equipment matched with the target application request according to the target application request, and forwards the media stream of the target media resource to the matched encoding and decoding equipment.
Wherein the host and the codec device are respectively registered on the streaming media server. In the streaming media server, a one-to-one correspondence between the host and the codec device may be stored, for example, the host identifier and the codec device identifier may be stored in correspondence in a form of a correspondence table.
The streaming media server analyzes the target application request to determine the matched target media resource, and simultaneously queries the corresponding relation between the host and the encoding and decoding equipment to determine the encoding and decoding equipment matched with the target application request, so that the media stream of the target media resource can be sent to the encoding and decoding equipment matched with the target media resource.
For example, the target application request is an on-demand request directed to the media resource a, the streaming media server analyzes the media resource a after receiving the target application request forwarded by the host, and queries the corresponding relationship between the host and the codec device to determine the matched codec device, so as to send the media stream of the media resource a to the matched codec device.
Optionally, the target application request may be directed to a plurality of target media resources, and then the streaming media server may parse the target application request to determine a plurality of target media resources, and then may send media streams of the plurality of target media resources to the matched codec devices respectively.
S250, the host sends control signaling to the encoding and decoding equipment according to the target application request, and the encoding and decoding equipment encodes and decodes the media stream of the target media resource forwarded by the streaming media server according to the control signaling and processes the encoding and decoding result.
And the host generates control signaling according to the target application request and sends the control signaling to the encoding and decoding equipment. The encoding and decoding equipment carries out encoding and decoding operation on the received media stream of the target media resource forwarded by the streaming media server according to the control signaling, and carries out corresponding processing on encoding and decoding results.
When the control signaling indicates to perform coding and decoding operations on the media streams of the plurality of target media resources, the coding and decoding equipment performs corresponding operations according to the operation indication corresponding to each target media resource. It should be noted that, if the target application request initiated by the user indicates a stop encoding request or a stop decoding operation request corresponding to the target media resource, the host sends the target application request to the streaming media server, the streaming media server analyzes the target application request to determine the target media resource, and after querying the corresponding relationship between the host and the codec device to determine the matched codec device, the host stops sending the media stream of the target media resource to the matched codec device. Meanwhile, the host generates a control signaling according to the target application request and sends the control signaling to the encoding and decoding equipment, the encoding and decoding equipment stops encoding and decoding operations, and the host analog signal at the current moment is directly transmitted to the display device for display.
In a specific example, as shown in fig. 3b, the host is connected to the codec devices through HDMI and a network port, the codec devices are respectively connected to the display device, and the host and the codec devices are respectively registered on the streaming server. The host computer sends the host computer analog signal to the encoding and decoding equipment through HDMI, the encoding and decoding equipment receives the host computer analog signal from the host computer, and when the encoding and decoding equipment does not carry out encoding and decoding business, the encoding and decoding equipment directly and transparently transmits the host computer analog signal to the display for displaying. After receiving a target application request directed to a target media resource connected to a streaming media server, the host forwards the target application request to the streaming media server, the streaming media server analyzes the received target application request, determines a matched target media resource, searches a corresponding relation stored between the host and a coding and decoding device, determines a coding and decoding device matched with the target application request, further forwards a media stream of the target media resource to the matched coding and decoding device, meanwhile, the host generates a control signaling according to the target application request, sends the control signaling to the coding and decoding device through a network port, and after receiving the control signaling, the coding and decoding device analyzes the control signaling according to a preset interface protocol, and if the analysis result is coding and decoding operation, performs coding and decoding operation on the received media stream of the target media resource forwarded by the streaming media server. Specifically, when the analysis result of the control signaling indicates the encoding operation, the encoding and decoding device encodes the received media stream of the target media resource, and after encoding is completed, the encoding result can be sent to the corresponding network node through the network according to the sending instruction in the control signaling; when the analysis result of the control signaling indicates decoding operation, the encoding and decoding equipment decodes the received media stream of the target media resource, and can fuse the decoding result with the host analog signal received currently according to the display indication in the control signaling and send the fusion result to the display for real-time picture display; when the analysis result of the control signaling indicates to stop encoding or decoding operation, the encoding and decoding equipment does not execute encoding and decoding service any more, and the host analog signal is directly transmitted to the display device for picture display.
When the multi-path media stream is required to be decoded, the encoding and decoding equipment respectively decodes the media stream of each path of target media resource according to the control signaling, and fuses a plurality of decoding results with the host analog signal received currently according to the display requirement information of the decoding results in the control signaling to obtain one path of signal displayed by the display device, so that the terminal can display images corresponding to the multi-path media stream simultaneously.
For example, when decoding a four-channel media stream, the obtained four decoding results may be fused with the currently received host analog signal according to the display requirement of the decoding results in the control signaling, where the signal fusion operation is performed according to the display requirement information of the decoding results in the control signaling, for example, the display requirement information of the decoding results in the control signaling is that the four channels of signals are uniformly distributed in the display page, the first channel of signals and the second channel of signals are respectively located at the left side and the right side of the first row, the third channel of signals and the fourth channel of signals are respectively located at the left side and the right side of the second row, and then the four decoding results are fused with the currently received host analog signal according to the display requirement, and the obtained fusion result is sent to the display device and displayed, so that the display effect shown in fig. 3c may be obtained.
Fig. 3d is an application scenario schematic diagram of an encoding and decoding method according to an embodiment of the present invention. In a specific example, as shown in fig. 3d, the network includes multiple (N-channel) video sources, a streaming server, and multiple (M) terminals, each including a host, a codec device, and a display. In each terminal, the host is connected with the encoding and decoding equipment through HDMI and the network port respectively, and the encoding and decoding equipment is connected with the display device. The multi-path video source and the plurality of terminals are respectively registered on the streaming media server, wherein a host and the encoding and decoding equipment which are included in the terminals are respectively registered on the streaming media server, and the corresponding relation between the host and the encoding and decoding equipment is recorded on the streaming media server.
And when the encoding and decoding equipment does not perform encoding and decoding service, the encoding and decoding equipment directly and transparently transmits the host analog signal to a display for displaying. After receiving a target application request directed to a target media resource connected to a streaming media server, a host forwards the target application request to the streaming media server, the streaming media server analyzes the received target application request, determines a matched target media resource, searches a corresponding relation between the stored host and coding decoding equipment to determine coding decoding equipment matched with the target application request, and further forwards a video source of the target media resource to the matched coding decoding equipment. After receiving a control signaling generated according to a target application request directed to a target media resource and sent by a host, the codec device analyzes the control signaling according to a preset interface protocol, and if the analysis result is that the codec operation is performed, the codec operation is performed on the received media stream of the target media resource forwarded by the streaming media server. Specifically, when the analysis result of the control signaling indicates the encoding operation, the encoding and decoding device performs the encoding operation on the video source of the received target media resource, and after encoding is completed, the encoding result can be sent to the corresponding network node through the network according to the sending instruction in the control signaling; when the analysis result of the control signaling indicates decoding operation, the encoding and decoding equipment decodes the video source of the received target media resource, and can fuse the decoding result with the host analog signal received currently according to the display indication in the control signaling and send the fusion result to the display for picture display; when the analysis result of the control signaling indicates to stop encoding or decoding operation, the encoding and decoding equipment does not execute encoding and decoding service any more, and the host analog signal is directly transmitted to the display device for picture display.
The target application request may point to a plurality of target media resources, so that the streaming media server sends the multi-path media streams corresponding to the plurality of target media resources to the encoding and decoding device, and the encoding and decoding device may perform encoding and decoding operations on the multi-path streaming media at the same time, for example, after encoding the multi-path video, the multi-path streaming media may be sent to different terminals, or decode and display the multi-path video at the same time, so as to implement concurrent processing of encoding and decoding of the multi-path audio and video.
The present embodiment is not explained in detail herein, and reference is made to the foregoing embodiments.
In the technical scheme, the media streams of the media resources can be forwarded to the encoding and decoding equipment through the streaming media server, the number of the media resources can be multiple, the encoding and decoding equipment can simultaneously encode and decode the multipath media streams forwarded by the streaming media server under the instruction of the host control signaling, and the concurrent processing of the encoding and decoding operations is realized, so that the support of encoding and decoding processing of the multi-platform audio and video under the condition of lower host performance is realized, and the high efficiency of the encoding and decoding operations is further improved.
Example III
Fig. 4 is a schematic structural diagram of a codec system according to a third embodiment of the present invention, where the present embodiment is applicable to a situation where efficient codec operation is implemented under a situation where the host performance is low. The encoding and decoding method in the above embodiment may be applied to the encoding and decoding system provided in the embodiment of the present invention.
As shown in fig. 4, the codec system provided in this embodiment includes: host 410, codec device 420, and display 430, wherein:
the host 410 is connected to the display device 430 through the codec device 420, and is configured to send a host analog signal to the codec device 420, and after receiving a target application request directed to a target media resource, send control signaling to the codec device 420 according to the target application request.
The codec device 420 is configured to transparently transmit the host analog signal to the display device 430 when the codec service is not performed, and perform codec on the media stream of the target media resource according to the control signaling and process the codec result.
And a display device 430 for displaying the analog signal transmitted by the codec device.
Illustratively, in the embodiment of the present invention, a Loongson host and a Hai Si codec device may be adopted, and the host configuration may be: CPU of Loongson 3A3000, DDR3 8GB memory, operating system of winning kylin V5.0.
The host 410 may send host analog signals to the codec device 420 through an analog signal interface of the host 410 corresponding to the codec device 420, where the codec device 420 receives the host analog signals from the host 410, and when the codec device 420 does not perform the codec service, the codec device 420 directly and transparently transmits the host analog signals to the display apparatus 430 for display.
After the host 410 receives the target application request directed to the target media resource, the host 410 may send a control signaling to the codec device 420 according to a preset interface protocol through a control signal interface corresponding to the codec device 420 by the host 410 according to the target application request, when the codec device 420 receives the control signaling sent by the host 410 according to the target application request directed to the target media resource, parse the control signaling according to the preset interface protocol, and if the parsing result is that the codec operation is performed, perform the codec operation on the received media stream of the target media resource. Specifically, if the codec device 420 parses the control signaling to start encoding, the codec device 420 requests the media stream from the corresponding target media resource, performs an encoding operation on the media stream of the target media resource according to the control signaling, and may send the obtained encoding result to the corresponding network node through the network according to the control signaling; if the codec device 420 parses the control signaling to start decoding, the codec device 420 requests the media stream from the corresponding target media resource, and performs decoding operation on the media stream of the target media resource according to the control signaling, and may fuse the decoding result with the host analog signal currently received according to the display requirement of the decoding result in the control signaling, and then send the fusion result to the display device 430 for real-time image display; when the control signaling indicates to stop encoding or decoding operation, the codec device 420 does not perform the codec service any more, and directly transmits the host analog signal to the display device 430 for display.
Optionally, the codec system provided in this embodiment may further include: the system comprises a streaming media server, wherein a host and a codec device are respectively registered on the streaming media server, and the streaming media server is used for determining the matched codec device according to a target application request which is sent by the host and points to a target media resource and forwarding the media stream of the target media resource to the matched codec device.
The host can send the host analog signal to the encoding and decoding equipment through the analog signal interface, the encoding and decoding equipment receives the host analog signal from the host, and when the encoding and decoding equipment does not carry out encoding and decoding service, the encoding and decoding equipment directly and transparently transmits the host analog signal to the display device for display. After receiving a target application request directed to a target media resource connected to a streaming media server, the host forwards the target application request to the streaming media server, the streaming media server analyzes the received target application request, determines a matched target media resource, searches a corresponding relation stored between the host and a coding and decoding device to determine a coding and decoding device matched with the target application request, further forwards a media stream of the target media resource to the matched coding and decoding device, simultaneously, generates a control signaling according to the target application request, sends the control signaling to the coding and decoding device through a control signal interface, analyzes the control signaling according to a preset interface protocol after the coding and decoding device receives the control signaling, and performs coding and decoding operation on the received media stream of the target media resource if the analysis result is coding and decoding operation. Specifically, if the codec device analyzes the control signaling to start encoding, the codec device performs encoding operation on the received media stream of the target media resource, and after encoding is completed, the obtained encoding result can be sent to the corresponding network node through the network according to the control signaling; when the control signaling indicates decoding operation, the encoding and decoding equipment decodes the received media stream of the target media resource, and can fuse the decoding result with the host analog signal received currently according to the display indication in the control signaling and send the fusion result to the display device for real-time picture display; when the control signaling indicates to stop encoding or decoding operation, the encoding and decoding equipment does not execute encoding and decoding service any more, and the host analog signal is directly transmitted to the display device for display.
The present embodiment is not explained in detail herein, and reference is made to the foregoing embodiments.
The host in the system sends the host analog signal to the encoding and decoding equipment, the encoding and decoding equipment receives the host analog signal sent by the host and transmits the host analog signal to the display device for displaying when the encoding and decoding service is not performed, the host sends the control signaling to the encoding and decoding equipment according to the target application request after receiving the target application request pointing to the target media resource, and when the encoding and decoding equipment receives the control signaling sent by the host according to the target application request pointing to the target media resource, the encoding and decoding equipment performs encoding and decoding operation on the media stream of the target media resource according to the control signaling and performs corresponding processing on the encoding and decoding result.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (8)
1. A method of encoding and decoding, comprising:
the host computer sends the host computer analog signal to the encoding and decoding equipment;
the encoding and decoding equipment transmits the host analog signal to a display device for display when encoding and decoding service is not performed; the host is connected with the display device through the encoding and decoding equipment;
after receiving a target application request pointing to a target media resource, the host sends a control signaling to the encoding and decoding equipment according to the target application request;
the encoding and decoding equipment encodes and decodes the media stream of the target media resource according to the control signaling and processes the encoding and decoding result;
in the case that the media stream of the target media resource is forwarded to the codec device by the streaming media server, the host computer, after receiving the target application request directed to the target media resource, includes:
the host forwards the target application request to the streaming media server;
the streaming media server determines a codec device matched with the target application request according to the target application request, and forwards a media stream of the target media resource to the matched codec device;
Wherein the host and the codec device are respectively registered on the streaming media server;
the encoding and decoding device encodes and decodes the media stream of the target media resource according to the control signaling and processes the encoding and decoding result, and the encoding and decoding device comprises:
and the encoding and decoding equipment encodes and decodes the media stream of the target media resource forwarded by the streaming media server according to the control signaling and processes the encoding and decoding result.
2. The method of claim 1, wherein the codec device codec the media stream of the target media resource according to the control signaling and process the codec result, comprising:
when the control signaling indicates the coding operation, the coding and decoding equipment performs the coding operation on the media stream of the target media resource according to the control signaling, and sends the coding result to the corresponding network node through the network.
3. The method of claim 1, wherein the codec device codec the media stream of the target media resource according to the control signaling and process the codec result, comprising:
When the control signaling indicates decoding operation, the encoding and decoding equipment decodes the media stream of the target media resource according to the control signaling, fuses the decoding result with the host analog signal received currently, and sends the fusion result to the display device for display.
4. The method of claim 1, wherein in the case where the target media resource is directly connected to the codec device, the codec device performs the codec on the media stream of the target media resource according to the control signaling and processes the codec result, including:
and the encoding and decoding equipment encodes and decodes the media stream directly sent by the target media resource according to the control signaling and processes the encoding and decoding result.
5. A method according to claim 3, wherein the codec device fuses the decoding result with the currently received host analog signal, comprising:
and the encoding and decoding equipment fuses the decoding result with the currently received host analog signal according to the display requirement of the decoding result in the control signaling.
6. The method of claim 1, wherein the host transmitting the host analog signal to the codec device comprises:
The host sends the host analog signal to the encoding and decoding equipment through an analog signal interface corresponding to the encoding and decoding equipment by the host.
7. The method of claim 1, wherein the host sending control signaling to the codec device comprises:
and the host sends control signaling to the encoding and decoding equipment according to a preset interface protocol through a control signal interface corresponding to the encoding and decoding equipment by the host.
8. A codec system, comprising: the system comprises a host, encoding and decoding equipment and a display device, wherein the host is connected with the display device through the encoding and decoding equipment;
the host is used for sending host analog signals to the encoding and decoding equipment, and sending control signaling to the encoding and decoding equipment according to the target application request after receiving the target application request pointing to the target media resource;
the encoding and decoding equipment is used for transmitting the host analog signal to the display device when encoding and decoding service is not performed, encoding and decoding the media stream of the target media resource according to the control signaling and processing encoding and decoding results; the display device is used for displaying the analog signals sent by the encoding and decoding equipment;
In the case that the media stream of the target media resource is forwarded to the codec device by the streaming media server, the host computer, after receiving the target application request directed to the target media resource, includes:
the host forwards the target application request to the streaming media server;
the streaming media server determines a codec device matched with the target application request according to the target application request, and forwards a media stream of the target media resource to the matched codec device;
a streaming media server, wherein the host and the codec device are respectively registered on the streaming media server;
the streaming media server is used for determining the encoding and decoding equipment matched with the target application request according to the target application request which is sent by the host and points to the target media resource, and forwarding the media stream of the target media resource to the matched encoding and decoding equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011553001.0A CN112738056B (en) | 2020-12-24 | 2020-12-24 | Encoding and decoding method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011553001.0A CN112738056B (en) | 2020-12-24 | 2020-12-24 | Encoding and decoding method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112738056A CN112738056A (en) | 2021-04-30 |
| CN112738056B true CN112738056B (en) | 2023-05-05 |
Family
ID=75615343
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011553001.0A Active CN112738056B (en) | 2020-12-24 | 2020-12-24 | Encoding and decoding method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112738056B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103179431A (en) * | 2013-03-21 | 2013-06-26 | 福建升腾资讯有限公司 | Method for redirecting, transcoding and separating audio/video under VDI (Virtual Desktop Infrastructure) condition |
| CN104683863A (en) * | 2013-11-28 | 2015-06-03 | 中国移动通信集团公司 | Method and equipment for multimedia data transmission |
| CN108124158A (en) * | 2016-11-29 | 2018-06-05 | 北京视联动力国际信息技术有限公司 | Multimedia terminal and the data processing method of multimedia terminal |
| WO2018119711A1 (en) * | 2016-12-27 | 2018-07-05 | 深圳前海达闼云端智能科技有限公司 | Multimedia encoding/decoding method and device for multi-operating system, and electronic device |
| CN109089084A (en) * | 2018-09-20 | 2018-12-25 | 北京计算机技术及应用研究所 | Video line transmits online data and extracts and stealthy storage control device and its working method |
| CN111970473A (en) * | 2020-08-19 | 2020-11-20 | 彩讯科技股份有限公司 | Method, device, equipment and storage medium for realizing synchronous display of double video streams |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10985779B2 (en) * | 2018-08-27 | 2021-04-20 | Polaran Haberlesme Teknolojileri Anonim Sirketi | Method and system for decoding data using compressed channel output information |
-
2020
- 2020-12-24 CN CN202011553001.0A patent/CN112738056B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103179431A (en) * | 2013-03-21 | 2013-06-26 | 福建升腾资讯有限公司 | Method for redirecting, transcoding and separating audio/video under VDI (Virtual Desktop Infrastructure) condition |
| CN104683863A (en) * | 2013-11-28 | 2015-06-03 | 中国移动通信集团公司 | Method and equipment for multimedia data transmission |
| CN108124158A (en) * | 2016-11-29 | 2018-06-05 | 北京视联动力国际信息技术有限公司 | Multimedia terminal and the data processing method of multimedia terminal |
| WO2018119711A1 (en) * | 2016-12-27 | 2018-07-05 | 深圳前海达闼云端智能科技有限公司 | Multimedia encoding/decoding method and device for multi-operating system, and electronic device |
| CN109089084A (en) * | 2018-09-20 | 2018-12-25 | 北京计算机技术及应用研究所 | Video line transmits online data and extracts and stealthy storage control device and its working method |
| CN111970473A (en) * | 2020-08-19 | 2020-11-20 | 彩讯科技股份有限公司 | Method, device, equipment and storage medium for realizing synchronous display of double video streams |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112738056A (en) | 2021-04-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2018196790A1 (en) | Video playing method, device and system | |
| US10805615B2 (en) | Synchronizing video signals using cached key frames | |
| CN112637661B (en) | Video stream switching method and device, computer storage medium and electronic equipment | |
| CN111787026B (en) | Method, device and equipment for transmitting media data and storage medium | |
| EP3399725B1 (en) | Multimedia stream multicasting method and device | |
| WO2019061256A1 (en) | Streaming media-based audio and video playback method and device | |
| EP2312826A2 (en) | Network device, information processing apparatus, stream switching method, information processing method, program, and content distribution system | |
| WO2021093882A1 (en) | Video meeting method, meeting terminal, server, and storage medium | |
| CN113259729B (en) | Data switching method, server, system and storage medium | |
| CN112738056B (en) | Encoding and decoding method and system | |
| WO2012163059A1 (en) | Method, device and system for device redirection data transmission | |
| CN111385590A (en) | Live broadcast data processing method and device and terminal | |
| CN112817913B (en) | Data transmission method and device, electronic equipment and storage medium | |
| CN112565799B (en) | Video data processing method and device | |
| CN115022725A (en) | Video playing method and device | |
| US11265357B2 (en) | AV1 codec for real-time video communication | |
| CN107172366A (en) | A kind of video previewing method | |
| CN113727183B (en) | Live push method, apparatus, device, storage medium and computer program product | |
| CN116668779B (en) | Virtual reality view field distribution method, system, device, equipment and medium | |
| WO2023216798A1 (en) | Audio and video transcoding apparatus and method, and device, medium and product | |
| CN115379257B (en) | Rendering method, device, system, storage medium and program product | |
| CN116055658B (en) | Multi-picture real-time image frame fusion monitoring method and system for websites and APP | |
| US20230088496A1 (en) | Method for video streaming | |
| WO2022100742A1 (en) | Video encoding and video playback method, apparatus and system | |
| WO2024032189A1 (en) | Data transmission method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |