CN114640862A - Video processing method, device, computer readable storage medium and processor - Google Patents

Video processing method, device, computer readable storage medium and processor Download PDF

Info

Publication number
CN114640862A
CN114640862A CN202011488959.6A CN202011488959A CN114640862A CN 114640862 A CN114640862 A CN 114640862A CN 202011488959 A CN202011488959 A CN 202011488959A CN 114640862 A CN114640862 A CN 114640862A
Authority
CN
China
Prior art keywords
soft
data
video
decoder
client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011488959.6A
Other languages
Chinese (zh)
Inventor
张聪慧
李强国
周晶晶
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian Novastar Electronic Technology Co Ltd
Original Assignee
Xian Novastar Electronic Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian Novastar Electronic Technology Co Ltd filed Critical Xian Novastar Electronic Technology Co Ltd
Priority to CN202011488959.6A priority Critical patent/CN114640862A/en
Publication of CN114640862A publication Critical patent/CN114640862A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23424Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44016Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration

Abstract

The invention discloses a video processing method, a video processing device, a computer readable storage medium and a processor. Wherein, the method comprises the following steps: the decoder acquires soft coding data of target video data, wherein the soft coding data are obtained by performing soft coding on the target video data; the decoder pushes the soft coded data to the client, wherein the soft coded data is subjected to soft decoding by the client to obtain soft decoded data; or, the decoder performs soft decoding on the soft coded data to obtain soft decoded data and pushes the soft decoded data to the client; the soft decoding data is used for enabling the client to render video pictures of the video source on the display interface. The invention solves the technical problem that enough hardware coding resources are needed to display the picture of the video source.

Description

Video processing method, device, computer readable storage medium and processor
Technical Field
The present invention relates to the field of video processing, and in particular, to a video processing method, apparatus, computer-readable storage medium, and processor.
Background
Currently, in a distributed system, in an On-Screen Display (OSD) of an agent node or in large Screen management software, a user wants to be able to view a picture of a video source in a source list, and may use a scheme of a haisi chip to transfer a picture of an input source to the OSD of the agent node or to the large Screen management software for Display.
However, the haisi chip has a lot of hardware coding resources, and usually the hardware coding resources inside the haisi chip are directly used for coding, and then the coded data is pushed to the local area network, and after the receiving side pulls the stream, the data is decoded and then displayed. This requires sufficient hardware coding resources to be realized.
In view of the above technical problem in the prior art that sufficient hardware coding resources are required to display the pictures of a video source, no effective solution has been proposed at present.
Disclosure of Invention
Embodiments of the present invention provide a video processing method, an apparatus, a computer-readable storage medium, and a processor, so as to at least solve the technical problem that enough hardware coding resources are required to display a picture of a video source.
According to an aspect of an embodiment of the present invention, there is provided a video processing method. The method can comprise the following steps: the decoder acquires soft coding data of target video data, wherein the soft coding data is obtained by performing soft coding on the target video data; the decoder pushes the soft coded data to the client, wherein the soft coded data is subjected to soft decoding by the client to obtain soft decoded data; or, the decoder performs soft decoding on the soft coded data to obtain soft decoded data and pushes the soft decoded data to the client; the soft decoding data is used for enabling the client to render video pictures of the video source on the display interface.
Optionally, the decoder obtains soft-coded data of the target video data, including: the decoder performs soft coding on the target video data to obtain soft coded data.
Optionally, the soft coding of the target video data by the decoder to obtain soft coded data includes: splicing the multi-channel source data on a target canvas by a decoder to obtain video picture data, wherein the target video data comprises the multi-channel source data; the decoder performs soft coding on the video picture data to obtain soft coded data.
Optionally, the decoder acquires target video data, including: and the decoder receives and responds to the first request sent by the client and acquires corresponding multi-path source data through the multi-path encoder node.
Optionally, after the decoder receives and responds to the first request sent by the client, the method further includes, by the multi-encoder node, acquiring corresponding multi-channel source data, and further includes: and the decoder receives and responds to the second request sent by the client and updates the multi-channel source data.
Optionally, the multiple paths of source data include at least one path of preview source data and at least one path of layer source data.
Optionally, before the decoder performs soft decoding on the soft-coded data to obtain soft-decoded data, the method further includes: the decoder obtains a video stream of the target video format obtained by soft-coding the target video data by the encoder, wherein the soft-coded data comprises the video stream of the target video format.
Optionally, the soft decoding the soft coded data by the decoder to obtain soft decoded data, including: the decoder performs soft decoding on the video stream of the target video format to obtain video frames of the video source, wherein the soft decoding data comprises the video frames of the video source.
Optionally, the decoder obtains a video stream of the target video format obtained by soft-coding the target video data by the encoder, and includes: the decoder acquires the video stream based on the address of the encoder, wherein the address of the encoder is determined by the requirement information of the client, and the requirement information is used for indicating the requirement of display of the display interface.
Optionally, the decoder obtains soft-coded data of the target video data, including: in the case where there are a plurality of video sources, the decoder sequentially acquires soft-coded data of target video data of each video source.
Optionally, the target video data is source bare data.
Optionally, the target video data is obtained by compressing original video data of the video source by an encoder.
According to another aspect of the embodiment of the invention, a video processing system is also provided. The system may include: an encoder for acquiring target video data; the decoder is connected with the encoder and used for acquiring soft coded data of the target video data, wherein the soft coded data are obtained by performing soft coding on the target video data by the decoder or the encoder; and the client is connected with the decoder and used for acquiring the soft coded data and performing soft decoding on the soft coded data to acquire soft decoded data, or acquiring the soft decoded data obtained by performing soft decoding on the soft coded data by the decoder, wherein the soft decoded data is used for enabling the client to render a video picture of a video source on a display interface.
According to another aspect of the embodiment of the invention, a video processing device is also provided. The apparatus may include: the device comprises an acquisition unit, a decoding unit and a processing unit, wherein the acquisition unit is used for enabling a decoder to acquire soft coding data of target video data, and the soft coding data is obtained by performing soft coding on the target video data; and the conversion unit is used for enabling the decoder to convert the target video data into video picture data of the video source, wherein the video picture data is used for enabling the client to display the video picture of the video source on the display interface.
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium. The computer readable storage medium includes a stored program, wherein the apparatus in which the storage medium is located is controlled to execute the video processing method according to the embodiment of the present invention when the program runs.
According to another aspect of the embodiments of the present invention, there is also provided a processor. The processor is configured to execute a program, wherein the program executes the video processing method according to the embodiment of the present invention when the program is executed by the processor.
In the invention, a decoder is adopted to obtain soft coding data of target video data, wherein the soft coding data is obtained by performing soft coding on the target video data; the decoder pushes the soft coded data to the client, wherein the soft coded data is subjected to soft decoding by the client to obtain soft decoded data; or, the decoder performs soft decoding on the soft coded data to obtain soft decoded data and pushes the soft decoded data to the client; the soft decoding data is used for enabling the client to render video pictures of the video source on the display interface. That is, the decoder of the present invention obtains the soft coded data of the target video data, and can push the soft coded data to the client directly, the client performs soft decoding on the soft coded data, to render video pictures of the video source on the client, or the decoder to soft-decode the soft-coded data, and push the obtained soft-decoded data to the client to render video pictures of the video source on the client, therefore, under the condition of not using hardware coding resources of a chip, the client can display the video pictures of a video source on a display interface, the aim of realizing the source pre-monitoring function under the condition of no hardware coding and decoding resources is fulfilled, therefore, the technical problem that the picture of the video source can be displayed only by enough hardware coding resources is solved, and the technical effect that the picture of the video source is displayed without enough hardware coding resources is achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a schematic diagram of a video processing system according to an embodiment of the present invention;
FIG. 2 is a flow diagram of a video processing method according to an embodiment of the invention;
FIG. 3 is a schematic diagram of a video processing system according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a video processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in other sequences than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
The embodiment of the invention provides a video processing system.
Fig. 1 is a schematic diagram of a video processing system according to an embodiment of the present invention. As shown in fig. 1, the video processing system 10 may include: an encoder 11, a decoder 12 and a client 13.
And an encoder 11 for acquiring the target video data.
In this embodiment, the Encoder (Encoder)11 has a Field-Programmable Gate Array (FPGA) chip, and the Encoder 11 may compress the original video data of the video source through the FPGA chip, where each frame of the original video data may be compressed to 480 × 270 video bare data (480 × 270raw data), which may also be referred to as source bare data, and determine the source bare data as the target video data.
Alternatively, the embodiment may pass the target video data into an encoder node (ARM), which may be used to push the unencoded data directly to the decoder 12.
Optionally, the ARM of this embodiment may also perform soft coding on the target video data, for example, perform soft coding on the target video data by using a Central Processing Unit (CPU), so as to obtain soft coded data, where the soft coded data may be a video stream in a target video format, for example, the target video format may be an H264 format. The soft coding is performed by using a CPU, and the hard coding is performed by using a non-CPU, for example, a Graphics Processing Unit (GPU), a dedicated Digital Signal Processor (DSP), a Field-Programmable Gate Array (FPGA), or an Application Specific Integrated Circuit (ASIC) chip.
And the decoder 12 is connected to the encoder 11 and configured to obtain soft coded data of the target video data, where the soft coded data is obtained by soft coding the target video data by the decoder or the encoder.
In this embodiment, the Decoder (Decoder)12 and the encoder 11 may be connected through a switch, and may obtain soft-coded data of the target video data.
Optionally, the master node of the decoder 12 in this embodiment may select corresponding multiple encoder nodes to connect according to a request of the client 13, and pull corresponding target video data from the encoder through the multiple encoder nodes, where the request of the client 13 may include a request for requesting multiple preview source data and multiple layer source data, the multiple encoder nodes may be 16 encoder nodes, and the target video data may be multiple source data, which may include multiple preview source data and multiple layer source data. After the decoder 12 pulls the corresponding target video data through the multiplex encoder node, the target video data corresponding to the multiplex encoder node may be arranged on a canvas for splicing, where the size of the canvas may be 1920 × 1080, and then the decoder node performs soft encoding on the spliced data, where the soft encoded data is also the video picture data, and then pushes the video picture data to the client 13, for example, the video picture data is pushed to the client 13 by using a Real Time Streaming Protocol (RTSP) Protocol, and in a multicast manner.
Optionally, in a case that the target video data in the target video format is obtained by soft-coding the target video data by using the CPU through the ARM, the decoder 12 may dynamically connect addresses (IP) of different encoders 11 according to a requirement displayed by the client 13 to obtain soft-coded data, for example, obtain video streams in different target video formats, and the decoder 12 may further use the CPU to soft-decode the video streams in the target video format to obtain soft-decoded data, where the soft-decoded data may include video frames which are bare data and then push the video frames to the client 13.
And the client 13 is connected to the decoder 12, and is configured to acquire the soft coded data and perform soft decoding on the soft coded data to acquire soft decoded data, or acquire soft decoded data obtained by performing soft decoding on the soft coded data by the decoder, where the soft decoded data is used to enable the client to render a video picture of a video source on a display interface.
In this embodiment, the client 13, that is, an Application (APP) end, may be a WEB page (WEB) client, and may be connected to the decoder 12 through a wireless route. Optionally, the client 13 receives the soft coded data sent by the decoder, and may perform processing such as soft decoding and cutting on the soft coded data, so as to render the video picture of the video source onto the display interface of the client 13, so that the user can see the video picture of the video source, thereby implementing a source pre-monitoring function, and implementing pre-monitored picture display, that is, the input video source can be viewed and previewed on the corresponding source content on the client 13.
Optionally, the client 13 obtains soft decoded data obtained by soft decoding the soft coded data by the decoder, and may display a video picture corresponding to the soft decoded data in a menu interface of the client 13, for example, the menu interface is an OSD.
Optionally, the video frames displayed on the display interface of the client 13 in this embodiment are initialized video frames.
Optionally, the user may slide the preview source list of the client 13, and through operations such as layer windowing and source cutting, the decoder 12 modifies the request for requesting the multiple paths of preview source data and the multiple paths of layer source data, so as to pull new multiple paths of preview source data and multiple paths of layer source data, and then returns the new multiple paths of preview source data and multiple paths of layer source data to the client 13, and the client 13 may perform processing such as refresh decoding and cutting on the new multiple paths of preview source data and multiple paths of layer source data, so as to display a new video picture on the client 13, so that the user sees the new video picture on the client 13.
Alternatively, the client 13 of this embodiment may display a default page when initially opened, then open a large screen edit page, and send a request for requesting multi-path preview source data and multi-path layer source data to the decoder 12.
Optionally, in the chip used in the video processing system of this embodiment, the encoding resource of the chip is only 4K60, so that the input pre-monitored video source needs to be transmitted in a bare data transmission manner; the resolution of the target video data of this embodiment may be 480x270, frame rate 15 frames; the client 13 may dynamically control the decoder 12 via the protocol to fill the corresponding video data source.
The video processing system of this embodiment may be a distributed system, and the original video data of the video source is compressed by the encoder 11 to obtain the target video data; connected to the encoder 11 through the decoder 12 for converting the target video data into video picture data of a video source; connected to the decoder 12 via the client 13 for displaying video pictures of the video source on the display interface based on the video picture data. That is, the decoder of this embodiment obtains the soft coded data of the target video data, and can push the soft coded data directly to the client, which performs soft decoding on the soft coded data, to render video pictures of the video source on the client, or the decoder to soft-decode the soft-coded data, and push the obtained soft-decoded data to the client to render video pictures of the video source on the client, therefore, under the condition of not using hardware coding resources of the chip, the client can display the video pictures of the video source on the display interface, the aim of realizing the source pre-monitoring function under the condition of no hardware coding and decoding resources is achieved, therefore, the technical problem that the pictures of the video source can be displayed only by using enough hardware coding resources is solved, and the technical effect that the pictures of the video source can be displayed without using enough hardware coding resources is achieved.
Example 2
According to an embodiment of the present invention, there is provided an embodiment of a video processing method, it should be noted that the video processing method of this embodiment may be executed by a video processing system of embodiment 1 of the present invention, the steps illustrated in the flowchart of the figure may be executed in a computer system such as a set of computer executable instructions, and although a logical order is illustrated in the flowchart, in some cases, the steps illustrated or described may be executed in an order different from that herein.
Fig. 2 is a flow chart of a video processing method according to an embodiment of the present invention. As shown in fig. 2, the method may include the steps of:
step S202, a decoder acquires soft coded data of target video data, wherein the soft coded data is obtained by performing soft coding on the target video data.
In the technical solution provided in step S202 of the present invention, a bare data transmission mode is adopted between the decoder and the encoder, and the target video data may be obtained by compressing the original video data of the video source by the FPGA chip of the encoder, for example, the encoder compresses the original video data to obtain the target video data with a size of 480x270, where the target video data may be referred to as video bare data and source bare data. Alternatively, the target video data of this embodiment may be passed by the encoder into the encoder node ARM, where the encoder node ARM may push the unencoded data directly to the decoder. Optionally, the encoder of this embodiment may send the target video data to the local area network through the encoder node ARM, or send the target video data to the decoder through the switch, so that the decoder acquires the target video data.
Optionally, the soft coded data of this embodiment may be obtained by performing soft coding on target video data by a decoder, for example, the target video data is multi-channel source data, and is spliced on a canvas, and soft coding is performed on the spliced data to obtain soft coded data, or the encoder performs soft coding on the target video data by using an ARM and using a CPU.
Step S204, the decoder pushes the soft coded data to the client, wherein the soft coded data is subjected to soft decoding by the client to obtain soft decoded data; or, the decoder performs soft decoding on the soft coded data to obtain soft decoded data and pushes the soft decoded data to the client; the soft decoding data is used for enabling the client to render video pictures of the video source on the display interface.
In the technical solution provided in step S204 of the present invention, the decoder may push the soft coded data obtained by soft coding the target video data to the client, and perform further soft decoding on the soft coded data through the client, so as to display the video picture of the video source on the display interface of the client; the method can also be used for carrying out soft decoding on soft coded data obtained by carrying out soft coding on target video data by an encoder through an ARM (advanced RISC machine) by adopting a CPU (central processing unit) to obtain soft decoded data and further pushing the soft decoded data to the client, wherein the soft decoded data can comprise video frames in a target video format, and further video pictures corresponding to the video frames are displayed on a display interface of the client through the soft decoded data, so that a source pre-monitoring function is realized, pre-monitored picture display is realized, namely, corresponding source contents can be viewed and previewed on the client for an input video source.
Through the above steps S202 and S204, the decoder obtains soft coded data of the target video data, where the soft coded data is obtained by performing soft coding on the target video data; the decoder pushes the soft coded data to the client, wherein the soft coded data is subjected to soft decoding by the client to obtain soft decoded data; or, the decoder performs soft decoding on the soft coded data to obtain soft decoded data and pushes the soft decoded data to the client; the soft decoding data is used for enabling the client to render video pictures of the video source on the display interface. That is to say, in this embodiment, the decoder obtains the soft coded data of the target video data, and can directly push the soft coded data to the client, and the client performs soft decoding on the soft coded data to render the video picture of the video source on the client, or the decoder performs soft decoding on the soft coded data to push the obtained soft decoded data to the client, so as to render the video picture of the video source on the client, thereby achieving the purpose of implementing the source pre-monitoring function without hardware encoding and decoding resources, further solving the technical problem that the picture of the video source can be displayed only when enough hardware encoding resources are needed, and achieving the technical effect that the picture of the video source can be displayed without enough hardware encoding resources.
The above method of this embodiment is further described below.
As an alternative implementation, in step S202, the decoder obtains soft-coded data of the target video data, including: the decoder performs soft coding on the target video data to obtain soft coded data.
In this embodiment, when the decoder obtains the soft coded data of the target video data, the decoder may perform soft coding on the obtained target video data, may perform soft coding on the target video data through the decoder node, so as to obtain soft coded data, and then push the soft coded data to the client, or send the soft coded data to the client using an RTSP protocol. The soft coded data can be subjected to soft decoding by the client, and the soft decoded data obtained by the soft decoding is drawn and rendered to a display interface of the client.
As an alternative embodiment, the decoder performs soft coding on the target video data to obtain soft coded data, including: splicing the multi-channel source data on a target canvas by a decoder to obtain video picture data, wherein the target video data comprises the multi-channel source data; the decoder performs soft coding on the video picture data to obtain soft coded data.
In this embodiment, the target video data may be multiple source data, for example, 16 source data, when the decoder performs soft coding on the target video data to obtain soft coded data, the multiple source data may be arranged on a target canvas, the size of the target canvas may be 1920x1080, and then the multiple source data are spliced on the target canvas to obtain video picture data, and then the video picture data obtained by splicing is soft coded to obtain soft coded data, and then the soft coded data is pushed to the client through an RTSP protocol.
As an alternative implementation, in step S202, the decoder obtains target video data, including: and the decoder receives and responds to the first request sent by the client and acquires corresponding multi-channel source data through the multi-channel encoder node.
In this embodiment, when the decoder acquires the target video data, the first request sent by the client is acquired by the decoder, where the first request is acquired by a master node of the decoder, and the first request is a request for acquiring corresponding multi-channel source data, and may be triggered by a user on a large-screen editing page of the client. After the decoder receives the first request, the decoder responds to the first request, and selects the corresponding multi-path encoder node to connect, where the multi-path encoder may be a 16-path encoder node, and pulls the corresponding multi-path source data to the encoder through the multi-path encoder node, that is, the encoder returns the multi-path source data to the decoder.
As an optional implementation manner, after the decoder receives and responds to the first request sent by the client, the method further includes, by the multi-encoder node, acquiring corresponding multi-source data, and further includes: and the decoder receives and responds to the second request sent by the client and updates the multi-channel source data.
In this embodiment, after the decoder receives and responds to the first request sent by the client and acquires the corresponding multi-path source data through the multi-path encoder node, the decoder may further receive a second request sent by the client, where the second request is a request for updating the multi-path source data, for example, a request for modifying the multi-path source data. Optionally, the client includes a preview source list, and the user may slide the preview source list to perform operations such as layer windowing and source cutting, so as to trigger the second request. After the decoder receives the second request, the decoder can respond to the second request to update the multi-path source data, new multi-path source data can be pulled to the encoder, the decoder is filled with the new multi-path source data and then returns the new multi-path source data to the client, and the client carries out refreshing soft decoding and cutting on the new multi-path source data so as to display a new video picture on the client, so that a user can see the new video picture on the client.
As an optional implementation manner, the multiple paths of source data include at least one path of preview source data and at least one path of layer source data.
In this embodiment, the multiple paths of source data may include at least one path of preview source data, for example, 16 paths of preview source data; the multiple paths of source data may further include at least one path of layer source data, for example, include 16 paths of layer source data, so that the first request in this embodiment is a request for obtaining information of at least one path of preview source data and at least one path of layer source data.
As an optional implementation manner, before the decoder performs soft decoding on the soft encoded data to obtain soft decoded data, the method further includes: the decoder obtains a video stream of the target video format obtained by soft-coding the target video data by the encoder, wherein the soft-coded data comprises the video stream of the target video format.
In this embodiment, the ARM of the encoder may perform soft encoding on the target video data, for example, using a CPU), to obtain soft encoded data, where the soft encoded data may be a video stream in a target video format, for example, the target video format may be in an H264 format, and then may be streamed into a local area network using RTSP, so that the encoder and the decoder in this embodiment may perform transmission in the target video format.
As an alternative implementation, in step S204, the soft decoding is performed on the soft encoded data by the decoder to obtain soft decoded data, including: the decoder performs soft decoding on the video stream of the target video format to obtain video frames of the video source, wherein the soft decoding data comprises the video frames of the video source.
In this embodiment, when the decoder performs soft decoding on the soft coded data to obtain soft decoded data, the decoder may perform soft decoding on a video stream in a target video format, for example, perform CPU soft decoding to obtain a video frame of a video source, and then send the video frame to the client, so as to display a video picture corresponding to the video frame on a menu interface of the client, where the menu interface may be an OSD menu interface.
As an alternative implementation, in step S202, the decoder obtains a video stream of a target video format obtained by soft-coding target video data by the encoder, and includes: the decoder acquires the video stream based on the address of the encoder, wherein the address of the encoder is determined by the requirement information of the client, and the requirement information is used for indicating the requirement of display of the display interface.
In this embodiment, when the decoder obtains the video stream in the target video format obtained by soft-coding the target video data by the encoder, the decoder may receive and respond to a third request to determine the address of the encoder, where the third request is used to indicate the requirement information of the client, and the requirement information may be display requirement information of the display interface. After determining the address of the encoder, the encoder may be connected to the encoder through the address of the encoder, and the video stream in the target video format is pulled to the encoder.
As an alternative implementation manner, in step S202, the decoder obtains soft coded data of the target video data, including: in the case where there are a plurality of video sources, the decoder sequentially acquires soft-coded data of target video data of each video source.
In this embodiment, the number of the video sources may be multiple, and the decoder may sequentially obtain the soft coded data of the target video data of each video source, which may be dynamically obtaining the soft coded data of the target video data of the source video corresponding to the video picture that needs to be displayed on the display interface of the client, so as to ensure the performance efficiency of video display.
The video processing method of the embodiment is a transmission scheme of a pre-monitoring picture, and the pre-monitoring picture can be displayed by the method under the condition of not using hardware coding resources of a chip; when the number of the input sources is large, the video data corresponding to the video pictures to be displayed on the display interface are dynamically acquired, so that the performance efficiency is ensured.
Example 3
The technical solutions of the embodiments of the present invention are described below by way of examples in connection with preferred embodiments.
In a distributed system, in the OSD menu of the agent node or in the large screen management software, the user wants to be able to view the content of the video source in real time in the source list, so it is necessary to transfer the dynamic video of the input source to the OSD of the agent node or to the large screen management software.
In the related technology, a Haesi chip scheme is used, and because the Haesi chip has more hard coding resources, the Haesi chip usually directly uses the hardware coding resources inside the Haesi chip to carry out coding, then the coded data is pushed to a local area network, and after the receiver pulls the stream, the coded data is decoded and displayed. However, this requires sufficient hardware coding resources to be realized.
The embodiment can realize the picture display of pre-monitoring under the condition of not using hardware coding resources of a chip, and can dynamically acquire the source content required by the display interface when the number of the input video sources is more so as to ensure the performance efficiency.
The above-described method of this embodiment is further described below.
Fig. 3 is a schematic diagram of a video processing system according to an embodiment of the present invention. As shown in fig. 3, the video processing system may include: APP end 31, wireless route 32, decoder 33, switch 34, and encoder 35.
In this embodiment, a bare data transmission mode is adopted between the internal encoding and decoding nodes, the FPGA chip in each encoder 33 first compresses each frame of the original video data into 480x270 size, and can transmit the compressed data to the encoder node ARM, where the ARM can directly push the uncoded data to the decoder 33.
In this embodiment, a user opens the APP end 31, the APP end 31 may display a default page, the user may further open a large-screen editing page of the APP end 31, and trigger the APP end 31 to send a request for requesting 8-way preview source data and 8-way layer source data to the decoder 33 through the wireless router 32, where the request may be sent to the master node of the decoder 33, the master node of the decoder 33 may respond to the request, and obtain corresponding 16-way source data from 480x270 compressed data in the encoder node ARM through the switch 34, where the 16-way source data may include 8-way preview source data and 8-way layer source data. The decoder 33 may arrange the 16 source numbers on one integral 1920 × 1080 canvas for splicing, then perform soft coding on the spliced video picture through the decoder node, and push the data after the soft coding to the APP terminal 31 in a multicast manner by using the RTSP protocol, and perform soft decoding through the APP terminal 31 and rendering to the interface of the APP terminal 31.
Optionally, the soft-coded data in this embodiment may be an RTSP video stream, the decoder 33 may return position data of the RTSP video stream to the APP terminal 31, for example, a Uniform Resource Locator (URL) address, the APP terminal 31 may obtain the RTSP video stream based on the URL address, decode and cut the RTSP video stream, and display a corresponding video picture, so that the APP terminal 31 may display an initialized video picture, and then a user may see the initialized video picture at the APP terminal 31. The preview source data and the layer source data in the RTSP video stream respectively have corresponding position data.
Optionally, the user may slide the preview source list of the APP terminal 31, modify, through operations such as layer windowing and source switching, the request sent to the decoder 33 for requesting 8-way preview sources and 8-way layer sources through the wireless router 32, pull new 16-way source data from the decoder 33, and return new 16-way source data from the encoder 35 to the decoder 33. The decoder 33 fills the new 16-way source data, successfully returns the new 16-way source data to the APP terminal 31, and the APP terminal 31 refreshes soft decoding and cutting to display a new video picture corresponding to the new 16-way source data, so that the user can see the latest video picture. Wherein, the APP terminal 31 can perform a silent frame display before the decoder 33 successfully returns the new 16-channel source data to the APP terminal 31.
It should be noted that, in the chip used in the video processing system of this embodiment, the encoding resource is only 4K60, so that the input pre-monitored video is transmitted in a bare data transmission manner; the resolution of the video data compressed by the encoder 35 is 480x270, and the frame rate is 15 frames; the APP end 31 fills the corresponding video source data through the protocol dynamic control decoder 33.
As another alternative example, the encoder and the decoder of this embodiment may transmit video data in an H264 format, where an FPGA chip in each encoder compresses each frame of original video data into 480 × 270, and transmits the compressed video data to an ARM, and the ARM may encode the video data into an H264 format video in a CPU soft coding manner, and then may use an RTSP protocol to stream the video data to a local area network. Optionally, the decoder may dynamically connect to different encoders IP according to the display requirements of the display interface of the client, and obtain different H264 video streams through the encoders IP. And then the decoder firstly performs soft decoding on the H264 video stream by using the CPU to obtain a video frame, and then transmits a video picture corresponding to the video frame to an OSD menu interface of the client.
The video processing method of the embodiment is a transmission scheme of a pre-monitoring picture, and the pre-monitoring picture can be displayed by the method under the condition of not using hardware coding resources of a chip; when the number of the input sources is large, the video data corresponding to the video pictures to be displayed on the display interface are dynamically acquired, so that the performance efficiency is ensured.
Example 4
The embodiment of the invention also provides a video processing device. It should be noted that the video processing apparatus of this embodiment may be used to execute the video processing method of the embodiment of the present invention.
Fig. 4 is a schematic diagram of a video processing apparatus according to an embodiment of the present invention. As shown in fig. 4, the video processing apparatus 40 may include: an acquisition unit 41 and a push unit 42.
An obtaining unit 41, configured to enable the decoder to obtain soft coded data of the target video data, where the soft coded data is obtained by performing soft coding on the target video data.
A pushing unit 42, configured to enable the decoder to push the soft coded data to the client, where the soft coded data is soft-decoded by the client to obtain soft decoded data; or, the soft decoding module is used for enabling the decoder to perform soft decoding on the soft coded data to obtain soft decoded data and pushing the soft decoded data to the client; the soft decoding data is used for enabling the client to render video pictures of the video source on the display interface.
Alternatively, the acquiring unit 41 includes: and the soft coding module is used for enabling the decoder to carry out soft coding on the target video data to obtain soft coded data.
Optionally, the soft coding module comprises: the splicing submodule is used for enabling the decoder to splice the multi-channel source data on the target canvas to obtain video picture data, wherein the target video data comprise the multi-channel source data; and the soft coding sub-module is used for enabling the decoder to carry out soft coding on the video picture data to obtain soft coded data.
Alternatively, the acquiring unit 41 includes: and the first acquisition module is used for enabling the decoder to receive and respond to the first request sent by the client and acquire the corresponding multi-channel source data through the multi-channel encoder nodes.
Optionally, the apparatus further comprises: and the updating unit is used for updating the multi-path source data after the decoder receives and responds to the first request sent by the client and acquires the corresponding multi-path source data through the multi-path encoder node.
Optionally, the multiple paths of source data include at least one path of preview source data and at least one path of layer source data.
Optionally, the apparatus further comprises: and a first obtaining unit, configured to enable the decoder to obtain a video stream of the target video format obtained by soft-coding the target video data by the encoder before the decoder performs soft-decoding on the soft-coded data to obtain soft-decoded data, where the soft-coded data includes the video stream of the target video format.
Optionally, the pushing unit 42 includes: and the soft decoding module is used for enabling the decoder to perform soft decoding on the video stream in the target video format to obtain the video frame of the video source, wherein the soft decoding data comprises the video frame of the video source.
Optionally, the first obtaining unit includes: and the second acquisition module is used for enabling the decoder to acquire the video stream based on the address of the encoder, wherein the address of the encoder is determined by the requirement information of the client, and the requirement information is used for indicating the requirement of display of the display interface.
Alternatively, the acquiring unit 41 includes: and the third acquisition module is used for enabling the decoder to sequentially acquire the soft coding data of the target video data of each video source under the condition that the video sources are multiple.
Optionally, the target video data is source bare data.
Optionally, the target video data is obtained by compressing original video data of the video source by an encoder.
In the video processing apparatus of this embodiment, soft-coded data of target video data is acquired by a decoder, the soft coded data can be directly pushed to the client, the client performs soft decoding on the soft coded data to render the video picture of the video source on the client, or the decoder performs soft decoding on the soft coded data and pushes the obtained soft decoded data to the client to render the video picture of the video source on the client, therefore, under the condition of not using hardware coding resources of the chip, the client can display the video pictures of the video source on the display interface, the aim of realizing the source pre-monitoring function under the condition of no hardware coding and decoding resources is achieved, therefore, the technical problem that the picture of the video source can be displayed only by enough hardware coding resources is solved, and the technical effect that the picture of the video source is displayed without enough hardware coding resources is achieved.
Example 5
According to an embodiment of the present invention, there is also provided a computer-readable storage medium. The computer readable storage medium includes a stored program, wherein the apparatus in which the storage medium is located is controlled to execute the video processing method according to the embodiment of the present invention when the program runs.
Example 6
According to an embodiment of the present invention, there is also provided a processor for executing a program, where the program executes the video processing method according to the embodiment of the present invention when executed by the processor.
Example 7
The embodiment of the invention provides a video processing method, which comprises the following steps: the decoder acquires soft coding data of target video data, wherein the soft coding data is obtained by performing soft coding on the target video data; the decoder pushes the soft coded data to the client, wherein the soft coded data is subjected to soft decoding by the client to obtain soft decoded data; or, the decoder performs soft decoding on the soft coded data to obtain soft decoded data and pushes the soft decoded data to the client; the soft decoding data is used for enabling the client to render video pictures of the video source on the display interface.
As an alternative embodiment, the decoder obtains soft-coded data of target video data, including: the decoder performs soft coding on the target video data to obtain soft coded data.
As an alternative embodiment, the decoder performs soft coding on the target video data to obtain soft coded data, including: splicing the multi-channel source data on a target canvas by a decoder to obtain video picture data, wherein the target video data comprises the multi-channel source data; the decoder performs soft coding on the video picture data to obtain soft coded data.
As an alternative embodiment, the decoder acquires target video data, including: and the decoder receives and responds to the first request sent by the client and acquires corresponding multi-channel source data through the multi-channel encoder node.
As an optional implementation manner, after the decoder receives and responds to the first request sent by the client, the method further includes, by the multi-encoder node, acquiring corresponding multi-source data, and further includes: and the decoder receives and responds to the second request sent by the client and updates the multi-channel source data.
As an optional implementation manner, the multiple paths of source data include at least one path of preview source data and at least one path of layer source data.
As an optional implementation manner, before the decoder performs soft decoding on the soft encoded data to obtain soft decoded data, the method further includes: the decoder obtains a video stream of the target video format obtained by soft-coding the target video data by the encoder, wherein the soft-coded data comprises the video stream of the target video format.
As an alternative embodiment, the decoder performs soft decoding on the soft-coded data to obtain soft-decoded data, including: the decoder performs soft decoding on the video stream of the target video format to obtain video frames of the video source, wherein the soft decoding data comprises the video frames of the video source.
As an alternative embodiment, the decoder obtains a video stream of a target video format obtained by soft-coding target video data by an encoder, and includes: the decoder acquires the video stream based on the address of the encoder, wherein the address of the encoder is determined by the requirement information of the client, and the requirement information is used for indicating the requirement of display of the display interface.
As an alternative embodiment, the decoder obtains soft-coded data of target video data, including: in the case where there are a plurality of video sources, the decoder sequentially acquires soft-coded data of target video data of each video source.
As an alternative embodiment, the target video data is source bare data.
As an alternative embodiment, the target video data is obtained by compressing the original video data of the video source by an encoder.
An embodiment of the present invention further provides a video processing system, where the system may include: an encoder for acquiring target video data; the decoder is connected with the encoder and used for acquiring soft coded data of the target video data, wherein the soft coded data is obtained by performing soft coding on the target video data by the decoder or the encoder; and the client is connected with the decoder and used for acquiring the soft coded data and performing soft decoding on the soft coded data to acquire soft decoded data, or acquiring the soft decoded data obtained by performing soft decoding on the soft coded data by the decoder, wherein the soft decoded data is used for enabling the client to render a video picture of a video source on a display interface.
An embodiment of the present invention further provides a video processing apparatus, where the apparatus may include: an acquisition unit, configured to enable a decoder to acquire soft coded data of target video data, where the soft coded data is obtained by performing soft coding on the target video data; the pushing unit is used for enabling the decoder to push the soft coded data to the client, wherein the soft coded data are subjected to soft decoding by the client to obtain soft decoding data; or, the soft decoding module is used for enabling the decoder to perform soft decoding on the soft coded data to obtain soft decoded data and pushing the soft decoded data to the client; the soft decoding data is used for enabling the client to render video pictures of the video source on the display interface.
The embodiment of the invention also provides a computer-readable storage medium, which comprises a stored program, wherein when the program runs, the device where the storage medium is located is controlled to execute the video processing method of the embodiment of the invention.
The embodiment of the invention also provides a processor, which is used for running the program, wherein when the program is run by the processor, the video processing method of the embodiment of the invention is executed.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, and various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims (10)

1. A video processing method, comprising:
a decoder acquires soft coding data of target video data, wherein the soft coding data is obtained by performing soft coding on the target video data;
the decoder pushes the soft coded data to a client, wherein the soft coded data is subjected to soft decoding by the client to obtain soft decoded data; alternatively, the first and second electrodes may be,
the decoder performs soft decoding on the soft coded data to obtain soft decoded data, and pushes the soft decoded data to the client;
and the soft decoding data is used for enabling the client to render video pictures of a video source on a display interface.
2. The method of claim 1, wherein the decoder obtains soft coded data for the target video data, comprising:
and the decoder performs soft coding on the target video data to obtain the soft coded data.
3. The method of claim 2, wherein the decoder soft-encodes the target video data to obtain the soft-encoded data, comprising:
the decoder splices multi-channel source data on a target canvas to obtain video picture data, wherein the target video data comprises the multi-channel source data;
and the decoder performs soft coding on the video picture data to obtain the soft coded data.
4. The method of claim 1, wherein before the decoder soft-decodes the soft-coded data to obtain the soft-decoded data, the method further comprises:
the decoder obtains a video stream of a target video format obtained by soft-coding the target video data by an encoder, wherein the soft-coded data comprises the video stream of the target video format.
5. The method of claim 4, wherein the decoder soft-decodes the soft-coded data to obtain the soft-decoded data, comprising:
and the decoder performs soft decoding on the video stream of the target video format to obtain the video frame of the video source, wherein the soft decoding data comprises the video frame of the video source.
6. The method of claim 4, wherein the decoder obtains the video stream in the target video format obtained by the encoder soft-coding the target video data, and comprises:
and the decoder acquires the video stream based on the address of the encoder, wherein the address of the encoder is determined by the requirement information of the client, and the requirement information is used for indicating the requirement of display of the display interface.
7. A video processing system, comprising:
an encoder for acquiring target video data;
the decoder is connected with the encoder and is used for acquiring soft coded data of the target video data, wherein the soft coded data is obtained by performing soft coding on the target video data by the decoder or the encoder;
and the client is connected with the decoder and used for acquiring the soft coded data and performing soft decoding on the soft coded data to acquire soft decoded data, or acquiring the soft decoded data obtained by performing soft decoding on the soft coded data by the decoder, wherein the soft decoded data is used for enabling the client to render a video picture of a video source on a display interface.
8. A video processing apparatus, comprising:
an obtaining unit, configured to enable a decoder to obtain soft coded data of target video data, where the soft coded data is obtained by performing soft coding on the target video data;
the pushing unit is used for enabling the decoder to push the soft coded data to a client, wherein the soft coded data is subjected to soft decoding by the client to obtain soft decoding data; or, the decoder is configured to perform soft decoding on the soft coded data to obtain the soft decoded data, and push the soft decoded data to the client;
and the soft decoding data is used for enabling the client to render video pictures of a video source on a display interface.
9. A computer-readable storage medium, comprising a stored program, wherein the program, when executed, controls an apparatus in which the storage medium is located to perform the method of any of claims 1-6.
10. A processor, characterized in that the processor is configured to run a program, wherein the program, when executed by the processor, performs the method of any one of claims 1 to 6.
CN202011488959.6A 2020-12-16 2020-12-16 Video processing method, device, computer readable storage medium and processor Pending CN114640862A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011488959.6A CN114640862A (en) 2020-12-16 2020-12-16 Video processing method, device, computer readable storage medium and processor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011488959.6A CN114640862A (en) 2020-12-16 2020-12-16 Video processing method, device, computer readable storage medium and processor

Publications (1)

Publication Number Publication Date
CN114640862A true CN114640862A (en) 2022-06-17

Family

ID=81944624

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011488959.6A Pending CN114640862A (en) 2020-12-16 2020-12-16 Video processing method, device, computer readable storage medium and processor

Country Status (1)

Country Link
CN (1) CN114640862A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101218644A (en) * 2005-08-31 2008-07-09 三星电子株式会社 Soft decoding method and apparatus, error correction method and apparatus, and soft output method and apparatus
CN104104913A (en) * 2014-07-14 2014-10-15 华侨大学 Intelligent distributed type video collecting system based on Android system
CN104768063A (en) * 2015-04-07 2015-07-08 天脉聚源(北京)教育科技有限公司 Video coding method and device
CN107087138A (en) * 2017-04-07 2017-08-22 华南理工大学 A kind of video conferencing system based on H.265 video code model
CN108235096A (en) * 2018-01-18 2018-06-29 湖南快乐阳光互动娱乐传媒有限公司 The mobile terminal hard decoder method that intelligently the soft decoding of switching plays video
CN108282164A (en) * 2017-01-05 2018-07-13 腾讯科技(深圳)有限公司 A kind of data encoding and coding/decoding method and device
CN111083546A (en) * 2019-12-13 2020-04-28 北京东土科技股份有限公司 Audio and video transmission control method, system and server
CN111447447A (en) * 2020-04-03 2020-07-24 北京三体云联科技有限公司 Live broadcast encoding method and device and electronic equipment

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101218644A (en) * 2005-08-31 2008-07-09 三星电子株式会社 Soft decoding method and apparatus, error correction method and apparatus, and soft output method and apparatus
CN104104913A (en) * 2014-07-14 2014-10-15 华侨大学 Intelligent distributed type video collecting system based on Android system
CN104768063A (en) * 2015-04-07 2015-07-08 天脉聚源(北京)教育科技有限公司 Video coding method and device
CN108282164A (en) * 2017-01-05 2018-07-13 腾讯科技(深圳)有限公司 A kind of data encoding and coding/decoding method and device
CN107087138A (en) * 2017-04-07 2017-08-22 华南理工大学 A kind of video conferencing system based on H.265 video code model
CN108235096A (en) * 2018-01-18 2018-06-29 湖南快乐阳光互动娱乐传媒有限公司 The mobile terminal hard decoder method that intelligently the soft decoding of switching plays video
CN111083546A (en) * 2019-12-13 2020-04-28 北京东土科技股份有限公司 Audio and video transmission control method, system and server
CN111447447A (en) * 2020-04-03 2020-07-24 北京三体云联科技有限公司 Live broadcast encoding method and device and electronic equipment

Similar Documents

Publication Publication Date Title
RU2378765C1 (en) Device and method for receiving multiple streams in mobile transmission system
JP7444872B2 (en) Methods, apparatus, and computer programs for encapsulating media data into media files
JP4855472B2 (en) Method and apparatus for controlling multi-channel scene configuration for mobile terminal screen display in mobile broadcast system and system thereof
KR102464061B1 (en) Method and device for sending and receiving media data
KR101234495B1 (en) Terminal, node device and method for processing stream in video conference system
US9369508B2 (en) Method for transmitting a scalable HTTP stream for natural reproduction upon the occurrence of expression-switching during HTTP streaming
JP2011514053A (en) Using triggers on video for interactive content identification
CN114503599A (en) Using extensions in the GLTF2 scene description to support video and audio data
EP2974319A1 (en) Distribution control system, distribution control method, and computer-readable storage medium
CN105122224A (en) Distribution control system, distribution control method, and computer-readable storage medium
CN110035331A (en) A kind of processing method and processing device of media information
KR20170138994A (en) Broadcast signal transmission apparatus, broadcast signal reception apparatus, broadcast signal transmission method, and broadcast signal reception method
CN105122818A (en) Computer system, distribution control system, distribution control method, and computer-readable storage medium
EP3151574A1 (en) System and method for maintaining connection channel in multi-device interworking service
CN110996122B (en) Video frame transmission method, device, computer equipment and storage medium
CN109845280A (en) Audio and video playing method and device based on Streaming Media
CA3069031A1 (en) Media information processing method and apparatus
CN102770827A (en) Method for displaying multimedia content on a screen of a terminal
CN113973224A (en) Method for transmitting media information, computing device and storage medium
CN112752074A (en) Data transmission method, device, terminal equipment and storage medium
WO2022116822A1 (en) Data processing method and apparatus for immersive media, and computer-readable storage medium
CN114640862A (en) Video processing method, device, computer readable storage medium and processor
KR102533674B1 (en) Receiving device, sending device and data processing method
CN115708356A (en) Video processing method, device, equipment and computer readable storage medium
KR20130056829A (en) Transmitter/receiver for 3dtv broadcasting, and method for controlling the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination