CN114630051B

CN114630051B - Video processing method and system

Info

Publication number: CN114630051B
Application number: CN202210313575.3A
Authority: CN
Inventors: 刘超; 张胜利
Original assignee: Alibaba China Co Ltd
Current assignee: Shenli Vision Shenzhen Cultural Technology Co ltd
Priority date: 2022-03-28
Filing date: 2022-03-28
Publication date: 2023-06-09
Anticipated expiration: 2042-03-28
Also published as: CN114630051A

Abstract

The embodiment of the specification provides a video processing method and a system, wherein the video processing method is applied to a transcoding unit and comprises the following steps: acquiring an original video acquired by a camera in the process of video acquisition by the camera; transcoding the original video according to the Internet protocol to obtain transcoded video data with a data format conforming to the Internet protocol; uploading the transcoded video data to a communications network that communicates according to the internetworking protocol. The scheme can ensure that the video processing is more efficient.

Description

Video processing method and system

Technical Field

The embodiment of the specification relates to the technical field of computers, in particular to a video processing method.

Background

In the production of video such as movie and television drama, advertisement, etc., video acquisition and video processing are of great importance.

In the related art, video captured by a camera is generally written directly into a memory card of the camera, and after the video capture is completed, the video is read from the memory card and the read video is processed, such as editing, toning, and the like. Thus, video processing must wait for video acquisition to end and video reading in the memory card to complete, resulting in a significant reduction in video processing efficiency. Thus, there is a need to provide a more efficient solution.

Disclosure of Invention

In view of this, the present embodiments provide a video processing method. One or more embodiments of the present specification relate to a video processing system, a video processing apparatus, a computing device, a computer-readable storage medium, and a computer program that solve the technical drawbacks of the prior art.

According to a first aspect of embodiments of the present disclosure, there is provided a video processing method, applied to a transcoding unit, including:

acquiring an original video acquired by a camera in the process of video acquisition by the camera;

transcoding the original video according to an Internet protocol to obtain transcoded video data with a data format conforming to the Internet protocol;

uploading the transcoded video data to a communications network that communicates according to the internetworking protocol.

According to a second aspect of embodiments of the present specification, there is provided a video processing method applied to a video processing apparatus accessing a communication network which communicates according to an internet protocol, comprising:

receiving transcoding video data sent by a transcoding unit through the communication network, wherein the transcoding video data is obtained by transcoding an original video acquired by a camera according to an Internet protocol in the process of video acquisition by the transcoding unit;

Video processing data is obtained based on the transcoded video data.

According to a third aspect of embodiments of the present specification, there is provided a video processing system comprising: a transcoding unit and a video processing device;

the transcoding unit is configured to acquire an original video acquired by the camera in the process of video acquisition by the camera; transcoding the original video according to an Internet protocol to obtain transcoded video data with a data format conforming to the Internet protocol; uploading the transcoded video data to a communications network that communicates according to the internetworking protocol;

the video processing device is configured to receive the transcoded video data via the communication network and obtain video processing data based on the transcoded video data.

According to a fourth aspect of embodiments of the present specification, there is provided a computing device comprising:

a memory and a processor;

the memory is configured to store computer-executable instructions that, when executed by the processor, perform the steps of the video processing method described above.

According to a fifth aspect of embodiments of the present specification, there is provided a computer readable storage medium storing computer executable instructions which, when executed by a processor, implement the steps of the video processing method described above.

According to a sixth aspect of the embodiments of the present specification, there is provided a computer program, wherein the computer program, when executed in a computer, causes the computer to perform the steps of the video processing method described above.

According to the embodiment of the specification, a transcoding unit is realized, and in the process of video acquisition by a camera, an original video acquired by the camera is acquired; transcoding the original video according to the Internet protocol to obtain transcoded video data with a data format conforming to the Internet protocol; the transcoded video data is uploaded to a communication network that communicates according to an internetworking protocol.

In this way, the transcoding unit transcodes the original video collected by the camera into transcoded video data conforming to the internet protocol, and the data conforming to the internet protocol has universality. Thus, it can be ensured that the transcoded video data is suitable for a computing device such as a video processing device. On the basis, the transcoded video data is uploaded to a communication network which communicates according to an Internet protocol, and computing equipment such as video processing equipment and the like do not need to wait for a camera to finish video acquisition and complete reading of an original video from a storage medium of the camera, but can directly acquire the transcoded video data from the communication network in the video acquisition process, so that video processing is performed based on the transcoded video data. Therefore, the video processing efficiency can be improved by the scheme.

Drawings

FIG. 1 is an exemplary diagram of a video processing flow in a film and television capture scene;

FIG. 2 is a flow chart of a video processing method provided in one embodiment of the present disclosure;

FIG. 3 is a flow chart of another video processing method provided by one embodiment of the present disclosure;

FIG. 4 is a schematic diagram of a video processing system according to one embodiment of the present disclosure;

FIG. 5 is a process diagram of a video processing method according to one embodiment of the present disclosure;

fig. 6 is an exemplary diagram of an application scenario of a video processing method according to an embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present disclosure;

fig. 8 is a schematic structural diagram of another video processing apparatus according to an embodiment of the present disclosure;

FIG. 9 is a block diagram of a computing device provided in one embodiment of the present description.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present description. This description may be embodied in many other forms than described herein and similarly generalized by those skilled in the art to whom this disclosure pertains without departing from the spirit of the disclosure and, therefore, this disclosure is not limited by the specific implementations disclosed below.

The terminology used in the one or more embodiments of the specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of the specification. As used in this specification, one or more embodiments and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present specification refers to and encompasses any or all possible combinations of one or more of the associated listed items.

It should be understood that, although the terms first, second, etc. may be used in one or more embodiments of this specification to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first may also be referred to as a second, and similarly, a second may also be referred to as a first, without departing from the scope of one or more embodiments of the present description. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.

First, terms related to one or more embodiments of the present specification will be explained.

Internetworking protocol (IP, internet Protocol): is a network layer protocol in the TCP/IP architecture. Wherein, TCP/IP (Transmission Control Protocol/Internet Protocol ) refers to a protocol cluster capable of implementing information transmission between multiple different networks. The IP has the function of improving the expandability of the network and realizing the interconnection and intercommunication of large-scale heterogeneous networks. IP is a foundation constituting the internet, and can provide various protocols of information, such as TCP, UDP, etc., to a transport layer; IP packets may be placed on the link layer for delivery via various technologies such as ethernet, token ring networks, etc.

IP network: the connected network is implemented in accordance with an internetworking protocol. For example, communication between different networks, such as ethernet, packet switched networks, etc., may be implemented in accordance with an internetworking protocol.

IP conversion: refers to converting various types of data (analog signal data, digital signal data, etc.) into IP packets conforming to the internet protocol. The IP packets may be transmitted based on a general internet infrastructure (such as a router, a switch, a communication network, etc.), and stored in a general storage device (such as a usb disk, a hard disk, a mobile hard disk, a network attached storage, etc.). Network attached storage (NAS, network Attached Storage): a device connected to a network and having a data storage function is also called a "network storage". NAS is a dedicated data storage server, which uses data as a center, thoroughly separates storage devices from the server, and centrally manages data, thereby freeing bandwidth, improving performance, and reducing total ownership cost.

Digital component serial interface (SDI, serial Digital Interface): a digital video interface standard. The interface of the SDI is mainly determined according to a transmission rate, for example, the HD-SDI interface is a high definition digital input and output port of a broadcasting stage, where HD represents a high definition signal. The SDI serial interface is an interface that sequentially transfers bits of a data word and corresponding data through a single channel. Since the data rate of serial digital signals is high, it must be processed before transmission. Since the SDI interface cannot directly transmit the compressed digital signal, after the compressed signal recorded by the digital video recorder, the hard disk, and other devices is replayed, the compressed signal must be decompressed and output through the SDI interface to enter the SDI system. If decompression and compression are repeated, it is necessary to cause degradation of image quality and increase of delay, and for this purpose, digital video recorders and nonlinear editing systems of various formats, which define their own interfaces for directly transmitting compressed digital signals, are provided.

Network device Interface (NDI, networkDevice Interface): audio and video codec and UDP based network transport protocol interfaces. NDI does not require complex wiring to reliably transmit and store conventional video signals in an IP network-based infrastructure. NDI can implement two functions, a first one being encoding compression and decoding of video and a second one being low-latency transmission based on the first one. Wherein, the encoding and decoding of NDI may include: the coding is to code the audio and video signals into NDI network flow to enter the exchanger or PC, then to be found and called by PC or software in the network; in the decoding process, the NDI is controlled to decode and restore NDI streams (NDI streams are selected when more NDI streams are needed) in the network into SDI/HDMI signals by decoding and restoring 1-path NDI streams only through one NDI box, and the SDI/HDMI signals are output to a local display, television, recorder or other equipment or terminals requiring SDI/HDMI signals through the NDI box. HDMI refers to a high definition multimedia interface (High Definition Multimedia Interface, HDMI) which is a fully digital video and audio transmission interface that can transmit uncompressed audio and video signals. HDMI can be used for set top boxes, DVD players, personal computers, televisions, game consoles, combination expansion machines, digital audio and television sets, and other devices. HDMI can send audio frequency and video signal simultaneously, because audio frequency and video signal adopt same wire rod, can simplify the installation degree of difficulty of system's circuit greatly.

Agent material: and the original video material is replaced by the agent material with smaller data volume and unchanged content through automatic transcoding and calling of the agent software. On the basis, the agent materials can be clipped, the clipping result is applied to the large video materials, and finally the target video which does not affect the video quality is output.

And (3) image transmission: the image is accurately and quickly transferred. The current common graphic transmission technologies are MPEG-2, MPEG-4, etc., and in brief, the technologies are to compress the emphasis of the image and grasp the emphasis transmission.

Metadata (Metadata): also called intermediate data and relay data, which are data (data about data) describing data, mainly describe information of data attribute (property) and are used for supporting functions such as indicating storage location, history data, resource searching, file recording, etc. Metadata is an electronic catalog, and in order to achieve the purpose of cataloging, the contents or characteristics of data must be described and collected, so as to achieve the purpose of assisting in data retrieval.

Referring to fig. 1, fig. 1 shows an exemplary diagram of a video processing flow in a film-shooting scene, which may specifically include the following steps: a post-editing process and a field shooting process. The field shooting process comprises the following steps: the video camera collects videos, the videos are sent to the image transmission end through the SDI cable, the image transmission end sends the videos to the image transmission receiving end through wireless transmission, the image transmission receiving end sends the videos to the site monitor through the SDI cable, and then site related personnel can monitor and review the shot videos through the site monitor. The later clipping flow includes: writing the video acquired by the camera into a memory card during shooting, taking out the memory card from the camera after the acquisition is completed, and copying the memory card and acquiring proxy materials; the copying refers to reading video from a memory card, and the agent material acquisition refers to automatic transcoding and calling of the read video through agent software to obtain agent material; further, storing the video obtained by copying, namely the original material and the proxy material, into an NAS storage matrix; editing personnel can acquire agent materials and original materials from the NAS storage matrix; editing the proxy material, and sleeving the editing result back to the original material to obtain a sheet. In the video processing flow shown in fig. 1, video processing such as editing, manual transfer and transcoding depending on a memory card, and operation can be performed only after shooting is completed, and cannot be performed in parallel with movie and television drama shooting, resulting in low video processing efficiency.

In order to improve video processing efficiency, in the present specification, a video processing method is provided, and the present specification relates to a video processing apparatus, a computing device, and a computer-readable storage medium, which are described in detail in the following embodiments one by one.

Referring to fig. 2, fig. 2 shows a flowchart of a video processing method according to an embodiment of the present disclosure, which is applied to a transcoding unit, and specifically includes the following steps:

s202, acquiring an original video acquired by a camera in the video acquisition process of the camera.

In a specific application, the transcoding unit is connected to the camera. The specific manner of connection may be varied depending on the specific form of the transcoding unit. For example, when the transcoding unit is a software module, the transcoding unit may be provided in an output port of the camera or in a network interface of a communication network communicating according to the internet protocol, which network interface is connected to the camera. Alternatively, for example, when the transcoding unit is a hardware device, the transcoding unit may be independent of the camera and the above-mentioned communication network, and connected to the camera and the above-mentioned communication network, respectively. And, the video capturing process by the camera may include: the camera starts the video acquisition to the process before the video acquisition is finished. Therefore, the step S202 can achieve the effect of immediately acquiring the video acquired by the camera: when the video is acquired by the camera, the currently acquired video is acquired without waiting for the video acquisition to finish. In this way, video processing efficiency can be ensured. The transcoding unit can acquire the original video acquired by the camera in the video acquisition process of the camera in various modes.

In an alternative embodiment, the output interface of the camera is connected to a network device interface of the communication network, wherein the network device interface comprises a transcoding unit;

correspondingly, the method for acquiring the original video acquired by the camera specifically comprises the following steps:

receiving an original video acquired by a camera by using a network equipment interface;

the original video is input to a transcoding unit.

The network device interface may specifically be NDI. In this way, an NDI in the form of a hardware device, i.e. an encoder, can be directly connected to the camera in an external manner, and the SDI output of the camera, i.e. the original video, is received. Further, NDI IP-converts received data by the included transcoding unit: the original video in the form of an SDI signal is transcoded into transcoded video data in the form of an NDI signal. Therefore, the embodiment realizes the acquisition and transcoding of the original video through the NDI in the form of hardware equipment, and does not need to additionally set codes for transcoding the video according to an Internet protocol, thereby being more convenient.

For example, the camera may actively output the captured video to the transcoding unit when the video is captured, so that the transcoding unit may receive the video, i.e., the original video. Alternatively, the transcoding unit may request the video captured by the camera during a preset period from the camera when it is monitored that the camera starts capturing the video, so that the transcoding unit may receive the original video. This is reasonable, and any manner of obtaining the original video collected by the camera during the video collection of the camera can be used in the present specification, which is not limited in this embodiment.

S204, transcoding the original video according to the Internet protocol to obtain transcoded video data with the data format conforming to the Internet protocol.

In a specific application, the original video is transcoded according to the internet protocol to obtain transcoded video data with a data format conforming to the internet protocol, and the original video is IP-formatted to obtain IP packets capable of being transmitted in a communication network communicating according to the internet protocol. In this embodiment, the IP data packet is transcoded video data, so that it can be ensured that the transcoded data can be uploaded to the communication network and obtained by the video processing device accessing the communication network. Also, the IP packet may be applicable to video processing devices, such as mobile terminals, portable notebooks, desktop computers, and the like.

In contrast to SDI transmitted data, the original video captured by the camera may no longer be limited to only the receipt by a monitor at the theatrical scene, but may be received and processed by a video processing device. In one case, the transcoding unit may also obtain metadata of the original video in order to ensure that the subsequent video processing is more accurate based on the video processing of the transcoded video data. This will be described in detail in the following in the form of alternative embodiments for ease of understanding and rational layout.

And S206, uploading the transcoded video data to a communication network which communicates according to an Internet protocol.

In particular applications, the communication network may be a plurality of communication networks communicating according to the internet protocol. The communication network may be, for example, a wireless communication network: WIFI networks, local area networks where cameras are located at video capture sites, ethernet, etc. In one case, the communication network communicating according to the internet protocol is a target wireless communication network; accordingly, after the transcoding unit uploads the transcoded video data to the target wireless communication network, the target wireless communication network may broadcast the transcoded video data.

The target wireless communication network may be a WIFI network where the video camera is located on the video shooting site, and in this embodiment, the NDI signal, that is, the transcoded video data, may be broadcast and output in the WIFI network. In this way, no additional connection means, such as signal transmission lines or the like, between the communication network and the acquisition of the transcoded video data are required. In addition, the access of the WIFI network can be increased in authority, so that the WIFI network can be directly broadcasted, and the WIFI network is more convenient and efficient. In this way, by the IP conversion of the original video, the transcoded video data can be applied to the video processing device, and compared with the video data transmitted directly through the image transmission module for realizing image transmission, the problem that the transmitted data can be only identified by industrial professional devices such as monitors and the like, but is identified by video processing devices such as computers, mobile phones and the like can be avoided.

In one embodiment of the present disclosure, the transcoding unit transcodes the original video collected by the camera into transcoded video data conforming to the internet protocol, and the data conforming to the internet protocol has versatility. Thus, it can be ensured that the transcoded video data is suitable for a computing device such as a video processing device. On the basis, the transcoded video data is uploaded to a communication network which communicates according to an Internet protocol, and computing equipment such as video processing equipment and the like do not need to wait for a camera to finish video acquisition and complete reading of an original video from a storage medium of the camera, but can directly acquire the transcoded video data from the communication network in the video acquisition process, so that video processing is performed based on the transcoded video data. Therefore, the video processing efficiency can be improved by the scheme.

In an alternative implementation manner, before uploading the transcoded video data to the communication network that communicates according to the internet protocol, the video processing method provided in the embodiment of the present specification may further include the following steps:

receiving an original video acquired by a camera, and extracting metadata of the original video;

transcoding the metadata according to the Internet protocol to obtain transcoded element data with a data format conforming to the Internet protocol;

Accordingly, the uploading of the transcoded video data to the communication network communicating according to the internet protocol may specifically include the following steps:

the transcoded video data and the transcoded symbol data are uploaded to a communications network that communicates according to an internetworking protocol.

In a specific application, metadata of an original video is used to describe attribute information of the original video. In this embodiment, in order to ensure that the transcoded video data can be used to process the transcoded video data into proxy material, the attribute information described by the metadata of the original video may include: information characterizing the uniqueness of the original video, information characterizing the relationship between each video frame in the original video and the duration of the video, and the like. For example, the information characterizing the uniqueness of the original video may be a name of the original video, and the information characterizing the relationship between each video frame and the video duration in the original video may be a time code of the original video. For example, video frame F1 should correspond to video duration 10 seconds. In addition, in order to ensure that the metadata can be transmitted and used, the metadata is transcoded, similar to the original video, to obtain transcoded symbol data with a data format conforming to the internet protocol. In a scenario where the transcoding unit is included in NDI, in order to implement the present embodiment, a module for extracting metadata of an original video may be provided in NDI. And, the NDI may be configured to transcode metadata according to an internet protocol.

In this way, in a scenario that the output interface of the camera includes the image transmission module to improve the image transmission efficiency, the embodiment can ensure that the data uploaded to the communication network includes the complete metadata of the original data, so as to reduce the metadata loss of the original video caused by image transmission, thereby causing the problem that the proxy material cannot be obtained later.

In an alternative embodiment, before the original video acquired by the camera is acquired, the video processing method provided in the embodiment of the present disclosure may further include the following steps:

acquiring transmission bandwidth of a communication network and bandwidth occupation amount of a camera;

determining the load quantity matched with the transmission bandwidth based on the transmission bandwidth and the bandwidth occupation quantity;

according to the number of loads, connections with a plurality of cameras are established.

In a specific application, the number of loads matched with the transmission bandwidth is determined based on the transmission bandwidth and the bandwidth occupation amount, so that the number of a plurality of cameras connected in a subsequent establishment can be ensured, and the number of the cameras can be matched with the transmission bandwidth of the communication network. Therefore, under the condition of accessing a plurality of cameras, the accessed load quantity is prevented from exceeding the load capacity of the communication network, and the normal operation of the communication network and the cameras is ensured. And in the process of establishing the connection with the plurality of cameras according to the number of loads, the number of the plurality of cameras is smaller than or equal to the number of loads. Therefore, the transcoding unit is used for controlling the access of a plurality of cameras, compared with the video processing flow shown in fig. 1, the transcoding unit does not need to additionally configure equipment in an existing shooting flow every time one camera is added, the convenience of video processing can be greatly improved, and the equipment cost is reduced.

Referring to fig. 3, fig. 3 is a flowchart of another video processing method provided in an embodiment of the present disclosure, which is applied to a video processing device accessing a communication network, where the communication network communicates according to an internet protocol, and specifically includes the following steps:

s302, receiving transcoding video data sent by a transcoding unit through a communication network, wherein the transcoding video data is obtained by transcoding an original video acquired by a camera according to an Internet protocol in the process of video acquisition by the transcoding unit.

In a specific application, the process of the transcoding unit obtaining the transcoded video data and the communication network in this embodiment are the same as the process of the transcoding unit obtaining the transcoded video data and the communication network in the embodiment of fig. 2, respectively, and are not described in detail herein. Also, the video processing device may be various, for example, the video processing device may be a mobile terminal, a desktop computer, a portable computer, or the like. The manner in which the video processing apparatus receives the transcoded video data sent by the transcoding unit via the communication network may be various. In an alternative embodiment, the communication network is a target wireless communication network;

Correspondingly, the receiving, through the communication network, the transcoded video data sent by the transcoding unit may specifically include the following steps:

and receiving the transcoded video data broadcasted by the target wireless communication network, wherein the transcoded video data is uploaded to the target wireless communication network by the transcoding unit.

The target wireless communication network may be a WIFI network where the video camera is located on the video shooting site, and in this embodiment, the NDI signal, that is, the transcoded video data, may be broadcast and output in the WIFI network. In this way, no additional connection means, such as signal transmission lines or the like, between the communication network and the acquisition of the transcoded video data are required. In addition, the access of the WIFI network can be increased in authority, so that the WIFI network can be directly broadcasted, and the WIFI network is more convenient and efficient.

S304, obtaining video processing data based on the transcoded video data.

In a specific application, the video processing data is data obtained by processing the transcoded video data, and may be various. For this reason, the manner in which video processing data is obtained based on transcoded video data may be various. Illustratively, the transcoded video may be decoded according to an internet protocol, and the original video obtained by decoding is used as video processing data. Alternatively, for example, metadata extraction may be performed on the transcoded video data, the transcoded video data may be compressed, and the compressed transcoded video data and metadata, that is, proxy material, may be used as video processing data. On this basis, efficient video editing can be performed using proxy material. Alternatively, illustratively, the transcoded video may be decoded in accordance with the internet protocol, and the original video obtained by decoding may be subjected to toning, editing, and so forth. In addition, the video processing device can directly clip the proxy material, and further, the clipping result is sleeved back to the original video obtained after decoding, so that the target video such as cost is obtained. Alternatively, the video processing device described above may send the proxy material and transcoded video data to a dedicated video editing device, which clips the video to obtain the target video. The agent material can be sent after transcoding according to the internet protocol.

In one case, in a scenario where the output interface of the camera includes a graphics module to improve the image transmission efficiency, the original video is a video that is compressed by graphics, so that metadata is likely to be missing, and a problem that the proxy material obtained later is inaccurate and cannot be used for video editing is also caused. In this regard, in an alternative embodiment, the video processing data includes target agent material for a video clip;

accordingly, before obtaining video processing data based on the transcoded video data, the video processing method provided in the embodiments of the present disclosure may further include the following steps:

receiving metadata of the transcoded video data sent by the transcoding unit through a communication network;

accordingly, obtaining video processing data based on the transcoded video data may specifically include the steps of:

decoding the transcoded video data, compressing the data quantity of the decoding result, and taking the compressed transcoded video data and metadata of the transcoded video data as target agent materials.

Illustratively, the original material is a material with a resolution of 4K, the file name of the original material is c001.Mp4, the video duration is 10 seconds, and the time code is 90001000 to 90011000. Then, the target agent material may include: the decoding result is compressed to obtain 1080P resolution material with a file name of C001-proxy.mp4, the video duration is 10 seconds, and the time codes are 90001000 to 90011000. The time code refers to corresponding marks of the video frames and the video time length of the material, so that dislocation of the video frames can be prevented. For example, the time code 90001000 represents the 1 st second corresponding video frame F0. On this basis, the video processing device may clip the C001-proxy.mp4 file as follows: the duration between 2 seconds and 7 seconds, i.e., the video frames between 90002000 and 90007000, is truncated and the brightness is increased by 50%. The clipping operation may produce a clipping result: files describing the above-described clipping operation. And (5) sleeving the original material by using the clipping result: the operation described by the clipping result is automatically attached to the above-mentioned c001.mp4 file, that is, the original material, by proxy software, to obtain the target video. The original material is the original video in the specification: and decoding the transcoded video data to obtain an original video.

The embodiment can ensure that the data uploaded to the communication network contains the complete metadata of the original data, thereby reducing the problem that the proxy material cannot be obtained later caused by the metadata deletion of the original video due to image transmission. Thus, the implementation of high-efficiency clipping can be ensured. And the target agent material can be acquired without waiting for the video acquisition to be finished and reading data from the memory card of the camera. On the basis, the target agent materials can be directly utilized to clip the video, the step of storing the target agent materials into the NAS storage matrix and then reading the target agent materials from the NAS storage matrix is not needed, and the video processing can be ensured to be more efficient.

In an alternative embodiment, after the compressed transcoded video data and the metadata of the transcoded video data are used as the target agent material, the video processing method provided in the embodiments of the present disclosure may further include the following steps:

and uploading the target agent material to a cloud end connected with a communication network through the communication network.

According to the embodiment, the target agent material is uploaded to the cloud end connected with the communication network, so that disaster tolerance storage of the target agent material can be at least ensured. In one case, the transcoded video data may be uploaded to the cloud via a communication network. And on the basis, a cloud collaborative video processing flow can be performed, so that video processing is more convenient, and the method is described in an alternative embodiment mode.

In an optional implementation manner, after the target agent material is uploaded to the cloud end connected to the communication network, the video processing method provided in the embodiment of the present disclosure may further include the following steps:

outputting a notice of finishing uploading the target agent materials to a target client of the cloud;

and receiving a processing result of the target client to the target agent material.

The target client of the cloud may include a client of a remote video processor. In this way, remote live or review of video content captured by the camera may be achieved. For example, a worker not at the video acquisition site where the camera is located may monitor, review, etc. the video at the cloud end of the off-site. Moreover, editing personnel not on the video acquisition site where the camera is located can remotely edit the video by utilizing the target agent material, so that convenience is greatly improved. In addition, the clipping personnel can upload the processing result, such as cost, of the target agent material to the cloud end through the target client end, and further video processing equipment of a video acquisition site where the camera is located can acquire the clipping result from the cloud end through the communication network, so that collaborative work with the workers in different places is realized.

In an optional implementation manner, after obtaining the video processing data network based on the transcoded video data, the video processing method provided in the embodiments of the present disclosure may further include the following steps:

adding authority control information to the video processing data to obtain authority video processing data;

and transmitting the authority video processing data to a target terminal in the communication network, so that the target terminal responds to the access request of the authority video processing data based on the user information of the target terminal user and the authority control information in the authority video processing data.

The permission control information may specifically include a correspondence between user information and video operation permission. For example, some users can only "read" and cannot "write", prohibit persistent storage for the terminals of the respective users, and so on. Specific rights control information may be set according to application requirements, which is not limited in this embodiment. The user information of the target terminal user may be attribute information of a user logging in the target terminal, such as an account number, a name, a post, a department, and the like. The rights control information is used to characterize the user's operation rights to the video, specifying the operations that the user can perform on the rights video processing data. In this way, the embodiment can give consideration to the convenience and the safety of video processing through the addition of the rights.

Corresponding to the above method embodiments, the present disclosure further provides an embodiment of a video processing system, and fig. 4 shows a schematic structural diagram of a video processing system provided in one embodiment of the present disclosure. As shown in fig. 4, the video processing system 400 may include: a transcoding unit 402 and a video processing device 404;

a transcoding unit 402, configured to obtain an original video acquired by the camera during the video acquisition by the camera; transcoding the original video according to the Internet protocol to obtain transcoded video data with a data format conforming to the Internet protocol; uploading the transcoded video data to a communications network that communicates according to an internetworking protocol;

A video processing device 404 configured to receive the transcoded video data via the communication network, obtain video processing data based on the transcoded video data.

The application of the video processing method provided in the present specification to a video processing system is taken as an example, and the video processing method is further described below with reference to fig. 5. Fig. 5 shows a processing procedure diagram of a video processing method according to an embodiment of the present disclosure, which specifically includes the following steps.

S502, acquiring an original video acquired by a camera in the process of video acquisition by the camera by a transcoding unit;

s504, the transcoding unit transcodes the original video according to the Internet protocol to obtain transcoded video data with a data format conforming to the Internet protocol;

s506, the transcoding unit sends the transcoded video data to the video processing device through a communication network which communicates according to the Internet protocol;

s508, the video processing apparatus obtains video processing data based on the transcoded video data.

Optionally, the transcoding unit 402 is further configured to:

before uploading the transcoded video data to a communication network, receiving an original video acquired by a camera, and extracting metadata of the original video;

accordingly, the transcoding unit 402 is further configured to:

the transcoded video data and the transcoded symbol data are uploaded to a communications network.

Optionally, the transcoding unit 402 is further configured to:

before acquiring an original video acquired by a camera, acquiring a transmission bandwidth of a communication network and a bandwidth occupation amount of the camera;

Optionally, the output interface of the camera is connected with a network device interface of the communication network, wherein the network device interface comprises a transcoding unit;

accordingly, the transcoding unit 402 is further configured to:

the original video is input to a transcoding unit.

Optionally, the video processing data includes target agent material for the video clip;

accordingly, the video processing device 404 is further configured to:

before obtaining video processing data based on the transcoded video data, receiving metadata of the transcoded video data sent by the transcoding unit via a communication network;

accordingly, the video processing device 404 is further configured to:

Optionally, the video processing device 404 is further configured to:

and uploading the compressed transcoded video data and metadata of the transcoded video data to a cloud end connected with a communication network through the communication network after taking the transcoded video data and metadata of the transcoded video data as target agent materials.

Optionally, the video processing device 404 is configured to:

after uploading the target agent material to a cloud end connected with a communication network, outputting a notification of completion of uploading the target agent material to a target client of the cloud end;

Optionally, the video processing device 404 is further configured to:

after obtaining video processing data based on transcoding video data, adding authority control information to the video processing data to obtain authority video processing data;

The above is a schematic solution of a video processing system of the present embodiment. It should be noted that, the technical solution of the video processing system and the technical solution of the video processing method belong to the same conception, and details of the technical solution of the video processing system, which are not described in detail, can be referred to the description of the technical solution of the video processing method.

The application of the video processing method provided in the present specification to a film and television theatrical shooting field is taken as an example, and the video processing method is further described below with reference to fig. 6. Fig. 6 shows an example diagram of an application scenario of a video processing method according to an embodiment of the present disclosure, which specifically includes the following steps:

the camera transmits the collected original video to an NDI (non-standard interface) transcoder connected with the camera through an SDI cable, the NDI transcoder carries out NDI transcoding on the original video and metadata of the original video to obtain transcoded video data and transcoded element data, and the transcoded video data and the transcoded element data are uploaded to a field WiFi network. Further, the field WiFi network broadcasts the transcoded video data and transcoded symbol data, and the DIT workstation (computing device used by the digital image engineer), for example, the field monitor, tablet computer, mobile terminal, and other devices receive the data broadcasted by the accessed field WiFi network, and can monitor, review, and obtain agent materials (not shown in the figure). And the DIT workstation can instantly transmit the agent materials and the transcoded video data to the NAS storage matrix for video clipping and nesting to obtain a slice. And the DIT workstation can cloud materials through a 5G network so as to realize cloud collaboration functions such as remote editing, remote monitoring, remote review and the like. Wherein the number of cameras may be plural. In one case, an NDI transcoder, i.e., transcoding unit, may be connected to a camera. In another case, one NDI transcoder may access multiple cameras. In a scenario where one NDI transcoder accesses multiple cameras, the NDI transcoder may select multiple original videos to be received.

In addition, in this embodiment, the camera may write the collected data, that is, the original material, into the memory card during shooting, and further store the video into the NAS storage matrix by copying, so as to improve disaster tolerance. Thus, this embodiment has at least four advantages: first, the acquisition of agent material is immediately carried out by the DIT workstation in the shooting process without waiting for copying, so that the copying working time can be greatly reduced, and the efficiency is improved. And the second point is that the video acquisition site can substantially reduce data transmission through cables, and the WiFi covered places can be accessed wirelessly. Third, the field WIFI network can seamlessly and quickly access more shooting devices under the condition of load permission (mainly transmission bandwidth), without adding a complete set of shooting process devices. Fourth, the technology is open, and more special technology customization can be performed by means of more convenient internet technology facilities, such as cloud material, remote monitoring, review, multi-work collaborative work and the like.

Corresponding to the above method embodiments, the present disclosure further provides an embodiment of a video processing apparatus, and fig. 7 shows a schematic structural diagram of a video processing apparatus according to one embodiment of the present disclosure. As shown in fig. 7, applied to a transcoding unit, the apparatus comprises:

The original video acquisition module 702 is configured to acquire an original video acquired by the camera in the process of video acquisition by the camera;

an original video transcoding module 704 configured to transcode the original video according to the internet protocol to obtain transcoded video data having a data format conforming to the internet protocol;

a transcoded video upload module 706 configured to upload transcoded video data to a communications network that communicates according to an internetworking protocol.

Optionally, the raw video acquisition module 702 is further configured to:

the original video transcoding module 704 is further configured to:

transcoded video upload module 706 is further configured to:

Optionally, the apparatus further includes a load management module configured to:

accordingly, the raw video acquisition module 702 is further configured to:

the original video is input to a transcoding unit.

The above is a schematic solution of a video processing apparatus of the present embodiment. It should be noted that, the technical solution of the video processing apparatus and the technical solution of the video processing method applied to the transcoding unit belong to the same concept, and details of the technical solution of the video processing apparatus, which are not described in detail, can be referred to the description of the technical solution of the video processing method applied to the transcoding unit.

Referring to fig. 8, fig. 8 shows a flowchart of another video processing apparatus provided in an embodiment of the present disclosure, which is applied to a video processing device accessing a communication network, and the communication network communicates according to an internet protocol, and the apparatus specifically includes:

the transcoded video receiving module 802 is configured to receive transcoded video data sent by the transcoded unit through a communication network, where the transcoded video data is obtained by transcoding an original video acquired by the camera according to an internet protocol in a process that the video is acquired by the camera by the transcoded unit;

a transcoded video processing module 804 configured to obtain video processing data based on the transcoded video data.

Accordingly, the transcoded video receiving module 802 is further configured to:

accordingly, the transcoded video processing module 804 is further configured to:

Optionally, the apparatus further includes a proxy material uploading module configured to:

Optionally, the agent material uploading module is further configured to:

Optionally, the apparatus further includes a rights adding module configured to:

Optionally, the communication network is a target wireless communication network;

accordingly, transcoded video receiving module 802 is configured to:

The above is a schematic solution of a video processing apparatus of the present embodiment. It should be noted that, the technical solution of the video processing apparatus and the technical solution of the video processing method applied to the video processing device belong to the same concept, and details of the technical solution of the video processing apparatus, which are not described in detail, can be referred to the description of the technical solution of the video processing method applied to the video processing device.

Fig. 9 illustrates a block diagram of a computing device provided in accordance with one embodiment of the present specification. The components of computing device 900 include, but are not limited to, memory 910 and processor 920. Processor 920 is coupled to memory 910 via bus 930 with database 950 configured to hold data.

Computing device 900 also includes an access device 940, access device 940 enabling computing device 900 to communicate via one or more networks 960. Examples of such networks include public switched telephone networks (PSTN, public Switched Telephone Network), local area networks (LAN, local Area Network), wide area networks (WAN, wide Area Network), personal area networks (PAN, personal Area Network), or combinations of communication networks such as the internet. Access device 940 may include one or more of any type of network interface, wired or wireless, such as a network interface card (NIC, network Interface Controller), such as an IEEE802.11 wireless local area network (WLAN, wireless Local Area Networks) wireless interface, a worldwide interoperability for microwave access (Wi-MAX, worldwide Interoperability for Microwave Access) interface, an ethernet interface, a universal serial bus (USB, universal Serial Bus) interface, a cellular network interface, a bluetooth interface, a near field communication (NFC, near Field Communication) interface, and so forth.

In one embodiment of the present description, the above-described components of computing device 900 and other components not shown in FIG. 9 may also be connected to each other, for example, by a bus. It should be understood that the block diagram of the computing device illustrated in FIG. 9 is for exemplary purposes only and is not intended to limit the scope of the present description. Those skilled in the art may add or replace other components as desired.

Computing device 900 may be any type of stationary or mobile computing device including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), mobile phone (e.g., smart phone), wearable computing device (e.g., smart watch, smart glasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 900 may also be a mobile or stationary server.

Wherein the processor 920 is configured to execute computer-executable instructions that, when executed by the processor, implement the steps of the video processing method described above.

The foregoing is a schematic illustration of a computing device of this embodiment. It should be noted that, the technical solution of the computing device and the technical solution of the video processing method belong to the same concept, and details of the technical solution of the computing device, which are not described in detail, can be referred to the description of the technical solution of the video processing method.

An embodiment of the present disclosure also provides a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of the video processing method described above.

The above is an exemplary version of a computer-readable storage medium of the present embodiment. It should be noted that, the technical solution of the storage medium and the technical solution of the video processing method belong to the same concept, and details of the technical solution of the storage medium which are not described in detail can be referred to the description of the technical solution of the video processing method.

An embodiment of the present disclosure also provides a computer program, where the computer program, when executed in a computer, causes the computer to perform the steps of the video processing method described above.

The above is an exemplary version of a computer program of the present embodiment. It should be noted that, the technical solution of the computer program and the technical solution of the video processing method belong to the same conception, and details of the technical solution of the computer program, which are not described in detail, can be referred to the description of the technical solution of the video processing method.

The foregoing describes specific embodiments of the present disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

The computer instructions include computer program code that may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth.

It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of combinations of actions, but it should be understood by those skilled in the art that the embodiments are not limited by the order of actions described, as some steps may be performed in other order or simultaneously according to the embodiments of the present disclosure. Further, those skilled in the art will appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily all required for the embodiments described in the specification.

In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to the related descriptions of other embodiments.

The preferred embodiments of the present specification disclosed above are merely used to help clarify the present specification. Alternative embodiments are not intended to be exhaustive or to limit the invention to the precise form disclosed. Obviously, many modifications and variations are possible in light of the teaching of the embodiments. The embodiments were chosen and described in order to best explain the principles of the embodiments and the practical application, to thereby enable others skilled in the art to best understand and utilize the invention. This specification is to be limited only by the claims and the full scope and equivalents thereof.

Claims

1. A video processing method, comprising:

in the process of video acquisition by a camera, acquiring an original video acquired by the camera through a transcoding unit, and extracting metadata of the original video, wherein the metadata are used for describing attribute information of the original video;

according to an Internet protocol, transcoding the original video and the metadata through the transcoding unit to obtain transcoded video data and transcoded symbol data with data formats conforming to the Internet protocol;

Uploading, by the transcoding unit, the transcoded video data and the transcoded symbol data to a communications network that communicates according to the internetworking protocol;

receiving the transcoded video data and the transcoded symbol data according to the communication network through video processing equipment, decoding the transcoded video data, compressing the data volume of a decoding result, and taking the compressed transcoded video data and the transcoded symbol data as target agent materials;

and performing editing operation on the target agent material through video processing equipment, generating a file describing the editing operation, and sleeving original material back through the file to obtain a target video, wherein the original material is an original video obtained by decoding the transcoded video data.

2. A video processing method applied to a video processing device accessing a communication network, the communication network communicating according to an internet protocol, the method comprising:

receiving transcoding video data and transcoding element data sent by a transcoding unit through the communication network, wherein the transcoding video data and the transcoding element data are obtained by transcoding original video acquired by a camera and extracted metadata of the original video according to an internet protocol in the process of video acquisition by the transcoding unit;

Decoding the transcoded video data, compressing the data quantity of the decoding result, and taking the compressed transcoded video data and the transcoded element data as target agent materials;

and performing clipping operation on the target agent material to generate a file describing the clipping operation, and sleeving original material through the file to obtain a target video, wherein the original material is an original video obtained by decoding the transcoded video data.

3. The video processing method according to claim 2, further comprising, after said transcoding the compressed video data and said transcoding metadata as said target agent material:

and uploading the target agent material to a cloud end connected with the communication network through the communication network.

4. The video processing method according to claim 3, further comprising, after said uploading the target agent material to a cloud end connected to the communication network:

5. The video processing method according to any one of claims 2 to 4, further comprising, after said transcoding the compressed video data and said transcoded symbol data as said target agent material:

Adding authority control information to video processing data to obtain authority video processing data, wherein the video processing data is data obtained by processing the transcoded video data;

and sending the authority video processing data to a target terminal in the communication network, so that the target terminal responds to the access request of the authority video processing data based on the user information of a target terminal user and the authority control information in the authority video processing data.

6. The video processing method of any of claims 2-4, the communication network being a target wireless communication network;

accordingly, the receiving, through the communication network, the transcoded video data and the transcoded symbol data sent by the transcoding unit includes:

and receiving the transcoded video data and the transcoded symbol data broadcasted by the target wireless communication network, wherein the transcoded video data and the transcoded symbol data are uploaded to the target wireless communication network by the transcoding unit.

7. A video processing system, comprising: a transcoding unit and a video processing device;

the transcoding unit is configured to acquire an original video acquired by the camera in the process of video acquisition by the camera, and extract metadata of the original video, wherein the metadata are used for describing attribute information of the original video; transcoding the original video and the metadata according to an Internet protocol to obtain transcoded video data and transcoded symbol data with data formats conforming to the Internet protocol; uploading the transcoded video data and the transcoded symbol data to a communications network that communicates according to the internetworking protocol;

The video processing device is configured to receive the transcoded video data and the transcoded symbol data through the communication network, decode the transcoded video data, compress a data amount of a decoding result, and take the compressed transcoded video data and the transcoded symbol data as target agent materials; and performing clipping operation on the target agent material to generate a file describing the clipping operation, and sleeving original material through the file to obtain a target video, wherein the original material is an original video obtained by decoding the transcoded video data.

8. A computing device, comprising:

a memory and a processor;

the memory is adapted to store a computer program, the processor being adapted to execute the computer program, which when executed by the processor performs the steps of the video processing method of any one of claims 1 to 6.