WO2016184332A1

WO2016184332A1 - Video capturing method, and related device and system

Info

Publication number: WO2016184332A1
Application number: PCT/CN2016/081657
Authority: WO
Inventors: 黄敦笔; 杜武平; 徐月钢
Original assignee: 阿里巴巴集团控股有限公司
Priority date: 2015-05-18
Filing date: 2016-05-11
Publication date: 2016-11-24
Also published as: CN106303551A

Abstract

Disclosed are a video capturing method, and a related device and system. In the technical solution of the present invention, another terminal having video capturing ability meeting a set video capturing ability requirement is selected as a capturing terminal to capture video data based on the obtained video capturing ability of all other terminals establishing a session connection with a terminal device initiating a video capturing request, thereby solving the problem of low video capturing effect due to the fact that a video capturing device selected by a current video capturing mode is relatively stationary and cannot preferably meet actual demands of an application scene, increasing video application experience of a user, and meanwhile, also being able to achieve the effects of saving interface resources of the terminal device initiating the video capturing request, increasing the utilization rate of the device and increasing the selection flexibility of the device.

Description

Video capture method and related equipment and system

The present application claims priority to Chinese Patent Application Serial No. No. No. No. No. No. No. No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No

Technical field

The present application relates to the field of video application technologies, and in particular, to a video collection method and related devices and systems.

Background technique

In a video real-time interaction scenario such as a video call or a video conference, if the terminal participating in the interaction does not have a video capture unit such as a camera, the video capture cannot be achieved due to the inability to implement the corresponding video capture, so that the user's video is The application experience is lower.

Specifically, in order to solve the above problem, the industry provides a video capture method using a camera phone as a computer camera to acquire video data, and the video capture method can be as follows:

Virtually attaching a camera-enabled mobile phone to a computer via a virtual camera driver set in the computer, and registering the registered mobile phone as the current video capture device of the computer, after which the computer can pass the virtual camera driver A get video data command is sent to the mobile phone as the current video capture device to obtain corresponding video data through the mobile phone.

It can be seen from the above that in the above video collection method, since the mobile phone having the camera function does not need to be connected to the computer through an interface such as a USB (Universal Serial Bus), the interface resources of the computer can be saved, and the connection of the device can be improved. Sex. However, in the above video collection method, since the video capture device that has been virtualized can be passively selected as the current video capture device of the computer, when the video capture capability of the virtualized video capture device is poor, There is a problem that the selected video capture device cannot meet the actual requirements of the application scenario, resulting in a low video capture effect and a poor video application experience of the user. At the same time, the device selection range is small and flexible. Poor question. Furthermore, since for each mobile phone having a camera function, when the mobile phone is used as a video capture device of a computer device, the virtual camera driver installed in the computer needs to be virtualized accordingly. There is also the problem of increasing the complexity of the implementation.

That is to say, in the prior art, when the terminal participating in the real-time interaction of the video class does not have a video capturing unit such as a camera, it is not possible to provide a video collection method with simple implementation and better effect, resulting in the user's view. The frequency application experience is poor.

Summary of the invention

The embodiment of the present invention provides a video collection method and related device and system, which are used to solve the problem that the current video acquisition mode of the terminal that does not have the video collection unit itself has poor collection effect and complicated implementation.

The embodiment of the present application provides a video collection method, including:

Obtaining a video collection capability of each other terminal that establishes a session connection with the terminal device that initiates the video collection request;

Based on the acquired video collection capabilities of the other terminals, the other terminals that have the session connection connection with the terminal device that initiated the video collection request are selected as other terminals that have the video capture capability that meets the set video capture capability requirements. Acquisition terminal

Instructing the collection terminal to perform video data collection based on video capture parameters required by the terminal device that initiates the video capture request and video capture capabilities of the collection terminal.

Correspondingly, the embodiment of the present application further provides a terminal, including:

a capability acquisition unit, configured to acquire video capture capability of each other terminal that establishes a session connection with the terminal itself;

a device selection unit, configured to select, according to a video collection capability of each other terminal acquired by the capability acquisition unit, a video capture capability that meets the set selection from each other terminal that establishes a session connection with the terminal itself Other terminals required by the video capture capability are used as collection terminals;

The device indication unit is configured to instruct the collection terminal selected by the device selection unit to collect video data based on the video collection parameters required by the terminal and the video collection capability of the collection terminal.

Correspondingly, the embodiment of the present application further provides a video collection system, including:

The terminal device that initiates the video collection request is used to acquire the video collection capability of each other terminal that has established a session connection with itself, and based on the obtained video collection capability of each other terminal, each other terminal that establishes a session connection with itself The other terminal that has the video capture capability that meets the set video capture capability requirements is selected as the collection terminal, and the collection terminal is instructed to select the video acquisition parameters and the collection based on the terminal device that initiates the video capture request. Video capture capability of the terminal to collect video data;

The collection terminal is configured to: according to the video collection indication sent by the terminal device that initiates the video collection request, the video collection parameter required by the terminal device that initiates the video collection request, and the video collection capability of the collection terminal, The video data is collected, and the collected video data is transmitted to the terminal device that initiates the video collection request.

The beneficial effects of the application are as follows:

The embodiment of the present application provides a video collection method and related device and system. In the technical solution of the embodiment of the present application, the other terminal devices that have a session connection with the terminal device that initiates the video collection request may be established. The video capture capability is selected by the other terminals that have the video capture capability to meet the set video capture capability requirements. The video capture device selected by the current video capture mode is relatively fixed and cannot be compared. The problem of low video capture is improved, and the video application experience of the user is improved. At the same time, the interface resources of the terminal device that initiates the video capture request are saved, and the utilization rate of the device is improved. Improve the flexibility of device selection.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following drawings will be briefly described in the description of the embodiments. It is obvious that the drawings in the following description are only some embodiments of the present application, Those skilled in the art can also obtain other drawings based on these drawings without paying any creative work.

FIG. 1 is a schematic flowchart diagram of a video collection method according to Embodiment 1 of the present application;

FIG. 2 is a schematic structural diagram of a terminal according to Embodiment 2 of the present application;

FIG. 3 is a schematic structural diagram of a video collection system according to Embodiment 2 of the present application.

detailed description

The present invention will be further described in detail with reference to the accompanying drawings, in which FIG. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

Embodiment 1:

A video capture method is provided in the first embodiment of the present application. As shown in FIG. 1 , it is a schematic flowchart of a video capture method according to the first embodiment of the present application. The video capture method may include the following steps:

Step 101: Acquire a video collection capability of each other terminal that establishes a session connection with the terminal device that initiates the video collection request.

Step 102: Based on the obtained video collection capability of each other terminal, from the end of the initiation of the video collection request The other terminal that establishes the session connection by the end device selects another terminal that has the video capture capability to meet the set video capture capability requirement as the collection terminal;

Step 103: Instruct the collection terminal to collect video data based on video capture parameters required by the terminal device that initiates the video capture request and video capture capabilities of the collection terminal.

That is, in the technical solution of the embodiment of the present application, the video collection capability of each terminal connected with the session may be established based on the obtained terminal device (which may be referred to as the requesting terminal) that initiates the video collection request, and the selected location is selected. The video capture device that meets the requirements of the set video capture capability is used as the collection terminal to collect video data. This solves the problem that the video capture device selected by the current video capture mode is relatively fixed and cannot meet the application scenario. The actual demand, resulting in a lower effect of video capture, improves the user's video application experience.

In the meantime, in the embodiment of the present application, the collection terminal can be selected from a plurality of other terminals that establish a session connection with the terminal device that initiates the video collection request, thereby improving the scope and flexibility of device selection. In addition, in the embodiment of the present application, the selected collection terminal does not need to be connected to the terminal device that initiates the video collection request through the interface such as the USB, thereby saving the interface resources of the terminal device that initiates the video collection request and improving the device connection. Flexibility. In addition, in the embodiment described in the present application, the selected collection terminal may be a terminal with a video capture capability, such as a mobile phone, a tablet computer, a notebook computer, and the like, and thus the mobile phone may be improved. The effect of utilization of a terminal with a camera such as a tablet or a notebook computer.

Hereinafter, each step described in the embodiment of the present application will be specifically described:

Optionally, the executor of the foregoing steps may be the terminal device itself that initiates the video collection request, or may be a device unit that is set in the terminal device that initiates the video collection request, which is not limited in this embodiment. .

Further, before performing the video collection capability of the other terminal that establishes the session connection with the terminal device that initiates the video collection request, the method may first be based on IP (Internet Protocol) multicast technology and point-to-point TCP. (Transmission Control Protocol) connection technology establishes a session connection between a terminal device that initiates a video capture request and each other terminal, or based on IP multicast technology and a Point-to-Point UDP (User Datagram Protocol) connection. The technology establishes a session connection between the terminal device that initiates the video collection request and each other terminal.

Among them, IP multicast (also known as multicast or multicast) technology is a TCP/IP network technology that allows one or more hosts (multicast sources) to send a single packet to multiple hosts. In network audio/video broadcasting applications, when it is necessary to transmit the signal of one node to multiple nodes, whether it is repeated point-to-point communication or wide Broadcast mode will seriously waste network bandwidth, and multicast as one-to-multipoint communication is one of the effective ways to save network bandwidth.

Specifically, the terminal device that initiates the video collection request is used as an example. The terminal device that initiates the video collection request may establish a session connection with other terminals by using the following steps:

The service of the session connection monitoring is started, and the connection request of each other terminal is awaited; at this time, each other terminal can also start the corresponding multicast session monitoring service;

Sending a multicast message to each of the other terminals, where the multicast message carries at least information such as an IP address of the terminal device that initiates the video capture request and a set interception port number, so that each other terminal receives the After the multicast message, an attempt is made to connect to the terminal device that initiated the video collection request by using the set interception port number in the multicast message in a TCP or UDP manner.

At this point, the terminal device that initiates the video collection request can complete the establishment of the session connection with other terminals, that is, complete the discovery and recognition of each other terminal.

Further, after completing the discovery and recognition of each other terminal, the operation of acquiring the video collection capability of each terminal connected with the terminal device that initiates the video collection request, that is, the video collection parameter, may be performed as described in step 101. Negotiation process.

Optionally, the acquiring the video collection capability of the other terminal that has the session connection with the terminal device that initiates the video collection request is performed as follows:

Step 1: Send a capability parameter acquisition request to each other terminal that establishes a session connection with the terminal device that initiates the video collection request.

Specifically, for any terminal, when receiving the capability parameter acquisition request, if the terminal determines that it has a corresponding video collection device, such as a camera, the terminal may traverse to generate a video collection capability set corresponding to the terminal (special If the video capture device is not available, the video capture capability set may be empty, and the corresponding video capture capability set is answered to the terminal device that initiates the video capture request.

For any terminal, the video collection capability set corresponding to the terminal is a parameter set composed of one or more sets of video collection parameters supported by the terminal. That is, for any terminal, each video capture capability possessed by the terminal can be represented by a corresponding set of video capture parameters (ie, a corresponding video capture parameter combination) that it supports.

Further, each set of video acquisition parameters supported by the terminal may include at least a video resolution (specifically, a maximum video resolution, unit: pixel x pixels), a frame rate (specifically, a maximum frame rate, unit: frame per second) , fps), code rate (specifically, maximum code rate, unit: bits per second, bps), video format (such as MJPEG, H264, YUV, Any one or more of RGB24, RGB32, etc., or acquisition delay (specifically, maximum acquisition delay, unit: millisecond), and accordingly, corresponding to any terminal, such as a mobile phone, the terminal corresponds to The video capture capability set can be expressed as:

{...

{Mobile (terminal type), 640x480, YUV, 30fps, 10ms};

{Mobile (terminal type), 1280x720, YUV, 30fps, 15ms};

...

}.

Further, it should be noted that, for any terminal, in order to more intuitively know the video collection capability corresponding to each group of video collection parameters, or to more intuitively identify each group of video collection supported by the terminal. According to the set calculation rules, the parameter comprehensive value corresponding to each group of video acquisition parameters can be calculated, and the video collection capability corresponding to each group of video acquisition parameters is quantized, and according to the comprehensive value of each parameter High or low, know the quality of the video capture capability corresponding to each group of video capture parameters or the quality of the video capture parameters supported by each group.

For example, for any set of video collection parameters supported by the terminal, the weights assigned to the video acquisition parameter dimensions (such as video resolution dimension, frame rate dimension, video format dimension, acquisition delay dimension, etc.) and the The specific parameters of the video capture parameters of the terminal in each video capture parameter dimension are used for weighted summation calculation, and a parameter integrated value corresponding to the set of video capture parameters is obtained, corresponding to the set of video capture parameters. The video capture capabilities are quantified. For the video format dimension, when the video format parameter in the dimension is quantized, the priority level corresponding to each video format may be taken as a corresponding specific parameter; in addition, for the collection delay dimension, the allocation is performed for the dimension. The weights are usually negative, and the embodiments of the present application do not describe them in detail.

Step 2: Receive a capability parameter response message returned by each terminal that has a session connection with the terminal device that initiates the video collection request, where the capability parameter response message returned by each other terminal carries a video corresponding to the corresponding other terminal. Collection capability set.

Step 3: According to the received capability parameter response message, the video collection capability of each other terminal that establishes a session connection with the terminal device that initiates the video collection request is obtained.

Further, it should be noted that, for any terminal, the terminal may perform the calculation operation of the video capture capability in parallel during the initialization process of the service process, so as to subsequently obtain the capability parameter acquisition request sent by the terminal device that initiates the video capture request. The corresponding video collection capability set can be directly returned to the terminal device that initiates the video collection request, so as to reduce the interaction delay of the actual response.

Further, after obtaining the video collection capability of each other terminal that establishes a session connection with the terminal device that initiates the video collection request, the acquired video collection capability of each other terminal may be selected, and which other terminal is responsible for the collection. That is, the operation described in step 102 is performed.

Optionally, in each other terminal that establishes a session connection with the terminal device that initiates the video collection request, the selected video capture capability meets the set video capture capability requirement (the set video capture is selected. The other terminal that can be flexibly adjusted according to the actual situation as the collection terminal can be specifically implemented as: selecting at least one video collection capability from among other terminals that establish a session connection with the terminal device that initiates the video collection request Any other terminal that meets the set video capture capability requirement (ie, not lower than the set video capture capability) is used as the collection terminal.

Further, in order to optimize the selected collection terminal and further improve the effect of the video collection, the video collection capability of each of the acquired other terminals according to step 102 is established from the terminal device that initiates the video collection request. In other terminals, other terminals that have the video capture capability that meet the set video capture capability requirements are selected as the collection terminal, and can be specifically implemented as:

Selecting an optimal combination of video acquisition parameters from all combinations of video acquisition parameters supported by each other terminal that establishes a session connection with the terminal device that initiates the video collection request, and supporting the selected optimal video collection parameter combination Other terminals are used as the collection terminal;

The optimal video acquisition parameter combination refers to a video capture parameter combination with the largest integrated parameter value.

Further, in order to further optimize the selected collection terminal, the optimal video acquisition parameter combination is selected from all video acquisition parameter combinations supported by each other terminal that establishes a session connection with the terminal device that initiates the video collection request. Can include:

If the video fluency is prioritized, all corresponding acquisition frame rates supported by the other terminals that establish a session connection with the terminal device that initiates the video collection request are not less than that required by the terminal device that initiates the video collection request. In the video collection parameter combination of the collection frame rate, the video combination parameter combination with the largest parameter comprehensive value is selected as the optimal video collection parameter combination; or

If the video resolution is the priority condition, all corresponding acquisition resolutions supported by the other terminals that establish a session connection with the terminal device that initiates the video collection request are not less than that required by the terminal device that initiates the video collection request. In the video capture parameter combination of the acquisition resolution, a video combination parameter combination with the largest integrated parameter value is selected as the optimal video acquisition parameter combination.

In other words, when considering the set priority conditions, such as video fluency or video clarity, etc. The terminal needs to be a terminal that can meet the priority requirement of the setting, which is not described in detail in this embodiment of the present application.

For example, it is assumed that the video collection parameters required by the terminal device that initiates the video collection request are: 1280x720, MJPEG, 25fps, and 10ms, and the video collection capability set replied by each other terminal that establishes a session connection with the terminal device that initiates the video collection request is as follows: Shown as follows:

laptop:

{..

{laptop, 640x480, YUV, 30fps, 10ms};

};

smart phone:

{..

{Mobile, 1280x720, YUV, 15fps, 10ms};

{Mobile, 1280x720, MJPEG, 25fps, 10ms};

};

tablet:

{..

{tablet, 1280x720, MJPEG, 30fps, 10ms};

}.

Then, if the video fluency is the priority condition, the tablet computer can be selected as the collection terminal from the above terminal.

It should be noted that, in order to optimize the selected collection terminal, in addition to considering a set priority condition, multiple priority conditions may be considered in the selection of the collection terminal, for example, the video may be considered simultaneously. The selection of the collection terminal by the fluency and the video clarity is not described in the embodiment of the present application.

Further, in order to improve the selection efficiency of the collection terminal, the optimal video collection parameter combination is selected from all the video collection parameter combinations supported by the other terminals that establish a session connection with the terminal device that initiates the video collection request, and may also be specific. Execution is:

Determining an optimal video collection parameter combination respectively supported by each of the other terminals that establish a session connection with the terminal device that initiated the video collection request;

Selecting, from the optimal video acquisition parameter combination supported by each other terminal that establishes a session connection with the terminal device that initiates the video collection request, selects a video acquisition parameter combination having the largest integrated parameter value.

Optionally, determining an optimal video collection parameter combination supported by each other terminal that establishes a session connection with the terminal device that initiates the video collection request may be specifically implemented as:

If the video fluency is the priority condition, the other collection terminal that is connected to the terminal device that initiates the video collection request is not less than the originating frame rate supported by the any other terminal. In the video collection parameter combination of the acquisition frame rate required by the terminal device for the video collection request, the combination of the video acquisition parameters having the largest integrated parameter value is selected as the optimal video acquisition parameter combination supported by any other terminal; or

If the video resolution is prioritized, any other terminal that has a session connection with the terminal device that initiates the video collection request, and the corresponding acquisition resolution supported by the other terminal is not less than the initiation. In the video collection parameter combination of the acquisition resolution required by the terminal device for the video acquisition request, the video capture parameter combination with the largest integrated parameter value is selected as the optimal video acquisition parameter combination supported by any other terminal.

Further, it should be noted that, in the embodiment of the present application, if the selected video capture capability meets the set video capture capability requirements, multiple other terminals (or selected optimal video) are selected. If there are multiple other terminals with the best collection capability, the method further includes:

In combination with at least one auxiliary condition, selecting from the plurality of other terminals having the video capture capability that meet the set video capture capability requirements (or from other terminals having the optimal optimal video capture capability) The other terminal of the at least one auxiliary condition serves as an acquisition terminal.

For example, if two or more terminals have the video capture capability that meets the set video capture capability requirements, it can be combined with whether there is a fixed power supply, whether it is equipped with a fixed bracket or a fixed base, or whether it is equipped with a large The selection of the collection terminal is performed by an auxiliary condition such as a screen, which is not described in detail in the embodiment of the present application.

Further, after selecting the corresponding collection terminal, the terminal device that initiates the video collection request may send a corresponding response success message to the terminal selected as the collection terminal, and send a corresponding response failure message to the not selected for collection. Terminal of the terminal. Correspondingly, the terminal that is not selected as the collection terminal may terminate the session connection with the terminal device that initiates the video collection request according to the corresponding response failure message, so as to reduce the consumption of network resources, which is not described in detail in this embodiment of the present application.

Further, after the corresponding collection terminal is selected, the video acquisition parameter required by the collection terminal based on the terminal device that initiates the video collection request and the video collection capability of the collection terminal are performed, and the video is performed. The operation of data collection.

Optionally, the collecting, by the collecting terminal, the video data collected by the terminal device that initiates the video capturing request and the video capturing capability of the collecting terminal to collect the video data may be specifically implemented as follows:

Selecting a combination of video acquisition parameters consisting of video acquisition parameters required by the terminal device that initiates the video collection request, and an optimal video acquisition parameter combination supported by the collection terminal, and selecting a video acquisition parameter combination with the smallest integrated parameter value And initializing each video acquisition parameter in the selected video acquisition parameter combination as acquisition a parameter; wherein, the video acquisition parameters required by the terminal device that initiates the video capture request include at least a video resolution (also referred to as an acquisition resolution), a frame rate (which may also be referred to as an acquisition frame rate), and a code rate (also Any one or more of an acquisition rate, a video format, or an acquisition delay;

Sending a video collection indication carrying the collection initialization parameter to the collection terminal, and instructing the collection terminal to perform video data collection according to the collection initialization parameter carried in the video collection indication.

Further, in order to optimize the video collection process and avoid the problem of reduced efficiency caused by the compression processing of the collected video data by the collection terminal, the collection terminal may be instructed by the terminal device that initiates the video collection request according to the following manner. The required video acquisition parameters and the video capture capability of the collection terminal are used to collect video data:

Instructing the collection terminal to perform the setting of the video compression data format (such as MJPEG, H264, etc.) supported by the collection terminal itself, based on the setting video compression data format supported by the collection terminal itself. Acquisition of video data.

In this way, after collecting the video data, the collecting terminal can directly send the video data to the terminal device that initiates the video collection request without performing corresponding compression processing, thereby saving network transmission resources to better adapt to the network transmission bandwidth. On the basis of the limited scenario, the processing pressure of the collection terminal is greatly reduced, the real-time performance of the video collection is ensured, and the efficiency of video collection is improved.

In addition, it should be noted that, for the collection terminal, if it determines that the built-in video compression data format is not supported, and the size of the collected video data can meet the set network transmission requirement, it may be based on The original video data format (such as YUV, RGB, etc.) transmits the collected video data to the terminal device that initiates the video acquisition request, to avoid the problem of increased processing pressure and increased transmission delay caused by video compression processing; or,

If it determines that the built-in video compression data format is not supported by the built-in, and the size of the collected video data cannot meet the set network transmission requirement, the collected video data may be appropriately compressed according to actual needs. Then, the video data is transmitted to the terminal device that initiates the video collection request, so as to reduce the corresponding network transmission burden, which is not described in this embodiment of the present application.

Further, it should be noted that after receiving the video data collected by the collection terminal, the terminal device that initiates the video collection request may perform processing on the corresponding video service according to the received video data, such as performing video stream forwarding, decoding, and The operations of the present application are not described in detail in the embodiments of the present application.

Further, it should be noted that, in order to avoid the phenomenon of video jamming caused by the instability of the video frame rate, in the embodiment of the present application, the method may further include the following steps:

Determining the total number of frames of the video received from the collecting terminal in the unit statistical period, and calculating the real-time video frame rate according to the total number of frames received in the unit statistical period; optionally, the video real-time can be calculated by the following manner Frame rate: FrameRate _rt = number_of_frames÷statistic_period;

Where statistic_period represents a unit statistical period, for example, may be 5 seconds, etc.; number_of_frames represents the total number of video frames received from the collection terminal in a unit statistical period;

If it is determined that the calculated real-time frame rate of the video is smaller than the acquisition frame rate required by the terminal device that initiates the video collection request, feedback (such as servo feedback, etc.) may be fed back to the collection terminal to perform corresponding adjustment. That is, the collection terminal may be fed back to notify the collection terminal that there may be a problem that the processor is busy, the background service process is excessive, or the memory is tight, which affects the collection output performance, so that the collection terminal can respond according to the corresponding feedback. Adjust the actual collection frame rate to meet the acquisition frame rate required by the terminal device that initiated the video acquisition request.

Of course, it should be noted that, in the video collection process, the terminal device that initiates the video collection request may also be based on actual needs (for example, in determining that the video real-time acquisition frame rate of the collection terminal is smaller than the acquisition frame required by the terminal device that initiates the video collection request). At the same time, the collection terminal terminates the corresponding video collection at any time. In addition, the collection terminal itself can terminate the corresponding video collection at any time according to actual needs, which is not described in this embodiment.

Further, it should be noted that, in the embodiment of the present application, each communication terminal (including the collection terminal, the terminal device that initiates the video collection request, etc.) may be a terminal that is internal to the local area network topology; and, each communication terminal Data can be transmitted in an end-to-end (peer-to-peer) direct connection without the need for back-end server support, thereby reducing system complexity and reducing data transmission delay.

Further, it should be noted that, in the embodiment of the present application, before acquiring the video collection capability of each other terminal that has a session connection with the terminal device that initiates the video collection request, the method may further include:

The terminal device that initiates the video capture request does not have the video capture capability; or the terminal device that initiates the video capture request has the video capture capability, and the video capture capability of the terminal device that initiates the video capture request cannot meet the set video capture capability. skill requirements.

That is to say, in the embodiment of the present application, some devices with low video capture capability can use the video capture device of the virtual cloud to collect video data, but can request video data from a higher-end video capture device on the virtual cloud. The acquisition to pursue a better video capture experience.

Further, it should be noted that, in the embodiment of the present application, the type of the terminal and the terminal device that initiates the video collection request are not limited, except that the limited collection terminal must be a terminal with video capture capability. The commonality is a network protocol interface with a microprocessor and set computing power and support settings. For example, when the terminal device that initiates the video capture request is a box terminal (TV Box, TVB for short), the end of the collection The terminal can be another box terminal with a camera, or can be a mobile phone with a video capture capability, a tablet computer, a notebook computer, etc., so as to improve the utilization rate of the device and save the cost, which is not described in the embodiment of the present application.

Further, it should be noted that the solution described in the embodiments of the present application has no limitation of language, software or hardware. However, in order to improve the efficiency of the video collection, the performance of the high-performance programming language (such as C, C++, or Java) and the high-performance hardware are preferred.

The first embodiment of the present application provides a video collection method. In the technical solution of the first embodiment of the present application, the video collection capability of each other terminal that has a session connection with the terminal device that initiates the video collection request may be established. The other terminals that have the video capture capability to meet the set video capture capability are selected as the collection terminal to collect video data, thereby solving the current video capture mode. The selected video capture device is relatively fixed and cannot be satisfactorily satisfied. The actual requirements of the application scenario result in a low video capture effect, which improves the video application experience of the user. At the same time, it can also save the interface resources of the terminal device that initiates the video capture request, improve the utilization rate of the device, and improve the device selection. The effect of flexibility.

Embodiment 2:

Based on the same inventive concept, the second embodiment of the present application provides a terminal. For the specific implementation of the terminal, reference may be made to the related description in the first embodiment of the foregoing method, and the repeated description is not repeated. As shown in FIG. 2, the terminal may be mainly include:

The capability acquisition unit 21 is configured to acquire video capture capability of each other terminal that establishes a session connection with the terminal itself;

The device selection unit 22 is configured to select, according to the video collection capability of each other terminal acquired by the capability acquiring unit 21, the video capture capability that is provided in the other terminals that have established a session connection with the terminal itself. Other terminals required by the specified video collection capability are used as collection terminals;

The device indication unit 23 is configured to instruct the collection terminal selected by the device selection unit 22 to collect video data based on the video collection parameters required by the terminal and the video collection capability of the collection terminal.

Further, the terminal may further include a connection establishing unit 24:

The connection establishing unit 24 may be configured to establish a session connection with other terminals based on an IP multicast technology and a peer-to-peer TCP connection technology before acquiring video collection capabilities of each other terminal having a session connection with itself, or based on IP multicast technology and peer-to-peer UDP connection technology establish a session connection with other terminals.

Further, the terminal may further include a capability determining unit 25:

The capability determining unit 25 may be configured to determine that the terminal does not have the video collection capability before acquiring the video collection capability of each other terminal that has a session connection with the terminal itself, or determine that the terminal itself has a video. The acquisition capability and the video capture capability that it has can't meet the set video capture capability requirements.

Optionally, the capability acquiring unit 21 is specifically configured to send a capability parameter acquisition request to each other terminal that establishes a session connection with the terminal itself, and receive a return of each other terminal that establishes a session connection with the terminal itself. The capability parameter response message, wherein the capability parameter response message returned by each other terminal carries a video capture capability set corresponding to the corresponding other terminal, and, for any other terminal, the corresponding one of the other terminals The video collection capability set is a parameter set composed of one or more sets of video collection parameters supported by any other terminal; and, according to the received capability parameter response message, acquires a session established with the terminal itself. Video capture capability of each connected terminal.

Optionally, the device selecting unit 22 is specifically configured to select an optimal video collection parameter combination from all video collection parameter combinations supported by each terminal that establishes a session connection with the terminal itself, and support The other terminal of the selected optimal video acquisition parameter combination is used as the collection terminal; wherein the optimal video acquisition parameter combination refers to a video acquisition parameter combination with the largest integrated parameter value.

Further, the device selecting unit 22 may be specifically configured to: if the video fluency is a priority condition, all corresponding collection frame rates supported by each other terminal that establishes a session connection with the terminal itself are not less than the In the video collection parameter combination of the acquisition frame rate required by the terminal, the combination of the video acquisition parameters with the largest integrated parameter value is selected as the optimal video collection parameter combination; or

If the video resolution is prioritized, all the corresponding acquisition resolutions supported by the other terminals that establish a session connection with the terminal itself are not less than the video collection parameter combinations of the acquisition resolution required by the terminal. And selecting, as the optimal video collection parameter combination, a combination of video acquisition parameters corresponding to the largest parameter comprehensive value.

Further, the device instructing unit 23 is specifically configured to use the combined video capture parameter combination and the optimal video capture parameter combination supported by the collection terminal to select a video capture parameter combination with a corresponding integrated parameter minimum value. And each video acquisition parameter in the selected video collection parameter combination is used as an acquisition initialization parameter;

Further, the device instructing unit 23 is specifically configured to instruct the collecting terminal to preferentially set the supported video compression data format based on the built-in support of the collection terminal itself. The video compression data format is used to collect video data.

Further, the terminal may further include an information feedback unit 26:

The information feedback unit 26 may be configured to determine a total number of video frames received from the collection terminal in a unit statistical period, and calculate a real-time video frame rate according to the total number of frames received in the unit statistical period; and If Determining that the calculated real-time frame rate of the video is smaller than the acquisition frame rate required by the terminal, and then feeding back to the collection terminal for corresponding adjustment.

Further, it should be noted that the terminal and the collection terminal are terminals with a microprocessor and having a set computing capability and a network protocol interface supporting setting.

Further, based on the same inventive concept, the second embodiment of the present application further provides a video capture system. For the specific implementation of the video capture system, refer to the related description in the first embodiment of the foregoing method. As shown in 3, the video capture system can mainly include:

The terminal device 31 that initiates the video collection request may be configured to acquire the video collection capability of each other terminal that has established a session connection with itself, and establish a session connection with itself based on the acquired video collection capability of each other terminal. In the terminal, the other terminal that has the video capture capability that meets the set video capture capability is selected as the collection terminal 32, and the collection terminal 32 is instructed to select the video acquisition parameters required by the terminal device 31 that initiates the video capture request. And the video collection capability of the collection terminal, and collecting video data;

The collecting terminal 32 is configured to be used according to the video collection indication sent by the terminal device 31 that initiates the video collection request, based on the video collection parameters required by the terminal device 31 that initiates the video collection request, and the video collection capability of the collection terminal 32. The video data is collected, and the collected video data is transmitted to the terminal device 31 that initiates the video collection request.

Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, apparatus (device), or computer program product. Thus, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present application is described with reference to flowchart illustrations and/or block diagrams of a method, apparatus, and computer program product according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory include instructions. An article of manufacture of a device that implements the functions specified in a block or blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

While the preferred embodiment of the present application has been described, it will be apparent that those skilled in the art can make further changes and modifications to the embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

It will be apparent to those skilled in the art that various modifications and changes can be made in the present application without departing from the spirit and scope of the application. Thus, it is intended that the present invention cover the modifications and variations of the present invention.

Claims

A video collection method, comprising:

Obtaining a video collection capability of each other terminal that establishes a session connection with the terminal device that initiates the video collection request;

Based on the acquired video collection capabilities of the other terminals, the other terminals that have the session connection connection with the terminal device that initiated the video collection request are selected as other terminals that have the video capture capability that meets the set video capture capability requirements. Acquisition terminal

Instructing the collection terminal to perform video data collection based on video capture parameters required by the terminal device that initiates the video capture request and video capture capabilities of the collection terminal.
The method of claim 1, wherein the method further comprises: before acquiring the video collection capability of each other terminal that has a session connection with the terminal device that initiates the video collection request, the method further includes:

Establishing a session connection between the terminal device that initiates the video collection request and other terminals based on the network protocol IP multicast technology and the peer-to-peer transmission control protocol TCP connection technology; or establishing the initiation based on the IP multicast technology and the peer-to-peer user data packet protocol UDP connection technology The session connection between the terminal device of the video acquisition request and other terminals.
The method of claim 1, wherein the method further comprises: before acquiring the video collection capability of each other terminal that has a session connection with the terminal device that initiates the video collection request, the method further includes:

The terminal device that initiates the video capture request does not have the video capture capability; or the terminal device that initiates the video capture request has the video capture capability, and the video capture capability of the terminal device that initiates the video capture request cannot meet the set video capture capability. skill requirements.
The method of claim 1, wherein the acquiring the video collection capability of each other terminal that has a session connection with the terminal device that initiates the video collection request comprises:

Transmitting a capability parameter acquisition request to each other terminal that establishes a session connection with the terminal device that initiates the video collection request;

And receiving, by the terminal device that initiates the video collection request, a capability parameter response message returned by each other terminal that has a session connection, where the capability parameter response message returned by each other terminal carries a video collection capability set corresponding to the corresponding other terminal And, for any other terminal, the video collection capability set corresponding to any other terminal is a parameter set consisting of one or more sets of video collection parameters supported by any other terminal;

According to the received capability parameter response message, the terminal device that initiates the video collection request is established. The video capture capability of each other terminal connected to the voice.
The method according to claim 1, wherein the video capture capability that meets the set video capture capability is selected from each of the other terminals that have established a session connection with the terminal device that initiated the video capture request. Other terminals serve as collection terminals, including:

Selecting an optimal combination of video acquisition parameters from all combinations of video acquisition parameters supported by each other terminal that establishes a session connection with the terminal device that initiates the video collection request, and supporting the selected optimal video collection parameter combination Other terminals are used as the collection terminal;

The optimal video acquisition parameter combination refers to a video capture parameter combination with the largest integrated parameter value.
The method according to claim 5, wherein the optimal video acquisition parameter combination is selected from all video acquisition parameter combinations supported by each other terminal that establishes a session connection with the terminal device that initiated the video collection request. ,include:

If the video fluency is prioritized, all corresponding acquisition frame rates supported by the other terminals that establish a session connection with the terminal device that initiates the video collection request are not less than the acquisition frames required by the terminal device that initiates the video collection request. In the video capture parameter combination of the rate, the video capture parameter combination with the largest integrated parameter value is selected as the optimal video capture parameter combination; or

If the video resolution is prioritized, all corresponding acquisition resolutions supported by the other terminals that establish a session connection with the terminal device that initiates the video collection request are not less than the acquisition resolution required by the terminal device that initiates the video collection request. In the video capture parameter combination of the rate, the video capture parameter combination with the largest integrated parameter value is selected as the optimal video capture parameter combination.
The method according to claim 1, wherein the instructing the collecting terminal to collect video data based on video capturing parameters required by the terminal device that initiates the video capturing request and the video capturing capability of the collecting terminal include:

Selecting a combination of video acquisition parameters consisting of video acquisition parameters required by the terminal device that initiates the video collection request, and an optimal video acquisition parameter combination supported by the collection terminal, and selecting a video acquisition parameter combination with the smallest integrated parameter value And each video acquisition parameter in the selected video collection parameter combination is used as an acquisition initialization parameter;

Sending a video collection indication carrying the collection initialization parameter to the collection terminal, and instructing the collection terminal to perform video data collection according to the collection initialization parameter carried in the video collection indication.
The method of claim 1 wherein said instructing said collection terminal is based on initiating a video Collecting video acquisition parameters required by the requested terminal device and the video collection capability of the collection terminal, and collecting video data, including:

When the collection terminal determines that the collection terminal supports the set video compression data format, the collection terminal preferentially collects the video data based on the set video compression data format supported by the collection terminal itself.
The method of claim 1 wherein the method further comprises:

Determining a total number of frames of the video received from the collection terminal in a unit statistical period, and calculating a real-time video frame rate according to the total number of frames received in the unit statistical period;

If it is determined that the calculated real-time frame rate of the video is smaller than the acquisition frame rate required by the terminal device that initiates the video collection request, the data is fed back to the collection terminal for corresponding adjustment.
The method according to claim 1, wherein said terminal device that initiates a video capture request and said collection terminal are terminals with a microprocessor and having a set computing capability and a supported network protocol interface .
A terminal, comprising:

a capability acquisition unit, configured to acquire video capture capability of each other terminal that establishes a session connection with the terminal itself;

a device selection unit, configured to select, according to a video collection capability of each other terminal acquired by the capability acquisition unit, a video capture capability that meets the set selection from each other terminal that establishes a session connection with the terminal itself Other terminals required by the video capture capability are used as collection terminals;

The device indication unit is configured to instruct the collection terminal selected by the device selection unit to collect video data based on the video collection parameters required by the terminal and the video collection capability of the collection terminal.
The terminal according to claim 11, wherein the terminal further comprises a connection establishing unit:

The connection establishing unit is configured to establish a session connection with other terminals based on a network protocol IP multicast technology and a peer-to-peer transmission control protocol TCP connection technology before acquiring video collection capabilities of each other terminal having a session connection with itself Or, establish a session connection with other terminals based on IP multicast technology and peer-to-peer user packet protocol UDP connection technology.
The terminal according to claim 11, wherein the terminal further comprises a capability determining unit:

The capability determining unit is configured to determine that the terminal does not have the video collection capability before acquiring the video collection capability of each other terminal that has the session connection with the terminal itself, or that the terminal itself has the video collection capability. The ability and the video capture capability that it has can't meet the set video capture capability requirements.
The terminal of claim 11 wherein:

The capability obtaining unit is configured to send a capability parameter acquisition request to each other terminal that establishes a session connection with the terminal itself, and receive a capability parameter response message returned by each other terminal that has established a session connection with the terminal itself. The capability parameter response message returned by each other terminal carries a video capture capability set corresponding to the corresponding other terminal, and for any other terminal, the video collection capability set corresponding to any other terminal is a set of parameters consisting of one or more sets of video collection parameters supported by any of the other terminals; and, according to the received capability parameter response messages, obtaining other terminals that have established a session connection with the terminal itself Video capture capabilities.
The terminal of claim 11 wherein:

The device selecting unit is specifically configured to select an optimal video collection parameter combination from all video acquisition parameter combinations supported by each other terminal that establishes a session connection with the terminal itself, and support the selected optimal Other terminals of the video collection parameter combination are used as the collection terminal;

The optimal video acquisition parameter combination refers to a video capture parameter combination with the largest integrated parameter value.
The terminal of claim 15 wherein:

The device selection unit is specifically configured to: if the video fluency is a priority condition, all corresponding collection frame rates supported by each other terminal that establishes a session connection with the terminal itself are not less than required by the terminal. In the video collection parameter combination of the collection frame rate, the video combination parameter combination with the largest parameter comprehensive value is selected as the optimal video collection parameter combination; or

If the video resolution is prioritized, all the corresponding acquisition resolutions supported by the other terminals that establish a session connection with the terminal itself are not less than the video collection parameter combinations of the acquisition resolution required by the terminal. And selecting, as the optimal video collection parameter combination, a combination of video acquisition parameters corresponding to the largest parameter comprehensive value.
The terminal of claim 11 wherein:

The device indication unit is specifically configured to select a video combination parameter combination composed of video acquisition parameters required by the terminal, and an optimal video collection parameter combination supported by the collection terminal, and select a corresponding parameter with a minimum integrated value Video capture parameter combination, and each video capture parameter in the selected video capture parameter combination is used as an acquisition initialization parameter;

Sending a video collection indication carrying the collection initialization parameter to the collection terminal, and instructing the collection terminal to perform video data collection according to the collection initialization parameter carried in the video collection indication.
The terminal of claim 11 wherein:

The device indication unit is specifically configured to instruct the collection terminal to preferentially set the video compression data supported by the collection terminal itself when determining the video compression data format supported by the collection terminal itself. The format is used to collect video data.
The terminal according to claim 11, wherein the terminal further comprises an information feedback unit:

The information feedback unit is configured to determine a total number of video frames received from the collection terminal in a unit statistical period, and calculate a real-time video frame rate according to the total number of frames received in the unit statistical period; and, if Determining that the calculated real-time frame rate of the video is smaller than the acquisition frame rate required by the terminal, and then feeding back to the collection terminal for corresponding adjustment.
The terminal according to claim 11, wherein said terminal and said collection terminal are terminals having a microprocessor and having a set computing capability and a supported network protocol interface.
A video capture system, comprising:

The terminal device that initiates the video collection request is used to acquire the video collection capability of each other terminal that has established a session connection with itself, and based on the obtained video collection capability of each other terminal, each other terminal that establishes a session connection with itself The other terminal that has the video capture capability that meets the set video capture capability requirements is selected as the collection terminal, and the collection terminal is instructed to select the video acquisition parameters and the collection based on the terminal device that initiates the video capture request. Video capture capability of the terminal to collect video data;

The collection terminal is configured to perform video data according to the video collection parameter sent by the terminal device that initiates the video collection request, and the video collection parameter required by the terminal device that initiates the video collection request and the video collection capability of the collection terminal. Collecting and transmitting the collected video data to the terminal device that initiates the video collection request.