CN112804556A - PC-end-oriented live broadcast data processing method, device and system - Google Patents
PC-end-oriented live broadcast data processing method, device and system Download PDFInfo
- Publication number
- CN112804556A CN112804556A CN202110375675.4A CN202110375675A CN112804556A CN 112804556 A CN112804556 A CN 112804556A CN 202110375675 A CN202110375675 A CN 202110375675A CN 112804556 A CN112804556 A CN 112804556A
- Authority
- CN
- China
- Prior art keywords
- live video
- target
- video
- storage devices
- live
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4627—Rights management associated to the content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/633—Control signals issued by server directed to the network components or client
- H04N21/6332—Control signals issued by server directed to the network components or client directed to client
- H04N21/6334—Control signals issued by server directed to the network components or client directed to client for authorisation, e.g. by transmitting a key
Abstract
The invention discloses a PC-side-oriented live broadcast data processing method, a PC-side-oriented live broadcast data processing device and a PC-side-oriented live broadcast data processing system, and belongs to the field of image processing and storage. According to the method, a plurality of storage devices for respectively storing live video clips are determined according to a Hash algorithm; the live video sub-segments and the background images are respectively sent to the corresponding storage devices to be stored, distributed storage of the video images is achieved, malicious tampering and malicious downloading of the video files after malicious access are avoided, risks of exposure of private data of users are reduced, and safety is improved. The target in the live video is tracked, the partial live video containing the target is generated and stored, the target selected by a user is identified from the live video, and the partial live video is divided into a plurality of live video clips according to the background image of the target, so that convenience is brought to image video processing based on the target in the later stage of the user, and the user experience is further improved.
Description
Technical Field
The invention relates to the field of image processing and storage, in particular to a method, a device and a system for processing live broadcast data facing a PC (personal computer) end.
Background
With the continuous development and popularization of live video broadcasting, while users show diversified lives through live video broadcasting, the processing and storage requirements of live video broadcasting are more and more diversified, and therefore, how to efficiently store and process a large amount of video image data becomes a technical problem which needs to be solved urgently.
In the existing video storage technology, complete video image data is uploaded and stored in a network storage device, and when a video image needs to be inquired or processed, the complete video image data is downloaded.
Obviously, the existing video storage technology cannot meet the storage requirement of live videos, cannot avoid malicious tampering and malicious downloading of the video files after being maliciously accessed, and improves the risk of exposing private data of users, so that the security is low.
Disclosure of Invention
In order to solve the problems in the prior art, embodiments of the present invention provide a PC-side-oriented live data processing method, apparatus, and system. The technical scheme is as follows:
on one hand, a PC-side-oriented live data processing method is provided, and the method comprises the following steps:
identifying a target selected by a user from a live video played by a PC (personal computer) end;
tracking a target in the live video to generate a part of live video containing the target;
according to the background image of the target, dividing the partial live video into a plurality of live video segments;
for any one of the live video clips, performing the following operations:
acquiring a plurality of available storage devices from all storage devices in the private network according to the operation behavior;
selecting a hash algorithm, and determining a plurality of storage devices for respectively storing the live video clips according to the hash algorithm;
and segmenting the live video clips to generate a plurality of live video sub-clips, and respectively sending the live video sub-clips and the background images to a plurality of corresponding storage devices for storage.
Optionally, the identifying, from the live video played by the PC, the target selected by the user includes:
acquiring and identifying a target selected by a user through a gesture on a live video interface of a PC (personal computer) end; or
And acquiring a target selected by a user through inputting a picture at a PC (personal computer) end, wherein the picture at least comprises the target.
Optionally, the tracking a target in the live video, and generating a part of the live video including the target includes:
identifying targets in all video frames in the live video, and extracting a plurality of video frames containing the targets;
and generating a part of live video containing the target according to the plurality of video frames.
Optionally, the tracking a target in the live video, and generating a part of the live video including the target further includes:
identifying targets in all video frames in the live video, and acquiring motion parameters of the targets according to vectors of pixel points of the targets;
extracting a plurality of video frames containing the target, and generating a part of live video containing the target according to the plurality of video frames, wherein the part of live video also comprises the motion parameters.
Optionally, the dividing the part of the live video into a plurality of live video segments according to the background image of the target includes:
respectively acquiring the similarity between background images of all video frames in the partial live video;
and extracting and generating a plurality of video frames with the similarity meeting the requirement of being larger than a preset value into the same live video clip.
Optionally, the obtaining a plurality of available storage devices from all storage devices in the private network includes:
acquiring the operation behaviors, the storage space and the online time of all the storage devices;
acquiring the storage space and the online time from all the storage devices, wherein the storage space and the online time are respectively greater than corresponding preset thresholds, and the operation behavior is selectable for a plurality of available storage devices for data storage, wherein selecting a hash algorithm and determining the plurality of storage devices for respectively storing the live video segments according to the hash algorithm comprises:
randomly selecting a target hash algorithm from a plurality of hash algorithms according to a preset time interval;
and carrying out hash processing on the identification of the storage equipment according to the target hash algorithm, and determining a plurality of storage equipment for respectively storing the live video segments.
In another aspect, a PC-oriented live data processing apparatus is provided, where the apparatus includes:
the identification module is used for identifying a target selected by a user from a live video played by a PC (personal computer) end;
the processing module is used for tracking a target in the live video and generating a part of live video containing the target;
the segmentation module is used for segmenting the part of live video into a plurality of live video segments according to the background image of the target;
the acquisition module is used for acquiring a plurality of available storage devices from all the storage devices in the private network according to the operation behavior;
the processing module is further used for selecting a hash algorithm and determining a plurality of storage devices for respectively storing the live video segments according to the hash algorithm;
the segmentation module is further configured to segment the live video segments to generate a plurality of live video sub-segments, and send the plurality of live video sub-segments and the background image to a plurality of corresponding storage devices respectively for storage.
Optionally, the identification module is specifically configured to:
acquiring and identifying a target selected by a user through a gesture on a live video interface of a PC (personal computer) end; or
And acquiring a target selected by a user through inputting a picture at a PC (personal computer) end, wherein the picture at least comprises the target.
Optionally, the processing module is specifically configured to:
identifying targets in all video frames in the live video, and extracting a plurality of video frames containing the targets;
and generating a part of live video containing the target according to the plurality of video frames.
Optionally, the processing module is further specifically configured to:
identifying targets in all video frames in the live video, and acquiring motion parameters of the targets according to vectors of pixel points of the targets;
extracting a plurality of video frames containing the target, and generating a part of live video containing the target according to the plurality of video frames, wherein the part of live video also comprises the motion parameters.
Optionally, the segmentation module is specifically configured to:
respectively acquiring the similarity between background images of all video frames in the partial live video;
and extracting and generating a plurality of video frames with the similarity meeting the requirement of being larger than a preset value into the same live video clip.
Optionally, the obtaining module is specifically configured to:
acquiring the operation behaviors, the storage space and the online time of all the storage devices;
the processing module is further specifically configured to acquire the storage space from all the storage devices and the online time that are respectively greater than the corresponding preset threshold, and the operation behavior is selectable for a plurality of available storage devices for data storage, and the processing module is further configured to:
randomly selecting a target hash algorithm from a plurality of hash algorithms according to a preset time interval;
and carrying out hash processing on the identification of the storage equipment according to the target hash algorithm, and determining a plurality of storage equipment for respectively storing the live video segments.
In another aspect, a PC-oriented live data processing system is provided, where the system includes:
the identification device is used for identifying a target selected by a user from a live video played by a PC (personal computer) end;
the processing device is used for tracking a target in the live video and generating a part of live video containing the target;
the segmentation device is used for segmenting the part of live video into a plurality of live video segments according to the background image of the target;
the acquisition device is used for acquiring a plurality of available storage devices from all the storage devices in the private network according to the operation behavior;
the processing device is further used for selecting a hash algorithm and determining a plurality of storage devices for respectively storing the live video segments according to the hash algorithm;
the segmentation device is further configured to segment the live video segments to generate a plurality of live video sub-segments, and send the plurality of live video sub-segments and the background image to the corresponding plurality of storage devices respectively for storage.
Optionally, the identification device is specifically configured to:
acquiring and identifying a target selected by a user through a gesture on a live video interface of a PC (personal computer) end; or
And acquiring a target selected by a user through inputting a picture at a PC (personal computer) end, wherein the picture at least comprises the target.
Optionally, the processing device is specifically configured to:
identifying targets in all video frames in the live video, and extracting a plurality of video frames containing the targets;
and generating a part of live video containing the target according to the plurality of video frames.
Optionally, the processing device is further specifically configured to:
identifying targets in all video frames in the live video, and acquiring motion parameters of the targets according to vectors of pixel points of the targets;
extracting a plurality of video frames containing the target, and generating a part of live video containing the target according to the plurality of video frames, wherein the part of live video also comprises the motion parameters.
Optionally, the dividing device is specifically configured to:
respectively acquiring the similarity between background images of all video frames in the partial live video;
and extracting and generating a plurality of video frames with the similarity meeting the requirement of being larger than a preset value into the same live video clip.
Optionally, the obtaining device is specifically configured to:
acquiring storage spaces and online time of all the storage devices;
and acquiring a plurality of available storage devices of which the storage space and the online time are respectively larger than corresponding preset thresholds from all the storage devices.
Optionally, the processing device is further specifically configured to:
randomly selecting a target hash algorithm from a plurality of hash algorithms according to a preset time interval;
and carrying out hash processing on the identification of the storage equipment according to the target hash algorithm, and determining a plurality of storage equipment for respectively storing the live video segments.
In another aspect, a PC-oriented live data processing apparatus is provided, where the apparatus includes a processor and a memory connected to the processor, where the memory is used to store a set of program codes, and the processor calls the program codes stored in the memory to implement the method according to any one of the first aspect.
The embodiment of the invention provides a PC-side-oriented live data processing method, a PC-side-oriented live data processing device and a PC-side-oriented live data processing system, wherein the PC-side-oriented live data processing device comprises the following steps: identifying a target selected by a user from a live video played by a PC (personal computer) end; tracking a target in the live video to generate a part of live video containing the target; according to a background image of a target, dividing part of live video into a plurality of live video segments; for any one live video clip, the following operations are performed: obtaining a plurality of available storage devices from all storage devices within the private network; selecting a hash algorithm, and determining a plurality of storage devices for respectively storing the live video clips according to the hash algorithm; the method comprises the steps of segmenting a live video clip, generating a plurality of live video sub-clips, and respectively sending the plurality of live video sub-clips and background images to a plurality of corresponding storage devices for storage.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
1. determining a plurality of storage devices for respectively storing the live video clips by selecting a hash algorithm and according to the hash algorithm; the live video clips are divided to generate a plurality of live video sub-clips, the live video sub-clips and the background images are respectively sent to the corresponding storage devices to be stored, distributed storage of the video images is achieved, malicious tampering and malicious downloading of the video files after being maliciously accessed are avoided, risks of exposure of user privacy data are reduced, and safety is improved.
2. Tracking a target in a live video to generate a part of live video containing the target; and the video image containing the target is stored, so that the later image video processing based on the target is facilitated for the user, and the user experience is further improved.
3. The target selected by the user is identified from the live video, so that the personalized demand of the user is realized, and the user experience is further improved.
4. By dividing part of live video into a plurality of live video segments according to the background image of the target, the user can store, search and process the image data according to the background image, thereby further facilitating the image video processing based on the target in the later period of the user and further improving the user experience.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart of a PC-oriented live data processing method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a PC-oriented live data processing apparatus according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a PC-oriented live data processing system according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example one
The embodiment of the invention provides a PC-side-oriented live data processing method, which is shown in figure 1 and comprises the following steps:
101. and identifying the target selected by the user from the live video played by the PC terminal.
Specifically, a target selected by a user through a gesture on a live video interface of a PC (personal computer) end is obtained and identified; or
And acquiring a target selected by a user through inputting a picture at a PC (personal computer) end, wherein the picture at least comprises the target.
102. And tracking the target in the live video to generate a part of live video containing the target.
Specifically, targets in all video frames in a live video are identified, and a plurality of video frames containing the targets are extracted;
and generating a part of live video containing the target according to the plurality of video frames.
Optionally, the process in step 102 may further include:
identifying targets in all video frames in a live video, and acquiring motion parameters of the targets according to vectors of pixel points of the targets;
extracting a plurality of video frames containing the target, and generating a part of live video containing the target according to the plurality of video frames, wherein the part of live video also comprises motion parameters.
103. And according to the background image of the target, dividing part of the live video into a plurality of live video segments.
Specifically, the similarity between background images of all video frames in part of live video is respectively obtained;
and extracting and generating a plurality of video frames with the similarity meeting the requirement of being larger than a preset value into the same live video clip.
For any one live video clip, the following operations are performed:
104. a plurality of available storage devices is retrieved from all storage devices within the private network based on the operational behavior.
Specifically, the operation behaviors, the storage space and the online time of all the storage devices are obtained;
obtaining a plurality of available storage devices from all the storage devices, wherein the storage space and the online time are respectively larger than the corresponding preset threshold values, and the operation behavior is data storage
105. And selecting a hash algorithm, and determining a plurality of storage devices for respectively storing the live video clips according to the hash algorithm.
Specifically, a target hash algorithm is randomly selected from a plurality of hash algorithms according to a preset time interval;
and performing hash processing on the identification of the storage equipment according to a target hash algorithm, and determining a plurality of storage equipment for respectively storing the live video clips.
106. The method comprises the steps of segmenting a live video clip, generating a plurality of live video sub-clips, and respectively sending the plurality of live video sub-clips and background images to a plurality of corresponding storage devices for storage.
Example two
The embodiment of the invention provides a PC-side-oriented live data processing method, which comprises the following steps:
201. and acquiring and identifying a target selected by a user through a gesture on a live video interface of the PC terminal.
Specifically, after a user inputs a closed or semi-closed curve of a track on a live video interface, identifying a target contained in the track, and outputting the target to the user, where the identification process may be implemented by a YOLOv3 (You Only Look Once v 3) algorithm;
after the user confirms the target, the target is the target selected by the user through gestures on the live video interface.
202. Acquiring a target selected by a user through inputting a picture at the PC end, wherein the picture at least comprises the target, and after the step 202, executing the step 203 or 205.
Specifically, a picture which is input by a user and at least comprises a target is obtained, and in practical application, the picture can be a screenshot or a picture obtained by photographing by the user;
recognizing all targets contained in the picture and outputting the recognized targets to the user, wherein the recognizing process can be realized through a YOLOv3 algorithm;
after the user selects the target from all the targets, the target is the target selected by the user through the input picture.
It should be noted that, step 201 or step 202 is a process for identifying an object selected by a user from a live video played on a PC side, and besides the above-mentioned steps, the process may also be implemented in other ways, and the embodiment of the present invention does not limit the specific ways.
203. Identifying targets in all video frames in a live video, and extracting a plurality of video frames containing the targets;
specifically, a first time interval is set;
sampling all video frames in the live video according to the first time interval to generate a plurality of sampled video frames;
for two video frames beginning and ending with the first time interval, executing the following steps: a
If the first video frame and the last video frame both contain the target, confirming that all the video frames in the first time interval contain the target;
if at least one of the first video frame or the last video frame does not contain the object, the first time is shortened until both the first video frame and the last video frame contain the object.
And after the operations are completed on all the video frames, a plurality of video frames containing the target are obtained.
204. From the plurality of video frames, a partial live video containing the target is generated, and after step 204, step 207 is performed.
Specifically, the plurality of video frames are combined according to time to generate a part of live video, where the live video includes the target, and a specific combination manner is not limited in the embodiment of the present invention.
205. Identifying targets in all video frames in a live video, and acquiring motion parameters of the targets according to vectors of pixel points of the targets;
specifically, the manner of identifying the targets in all video frames in the live video is the same as that described in step 203, and is not described herein again.
According to the vector of the pixel point of the target, the process of obtaining the motion parameter of the target may be:
locating a plurality of pixel points for describing the target, and for any consecutive n video frames of the plurality of video frames, performing the following operations:
for the ith video frame (i is less than n), the following operations are performed:
obtaining coordinate values of the pixel points in the ith video frame;
obtaining coordinate values of the pixel points in the (i + 1) th video frame;
respectively calculating a plurality of vectors between the coordinate value phase in the (i + 1) th video frame and the coordinate value phase in the ith video frame corresponding to the plurality of pixel points;
counting the directions of the vectors, acquiring the proportion of the vectors with the same direction in the vectors, and if the proportion is greater than or equal to a proportion threshold value, determining the direction as the motion direction of the target;
and calculating the motion speed of the target according to the time length between the ith video frame and the (i + 1) th video frame and the average length of the vectors.
206. Extracting a plurality of video frames containing the target, generating a part of live video containing the target according to the plurality of video frames, wherein the part of live video also comprises motion parameters, and executing a step 207 after the step 206.
Specifically, the step is the same as the process described in step 204 except that the motion parameter is loaded to a part of the live video, and is not described again here. In addition, the embodiment of the present invention does not limit the manner in which the motion parameter is loaded to a part of the live video.
It should be noted that the processes described in steps 203 to 204 and steps 205 to 206 are all processes for tracking a target in a live video and generating a partial live video including the target, and besides the above-described processes, the processes may be implemented in other ways, and the specific way of the embodiment of the present invention is not limited.
207. And respectively acquiring the similarity between the background images of all video frames in part of live video.
Specifically, a second time interval is set;
sampling all video frames in the part of live video according to a second time interval to generate a plurality of sampled video frames;
for two video frames beginning and ending with the second time interval, the following steps are executed: a
Respectively identifying all targets of a first video frame and a last video frame through a YOLOv3 algorithm;
judging the proportion of all targets in the first video frame to all targets in the last video frame, wherein the proportion is the similarity;
if the similarity of the first video frame and the last video frame is below 50%, shortening the first time interval according to preset unit time until the similarity of the first video frame and the last video frame is above 50%;
if the similarity between the first video frame and the last video frame is more than 50%, increasing the first time interval according to a preset unit time until the similarity between the first video frame and the last video frame is less than 50%, and confirming that the similarity between the first video frame and the last video frame in a second time interval corresponding to the last preset unit time is more than 50%;
after the above steps are completed for the current second time interval, the above steps are continued for the next second time interval.
208. And extracting and generating a plurality of video frames with the similarity meeting the requirement of being larger than a preset value into the same live video clip.
Specifically, if the similarity between the first video frame and the last video frame is more than 50%, all the video frames between the first video frame and the last video frame are extracted and combined according to time to generate a live video clip, and the background images of the live video clip are the same.
It should be noted that steps 207 to 208 are processes for dividing a part of the live video into a plurality of live video segments according to the background image of the target, and the processes may be implemented in other ways besides the ways described in the above steps, and the specific ways are not limited in the embodiment of the present invention.
For any one live video clip, the following operations are performed:
209. acquiring storage spaces and online time of all storage devices;
specifically, the embodiment of the present invention does not limit the specific acquisition manner.
It should be noted that, in the embodiment of the present invention, all the storage devices are registered storage devices, and a specific registration manner is not limited in the embodiment of the present invention, before executing step 209, the method further includes:
and verifying the credibility of all the storage devices, wherein the process can be as follows:
respectively sending verification requests to all the storage devices, wherein the verification requests are used for indicating the storage devices to feed back verification information generated immediately or user information generated immediately;
if the verification information or the user information is consistent with the verification information registered by the system and the user information, confirming that the storage equipment is credible, otherwise, confirming that the equipment is not credible;
the verification information may be a key generated instantly, and the user information may be biometric information collected instantly, such as fingerprint and facial information.
Optionally, the following steps may be further performed:
and acquiring storage behavior records of all the storage devices, wherein the storage behavior records are used for indicating whether illegal behaviors such as malicious access, malicious downloading or data tampering occur in the preset time of the storage devices.
And if the storage behavior record indicates that the illegal behavior occurs in the preset time of the storage equipment, determining that the equipment is not trusted, otherwise, determining that the equipment is trusted.
A plurality of trusted storage devices are retrieved from the all-storage device.
210. And acquiring a plurality of available storage devices of which the storage space and the online time are respectively larger than the corresponding preset threshold values from all the storage devices.
Specifically, a plurality of available storage devices whose storage space and online time are respectively greater than corresponding preset thresholds are acquired from a plurality of trusted storage devices, and a specific acquisition mode is not limited in the embodiment of the present invention.
To further protect the privacy of the user, all storage devices described in the embodiments of the present invention are in a private network, which may be a private network selected or purchased by the user, thereby further avoiding malicious access and malicious downloading.
Optionally, for any one trusted storage device, the following may be further performed:
acquiring an operation record of the trusted storage device, wherein the operation record comprises an operation behavior of the trusted storage device and the time when the operation behavior occurs, and the operation behavior comprises program processing and data storage;
predicting the operation behavior of the trusted device in the next unit time according to the operation record, and if the operation behavior indicates that the operation behavior of the device in the next unit time is data storage, indicating that the trusted storage device is available;
the process of predicting the operation behavior of the trusted device in the next unit time may be:
acquiring the proportion of certain operation behaviors of the trusted equipment in the operation records with different dates and the same time, and setting the proportion as a first influence factor;
acquiring operation records of other equipment of the same type as the trusted equipment, acquiring the proportion of the same operation behavior of the other equipment in the operation records at different dates and the same time, and setting the proportion as a second influence factor;
and if the sum of the first influence factor and the second influence factor is larger than a preset value, predicting that the operation behavior of the trusted device in the next unit time is the operation behavior.
It should be noted that steps 209 to 210 are processes for obtaining a plurality of available storage devices from all storage devices, and the processes may be implemented in other ways besides the ways described in the above steps, and the embodiment of the present invention is not limited to the specific ways.
211. And randomly selecting a target hash algorithm from the plurality of hash algorithms according to a preset time interval.
Specifically, according to a third preset time interval, a target hash algorithm is randomly selected from the multiple hash algorithms, and if the currently randomly selected hash algorithm is the same as the last randomly selected hash algorithm, the hash algorithm is reselected.
212. And performing hash processing on the identification of the storage equipment according to a target hash algorithm, and determining a plurality of storage equipment for respectively storing the live video clips.
Specifically, the embodiment of the present invention does not limit the way of performing hash processing on the identifier of the storage device according to the target hash algorithm.
It should be noted that steps 211 to 212 are processes of implementing selection of a hash algorithm and determining a plurality of storage devices for respectively storing live video segments according to the hash algorithm, and besides the manners described in the above steps, the processes may be implemented in other manners, and a specific manner is not limited in the embodiment of the present invention.
213. The method comprises the steps of segmenting a live video clip, generating a plurality of live video sub-clips, and respectively sending the plurality of live video sub-clips and background images to a plurality of corresponding storage devices for storage.
Specifically, the embodiment of the present invention does not limit the specific dividing manner.
EXAMPLE III
An embodiment of the present invention provides a PC-oriented live data processing apparatus 2, and as shown in fig. 2, the apparatus 2 includes:
the identification module 21 is configured to identify a target selected by a user from a live video played by a PC;
the processing module 22 is configured to track a target in a live video and generate a part of live video including the target;
the segmentation module 23 is configured to segment a part of the live video into a plurality of live video segments according to a background image of the target;
an obtaining module 24, configured to obtain a plurality of available storage devices from all storage devices in the private network according to the operation behavior;
the processing module 22 is further configured to select a hash algorithm, and determine, according to the hash algorithm, a plurality of storage devices for respectively storing the live video segments;
the segmentation module 23 is further configured to segment the live video segment to generate a plurality of live video sub-segments, and send the plurality of live video sub-segments and the background image to the corresponding plurality of storage devices respectively for storage.
Optionally, the identification module 21 is specifically configured to:
acquiring and identifying a target selected by a user through a gesture on a live video interface of a PC (personal computer) end; or
And acquiring a target selected by a user through inputting a picture at a PC (personal computer) end, wherein the picture at least comprises the target.
Optionally, the processing module 22 is specifically configured to:
identifying targets in all video frames in a live video, and extracting a plurality of video frames containing the targets;
and generating a part of live video containing the target according to the plurality of video frames.
Optionally, the processing module 22 is further specifically configured to:
identifying targets in all video frames in a live video, and acquiring motion parameters of the targets according to vectors of pixel points of the targets;
extracting a plurality of video frames containing the target, and generating a part of live video containing the target according to the plurality of video frames, wherein the part of live video also comprises motion parameters.
Optionally, the segmentation module 23 is specifically configured to:
respectively acquiring the similarity between background images of all video frames in part of live video;
and extracting and generating a plurality of video frames with the similarity meeting the requirement of being larger than a preset value into the same live video clip.
Optionally, the obtaining module 24 is specifically configured to:
and acquiring the storage space and the online time from all the storage devices, wherein the storage space and the online time are respectively larger than the corresponding preset threshold values, and the operation behavior is a plurality of available storage devices for data storage.
Optionally, the processing module 22 is further specifically configured to:
randomly selecting a target hash algorithm from a plurality of hash algorithms according to a preset time interval;
and performing hash processing on the identification of the storage equipment according to a target hash algorithm, and determining a plurality of storage equipment for respectively storing the live video clips.
Example four
An embodiment of the present invention provides a PC-end-oriented live data processing system, and as shown in fig. 3, the system includes:
the recognition device 31 is used for recognizing the target selected by the user from the live video played by the PC terminal;
the processing device 32 is used for tracking a target in the live video and generating a part of live video containing the target;
a dividing device 33, configured to divide a part of the live video into a plurality of live video segments according to the background image of the target;
an obtaining means 34, configured to obtain a plurality of available storage devices from all storage devices in the private network according to the operation behavior;
the processing device 32 is further configured to select a hash algorithm, and determine, according to the hash algorithm, a plurality of storage devices for respectively storing the live video segments;
the dividing device 33 is further configured to divide the live video segment, generate a plurality of live video sub-segments, and send the plurality of live video sub-segments and the background image to the corresponding plurality of storage devices respectively for storage.
Optionally, the identification device 31 is specifically configured to:
acquiring and identifying a target selected by a user through a gesture on a live video interface of a PC (personal computer) end; or
And acquiring a target selected by a user through inputting a picture at a PC (personal computer) end, wherein the picture at least comprises the target.
Optionally, the processing device 32 is specifically configured to:
identifying targets in all video frames in a live video, and extracting a plurality of video frames containing the targets;
and generating a part of live video containing the target according to the plurality of video frames.
Optionally, the processing device 32 is further specifically configured to:
identifying targets in all video frames in a live video, and acquiring motion parameters of the targets according to vectors of pixel points of the targets;
extracting a plurality of video frames containing the target, and generating a part of live video containing the target according to the plurality of video frames, wherein the part of live video also comprises motion parameters.
Optionally, the dividing device 33 is specifically configured to:
respectively acquiring the similarity between background images of all video frames in part of live video;
and extracting and generating a plurality of video frames with the similarity meeting the requirement of being larger than a preset value into the same live video clip.
Optionally, the obtaining device 34 is specifically configured to:
and acquiring the storage space and the online time from all the storage devices, wherein the storage space and the online time are respectively larger than the corresponding preset threshold values, and the operation behavior is a plurality of available storage devices for data storage.
Optionally, the processing device 32 is further specifically configured to:
randomly selecting a target hash algorithm from a plurality of hash algorithms according to a preset time interval;
and performing hash processing on the identification of the storage equipment according to a target hash algorithm, and determining a plurality of storage equipment for respectively storing the live video clips.
EXAMPLE five
The embodiment of the invention provides a PC-side-oriented live data processing device, which comprises a processor and a memory connected with the processor, wherein the memory is used for storing a group of program codes, and the processor calls the program codes stored in the memory to realize the method in the first embodiment and/or the second embodiment.
The embodiment of the invention provides a PC-side-oriented live broadcast data processing method, a PC-side-oriented live broadcast data processing device and a PC-side-oriented live broadcast data processing system, wherein a plurality of storage devices for respectively storing live broadcast video clips are determined by selecting a hash algorithm and according to the hash algorithm; the live video clips are divided to generate a plurality of live video sub-clips, the live video sub-clips and the background images are respectively sent to the corresponding storage devices to be stored, distributed storage of the video images is achieved, malicious tampering and malicious downloading of the video files after being maliciously accessed are avoided, risks of exposure of user privacy data are reduced, and safety is improved. Tracking a target in a live video to generate a part of live video containing the target; and the video image containing the target is stored, so that the later image video processing based on the target is facilitated for the user, and the user experience is further improved. The target selected by the user is identified from the live video, so that the personalized demand of the user is realized, and the user experience is further improved. By dividing part of live video into a plurality of live video segments according to the background image of the target, the user can store, search and process the image data according to the background image, thereby further facilitating the image video processing based on the target in the later period of the user and further improving the user experience.
All the above-mentioned optional technical solutions can be combined arbitrarily to form the optional embodiments of the present invention, and are not described herein again.
It should be noted that: in the above-mentioned embodiment, when the PC-oriented live data processing apparatus and system are used to execute the PC-oriented live data processing method, only the division of the above-mentioned functional modules is taken as an example, and in practical applications, the above-mentioned function distribution can be completed by different functional modules according to needs, that is, the internal structures of the apparatus and system are divided into different functional modules, so as to complete all or part of the above-mentioned functions. In addition, the embodiments of the PC-oriented live data processing method, device, and system provided in the foregoing embodiments belong to the same concept, and specific implementation processes thereof are described in detail in the method embodiments and are not described herein again.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (10)
1. A PC-side-oriented live broadcast data processing method is characterized by comprising the following steps:
identifying a target selected by a user from a live video played by a PC (personal computer) end;
tracking a target in the live video to generate a part of live video containing the target;
according to the background image of the target, dividing the partial live video into a plurality of live video segments;
for any one of the live video clips, performing the following operations:
acquiring a plurality of available storage devices from all storage devices in the private network according to the operation behavior;
selecting a hash algorithm, and determining a plurality of storage devices for respectively storing the live video clips according to the hash algorithm;
the live video clips are segmented to generate a plurality of live video sub-clips, and the live video sub-clips and the background images are respectively sent to a plurality of corresponding storage devices to be stored;
the method for identifying the target selected by the user from the live video played by the PC end comprises the following steps:
acquiring and identifying a target selected by a user through a gesture on a live video interface of a PC (personal computer) end; or
And acquiring a target selected by a user through inputting a picture at a PC (personal computer) end, wherein the picture at least comprises the target.
2. The method of claim 1, wherein tracking a target in the live video and generating a portion of the live video containing the target comprises:
identifying targets in all video frames in the live video, and extracting a plurality of video frames containing the targets;
and generating a part of live video containing the target according to the plurality of video frames.
3. The method of claim 2, wherein tracking a target in the live video, generating a portion of live video that includes the target further comprises:
identifying targets in all video frames in the live video, and acquiring motion parameters of the targets according to vectors of pixel points of the targets;
extracting a plurality of video frames containing the target, and generating a part of live video containing the target according to the plurality of video frames, wherein the part of live video also comprises the motion parameters.
4. The method of claim 3, wherein the segmenting the portion of the live video into a plurality of live video segments according to the background image of the target comprises:
respectively acquiring the similarity between background images of all video frames in the partial live video;
and extracting and generating a plurality of video frames with the similarity meeting the requirement of being larger than a preset value into the same live video clip.
5. The method of claim 4, wherein obtaining the plurality of available storage devices from all storage devices within the private network comprises:
acquiring the operation behaviors, the storage space and the online time of all the storage devices;
and acquiring the storage space and the online time from all the storage devices, wherein the storage space and the online time are respectively larger than corresponding preset thresholds, and the operation behavior is a plurality of available storage devices for data storage.
6. The method of claim 5, wherein selecting a hash algorithm and determining a plurality of storage devices for respectively storing the live video segments according to the hash algorithm comprises:
randomly selecting a target hash algorithm from a plurality of hash algorithms according to a preset time interval;
and carrying out hash processing on the identification of the storage equipment according to the target hash algorithm, and determining a plurality of storage equipment for respectively storing the live video segments.
7. A PC-side-oriented live data processing device is characterized by comprising:
the identification module is used for identifying a target selected by a user from a live video played by a PC (personal computer) end;
the processing module is used for tracking a target in the live video and generating a part of live video containing the target;
the segmentation module is used for segmenting the part of live video into a plurality of live video segments according to the background image of the target;
the acquisition module is used for acquiring a plurality of available storage devices from all the storage devices in the private network according to the operation behavior;
the processing module is further used for selecting a hash algorithm and determining a plurality of storage devices for respectively storing the live video segments according to the hash algorithm;
the segmentation module is further configured to segment the live video segments to generate a plurality of live video sub-segments, and send the plurality of live video sub-segments and the background image to a plurality of corresponding storage devices for storage;
wherein the identification module is configured to perform any one of the following operations:
acquiring and identifying a target selected by a user through a gesture on a live video interface of a PC (personal computer) end; or
And acquiring a target selected by a user through inputting a picture at a PC (personal computer) end, wherein the picture at least comprises the target.
8. The apparatus of claim 7, wherein the processing module is specifically configured to:
identifying targets in all video frames in the live video, and extracting a plurality of video frames containing the targets;
and generating a part of live video containing the target according to the plurality of video frames.
9. A PC-side-oriented live broadcast data processing system is characterized by comprising:
the identification device is used for identifying a target selected by a user from a live video played by a PC (personal computer) end;
the processing device is used for tracking a target in the live video and generating a part of live video containing the target;
the segmentation device is used for segmenting the part of live video into a plurality of live video segments according to the background image of the target;
the acquisition device is used for acquiring a plurality of available storage devices from all the storage devices in the private network according to the operation behavior;
the processing device is further used for selecting a hash algorithm and determining a plurality of storage devices for respectively storing the live video segments according to the hash algorithm;
the segmentation device is further used for segmenting the live video clips to generate a plurality of live video sub-clips, and respectively sending the live video sub-clips and the background images to a plurality of corresponding storage devices for storage;
wherein the identification means is configured to perform any one of the following operations:
acquiring and identifying a target selected by a user through a gesture on a live video interface of a PC (personal computer) end; or
And acquiring a target selected by a user through inputting a picture at a PC (personal computer) end, wherein the picture at least comprises the target.
10. A PC-oriented live data processing apparatus, comprising a processor and a memory connected to the processor, wherein the memory is configured to store a set of program codes, and the processor calls the program codes stored in the memory to implement the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110375675.4A CN112804556B (en) | 2021-04-08 | 2021-04-08 | PC-end-oriented live broadcast data processing method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110375675.4A CN112804556B (en) | 2021-04-08 | 2021-04-08 | PC-end-oriented live broadcast data processing method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112804556A true CN112804556A (en) | 2021-05-14 |
| CN112804556B CN112804556B (en) | 2021-06-22 |
Family
ID=75816519
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110375675.4A Active CN112804556B (en) | 2021-04-08 | 2021-04-08 | PC-end-oriented live broadcast data processing method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112804556B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040261027A1 (en) * | 2003-06-09 | 2004-12-23 | Dillon Patrick Morton | Methods and apparatuses for streamlining the digital publishing of filmed video programs |
| CN101321097A (en) * | 2008-05-27 | 2008-12-10 | 南京邮电大学 | Tencent network living broadcast business recognition method based on payload depth detection |
| US20140108586A1 (en) * | 2011-11-29 | 2014-04-17 | Huawei Technologies Co., Ltd. | Method, device and system for delivering live content |
| WO2015130925A1 (en) * | 2014-02-26 | 2015-09-03 | Arris Enterprises, Inc. | Copy count for dtcp with an abbreviation hash used for check in copy |
| EP3312714A1 (en) * | 2016-10-24 | 2018-04-25 | Datrium, Inc. | Distributed data parallel method for reclaiming space |
| CN109862388A (en) * | 2019-04-02 | 2019-06-07 | 网宿科技股份有限公司 | Generation method, device, server and the storage medium of the live video collection of choice specimens |
| CN109889860A (en) * | 2019-03-12 | 2019-06-14 | 山东云缦智能科技有限公司 | A kind of live video file demolition method, apparatus and system |
| CN111064970A (en) * | 2018-10-17 | 2020-04-24 | 武汉斗鱼网络科技有限公司 | Video resource management method, live broadcast server and storage medium |
| US10649682B1 (en) * | 2017-10-06 | 2020-05-12 | EMC IP Holding Company LLC | Focused sanitization process for deduplicated storage systems |
-
2021
- 2021-04-08 CN CN202110375675.4A patent/CN112804556B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040261027A1 (en) * | 2003-06-09 | 2004-12-23 | Dillon Patrick Morton | Methods and apparatuses for streamlining the digital publishing of filmed video programs |
| CN101321097A (en) * | 2008-05-27 | 2008-12-10 | 南京邮电大学 | Tencent network living broadcast business recognition method based on payload depth detection |
| US20140108586A1 (en) * | 2011-11-29 | 2014-04-17 | Huawei Technologies Co., Ltd. | Method, device and system for delivering live content |
| WO2015130925A1 (en) * | 2014-02-26 | 2015-09-03 | Arris Enterprises, Inc. | Copy count for dtcp with an abbreviation hash used for check in copy |
| EP3312714A1 (en) * | 2016-10-24 | 2018-04-25 | Datrium, Inc. | Distributed data parallel method for reclaiming space |
| US10649682B1 (en) * | 2017-10-06 | 2020-05-12 | EMC IP Holding Company LLC | Focused sanitization process for deduplicated storage systems |
| CN111064970A (en) * | 2018-10-17 | 2020-04-24 | 武汉斗鱼网络科技有限公司 | Video resource management method, live broadcast server and storage medium |
| CN109889860A (en) * | 2019-03-12 | 2019-06-14 | 山东云缦智能科技有限公司 | A kind of live video file demolition method, apparatus and system |
| CN109862388A (en) * | 2019-04-02 | 2019-06-07 | 网宿科技股份有限公司 | Generation method, device, server and the storage medium of the live video collection of choice specimens |
Non-Patent Citations (2)
| Title |
|---|
| PING JIANG: "An Intelligent Information Forwarder for Healthcare Big Data Systems With Distributed Wearable Sensors", 《IEEE SYSTEMS JOURNAL 》 * |
| 郑璐: "基于行为分析的P2P流媒体业务识别方法研究与实现", 《中国优秀硕士学位论文全文数据库》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112804556B (en) | 2021-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108353208B (en) | Optimizing media fingerprint retention to improve system resource utilization | |
| CN109710780B (en) | Archiving method and device | |
| US10643667B2 (en) | Bounding box doubling as redaction boundary | |
| CN110853033B (en) | Video detection method and device based on inter-frame similarity | |
| CN110675433A (en) | Video processing method and device, electronic equipment and storage medium | |
| US20220172476A1 (en) | Video similarity detection method, apparatus, and device | |
| US20050069291A1 (en) | Systems and methods for locating a video file | |
| CN111667275A (en) | User identity identification method, device, equipment and medium thereof | |
| CN113139527B (en) | Video privacy protection method, device, equipment and storage medium | |
| CN112804556B (en) | PC-end-oriented live broadcast data processing method, device and system | |
| CN113297499A (en) | Information recommendation system, method, computer equipment and storage medium | |
| CN112672102B (en) | Video generation method and device | |
| CN113689585B (en) | Non-inductive attendance card punching method, system and related equipment | |
| CN115695988A (en) | Intelligent equipment true random key generation method, device, terminal and medium | |
| CN111898529B (en) | Face detection method and device, electronic equipment and computer readable medium | |
| CN106651751B (en) | Image processing method and terminal | |
| CN115391596A (en) | Video archive generation method and device and storage medium | |
| CN113782027A (en) | Audio processing method and audio processing device | |
| JP2022112831A (en) | Face tracking apparatus and program | |
| CN112308031A (en) | Universal face recognition and face feature information base generation method, device and equipment | |
| CN112380938A (en) | Face recognition and temperature measurement method, device, equipment and medium | |
| CN114743254B (en) | Face authentication method and device, terminal equipment and storage medium | |
| CN111325656B (en) | Image processing method, image processing device and terminal equipment | |
| JP2018137639A (en) | Moving image processing system, encoder and program, decoder and program | |
| Sudo et al. | Estimating anomality of the video sequences for surveillance using 1-class SVM |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |