CN104980750A - Collection method, device and system for video transcoding logs - Google Patents
Collection method, device and system for video transcoding logs Download PDFInfo
- Publication number
- CN104980750A CN104980750A CN201510372410.3A CN201510372410A CN104980750A CN 104980750 A CN104980750 A CN 104980750A CN 201510372410 A CN201510372410 A CN 201510372410A CN 104980750 A CN104980750 A CN 104980750A
- Authority
- CN
- China
- Prior art keywords
- code conversion
- video code
- daily record
- transcoding
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention discloses a collection method, device and system of video transcoding logs. The collection method of the video transcoding logs includes the following steps that: video transcoding logs generated by a transcoding server are put into a local cache; whether the transcoding server performs video transcoding is monitored; if the transcoding server performs video transcoding, partial video transcoding logs satisfying preset conditions are acquired from the video transcoding logs in the local cache, and the acquired partial video transcoding logs are transmitted to a central memory; and if the transcoding server does not perform video transcoding, the video transcoding logs in the local cache are transmitted to the central memory. In the above process, when the transcoding server performs video transcoding, only a part of the video transcoding logs satisfying the preset conditions are transmitted to the central memory, and therefore, compared with the prior art, computing resources occupied by video transcoding log transmission in a video transcoding process can be decreased, and the video transcoding efficiency of the transcoding server can be improved.
Description
Technical field
The present invention relates to Video Transcoding Technology field, particularly relate to a kind of collection method, Apparatus and system of video code conversion daily record.
Background technology
Along with the development of the Internet science and technology, increasing people is by the various video of internet viewing.In the process that internet video is produced, need to carry out video code conversion by transcoding server, a large amount of video code conversion daily records can be produced simultaneously.This video code conversion daily record has important effect, such as: 1. by analyzing the video code conversion daily record of anomalous video, can draw error reason, be conducive to reparation problem; 2. by analyzing the video code conversion daily record of normal video, the consuming time of each step in video code conversion process can be obtained, find the bottleneck that video code conversion is served, to optimize further; 3. can be found the mistake in video production process by the daily record of analysis video code conversion in time, and send early warning information to reduce loss etc.Therefore, the collection of video code conversion daily record has great importance.
At present, video code conversion daily record of the prior art is by gathering system real-time collecting, and as shown in Figure 1, in prior art, the gathering system of video code conversion daily record comprises: multiple transcoding server 101, central memory 102 and log processing cluster 103.Wherein, transcoding server 101 is while carrying out video code conversion, constantly by produce video code conversion Log Sender in central memory 102, with facilitate in log processing cluster 103 pairs of central memory 102 store video code conversion daily record calculate and statistical disposition.
The process of carrying out video code conversion and the daily record of transmission video code conversion due to prior art transit code server is synchronously carried out, and the process of the process of video code conversion and the daily record of transmission video code conversion all needs to take computational resources a large amount of in transcoding server, the deficiency of computational resource when causing carrying out video code conversion, this carries out the efficiency of video code conversion by having influence on transcoding server.
Summary of the invention
The object of the embodiment of the present invention is the collection method, the Apparatus and system that provide a kind of video code conversion daily record, to reduce in video code conversion process, sends the computational resource shared by video code conversion daily record.
For achieving the above object, the embodiment of the invention discloses a kind of collection method of video code conversion daily record, being applied in transcoding server, comprising step:
Local cache is put in the video code conversion daily record that transcoding server produces;
Whether monitoring transcoding server is carrying out video code conversion;
When monitoring transcoding server when carrying out video code conversion, carry out following steps:
From in the video code conversion daily record local cache, obtain and meet pre-conditioned partial video transcoding daily record;
By the partial video transcoding Log Sender of acquisition in central memory;
When monitoring transcoding server not when carrying out video code conversion, carry out following steps:
By the video code conversion Log Sender in local cache in central memory.
Wherein, described from the video code conversion daily record local cache, obtain the step meeting pre-conditioned partial video transcoding daily record, can comprise:
Video code conversion daily record in local cache is divided into different classifications;
Obtain the video code conversion daily record of pre-set categories;
The described partial video transcoding Log Sender by acquisition comprises to the step in central memory:
By the video code conversion Log Sender of the pre-set categories of acquisition in central memory.
Described by obtain partial video transcoding Log Sender to the step in central memory, can comprise:
Extract the First Eigenvalue of described partial video transcoding daily record;
Described the First Eigenvalue is carried out statistical computation, obtains the first statistics;
Described first statistics is carried out compression process, obtain the first result;
First result is sent in central memory.
Described by the video code conversion Log Sender in local cache to the step in central memory, can comprise:
Extract the Second Eigenvalue of the video code conversion daily record in local cache;
Statistical computation is carried out to described Second Eigenvalue, obtains the second statistics;
Described second statistics is carried out compression process, obtain the second result;
By the video code conversion Log Sender in the second result and local cache in central memory.
Described by the video code conversion Log Sender in the second result and local cache to the step in central memory, can comprise:
Video code conversion daily record in local cache is carried out compression process;
By the video code conversion Log Sender in the local cache after the second result and compression process in central memory.
Described central memory can comprise multiple storage server, according to preset rules, by the video code conversion Log Sender in the partial video transcoding daily record of acquisition and local cache in identical or different storage server.
After local cache is put in the video code conversion daily record produced by transcoding server, can also comprise:
According to the content of the video code conversion daily record produced, whether the operation of monitor video transcoding is normal;
When video code conversion operation exception, export early warning signal.
The embodiment of the invention also discloses a kind of gathering-device of video code conversion daily record, be applied in transcoding server, comprise:
Video code conversion log buffer unit: local cache is put in the video code conversion daily record for being produced by transcoding server;
Monitoring unit: whether carrying out video code conversion for monitoring transcoding server; If so, the daily record of triggering part video code conversion obtains unit and partial video transcoding Log Sender unit; Otherwise, triggering video transcoding Log Sender unit;
The daily record of partial video transcoding obtains unit: for from the video code conversion daily record in local cache, obtain and meet pre-conditioned partial video transcoding daily record;
Partial video transcoding Log Sender unit: for will obtain partial video transcoding Log Sender to central memory;
Video code conversion Log Sender unit: for by the video code conversion Log Sender in local cache to central memory.
Wherein, described partial video transcoding daily record acquisition unit can comprise:
Category division subelement: for the video code conversion daily record in local cache is divided into different classifications;
The daily record of partial video transcoding obtains subelement: for obtaining the video code conversion daily record of pre-set categories;
Described partial video transcoding Log Sender unit comprises:
Partial video transcoding Log Sender subelement: for the video code conversion Log Sender of pre-set categories that will obtain to central memory.
Described partial video transcoding Log Sender unit can comprise:
The First Eigenvalue extracts subelement: for extracting the First Eigenvalue of described partial video transcoding daily record;
First statistics obtains subelement: for described the First Eigenvalue is carried out statistical computation, obtain the first statistics;
First result obtains subelement: for described first statistics being carried out compression process, obtain the first result;
First sends subelement: for the first result is sent to central memory.
Described video code conversion Log Sender unit can comprise:
Second Eigenvalue extracts subelement: for extracting the Second Eigenvalue of the video code conversion daily record in local cache;
Second statistics obtains subelement: for carrying out statistical computation to described Second Eigenvalue, obtain the second statistics;
Second result obtains subelement: for described second statistics being carried out compression process, obtain the second result;
Second send subelement: for by the video code conversion Log Sender in the second result and local cache to central memory.
Described second sends subelement can comprise:
Compression subelement: for the video code conversion daily record in local cache being carried out compression process;
Send subelement: the video code conversion Log Sender in the local cache after the second result and compression being processed is to central memory.
Described device can also comprise:
Prewarning unit: for the content according to the video code conversion daily record produced, whether the operation of monitor video transcoding is normal; When video code conversion operation exception, export early warning signal.
The embodiment of the invention also discloses a kind of gathering system of video code conversion daily record, comprise multiple transcoding server and central memory;
Wherein, each transcoding server, preliminary treatment is carried out in the video code conversion daily record of putting into local cache for self being produced: when monitoring this transcoding server when carrying out video code conversion, from in the video code conversion daily record described local cache, obtain and meet pre-conditioned partial video transcoding daily record; By the partial video transcoding Log Sender of acquisition in central memory; When monitoring transcoding server not when carrying out video code conversion, by the video code conversion Log Sender in described local cache in central memory;
The video code conversion daily record that central memory sends for storing each transcoding server.
Wherein, described central memory can provide user's query interface, inquires about the video code conversion daily record stored in central memory for user.
Described central memory can comprise multiple storage server, each transcoding server according to preset rules, by obtain the daily record of partial video transcoding and local cache in video code conversion Log Sender in identical or different storage server.
The technical scheme that the embodiment of the present invention provides, puts into local cache by the video code conversion daily record that transcoding server produces.Whether monitoring transcoding server is carrying out video code conversion.If so, carry out following steps: from the video code conversion daily record local cache, obtain and meet pre-conditioned partial video transcoding daily record; By the partial video transcoding Log Sender of acquisition in central memory.Otherwise, carry out following steps: by the video code conversion Log Sender in local cache in central memory.Due in above process, when transcoding server carries out video code conversion, only will meet pre-conditioned partial video transcoding Log Sender in central memory, when transcoding server does not carry out video code conversion just by the video code conversion Log Sender in local cache in central memory.So technical scheme of the present invention compared with prior art decreases the computational resource sent in video code conversion process shared by video code conversion daily record, further, improve the efficiency that transcoding server carries out video code conversion.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the structural representation of the gathering system of existing a kind of video code conversion daily record;
Fig. 2 is the implementing procedure figure of the collection method of a kind of video code conversion daily record of the embodiment of the present invention;
Fig. 3 is the structural representation of the gathering-device of a kind of video code conversion daily record of the embodiment of the present invention;
Fig. 4 is the structural representation of the gathering system of a kind of video code conversion daily record of the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
As shown in Figure 2, the collection method of a kind of video code conversion daily record that the embodiment of the present invention provides, the method can comprise:
Step S201, puts into local cache by the video code conversion daily record that transcoding server produces;
Specific description is once done to the implementation process of technical scheme of the present invention below.First, transcoding server will produce a large amount of video code conversion daily records in the process of carrying out video code conversion, and local cache is put in the video code conversion daily record that transcoding server produces.Wherein, the method that local cache is put in the video code conversion daily record that transcoding server produces is belonged to prior art, repeats no more here.
Step S202, whether monitoring transcoding server is carrying out video code conversion; When monitoring transcoding server when carrying out video code conversion, then perform step S203 and step S204, otherwise perform step S205.
Step S203, from the video code conversion daily record local cache, obtains and meets pre-conditioned partial video transcoding daily record;
Step S204, by the partial video transcoding Log Sender of acquisition in central memory;
First, obtain from the video code conversion daily record local cache and meet pre-conditioned partial video transcoding daily record.Further, by the partial video transcoding Log Sender of acquisition in central memory, be stored in central memory to make the part transcoding daily record of above-mentioned acquisition.Wherein, meeting pre-conditioned partial video transcoding daily record in step S203 can be abnormal video code conversion daily record, also can be key sentence in video code conversion daily record etc.
In a kind of embodiment of the present invention, step S203 can comprise:
Video code conversion daily record in local cache is divided into different classifications;
Obtain the video code conversion daily record of pre-set categories.
Correspondingly, step S204 can comprise:
By the video code conversion Log Sender of the pre-set categories of acquisition in central memory.
Wherein, when dividing classification to the video code conversion daily record in local cache, multiple dividing mode can be had.Such as, the video code conversion daily record in local cache can be divided into video daily record, audio frequency daily record etc. classification; Also the video code conversion daily record in local cache can be divided into normal video code conversion daily record and abnormal video code conversion daily record, the statement of the video code conversion daily record in local cache can also be divided into key sentence and non-key statement.
After the video code conversion daily record division classification in local cache terminates, further, obtain the video code conversion daily record of pre-set categories, and by the video code conversion Log Sender of this pre-set categories in central memory.Such as when the video code conversion daily record in local cache is divided into video daily record and audio frequency daily record, in this step, can only select video Log Sender to central memory; Or the video code conversion daily record in local cache is when being divided into normal daily record and abnormal log, in this step, only abnormal log can be sent to central memory.
In another kind of embodiment of the present invention, step S204 can comprise:
Extract the First Eigenvalue of described partial video transcoding daily record;
Described the First Eigenvalue is carried out statistical computation, obtains the first statistics;
Described first statistics is carried out compression process, obtain the first result;
First result is sent in central memory.
Wherein, in concrete enforcement, above-mentioned the First Eigenvalue can be specifically the centre word of partial video transcoding daily record, also can be the information such as the success rate of video code conversion.
Step S205, by the video code conversion Log Sender in local cache in central memory.
In the process that the present invention specifically implements, step S105 can comprise:
Extract the Second Eigenvalue of the video code conversion daily record in local cache;
Statistical computation is carried out to described Second Eigenvalue, obtains the second statistics;
Described second statistics is carried out compression process, obtain the second result;
By the video code conversion Log Sender in the second result and local cache in central memory.
Wherein, in concrete enforcement, above-mentioned Second Eigenvalue can be the centre word of the video code conversion daily record in local cache, also can be the information consuming time of each step of video code conversion, certainly, can also be the information such as the success rate of video code conversion.
It should be noted that, in the present invention specifically implements, also can not carry out compression process to the first statistics and/or the second statistics, directly the first statistics and/or the second statistics are sent in central memory.In addition, the First Eigenvalue in the present invention and Second Eigenvalue can be the important statements of corresponding video code conversion daily record, also can be the centre word of corresponding video code conversion daily record, can also be video code conversion daily record of each step situation consuming time in reflecting video transcoding process etc.
In a kind of embodiment of the present invention, described video code conversion Log Sender in second result and local cache can be comprised to the step in central memory:
Video code conversion daily record in local cache is carried out compression process;
By the video code conversion Log Sender in the local cache after the second result and compression process in central memory.
In fact, in prior art, by log processing cluster 103, characteristics extraction and statistics and compression are carried out to the video code conversion daily record being stored into central memory 102 and process.And in the embodiment of the present invention, by transcoding server at one's leisure, above-mentioned process can be carried out to the video code conversion daily record in local cache.Thus, improve the resource utilization of transcoding server.Wherein, above-mentioned the First Eigenvalue and Second Eigenvalue to be extracted, to add up and to the first statistics, second statistics and the video code conversion daily record in local cache carry out compressing the process processed can be identical with the processing procedure of prior art log processing cluster 103, repeats no more here.
In addition, in the process that the present invention specifically implements, the central memory mentioned in above-mentioned steps can comprise multiple storage server, according to preset rules, by the video code conversion Log Sender in the partial video transcoding daily record of acquisition and local cache in identical or different storage server.Wherein, preset rules can be made an appointment, and such as, can make an appointment and the first result to be put in a storage server, and the video code conversion daily record in the second result and local cache be put in another storage server.
Need to further illustrate: in said process, achieve the calculating to the video code conversion daily record in the partial video transcoding daily record obtained in step S203 and local cache and process, this is compared with the gathering system (shown in Figure 1) of video code conversion daily record of the prior art, take full advantage of the computational resource of transcoding server, computational resource when particularly transcoding server is idle, and without the need to purchasing special log processing cluster.
In a kind of embodiment of the present invention, after local cache is put in the video code conversion daily record produced by transcoding server, can also comprise:
According to the content of the video code conversion daily record produced, whether the operation of monitor video transcoding is normal;
When video code conversion operation exception, export early warning signal.
Due in said process when analyzing video code conversion operation exception, output early warning signal in time.Such as, find the consuming time beyond when expecting of a certain step of video code conversion process, export early warning signal; Or when finding that the error rate of the video code conversion daily record that transcoding server produces exceeds designated value, export early warning signal etc.This is conducive to reminding staff to deal with to abnormal conditions in time, reduces the loss.
The technical scheme that the embodiment of the present invention provides, puts into local cache by the video code conversion daily record that transcoding server produces.Whether monitoring transcoding server is carrying out video code conversion.If so, carry out following steps: from the video code conversion daily record local cache, obtain and meet pre-conditioned partial video transcoding daily record; By the partial video transcoding Log Sender of acquisition in central memory.Otherwise, carry out following steps: by the video code conversion Log Sender in local cache in central memory.Due in above process, when transcoding server carries out video code conversion, only will meet pre-conditioned partial video transcoding Log Sender in central memory, when transcoding server does not carry out video code conversion just by the video code conversion Log Sender in local cache in central memory.So technical scheme of the present invention compared with prior art decreases the computational resource sent in video code conversion process shared by video code conversion daily record, further, improve the efficiency that transcoding server carries out video code conversion.
Relative to embodiment of the method above, the present invention also provides a kind of gathering-device of video code conversion daily record, shown in Figure 3, and this device can comprise:
Video code conversion log buffer unit 301: local cache is put in the video code conversion daily record for being produced by transcoding server;
Monitoring unit 302: whether carrying out video code conversion for monitoring transcoding server; If so, the daily record of triggering part video code conversion obtains unit and partial video transcoding Log Sender unit; Otherwise, triggering video transcoding Log Sender unit;
The daily record of partial video transcoding obtains unit 303: for from the video code conversion daily record in local cache, obtain and meet pre-conditioned partial video transcoding daily record;
Partial video transcoding Log Sender unit 304: for will obtain partial video transcoding Log Sender to central memory;
Video code conversion Log Sender unit 305: for by the video code conversion Log Sender in local cache to central memory.
Wherein, the gathering-device of above-mentioned video code conversion daily record, can be operate in certain software with log collection function on transcoding server and/or hardware, such as, can be log collector.
In a kind of embodiment of the present invention,
Described partial video transcoding daily record obtains unit 303 and can comprise:
Category division subelement: for the video code conversion daily record in local cache is divided into different classifications;
The daily record of partial video transcoding obtains subelement: for obtaining the video code conversion daily record of pre-set categories;
Described partial video transcoding Log Sender unit 304 can comprise:
Partial video transcoding Log Sender subelement: for the video code conversion Log Sender of pre-set categories that will obtain to central memory.
In a kind of embodiment of the present invention, described partial video transcoding Log Sender unit 304 can comprise:
The First Eigenvalue extracts subelement: for extracting the First Eigenvalue of described partial video transcoding daily record;
First statistics obtains subelement: for described the First Eigenvalue is carried out statistical computation, obtain the first statistics;
First result obtains subelement: for described first statistics being carried out compression process, obtain the first result;
First sends subelement: for the first result is sent to central memory.
In a kind of embodiment of the present invention, described video code conversion Log Sender unit 305 can comprise:
Second Eigenvalue extracts subelement: for extracting the Second Eigenvalue of the video code conversion daily record in local cache;
Second statistics obtains subelement: for carrying out statistical computation to described Second Eigenvalue, obtain the second statistics;
Second result obtains subelement: for described second statistics being carried out compression process, obtain the second result;
Second send subelement: for by the video code conversion Log Sender in the second result and local cache to central memory.
In a kind of embodiment of the present invention, described second sends subelement can comprise:
Compression subelement: for the video code conversion daily record in local cache being carried out compression process;
Send subelement: the video code conversion Log Sender in the local cache after the second result and compression being processed is to central memory.
In a kind of embodiment of the present invention, the gathering-device of the video code conversion daily record in above-described embodiment, can also comprise:
Prewarning unit: for the content according to the video code conversion daily record produced, whether the operation of monitor video transcoding is normal; When video code conversion operation exception, export early warning signal.
The technical scheme that the embodiment of the present invention provides, puts into local cache by the video code conversion daily record that transcoding server produces.Whether monitoring transcoding server is carrying out video code conversion.If so, carry out following steps: from the video code conversion daily record local cache, obtain and meet pre-conditioned partial video transcoding daily record; By the partial video transcoding Log Sender of acquisition in central memory.Otherwise, carry out following steps: by the video code conversion Log Sender in local cache in central memory.Due in above process, when transcoding server carries out video code conversion, only will meet pre-conditioned partial video transcoding Log Sender in central memory, when transcoding server does not carry out video code conversion just by the video code conversion Log Sender in local cache in central memory.So technical scheme of the present invention compared with prior art decreases the computational resource sent in video code conversion process shared by video code conversion daily record, further, improve the efficiency that transcoding server carries out video code conversion.
For convenience of description, various unit is divided into describe respectively with function when describing above device.Certainly, the function of each unit can be realized in same or multiple software and/or hardware when implementing of the present invention.
The embodiment of the present invention also provides a kind of gathering system of video code conversion daily record, shown in Figure 4, and this system can comprise multiple transcoding server 401 and central memory 402;
Wherein, each transcoding server 401, preliminary treatment is carried out in the video code conversion daily record of putting into local cache for self being produced: when monitoring this transcoding server 401 when carrying out video code conversion, from in the video code conversion daily record described local cache, obtain and meet pre-conditioned partial video transcoding daily record; By the partial video transcoding Log Sender of acquisition in central memory 402; When monitoring transcoding server 401 not when carrying out video code conversion, by the video code conversion Log Sender in described local cache in central memory 402;
The video code conversion daily record that central memory 402 sends for storing each transcoding server 401.
In a kind of embodiment of the present invention, described central memory 402 provides user query interface, inquires about the video code conversion daily record stored in central memory 402 for user.
In a kind of embodiment of the present invention, described central memory 402 comprises multiple storage server, each transcoding server according to preset rules, by obtain the daily record of partial video transcoding and local cache in video code conversion Log Sender in identical or different storage server.Wherein, preset rules is herein identical with the preset rules mentioned in embodiment of the method, repeats no more here.Further, be understandable that: in the present invention specifically implements, also can set up rule between transcoding server and central memory.Such as, can be sent in a storage server by the video code conversion in the partial video transcoding daily record of the transcoding server of specifying acquisition and local cache, wherein, the number of the transcoding server of specifying is one or more; Video code conversion in the partial video transcoding daily record obtained by remaining transcoding server and local cache is sent in another storage server.
In the present invention specifically implements, the gathering system of the video code conversion daily record in above-described embodiment can also comprise: log processing cluster, and further process is done in the video code conversion daily record that this log processing cluster is used for central memory 402 stores.Such as, log processing cluster can carry out analysis and calculation to the store video transcoding daily record in central memory 402, and then each step consuming time when showing that transcoding is served, to do further optimization to transcoding service.Wherein, above-mentioned log processing cluster can be positioned in above-mentioned central memory, also can independent of above-mentioned central memory.When log processing cluster is independent of above-mentioned central memory, this log processing cluster is provided with the interface for user's inquiry log Processing Cluster result.
The technical scheme that the embodiment of the present invention provides, puts into local cache by the video code conversion daily record that transcoding server produces.Whether monitoring transcoding server is carrying out video code conversion.If so, carry out following steps: from the video code conversion daily record local cache, obtain and meet pre-conditioned partial video transcoding daily record; By the partial video transcoding Log Sender of acquisition in central memory.Otherwise, carry out following steps: by the video code conversion Log Sender in local cache in central memory.Due in above process, when transcoding server carries out video code conversion, only will meet pre-conditioned partial video transcoding Log Sender in central memory, when transcoding server does not carry out video code conversion just by the video code conversion Log Sender in local cache in central memory.So technical scheme of the present invention compared with prior art decreases the computational resource sent in video code conversion process shared by video code conversion daily record, further, improve the efficiency that transcoding server carries out video code conversion.
As seen through the above description of the embodiments, those skilled in the art can be well understood to the mode that the present invention can add required general hardware platform by software and realizes.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product can be stored in storage medium, as ROM/RAM, magnetic disc, CD etc., comprising some instructions in order to make a computer equipment (can be personal computer, server, or the network equipment etc.) perform the method described in some part of each embodiment of the present invention or embodiment.
It should be noted that, in this article, the such as relational terms of first and second grades and so on is only used for an entity or operation to separate with another entity or operating space, and not necessarily requires or imply the relation that there is any this reality between these entities or operation or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or equipment and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or equipment.
Each embodiment in this specification all adopts relevant mode to describe, between each embodiment identical similar part mutually see, what each embodiment stressed is the difference with other embodiments.Especially, for system embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, relevant part illustrates see the part of embodiment of the method.Apparatus and system embodiment described above is only schematic, the wherein said unit illustrated as separating component or can may not be and physically separates, parts as unit display can be or may not be physical location, namely can be positioned at a place, or also can be distributed in multiple network element.Some or all of module wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.Those of ordinary skill in the art, when not paying creative work, are namely appreciated that and implement.
The foregoing is only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.All any amendments done within the spirit and principles in the present invention, equivalent replacement, improvement etc., be all included in protection scope of the present invention.
Claims (16)
1. a collection method for video code conversion daily record, is characterized in that, is applied in transcoding server, comprises step:
Local cache is put in the video code conversion daily record that transcoding server produces;
Whether monitoring transcoding server is carrying out video code conversion;
When monitoring transcoding server when carrying out video code conversion, carry out following steps:
From in the video code conversion daily record local cache, obtain and meet pre-conditioned partial video transcoding daily record;
By the partial video transcoding Log Sender of acquisition in central memory;
When monitoring transcoding server not when carrying out video code conversion, carry out following steps:
By the video code conversion Log Sender in local cache in central memory.
2. method according to claim 1, is characterized in that,
Described from the video code conversion daily record local cache, obtain the step meeting pre-conditioned partial video transcoding daily record and comprise:
Video code conversion daily record in local cache is divided into different classifications;
Obtain the video code conversion daily record of pre-set categories;
The described partial video transcoding Log Sender by acquisition comprises to the step in central memory:
By the video code conversion Log Sender of the pre-set categories of acquisition in central memory.
3. method according to claim 1, is characterized in that, the described partial video transcoding Log Sender by acquisition comprises to the step in central memory:
Extract the First Eigenvalue of described partial video transcoding daily record;
Described the First Eigenvalue is carried out statistical computation, obtains the first statistics;
Described first statistics is carried out compression process, obtain the first result;
First result is sent in central memory.
4. method according to claim 3, is characterized in that, is describedly comprised to the step in central memory by video code conversion Log Sender in local cache:
Extract the Second Eigenvalue of the video code conversion daily record in local cache;
Statistical computation is carried out to described Second Eigenvalue, obtains the second statistics;
Described second statistics is carried out compression process, obtain the second result;
By the video code conversion Log Sender in the second result and local cache in central memory.
5. method according to claim 4, is characterized in that, is describedly comprised to the step in central memory by video code conversion Log Sender in the second result and local cache:
Video code conversion daily record in local cache is carried out compression process;
By the video code conversion Log Sender in the local cache after the second result and compression process in central memory.
6. method according to claim 4, it is characterized in that, described central memory comprises multiple storage server, according to preset rules, by the video code conversion Log Sender in the partial video transcoding daily record of acquisition and local cache in identical or different storage server.
7. method according to claim 1, is characterized in that, after local cache is put in the video code conversion daily record produced by transcoding server, also comprises:
According to the content of the video code conversion daily record produced, whether the operation of monitor video transcoding is normal;
When video code conversion operation exception, export early warning signal.
8. a gathering-device for video code conversion daily record, is characterized in that, is applied in transcoding server, comprises:
Video code conversion log buffer unit: local cache is put in the video code conversion daily record for being produced by transcoding server;
Monitoring unit: whether carrying out video code conversion for monitoring transcoding server; If so, the daily record of triggering part video code conversion obtains unit and partial video transcoding Log Sender unit; Otherwise, triggering video transcoding Log Sender unit;
The daily record of partial video transcoding obtains unit: for from the video code conversion daily record in local cache, obtain and meet pre-conditioned partial video transcoding daily record;
Partial video transcoding Log Sender unit: for will obtain partial video transcoding Log Sender to central memory;
Video code conversion Log Sender unit: for by the video code conversion Log Sender in local cache to central memory.
9. device according to claim 8, is characterized in that,
Described partial video transcoding daily record obtains unit and comprises:
Category division subelement: for the video code conversion daily record in local cache is divided into different classifications;
The daily record of partial video transcoding obtains subelement: for obtaining the video code conversion daily record of pre-set categories;
Described partial video transcoding Log Sender unit comprises:
Partial video transcoding Log Sender subelement: for the video code conversion Log Sender of pre-set categories that will obtain to central memory.
10. device according to claim 8, is characterized in that, described partial video transcoding Log Sender unit comprises:
The First Eigenvalue extracts subelement: for extracting the First Eigenvalue of described partial video transcoding daily record;
First statistics obtains subelement: for described the First Eigenvalue is carried out statistical computation, obtain the first statistics;
First result obtains subelement: for described first statistics being carried out compression process, obtain the first result;
First sends subelement: for the first result is sent to central memory.
11. devices according to claim 10, is characterized in that, described video code conversion Log Sender unit comprises:
Second Eigenvalue extracts subelement: for extracting the Second Eigenvalue of the video code conversion daily record in local cache;
Second statistics obtains subelement: for carrying out statistical computation to described Second Eigenvalue, obtain the second statistics;
Second result obtains subelement: for described second statistics being carried out compression process, obtain the second result;
Second send subelement: for by the video code conversion Log Sender in the second result and local cache to central memory.
12. devices according to claim 11, is characterized in that, described second sends subelement comprises:
Compression subelement: for the video code conversion daily record in local cache being carried out compression process;
Send subelement: the video code conversion Log Sender in the local cache after the second result and compression being processed is to central memory.
13. devices according to claim 8, is characterized in that, also comprise:
Prewarning unit: for the content according to the video code conversion daily record produced, whether the operation of monitor video transcoding is normal; When video code conversion operation exception, export early warning signal.
The gathering system of 14. 1 kinds of video code conversion daily records, is characterized in that, comprises multiple transcoding server and central memory;
Wherein, each transcoding server, preliminary treatment is carried out in the video code conversion daily record of putting into local cache for self being produced: when monitoring this transcoding server when carrying out video code conversion, from in the video code conversion daily record described local cache, obtain and meet pre-conditioned partial video transcoding daily record; By the partial video transcoding Log Sender of acquisition in central memory; When monitoring transcoding server not when carrying out video code conversion, by the video code conversion Log Sender in described local cache in central memory;
The video code conversion daily record that central memory sends for storing each transcoding server.
15. systems according to claim 14, is characterized in that, described central memory provides user query interface, inquire about the video code conversion daily record stored in central memory for user.
16. systems according to claim 14, it is characterized in that, described central memory comprises multiple storage server, each transcoding server according to preset rules, by obtain the daily record of partial video transcoding and local cache in video code conversion Log Sender in identical or different storage server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510372410.3A CN104980750B (en) | 2015-06-30 | 2015-06-30 | A kind of collection method of video code conversion daily record, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510372410.3A CN104980750B (en) | 2015-06-30 | 2015-06-30 | A kind of collection method of video code conversion daily record, apparatus and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104980750A true CN104980750A (en) | 2015-10-14 |
| CN104980750B CN104980750B (en) | 2018-04-20 |
Family
ID=54276772
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510372410.3A Active CN104980750B (en) | 2015-06-30 | 2015-06-30 | A kind of collection method of video code conversion daily record, apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104980750B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105868009A (en) * | 2016-03-23 | 2016-08-17 | 乐视控股（北京）有限公司 | Live streaming software transcoding task management method and device |
| CN105898554A (en) * | 2015-12-18 | 2016-08-24 | 乐视云计算有限公司 | Real-time transcoding monitoring method and real-time transcoding system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6662218B2 (en) * | 1996-06-03 | 2003-12-09 | Webtv Networks, Inc. | Method of transcoding documents in a network environment using a proxy server |
| CN101667932A (en) * | 2009-09-30 | 2010-03-10 | 中兴通讯股份有限公司 | Method of network element equipment log management and device |
| CN103209087A (en) * | 2012-01-17 | 2013-07-17 | 深圳市腾讯计算机系统有限公司 | Distributed log statistical processing method and system |
| CN103702137A (en) * | 2013-12-23 | 2014-04-02 | 乐视网信息技术（北京）股份有限公司 | Method and system for generating statistic data during transcoding task processing |
| CN104202201A (en) * | 2014-09-16 | 2014-12-10 | 广州金山网络科技有限公司 | Log processing method and device and terminal |
-
2015
- 2015-06-30 CN CN201510372410.3A patent/CN104980750B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6662218B2 (en) * | 1996-06-03 | 2003-12-09 | Webtv Networks, Inc. | Method of transcoding documents in a network environment using a proxy server |
| CN101667932A (en) * | 2009-09-30 | 2010-03-10 | 中兴通讯股份有限公司 | Method of network element equipment log management and device |
| CN103209087A (en) * | 2012-01-17 | 2013-07-17 | 深圳市腾讯计算机系统有限公司 | Distributed log statistical processing method and system |
| CN103702137A (en) * | 2013-12-23 | 2014-04-02 | 乐视网信息技术（北京）股份有限公司 | Method and system for generating statistic data during transcoding task processing |
| CN104202201A (en) * | 2014-09-16 | 2014-12-10 | 广州金山网络科技有限公司 | Log processing method and device and terminal |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105898554A (en) * | 2015-12-18 | 2016-08-24 | 乐视云计算有限公司 | Real-time transcoding monitoring method and real-time transcoding system |
| WO2017101488A1 (en) * | 2015-12-18 | 2017-06-22 | 乐视控股（北京）有限公司 | Real-time transcoding monitoring method and real-time transcoding system |
| CN105868009A (en) * | 2016-03-23 | 2016-08-17 | 乐视控股（北京）有限公司 | Live streaming software transcoding task management method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104980750B (en) | 2018-04-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109977158B (en) | Public security big data analysis processing system and method | |
| CN108009236B (en) | Big data query method, system, computer and storage medium | |
| CN101853287B (en) | Data compression quick retrieval file system and method thereof | |
| CN103942210A (en) | Processing method, device and system of mass log information | |
| CN104462121B (en) | Data processing method, apparatus and system | |
| CN103838867A (en) | Log processing method and device | |
| US9940360B2 (en) | Streaming optimized data processing | |
| CN108334557B (en) | Aggregated data analysis method and device, storage medium and electronic equipment | |
| US8438275B1 (en) | Formatting data for efficient communication over a network | |
| CN106897280B (en) | Data query method and device | |
| CN106250287A (en) | A kind of log information processing means | |
| CN113360554A (en) | Method and equipment for extracting, converting and loading ETL (extract transform load) data | |
| CN113448812A (en) | Monitoring alarm method and device under micro-service scene | |
| CN106557483B (en) | Data processing method, data query method, data processing equipment and data query equipment | |
| CN104980750A (en) | Collection method, device and system for video transcoding logs | |
| CN106919566A (en) | A kind of query statistic method and system based on mass data | |
| CN111159107B (en) | Data processing method and server cluster | |
| CN105245394A (en) | Method and equipment for analyzing network access log based on layered approach | |
| CN113918577B (en) | Data table identification method and device, electronic equipment and storage medium | |
| CN111209314A (en) | System for processing massive log data of power information system in real time | |
| CN110781232A (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN115470279A (en) | Data source conversion method, device, equipment and medium based on enterprise data | |
| US8572041B2 (en) | Representing records | |
| CN110677271B (en) | Big data alarm method, device, equipment and storage medium based on ELK | |
| CN112214290B (en) | Log information processing method, edge node, center node and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |