CN107016356A - Certain content recognition methods, device and electronic equipment - Google Patents

Certain content recognition methods, device and electronic equipment Download PDF

Info

Publication number
CN107016356A
CN107016356A CN201710170249.0A CN201710170249A CN107016356A CN 107016356 A CN107016356 A CN 107016356A CN 201710170249 A CN201710170249 A CN 201710170249A CN 107016356 A CN107016356 A CN 107016356A
Authority
CN
China
Prior art keywords
certain content
machine learning
learning model
model
trained
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710170249.0A
Other languages
Chinese (zh)
Inventor
刘德顺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hong Kong LiveMe Corp ltd
Original Assignee
Happy Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Happy Technology Co Ltd filed Critical Happy Technology Co Ltd
Priority to CN201710170249.0A priority Critical patent/CN107016356A/en
Publication of CN107016356A publication Critical patent/CN107016356A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/41Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Medical Informatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)

Abstract

The present invention proposes a kind of certain content recognition methods, device and electronic equipment, wherein, method includes:Sectional drawing is carried out to history live video, generate picture sample storehouse, based on each samples pictures in picture sample storehouse, and each samples pictures whether be certain content mark, machine learning model is trained, online live video is carried out to the test pictures obtained by sectional drawing, content recognition is carried out using trained machine learning model, re -training is carried out to machine learning model according to recognition result, using the machine learning model by re -training, certain content identification is carried out to online live video.Due to make use of machine learning model to carry out certain content identification, identification process reduces human cost, improves recognition efficiency, solve the less efficient technical problem of manual identified in the prior art without manually being participated in.

Description

Certain content recognition methods, device and electronic equipment
Technical field
The present invention relates to Internet technical field, more particularly to a kind of certain content recognition methods, device and electronic equipment.
Background technology
With continuing to develop for Internet technology, the live platform based on internet is developed rapidly, live conduct A kind of new broadcasting media mode, also attracted increasing main broadcaster and user participate in it is live in.
In live, on the one hand, user can carry out real-time, interactive with main broadcaster, with very strong flexibility and real-time; But then, live content uncertainty is higher, and the characteristics of due to its real-time and big concurrency, to including illegal Certain content supervision including content brings great difficulty.In the prior art, this side based on manual identified certain content Formula, for it is live when, recognition effect is very poor, and Expenses Cost is higher.
The content of the invention
It is contemplated that at least solving one of technical problem in correlation technique to a certain extent.
Therefore, first purpose of the present invention is to propose a kind of certain content recognition methods, to realize for live Certain content recognizes that manual identified certain content recognition effect is very poor in the prior art for solution, and the higher skill of Expenses Cost Art problem.
Second object of the present invention is to propose a kind of certain content identifying device.
Third object of the present invention is to propose a kind of electronic equipment.
For up to above-mentioned purpose, first aspect present invention embodiment proposes a kind of certain content recognition methods, including:
Sectional drawing, generation picture sample storehouse are carried out to history live video;
Based on each samples pictures in picture sample storehouse, and each samples pictures whether be certain content mark, to machine Learning model is trained;
Online live video is carried out to the test pictures obtained by sectional drawing, carried out using trained machine learning model Content recognition, re -training is carried out according to recognition result to machine learning model;
Using the machine learning model by re -training, certain content identification is carried out to online live video.
Alternatively, as the first possible implementation of first aspect, machine learning model, including first order model With second level model, the first order model and the second level model have identical model structure.
Alternatively, it is described to be based on each sample in picture sample storehouse as second of possible implementation of first aspect Picture, and each samples pictures whether be certain content mark, machine learning model is trained, including:
Based on each samples pictures in the picture sample storehouse, and the picture sample storehouse whether be certain content mark Note, is trained to the first order model of the machine learning model.
Alternatively, it is described that online live video is subjected to sectional drawing as the third possible implementation of first aspect Resulting test pictures, carry out content recognition, according to recognition result to engineering using trained machine learning model Practise model and carry out re -training, including:
By the test pictures, content recognition is carried out using trained first order model;
According to wrong part is recognized in the test pictures, second level model is trained, obtains trained Second level model.
Alternatively, it is described to be recognized according in the test pictures as the 4th kind of possible implementation of first aspect Wrong part, is trained to second level model, obtains trained second level model, including:
From the test pictures, the wrong misrecognition picture of inquiry identification, wherein, the misrecognition picture includes mark For the particular picture comprising normal content, and/or it is labeled as including the normal picture of certain content;
According to the misrecognition picture, the picture sample storehouse is regenerated;
Based on the picture sample storehouse regenerated, the second level model of the machine learning model is trained.
Alternatively, as the 5th kind of possible implementation of first aspect, the machine using by re -training Learning model, certain content identification is carried out to online live video, including:
Certain content identification is carried out to the sectional drawing of online live video using the first order model;
According to the confidence level of identification, the sectional drawing by the confidence level of identification less than the online live video of threshold value, using described Second level model, carries out certain content identification.
Alternatively, as the 6th kind of possible implementation of first aspect, the machine learning model is convolutional Neural Network;The certain content, including illegal contents.
The certain content recognition methods of the embodiment of the present invention, by carrying out sectional drawing to history live video, generates picture sample This storehouse, based on each samples pictures in picture sample storehouse, and each samples pictures whether be certain content mark, to machine learning Model is trained, and online live video is carried out to the test pictures obtained by sectional drawing, trained machine learning mould is utilized Type carries out content recognition, carries out re -training to machine learning model according to recognition result, utilizes the machine by re -training Learning model, certain content identification is carried out to online live video.Due to make use of machine learning model to carry out certain content knowledge Not, identification process reduces human cost, improves recognition efficiency, solve people in the prior art without manually being participated in The relatively low technical problem of work recognition efficiency.
For up to above-mentioned purpose, second aspect of the present invention embodiment proposes a kind of certain content identifying device, including:
Generation module, for carrying out sectional drawing, generation picture sample storehouse to history live video;
Training module, for based on each samples pictures in picture sample storehouse, and whether each samples pictures are certain content Mark, machine learning model is trained;
Retraining module, for online live video to be carried out to the test pictures obtained by sectional drawing, using trained Machine learning model carries out content recognition, and re -training is carried out to machine learning model according to recognition result;
Identification module, for using the machine learning model by re -training, being carried out to online live video in specific Hold identification.
Alternatively, as the first possible implementation of second aspect, the machine learning model, including the first order Model and second level model, the first order model and the second level model have identical model structure.
Alternatively, as second of possible implementation of second aspect, the training module, specifically for:
Based on each samples pictures in the picture sample storehouse, and the picture sample storehouse whether be certain content mark Note, is trained to the first order model of the machine learning model.
Alternatively, as the third possible implementation of second aspect, the retraining module, including:
Recognition unit, for by the test pictures, content recognition to be carried out using trained first order model;
Retraining unit, for according to wrong part is recognized in the test pictures, being trained to second level model, Obtain trained second level model.
Alternatively, as the 4th kind of possible implementation of second aspect, the retraining unit, specifically for:
From the test pictures, the wrong misrecognition picture of inquiry identification, wherein, the misrecognition picture includes mark For the particular picture comprising normal content, and/or it is labeled as including the normal picture of certain content;
According to the misrecognition picture, the picture sample storehouse is regenerated;
Based on the picture sample storehouse regenerated, the second level model of the machine learning model is trained.
Alternatively, as the 5th kind of possible implementation of second aspect, the identification module, specifically for:
Certain content identification is carried out to the sectional drawing of online live video using the first order model;
According to the confidence level of identification, the sectional drawing by the confidence level of identification less than the online live video of threshold value, using described Second level model, carries out certain content identification.
Alternatively, as the 6th kind of possible implementation of second aspect, the machine learning model is convolutional Neural Network;The certain content, including illegal contents.
The certain content identifying device of the embodiment of the present invention, by carrying out sectional drawing to history live video, generates picture sample This storehouse, based on each samples pictures in picture sample storehouse, and each samples pictures whether be certain content mark, to machine learning Model is trained, and online live video is carried out to the test pictures obtained by sectional drawing, trained machine learning mould is utilized Type carries out content recognition, carries out re -training to machine learning model according to recognition result, utilizes the machine by re -training Learning model, certain content identification is carried out to online live video.Due to make use of machine learning model to carry out certain content knowledge Not, identification process reduces human cost, improves recognition efficiency, solve people in the prior art without manually being participated in The relatively low technical problem of work recognition efficiency.
For up to above-mentioned purpose, third aspect present invention embodiment proposes electronic equipment, including:Housing, processor, storage Device, circuit board and power circuit, wherein, circuit board is placed in the interior volume that housing is surrounded, and processor and memory are arranged on On circuit board;Power circuit, for being powered for each circuit or device of above-mentioned electronic equipment;Memory is used to store executable Program code;The executable program code that processor is stored by reading in memory is corresponding with executable program code to run Program, for performing the certain content recognition methods described in first aspect.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partly become from the following description Obtain substantially, or recognized by the practice of the present invention.
Brief description of the drawings
Of the invention above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments Substantially and be readily appreciated that, wherein:
A kind of schematic flow sheet for certain content recognition methods that Fig. 1 is provided by the embodiment of the present invention;
The schematic flow sheet for another certain content recognition methods that Fig. 2 is provided by the embodiment of the present invention;
Fig. 3 is a kind of structural representation of certain content identifying device provided in an embodiment of the present invention;
Fig. 4 is the structural representation of another certain content identifying device provided in an embodiment of the present invention;And
Fig. 5 is the structural representation of electronic equipment one embodiment of the present invention.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached The embodiment of figure description is exemplary, it is intended to for explaining the present invention, and be not considered as limiting the invention.
Below with reference to the accompanying drawings certain content recognition methods and the device of the embodiment of the present invention described.
The live of internet has the features such as real-time, uncertainty degree is high, concurrency is big, is brought very to content monitoring Big challenge.In particular in terms of protection of minors, it is desirable to be able to real-time monitor the certain content included in live. Here certain content includes illegal contents, waste advertisements, vulgar content etc..
A kind of schematic flow sheet for certain content recognition methods that Fig. 1 is provided by the embodiment of the present invention, the present embodiment institute The method of offer, make use of machine learning model to carry out certain content identification, and identification process is reduced without manually being participated in Human cost, improves recognition efficiency, solves the less efficient technical problem of manual identified in the prior art.
As shown in figure 1, certain content recognition methods comprises the following steps:
Step 101, sectional drawing, generation picture sample storehouse are carried out to history live video.
Specifically, every default frame number, sectional drawing is carried out to history live video, or every predetermined period, it is straight to history Broadcast video and carry out sectional drawing.The picture that sectional drawing is obtained is used as the samples pictures in picture sample storehouse.Using manual type, to sectional drawing It is identified, it is particular picture or normal picture to mark each pictures.
Wherein, the picture comprising certain content can not be considered as normal picture.
Step 102, based on each samples pictures in picture sample storehouse, and each samples pictures whether be certain content mark Note, is trained to machine learning model.
Specifically, by being trained to machine learning model so that each parameter value is arrived in machine learning model study, so that Realize the identification to certain content.
Step 103, online live video is carried out to the test pictures obtained by sectional drawing, trained machine learning is utilized Model carries out content recognition, and re -training is carried out to machine learning model according to recognition result.
Specifically, machine learning model is put on line and run, sectional drawing periodically is carried out to online live video, obtained To test pictures.Content recognition is carried out to test pictures using trained machine learning model.
From the test pictures, the wrong misrecognition picture of inquiry identification, wherein, the misrecognition picture includes mark For the particular picture comprising normal content, and/or it is labeled as including the normal picture of certain content;Schemed according to the misrecognition Piece, regenerates the picture sample storehouse;Based on the picture sample storehouse regenerated, the machine learning model is carried out Re -training.
Step 104, using the machine learning model by re -training, certain content knowledge is carried out to online live video Not.
The method that the present embodiment is provided, can repeat step 103 and step 104, so that machine learning mould Type is more perfect, and recognition accuracy is improved constantly.
In the present embodiment, sectional drawing, generation picture sample storehouse, based on various kinds in picture sample storehouse are carried out to history live video This picture, and each samples pictures whether be certain content mark, machine learning model is trained, live regarded online Frequency carries out the test pictures obtained by sectional drawing, and content recognition is carried out using trained machine learning model, is tied according to identification Fruit carries out re -training to machine learning model, and using the machine learning model by re -training, online live video is entered Row certain content is recognized.Due to make use of machine learning model to carry out certain content identification, identification process is without manually being joined With reducing human cost, improving recognition efficiency, solve the less efficient technical problem of manual identified in the prior art.
For an embodiment in clear explanation, another certain content recognition methods is present embodiments provided, Fig. 2 is this hair The schematic flow sheet for another certain content recognition methods that bright embodiment is provided, in the present embodiment, machine learning model Specially two-level model, including first order model and second level model, first order model and the second level model have identical Convolutional neural networks model structure.When the confidence level of first order Model Identification is less than threshold value, carried out using second level model special Determine content recognition.Because second level model is to be trained what is obtained based on the wrong misrecognition picture of first order Model Identification, Therefore, it is possible to obtain more accurate recognition result, recognition accuracy is improved.
The method of the present embodiment is applied particularly under application scenarios that illegal contents are identified, so that in the present embodiment Certain content specifically include illegal contents, correspondingly, particular picture be the picture comprising certain content, be specifically as follows and include The illegal picture of illegal contents.Wherein, certain content here can refer to waste advertisements, violence, pornographic etc..
As shown in Fig. 2 the certain content recognition methods, including:Training stage and cognitive phase.
Wherein, the training stage includes:
Step 201, sectional drawing, generation picture sample storehouse are carried out to history live video.
Specifically, every default frame number, sectional drawing is carried out to history live video, or every predetermined period, it is straight to history Broadcast video and carry out sectional drawing.The picture that sectional drawing is obtained is used as the samples pictures in picture sample storehouse.Using manual type, to sectional drawing It is identified, it is illegal picture or normal picture to mark each pictures.
Step 202, based on each samples pictures in picture sample storehouse, and picture sample storehouse whether be illegal contents mark Note, is trained to the first order model of machine learning model.
Wherein, first order model and second level model refer to the convolutional neural networks model of Google inception v3.From unlike inception v3, the first order model and second level model of the present embodiment are being connected entirely Layer, softmax functions output recognition result is converted into by logit functions.So as to the numerical value for the 0-1 for directly using output, It is used as the confidence level of this identification.
Step 203, online live video is carried out to the test pictures obtained by sectional drawing, trained first order mould is utilized Type carries out content recognition.
Specifically, online live video is carried out to the test pictures obtained by sectional drawing, just with trained first Level model carries out content recognition, without being identified using second level model.
Step 204, according to wrong part is recognized in test pictures, second level model is trained, obtained by instruction Experienced second level model.
Specifically, from test pictures, the wrong misrecognition picture of inquiry identification, wherein, misrecognition picture includes mark For the illegal picture comprising normal content, and/or it is labeled as including the normal picture of illegal contents.According to misrecognition picture, weight The newly-generated picture sample storehouse.Based on the picture sample storehouse regenerated, the second level model of machine learning model is carried out Training.
Wherein, cognitive phase includes:
Step 205, during ONLINE RECOGNITION illegal contents, the sectional drawing of online live video is carried out using first order model illegal Content recognition, whether determine each sectional drawing is illegal picture, and recognition result confidence level.
Step 206, judge whether confidence level is less than threshold value, if less than threshold value, performing step 207, otherwise performing step 208。
Step 207, if confidence level is less than threshold value, using second level model, illegal contents identification is re-started to the sectional drawing, Accept and believe the recognition result of second level model.
Step 208, if confidence level is not less than threshold value, the recognition result of first order model is accepted and believed.
In the present embodiment, sectional drawing, generation picture sample storehouse, based on various kinds in picture sample storehouse are carried out to history live video This picture, and each samples pictures whether be illegal contents mark, machine learning model is trained, live regarded online Frequency carries out the test pictures obtained by sectional drawing, and content recognition is carried out using trained machine learning model, is tied according to identification Fruit carries out re -training to machine learning model, and using the machine learning model by re -training, online live video is entered Row illegal contents are recognized.Due to make use of machine learning model to carry out illegal contents identification, identification process is without manually being joined With reducing human cost, improving recognition efficiency, solve the less efficient technical problem of manual identified in the prior art.
In order to realize above-described embodiment, the present invention also proposes a kind of certain content identifying device.
Fig. 3 is a kind of structural representation of certain content identifying device provided in an embodiment of the present invention.
As shown in figure 3, the certain content identifying device includes:Generation module 31, training module 32, the and of retraining module 33 Identification module 34.
Generation module 31, for carrying out sectional drawing, generation picture sample storehouse to history live video.
Training module 32, for based on each samples pictures in picture sample storehouse, and whether each samples pictures are in specific The mark of appearance, is trained to machine learning model.
Retraining module 33, for by the test pictures obtained by online live video progress sectional drawing, using by training Machine learning model carry out content recognition, according to recognition result to machine learning model carry out re -training.
Identification module 34, for using the machine learning model by re -training, being carried out to online live video specific Content recognition.
It should be noted that the foregoing explanation to embodiment of the method is also applied for the device of the embodiment, herein not Repeat again.
Based on above-described embodiment, the embodiment of the present invention additionally provides the possible realization of another certain content identifying device Mode, Fig. 4 is the structural representation of another certain content identifying device provided in an embodiment of the present invention, in a upper embodiment On the basis of, machine learning model, including first order model and second level model, the first order model and the second level model With identical model structure, for example:Convolutional neural networks.
Further, training module 32, specifically for:Based on each in the picture sample storehouse, and the picture sample storehouse Samples pictures whether be certain content mark, the first order model of the machine learning model is trained.
Retraining module 33, including:Recognition unit 331 and retraining unit 332.
Recognition unit 331, for by the test pictures, content recognition to be carried out using trained first order model.
Retraining unit 332, for according to wrong part is recognized in the test pictures, being instructed to second level model Practice, obtain trained second level model.
Specifically, retraining unit 332, specifically for:From the test pictures, the wrong misrecognition figure of inquiry identification Piece, wherein, the misrecognition picture includes being labeled as including the particular picture of normal content, and/or is labeled as comprising specific interior The normal picture of appearance;According to the misrecognition picture, the picture sample storehouse is regenerated;Based on the picture regenerated Sample Storehouse, is trained to the second level model of the machine learning model.
Further, identification module 34, specifically for:The sectional drawing of online live video is carried out using the first order model Certain content is recognized;According to the confidence level of identification, the sectional drawing by the confidence level of identification less than the online live video of threshold value is utilized The second level model, carries out certain content identification.
In the embodiment of the present invention, sectional drawing, generation picture sample storehouse, based in picture sample storehouse are carried out to history live video Each samples pictures, and each samples pictures whether be certain content mark, machine learning model is trained, will be straight online The test pictures obtained by video progress sectional drawing are broadcast, content recognition are carried out using trained machine learning model, according to knowledge Other result carries out re -training to machine learning model, using the machine learning model by re -training, is regarded to live online Frequency carries out certain content identification.Due to make use of machine learning model to carry out certain content identification, identification process is without manually entering Row is participated in, and is reduced human cost, is improved recognition efficiency, solves the less efficient technology of manual identified in the prior art and ask Topic.
As a kind of possible application scenarios, the device that the present embodiment is provided is applied particularly to know illegal contents Under other application scenarios so that the certain content in the present embodiment specifically includes illegal contents, correspondingly, particular picture be comprising The picture of certain content, is specifically as follows the illegal picture comprising illegal contents.Wherein, certain content here can refer to rubbish Rubbish advertisement, violence, pornographic etc..
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means to combine specific features, structure, material or the spy that the embodiment or example are described Point is contained at least one embodiment of the present invention or example.In this manual, to the schematic representation of above-mentioned term not Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area Art personnel can be tied the not be the same as Example or the feature of example and non-be the same as Example or example described in this specification Close and combine.
In addition, term " first ", " second " are only used for describing purpose, and it is not intended that indicating or implying relative importance Or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can express or Implicitly include at least one this feature.In the description of the invention, " multiple " are meant that at least two, such as two, three It is individual etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, represent to include Module, fragment or the portion of the code of one or more executable instructions for the step of realizing custom logic function or process Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not be by shown or discussion suitable Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention Embodiment person of ordinary skill in the field understood.
Represent in flow charts or logic and/or step described otherwise above herein, for example, being considered use In the order list for the executable instruction for realizing logic function, it may be embodied in any computer-readable medium, for Instruction execution system, device or equipment (such as computer based system including the system of processor or other can be held from instruction The system of row system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or set It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass Defeated program is for instruction execution system, device or equipment or the dress for combining these instruction execution systems, device or equipment and using Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following:Electricity with one or more wirings Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage (ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits Reservoir (CDROM).In addition, can even is that can be in the paper of printing described program thereon or other are suitable for computer-readable medium Medium, because can then enter edlin, interpretation or if necessary with it for example by carrying out optical scanner to paper or other media His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned In embodiment, the software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage Or firmware is realized.Such as, if realized with hardware with another embodiment, following skill well known in the art can be used Any one of art or their combination are realized:With the logic gates for realizing logic function to data-signal from Scattered logic circuit, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can be compiled Journey gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method is carried Rapid to can be by program to instruct the hardware of correlation to complete, described program can be stored in a kind of computer-readable storage medium In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the invention can be integrated in a processing module, can also That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould Block can both be realized in the form of hardware, it would however also be possible to employ the form of software function module is realized.The integrated module is such as Fruit is realized using in the form of software function module and as independent production marketing or in use, can also be stored in a computer In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..Although having been shown and retouching above Embodiments of the invention are stated, it is to be understood that above-described embodiment is exemplary, it is impossible to be interpreted as the limit to the present invention System, one of ordinary skill in the art can be changed to above-described embodiment, change, replace and become within the scope of the invention Type.
The embodiment of the present invention also provides a kind of electronic equipment, and electronic equipment includes the device described in foregoing any embodiment.
Fig. 5 is the structural representation of electronic equipment one embodiment of the present invention, it is possible to achieve implemented shown in Fig. 1-4 of the present invention The flow of example, as shown in figure 5, above-mentioned electronic equipment can include:Housing 41, processor 42, memory 43, circuit board 44 and electricity Source circuit 45, wherein, circuit board 44 is placed in the interior volume that housing 41 is surrounded, and processor 42 and memory 43 are arranged on circuit On plate 44;Power circuit 45, for being powered for each circuit or device of above-mentioned electronic equipment;Memory 43 is used to store and can hold Line program code;Processor 42 is run and executable program generation by reading the executable program code stored in memory 43 The corresponding program of code, for performing the certain content recognition methods described in foregoing any embodiment.
Processor 42 to the specific implementation procedure and processor 42 of above-mentioned steps by run executable program code come The step of further performing, may refer to the description of Fig. 1-4 illustrated embodiments of the present invention, will not be repeated here.
The electronic equipment exists in a variety of forms, includes but is not limited to:
(1) mobile communication equipment:The characteristics of this kind equipment is that possess mobile communication function, and to provide speech, data Communicate as main target.This Terminal Type includes:Smart mobile phone (such as iPhone), multimedia handset, feature mobile phone, and it is low Hold mobile phone etc..
(2) super mobile personal computer equipment:This kind equipment belongs to the category of personal computer, there is calculating and processing work( Can, typically also possess mobile Internet access characteristic.This Terminal Type includes:PDA, MID and UMPC equipment etc., such as iPad.
(3) portable entertainment device:This kind equipment can show and play content of multimedia.The kind equipment includes:Audio, Video player (such as iPod), handheld device, e-book, and intelligent toy and portable car-mounted navigation equipment.
(4) server:The equipment for providing the service of calculating, the composition of server is total including processor, hard disk, internal memory, system Line etc., server is similar with general computer architecture, but is due to need to provide highly reliable service, therefore in processing energy Require higher in terms of power, stability, reliability, security, scalability, manageability.
(5) other electronic equipments with data interaction function.
One of ordinary skill in the art will appreciate that realize all or part of flow in above-described embodiment method, being can be with The hardware of correlation is instructed to complete by computer program, described program can be stored in a computer read/write memory medium In, the program is upon execution, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, described storage medium can be magnetic Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access Memory, RAM) etc..
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any Those familiar with the art the invention discloses technical scope in, the change or replacement that can be readily occurred in, all should It is included within the scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.

Claims (10)

1. a kind of certain content recognition methods, it is characterised in that comprise the following steps:
Sectional drawing, generation picture sample storehouse are carried out to history live video;
Based on each samples pictures in picture sample storehouse, and each samples pictures whether be certain content mark, to machine learning Model is trained;
Online live video is carried out to the test pictures obtained by sectional drawing, content is carried out using trained machine learning model Identification, re -training is carried out according to recognition result to machine learning model;
Using the machine learning model by re -training, certain content identification is carried out to online live video.
2. certain content recognition methods according to claim 1, it is characterised in that the machine learning model, including the First-order model and second level model, the first order model and the second level model have identical model structure.
3. certain content recognition methods according to claim 2, it is characterised in that described to be based on various kinds in picture sample storehouse This picture, and each samples pictures whether be certain content mark, machine learning model is trained, including:
Based on each samples pictures in the picture sample storehouse, and the picture sample storehouse whether be certain content mark, it is right The first order model of the machine learning model is trained.
4. certain content recognition methods according to claim 2, it is characterised in that described to be cut online live video Test pictures obtained by figure, carry out content recognition, according to recognition result to machine using trained machine learning model Learning model carries out re -training, including:
By the test pictures, content recognition is carried out using trained first order model;
According to wrong part is recognized in the test pictures, second level model is trained, trained second is obtained Level model.
5. certain content recognition methods according to claim 4, it is characterised in that described to know according in the test pictures Not wrong part, is trained to second level model, obtains trained second level model, including:
From the test pictures, the wrong misrecognition picture of inquiry identification, wherein, the misrecognition picture includes being labeled as bag Particular picture containing normal content, and/or it is labeled as including the normal picture of certain content;
According to the misrecognition picture, the picture sample storehouse is regenerated;
Based on the picture sample storehouse regenerated, the second level model of the machine learning model is trained.
6. certain content recognition methods according to claim 2, it is characterised in that the machine using by re -training Device learning model, certain content identification is carried out to online live video, including:
Certain content identification is carried out to the sectional drawing of online live video using the first order model;
According to the confidence level of identification, the sectional drawing by the confidence level of identification less than the online live video of threshold value utilizes described second Level model, carries out certain content identification.
7. the certain content recognition methods according to claim any one of 1-6, it is characterised in that the machine learning model For convolutional neural networks;The certain content, including illegal contents.
8. a kind of certain content identifying device, it is characterised in that including:
Generation module, for carrying out sectional drawing, generation picture sample storehouse to history live video;
Training module, for based on each samples pictures in picture sample storehouse, and each samples pictures whether be certain content mark Note, is trained to machine learning model;
Retraining module, for by the test pictures obtained by online live video progress sectional drawing, utilizing trained machine Learning model carries out content recognition, and re -training is carried out to machine learning model according to recognition result;
Identification module, for using the machine learning model by re -training, certain content knowledge to be carried out to online live video Not.
9. certain content identifying device according to claim 8, it is characterised in that the machine learning model, including the First-order model and second level model, the first order model and the second level model have identical model structure.
10. a kind of electronic equipment, it is characterised in that including:Housing, processor, memory, circuit board and power circuit, wherein, Circuit board is placed in the interior volume that housing is surrounded, and processor and memory are set on circuit boards;Power circuit, for for Each circuit or device for stating electronic equipment are powered;Memory is used to store executable program code;Processor is deposited by reading The executable program code stored in reservoir runs program corresponding with executable program code, and 1- is required for perform claim Certain content recognition methods described in 7 any one.
CN201710170249.0A 2017-03-21 2017-03-21 Certain content recognition methods, device and electronic equipment Pending CN107016356A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710170249.0A CN107016356A (en) 2017-03-21 2017-03-21 Certain content recognition methods, device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710170249.0A CN107016356A (en) 2017-03-21 2017-03-21 Certain content recognition methods, device and electronic equipment

Publications (1)

Publication Number Publication Date
CN107016356A true CN107016356A (en) 2017-08-04

Family

ID=59439637

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710170249.0A Pending CN107016356A (en) 2017-03-21 2017-03-21 Certain content recognition methods, device and electronic equipment

Country Status (1)

Country Link
CN (1) CN107016356A (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107590443A (en) * 2017-08-23 2018-01-16 上海交通大学 Limiter stage live video automatic testing method and system based on the study of depth residual error
CN107729944A (en) * 2017-10-23 2018-02-23 百度在线网络技术(北京)有限公司 A kind of recognition methods, device, server and the storage medium of vulgar picture
CN108038485A (en) * 2017-11-30 2018-05-15 广东小天才科技有限公司 The lookup method and electronic equipment of a kind of learning Content
CN108322788A (en) * 2018-02-09 2018-07-24 武汉斗鱼网络科技有限公司 Advertisement demonstration method and device in a kind of net cast
CN108334861A (en) * 2018-03-02 2018-07-27 北京未来媒体科技股份有限公司 A kind of video content recognition method and device based on machine learning
CN108388873A (en) * 2018-03-01 2018-08-10 路志宏 A kind of supervisory systems of machine vision, method and client computer, storage medium
CN108399389A (en) * 2018-03-01 2018-08-14 路志宏 Multimachine supervisory systems, method and the client computer of machine vision, server, storage medium
CN108491930A (en) * 2018-03-23 2018-09-04 腾讯科技(深圳)有限公司 A kind of processing method and data processing equipment of sample data
CN108537272A (en) * 2018-04-08 2018-09-14 上海天壤智能科技有限公司 Method and apparatus for detection and analysis position in storehouse
CN108537129A (en) * 2018-03-14 2018-09-14 北京影谱科技股份有限公司 The mask method of training sample, device and system
CN108846421A (en) * 2018-05-28 2018-11-20 杭州电子科技大学 A kind of image classification method based on deep learning
CN108921002A (en) * 2018-04-23 2018-11-30 中国科学院自动化研究所 Audio-video recognition methods and device are feared cruelly based on multi thread fusion
CN109002812A (en) * 2018-08-08 2018-12-14 北京未来媒体科技股份有限公司 A kind of method and device of intelligent recognition video cover
CN109040773A (en) * 2018-07-10 2018-12-18 武汉斗鱼网络科技有限公司 A kind of video improvement method, apparatus, equipment and medium
CN109271534A (en) * 2018-10-19 2019-01-25 武汉斗鱼网络科技有限公司 A kind of live data identification framework, method, server and storage medium
CN109766807A (en) * 2018-12-28 2019-05-17 广州华多网络科技有限公司 Machine audits processing method, device, electronic equipment and storage medium
CN109993047A (en) * 2017-12-28 2019-07-09 杭州海康威视系统技术有限公司 City huddles violation recognition methods, device and the electronic equipment of material
CN110188790A (en) * 2019-04-17 2019-08-30 阿里巴巴集团控股有限公司 The automatic generating method and system of picture sample
CN110334233A (en) * 2019-07-12 2019-10-15 福建省趋普物联科技有限公司 Advertising image classification method based on depth convolutional neural networks model
CN110503460A (en) * 2019-07-26 2019-11-26 秒针信息技术有限公司 Monitoring of the advertisement method, device, system, electronic equipment and storage medium
WO2020018014A1 (en) * 2018-07-20 2020-01-23 Iron Gaming Limited Method and apparatus for categorising images of mobile device software
CN111884992A (en) * 2020-06-09 2020-11-03 武汉绿色网络信息服务有限责任公司 Identification method and identification device for bad websites
CN112396042A (en) * 2021-01-20 2021-02-23 鹏城实验室 Real-time updated target detection method and system, and computer-readable storage medium
CN112418276A (en) * 2020-11-03 2021-02-26 北京五八信息技术有限公司 Processing method and device of classifier

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1761204A (en) * 2005-11-18 2006-04-19 郑州金惠计算机系统工程有限公司 System for blocking off erotic images and unhealthy information in internet
KR20080110064A (en) * 2007-06-14 2008-12-18 유성준 Method for distinguishing obscene image and apparatus therefor
CN104182735A (en) * 2014-08-18 2014-12-03 厦门美图之家科技有限公司 Training optimization pornographic picture or video detection method based on convolutional neural network
CN104268596A (en) * 2014-09-25 2015-01-07 深圳市捷顺科技实业股份有限公司 License plate recognizer and license plate detection method and system thereof
CN104268570A (en) * 2014-09-19 2015-01-07 北京理工大学 Layering single-class ship target false alarm eliminating method based on intra-class difference
CN104361366A (en) * 2014-12-08 2015-02-18 深圳市捷顺科技实业股份有限公司 Vehicle license plate recognition method and vehicle license plate recognition equipment
CN104992177A (en) * 2015-06-12 2015-10-21 安徽大学 Internet porn image detection method based on deep convolution nerve network
CN105310696A (en) * 2015-11-06 2016-02-10 中国科学院计算技术研究所 Fall detection model construction method as well as corresponding fall detection method and apparatus
CN105718890A (en) * 2016-01-22 2016-06-29 北京大学 Method for detecting specific videos based on convolution neural network
CN105844239A (en) * 2016-03-23 2016-08-10 北京邮电大学 Method for detecting riot and terror videos based on CNN and LSTM
CN105844238A (en) * 2016-03-23 2016-08-10 乐视云计算有限公司 Method and system for discriminating videos
CN106339719A (en) * 2016-08-22 2017-01-18 微梦创科网络科技(中国)有限公司 Image identification method and image identification device
CN106503610A (en) * 2015-09-08 2017-03-15 阿里巴巴集团控股有限公司 Video frequency identifying method and device

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1761204A (en) * 2005-11-18 2006-04-19 郑州金惠计算机系统工程有限公司 System for blocking off erotic images and unhealthy information in internet
KR20080110064A (en) * 2007-06-14 2008-12-18 유성준 Method for distinguishing obscene image and apparatus therefor
CN104182735A (en) * 2014-08-18 2014-12-03 厦门美图之家科技有限公司 Training optimization pornographic picture or video detection method based on convolutional neural network
CN104268570A (en) * 2014-09-19 2015-01-07 北京理工大学 Layering single-class ship target false alarm eliminating method based on intra-class difference
CN104268596A (en) * 2014-09-25 2015-01-07 深圳市捷顺科技实业股份有限公司 License plate recognizer and license plate detection method and system thereof
CN104361366A (en) * 2014-12-08 2015-02-18 深圳市捷顺科技实业股份有限公司 Vehicle license plate recognition method and vehicle license plate recognition equipment
CN104992177A (en) * 2015-06-12 2015-10-21 安徽大学 Internet porn image detection method based on deep convolution nerve network
CN106503610A (en) * 2015-09-08 2017-03-15 阿里巴巴集团控股有限公司 Video frequency identifying method and device
CN105310696A (en) * 2015-11-06 2016-02-10 中国科学院计算技术研究所 Fall detection model construction method as well as corresponding fall detection method and apparatus
CN105718890A (en) * 2016-01-22 2016-06-29 北京大学 Method for detecting specific videos based on convolution neural network
CN105844239A (en) * 2016-03-23 2016-08-10 北京邮电大学 Method for detecting riot and terror videos based on CNN and LSTM
CN105844238A (en) * 2016-03-23 2016-08-10 乐视云计算有限公司 Method and system for discriminating videos
CN106339719A (en) * 2016-08-22 2017-01-18 微梦创科网络科技(中国)有限公司 Image identification method and image identification device

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107590443A (en) * 2017-08-23 2018-01-16 上海交通大学 Limiter stage live video automatic testing method and system based on the study of depth residual error
CN107729944A (en) * 2017-10-23 2018-02-23 百度在线网络技术(北京)有限公司 A kind of recognition methods, device, server and the storage medium of vulgar picture
CN107729944B (en) * 2017-10-23 2021-05-07 百度在线网络技术(北京)有限公司 Identification method and device of popular pictures, server and storage medium
CN108038485A (en) * 2017-11-30 2018-05-15 广东小天才科技有限公司 The lookup method and electronic equipment of a kind of learning Content
CN109993047A (en) * 2017-12-28 2019-07-09 杭州海康威视系统技术有限公司 City huddles violation recognition methods, device and the electronic equipment of material
CN108322788A (en) * 2018-02-09 2018-07-24 武汉斗鱼网络科技有限公司 Advertisement demonstration method and device in a kind of net cast
CN108322788B (en) * 2018-02-09 2021-03-16 武汉斗鱼网络科技有限公司 Advertisement display method and device in live video
CN108388873A (en) * 2018-03-01 2018-08-10 路志宏 A kind of supervisory systems of machine vision, method and client computer, storage medium
CN108399389A (en) * 2018-03-01 2018-08-14 路志宏 Multimachine supervisory systems, method and the client computer of machine vision, server, storage medium
CN108399389B (en) * 2018-03-01 2020-05-08 路志宏 Multi-machine monitoring system and method for machine vision, client, server and storage medium
CN108334861A (en) * 2018-03-02 2018-07-27 北京未来媒体科技股份有限公司 A kind of video content recognition method and device based on machine learning
CN108537129A (en) * 2018-03-14 2018-09-14 北京影谱科技股份有限公司 The mask method of training sample, device and system
CN108491930A (en) * 2018-03-23 2018-09-04 腾讯科技(深圳)有限公司 A kind of processing method and data processing equipment of sample data
CN108537272A (en) * 2018-04-08 2018-09-14 上海天壤智能科技有限公司 Method and apparatus for detection and analysis position in storehouse
CN108921002A (en) * 2018-04-23 2018-11-30 中国科学院自动化研究所 Audio-video recognition methods and device are feared cruelly based on multi thread fusion
CN108846421A (en) * 2018-05-28 2018-11-20 杭州电子科技大学 A kind of image classification method based on deep learning
CN108846421B (en) * 2018-05-28 2021-11-16 杭州电子科技大学 Image classification method based on deep learning
CN109040773A (en) * 2018-07-10 2018-12-18 武汉斗鱼网络科技有限公司 A kind of video improvement method, apparatus, equipment and medium
WO2020018014A1 (en) * 2018-07-20 2020-01-23 Iron Gaming Limited Method and apparatus for categorising images of mobile device software
US11093802B2 (en) 2018-07-20 2021-08-17 Iron Gaming Limited Method and apparatus for categorizing images of mobile device software
CN109002812A (en) * 2018-08-08 2018-12-14 北京未来媒体科技股份有限公司 A kind of method and device of intelligent recognition video cover
CN109271534A (en) * 2018-10-19 2019-01-25 武汉斗鱼网络科技有限公司 A kind of live data identification framework, method, server and storage medium
CN109766807A (en) * 2018-12-28 2019-05-17 广州华多网络科技有限公司 Machine audits processing method, device, electronic equipment and storage medium
CN110188790A (en) * 2019-04-17 2019-08-30 阿里巴巴集团控股有限公司 The automatic generating method and system of picture sample
CN110188790B (en) * 2019-04-17 2023-09-29 创新先进技术有限公司 Automatic generation method and system for picture sample
CN110334233A (en) * 2019-07-12 2019-10-15 福建省趋普物联科技有限公司 Advertising image classification method based on depth convolutional neural networks model
CN110503460A (en) * 2019-07-26 2019-11-26 秒针信息技术有限公司 Monitoring of the advertisement method, device, system, electronic equipment and storage medium
CN111884992A (en) * 2020-06-09 2020-11-03 武汉绿色网络信息服务有限责任公司 Identification method and identification device for bad websites
CN112418276A (en) * 2020-11-03 2021-02-26 北京五八信息技术有限公司 Processing method and device of classifier
CN112396042A (en) * 2021-01-20 2021-02-23 鹏城实验室 Real-time updated target detection method and system, and computer-readable storage medium

Similar Documents

Publication Publication Date Title
CN107016356A (en) Certain content recognition methods, device and electronic equipment
Helberger Challenging Diversity-Social Media Platforms and a New Conception of Media Diversity
Nigam et al. Towards a robust metric of opinion
CN106339507B (en) Streaming Media information push method and device
CN110147711A (en) Video scene recognition methods, device, storage medium and electronic device
CN106126582A (en) Recommend method and device
Furini et al. TSentiment: On gamifying Twitter sentiment analysis
Hoang et al. Politics, sharing and emotion in microblogs
CN109657038A (en) The method for digging, device and electronic equipment of a kind of question and answer to data
CN110474944B (en) Network information processing method, device and storage medium
CN109829059A (en) Recommend method, apparatus, equipment and the storage medium of knowledge point
CN109218390A (en) User's screening technique and device
Hawkins et al. Convention-formation in iterated reference games.
CN108021660B (en) Topic self-adaptive microblog emotion analysis method based on transfer learning
CN112969065B (en) Method, device and computer readable medium for evaluating video conference quality
CN106648675A (en) Method and device for displaying application program using information and electronic equipment
CN110234018A (en) Multimedia content description generation method, training method, device, equipment and medium
CN108830467A (en) Evaluation method, device, equipment and the storage medium of reading behavior
CN109033285A (en) Information-pushing method and device
CN107864405A (en) A kind of Forecasting Methodology, device and the computer-readable medium of viewing behavior type
CN109325124A (en) A kind of sensibility classification method, device, server and storage medium
CN106557954A (en) The method and device of customer service marketing
CN108090201A (en) A kind of method, apparatus and electronic equipment of article content classification
CN106843635A (en) Information displaying method, device and electronic equipment
CN109460503A (en) Answer input method, device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Cayman Islands, Grand Cayman

Applicant after: LIVE.ME Inc.

Address before: Cayman Islands, Grand Cayman

Applicant before: LEMI TECHNOLOGY CO.,LTD.

CB02 Change of applicant information
TA01 Transfer of patent application right

Effective date of registration: 20190621

Address after: Room 1101, Santai Commercial Building, 139 Connaught Road, Hong Kong, China

Applicant after: HONG KONG LIVE.ME Corp.,Ltd.

Address before: Grand Cayman

Applicant before: LIVE.ME Inc.

TA01 Transfer of patent application right
RJ01 Rejection of invention patent application after publication

Application publication date: 20170804

RJ01 Rejection of invention patent application after publication