CN109819271A - The method and device of game direct broadcasting room displaying, storage medium, electronic equipment - Google Patents

The method and device of game direct broadcasting room displaying, storage medium, electronic equipment Download PDF

Info

Publication number
CN109819271A
CN109819271A CN201910114207.4A CN201910114207A CN109819271A CN 109819271 A CN109819271 A CN 109819271A CN 201910114207 A CN201910114207 A CN 201910114207A CN 109819271 A CN109819271 A CN 109819271A
Authority
CN
China
Prior art keywords
copy
game
single frames
title
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910114207.4A
Other languages
Chinese (zh)
Inventor
李秋实
陀健
光超
巢娅
陈健生
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Hangzhou Network Co Ltd
Original Assignee
Netease Hangzhou Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Hangzhou Network Co Ltd filed Critical Netease Hangzhou Network Co Ltd
Priority to CN201910114207.4A priority Critical patent/CN109819271A/en
Publication of CN109819271A publication Critical patent/CN109819271A/en
Pending legal-status Critical Current

Links

Abstract

The embodiment of the present invention is the method and device shown about a kind of game direct broadcasting room, storage medium, electronic equipment, this method comprises: obtaining single frames picture from the video flowing that the game direct broadcasting room plays;The identification of game transcript status information is carried out to the single frames picture;Wherein, the game transcript status information includes at least one of the following: copy icon, copy title;The game direct broadcasting room is marked according to recognition result.This method solve the problem poor by the real-time of copy state information caused by manual setting room title and accuracy is needed in the prior art, the real-time and accuracy of copy information are improved, and then the user experience is improved.

Description

The method and device of game direct broadcasting room displaying, storage medium, electronic equipment
Technical field
The present embodiments relate to game technical field, a kind of shown in particular to game direct broadcasting room method and Device, storage medium, electronic equipment.
Background technique
Game transcript is one of the part that player is most interested in a online game, and room is broadcast live in selection game in spectators When, whether main broadcaster is an important references in copy of playing games.Since the room to start broadcasting simultaneously on live streaming platform is numerous, Guan Zhongnan To obtain the copy state information of current time live game from static room selection interface, need by click manually into Judged after entering room by live streaming picture, therefore will cause spectators and be difficult to quickly select oneself interested room, Influence user experience.
Accordingly, it is desirable to provide a kind of method and device that new game direct broadcasting room is shown.
It should be noted that the information in the invention of above-mentioned background technology part is only used for reinforcing the reason to background of the invention Solution, therefore may include the information not constituted to the prior art known to persons of ordinary skill in the art.
Summary of the invention
The purpose of the present invention is to provide a kind of game direct broadcasting room show method and device, storage medium, electronic equipment, And then game live streaming can not be accurately obtained caused by overcoming the limitation and defect due to the relevant technologies at least to a certain extent Between copy state information the problem of.
According to one aspect of the disclosure, a kind of method that game direct broadcasting room is shown is provided, comprising:
Single frames picture is obtained from the video flowing that the game direct broadcasting room plays;
The identification of game transcript status information is carried out to the single frames picture;Wherein, the game transcript status information packet It includes at least one of following: copy icon, copy title;
The game direct broadcasting room is marked according to recognition result.
It is described when the game transcript status information is copy icon in a kind of exemplary embodiment of the disclosure The identification of game transcript status information is carried out to the single frames picture, comprising:
The identification for being carried out copy icon to the single frames picture using preset deep learning model is obtained the single frames and drawn It include the confidence level of copy icon in face;
If the confidence level is greater than preset threshold, the corresponding game transcript of the copy icon that will identify that is as identification knot Fruit.
It is described when the game transcript status information is copy title in a kind of exemplary embodiment of the disclosure The identification of game transcript status information is carried out to the single frames picture, comprising:
The identification for carrying out copy title to the single frames picture using preset deep learning model obtains prediction copy name Title and corresponding confidence level;
If the confidence level of the prediction copy title is greater than preset threshold, by the corresponding game of the prediction copy title Copy is as recognition result.
In a kind of exemplary embodiment of the disclosure, when the game transcript status information includes copy icon and copy When title, the identification that game transcript status information is carried out to the single frames picture, comprising:
The identification for being carried out copy icon to the single frames picture using preset deep learning model is obtained the single frames and drawn It include the confidence level of copy icon in face;
If the confidence level in the single frames picture comprising copy icon is greater than preset threshold, preset deep learning is utilized Model carries out the identification of copy title to the single frames picture, obtains prediction copy title;
Using the obtained corresponding game transcript of prediction copy title as recognition result.
In a kind of exemplary embodiment of the disclosure, when the game transcript status information includes copy icon and copy When title, the identification that game transcript status information is carried out to the single frames picture, comprising:
The identification for carrying out copy title to the single frames picture using preset deep learning model obtains prediction copy name Title and corresponding confidence level;
If the confidence level of the prediction copy title is greater than preset threshold, using preset deep learning model to described The identification of single frames picture progress copy icon;
If recognizing comprising the corresponding copy icon of the prediction copy title in the single frames picture, by the prediction The corresponding game transcript of copy title is as recognition result.
It is described that the game direct broadcasting room is marked according to recognition result in a kind of exemplary embodiment of the disclosure Note, comprising:
The title of the game direct broadcasting room is adjusted to match with the title of the game transcript in the recognition result Title;Alternatively,
Type belonging to the game transcript in the recognition result is determined, according to determining type to the game direct broadcasting room Displaying thumbnail carry out classification logotype;Alternatively,
Type belonging to the game transcript in the recognition result is determined, according to determining type by the game direct broadcasting room Displaying thumbnail be moved in the copy column of corresponding types.
It is described that list is obtained from the video flowing that the game direct broadcasting room plays in a kind of exemplary embodiment of the disclosure Frame picture, comprising: obtain multiple single frames pictures from the video flowing that the game direct broadcasting room plays;
It is described that the game direct broadcasting room is marked according to recognition result, comprising:
The most game pair of frequency of occurrence is determined according to the recognition result of every single frames picture in multiple described single frames pictures This;
The game direct broadcasting room is marked according to the frequency of occurrence most game transcript.
It is described to utilize preset deep learning model to the single frames picture in a kind of exemplary embodiment of the disclosure Carry out the identification of copy icon, comprising:
Picture interception is carried out to the single frames picture using preset first window size and first movement step-length, wherein The first window size is less than the size of the single frames picture;
Copy icon-based programming, every intercepted are carried out by every picture of the preset deep learning model to interception Picture includes the confidence level of copy icon;
Using obtained every picture include in the confidence level of copy icon maximum confidence level as the single frames picture It include the confidence level of copy icon.
It is described to utilize preset deep learning model to the single frames picture in a kind of exemplary embodiment of the disclosure Carry out the identification of copy title, comprising:
Picture interception is carried out to the single frames picture using preset second window size and the second moving step length, wherein The second window size is less than the size of the single frames picture;
The identification of copy title, every intercepted are carried out by every picture of the preset deep learning model to interception The corresponding prediction copy title of picture and corresponding confidence level;
By maximum confidence level in the corresponding confidence level of the corresponding prediction copy title of obtained every picture and corresponding Prediction copy name is referred to as the confidence level and corresponding prediction copy title of the single frames picture.
According to one aspect of the disclosure, a kind of device that game direct broadcasting room is shown is provided, comprising:
Single frames picture obtains module, for obtaining single frames picture from the video flowing that the game direct broadcasting room plays;
Status information identification module, for carrying out the identification of game transcript status information to the single frames picture;Wherein, institute It states game transcript status information and includes at least one of the following: copy icon, copy title;
Mark module, for the game direct broadcasting room to be marked according to recognition result.
According to one aspect of the disclosure, a kind of computer readable storage medium is provided, computer program is stored thereon with, The computer program realizes the method that game direct broadcasting room described in above-mentioned any one is shown when being executed by processor.
According to one aspect of the disclosure, a kind of electronic equipment is provided, comprising:
Processor;And
Memory, for storing the executable instruction of the processor;
Wherein, the processor is configured to execute trip described in above-mentioned any one via the executable instruction is executed The method that direct broadcasting room of playing is shown.
The method that a kind of game direct broadcasting room of the embodiment of the present invention is shown, by single frames picture in acquisition video flowing and to single frames Picture carries out the identification of game transcript status information, and then game direct broadcasting room is marked further according to recognition result;On the one hand, By carrying out the identification of game transcript status information to single frames picture, then game direct broadcasting room is marked further according to recognition result Note, solves the real-time and standard needed in the prior art through copy state information caused by manual setting room title The poor problem of true property, improves the real-time and accuracy of game direct broadcasting room label, and then the user experience is improved;It is another Aspect carries out automatic identification by the copy state information to single frames picture, carries out further according to recognition result to game direct broadcasting room Label, improves the recognition speed of recognition result;In another aspect, being known automatically by the copy state information to single frames picture Not, game direct broadcasting room is marked further according to recognition result, avoiding will directly contract due to identify to game transcript On shown ih outline to room selection interface, and then it can make the thumbnail that may not be the thumbnail of copy state information, from And the problem of reducing user experience.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not It can the limitation present invention.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows and meets implementation of the invention Example, and be used to explain the principle of the present invention together with specification.It should be evident that the accompanying drawings in the following description is only the present invention Some embodiments for those of ordinary skill in the art without creative efforts, can also basis These attached drawings obtain other attached drawings.
Fig. 1 schematically shows a kind of flow chart of method that game direct broadcasting room is shown;
Fig. 2 schematically shows a kind of game transcript scene exemplary diagram;
Fig. 3 schematically shows the method flow diagram that a kind of pair of single frames picture carries out the identification of copy state information;
Fig. 4 schematically shows the method flow diagram of another identification that copy state information is carried out to single frames picture;
Fig. 5 schematically shows a kind of block diagram of device that game direct broadcasting room is shown;
Fig. 6 schematically shows a kind of electronic equipment of method shown for realizing above-mentioned game direct broadcasting room;
Fig. 7 schematically shows a kind of computer-readable storage medium of method shown for realizing above-mentioned game direct broadcasting room Matter.
Specific embodiment
Example embodiment is described more fully with reference to the drawings.However, example embodiment can be with a variety of shapes Formula is implemented, and is not understood as limited to example set forth herein;On the contrary, thesing embodiments are provided so that the present invention will more Fully and completely, and by the design of example embodiment comprehensively it is communicated to those skilled in the art.Described feature, knot Structure or characteristic can be incorporated in any suitable manner in one or more embodiments.In the following description, it provides perhaps More details fully understand embodiments of the present invention to provide.It will be appreciated, however, by one skilled in the art that can It is omitted with practicing technical solution of the present invention one or more in the specific detail, or others side can be used Method, constituent element, device, step etc..In other cases, be not shown in detail or describe known solution to avoid a presumptuous guest usurps the role of the host and So that each aspect of the present invention thickens.
In addition, attached drawing is only schematic illustrations of the invention, it is not necessarily drawn to scale.Identical attached drawing mark in figure Note indicates same or similar part, thus will omit repetition thereof.Some block diagrams shown in the drawings are function Energy entity, not necessarily must be corresponding with physically or logically independent entity.These function can be realized using software form Energy entity, or these functional entitys are realized in one or more hardware modules or integrated circuit, or at heterogeneous networks and/or place These functional entitys are realized in reason device device and/or microcontroller device.
Image recognition technology is a kind of technology that computer program obtains target information in image automatically, special based on image It seeks peace pattern recognition model.Traditional image recognition technology is to use appropriate feature based on the characteristics of image manually designed Sample data trains identification model, and the scene stable for feature can reach higher accuracy of identification and stability, but as spy It is showed when levying complicated and changeable poor.Based on the image recognition technology of deep learning by learning automatically using great amount of samples data Effective characteristics of image has better robustness compared to the feature of engineer, and the performance under complex scene is better than biography System image recognition technology, is widely used.
Pattern recognition model based on deep learning usually requires great amount of samples data and is trained, and the size of sample size is An important factor for influencing model accuracy and generalization ability.Game transcript information is usually to follow game version iteration and quickly change , identification model is also required to quickly be updated, and updates iteration every time and is required to collect a large amount of newest training samples again Data, therefore sample collection method is most important.It is big needed for deep learning model in no available situation of public data collection Amount sample data is obtained frequently with the mode artificially collected, but this method is more time-consuming.
Picture is broadcast live by using the image recognition technology based on deep learning, dynamic acquisition going game in the embodiment of the present invention The state of game transcript in face, and classification marker is carried out to each live streaming with this, in order to which spectators quick and precisely select oneself sense emerging The live streaming room of interest.
A kind of method that game direct broadcasting room is shown is provided firstly in this example embodiment, this method can run on clothes Business device, server cluster or Cloud Server etc., can also run on terminal device;Certainly, those skilled in the art can also root Method of the invention is run in other platforms according to demand, and particular determination is not done to this in the present exemplary embodiment.With reference to Fig. 1 institute Show, the method which shows may comprise steps of:
Step S110. obtains single frames picture from the video flowing that game direct broadcasting room plays.
Step S120. carries out the identification of game transcript status information to the single frames picture;Wherein, game transcript status information Include at least one of the following: copy icon, copy title.
Step S130. is marked the game direct broadcasting room according to recognition result.
The following two kinds is generally comprised in the existing method for obtaining game copy state information in live streaming room: one is, Main broadcaster's manual setting room title, then user judges according to title;Another kind is that thumbnail is concentrated on a room In selection interface, then user is judged by the thumbnail that room selection interface is shown.
But in the above described two methods, it has following defects that on the one hand, since copy version updates iteration speed mistake Fastly, by manual setting title, so that the real-time and accuracy of copy state information are lower;On the other hand, due to displaying Static thumbnail is the simple displaying to game transcript status information, and user can not be accurately obtained copy state information, lead Cause copy state information error in judgement rate high, to reduce user experience.
In the method that above-mentioned game direct broadcasting room provided by the invention is shown, on the one hand, by carrying out game to single frames picture Then the identification of copy state information is marked game direct broadcasting room further according to recognition result, solve needs in the prior art Problem that will be poor by the real-time and accuracy of copy state information caused by manual setting room title, improves The real-time and accuracy of game direct broadcasting room label, and then the user experience is improved;On the other hand, by single frames picture Copy state information carries out automatic identification, obtains recognition result, improves the recognition speed of recognition result;In another aspect, passing through Automatic identification is carried out to the copy state information of single frames picture, game direct broadcasting room is marked further according to recognition result, is avoided Due to not identified to game transcript directly thumbnail is shown in room selection interface, and then the thumbnail can be made Copy state information may not can accurately reflect, thus the problem of reducing user experience.
In the following, by each step in the method shown in conjunction with attached drawing to game direct broadcasting room above-mentioned in this example embodiment into The detailed explanation of row and explanation.
In step s 110, single frames picture is obtained from the video flowing that game direct broadcasting room plays.
In this example embodiment, can at set time intervals (such as can be 20s or 30s, can also be with It is other times interval, there is no special restriction on this for this example), from the current live video flowing that game is broadcast live, obtain continuous Multiple single frames pictures;For example, available 40 frame single frames picture etc..Wherein, a wherein frame single frames picture for acquisition can join It examines shown in Fig. 2.
In the step s 120, the identification of game transcript status information is carried out to the single frames picture of acquisition;Wherein, game transcript Status information includes at least one of the following: copy icon, copy title.
It is described to the single frames when the game transcript status information is copy icon in this example embodiment Picture carry out game transcript status information identification may include: using preset deep learning model to the single frames picture into The identification of row copy icon obtains the confidence level in the single frames picture comprising copy icon;If the confidence level is greater than default Threshold value, then the corresponding game transcript of copy icon that will identify that is as recognition result.
Copy icon is one of important feature of copy, and system is scanned the single frames picture of acquisition, can be somebody's turn to do The characteristic information for the icon for including in single frames picture, in embodiments of the present invention, systemic presupposition deep learning model, the model For the pattern recognition model based on deep learning, sample data includes the copy icon of game transcript, therefore passes through the depth The icon information that learning model obtains scanning identifies, can determine whether the icon that scanning obtains belongs to copy icon, And belong to the credibility of copy icon, i.e. confidence level.In embodiments of the present invention, confidence level is greater than to the pair of preset threshold The corresponding game transcript of this icon is as recognition result.According to practice, repeatedly test obtains the preset threshold, e.g., the preset threshold It can be 0.8, or 0.9, there is no special restriction on this for this example.
Specifically, refering to what is shown in Fig. 3, carrying out copy icon to the single frames picture using preset deep learning model Identification may include step S310- step S330, be described in detail below.
In step s310, figure is carried out to the single frames picture using preset first window size and first movement step-length Piece interception, wherein the first window size is less than the size of the single frames picture.
It, can be to the single frames picture to realize the accuracy scanned to single frames picture icon in this example embodiment Multiple repairing weld and scanning are carried out, multiple repairing weld can be carried out to the single frames picture by a certain size window, obtain multiple figures Then piece is scanned plurality of pictures respectively.For example, can use preset first window size and first movement step-length pair Single frames picture shown in Fig. 2 is sampled, i.e. the every mobile first movement step-length of window, then intercepts the first window from the single frames picture The picture of mouthful size, can since any bar side of single frames picture screenshot, can also be opened from any region among single frames picture Beginning screenshot.Window can be rule square, such as 40mm*40mm, be also possible to rule rectangle, such as 40mm*30mm, It can be other irregular shapes, there is no special restriction on this for this example, and it is upper need to only to guarantee that preset first window size is less than State the size of single frames picture;Preset first movement step-length length can be a unit length, be also possible to two unit lengths, If first movement step-length is 20mm, there is no special restriction on this for this example.In the specific implementation, in order to improve icon prediction prediction Accuracy, above-mentioned first window size and first movement step-length cannot be too big;Also, in order to guarantee icon prediction efficiency, Above-mentioned first window size and first movement step-length can not be too small, specifically can be according to the size of single frames picture and terminal Calculation processing ability determines the value of first window size and first movement step-length.
In step s 320, copy icon-based programming is carried out by every picture of the preset deep learning model to interception, The every picture intercepted includes the confidence level of copy icon.
In this example embodiment, after the picture for obtaining obtaining above by traversal interception single frames picture, by pre- If deep learning model copy icon-based programming is carried out to every picture of interception;Wherein, which is Based on neural network model and by what is be trained to a large amount of training sample, which can be by history The single frames picture of game transcript handled to obtain;Further, when by preset deep learning model to every picture After carrying out copy icon-based programming, available every picture includes the confidence level of copy icon.
In step S330, using obtained every picture include in the confidence level of copy icon maximum confidence level as The single frames picture includes the confidence level of copy icon.
It is described to the single frames when the game transcript status information is copy title in this example embodiment The identification of picture progress game transcript status information, comprising: the single frames picture is carried out using preset deep learning model The identification of copy title obtains prediction copy title and corresponding confidence level;If the confidence level of the prediction copy title is greater than Preset threshold, then using the corresponding game transcript of the prediction copy title as recognition result.Specifically, refering to what is shown in Fig. 4, benefit It may include step S410- step with the identification that preset deep learning model carries out copy title to the single frames picture S430 is described in detail below.
In step S410, figure is carried out to the single frames picture using preset second window size and the second moving step length Piece interception, wherein the second window size is less than the size of the single frames picture.
In this example embodiment, preset second window size can use (for example, the second window size can be with It is 40mm*40mm, be also possible to other sizes, such as can be 30mm*30mm etc., there is no special restriction on this for this example, Also, above-mentioned second window size is less than the size of above-mentioned single frames picture) and the second moving step length (for example, this is second mobile Step-length can be a unit length, be also possible to two unit lengths, there is no special restriction on this for this example) in Fig. 2 In addition to there is edge stage property and the region unrelated with the gaming portion to carry out traversal interception, multiple capturing pictures are obtained.Its In, the capturing picture for example can be in Fig. 2 in addition to edge has stage property and the region unrelated with the gaming portion Subgraph is no longer illustrated one by one since quantity is more.It should be added that, predicted herein in order to improve icon And the accuracy of title prediction, above-mentioned second window size and the second moving step length cannot be too big;Further, in order to can To improve the efficiency of icon prediction and title prediction, above-mentioned second window size and the second moving step length can not be too small, It therefore, can be with value are as follows: the second pre-set dimension is 30mm*30mm;Second pre-set dimension is 2 unit lengths.
In the step s 420, the identification of copy title is carried out by every picture of the preset deep learning model to interception, The corresponding prediction copy title of the every picture intercepted and corresponding confidence level.
In step S430, set maximum in the corresponding confidence level of the corresponding prediction copy title of obtained every picture Reliability and corresponding prediction copy name are referred to as the confidence level and corresponding prediction copy title of the single frames picture.
Further, in this example embodiment, when the game transcript status information includes copy icon and pair When this title, the identification that game transcript status information is carried out to the single frames picture, comprising: utilize preset deep learning Model carries out the identification of copy icon to the single frames picture, obtains the confidence level in the single frames picture comprising copy icon; If the confidence level in the single frames picture comprising copy icon is greater than preset threshold, using preset deep learning model to institute The identification that single frames picture carries out copy title is stated, prediction copy title is obtained;The corresponding game of prediction copy title that will be obtained Copy is as recognition result.
Further, in this example embodiment, when the game transcript status information includes copy icon and pair When this title, the identification that game transcript status information is carried out to the single frames picture also may include: to utilize preset depth The identification that learning model carries out copy title to the single frames picture is spent, prediction copy title and corresponding confidence level are obtained;If It is described prediction copy title confidence level be greater than preset threshold, then using preset deep learning model to the single frames picture into The identification of row copy icon;If recognizing includes the corresponding copy icon of the prediction copy title in the single frames picture, Using the corresponding game transcript of the prediction copy title as recognition result.
In step s 130, the game direct broadcasting room is marked according to recognition result.
In this example embodiment, the game direct broadcasting room is marked according to recognition result and is specifically included: will be described The title of game direct broadcasting room is adjusted to the title to match with the title of the game transcript in the recognition result;Alternatively, determining Type belonging to game transcript in the recognition result, according to determining type to the displaying thumbnail of the game direct broadcasting room Carry out classification logotype;Alternatively, determine type belonging to the game transcript in the recognition result, it will be described according to determining type The displaying thumbnail of game direct broadcasting room is moved in the copy column of corresponding types.
Further, in this example embodiment, single frames picture, packet are obtained from the video flowing that game direct broadcasting room plays It includes: obtaining multiple single frames pictures from the video flowing that game direct broadcasting room plays.To, according to recognition result to game direct broadcasting room into Line flag may include: that the recognition result of every single frames picture in multiple single frames pictures according to acquisition determines that frequency of occurrence is most Game transcript;The game direct broadcasting room is marked according to frequency of occurrence most game transcript.
Further, the copy state information can be searched according to classification for the ease of user, game live streaming Between the method that shows can also include: type according to game transcript, classification marker is carried out to game direct broadcasting room.Specifically:
Firstly, the type of above-mentioned game transcript may include common copy, elite copy, more people's copies, challenge copy with And booty loft copy etc.;It is then possible to carry out classification marker to game direct broadcasting room according to the type of the game transcript;Example Such as, when the type of game transcript is elite copy, which can be labeled as elite copy;Then when user needs When watching such live streaming, the game direct broadcasting room can be found in the window of elite copy, and watched.Pass through the party Method saves the lookup time of user, further improves user experience.
Picture, which is broadcast live, in game has various colors, and content scene is changeable, and games window position is not fixed and picture quality The features such as just uneven, so that the traditional recognition method accuracy rate based on image procossing is not high.Game version update iteration is rapid, Recognition methods based on image procossing depends on the characteristics of image of engineer, and therefore, it is difficult to quickly cope with changing for game transcript Become.This programme uses the image recognition technology based on deep learning, and accuracy of identification is high, and is not necessarily to engineer's characteristics of image, It is fast thus to update iteration speed, can quickly cope with the variation of game transcript version.
Further, based on the image recognition technology of deep learning, it usually needs a large amount of marker samples train network Model, and taken time and effort by way of sample on line artificially collecting, cost dearly and be difficult to adapt to the fast of game transcript version Speed variation.This programme by using image processing techniques, automatically generate largely with picture sample similar in real screen, with meet Requirement of the deep learning to sample size.
Further, in example embodiment of the invention, on the one hand, by using the image based on deep learning Identification technology, the copy state information of picture is broadcast live in dynamic acquisition going game, and carries out classification marker to live streaming with this, so that Spectators can rapidly and accurately select oneself interested live streaming, and the user experience is improved.On the other hand, deep learning skill is utilized Art, and the method for automatically generating a large amount of training samples based on image procossing is used, improving game transcript recognition accuracy Meanwhile, it is capable to adapt to the quick update iteration of game transcript version.
The disclosure additionally provides a kind of device that game direct broadcasting room is shown.Refering to what is shown in Fig. 5, what the game direct broadcasting room was shown Device may include: that single frames picture obtains module 510, status information identification module 520 and mark module 530.Wherein:
Single frames picture, which obtains module 510, can be used for obtaining single frames picture from the video flowing that the game direct broadcasting room plays Face;
Status information identification module 520 can be used for carrying out the single frames picture identification of game transcript status information; Wherein, the game transcript status information includes at least one of the following: copy icon, copy title;
Mark module 530 can be used for that the game direct broadcasting room is marked according to recognition result.
It is described right when the game transcript status information is copy icon in a kind of example embodiment of the disclosure The identification that the single frames picture carries out game transcript status information includes:
The identification for being carried out copy icon to the single frames picture using preset deep learning model is obtained the single frames and drawn It include the confidence level of copy icon in face;
If the confidence level is greater than preset threshold, the corresponding game transcript of the copy icon that will identify that is as identification knot Fruit.
It is described right when the game transcript status information is copy title in a kind of example embodiment of the disclosure The single frames picture carries out the identification of game transcript status information, comprising:
The identification for carrying out copy title to the single frames picture using preset deep learning model obtains prediction copy name Title and corresponding confidence level;
If the confidence level of the prediction copy title is greater than preset threshold, by the corresponding game of the prediction copy title Copy is as recognition result.
In a kind of example embodiment of the disclosure, when the game transcript status information includes copy icon and copy name When title, the identification that game transcript status information is carried out to the single frames picture, comprising:
The identification for being carried out copy icon to the single frames picture using preset deep learning model is obtained the single frames and drawn It include the confidence level of copy icon in face;
If the confidence level in the single frames picture comprising copy icon is greater than preset threshold, preset deep learning is utilized Model carries out the identification of copy title to the single frames picture, obtains prediction copy title;
Using the obtained corresponding game transcript of prediction copy title as recognition result.
In a kind of example embodiment of the disclosure, when the game transcript status information includes copy icon and copy name When title, the identification that game transcript status information is carried out to the single frames picture, comprising:
The identification for carrying out copy title to the single frames picture using preset deep learning model obtains prediction copy name Title and corresponding confidence level;
If the confidence level of the prediction copy title is greater than preset threshold, using preset deep learning model to described The identification of single frames picture progress copy icon;
If recognizing comprising the corresponding copy icon of the prediction copy title in the single frames picture, by the prediction The corresponding game transcript of copy title is as recognition result.
It is described that the game direct broadcasting room is marked according to recognition result in a kind of example embodiment of the disclosure, Include:
The title of the game direct broadcasting room is adjusted to match with the title of the game transcript in the recognition result Title;Alternatively,
Type belonging to the game transcript in the recognition result is determined, according to determining type to the game direct broadcasting room Displaying thumbnail carry out classification logotype;Alternatively,
Type belonging to the game transcript in the recognition result is determined, according to determining type by the game direct broadcasting room Displaying thumbnail be moved in the copy column of corresponding types.
It is described to obtain single frames from the video flowing that the game direct broadcasting room plays in a kind of example embodiment of the disclosure Picture, comprising: obtain multiple single frames pictures from the video flowing that the game direct broadcasting room plays;
It is described that the game direct broadcasting room is marked according to recognition result, comprising:
The most game pair of frequency of occurrence is determined according to the recognition result of every single frames picture in multiple described single frames pictures This;
The game direct broadcasting room is marked according to the frequency of occurrence most game transcript.
In a kind of example embodiment of the disclosure, it is described using preset deep learning model to the single frames picture into The identification of row copy icon, comprising:
Picture interception is carried out to the single frames picture using preset first window size and first movement step-length, wherein The first window size is less than the size of the single frames picture;
Copy icon-based programming, every intercepted are carried out by every picture of the preset deep learning model to interception Picture includes the confidence level of copy icon;
Using obtained every picture include in the confidence level of copy icon maximum confidence level as the single frames picture It include the confidence level of copy icon.
In a kind of example embodiment of the disclosure, it is described using preset deep learning model to the single frames picture into The identification of row copy title, comprising:
Picture interception is carried out to the single frames picture using preset second window size and the second moving step length, wherein The second window size is less than the size of the single frames picture;
The identification of copy title, every intercepted are carried out by every picture of the preset deep learning model to interception The corresponding prediction copy title of picture and corresponding confidence level;
By maximum confidence level in the corresponding confidence level of the corresponding prediction copy title of obtained every picture and corresponding Prediction copy name is referred to as the confidence level and corresponding prediction copy title of the single frames picture.
The detail of each module is shown in corresponding game direct broadcasting room in the device that above-mentioned game direct broadcasting room is shown Method in be described in detail, therefore details are not described herein again.
It should be noted that although being referred to several modules or list for acting the equipment executed in the above detailed description Member, but this division is not enforceable.In fact, embodiment according to the present invention, it is above-described two or more Module or the feature and function of unit can embody in a module or unit.Conversely, an above-described mould The feature and function of block or unit can be to be embodied by multiple modules or unit with further division.
In addition, although describing each step of method in the present invention in the accompanying drawings with particular order, this does not really want These steps must be executed in this particular order by asking or implying, or having to carry out step shown in whole could realize Desired result.Additional or alternative, it is convenient to omit multiple steps are merged into a step and executed by certain steps, and/ Or a step is decomposed into execution of multiple steps etc..
Through the above description of the embodiments, those skilled in the art is it can be readily appreciated that example described herein is implemented Mode can also be realized by software realization in such a way that software is in conjunction with necessary hardware.Therefore, according to the present invention The technical solution of embodiment can be embodied in the form of software products, which can store non-volatile at one Property storage medium (can be CD-ROM, USB flash disk, mobile hard disk etc.) in or network on, including some instructions are so that a calculating Equipment (can be personal computer, server, mobile terminal or network equipment etc.) executes embodiment according to the present invention Method.
In an exemplary embodiment of the present invention, a kind of electronic equipment that can be realized the above method is additionally provided.
Person of ordinary skill in the field it is understood that various aspects of the invention can be implemented as system, method or Program product.Therefore, various aspects of the invention can be embodied in the following forms, it may be assumed that complete hardware embodiment, complete The embodiment combined in terms of full Software Implementation (including firmware, microcode etc.) or hardware and software, can unite here Referred to as circuit, " module " or " system ".
The electronic equipment 600 of this embodiment according to the present invention is described referring to Fig. 6.The electronics that Fig. 6 is shown Equipment 600 is only an example, should not function to the embodiment of the present invention and use scope bring any restrictions.
As shown in fig. 6, electronic equipment 600 is showed in the form of universal computing device.The component of electronic equipment 600 can wrap It includes but is not limited to: at least one above-mentioned processing unit 610, at least one above-mentioned storage unit 620, the different system components of connection The bus 630 of (including storage unit 620 and processing unit 610).
Wherein, the storage unit is stored with program code, and said program code can be held by the processing unit 610 Row, so that various according to the present invention described in the execution of the processing unit 610 above-mentioned " illustrative methods " part of this specification The step of illustrative embodiments.For example, the processing unit 610 can execute step S110 as shown in fig. 1: from described Single frames picture is obtained in the video flowing that game direct broadcasting room plays;S120: game transcript status information is carried out to the single frames picture Identification;Wherein, the game transcript status information includes at least one of the following: copy icon, copy title;Step S130: Judge in the replica prediction title whether to include that identical copies predict title;Step S140: according to recognition result to the trip Play direct broadcasting room is marked.
Storage unit 620 may include the readable medium of volatile memory cell form, such as Random Access Storage Unit (RAM) 6201 and/or cache memory unit 6202, it can further include read-only memory unit (ROM) 6203.
Storage unit 620 can also include program/utility with one group of (at least one) program module 6205 6204, such program module 6205 includes but is not limited to: operating system, one or more application program, other program moulds It may include the realization of network environment in block and program data, each of these examples or certain combination.
Bus 630 can be to indicate one of a few class bus structures or a variety of, including storage unit bus or storage Cell controller, peripheral bus, graphics acceleration port, processing unit use any bus structures in a variety of bus structures Local bus.
Electronic equipment 600 can also be with one or more external equipments 700 (such as keyboard, sensing equipment, bluetooth equipment Deng) communication, can also be enabled a user to one or more equipment interact with the electronic equipment 600 communicate, and/or with make Any equipment (such as the router, modulation /demodulation that the electronic equipment 600 can be communicated with one or more of the other calculating equipment Device etc.) communication.This communication can be carried out by input/output (I/O) interface 650.Also, electronic equipment 600 can be with By network adapter 660 and one or more network (such as local area network (LAN), wide area network (WAN) and/or public network, Such as internet) communication.As shown, network adapter 660 is communicated by bus 630 with other modules of electronic equipment 600. It should be understood that although not shown in the drawings, other hardware and/or software module can not used in conjunction with electronic equipment 600, including but not Be limited to: microcode, device driver, redundant processing unit, external disk drive array, RAID system, tape drive and Data backup storage system etc..
Through the above description of the embodiments, those skilled in the art is it can be readily appreciated that example described herein is implemented Mode can also be realized by software realization in such a way that software is in conjunction with necessary hardware.Therefore, according to the present invention The technical solution of embodiment can be embodied in the form of software products, which can store non-volatile at one Property storage medium (can be CD-ROM, USB flash disk, mobile hard disk etc.) in or network on, including some instructions are so that a calculating Equipment (can be personal computer, server, terminal installation or network equipment etc.) executes embodiment according to the present invention Method.
In an exemplary embodiment of the present invention, a kind of computer readable storage medium is additionally provided, energy is stored thereon with Enough realize the program product of this specification above method.In some possible embodiments, various aspects of the invention may be used also In the form of being embodied as a kind of program product comprising program code, when described program product is run on the terminal device, institute Program code is stated for executing the terminal device described in above-mentioned " illustrative methods " part of this specification according to this hair The step of bright various illustrative embodiments.
Refering to what is shown in Fig. 7, describing the program product for realizing the above method of embodiment according to the present invention 710, can using portable compact disc read only memory (CD-ROM) and including program code, and can in terminal device, Such as it is run on PC.However, program product of the invention is without being limited thereto, in this document, readable storage medium storing program for executing can be with To be any include or the tangible medium of storage program, the program can be commanded execution system, device or device use or It is in connection.
Described program product can be using any combination of one or more readable mediums.Readable medium can be readable letter Number medium or readable storage medium storing program for executing.Readable storage medium storing program for executing for example can be but be not limited to electricity, magnetic, optical, electromagnetic, infrared ray or System, device or the device of semiconductor, or any above combination.The more specific example of readable storage medium storing program for executing is (non exhaustive List) include: electrical connection with one or more conducting wires, portable disc, hard disk, random access memory (RAM), read-only Memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read only memory (CD-ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.
Computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal, In carry readable program code.The data-signal of this propagation can take various forms, including but not limited to electromagnetic signal, Optical signal or above-mentioned any appropriate combination.Readable signal medium can also be any readable Jie other than readable storage medium storing program for executing Matter, the readable medium can send, propagate or transmit for by instruction execution system, device or device use or and its The program of combined use.
The program code for including on readable medium can transmit with any suitable medium, including but not limited to wirelessly, have Line, optical cable, RF etc. or above-mentioned any appropriate combination.
The program for executing operation of the present invention can be write with any combination of one or more programming languages Code, described program design language include object oriented program language-Java, C++ etc., further include conventional Procedural programming language-such as " C " language or similar programming language.Program code can be fully in user It calculates and executes in equipment, partly executes on a user device, being executed as an independent software package, partially in user's calculating Upper side point is executed on a remote computing or is executed in remote computing device or server completely.It is being related to far Journey calculates in the situation of equipment, and remote computing device can pass through the network of any kind, including local area network (LAN) or wide area network (WAN), it is connected to user calculating equipment, or, it may be connected to external computing device (such as utilize ISP To be connected by internet).
In addition, above-mentioned attached drawing is only the schematic theory of processing included by method according to an exemplary embodiment of the present invention It is bright, rather than limit purpose.It can be readily appreciated that the time that above-mentioned processing shown in the drawings did not indicated or limited these processing is suitable Sequence.In addition, be also easy to understand, these processing, which can be, for example either synchronously or asynchronously to be executed in multiple modules.
Those skilled in the art will readily occur to of the invention its after considering specification and the invention invented here of practice His embodiment.This application is intended to cover any variations, uses, or adaptations of the invention, these modifications, purposes or Adaptive change follow general principle of the invention and the common knowledge in the art do not invented including the present invention or Conventional techniques.The description and examples are only to be considered as illustrative, and true scope and spirit of the invention are by claim It points out.

Claims (12)

1. a kind of method that game direct broadcasting room is shown characterized by comprising
Single frames picture is obtained from the video flowing that the game direct broadcasting room plays;
The identification of game transcript status information is carried out to the single frames picture;Wherein, the game transcript status information include with It is at least one of lower: copy icon, copy title;
The game direct broadcasting room is marked according to recognition result.
2. the method that game direct broadcasting room according to claim 1 is shown, which is characterized in that when the game transcript state is believed When breath is copy icon, the identification that game transcript status information is carried out to the single frames picture, comprising:
The identification for being carried out copy icon to the single frames picture using preset deep learning model, is obtained in the single frames picture Confidence level comprising copy icon;
If the confidence level is greater than preset threshold, the corresponding game transcript of copy icon that will identify that is as recognition result.
3. the method that game direct broadcasting room according to claim 1 is shown, which is characterized in that when the game transcript state is believed When breath is copy title, the identification that game transcript status information is carried out to the single frames picture, comprising:
Using preset deep learning model to the single frames picture carry out copy title identification, obtain prediction copy title and Corresponding confidence level;
If the confidence level of the prediction copy title is greater than preset threshold, by the corresponding game transcript of the prediction copy title As recognition result.
4. the method that game direct broadcasting room according to claim 1 is shown, which is characterized in that when the game transcript state is believed When breath includes copy icon and copy title, the identification that game transcript status information is carried out to the single frames picture, comprising:
The identification for being carried out copy icon to the single frames picture using preset deep learning model, is obtained in the single frames picture Confidence level comprising copy icon;
If the confidence level in the single frames picture comprising copy icon is greater than preset threshold, preset deep learning model is utilized The identification that copy title is carried out to the single frames picture obtains prediction copy title;
Using the obtained corresponding game transcript of prediction copy title as recognition result.
5. the method that game direct broadcasting room according to claim 1 is shown, which is characterized in that when the game transcript state is believed When breath includes copy icon and copy title, the identification that game transcript status information is carried out to the single frames picture, comprising:
Using preset deep learning model to the single frames picture carry out copy title identification, obtain prediction copy title and Corresponding confidence level;
If the confidence level of the prediction copy title is greater than preset threshold, using preset deep learning model to the single frames The identification of picture progress copy icon;
If recognizing comprising the corresponding copy icon of the prediction copy title in the single frames picture, by the prediction copy The corresponding game transcript of title is as recognition result.
6. the method that game direct broadcasting room according to any one of claims 2 to 5 is shown, which is characterized in that described according to knowledge The game direct broadcasting room is marked in other result, comprising:
The title of the game direct broadcasting room is adjusted to the title to match with the title of the game transcript in the recognition result; Alternatively,
Determine type belonging to the game transcript in the recognition result, the exhibition according to determining type to the game direct broadcasting room Show that thumbnail carries out classification logotype;Alternatively,
Type belonging to the game transcript in the recognition result is determined, according to determining type by the exhibition of the game direct broadcasting room Show that thumbnail is moved in the copy column of corresponding types.
7. the method that game direct broadcasting room according to any one of claims 2 to 5 is shown, which is characterized in that described from described Single frames picture is obtained in the video flowing that game direct broadcasting room plays, comprising: obtain from the video flowing that the game direct broadcasting room plays Multiple single frames pictures;
It is described that the game direct broadcasting room is marked according to recognition result, comprising:
The most game transcript of frequency of occurrence is determined according to the recognition result of every single frames picture in multiple described single frames pictures;
The game direct broadcasting room is marked according to the frequency of occurrence most game transcript.
8. the method that the game direct broadcasting room according to any one of claim 2,4,5 is shown, which is characterized in that the utilization Preset deep learning model carries out the identification of copy icon to the single frames picture, comprising:
Picture interception is carried out to the single frames picture using preset first window size and first movement step-length, wherein described First window size is less than the size of the single frames picture;
Copy icon-based programming, the every picture intercepted are carried out by every picture of the preset deep learning model to interception It include the confidence level of copy icon;
Using obtained every picture include in the confidence level of copy icon maximum confidence level as the single frames picture include There is the confidence level of copy icon.
9. the method that game direct broadcasting room according to any one of claim 3 to 5 is shown, which is characterized in that the utilization Preset deep learning model carries out the identification of copy title to the single frames picture, comprising:
Picture interception is carried out to the single frames picture using preset second window size and the second moving step length, wherein described Second window size is less than the size of the single frames picture;
The identification of copy title, the every picture intercepted are carried out by every picture of the preset deep learning model to interception Corresponding prediction copy title and corresponding confidence level;
By maximum confidence level and corresponding prediction in the corresponding confidence level of the corresponding prediction copy title of obtained every picture Copy name is referred to as the confidence level and corresponding prediction copy title of the single frames picture.
10. the device that a kind of game direct broadcasting room is shown characterized by comprising
Single frames picture obtains module, for obtaining single frames picture from the video flowing that the game direct broadcasting room plays;
Status information identification module, for carrying out the identification of game transcript status information to the single frames picture;Wherein, the trip Play copy state information includes at least one of the following: copy icon, copy title;
Mark module, for the game direct broadcasting room to be marked according to recognition result.
11. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program The method that the described in any item game direct broadcasting rooms of claim 1-9 are shown is realized when being executed by processor.
12. a kind of electronic equipment characterized by comprising
Processor;And
Memory, for storing the executable instruction of the processor;
Wherein, the processor is configured to require 1-9 described in any item via executing the executable instruction and carry out perform claim The method that game direct broadcasting room is shown.
CN201910114207.4A 2019-02-14 2019-02-14 The method and device of game direct broadcasting room displaying, storage medium, electronic equipment Pending CN109819271A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910114207.4A CN109819271A (en) 2019-02-14 2019-02-14 The method and device of game direct broadcasting room displaying, storage medium, electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910114207.4A CN109819271A (en) 2019-02-14 2019-02-14 The method and device of game direct broadcasting room displaying, storage medium, electronic equipment

Publications (1)

Publication Number Publication Date
CN109819271A true CN109819271A (en) 2019-05-28

Family

ID=66606568

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910114207.4A Pending CN109819271A (en) 2019-02-14 2019-02-14 The method and device of game direct broadcasting room displaying, storage medium, electronic equipment

Country Status (1)

Country Link
CN (1) CN109819271A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110365994A (en) * 2019-07-18 2019-10-22 广州虎牙科技有限公司 Recommended method, device, server and readable storage medium storing program for executing is broadcast live
CN111135571A (en) * 2019-12-30 2020-05-12 广州酷狗计算机科技有限公司 Game identification method, device, terminal, server and readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160219023A1 (en) * 2015-01-23 2016-07-28 Arris Enterprises, Inc. Reducing start-up delay in streaming media sessions
CN106998477A (en) * 2017-04-05 2017-08-01 腾讯科技(深圳)有限公司 The front cover display methods and device of live video
CN107569848A (en) * 2017-08-30 2018-01-12 武汉斗鱼网络科技有限公司 One kind game classification method, apparatus and electronic equipment
CN108737846A (en) * 2018-05-25 2018-11-02 广州虎牙信息科技有限公司 Direct broadcasting room display methods, device, server and medium
CN108769821A (en) * 2018-05-25 2018-11-06 广州虎牙信息科技有限公司 Scene of game describes method, apparatus, equipment and storage medium
CN108833936A (en) * 2018-05-25 2018-11-16 广州虎牙信息科技有限公司 Direct broadcasting room information-pushing method, device, server and medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160219023A1 (en) * 2015-01-23 2016-07-28 Arris Enterprises, Inc. Reducing start-up delay in streaming media sessions
CN106998477A (en) * 2017-04-05 2017-08-01 腾讯科技(深圳)有限公司 The front cover display methods and device of live video
CN107569848A (en) * 2017-08-30 2018-01-12 武汉斗鱼网络科技有限公司 One kind game classification method, apparatus and electronic equipment
CN108737846A (en) * 2018-05-25 2018-11-02 广州虎牙信息科技有限公司 Direct broadcasting room display methods, device, server and medium
CN108769821A (en) * 2018-05-25 2018-11-06 广州虎牙信息科技有限公司 Scene of game describes method, apparatus, equipment and storage medium
CN108833936A (en) * 2018-05-25 2018-11-16 广州虎牙信息科技有限公司 Direct broadcasting room information-pushing method, device, server and medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110365994A (en) * 2019-07-18 2019-10-22 广州虎牙科技有限公司 Recommended method, device, server and readable storage medium storing program for executing is broadcast live
CN111135571A (en) * 2019-12-30 2020-05-12 广州酷狗计算机科技有限公司 Game identification method, device, terminal, server and readable storage medium
CN111135571B (en) * 2019-12-30 2024-04-09 广州酷狗计算机科技有限公司 Game identification method, game identification device, terminal, server and readable storage medium

Similar Documents

Publication Publication Date Title
US11475666B2 (en) Method of obtaining mask frame data, computing device, and readable storage medium
US11871086B2 (en) Method of displaying comment information, computing device, and readable storage medium
CN107480236A (en) A kind of information query method, device, equipment and medium
CN110166842B (en) Video file operation method and device and storage medium
CN110865708A (en) Interaction method, medium, device and computing equipment of virtual content carrier
CN105933730A (en) Video association information recommendation method and device
CN111097168B (en) Display control method and device in game live broadcast, storage medium and electronic equipment
CN111401228A (en) Video target labeling method and device and electronic equipment
CN104508664A (en) Visualization of top local geographical entities through web search data
CN109819271A (en) The method and device of game direct broadcasting room displaying, storage medium, electronic equipment
US11533427B2 (en) Multimedia quality evaluation
US11483472B2 (en) Enhancing quality of multimedia
US11423654B2 (en) Identification of continuity errors in video by automatically detecting visual inconsistencies in video frames
CN107770580B (en) Video image processing method and device and terminal equipment
CN110102057B (en) Connecting method, device, equipment and medium for cut-scene animations
CN110197459B (en) Image stylization generation method and device and electronic equipment
CN114968044B (en) Picture display method and device, electronic equipment and storage medium
CN111242455A (en) Method and device for evaluating voice function of electronic map, electronic equipment and storage medium
CN112788390B (en) Control method, device, equipment and storage medium based on man-machine interaction
US11700285B2 (en) Filtering video content items
CN114268847A (en) Video playing method and device, electronic equipment and storage medium
US20220339542A1 (en) Video game overlay
CN108805951B (en) Projection image processing method, device, terminal and storage medium
CN112822555A (en) Shooting method, shooting device, electronic equipment and storage medium
CN110377843A (en) Direct broadcasting room processing method and processing device, electronic equipment, storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190528

RJ01 Rejection of invention patent application after publication