CN108124184A - A kind of method and device of living broadcast interactive - Google Patents

A kind of method and device of living broadcast interactive Download PDF

Info

Publication number
CN108124184A
CN108124184A CN201611064091.0A CN201611064091A CN108124184A CN 108124184 A CN108124184 A CN 108124184A CN 201611064091 A CN201611064091 A CN 201611064091A CN 108124184 A CN108124184 A CN 108124184A
Authority
CN
China
Prior art keywords
characteristic information
user
image
images
recognized
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611064091.0A
Other languages
Chinese (zh)
Inventor
蔡毅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Huaduo Network Technology Co Ltd
Original Assignee
Guangzhou Huaduo Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huaduo Network Technology Co Ltd filed Critical Guangzhou Huaduo Network Technology Co Ltd
Priority to CN201611064091.0A priority Critical patent/CN108124184A/en
Priority to PCT/CN2017/104468 priority patent/WO2018095142A1/en
Publication of CN108124184A publication Critical patent/CN108124184A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5838Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5862Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using texture
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254Management at additional data server, e.g. shopping server, rights management server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • Library & Information Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Strategic Management (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Databases & Information Systems (AREA)
  • Marketing (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Economics (AREA)
  • General Business, Economics & Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a kind of method and device of living broadcast interactive, when receive it is default check instruction when, using the picture of live video as images to be recognized;Extract the characteristic information of images to be recognized;It searches in the characteristic information storehouse pre-established with the presence or absence of characteristic information;When existing characteristics information in characteristic information storehouse, the merchandise news of article corresponding with characteristic information is shown to user using default exhibition method.The image in the live video region checked by the way that user is obtained to want, matched using the characteristic information and the characteristic information in characteristic information storehouse of image, then the article of region displaying whether in need is judged, when user wants the article of the video area checked displaying in need, the merchandise news of article is showed into user.As it can be seen that the merchandise news for the article checked using image recognition technology user to be identified to want, user is showed by the merchandise news of article, the merchandise news of article in live streaming can be shown naturally, improve user experience.

Description

A kind of method and device of living broadcast interactive
Technical field
The present invention relates to image processing field, more particularly to a kind of method and device of living broadcast interactive.
Background technology
With the development of Internet technology and the current demand of society, network direct broadcasting industry has been expedited the emergence of.Network direct broadcasting one As refer to that main broadcaster is wanted the content displaying of live streaming to spectators by main broadcaster by network technology, and main broadcaster can then utilize word, regard The means such as frequency carry out interactive with spectators.
Main broadcaster refers to the host or performing artist to leave the country in network direct broadcasting, and main broadcaster may be considered a kind of newborn duty Industry.Some main broadcasters are by the product placement in live content, to obtain additional economic interests.Main broadcaster is usually should using live streaming It is broadcast live with program, and spectators watch live streaming also with live streaming application program.Main broadcaster can be in live streaming using journey The ad content to be shown is set in the live streaming interface of sequence, i.e., by means such as word or pictures on live streaming interface, By exhibiting advertising content to spectators;The ad content to be shown can also be arranged directly in reality scene, i.e., in real field Photo either word is shown in scape so as to achieve the purpose that show advertisement.For example, be broadcast live in mobile video in application program, it is main The ad content to be shown can be set in a region at live streaming interface by broadcasting, and the advertising area at interface is by being broadcast live What application developer was provided, the user of spectators or application program is broadcast live by clicking in the advertisement of interface advertising area Rong Hou can jump to the displaying interface of a commodity, to achieve the effect that show commodity to user.
But show merchandise news using the advertising area at the live streaming interface that application program is broadcast live, influence whether anchor sheet The displaying of content is drilled, user can also be allowed to receive ad content more stiffly, and then influence the viewing experience of user.How straight Naturally the article to be shown in broadcasting, and then the usage experience for improving user is this field urgent problem to be solved, base In this, the present invention proposes a kind of method and device of living broadcast interactive.
The content of the invention
The object of the present invention is to provide a kind of methods of living broadcast interactive, and it is in the prior art that article is stiff to aim at solution Ground shows user in live streaming so that the problem of usage experience of user is relatively low;It is a further object of the present invention to provide one The device of kind living broadcast interactive, can show article naturally so that the usage experience of user is preferable.
In order to solve the above technical problems, the present invention provides a kind of method of living broadcast interactive, this method includes:
When receive it is default check instruction when, using the picture of live video as images to be recognized;
Extract the characteristic information of the images to be recognized;
It searches in the characteristic information storehouse pre-established with the presence or absence of the characteristic information;
When in the characteristic information storehouse there are during the characteristic information, using default exhibition method to user show with it is described The merchandise news of the corresponding article of characteristic information.
Optionally, the establishment step in the characteristic information storehouse includes:
The image of the article is obtained using graph capture device;
Extract the characteristic information of described image;
The characteristic information and the correspondence of merchandise news are established, is stored to the characteristic information storehouse.
Optionally, the characteristic information of the extraction images to be recognized includes:
Pretreatment operation is done to the images to be recognized, draws gray level image to be identified;
The gray level image to be identified is divided into the local cell domain of presetted pixel size;
According to the pixel gray value in the local cell domain, the corresponding characteristic in each local cell domain is drawn According to;
Statistical analysis is carried out to the characteristic, the texture feature vector of the images to be recognized is drawn, by the line Feature vector is managed as the characteristic information.
Optionally, it is described when receive it is default check instruction when, using the picture of the live video as images to be recognized Including:
When receiving the click commands of user, the point centered on the point that the user is clicked on intercepts the live streaming and regards The video image of the preset area of frequency, using the video image as the images to be recognized.
Optionally, it is described when in the characteristic information storehouse there are during the characteristic information, using default exhibition method to Family shows that the merchandise news of article corresponding with the characteristic information includes:
When the multiple characteristic informations to match in the characteristic information storehouse in the presence of the characteristic information with the images to be recognized When, obtain multiple correspondences;
According to multiple correspondences, show that the commodity of multiple corresponding articles are believed to the user with interface form Breath;
Wherein, multiple merchandise newss are shown in same interface or multiple merchandise newss are on different boundaries It is shown in face.
In addition, the present invention also provides a kind of device of living broadcast interactive, including:
Identify image collection module, for when receive it is default check instruction when, using the picture of live video as waiting to know Other image;
Extraction module, for extracting the characteristic information of the images to be recognized;
Searching module, for searching in the characteristic information storehouse pre-established with the presence or absence of the characteristic information;
Display module, for when in the characteristic information storehouse there are during the characteristic information, using default exhibition method to User shows the merchandise news of article corresponding with the characteristic information.
Optionally, further include:
Image capture module, for obtaining the image of the article using graph capture device;
Characteristic extracting module, for extracting the characteristic information of described image;
Module is established, for establishing the correspondence of the characteristic information and merchandise news, is stored to the characteristic information Storehouse.
Optionally, the extraction module includes:
Pretreatment unit for doing pretreatment operation to the images to be recognized, draws gray level image to be identified;
Division unit, for the gray level image to be identified to be divided into the local cell domain of presetted pixel size;
Characteristic computing unit, for according to the pixel gray value in the local cell domain, drawing each described The corresponding characteristic in local cell domain;
Statistical analysis unit for carrying out statistical analysis to the characteristic, draws the described of the images to be recognized Characteristic information.
Optionally, the identification image collection module includes:
Interception unit, for when receiving the click commands from the user, using the point that the user is clicked on as Central point intercepts the video image of the preset area of the live video, using the video image as the images to be recognized.
Optionally, the display module includes:
Acquiring unit, with when exist in the characteristic information storehouse match with the characteristic information of the images to be recognized it is more During a characteristic information, multiple correspondences are obtained;
Showing interface unit, for according to multiple correspondences, it is multiple right to be shown with interface form to the user The merchandise news for the article answered;
Wherein, multiple merchandise newss are shown in same interface or multiple merchandise newss are on different boundaries It is shown in face.
A kind of method and device of living broadcast interactive provided by the present invention, when receive it is default check instruction when, will be broadcast live The picture of video is as images to be recognized;Extract the characteristic information of the images to be recognized;Search the characteristic information pre-established It whether there is the characteristic information in storehouse;
When in the characteristic information storehouse there are during the characteristic information, using default exhibition method to user show with it is described The merchandise news of the corresponding article of characteristic information.The image in the live video region checked by the way that user is obtained to want, utilizes figure The characteristic information of picture matches with the characteristic information in characteristic information storehouse, then judges the object of region displaying whether in need The information of the article when there is article in the video area that user wants to check, is then showed user by product with certain exhibition method. As it can be seen that the merchandise news for the article checked using image recognition technology user to be identified to want, and then the commodity of the article are believed Breath shows user, can show the merchandise news of article naturally in live streaming, and then improves the use body of user It tests.
Description of the drawings
It, below will be to embodiment or existing for the clearer technical solution for illustrating the embodiment of the present invention or the prior art Attached drawing is briefly described needed in technology description, it should be apparent that, the accompanying drawings in the following description is only this hair Some bright embodiments, for those of ordinary skill in the art, without creative efforts, can be with root Other attached drawings are obtained according to these attached drawings.
A kind of flow diagram of the specific embodiment for the living broadcast interactive method that Fig. 1 is provided by the embodiment of the present invention;
The flow signal of another specific embodiment for the living broadcast interactive method that Fig. 2 is provided by the embodiment of the present invention Figure;
Fig. 3-1 is the sample schematic diagram of pending image;
Fig. 3-2 is the schematic diagram of the characteristic obtained after handling;
Fig. 4 is the schematic diagram of image deduplication operation;
Fig. 5 is the structure diagram of the device of living broadcast interactive provided in an embodiment of the present invention.
Specific embodiment
In order to which those skilled in the art is made to more fully understand the present invention program, with reference to the accompanying drawings and detailed description The present invention is described in further detail.Obviously, described embodiment be only part of the embodiment of the present invention rather than Whole embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise Lower all other embodiments obtained, belong to the scope of protection of the invention.
Refer to Fig. 1, a kind of stream of the specific embodiment for the living broadcast interactive method that Fig. 1 is provided by the embodiment of the present invention Journey schematic diagram.
Step 101:When receive it is default check instruction when, using the picture of live video as images to be recognized;
When the user for watching live video send it is default check instruction after, instruction is checked according to this and is currently broadcast to obtain The video pictures for the live video put, using the picture acquired as images to be recognized.It is understood that images to be recognized Can be the two field picture in live video, at this time can be using the entire picture of live video as images to be recognized, it can also It is the local cell domain of a two field picture, it at this time can be using a part of region of the picture of live video as images to be recognized.
It should be noted that default check that instruction is preset, when user wants to know about some of live video During Item Information in region, can instruction be checked by input accordingly, and then the purpose checked.It is preset and checks finger Order can be any one in click commands, double-click instruction and long-press instruction.User is using live streaming application program viewing During live video, input is default to check that the mode of instruction has very much.For example, when live streaming application program used by a user is shifting When application program is broadcast live in moved end, user can be clicked using finger either double-clicks live video picture, refers to so as to input click Instruction is either double-clicked in order;And when application program is broadcast live for computer end in live streaming application program used by a user, user at this time It can click using mouse or double-click live video picture, so as to input click commands or double-click instruction, certainly, such as When the display screen of fruit computer is touch-screen, finger input can also be utilized to check instruction.It should be evident that the above-mentioned point being previously mentioned It hits instruction, double-click instruction and long-press instruction is simply default checks instruction preferred embodiment, it is default to check that instruction be with For other types of instruction, details are not described herein.
It is the image of a frame frame static state due to video playing, therefore can inputs to preset and check instruction, and then obtains video A frame still image in image, is then handled to the image.Sectional drawing behaviour can be carried out by inputting click commands Make, then get the video image for wanting acquisition, in some embodiments of the invention, detailed process can be:When connecing When receiving the click commands from the user, the point centered on the point that the user is clicked on intercepts the live video The video image of preset area, using the video image as the images to be recognized.User can click touch using finger Shield to input click commands or input click commands using mouse-click video pictures, after receiving click commands, to straight It broadcasts video and carries out shot operation, obtain the video image of preset area.
The video image of preset area can refer to that the area of intercepted video image is to be manually set, you can to cut The video image of rounding live video picture as images to be recognized, make by the subregion that can also intercept live video picture For images to be recognized.It is understood that the size for the video image for wanting interception can be artificially adjusted, i.e., when user inputs When checking instruction, meeting user shows the screenshot box with certain size, and user can adjust the size of screenshot box, with adjustment The size for the video image to be intercepted.Local cell domain will be intercepted as images to be recognized, recognition efficiency higher, response Faster.For example, user, which is entered using mobile phone in live streaming interface, watches live video, and main broadcaster is showing commodity at this time, should Commodity can be clothes, shoes and cap and other items, and main broadcaster can wear commodity and can arbitrarily walk about with It is shown in all directions, in the image pickup scope that live streaming camera can also be placed.User can click on any position of commodity, The arbitrary region of current live video can also be clicked on, then the point centered on the point that user clicks on, screen printing resolution ratio 1/4 video pictures, as images to be recognized.Preset area is identified point for 1/4 video pictures of screen resolution Analysis, the performance cost that can cause mobile phone terminal is relatively low, and response will be fast, can significantly improve the usage experience of user.
Receive user checks instruction, then gets images to be recognized, which includes user and want to look into See the merchandise news of article.In order to enable users to recognize in detail the merchandise news for the article for wanting to check, it is necessary to obtaining The image information of images to be recognized analyzed, need to extract the feature of images to be recognized before analyzing image information Information.
Step 102:Extract the characteristic information of the images to be recognized;
It should be noted that characteristic information refers to the image information of characterization digital picture, the classification of characteristics of image has face Color characteristic, spatial relation characteristics, shape feature and textural characteristics etc., the difference of feature classification, the process of extraction also can phase The difference answered.
What textural characteristics characterized is the difference of the gray value of image slices vegetarian refreshments, can extract the textural characteristics of images to be recognized Information, and then the texture feature information of extraction is analyzed.In some examples of the present invention, texture feature information carries Taking process can be specially:Pretreatment operation is done to the images to be recognized, draws gray level image to be identified;It will be described to be identified Gray level image is divided into the local cell domain of presetted pixel size;According to the pixel gray value in the local cell domain, obtain Go out the corresponding characteristic in each local cell domain;Statistical analysis is carried out to the characteristic, is drawn described to be identified The texture feature vector of image, using the texture feature vector as the characteristic information.First by images to be recognized gray processing, turn For gray level image to be identified, in order to make the accuracy of the texture feature information of extraction, denoising operation can be carried out to image, and gone Operation of making an uproar can be completed using median filter and sharpening algorithm.The gray level image to be identified after denoising is divided into again more A local cell domain, the area in each of which local cell domain is identical, and the area in local cell domain is default.It can utilize Demosaicing algorithm by region division to be identified into the local cell domain of multiple preset areas, for example, being divided into multiple 16*16's Local cell domain.The gray value of the pixel in each local cell domain is compared again, draws characteristic, last profit The texture feature vector of images to be recognized is obtained with characteristic, texture feature vector is then believed for the feature of view picture images to be recognized Breath.It should be evident that texture feature information is a kind of preferred embodiment of characteristic information, characteristic information can also be it The image information of its classification, corresponding extraction process are no longer further described illustrating herein.
Since the images to be recognized obtained may be comprising Item Information, it is also possible to the merchandise news of the article included The merchandise news of displaying is not intended to, therefore after the characteristic information of extraction images to be recognized, it is also necessary to it is gone using characteristic information Judge whether there is the merchandise news for wanting displaying in the images to be recognized.
Step 103:It searches in the characteristic information storehouse pre-established with the presence or absence of the characteristic information;
It is compared using the characteristic information of extraction with the characteristic information in the characteristic information storehouse pre-established, passes through judgement It compares and whether unanimously determines the characteristic information for whether having images to be recognized in characteristic information storehouse.When needing to be known in characteristic information storehouse During the characteristic information of other image, show the article of displaying in need in images to be recognized, when not to be identified in characteristic information storehouse During the characteristic information of image, show do not have to need the article shown in images to be recognized.
Various features information is included in characteristic information storehouse, various features information corresponds to the article of a variety of required displayings, And each characteristic information can have multiple characteristic informations, i.e., each article corresponds to multiple characteristic informations.Each article Multiple characteristic informations are corresponded to, multiple and different characteristic informations can include the different visual angles and different distance of article well Under characteristic information, can make article identify accuracy rate higher.For example, 8 different characteristic information of article can be stored In characteristic information storehouse, this 8 characteristic informations are that the image pattern of the different visual angles and different distance by extracting article obtains , it can be very good the characteristic information of characterization article all angles and different distance.
In characteristic information storehouse, in addition to it can store characteristic information, characteristic information and merchandise news can also be stored Correspondence.On the premise of characteristic information is known, corresponding article can be easily found by the correspondence Merchandise news.Therefore in the case where each article corresponds to multiple characteristic informations, the merchandise news of the article corresponds to multiple spies Reference ceases.And merchandise news can be image information, pricing information and classification information of article etc..It can be pre-selected spy Reference breath is bound with default merchandise news.Correspondence can be the one-to-one ID of article, i.e. characteristic information and business There are one ID between product information, corresponding unique ID can be found by characteristic information, then can be found pair according to unique ID The merchandise news for the article answered.Certainly, correspondence can also be relation of the merchandise news directly with characteristic information between the two, The merchandise news of corresponding article can be found by characteristic information.It should be evident that above-mentioned correspondence is simply preferred Embodiment not fully includes all embodiments of correspondence.
The characteristic information of images to be recognized is matched compared with the image pattern information in characteristic information storehouse, to find Go out in the images to be recognized merchandise news for including article.Pre-establishing for its characteristic information storehouse various is thought by gathering in advance The sample image for the article to be shown extracts the sample characteristics information of the sample image, can be established according to sample characteristics information Characteristic information storehouse.In some embodiments of the invention, characteristic information storehouse establishes process and can be specially:It is adopted using figure Collect the image that equipment obtains the article;Extract the characteristic information of described image;Establish the characteristic information and merchandise news Correspondence is stored to the characteristic information storehouse.The sample image of picture is gathered using image capture device, the sample image Quantity can be a width, but in order to make the accuracy rate of identification high as much as possible, and it is up and down etc. each can to gather the article The image and image capture device at visual angle and the image in the case of the different distance of the article.For a corresponding article, adopt The sample image of collection is more, and the number of the characteristic information of extraction is also more, and the accuracy rate of identification also can be improved correspondingly, identification Efficiency can then accordingly decrease.It is comprehensive to weigh recognition efficiency and recognition accuracy, can the front of the article, the back side, The left side and 4, back side visual angle, and 8 sample images of two different distances are gathered under this 4 different visual angles respectively.Example Such as, in image capture device apart from positive visual angle, back side visual angle, the left side of the position of article 0.5m and 4m, respectively acquisition article Face visual angle and the sample image at back side visual angle then have the 4 width sample images of 0.5m and the 4 width sample images of 4m.
When the characteristic information there are images to be recognized in characteristic information storehouse, then showing to have in the region that user is checked needs The merchandise news for the article to be shown.
Step 104:When in the characteristic information storehouse there are during the characteristic information, using default exhibition method to user's exhibition Show the merchandise news of article corresponding with the characteristic information.
When there is the characteristic information of images to be recognized in characteristic information storehouse, by the corresponding article display of this feature information to use Family, user is it is seen that merchandise news on the article.It is understood that the merchandise news can refer to the advertisement of article Information.
Default exhibition method can be interface form, that is, jump out an interface to user, which can be live streaming application Interface in program or some interface specified is linked to outside.It can include the merchandise news on article on the interface Link, corresponding merchandise news can be viewed by clicking on the link, can also include the corresponding merchandise news of article.By commodity Merchandise news show user, for example, user click on live video arbitrary region after, identified using image analysis algorithm Include the article identification information of the advance typing of main broadcaster to the region, then corresponding business is determined according to obtained characteristic information Product are, for example, clothes, then jump on a purchase interface, there is the merchandise news of the clothes on the purchase interface, and user also may be used To buy the clothes at the interface.Certainly, default exhibition method is not limited to interface form mentioned above, is not limited thereto.
Multiple merchandise newss can be included in images to be recognized, accordingly also have multiple and different characteristic informations.Into During row article display, multiple articles can be shown using different exhibition methods.In some embodiments of the invention, It shows that the process of multiple merchandise newss can be specially:When there is spy with the images to be recognized in the characteristic information storehouse During the matched multiple characteristic informations of reference manner of breathing, multiple correspondences are obtained;According to multiple correspondences, with interface Form shows the merchandise news of multiple corresponding articles to the user;Wherein, multiple merchandise newss are in same interface It is shown or multiple merchandise newss is shown in different interfaces.Multiple characteristic informations correspond to a variety of corresponding passes System obtains the merchandise news of corresponding article according to multiple correspondences of return, and then carries out the displaying of merchandise news.
The method for the living broadcast interactive that the embodiment of the present invention is provided, when receive it is default check instruction when, by live video Picture as images to be recognized;Extract the characteristic information of images to be recognized;Search in the characteristic information storehouse that pre-establishes whether Existing characteristics information;When existing characteristics information in characteristic information storehouse, believed using default exhibition method to user's displaying with feature Cease the merchandise news of corresponding article.The image in the live video region checked by the way that user is obtained to want, utilizes the spy of image Reference breath matches with the characteristic information in characteristic information storehouse, then judge the article of region displaying whether in need, when with There is article in the video area that family is wanted to check, then the information of the article is showed user with certain exhibition method.It is as it can be seen that sharp With the merchandise news for the article that image recognition technology is checked user to be identified to want, and then the merchandise news of the article is showed User can show the merchandise news of article naturally in live streaming, and then improve the usage experience of user.
Present main broadcaster is usually what is be broadcast live using application program is broadcast live, and the live streaming instrument used can be mobile phone Or the terminals such as computer.Main broadcaster can advertise in live streaming in live streaming, i.e., by being broadcast live merchandise display to user to reach The effect of advertisement.When main broadcaster is broadcast live and during promotion item information, user can enter the live streaming of the main broadcaster using mobile phone Interface viewing live streaming, then when main broadcaster carries out merchandise display, user obtains the purchase of corresponding goods by clicking on commodity region Information is bought, completes living broadcast interactive shopping.Above-mentioned living broadcast interactive shopping process is introduced below.
Refer to Fig. 2, another specific embodiment for the living broadcast interactive method that Fig. 2 is provided by the embodiment of the present invention Flow diagram.
Step 201:The sample image of commodity is obtained, and extracts the texture feature information of sample image;
The sample image of commodity is shot using camera, the sample image that shooting obtains is sent to processor.First The commodity page of live streaming application program is opened, inputs the merchandise news of article, after the completion of input, then the identification letter of typing commodity Breath;Moreover by the front of camera face commodity, and the distance of camera and commodity is pre-determined distance, and click recognition button carries out Identification, if identified successfully, then it represents that the positive sample image of commodity has succeeded typing;Then by camera face commodity Left surface, and the distance of camera and commodity is pre-determined distance, click recognition button is identified, if identified successfully, table Show that the sample image of the left surface of commodity has succeeded typing.With above-mentioned input method to the back side of commodity and the sample of right flank Image is acquired typing, completes identification information, that is, sample image of typing commodity.It should be evident that pre-determined distance can be 0.5m, 2 or other numerical value.To same commodity, the sample image of different pre-determined distances can be gathered, it is accurate to be identified with increase Rate.For example, pre-determined distance can be gathered respectively as 0.5m and 2m fronts sample image, back side sample image, left samples image And right side sample image.Certainly, pre-determined distance and the angle of acquisition are not limited to mentioned above.
The sample image of commodity is collected afterwards, it is necessary to extract the texture feature information of the sample image of acquisition.First Sample image is converted into the gray scale image of HSV, obtains sample gray level image, median filter is recycled afterwards and sharpens and calculate Noise in method removal sample gray level image, moreover sample gray level image is divided into presetted pixel size using demosaicing algorithm Small lattice.By the central pixel point in each small lattice compared with the gray value of 8 adjacent pixels, if surrounding picture The gray value of vegetarian refreshments is more than the gray value of central pixel point, then the position of the pixel is denoted as 1, on the contrary then be designated as 0, to obtain Whole characteristics of sample image, for example, referring to Fig. 3-1, Fig. 3-2.Fig. 3-1 is that the sample of pending image is illustrated Figure;Fig. 3-2 is the schematic diagram of the characteristic obtained after handling.By Fig. 3-1 after denoising operation, division operation, in basis The grey value difference of pixel draws the characteristic schematic diagram of Fig. 3-2.It should be evident that the denoising and division of sample image Method be not limited to above-mentioned be previously mentioned.
After the characteristic of all sample images is got, deduplication operation is carried out to characteristic, is rejected useless Interference characteristic obtains pure characteristic.For example, referring to Fig. 4, Fig. 4 is the schematic diagram of image deduplication operation.By the sample of 0.5m The characteristic of this image and the characteristic of the sample image of 2m are compared, and interference characteristic are rejected, after proposition obtains duplicate removal Corresponding pure characteristic.
After obtaining pure characteristic, the histogram of each small lattice characteristic point in every group of data can be calculated, that is, is united The probability distribution situation of the gray value of each pixel is counted, then histogram is normalized, it finally will be after normalization Histogram is connected as feature vector, and feature vector is texture feature vector, is texture feature information.When there is 8 groups of pure spies When levying data, correspondingly there are 8 groups of texture feature vectors.
Step 202:Texture feature information and corresponding goods are bound, generate unique ID, establishes characteristic information storehouse;
It on the texture feature vector drawn is uploaded onto the server, is bound, and is generated only one by one with corresponding commodity One corresponding ID establishes feature database according to texture feature vector and corresponding ID.Such as when the texture feature vector drawn is 8 When a, 8 texture feature informations can be done layout sequence, be packaged into a binary feature recognition file and be synchronized to Server.So far the typing identification information of commodity, establishes characteristic information storehouse.Certainly, when necessary, can record again Enter the identification information of commodity.
Step 203:Obtain images to be recognized;
When the user of live streaming application program enters live streaming interface, live streaming application program can download main broadcaster's characteristic information storehouse Into live streaming application program used by a user, so as to the calling of follow-up identification step, live streaming application program can be mobile phone terminal Live streaming application program, or the live streaming application program of computer end, be, for example, protruding canine teeth live streaming.When user clicks on live video When, then the point centered on the point clicked on, intercepts the video image of certain area as images to be recognized, which is whole The local cell domain of a video clip.For example, user, which is entered in live streaming interface, watches live video, main broadcaster is showing at this time Commodity, which can be clothes, shoes and other items, and main broadcaster can wear clothes with it and arbitrarily walk about to carry out complete It shows to orientation, the visual range included by live streaming camera can also be placed.User can click on any position of the commodity, The arbitrary region of current live video can also be clicked on, then the point centered on the point that user clicks on, screen printing resolution ratio 1/4 video image is as images to be recognized.It is understood that the mode of above-mentioned acquisition images to be recognized is a kind of preferred Embodiment, images to be recognized can also be obtained using other modes.
Step 204:Extract the texture feature information of images to be recognized;
The images to be recognized of acquisition is converted into grayscale picture, and the noise in gray level image to be identified is removed, denoising Method can utilize median filter and sharpening algorithm, moreover divide gray level image to be identified using demosaicing algorithm, will Gray level image to be identified is divided into the small lattice of certain area, is, for example, 16*16 elemental area sizes.Using depth of field algorithm remove from The small lattice of screen farther out.The characteristic of each small lattice of extraction, the process of extraction were extracted with the texture feature information of step 201 Journey is similar, and details are not described herein.Statistics draws the histogram of each small lattice characteristic point in every group of data, and normalizing is carried out to histogram Change is handled, and the texture feature vector of images to be recognized is being drawn according to the histogram after normalization.
Step 205:Whether search has the texture feature information of images to be recognized in characteristic information storehouse;
It is done using the texture feature vector in the texture feature vector and feature database obtained before and compared one by one, when discovery has During matched feature vector, then show the commodity of displaying in need in the region that user is clicked on.It is returned according to texture feature vector Return the ID of corresponding goods
Step 206:When there is the texture feature information of images to be recognized in characteristic information storehouse, then corresponding ID, root are obtained According to ID by corresponding merchandise display to user.
According to the ID of return, obtain corresponding merchandise news, and by merchandise news by showing interface to user.For example, Corresponding purchase interface can be jumped to according to ID, merchandise news and purchase commodity are recognized that at the purchase interface.
It is understood that main broadcaster may show a variety of commodity, such as clothes, cap and trousers etc., Zhu Boke simultaneously It clothes, cap and trousers to be worn, arbitrarily walks about and carries out advertising display, user can be clicked in video at this time Garment region, cap region and trousers region, to get the purchase information of corresponding commodity respectively.I.e. same images to be recognized In can include multiple characteristic areas, user can click on different characteristic region at this time, to recognize different characteristic area The corresponding merchandise news in domain.
The identification information of the method for the living broadcast interactive that the embodiment of the present invention is provided, in advance typing commodity, for follow-up identification Process provides initial data.When user clicks on the arbitrary region of live video, then user is determined using image recognition technology The product features information of typing before whether the region clicked on has.If so, corresponding merchandise news is then showed into user, To complete living broadcast interactive shopping.Intelligent recognition is carried out by the local cell domain clicked on to user, compared to most picture in its entirety into Row identification, recognition efficiency higher is lower to the expense of performance, without testing and analyzing every time.Whole process is naturally quick, The shopping experience of user is greatly improved.
Living broadcast interactive device provided in an embodiment of the present invention is introduced below, living broadcast interactive device described below with Above-described living broadcast interactive method can correspond reference.
Fig. 5 is the structure diagram of the device of living broadcast interactive provided in an embodiment of the present invention, with reference to the device of Fig. 5 living broadcast interactives It can include:
Identify image collection module 501, for when receive it is default check instruction when, picture using live video is as treating Identify image;
Extraction module 502, for extracting the characteristic information of the images to be recognized;
Searching module 503, for searching in the characteristic information storehouse pre-established with the presence or absence of the characteristic information;
Display module 504, for when, there are during the characteristic information, utilizing default exhibition method in the characteristic information storehouse The merchandise news of article corresponding with the characteristic information is shown to user.
Optionally, further include:
Image capture module 505, for obtaining the image of the article using graph capture device;
Characteristic extracting module 506, for extracting the characteristic information of described image;
Module 507 is established, for establishing the correspondence of the characteristic information and merchandise news, stores to the feature and believes Cease storehouse.
Optionally, the extraction module 502 includes:
Pretreatment unit for doing pretreatment operation to the images to be recognized, draws gray level image to be identified;
Division unit, for the gray level image to be identified to be divided into the local cell domain of presetted pixel size;
Characteristic computing unit, for according to the pixel gray value in the local cell domain, drawing each described The corresponding characteristic in local cell domain;
Statistical analysis unit for carrying out statistical analysis to the characteristic, draws the described of the images to be recognized Characteristic information.
Optionally, the identification image collection module 501 includes:
Interception unit, for when receiving the click commands from the user, using the point that the user is clicked on as Central point intercepts the video image of the preset area of the live video, using the video image as the images to be recognized.
Optionally, the display module 504 includes:
Acquiring unit, with when exist in the characteristic information storehouse match with the characteristic information of the images to be recognized it is more During a characteristic information, multiple correspondences are obtained;
Showing interface unit, for according to multiple correspondences, it is multiple right to be shown with interface form to the user The merchandise news for the article answered;
Wherein, multiple merchandise newss are shown in same interface or multiple merchandise newss are on different boundaries It is shown in face.
The device for the living broadcast interactive that the embodiment of the present invention is provided, device are regarded by obtaining the live streaming that user wants to check The image in frequency domain is matched using the characteristic information and the characteristic information in characteristic information storehouse of image, then judges the region Whether the article of displaying in need, when there is article in the video area that user wants to check, then by the information of the article with certain Exhibition method shows user.Using the merchandise news for the article that image recognition technology is checked user to be identified to want, and then will The merchandise news of the article shows user, can show the merchandise news of article naturally in live streaming, Jin Erti The usage experience of high user.
Each embodiment is described by the way of progressive in this specification, the highlights of each of the examples are with it is other The difference of embodiment, just to refer each other for same or similar part between each embodiment.For dress disclosed in embodiment For putting, since it is corresponded to the methods disclosed in the examples, so description is fairly simple, related part is referring to method part Explanation.
Professional further appreciates that, with reference to each exemplary unit of the embodiments described herein description And algorithm steps, can be realized with the combination of electronic hardware, computer software or the two, in order to clearly demonstrate hardware and The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These Function is performed actually with hardware or software mode, specific application and design constraint depending on technical solution.Specialty Technical staff can realize described function to each specific application using distinct methods, but this realization should not Think beyond the scope of this invention.
It can directly be held with reference to the step of method or algorithm that the embodiments described herein describes with hardware, processor The combination of capable software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only deposit Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology In any other form of storage medium well known in field.
The method and device of living broadcast interactive provided by the present invention are described in detail above.It is used herein Specific case is set forth the principle of the present invention and embodiment, and the explanation of above example is only intended to help to understand this The method and its core concept of invention.It should be pointed out that for those skilled in the art, this hair is not being departed from On the premise of bright principle, can also to the present invention some improvement and modification can also be carried out, these improvement and modification also fall into power of the present invention In the protection domain of profit requirement.

Claims (10)

  1. A kind of 1. method of living broadcast interactive, which is characterized in that including:
    When receive it is default check instruction when, using the picture of live video as images to be recognized;
    Extract the characteristic information of the images to be recognized;
    It searches in the characteristic information storehouse pre-established with the presence or absence of the characteristic information;
    When in the characteristic information storehouse there are during the characteristic information, using default exhibition method to user's displaying and the feature The merchandise news of the corresponding article of information.
  2. 2. the method as described in claim 1, which is characterized in that the establishment step in the characteristic information storehouse includes:
    The image of the article is obtained using graph capture device;
    Extract the characteristic information of described image;
    The characteristic information and the correspondence of merchandise news are established, is stored to the characteristic information storehouse.
  3. 3. method as claimed in claim 2, which is characterized in that the characteristic information of the extraction images to be recognized includes:
    Pretreatment operation is done to the images to be recognized, draws gray level image to be identified;
    The gray level image to be identified is divided into the local cell domain of presetted pixel size;
    According to the pixel gray value in the local cell domain, the corresponding characteristic in each local cell domain is drawn;
    Statistical analysis is carried out to the characteristic, draws the texture feature vector of the images to be recognized, the texture is special Sign vector is used as the characteristic information.
  4. 4. method as described in any one of claims 1 to 3, which is characterized in that it is described when receive it is default check instruction when, will The picture of the live video includes as images to be recognized:
    When receiving the click commands of user, the point centered on the point that the user is clicked on intercepts the live video The video image of preset area, using the video image as the images to be recognized.
  5. 5. method as claimed in claim 2, which is characterized in that described when there are the characteristic informations in the characteristic information storehouse When, show that the merchandise news of article corresponding with the characteristic information includes to user using default exhibition method:
    When there is the multiple characteristic informations to match with the characteristic information of the images to be recognized in the characteristic information storehouse, obtain Take multiple correspondences;
    According to multiple correspondences, the merchandise news of multiple corresponding articles is shown to the user with interface form;
    Wherein, multiple merchandise newss are shown in same interface or multiple merchandise newss are in different interfaces It is shown.
  6. 6. a kind of device of living broadcast interactive, which is characterized in that including:
    Identify image collection module, for when receive it is default check instruction when, using the picture of live video as figure to be identified Picture;
    Extraction module, for extracting the characteristic information of the images to be recognized;
    Searching module, for searching in the characteristic information storehouse pre-established with the presence or absence of the characteristic information;
    Display module, for when in the characteristic information storehouse there are during the characteristic information, using default exhibition method to user The merchandise news of displaying article corresponding with the characteristic information.
  7. 7. device as claimed in claim 6, which is characterized in that further include:
    Image capture module, for obtaining the image of the article using graph capture device;
    Characteristic extracting module, for extracting the characteristic information of described image;
    Module is established, for establishing the correspondence of the characteristic information and merchandise news, is stored to the characteristic information storehouse.
  8. 8. device as claimed in claim 7, which is characterized in that the extraction module includes:
    Pretreatment unit for doing pretreatment operation to the images to be recognized, draws gray level image to be identified;
    Division unit, for the gray level image to be identified to be divided into the local cell domain of presetted pixel size;
    Characteristic computing unit, for according to the pixel gray value in the local cell domain, drawing each part The corresponding characteristic in zonule;
    Statistical analysis unit for carrying out statistical analysis to the characteristic, draws the feature of the images to be recognized Information.
  9. 9. such as claim 6 to 8 any one of them device, which is characterized in that the identification image collection module includes:
    Interception unit, for when receiving the click commands from the user, centered on the point that the user is clicked on Point intercepts the video image of the preset area of the live video, using the video image as the images to be recognized.
  10. 10. device as claimed in claim 7, which is characterized in that the display module includes:
    Acquiring unit, for work as in the characteristic information storehouse exist match with the characteristic information of the images to be recognized it is multiple During characteristic information, multiple correspondences are obtained;
    Showing interface unit for according to multiple correspondences, is shown with interface form to the user multiple corresponding The merchandise news of article;
    Wherein, multiple merchandise newss are shown in same interface or multiple merchandise newss are in different interfaces It is shown.
CN201611064091.0A 2016-11-28 2016-11-28 A kind of method and device of living broadcast interactive Pending CN108124184A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201611064091.0A CN108124184A (en) 2016-11-28 2016-11-28 A kind of method and device of living broadcast interactive
PCT/CN2017/104468 WO2018095142A1 (en) 2016-11-28 2017-09-29 Livestream interaction method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611064091.0A CN108124184A (en) 2016-11-28 2016-11-28 A kind of method and device of living broadcast interactive

Publications (1)

Publication Number Publication Date
CN108124184A true CN108124184A (en) 2018-06-05

Family

ID=62194714

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611064091.0A Pending CN108124184A (en) 2016-11-28 2016-11-28 A kind of method and device of living broadcast interactive

Country Status (2)

Country Link
CN (1) CN108124184A (en)
WO (1) WO2018095142A1 (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109118279A (en) * 2018-08-06 2019-01-01 北京绿善心星球网络科技开发有限公司 Online live streaming method of commerce, system, electronic equipment and readable storage medium storing program for executing
CN109598541A (en) * 2018-11-19 2019-04-09 中信国安广视网络有限公司 Large-size screen monitors advertisement recommended method based on video identification
CN109766466A (en) * 2018-12-29 2019-05-17 广东益萃网络科技有限公司 Querying method, device, computer equipment and the storage medium of product information
CN111539779A (en) * 2019-01-21 2020-08-14 阿里巴巴集团控股有限公司 Commodity page generation method, electronic equipment and computer storage medium
CN111612588A (en) * 2020-05-27 2020-09-01 腾讯科技(深圳)有限公司 Commodity presentation method and device, computing equipment and computer-readable storage medium
CN111626816A (en) * 2020-05-10 2020-09-04 石伟 Image interaction information processing method based on e-commerce live broadcast and cloud computing platform
CN111754302A (en) * 2020-06-24 2020-10-09 詹晨 Video live broadcast interface commodity display intelligent management system based on big data
CN112291576A (en) * 2020-10-14 2021-01-29 珠海格力电器股份有限公司 Virtual live broadcast system and method
CN113240488A (en) * 2021-05-14 2021-08-10 深圳迅销科技股份有限公司 System and method for displaying commodity information by using electronic commerce
CN113286204A (en) * 2021-05-13 2021-08-20 北京达佳互联信息技术有限公司 Information display method and device, computer equipment and computer readable storage medium
CN113382308A (en) * 2021-05-31 2021-09-10 北京达佳互联信息技术有限公司 Information display method and device, electronic equipment and computer readable storage medium
CN113596496A (en) * 2021-07-28 2021-11-02 广州博冠信息科技有限公司 Interaction control method, device, medium and electronic equipment for virtual live broadcast room
WO2021238631A1 (en) * 2020-05-27 2021-12-02 腾讯科技(深圳)有限公司 Article information display method, apparatus and device and readable storage medium
CN114449304A (en) * 2022-01-27 2022-05-06 北京达佳互联信息技术有限公司 Information display method, device, equipment, medium and product
CN114554294A (en) * 2022-03-04 2022-05-27 天比高零售管理(深圳)有限公司 Live broadcast content filtering and prompting method
CN114866853A (en) * 2022-04-12 2022-08-05 咪咕文化科技有限公司 Live broadcast interaction method, device, equipment and storage medium
WO2022237460A1 (en) * 2021-05-13 2022-11-17 北京字节跳动网络技术有限公司 Image processing method and device, storage medium, and program product

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110505497B (en) * 2019-07-31 2022-04-22 湖南微算互联信息技术有限公司 Cloud mobile phone operation monitoring method, system, device and storage medium
CN111144974B (en) * 2019-12-04 2022-03-08 北京三快在线科技有限公司 Information display method and device
CN111541907B (en) * 2020-04-23 2023-09-22 腾讯科技(深圳)有限公司 Article display method, apparatus, device and storage medium
CN113298587A (en) * 2020-05-25 2021-08-24 阿里巴巴集团控股有限公司 Shop commodity information display method, electronic equipment and client
CN113014934A (en) * 2021-01-29 2021-06-22 腾讯科技(深圳)有限公司 Product display method, product display device, computer equipment and storage medium
CN113055724B (en) * 2021-03-12 2023-01-20 北京达佳互联信息技术有限公司 Live broadcast data processing method, device, server, terminal, medium and product
CN113507626A (en) * 2021-04-19 2021-10-15 支付宝(杭州)信息技术有限公司 Commodity association method, device and equipment in video interaction
CN113810744B (en) * 2021-09-17 2023-03-21 北京快来文化传播集团有限公司 Commercial live broadcast wheat connecting system and method
CN113965771A (en) * 2021-10-22 2022-01-21 成都天翼空间科技有限公司 VR live broadcast user interactive experience system
CN114727138B (en) * 2022-03-31 2023-12-19 大众问问(北京)信息科技有限公司 Commodity information processing method, commodity information processing device and computer equipment
CN115225921B (en) * 2022-06-08 2024-02-06 深圳软银思创科技有限公司 Live broadcast interactive control method, device, equipment and storage medium based on big data
CN114928768A (en) * 2022-06-10 2022-08-19 北京百度网讯科技有限公司 Live broadcast information pushing method, device, system, electronic equipment and computer medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060075426A1 (en) * 2004-10-05 2006-04-06 Robert Koch Methods and computer program products for taking a secondary action responsive to receipt of an advertisement
CN102802055A (en) * 2011-05-25 2012-11-28 阿里巴巴集团控股有限公司 Data interaction method and device based on on-line video
CN104991906A (en) * 2015-06-17 2015-10-21 百度在线网络技术(北京)有限公司 Information acquisition method, server, terminal and method and device for database construction
US20150350729A1 (en) * 2014-05-28 2015-12-03 United Video Properties, Inc. Systems and methods for providing recommendations based on pause point in the media asset
CN105373938A (en) * 2014-08-27 2016-03-02 阿里巴巴集团控股有限公司 Method for identifying commodity in video image and displaying information, device and system
CN105681918A (en) * 2015-09-16 2016-06-15 乐视致新电子科技(天津)有限公司 Method and system for presenting article relevant information in video stream
CN105828123A (en) * 2016-03-30 2016-08-03 乐视控股(北京)有限公司 Method and apparatus for interaction in live broadcast
CN105916050A (en) * 2016-05-03 2016-08-31 乐视控股(北京)有限公司 TV shopping information processing method and device
CN106162213A (en) * 2016-07-11 2016-11-23 福建方维信息科技有限公司 A kind of merchandise display method and system based on net cast shopping

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060075426A1 (en) * 2004-10-05 2006-04-06 Robert Koch Methods and computer program products for taking a secondary action responsive to receipt of an advertisement
CN102802055A (en) * 2011-05-25 2012-11-28 阿里巴巴集团控股有限公司 Data interaction method and device based on on-line video
US20150350729A1 (en) * 2014-05-28 2015-12-03 United Video Properties, Inc. Systems and methods for providing recommendations based on pause point in the media asset
CN105373938A (en) * 2014-08-27 2016-03-02 阿里巴巴集团控股有限公司 Method for identifying commodity in video image and displaying information, device and system
CN104991906A (en) * 2015-06-17 2015-10-21 百度在线网络技术(北京)有限公司 Information acquisition method, server, terminal and method and device for database construction
CN105681918A (en) * 2015-09-16 2016-06-15 乐视致新电子科技(天津)有限公司 Method and system for presenting article relevant information in video stream
CN105828123A (en) * 2016-03-30 2016-08-03 乐视控股(北京)有限公司 Method and apparatus for interaction in live broadcast
CN105916050A (en) * 2016-05-03 2016-08-31 乐视控股(北京)有限公司 TV shopping information processing method and device
CN106162213A (en) * 2016-07-11 2016-11-23 福建方维信息科技有限公司 A kind of merchandise display method and system based on net cast shopping

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109118279A (en) * 2018-08-06 2019-01-01 北京绿善心星球网络科技开发有限公司 Online live streaming method of commerce, system, electronic equipment and readable storage medium storing program for executing
CN109598541A (en) * 2018-11-19 2019-04-09 中信国安广视网络有限公司 Large-size screen monitors advertisement recommended method based on video identification
CN109766466A (en) * 2018-12-29 2019-05-17 广东益萃网络科技有限公司 Querying method, device, computer equipment and the storage medium of product information
CN111539779A (en) * 2019-01-21 2020-08-14 阿里巴巴集团控股有限公司 Commodity page generation method, electronic equipment and computer storage medium
CN111626816A (en) * 2020-05-10 2020-09-04 石伟 Image interaction information processing method based on e-commerce live broadcast and cloud computing platform
WO2021238631A1 (en) * 2020-05-27 2021-12-02 腾讯科技(深圳)有限公司 Article information display method, apparatus and device and readable storage medium
CN111612588A (en) * 2020-05-27 2020-09-01 腾讯科技(深圳)有限公司 Commodity presentation method and device, computing equipment and computer-readable storage medium
CN111612588B (en) * 2020-05-27 2023-12-26 腾讯科技(深圳)有限公司 Commodity presenting method and device, computing equipment and computer readable storage medium
CN111754302A (en) * 2020-06-24 2020-10-09 詹晨 Video live broadcast interface commodity display intelligent management system based on big data
CN111754302B (en) * 2020-06-24 2021-04-27 广西壹农乐信息技术有限公司 Video live broadcast interface commodity display intelligent management system based on big data
CN112291576A (en) * 2020-10-14 2021-01-29 珠海格力电器股份有限公司 Virtual live broadcast system and method
CN113286204A (en) * 2021-05-13 2021-08-20 北京达佳互联信息技术有限公司 Information display method and device, computer equipment and computer readable storage medium
WO2022237460A1 (en) * 2021-05-13 2022-11-17 北京字节跳动网络技术有限公司 Image processing method and device, storage medium, and program product
CN113240488A (en) * 2021-05-14 2021-08-10 深圳迅销科技股份有限公司 System and method for displaying commodity information by using electronic commerce
CN113240488B (en) * 2021-05-14 2024-04-05 深圳迅销科技股份有限公司 System and method for displaying commodity information by utilizing electronic commerce
CN113382308A (en) * 2021-05-31 2021-09-10 北京达佳互联信息技术有限公司 Information display method and device, electronic equipment and computer readable storage medium
CN113382308B (en) * 2021-05-31 2022-11-22 北京达佳互联信息技术有限公司 Information display method and device, electronic equipment and computer readable storage medium
CN113596496A (en) * 2021-07-28 2021-11-02 广州博冠信息科技有限公司 Interaction control method, device, medium and electronic equipment for virtual live broadcast room
CN114449304A (en) * 2022-01-27 2022-05-06 北京达佳互联信息技术有限公司 Information display method, device, equipment, medium and product
CN114554294A (en) * 2022-03-04 2022-05-27 天比高零售管理(深圳)有限公司 Live broadcast content filtering and prompting method
CN114866853A (en) * 2022-04-12 2022-08-05 咪咕文化科技有限公司 Live broadcast interaction method, device, equipment and storage medium

Also Published As

Publication number Publication date
WO2018095142A1 (en) 2018-05-31

Similar Documents

Publication Publication Date Title
CN108124184A (en) A kind of method and device of living broadcast interactive
US10049308B1 (en) Synthesizing training data
US10395120B2 (en) Method, apparatus, and system for identifying objects in video images and displaying information of same
US10735494B2 (en) Media information presentation method, client, and server
US10956784B2 (en) Neural network-based image manipulation
JP6681342B2 (en) Behavioral event measurement system and related method
US9336459B2 (en) Interactive content generation
CN110297943B (en) Label adding method and device, electronic equipment and storage medium
US9607010B1 (en) Techniques for shape-based search of content
CN106202316A (en) Merchandise news acquisition methods based on video and device
CN110163076A (en) A kind of image processing method and relevant apparatus
CN104991906B (en) Information acquisition method, server, terminal, database construction method and device
CN106663196A (en) Computerized prominent person recognition in videos
CN110881134B (en) Data processing method and device, electronic equipment and storage medium
CN106095884A (en) A kind of relative article information processing method based on picture and device
CN108256537A (en) A kind of user gender prediction method and system
CN107590267A (en) Information-pushing method and device, terminal and readable storage medium storing program for executing based on picture
CN109213397B (en) Data processing method and device and user side
CN105005982A (en) Image processing including object selection
US20170013309A1 (en) System and method for product placement
KR20120100124A (en) System and method for providing video related service based on image
CN110796014A (en) Garbage throwing habit analysis method, system and device and storage medium
CN110020123B (en) Popularization information delivery method, device, medium and equipment
CN108156504B (en) Video display method and device
CN109522429A (en) Method and apparatus for generating information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180605

RJ01 Rejection of invention patent application after publication