WO2017045462A1 - 视频流中的物品相关信息展示方法及系统 - Google Patents
视频流中的物品相关信息展示方法及系统 Download PDFInfo
- Publication number
- WO2017045462A1 WO2017045462A1 PCT/CN2016/089116 CN2016089116W WO2017045462A1 WO 2017045462 A1 WO2017045462 A1 WO 2017045462A1 CN 2016089116 W CN2016089116 W CN 2016089116W WO 2017045462 A1 WO2017045462 A1 WO 2017045462A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- item
- client
- video stream
- image
- server
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000004590 computer program Methods 0.000 claims description 10
- 238000007689 inspection Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000010354 integration Effects 0.000 description 5
- 239000000047 product Substances 0.000 description 5
- 230000000694 effects Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000012467 final product Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/254—Management at additional data server, e.g. shopping server, rights management server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/47815—Electronic shopping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/254—Management at additional data server, e.g. shopping server, rights management server
- H04N21/2542—Management at additional data server, e.g. shopping server, rights management server for selling goods, e.g. TV shopping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
Definitions
- the embodiments of the present invention relate to the field of video processing technologies, and in particular, to a method and system for displaying item related information in a video stream.
- “television shopping” has become one of the important ways people spend their daily shopping.
- “Television shopping” is a way of selling goods. Specifically, the user watches the product information through the television in the home and makes an order.
- the order form can be a telephone order or an online order, and the final product is delivered to the user's home. Payment methods can be cash on delivery, post office remittance, credit card checkout, etc.
- the "television shopping" approach has appeared almost everywhere in local radio and television stations.
- Video shopping is mainly based on video streaming display to promote products to users. Commodities are displayed in the form of video streams, which can be displayed more vividly, more realistically and in all directions. This form of video shopping gives users a special user experience. But the downside is that users need to watch a lot of videos when they buy goods, which is not fast enough. “Video Shopping” has been adopted by major well-known shopping websites, such as Taobao, Suning Tesco and so on.
- TV shopping and video shopping are all advertisements for specific products. But there are also some shortcomings: if the user likes to wear a jacket on a star in a TV series or a pair of glasses, mobile phones and other items. However, if the user wants to know the related effect or purchase information of the item, he or she can only search on the Internet or elsewhere. Since there is no keyword or keyword required for searching, or the keyword or keyword is inaccurate, it is often impossible to search. Get accurate information.
- Embodiments of the present invention provide a method and system for displaying item related information in a video stream, which are used by In order to solve the problem that the user in the prior art cannot accurately obtain the item-related information in the video stream.
- an embodiment of the present invention provides a method for displaying item related information in a video stream, including:
- the client performs recognition and analysis on the frame image in the played video stream, and sends the area image conforming to the feature of the item to the server;
- the client adds a focus frame on the area image
- the client After receiving the click operation of the focus frame, the client displays a floating layer window, and displays related information of the matched item obtained from the server end in the floating layer window.
- the embodiment of the invention further provides a method for displaying item related information in a video stream, including:
- the server receives the client to identify and analyze the frame image in the played video stream, and obtains an area image that conforms to the feature of the item;
- the server side matches the area image with a pre-stored item example picture
- the server sends the related information of the matched item to the client, so that the client adds a focus frame on the area image, after receiving the click operation of the focus frame Displaying a floating layer window and displaying information about the matched item in the floating layer window.
- an embodiment of the present invention further provides an item related information display system in a video stream, including:
- Clients including:
- An identification module configured to perform recognition and analysis on a frame image in the played video stream, and send an area image conforming to the feature of the item to the server end;
- a focus module configured to add a focus frame on the area image when the server end matches the area image and the pre-stored item sample picture, and the matching is successful;
- a display module configured to display a floating layer window after receiving the click operation of the focus frame, and display related information of the matched item obtained from the server end in the floating layer window.
- An embodiment of the present invention further provides an item related information display system in a video stream, including:
- Server side including:
- a receiving module configured to receive, by the client, a frame image in the played video stream Arranging, obtaining an image of the area that matches the characteristics of the item;
- a matching module configured to match the area image and the item sample picture pre-stored in the item information base; if the matching is successful, send related information of the matched item to the client.
- a computer program comprising computer readable code, when said computer readable code is run on a computing device, causing said computing device to perform an item related in said video stream Information display method.
- a computer readable medium wherein the computer program described above is stored.
- the client side identifies and analyzes the frame image in the played video stream, and sends the area image conforming to the item feature to the server end; the server side displays the area image Matching with the pre-stored item sample image; if the matching is successful, the server sends relevant information of the matched item to the client; the client adds a focus frame on the area image; after receiving the click operation of the focus frame, the client displays A floating layer window displays information about the matched items obtained from the server side in the floating layer window.
- displaying the floating layer window on the client does not affect the normal playback of the video stream.
- the degree of integration of the related information of the item and the video stream is greatly improved, so that the user can know the information about the item of interest while watching the video stream.
- FIG. 1 is a flow chart of steps of a method for displaying item related information in a video stream according to Embodiment 1 of the present invention
- FIG. 2 is a flow chart of steps of a method for displaying item related information in a video stream according to Embodiment 2 of the present invention
- FIG. 3 is a schematic structural diagram of an item related information display system in a video stream according to Embodiment 3 of the present invention.
- FIG. 4 is a schematic structural diagram of an item related information display system in a video stream according to Embodiment 4 of the present invention.
- Figure 5 is a schematic block diagram of a computing device for performing a method in accordance with an embodiment of the present invention
- Fig. 6 schematically shows a storage unit for holding or carrying program code implementing a method according to an embodiment of the invention.
- Embodiment 1 of the present invention A method for displaying item related information in a video stream according to Embodiment 1 of the present invention is described in detail.
- FIG. 1 a flow chart of steps of a method for displaying item related information in a video stream in Embodiment 1 of the present invention is shown.
- Step 100 The client performs recognition and analysis on the frame image in the played video stream, and sends the area image that conforms to the feature of the item to the server.
- the client can be a web player.
- the client performs recognition and analysis on the frame image in the played video stream, and identifies and analyzes the frame image of the item appearing in the video stream, that is, obtains the area image that conforms to the feature of the item.
- Step 102 The server receives the area image corresponding to the item feature from the client, and matches the area image with the pre-stored item sample picture. If the matching is successful, step 104 is performed; if the matching fails, the process ends.
- the pre-stored item instance picture may be pre-stored in the server-side database, and at the same time, other related information related to the item may be pre-stored in the server-side database, for example, the item is edited. Number, item type, brand, color appearance characteristics, purchase channel, etc., wherein the item number is unique and is used to distinguish different items.
- the item instance picture has a corresponding relationship with the item number, and the item number picture can be used to determine the unique item number, that is, the unique item is obtained.
- Step 104 The server sends relevant information of the matched item to the client.
- the pre-stored item instance picture is corresponding to the item in the server-side database.
- the related information of the matched item may include information associated with the item pre-stored in the database.
- Step 106 The client adds a focus frame on the area image, and after receiving the click operation of the focus frame, displays the floating layer window, and displays related information of the matched items obtained from the server end in the floating layer window.
- the client can add a focus frame to the entire area image, or add a focus frame at a specific location in the area image. And you can click on the focus box and so on. After the user clicks on the focus frame, the floating layer window is displayed on the client, and the related information of the matched item is displayed in the floating layer window.
- the floating layer window can be dragged or zoomed in and out on the playback interface of the video stream, and the floating layer window can be closed.
- Adding a focus frame to the area image, receiving a click operation of the focus frame, and displaying the floating layer window, and displaying related information of the matched item on the floating layer window does not affect the normal play of the video stream.
- the item related information display method in the video stream does not need to pre-store the related information of the item on the server side and display the related information of the item in the video stream played by the client. Searching for items through the Internet, etc., can obtain information about the items, making it easy to understand the items in the video stream.
- displaying the floating layer window on the client does not affect the normal playback of the video stream.
- the degree of integration of the related information of the item and the video stream is greatly improved, so that the user can know the information about the item of interest while watching the video stream.
- FIG. 2 a flow chart of steps of a method for displaying item related information in a video stream in Embodiment 2 of the present invention is shown.
- Step 200 The client performs recognition and analysis on the frame image in the played video stream, and sends the area image that conforms to the feature of the item to the server.
- the client can be a web player.
- the client performs recognition and analysis on the frame image in the played video stream, and identifies and analyzes the frame image of the item appearing in the video stream, that is, obtains the area image that conforms to the feature of the item.
- the client may perform the identification analysis on the frame image in the played video stream, and the method may include:
- step 2001 the client intercepts the frame image in the played video stream according to the preset time interval.
- the preset time interval may be 3 seconds or other time, and may be set according to actual conditions.
- step 2002 the client performs image recognition analysis on the captured frame image.
- the preset feature labeling features such as the item type, the item shape, the item color, the color distribution, etc.
- the image features are matched to a certain threshold ratio.
- the frame image of the item tagging feature is determined to be an area image that conforms to the item feature.
- the threshold ratio can be 80%, or it can be set according to the specific situation.
- the image recognition analysis of the frame image may also be performed by any existing image recognition analysis technique, and the embodiment of the present invention does not specifically limit the image recognition analysis.
- Step 202 The server receives the image of the area corresponding to the item feature from the client, and matches the area image with the pre-stored item sample picture. If the matching is successful, step 204 is performed; if the matching fails, step 208 is performed.
- the pre-stored item instance picture may be pre-stored in the item information database of the server side, and at the same time, other information related to the item may be pre-stored in the item information database of the server side, for example, the item number, the item type, the brand, and the color appearance.
- Other information related to the item may be pre-stored in the item information database of the server side, for example, the item number, the item type, the brand, and the color appearance.
- the item instance picture has a corresponding relationship with the item number, and the item number picture can be used to determine the unique item number, that is, the unique item is obtained.
- the item related information in the item information database can be directly entered by manual, or the client can automatically identify the items in the video stream, identify and report to the server, and then pass the review by the background personnel.
- Step 204 The server sends relevant information of the matched item to the client.
- the pre-stored item instance picture is corresponding to the item in the server-side item information database.
- the related information of the matched item may include information associated with the item pre-stored in the item information database.
- the server can also record the time information of the matching item in the current video to the item information base. Through multiple matching success, all the time information of the matched item in the current video can be recorded in the item information database.
- the client After the client receives the user instruction, the time information of the matching item appearing elsewhere in the current video is obtained from the server, and the client displays the other at least one video frame of the matched item appearing in the current video.
- the matched items can appear multiple times in the current video, and the time of each occurrence can be recorded in the item information base.
- the video frame corresponding to the other occurrence time point of the matched item in the current video may be displayed in the client, so as to conveniently view the matched item in the current video. The effect of the display in different video frames.
- the client After receiving the user instruction, the client obtains time information of the matched item appearing in other videos from the server side, and the client displays at least one video frame of the matched item appearing in other videos.
- Matched items can appear not only in the current video, but also in other videos.
- the associated information of the video of the matched item may also be stored in the item information database of the server.
- the associated information of the video may include a video number, a video name, a video profile, an item number in the video, time information of the item appearing, and the like. Among them, the video number is unique.
- the item number of the matched item, the video number, and the time information of the item appearing may display other videos in the client where the matched item appears, and the user selects any one of the videos, and may specifically display At least one video frame in which the matched item appears in the selected video.
- the item number can also be searched at the client to obtain a video containing the item corresponding to the item number.
- the above-mentioned user command may be an operation instruction for the user to view the display effect of the matched item in the current video or other video.
- the embodiment of the present invention does not specifically limit the generation and operation form of the user instruction.
- Step 206 The client adds a focus frame on the area image, and after receiving the click operation of the focus frame, displays the floating layer window, and displays related information of the matched items obtained from the server end in the floating layer window.
- the client can add a focus frame to the entire area image, or add a focus frame at a specific location in the area image. And you can click on the focus box and so on.
- the floating layer window is displayed on the client, and the related information of the matched item is displayed in the floating layer window.
- the floating layer window can be dragged or zoomed in and out on the playback interface of the video stream, and the floating layer window can be closed.
- Adding a focus frame to the area image, receiving a click operation of the focus frame, and displaying the floating layer window, and displaying related information of the matched item on the floating layer window does not affect the normal play of the video stream.
- step 208 the server side re-examines the area image. If the re-inspection confirms that the area image contains an item, the server side supplements the related information of the item.
- the server side re-examines the area image, and can upload the area image to be re-examined to the background of the item to be identified, and manually check whether the area image contains an item. If the item is included, the object information database of the server side can be added. The information about the item, the related information of the item can be used in the same way as the related information of other items.
- the item related information display method in the video stream does not need to pre-store the related information of the item on the server side and display the related information of the item in the video stream played by the client. Searching for items through the Internet, etc., can obtain information about the items, making it easy to understand the items in the video stream.
- displaying the floating layer window on the client does not affect the normal playback of the video stream.
- the degree of integration of the related information of the item and the video stream is greatly improved, so that the user can know the information about the item of interest while watching the video stream.
- FIG. 3 a schematic structural diagram of an item related information display system in a video stream according to Embodiment 3 of the present invention is shown.
- the system can include: a client and a server.
- the client may include: an identification module 310, a focus module 312, and a presentation module 314.
- the server side may include: a receiving module 320, and a matching module 322.
- the identification module 310 is configured to perform recognition and analysis on the frame image in the played video stream, and send the area image that conforms to the feature of the item to the server.
- the focus module 312 is configured to add a focus frame on the area image when the server end matches the area image and the pre-stored item example picture, and the matching is successful.
- the display module 314 is configured to display a floating layer window after receiving the click operation of the focus frame, and display related information of the matched item obtained from the server end in the floating layer window.
- the receiving module 320 is configured to receive, by the client, a recognition and analysis of the frame image in the played video stream, and obtain an area image that conforms to the feature of the item.
- the matching module 322 is configured to match the area image and the item sample picture pre-stored in the item information base; if the matching is successful, send related information of the matched item to the client.
- the item related information display system in the video stream provided by the embodiment of the present invention displays the related information of the item in the video stream played by the client by pre-storing the related information of the item on the server side, and does not need to display Searching for items through the Internet, etc., can obtain information about the items, making it easy to understand the items in the video stream.
- displaying the floating layer window on the client does not affect the normal playback of the video stream.
- the degree of integration of the related information of the item and the video stream is greatly improved, so that the user can know the information about the item of interest while watching the video stream.
- FIG. 4 a schematic structural diagram of an item related information display system in a video stream in Embodiment 4 of the present invention is shown.
- the system can include: a client and a server.
- the client may include: an identification module 410, a focus module 412, a presentation module 414, a first association presentation module 416, and a second association presentation module 418.
- the server side may include: a receiving module 420, a matching module 422, a rechecking module 424, a recording module 426, a first time information sending module, and a second time information sending module.
- the identification module 410 is configured to perform recognition and analysis on the frame image in the played video stream, and send the area image that conforms to the feature of the item to the server.
- the identifying module 410 is configured to intercept a frame image in the played video stream according to a preset time interval; perform image recognition analysis on the intercepted frame image, and send an area image conforming to the feature of the item to Service-Terminal.
- the focus module 412 is configured to add a focus frame on the area image when the server end matches the area image and the pre-stored item example picture, and the matching is successful.
- the display module 414 is configured to display a floating layer window after receiving the click operation of the focus frame, and display related information of the matched item obtained from the server end in the floating layer window.
- the first association presentation module 416 is configured to: after receiving the user instruction, obtain time information of the matched item appearing elsewhere in the current video from the server end; and display at least one other video frame that appears in the current video of the matched item. .
- the second association presentation module 418 is configured to: after receiving the user instruction, acquire time information of the matched item appearing in other videos from the server end; and display at least one video frame of the matched item appearing in other videos.
- the receiving module 420 is configured to receive, by the client, a recognition and analysis of the frame image in the played video stream, and obtain an area image that conforms to the feature of the item.
- the matching module 422 is configured to match the area image and the item sample picture pre-stored in the item information base; if the matching is successful, send related information of the matched item to the client.
- the re-inspection module 424 is configured to re-examine the image of the area if the matching is unsuccessful; if the re-inspection confirms that the image of the area contains an item, the related information of the item is complemented.
- the recording module 426 is configured to record, to the item information database, time information of the matching item in the current video if the matching is successful.
- the first time information sending module is configured to send, after the client receives the user instruction, time information of the matched item appearing elsewhere in the current video to the client.
- the second time information sending module is configured to send, after the client receives the user instruction, time information of the matched item appearing in other videos to the client.
- the item related information display system in the video stream provided by the embodiment of the present invention displays the related information of the item in the video stream played by the client by pre-storing the related information of the item on the server side, and does not need to display Searching for items through the Internet, etc., can obtain information about the items, making it easy to understand the items in the video stream.
- displaying the floating layer window on the client does not affect the normal playback of the video stream.
- the degree of integration of the related information of the item and the video stream is greatly improved, so that the user can know the information about the item of interest while watching the video stream.
- the various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof.
- a microprocessor or digital signal processor may be used in practice to implement some or all of the functionality of some or all of the components of a computing device in accordance with embodiments of the present invention.
- the invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein.
- a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.
- FIG. 5 illustrates a computing device that can implement an item related information presentation method in a video stream in accordance with the present invention.
- the computing device conventionally includes a processor 510 and a computer program product or computer readable medium in the form of a memory 520.
- the memory 520 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM.
- Memory 520 has a memory space 730 for program code 531 for performing any of the method steps described above.
- storage space 530 for program code may include various program code 531 for implementing various steps in the above methods, respectively.
- the program code can be read from or written to one or more computer program products.
- These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such computer program products are typically portable or fixed storage units as described with reference to FIG.
- the storage unit may have storage segments, storage spaces, and the like that are similarly arranged to memory 520 in the computing device of FIG.
- the program code can be compressed, for example, in an appropriate form.
- the storage unit includes computer readable code 531 ', ie, code readable by a processor, such as 510, that when executed by a computing device causes the computing device to perform each of the methods described above step.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
一种视频流中的物品相关信息展示方法及系统，其中，所述方法包括：客户端对播放的视频流中的帧图像进行识别分析，将符合物品特征的区域图像发送至服务器端；当所述服务器端将所述区域图像和预存的物品示例图片进行匹配，且匹配成功时，所述客户端在所述区域图像上添加焦点框；所述客户端接收到所述焦点框的点击操作之后，展示浮层窗口，并在所述浮层窗口中展示从所述服务器端获得的所匹配物品的相关信息。该方法和系统通过在服务器端预存物品的相关信息，并在客户端播放的视频流中对物品的相关信息进行展示，不需要通过互联网等对物品进行搜索即可获得物品的相关信息，方便了解视频流中的物品。
Description
本申请要求在2015年9月16日提交中国专利局、申请号为201510591642.8、发明名称为“视频流中的物品相关信息展示方法及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
本发明实施例涉及视频处理技术领域，尤其涉及一种视频流中的物品相关信息展示方法及系统。
随着社会经济的快速发展，传统的网上购物已经发展的如火如荼。但网上购物只能通过描述、图片等来了解所需要的商品，一方面不能很好的将商品的特点展示给用户，另一方面用户也可能会买到不理想的商品。在此基础上催生了“电视购物”和“视频购物”。
早在几年前，“电视购物”就已成为人们日常消费购物的重要方式之一。“电视购物”是销售商品的一种方式，具体是指用户在家庭中通过电视收看商品信息，并进行订购，订购形式可以为电话订购或者网络订购，最终商品被配送到用户家庭。付款方式可以是货到付款、邮局汇款、信用卡结账等方式。“电视购物”这种方式几乎在各地广电的地方台中都有出现。
“视频购物”主要是基于视频流展示向用户推广商品。商品以视频流的形式展示，能够更形象、更逼真、全方位的被展示。这种视频购物的形式给用户带来了特别的用户体验。但缺点是用户购买商品，需要看大量视频，不够快捷。“视频购物”目前已被各大知名的购物网站采用，比如淘宝，苏宁易购等。
“电视购物”和“视频购物”都是针对特定商品进行的广告展示。但同样存在一些缺陷：若用户很喜欢热播电视剧中某明星身上穿的外套或是一款眼镜、手机等物品。但是如果用户想了解该物品的关联效果或者购买信息等，只能够在互联网上或其他地方进行搜索，由于没有搜索所需的关键字或关键词，或者关键字或关键词不准确，往往无法搜索得到准确的信息。
发明内容
本发明实施例提供一种视频流中的物品相关信息展示方法及系统，用
以解决现有技术中用户无法准确获取得到视频流中的物品关联信息的问题。
根据本发明的一个方面，本发明实施例提供一种视频流中的物品相关信息展示方法，包括：
客户端对播放的视频流中的帧图像进行识别分析，将符合物品特征的区域图像发送至服务器端；
当所述服务器端将所述区域图像和预存的物品示例图片进行匹配，且匹配成功时，所述客户端在所述区域图像上添加焦点框；
所述客户端接收到所述焦点框的点击操作之后，展示浮层窗口，并在所述浮层窗口中展示从所述服务器端获得的所匹配物品的相关信息。
本发明实施例还提供了一种视频流中的物品相关信息展示方法，包括：
服务器端接收客户端对播放的视频流中的帧图像进行识别分析，得到的符合物品特征的区域图像；
所述服务器端将所述区域图像和预存的物品示例图片进行匹配；
若匹配成功，则所述服务器端将所匹配物品的相关信息发送至所述客户端，以令所述客户端在所述区域图像上添加焦点框，在接收到所述焦点框的点击操作之后，展示浮层窗口，并在所述浮层窗口中展示所匹配物品的相关信息。
根据本发明的另一个方面，本发明实施例还提供了一种视频流中的物品相关信息展示系统，包括：
客户端，包括：
识别模块，用于对播放的视频流中的帧图像进行识别分析，将符合物品特征的区域图像发送至服务器端；
焦点模块，用于当所述服务器端将所述区域图像和预存的物品示例图片进行匹配，且匹配成功时，在所述区域图像上添加焦点框；
展示模块，用于接收到所述焦点框的点击操作之后，展示浮层窗口，并在所述浮层窗口中展示从所述服务器端获得的所匹配物品的相关信息。
本发明实施例还提供了一种视频流中的物品相关信息展示系统，包括：
服务器端，包括：
接收模块，用于接收客户端对播放的视频流中的帧图像进行识别分
析，得到的符合物品特征的区域图像；
匹配模块，用于将所述区域图像和物品信息库中预存的物品示例图片进行匹配；若匹配成功，则将所匹配物品的相关信息发送至所述客户端。
根据本发明的又一个方面，提供了一种计算机程序，其包括计算机可读代码，当所述计算机可读代码在计算设备上运行时，导致所述计算设备执行上述的视频流中的物品相关信息展示方法。
根据本发明的再一个方面，提供了一种计算机可读介质，其中存储了上述的计算机程序。
本发明的有益效果为：
本发明实施例提供的视频流中的物品相关信息展示方法及系统，客户端对播放的视频流中的帧图像进行识别分析，将符合物品特征的区域图像发送至服务器端；服务器端将区域图像和预存的物品示例图片进行匹配；若匹配成功，则服务器端将所匹配物品的相关信息发送至客户端；客户端在区域图像上添加焦点框；客户端接收到焦点框的点击操作之后，展示浮层窗口，并在浮层窗口中展示从服务器端获得的所匹配物品的相关信息。通过在服务器端预存物品的相关信息，并在客户端播放的视频流中对物品的相关信息进行展示，不需要通过互联网等对物品进行搜索即可获得物品的相关信息，方便了解视频流中的物品。
并且，在客户端上展示浮层窗口，不影响视频流的正常播放。
大幅提高物品的相关信息与视频流的结合程度，让用户在观看视频流的过程中可以了解感兴趣的物品的相关信息。
上述说明仅是本发明技术方案的概述，为了能够更清楚了解本发明的技术手段，而可依照说明书的内容予以实施，并且为了让本发明的上述和其它目的、特征和优点能够更明显易懂，以下特举本发明的具体实施方式。
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例中所需要使用的附图作一简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本发明实施例一中的一种视频流中的物品相关信息展示方法的步骤流程图；
图2为本发明实施例二中的一种视频流中的物品相关信息展示方法的步骤流程图；
图3为本发明实施例三中的一种视频流中的物品相关信息展示系统的结构示意图；
图4为本发明实施例四中的一种视频流中的物品相关信息展示系统的结构示意图。
图5示意性地示出了用于执行根据本发明实施例的方法的计算设备的框图；以及
图6示意性地示出了用于保持或者携带实现根据本发明实施例的方法的程序代码的存储单元。
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
实施例一
详细介绍本发明实施例一提出的一种视频流中的物品相关信息展示方法。
参照图1，示出了本发明实施例一中的一种视频流中的物品相关信息展示方法的步骤流程图。
步骤100，客户端对播放的视频流中的帧图像进行识别分析，将符合物品特征的区域图像发送至服务器端。
所述客户端可以为网页播放器。所述客户端对播放的视频流中的帧图像进行识别分析，识别分析得到视频流中出现物品的帧图像，即得到符合物品特征的区域图像。
步骤102，服务器端接收来自客户端的符合物品特征的区域图像，并将区域图像和预存的物品示例图片进行匹配，若匹配成功，则执行步骤104；若匹配失败，则流程结束。
所述预存的物品实例图片可以预存在服务器端的数据库中，同时，在服务器端的数据库中还可以预存有其它与物品关联的相关信息，例如，物品编
号、物品类型、品牌、颜色外观特征、购买渠道等等，其中，物品编号具有唯一性，用于区别不同的物品。物品实例图片与物品编号具有对应关系，通过物品实例图片可以确定得到唯一的物品编号，即得到唯一的物品。
步骤104，服务器端将所匹配物品的相关信息发送至客户端。
所匹配的物品为将区域图像和预存的物品示例图片进行匹配成功之后，预存的物品实例图片在服务器端的数据库中对应的物品。
所匹配物品的相关信息可以包括数据库中预存的与物品关联的信息。
步骤106，客户端在区域图像上添加焦点框，在接收到焦点框的点击操作之后，展示浮层窗口，并在浮层窗口中展示从服务器端获得的所匹配物品的相关信息。
客户端可以在整个区域图像上添加焦点框，也可以在区域图像中显示物品的具体位置处添加焦点框。并可以在焦点框上进行点击等操作。当用户在焦点框上点击之后，在客户端上展示浮层窗口，在浮层窗口中展示所匹配物品的相关信息。展示浮层窗口可以在视频流的播放界面之上任意拖动或者放大缩小，同时，可以对展示浮层窗口进行关闭等操作。
在区域图像上添加焦点框，接收焦点框的点击操作，以及展示浮层窗口，在浮层窗口上展示所匹配物品的相关信息均不影响视频流的正常播放。
综上所述，本发明实施例提供的视频流中的物品相关信息展示方法，通过在服务器端预存物品的相关信息，并在客户端播放的视频流中对物品的相关信息进行展示，不需要通过互联网等对物品进行搜索即可获得物品的相关信息，方便了解视频流中的物品。
并且，在客户端上展示浮层窗口，不影响视频流的正常播放。
大幅提高物品的相关信息与视频流的结合程度，让用户在观看视频流的过程中可以了解感兴趣的物品的相关信息。
实施例二
详细介绍本发明实施例二提出的一种视频流中的物品相关信息展示方法。
参照图2，示出了本发明实施例二中的一种视频流中的物品相关信息展示方法的步骤流程图。
步骤200，客户端对播放的视频流中的帧图像进行识别分析，将符合物品特征的区域图像发送至服务器端。
所述客户端可以为网页播放器。所述客户端对播放的视频流中的帧图像进行识别分析，识别分析得到视频流中出现物品的帧图像，即得到符合物品特征的区域图像。
优选地，所述步骤200中，客户端对播放的视频流中的帧图像进行识别分析可以包括：
步骤2001，客户端按照预设时间间隔对播放的视频流中的帧图像进行截取。
所述预设时间间隔可以为3秒，也可以为其他时间，具体可以根据实际情况设定。
步骤2002，客户端对截取到的帧图像进行图像识别分析。
在对帧图像进行图像识别分析时，可以利用预设的物品标注特征，如物品类型、物品形态、物品颜色、颜色分布等与帧图像的图像特征进行比对，将图像特征符合一定阈值比例的物品标注特征的帧图像确定为符合物品特征的区域图像。一定阈值比例可以为80％，也可以根据具体情况设定。
对帧图像进行图像识别分析也可以采用现有的任何图像识别分析技术，本发明实施例对图像识别分析不做具体限制。
步骤202，服务器端接收来自客户端的符合物品特征的区域图像，并将区域图像和预存的物品示例图片进行匹配，若匹配成功，则执行步骤204；若匹配失败，则执行步骤208。
所述预存的物品实例图片可以预存在服务器端的物品信息库中，同时，在服务器端的物品信息库中还可以预存有其它与物品关联的相关信息，例如，物品编号、物品类型、品牌、颜色外观特征、购买渠道等等，其中，物品编号具有唯一性，用于区别不同的物品。物品实例图片与物品编号具有对应关系，通过物品实例图片可以确定得到唯一的物品编号，即得到唯一的物品。物品信息库中的物品相关信息可以由人工直接录入，也可以由客户端自动对视频流中的物品进行识别，识别后上报到服务器，由后台人员审核通过后再进行录入。
步骤204，服务器端将所匹配物品的相关信息发送至客户端。
所匹配的物品为将区域图像和预存的物品示例图片进行匹配成功之后，预存的物品实例图片在服务器端的物品信息库中对应的物品。
所匹配物品的相关信息可以包括物品信息库中预存的与物品关联的信息。
若匹配成功，服务器端还可以向物品信息库记录所匹配物品在当前视频出现的时间信息。通过多次匹配成功，可以在物品信息库中记录所匹配物品在当前视频中出现的全部时间信息。
在客户端接收用户指令之后，从服务器端获取所匹配物品在当前视频中其他地方出现的时间信息，客户端展现所匹配物品在当前视频中出现的其他至少一个视频帧。
所匹配物品在当前视频中可以出现多次，每次出现时的时间可以记录在物品信息库中。当所匹配物品在当前视频中出现之后，根据物品编号和物品出现的时间信息可以在客户端中展示所匹配物品在当前视频中其他出现的时间点对应的视频帧，方便观看所匹配物品在当前视频中不同视频帧中的展示效果。
客户端接收用户指令之后，从服务器端获取所匹配物品在其他视频中出现的时间信息，客户端展现所匹配物品在其他视频中出现的至少一个视频帧。
所匹配物品不仅可以出现在当前视频中，还可以在其它视频中出现。出现所匹配物品的视频的关联信息也可以存储在服务器端的物品信息库中，视频的关联信息可以包括视频编号、视频名称、视频简介、视频中的物品编号、物品出现的时间信息等等。其中，视频编号具有唯一性。
当所匹配物品在当前视频中出现时，通过所匹配物品的物品编号、视频编号和物品出现的时间信息可以在客户端中展示出现所匹配物品的其他视频，用户选择其中任一视频，可以具体展现所匹配物品在选择的视频中出现的至少一个视频帧。
若用户已知某物品的物品编号，还可以在客户端对物品编号进行检索，得到含有该物品编号对应的物品的视频。
上述用户指令可以为一种用户查看所匹配物品在当前视频或其他视频中的展示效果的操作指令，本发明实施例对用户指令的生成和操作形式等不做具体限制。
步骤206，客户端在区域图像上添加焦点框，在接收到焦点框的点击操作之后，展示浮层窗口，并在浮层窗口中展示从服务器端获得的所匹配物品的相关信息。
客户端可以在整个区域图像上添加焦点框，也可以在区域图像中显示物品的具体位置处添加焦点框。并可以在焦点框上进行点击等操作。当用户在
焦点框上点击之后，在客户端上展示浮层窗口，在浮层窗口中展示所匹配物品的相关信息。展示浮层窗口可以在视频流的播放界面之上任意拖动或者放大缩小，同时，可以对展示浮层窗口进行关闭等操作。
在区域图像上添加焦点框，接收焦点框的点击操作，以及展示浮层窗口，在浮层窗口上展示所匹配物品的相关信息均不影响视频流的正常播放。
步骤208，服务器端对区域图像进行复检，若复检确认区域图像含有物品，则服务器端补全该物品的相关信息。
服务器端对区域图像进行复检，可以将待复检的区域图像上传至待识别物品后台，由人工审核区域图像中是否含有物品，若含有物品，则可以在服务器端的物品信息库中补全该物品的相关信息，补全的该物品的相关信息可以同其他物品的相关信息一样利用。
综上所述，本发明实施例提供的视频流中的物品相关信息展示方法，通过在服务器端预存物品的相关信息，并在客户端播放的视频流中对物品的相关信息进行展示，不需要通过互联网等对物品进行搜索即可获得物品的相关信息，方便了解视频流中的物品。
并且，在客户端上展示浮层窗口，不影响视频流的正常播放。
大幅提高物品的相关信息与视频流的结合程度，让用户在观看视频流的过程中可以了解感兴趣的物品的相关信息。
实施例三
详细介绍本发明实施例三提出的一种视频流中的物品相关信息展示系统。
参照图3，示出了本发明实施例三中的一种视频流中的物品相关信息展示系统的结构示意图。
所述系统可以包括：客户端和服务器端。
其中，客户端可以包括：识别模块310，焦点模块312，展示模块314。
服务器端可以包括：接收模块320，匹配模块322。
下面分别详细介绍各模块的功能以及各模块之间的关系。
识别模块310，用于对播放的视频流中的帧图像进行识别分析，将符合物品特征的区域图像发送至服务器端。
焦点模块312，用于当所述服务器端将所述区域图像和预存的物品示例图片进行匹配，且匹配成功时，在所述区域图像上添加焦点框。
展示模块314，用于接收到所述焦点框的点击操作之后，展示浮层窗口，并在所述浮层窗口中展示从所述服务器端获得的所匹配物品的相关信息。
接收模块320，用于接收客户端对播放的视频流中的帧图像进行识别分析，得到的符合物品特征的区域图像。
匹配模块322，用于将所述区域图像和物品信息库中预存的物品示例图片进行匹配；若匹配成功，则将所匹配物品的相关信息发送至所述客户端。
综上所述，本发明实施例提供的视频流中的物品相关信息展示系统，通过在服务器端预存物品的相关信息，并在客户端播放的视频流中对物品的相关信息进行展示，不需要通过互联网等对物品进行搜索即可获得物品的相关信息，方便了解视频流中的物品。
并且，在客户端上展示浮层窗口，不影响视频流的正常播放。
大幅提高物品的相关信息与视频流的结合程度，让用户在观看视频流的过程中可以了解感兴趣的物品的相关信息。
实施例四
详细介绍本发明实施例四提出的一种视频流中的物品相关信息展示系统。
参照图4，示出了本发明实施例四中的一种视频流中的物品相关信息展示系统的结构示意图。
所述系统可以包括：客户端和服务器端。
其中，客户端可以包括：识别模块410，焦点模块412，展示模块414，第一关联展现模块416，第二关联展现模块418。
服务器端可以包括：接收模块420，匹配模块422，复检模块424，记录模块426，第一时间信息发送模块，第二时间信息发送模块。
下面分别详细介绍各模块的功能以及各模块之间的关系。
识别模块410，用于对播放的视频流中的帧图像进行识别分析，将符合物品特征的区域图像发送至服务器端。
优选地，所述识别模块410，用于按照预设时间间隔对所述播放的视频流中的帧图像进行截取；对截取到的帧图像进行图像识别分析，将符合物品特征的区域图像发送至服务器端。
焦点模块412，用于当所述服务器端将所述区域图像和预存的物品示例图片进行匹配，且匹配成功时，在所述区域图像上添加焦点框。
展示模块414，用于接收到所述焦点框的点击操作之后，展示浮层窗口，并在所述浮层窗口中展示从所述服务器端获得的所匹配物品的相关信息。
第一关联展现模块416，用于在接收用户指令之后，从所述服务器端获取所匹配物品在当前视频中其他地方出现的时间信息；展现所匹配物品在当前视频中出现的其他至少一个视频帧。
第二关联展现模块418，用于在接收用户指令之后，从所述服务器端获取所匹配物品在其他视频中出现的时间信息；展现所匹配物品在其他视频中出现的至少一个视频帧。
接收模块420，用于接收客户端对播放的视频流中的帧图像进行识别分析，得到的符合物品特征的区域图像。
匹配模块422，用于将所述区域图像和物品信息库中预存的物品示例图片进行匹配；若匹配成功，则将所匹配物品的相关信息发送至所述客户端。
复检模块424，用于若匹配不成功，对所述区域图像进行复检；若复检确认所述区域图像含有物品，则补全该物品的相关信息。
记录模块426，用于若匹配成功，则向物品信息库记录所匹配物品在当前视频出现的时间信息。
第一时间信息发送模块，用于在所述客户端接收用户指令之后，将所匹配物品在当前视频中其他地方出现的时间信息发送至所述客户端。
第二时间信息发送模块，用于在所述客户端接收用户指令之后，将所匹配物品在其他视频中出现的时间信息发送至所述客户端。
综上所述，本发明实施例提供的视频流中的物品相关信息展示系统，通过在服务器端预存物品的相关信息，并在客户端播放的视频流中对物品的相关信息进行展示，不需要通过互联网等对物品进行搜索即可获得物品的相关信息，方便了解视频流中的物品。
并且，在客户端上展示浮层窗口，不影响视频流的正常播放。
大幅提高物品的相关信息与视频流的结合程度，让用户在观看视频流的过程中可以了解感兴趣的物品的相关信息。
以上所描述的系统实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例
方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下，即可以理解并实施。
本发明的各个部件实施例可以以硬件实现，或者以在一个或者多个处理器上运行的软件模块实现，或者以它们的组合实现。本领域的技术人员应当理解，可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本发明实施例的计算设备中的一些或者全部部件的一些或者全部功能。本发明还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如，计算机程序和计算机程序产品)。这样的实现本发明的程序可以存储在计算机可读介质上，或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到，或者在载体信号上提供，或者以任何其他形式提供。
例如，图5示出了可以实现根据本发明的视频流中的物品相关信息展示方法的计算设备。该计算设备传统上包括处理器510和以存储器520形式的计算机程序产品或者计算机可读介质。存储器520可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。存储器520具有用于执行上述方法中的任何方法步骤的程序代码531的存储空间730。例如，用于程序代码的存储空间530可以包括分别用于实现上面的方法中的各种步骤的各个程序代码531。这些程序代码可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。这些计算机程序产品包括诸如硬盘，紧致盘(CD)、存储卡或者软盘之类的程序代码载体。这样的计算机程序产品通常为如参考图6所述的便携式或者固定存储单元。该存储单元可以具有与图5的计算设备中的存储器520类似布置的存储段、存储空间等。程序代码可以例如以适当形式进行压缩。通常，存储单元包括计算机可读代码531’，即可以由例如诸如510之类的处理器读取的代码，这些代码当由计算设备运行时，导致该计算设备执行上面所描述的方法中的各个步骤。
本文中所称的“一个实施例”、“实施例”或者“一个或者多个实施例”意味着，结合实施例描述的特定特征、结构或者特性包括在本发明的至少一个实施例中。此外，请注意，这里“在一个实施例中”的词语例子不一定全指同一个实施例。
在此处所提供的说明书中，说明了大量具体细节。然而，能够理解，
本发明的实施例可以在没有这些具体细节的情况下被实践。在一些实例中，并未详细示出公知的方法、结构和技术，以便不模糊对本说明书的理解。
应该注意的是上述实施例对本发明进行说明而不是对本发明进行限制，并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中，不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本发明可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中，这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。
此外，还应当注意，本说明书中使用的语言主要是为了可读性和教导的目的而选择的，而不是为了解释或者限定本发明的主题而选择的。因此，在不偏离所附权利要求书的范围和精神的情况下，对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。对于本发明的范围，对本发明所做的公开是说明性的，而非限制性的，本发明的范围由所附权利要求书限定。
最后应说明的是：以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。
Claims (20)
- 一种视频流中的物品相关信息展示方法，其特征在于，包括：客户端对播放的视频流中的帧图像进行识别分析，将符合物品特征的区域图像发送至服务器端；当所述服务器端将所述区域图像和预存的物品示例图片进行匹配，且匹配成功时，所述客户端在所述区域图像上添加焦点框；所述客户端接收到所述焦点框的点击操作之后，展示浮层窗口，并在所述浮层窗口中展示从所述服务器端获得的所匹配物品的相关信息。
- 根据权利要求1所述的方法，其特征在于，所述客户端对播放的视频流中的帧图像进行识别分析，包括：所述客户端按照预设时间间隔对所述播放的视频流中的帧图像进行截取；所述客户端对截取到的帧图像进行图像识别分析。
- 根据权利要求1所述的方法，其特征在于，还包括：所述客户端接收用户指令之后，从所述服务器端获取所匹配物品在当前视频中其他地方出现的时间信息；所述客户端展现所匹配物品在当前视频中出现的其他至少一个视频帧。
- 根据权利要求1所述的方法，其特征在于，还包括：所述客户端接收用户指令之后，从所述服务器端获取所匹配物品在其他视频中出现的时间信息；所述客户端展现所匹配物品在其他视频中出现的至少一个视频帧。
- 一种视频流中的物品相关信息展示方法，其特征在于，包括：服务器端接收客户端对播放的视频流中的帧图像进行识别分析，得到的符合物品特征的区域图像；所述服务器端将所述区域图像和预存的物品示例图片进行匹配；若匹配成功，则所述服务器端将所匹配物品的相关信息发送至所述客户端，以令所述客户端在所述区域图像上添加焦点框，在接收到所述焦点框的点击操作之后，展示浮层窗口，并在所述浮层窗口中展示所匹配物品的相关信息。
- 根据权利要求5所述的方法，其特征在于，还包括：若匹配不成功，则所述服务器端对所述区域图像进行复检，若复检确认所述区域图像含有物品，则所述服务器端补全该物品的相关信息。
- 根据权利要求5所述的方法，其特征在于，还包括：若匹配成功，则所述服务器端向物品信息库记录所匹配物品在当前视频出现的时间信息。
- 根据权利要求5所述的方法，其特征在于，还包括：在所述客户端接收用户指令之后，所述服务器端将所匹配物品在当前视频中其他地方出现的时间信息发送至所述客户端，以令所述客户端展现所匹配物品在当前视频中出现的其他至少一个视频帧。
- 根据权利要求5所述的方法，其特征在于，还包括：在所述客户端接收用户指令之后，所述服务器端将所匹配物品在其他视频中出现的时间信息发送至所述客户端，以令所述客户端展现所匹配物品在其他视频中出现的至少一个视频帧。
- 一种视频流中的物品相关信息展示系统，其特征在于，包括：客户端，包括：识别模块，用于对播放的视频流中的帧图像进行识别分析，将符合物品特征的区域图像发送至服务器端；焦点模块，用于当所述服务器端将所述区域图像和预存的物品示例图片进行匹配，且匹配成功时，在所述区域图像上添加焦点框；展示模块，用于接收到所述焦点框的点击操作之后，展示浮层窗口，并在所述浮层窗口中展示从所述服务器端获得的所匹配物品的相关信息。
- 根据权利要求10所述的系统，其特征在于，所述识别模块，用于按照预设时间间隔对所述播放的视频流中的帧图像进行截取；对截取到的帧图像进行图像识别分析，将符合物品特征的区域图像发送至服务器端。
- 根据权利要求10所述的系统，其特征在于，所述客户端还包括：第一关联展现模块，用于在接收用户指令之后，从所述服务器端获取所匹配物品在当前视频中其他地方出现的时间信息；展现所匹配物品在当前视频中出现的其他至少一个视频帧。
- 根据权利要求10所述的系统，其特征在于，所述客户端还包括：第二关联展现模块，用于在接收用户指令之后，从所述服务器端获取所匹配物品在其他视频中出现的时间信息；展现所匹配物品在其他视频中出现的至少一个视频帧。
- 一种视频流中的物品相关信息展示系统，其特征在于，包括：服务器端，包括：接收模块，用于接收客户端对播放的视频流中的帧图像进行识别分析，得到的符合物品特征的区域图像；匹配模块，用于将所述区域图像和物品信息库中预存的物品示例图片进行匹配；若匹配成功，则将所匹配物品的相关信息发送至所述客户端。
- 根据权利要求14所述的系统，其特征在于，所述服务器端还包括：复检模块，用于若匹配不成功，对所述区域图像进行复检；若复检确认所述区域图像含有物品，则补全该物品的相关信息。
- 根据权利要求14所述的系统，其特征在于，所述服务器端还包括：记录模块，用于若匹配成功，则向物品信息库记录所匹配物品在当前视频出现的时间信息。
- 根据权利要求14所述的系统，其特征在于，所述服务器端还包括：第一时间信息发送模块，用于在所述客户端接收用户指令之后，将所匹配物品在当前视频中其他地方出现的时间信息发送至所述客户端。
- 根据权利要求14所述的系统，其特征在于，所述服务器端还包括：第二时间信息发送模块，用于在所述客户端接收用户指令之后，将所匹配物品在其他视频中出现的时间信息发送至所述客户端。
- 一种计算机程序，包括计算机可读代码，当所述计算机可读代码在计算设备上运行时，导致所述计算设备执行根据权利要求1-9中的任一个所述的视频流中的物品相关信息展示方法。
- 一种计算机可读介质，其中存储了如权利要求19所述的计算机程序。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US15/245,110 US20170076176A1 (en) | 2015-09-16 | 2016-08-23 | Method and system for displaying item related information in video streaming |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510591642.8 | 2015-09-16 | ||
| CN201510591642.8A CN105681918A (zh) | 2015-09-16 | 2015-09-16 | 视频流中的物品相关信息展示方法及系统 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/245,110 Continuation US20170076176A1 (en) | 2015-09-16 | 2016-08-23 | Method and system for displaying item related information in video streaming |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2017045462A1 true WO2017045462A1 (zh) | 2017-03-23 |
Family
ID=56946862
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2016/089116 WO2017045462A1 (zh) | 2015-09-16 | 2016-07-07 | 视频流中的物品相关信息展示方法及系统 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105681918A (zh) |
| WO (1) | WO2017045462A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111859159A (zh) * | 2020-08-05 | 2020-10-30 | 上海连尚网络科技有限公司 | 信息推送、视频处理方法和设备 |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105681918A (zh) * | 2015-09-16 | 2016-06-15 | 乐视致新电子科技（天津）有限公司 | 视频流中的物品相关信息展示方法及系统 |
| CN106303595B (zh) * | 2016-08-17 | 2020-02-21 | 腾讯科技（深圳）有限公司 | 一种智能电视信息交互方法和智能电视 |
| CN108124184A (zh) * | 2016-11-28 | 2018-06-05 | 广州华多网络科技有限公司 | 一种直播互动的方法及装置 |
| CN106845382A (zh) * | 2017-01-16 | 2017-06-13 | 广州广电物业管理有限公司 | 一种基于视频识别的任务管理方法、装置及系统 |
| CN109429084B (zh) * | 2017-08-24 | 2022-03-29 | 北京搜狗科技发展有限公司 | 视频处理方法和装置、用于视频处理的装置 |
| CN109429078B (zh) * | 2017-08-24 | 2022-02-22 | 北京搜狗科技发展有限公司 | 视频处理方法和装置、用于视频处理的装置 |
| CN110019961A (zh) * | 2017-08-24 | 2019-07-16 | 北京搜狗科技发展有限公司 | 视频处理方法和装置、用于视频处理的装置 |
| CN107679970A (zh) * | 2017-10-26 | 2018-02-09 | 视连时代（上海）信息科技有限公司 | 实体场景的可视化远程展示方法及展示系统 |
| CN107995516B (zh) * | 2017-11-21 | 2021-01-22 | 霓螺（宁波）信息技术有限公司 | 一种互动视频中物品的展示方法及装置 |
| CN108600822A (zh) * | 2018-05-24 | 2018-09-28 | 安徽质在智能科技有限公司 | 在线购物视频信息播放方法和系统 |
| CN110557548A (zh) * | 2018-05-31 | 2019-12-10 | 北京京东尚科信息技术有限公司 | 图像打标控制方法、装置和图像打标系统 |
| CN109068173A (zh) * | 2018-09-28 | 2018-12-21 | 石家庄永捷科技有限公司 | 一种视频处理方法以及视频处理装置 |
| CN109697245A (zh) * | 2018-12-05 | 2019-04-30 | 百度在线网络技术（北京）有限公司 | 基于网页视频的语音搜索方法和装置 |
| CN109902733A (zh) * | 2019-02-22 | 2019-06-18 | 北京三快在线科技有限公司 | 录入物品信息的方法、装置及存储介质 |
| CN111178131A (zh) * | 2019-11-26 | 2020-05-19 | 恒大智慧科技有限公司 | 基于智慧社区的物品找回方法及系统 |
| CN114650443B (zh) * | 2020-12-18 | 2024-04-19 | 广州视享科技有限公司 | 头戴式显示设备的播放方法、装置以及头戴式显示设备 |
| CN114415870A (zh) * | 2021-12-29 | 2022-04-29 | 中国电信股份有限公司 | 一种针对视频数据中的物品信息的推送方法和装置 |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102831537A (zh) * | 2012-07-09 | 2012-12-19 | 北京十分科技有限公司 | 一种获取网络广告信息的方法及装置 |
| CN102855273A (zh) * | 2012-07-16 | 2013-01-02 | 宇龙计算机通信科技(深圳)有限公司 | 终端和信息获取方法 |
| CN102868915A (zh) * | 2012-08-07 | 2013-01-09 | 青岛海信传媒网络技术有限公司 | 基于电视平台实现商品购买的方法及装置 |
| CN102902771A (zh) * | 2012-09-27 | 2013-01-30 | 百度国际科技（深圳）有限公司 | 一种图片搜索方法、装置及服务器 |
| CN103297840A (zh) * | 2012-03-01 | 2013-09-11 | 阿里巴巴集团控股有限公司 | 一种基于视频移动焦点的附加信息展现方法及系统 |
| CN103294803A (zh) * | 2013-05-30 | 2013-09-11 | 佛山电视台南海分台 | 一种实现增强产品信息介绍和人机交互的方法和系统 |
| US20140181143A1 (en) * | 2012-12-26 | 2014-06-26 | Huawei Technologies Co., Ltd. | File presentation method and apparatus |
| CN105681918A (zh) * | 2015-09-16 | 2016-06-15 | 乐视致新电子科技（天津）有限公司 | 视频流中的物品相关信息展示方法及系统 |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8205237B2 (en) * | 2000-09-14 | 2012-06-19 | Cox Ingemar J | Identifying works, using a sub-linear time search, such as an approximate nearest neighbor search, for initiating a work-based action, such as an action on the internet |
| CN102063436A (zh) * | 2009-11-18 | 2011-05-18 | 腾讯科技（深圳）有限公司 | 一种利用终端获取图像实现商品信息搜索的系统及方法 |
| US20140033239A1 (en) * | 2011-04-11 | 2014-01-30 | Peng Wang | Next generation television with content shifting and interactive selectability |
| US8833652B2 (en) * | 2011-08-23 | 2014-09-16 | Tyco Fire & Security Gmbh | Product information system and method using a tag and mobile device |
| TW201525880A (zh) * | 2013-12-23 | 2015-07-01 | Chao-Yu Yueh | 電子裝置及其顯示之動態影像之物件資訊查詢方法 |
-
2015
- 2015-09-16 CN CN201510591642.8A patent/CN105681918A/zh active Pending
-
2016
- 2016-07-07 WO PCT/CN2016/089116 patent/WO2017045462A1/zh active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103297840A (zh) * | 2012-03-01 | 2013-09-11 | 阿里巴巴集团控股有限公司 | 一种基于视频移动焦点的附加信息展现方法及系统 |
| CN102831537A (zh) * | 2012-07-09 | 2012-12-19 | 北京十分科技有限公司 | 一种获取网络广告信息的方法及装置 |
| CN102855273A (zh) * | 2012-07-16 | 2013-01-02 | 宇龙计算机通信科技(深圳)有限公司 | 终端和信息获取方法 |
| CN102868915A (zh) * | 2012-08-07 | 2013-01-09 | 青岛海信传媒网络技术有限公司 | 基于电视平台实现商品购买的方法及装置 |
| CN102902771A (zh) * | 2012-09-27 | 2013-01-30 | 百度国际科技（深圳）有限公司 | 一种图片搜索方法、装置及服务器 |
| US20140181143A1 (en) * | 2012-12-26 | 2014-06-26 | Huawei Technologies Co., Ltd. | File presentation method and apparatus |
| CN103294803A (zh) * | 2013-05-30 | 2013-09-11 | 佛山电视台南海分台 | 一种实现增强产品信息介绍和人机交互的方法和系统 |
| CN105681918A (zh) * | 2015-09-16 | 2016-06-15 | 乐视致新电子科技（天津）有限公司 | 视频流中的物品相关信息展示方法及系统 |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111859159A (zh) * | 2020-08-05 | 2020-10-30 | 上海连尚网络科技有限公司 | 信息推送、视频处理方法和设备 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105681918A (zh) | 2016-06-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017045462A1 (zh) | 视频流中的物品相关信息展示方法及系统 | |
| KR101511050B1 (ko) | 상품 정보를 제공하고 표시하는 방법, 장치, 시스템 및 컴퓨터 프로그램 | |
| US9697538B2 (en) | Product recommendations based on analysis of social experiences | |
| US10643264B2 (en) | Method and computer readable medium for presentation of content items synchronized with media display | |
| JP6485969B2 (ja) | ビデオコンテンツの動的バインド | |
| JP6059192B2 (ja) | 特定地域在庫検索用のメタデータ使用 | |
| US11611795B2 (en) | Online live video sales management system | |
| US9049488B2 (en) | Systems and methods for displaying and interacting with interaction opportunities associated with media content | |
| US20170255830A1 (en) | Method, apparatus, and system for identifying objects in video images and displaying information of same | |
| US10440435B1 (en) | Performing searches while viewing video content | |
| US20170076176A1 (en) | Method and system for displaying item related information in video streaming | |
| WO2017080173A1 (zh) | 基于自然信息识别的推送系统和方法及一种客户端 | |
| CN104504155B (zh) | 一种基于图像搜索的数据获取方法及系统 | |
| WO2016173180A1 (zh) | 一种基于图像的信息获取方法和装置 | |
| CN105611410A (zh) | 一种信息推送方法和装置 | |
| CN113760158A (zh) | 目标对象展示方法、对象关联方法、装置、介质及设备 | |
| US20150235264A1 (en) | Automatic entity detection and presentation of related content | |
| WO2021088468A1 (zh) | 信息推送方法和装置 | |
| Ilakkuvan et al. | Cameras for public health surveillance: a methods protocol for crowdsourced annotation of point-of-sale photographs | |
| TW202006635A (zh) | 線下商品資訊查詢方法、裝置、設備及系統 | |
| WO2016125166A1 (en) | Systems and methods for analyzing video and making recommendations | |
| US9471939B1 (en) | Product recommendations based on analysis of social experiences | |
| WO2009024990A1 (en) | System of processing portions of video stream data | |
| KR20210110030A (ko) | 멀티미디어 콘텐츠 내 상품 정보 제공 장치 및 방법 | |
| US20230334516A1 (en) | Product/service ordering system, product/service ordering method, and program for the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16845576 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 16845576 Country of ref document: EP Kind code of ref document: A1 |