WO2017008652A1 - 信息处理方法及装置 - Google Patents
信息处理方法及装置 Download PDFInfo
- Publication number
- WO2017008652A1 WO2017008652A1 PCT/CN2016/088322 CN2016088322W WO2017008652A1 WO 2017008652 A1 WO2017008652 A1 WO 2017008652A1 CN 2016088322 W CN2016088322 W CN 2016088322W WO 2017008652 A1 WO2017008652 A1 WO 2017008652A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- target object
- image
- tag
- data
- tag data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8543—Content authoring using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
Definitions
- a digital video conversion box (STB, also commonly referred to as a set top box or a set-top box) is a device that connects a television terminal with an external signal source.
- the digital video converter box converts the compressed digital signal into television content and displays it on the television terminal.
- aspects of the present application provide an information processing method and apparatus for simplifying operation complexity and improving real-time performance of acquiring object information in a video.
- An aspect of the present application provides an information processing method, including:
- the tag data of the target object in the image is displayed.
- Another aspect of the present application provides an information processing method, including:
- an information processing apparatus including:
- a parsing module configured to parse, from a data stream corresponding to the image, tag data of the target object in the image, where the target object is an object to which tag data is added in the image;
- a display module for displaying tag data of a target object in the image.
- an information processing apparatus including:
- a determination module for determining a target object in the image to which tag data needs to be added
- An obtaining module configured to acquire tag data of the target object
- a forming module configured to form a data stream corresponding to the image according to the tag data of the target object and the content data of the image.
- the tag data of the object inserted in the image forms a data stream corresponding to the image
- the tag data of the target object is parsed from the data stream corresponding to the image, and further The label data of the object in the image is displayed, so that the user can obtain the information of the object in the image, the operation is simple, and the acquisition efficiency is high.
- FIG. 1 is a schematic flowchart diagram of an information processing method according to an embodiment of the present application
- FIG. 2 is a schematic flowchart of an information processing method according to another embodiment of the present application.
- FIG. 3 is a schematic diagram of a process of adding tag data or displaying tag data according to an embodiment of the present application
- FIG. 7 is a schematic structural diagram of an information processing apparatus according to an embodiment of the present disclosure.
- FIG. 8 is a schematic structural diagram of an information processing apparatus according to another embodiment of the present disclosure.
- FIG. 9 is a schematic structural diagram of a video playing device according to another embodiment of the present disclosure.
- FIG. 9b is a schematic flowchart of adding an XML tag to an object in an image according to an embodiment of the present disclosure
- FIG. 9c is a schematic flowchart of extracting an XML tag of an object in an image according to an embodiment of the present application.
- FIG. 1 is a schematic flowchart diagram of an information processing method according to an embodiment of the present application. As shown in Figure 1, the method includes:
- the information processing device may be a device having an image processing function, for example, various devices having a video playing function, and specifically may be various video playing devices such as a television, a mobile phone, a personal computer, and a tablet computer.
- the image in this embodiment may be each frame image during video playback.
- the image of each frame in the video playing process can be processed by the method of the embodiment.
- the image in this embodiment may also be an image in a non-video, such as an image in a web page.
- the image is the result of displaying the content data of the image.
- the content data of the image mainly includes video data and audio data.
- a data stream including tag data of an object in the image is generated in advance.
- the tag data of the object in the image may be parsed from the data stream corresponding to the image, and the tag data of the object in the image may be displayed to the user for the user to acquire the information of the object in the image.
- the tag data of the object may include any information related to the object.
- the tag data of the object includes, but is not limited to, detailed information of at least one of the following objects, a service entry of the object, and detailed information of the service of the object.
- an object related to tag data in an image is referred to as a target object.
- the target object refers to an object in the image to which tag data needs to be added; after the tag data is added, the target object refers to an object to which tag data is added in the image.
- tag data can be added to some of the objects in the image, or all pairs in the image.
- the target object can be part of the object in the image, or it can be all objects in the image.
- the tag data of the target object may include any information related to the target object.
- the tag data of the target object includes, but is not limited to, detailed information of at least one of the following target objects, a service entry of the target object, and detailed information of the service of the target object.
- the detailed information of the target object mainly refers to information directly related to the target object.
- the details of the target object will generally vary depending on the target audience. If the target object is a commodity, such as clothes, for example, the detailed information generally includes the name, origin, price, brand, recommendation level, material, merchant, anti-counterfeiting information or credential information of the offline transaction (the anti-counterfeiting information may be an anti-counterfeit label) , QR code or barcode) and so on.
- the service entry of the target object mainly refers to the entry of various services related to the target object.
- the service related to the target object can be invoked or accessed through the service entry of the target object.
- the service portal can be a link address or a two-dimensional code or the like.
- the detailed information of the service of the target object is mainly basic information of the service related to the target object, such as the name of the service, the basic function of the service, the usage method of the service, and the like.
- the information processing device can parse the tag data of the target object in the image from the data stream corresponding to the image, and display the tag data of the target object to the user for the user to acquire the information of the target object.
- the label data of the target object in the image is inserted to form a data stream corresponding to the image, and in the process of playing the image, the target object is parsed from the data stream corresponding to the image.
- the tag data further displays the tag data of the object in the image to the user, so that the user can acquire the information of the object in the image, the operation is simple, and the acquisition efficiency is high.
- the user may use the service of the target object or guide the user to achieve the purpose of acquiring the service or shopping of the target object in the image, and the services of the target object include, but are not limited to, an item advertisement, Product customization, social recommendation, social networking, etc.
- the user may also issue a search instruction according to the tag data of the target object; the information processing device receives a search instruction issued by the user according to the tag data of the target object, and according to the search instruction, extracts keywords from the tag data of the target object, and searches for The user returns search results that match the tag data of the target object, so that the user can obtain richer information.
- the content data of an image in a video mainly includes audio data and video data in an image, it belongs to an audio type and a video type, respectively.
- the general audio data is stored in an audio type packet
- the video data is stored in a video type packet.
- the tag data of the target object is implemented as a new data type, which is referred to as a tag type and stored in a tag type packet.
- Pre-formed map In an embodiment of the corresponding data stream, a tag type data packet is formed according to the tag data of the target object and the location information of the target object in the image; the tag type data packet is inserted into the image content data to form The data stream corresponding to the image.
- the data stream corresponding to the image mainly includes an audio type data packet, a video type data packet, and a label type data packet. Among them, different types of data packets are distinguished by the type identification field in the data packet.
- an embodiment of parsing the tag data of the target object in the image from the data stream corresponding to the image is:
- Detecting whether the data stream corresponding to the image includes a data packet of a label type Detecting whether the data stream corresponding to the image includes a data packet of a label type; and when detecting that the data stream corresponding to the image includes a data packet of a label type, parsing the label data of the target object from the data packet of the label type.
- the type identifier field of each data packet in the data stream corresponding to the image may be detected, and if the type identifier of the label type is found, determining The data stream corresponding to the image includes a data packet of a label type; if the type identifier of the label type is not found, it is determined that the data stream corresponding to the image does not include the data packet of the label type.
- an implementation manner of parsing the tag data of the target object from the tag type data packet includes:
- the information processing device When detecting that the data stream corresponding to the image includes a data packet of a tag type, the information processing device displays the prompt information to the user to prompt the user to perform tag data processing; for example, a view control may be displayed in the lower right corner of the image. To prompt the user to have object data to be tagged in the image, the tag data processing can be performed;
- the label data processing can be performed on the image; when the user determines that the label data processing is to be performed, the label data processing instruction can be issued, for example, the user can click, touch, long press, etc. a view control to issue a tag data processing instruction;
- the information processing device receives the tag data processing instruction sent by the user according to the prompt information; according to the tag data processing instruction, extracts a data packet of a tag type from the data stream corresponding to the image; for example, the image may be identified according to the type of the tag type.
- a data packet of a tag type is extracted from the corresponding data stream; wherein the data stream corresponding to the image may be determined by the PTS value of the image, and the PTS value of each frame image is unique;
- the information processing apparatus extracts the tag data of the target object and the position information of the target object in the image from the packet of the tag type described above.
- the data packet of the tag type includes tag data of all target objects and position information of all target objects in the image.
- the tag data of the target object may be sorted according to the positional relationship of the target object in the image, and the tag data of the target object and the location information of the target object in the image have a certain mapping relationship in the storage location, for example, the two may Adjacent storage.
- an implementation manner of displaying tag data of a target object includes:
- the target object is marked in the image; the label data display instruction issued by the user is received; and the label data of the target object is displayed according to the label data display instruction.
- the method for marking the target object in the image is: determining the position of the target object on the interface where the image is located according to the position information of the target object in the image, and directly displaying the operable control at the position. To achieve the annotation of the target object.
- the method for marking the target object in the image is: displaying an interface on the image.
- the interface is transparent, so that the effect of the user viewing the image is not affected, and the user is better;
- the position information of the object in the image, and the controllable operation control is displayed at the position corresponding to the target object on the interface to realize the labeling of the target object.
- the manner in which the user issues the tag data display instruction may be that the user issues a tag data display instruction by operating an operable control at the position of the target object on the interface.
- the user's operation of the operable controls includes clicking, double clicking, long pressing, touching, and the like.
- a tag data presentation instruction issued by the user through an operable control at a position corresponding to the target object on the interface is received.
- the operable control corresponding to the target object that wants to display the tag data may be operated to issue a tag data display instruction.
- the tag data display instruction includes location information of the target object. Based on this, the information processing apparatus may specifically determine the tag data of the target object according to the mapping relationship between the location information and the tag data on the storage location and the location information of the target tag; and further display the tag data of the target object.
- the label data of the target object is displayed according to the label data display instruction, which may be, but is not limited to, the following methods:
- the first way display the tag data of the target object in the window where the image is located.
- the tag data of the target object can be displayed in a window in which the image is played on the television screen.
- the second way display the tag data of the target object in another window independent of the window in which the image is located.
- the information processing device is a television
- two windows are displayed on the television screen, one window for playing an image and the other window for displaying tag data of the target object.
- the arrangement between the two windows can be cascading or tiling.
- the window for displaying the tag data of the target object is smaller than the window for playing the image.
- a third way Display the tag data of the target object in another display independent of the display on which the image is located. For example, suppose the information processing device is a television, and the television screen displays a window for playing an image. At the same time, When the TV is connected to the user's personal computer, the tag data of the target object can be displayed through the display on the personal computer.
- the label data of the target object may be subjected to signature processing to prevent the label data of the target object from being tampered, thereby improving the label data of the target object.
- signature processing to prevent the label data of the target object from being tampered, thereby improving the label data of the target object.
- the tag data of the target object can also be signature verified, and the tag data of the target object in the image is displayed only when the signature is verified.
- the RSA signature algorithm may be used to perform signature processing on the tag data of the target object.
- the specific signature processing process refer to the prior art.
- the tag data of the target object includes anti-counterfeiting information of the target object.
- the information processing apparatus may extract the anti-counterfeiting information of the target object from the tag data of the target object, and perform authenticity verification on the target object according to the anti-counterfeiting information of the target object. For example, when a user needs to purchase or acquire a target object online, the target object can be authenticated by the anti-counterfeiting information in the tag data. When the verification result is true, the target object is purchased or acquired to prevent being cheat.
- the above anti-counterfeiting information may be, but not limited to, a security label, a two-dimensional code, or a barcode.
- tag data of the target object in each embodiment of the present application may be an Extensible Markup Language (XML) tag, but is not limited thereto.
- XML Extensible Markup Language
- FIG. 2 is a schematic flowchart diagram of an information processing method according to another embodiment of the present application.
- the method mainly describes a process of pre-forming a data stream corresponding to an image. As shown in Figure 2, the method includes:
- the information processing device may be a device having an image processing function, for example, a device having a video playing function, and specifically may be various video playing devices such as a television, a mobile phone, a personal computer, and a tablet computer.
- the image in this embodiment may be each frame image during video playback.
- the image of each frame in the video playing process can be processed by the method of the embodiment.
- the image in this embodiment may also be an image in a non-video, such as an image on a web page.
- the image is the result of displaying the content data of the image.
- the content data of the image mainly includes video data and audio data.
- the information of the object in order to be able to provide an image to the user in a simple and quick manner during image playback.
- the information of the object generates a data stream including tag data of the object in the image, so as to display the tag data of the object in the image to the user during image playback, so that the user can obtain the information of the object in the image.
- an object related to tag data in an image is referred to as a target object.
- the target object refers to an object in the image to which tag data needs to be added; after the tag data is added, the target object refers to an object to which tag data is added in the image.
- the target object can be part of the object in the image, or it can be all objects in the image.
- the tag data of the target object may include any information related to the target object.
- the information processing apparatus can automatically identify an object that meets the preset condition from the image as the target object.
- the preset condition may be various conditions, such as conditions for defining features such as object type, size, shape, color, and the like.
- This method is suitable for adding tag data to some objects in the image. By identifying the target object, the accuracy of adding tag data can be improved.
- the information processing apparatus can automatically recognize all objects in the image as target objects. This method is suitable for adding tag data to all objects in the image, and adding tag data is more efficient.
- the information processing apparatus may receive an object selection instruction issued by the user on the image, and determine the target object according to the object selection instruction.
- This embodiment is suitable for still images as well as for dynamic images.
- the information processing apparatus may determine the image before determining the target object. For example, the information processing apparatus can use the currently played picture as the image in the present embodiment. Alternatively, the information processing apparatus may receive a label data addition instruction issued by the user during the video playing process; according to the label data adding instruction, pause the video playing, and use the paused video screen as an image.
- an add control may be displayed to the user in the lower left corner of the image, and the user may issue a tag data addition instruction by operating the add control.
- the user's operation of the added control includes but is not limited to: click, touch, long press, and the like.
- the information processing device receives the tag data addition instruction sent by the user, suspending the video playback, and the user selects the target object that needs to add the tag data.
- the user can touch, click or long press an object in the image that needs to add tag data to issue an object selection instruction.
- the information processing apparatus receives an object selection instruction issued by the user, and determines an object operated by the object selection instruction as a target object.
- the tag data of the target object can be acquired.
- the information processing apparatus may acquire label description information of the target object, and perform format conversion on the label description information of the target object to generate label data of the target object.
- the label description information is in a text format
- the label data may be in an XML format
- the label description information in the text format is formatted to obtain label data in XML format, which is simply referred to as an XML label.
- the information processing apparatus may display an information input box to the user, for example, may display an information input box to the user in the window where the image is located, for the user to input the label description information; and receive the label description information input by the user through the information input box.
- the information acquisition method is simple in object implementation, convenient for user operation, and has high efficiency in obtaining label description information.
- the information processing apparatus may also acquire the label description information of the target object through the Internet search.
- the content data of an image in a video mainly includes audio data and video data in an image, it belongs to an audio type and a video type, respectively.
- the general audio data is stored in an audio type packet
- the video data is stored in a video type packet.
- the tag data of the target object is implemented as a new data type, which is referred to as a tag type and stored in a tag type packet.
- the tag type may be formed according to the tag data of the target object and the position information of the target object in the image.
- a data packet; a data packet of a tag type is inserted into the content data of the image to form a data stream corresponding to the image.
- the data stream corresponding to the image mainly includes an audio type data packet, a video type data packet, and a label type data packet. Among them, different types of data packets are distinguished by the type identification field in the data packet.
- the position information of the target object in the image may be acquired according to an object selection instruction issued by the user.
- the position coordinate of clicking, touching or long pressing when the user issues the object selection instruction may be used as the position information of the target object in the image.
- the label data of the target object may be sequentially added to the data packet of the label type according to the positional relationship of the target object in the image.
- the data packet of the tag type may be signed to ensure the authenticity and credibility of the tag data.
- the RSA algorithm it is possible to use, but is not limited to, the RSA algorithm.
- the data packet of the tag type may include, but is not limited to, a frame number of the image, a time stamp, location information of the target object in the image, tag data of the target object, type identification of the tag type, and the like.
- the tag data of the target object includes, but is not limited to, detailed information of at least one of the following target objects, a service entry of the target object, and detailed information of the service of the target object.
- the detailed information of the target object mainly refers to information directly related to the target object.
- the details of the target object will generally vary depending on the target audience. If the target object is a commodity, such as clothes, for example, the detailed information generally includes the name, origin, price, brand, recommendation level, material, merchant, anti-counterfeiting information or credential information of the offline transaction (the anti-counterfeiting information may be an anti-counterfeit label) , QR code or barcode) and so on.
- the service entry of the target object mainly refers to the entry of various services related to the target object.
- the service related to the target object can be invoked or accessed through the service entry of the target object.
- the service portal can be a link address or a two-dimensional code or the like.
- the detailed information of the service of the target object is mainly basic information of the service related to the target object, such as the name of the service, the basic function of the service, the usage method of the service, and the like.
- the tag data of the target object in the image is inserted to form a data stream corresponding to the image, so that the tag data of the target object is parsed from the data stream corresponding to the image during the process of playing the image. Then, the user displays the tag data of the object in the image, so that the user can obtain the information of the object in the image, the operation is simple, and the acquisition efficiency is high.
- Figures 3-6 show a schematic diagram of the process of adding or displaying tag data to an image.
- the information processing apparatus displays an image on its display in which a person's top, skirt, handbag, camera, nail polish, etc. can be used as target objects, and tag data or extracted tags are added. data.
- the image has a "+” icon in the lower left corner. The icon is actually an "add” control for the user to issue a label addition command; the image has a "magnifying glass” in the lower right corner. Icon, which is actually a "view” control for the user to issue tag data processing instructions.
- the "add" control and the view” control are simultaneously shown in FIG. 3-6. In the actual application, the "add” control can be displayed during the label adding process, and the "view” control can only be in the Displayed during label extraction.
- an "add" control specifically a "+” icon, is displayed to the user in the lower left corner of each frame of the image. If the user wants to add tag data to the object in the image, the user can click the "+” icon to issue a tag data addition command, and the information processing device pauses the video playback.
- the user clicks or touches an object on the image to which the tag data is to be added, such as a handbag, which is equivalent to issuing an object selection instruction; and the information processing device determines the object to be clicked or touched according to the object selection instruction.
- a handbag then a transparent cursor appears at the click or touch point, and an information input box of a specified format is popped up.
- it can be an XML page frame.
- the user inputs various tag description information in the information input box.
- the information processing device formats the label description information to form label data, and then saves the current frame number, the time stamp, the position information of the handbag, and the label data in the XML format to the designated data layer of the data stream corresponding to the image (specifically In the tag type of the packet).
- tag data is added to the camera, skirt, sweater, shoes, and nail polish of the person in the image in the same manner. It is worth noting that the information input box is not shown in FIGS. 4 and 5.
- a pattern of the label data formed in FIGS. 4 and 5 is as shown in FIG. 6.
- the information processing apparatus detects whether there is a tag type data packet in the data stream corresponding to each frame image; if a tag type data packet is detected, the information is displayed to the user in the lower right corner of the image.
- a "view” control specifically a "magnifying glass” icon.
- the "magnifying glass" icon may be clicked to issue a tag data processing instruction, the information processing device pauses the video playback, and the cursor appears transparently at all target object positions. (The cursor appears at the click or touch position where the tag data is added).
- the information processing apparatus acquires tag data of the target object.
- the tag data of the target object can be displayed in a separate window/display, or a transparent overlay can be displayed in the current image.
- the transparent cursor on the other target objects in FIG. 4 is not shown.
- FIG. 6 A pattern of the label data of the handbag in Fig. 4 is shown in Fig. 6.
- the user can conveniently obtain a specific object (item) or a network service of a specific object by using a network link address or a two-dimensional code scan entry in the tag data.
- the user can obtain the offline shopping identification code or the anti-counterfeiting tag from the tag data, for example, download and present it under the O2O line, as the offline transaction credential of the object (to enjoy the discount) Or anti-counterfeiting strategy).
- the user can issue a search command to facilitate the information processing device to extract keywords from the tag data for searching, and then output search results that match the tag data to implement image-based search.
- FIG. 7 is a schematic structural diagram of an information processing apparatus according to an embodiment of the present application. As shown in FIG. 7, the apparatus includes a determination module 71 and a display module 72.
- the analysis module 71 is configured to parse the tag data of the target object in the image from the data stream corresponding to the image, and the target object is an object to which tag data is added in the image.
- the display module 72 is configured to display the tag data of the target object in the image parsed by the parsing module 71.
- the parsing module 71 is specifically configured to:
- the tag data of the target object is parsed from the data packet of the tag type.
- the parsing module 71 is specifically configured to: when parsing the tag data of the target object from the data packet of the tag type:
- the tag data of the target object and the position information of the target object in the image are extracted.
- the display module 72 is specifically configured to:
- the tag data of the target object is presented to the user according to the tag data display instruction.
- the display module 72 is specifically configured to: when the target object is marked in the image according to the location information of the target object in the image, specifically:
- an operable control is displayed at a position corresponding to the target object on the interface.
- the display module 72 is specifically configured to: when receiving the label data display instruction issued by the user:
- a tag data presentation instruction issued by the user via an operable control at a location corresponding to the target object on the interface is received.
- the tag data display instruction includes: location information of the target tag. Based on this, when the display module 72 displays the tag data of the target object according to the tag data display instruction, the display module 72 is specifically configured to: determine the target object according to the mapping relationship between the location information and the tag data on the storage location and the location information of the target tag. Tag data; displays tag data for the target object.
- the display module 72 is specifically configured to: when displaying the tag data of the target object according to the tag data display instruction,
- the tag data of the target object is displayed in another display independent of the display in which the image is located.
- the display module 72 is specifically configured to:
- the information processing apparatus may further include: a search module, configured to receive a search instruction issued by the user according to the tag data of the target object; and return a search that matches the tag data of the target object to the user according to the search instruction. result.
- a search module configured to receive a search instruction issued by the user according to the tag data of the target object; and return a search that matches the tag data of the target object to the user according to the search instruction. result.
- the tag data of the above target object includes at least one of the following:
- Details information of the target object, a service entry of the target object, and detailed information of the service of the target object are included.
- the tag data of the above target object may be an XML tag.
- the tag data of the target object may include: anti-counterfeiting information of the target object. Based on this, the device may further include: an anti-counterfeiting module.
- the anti-counterfeiting module is configured to extract the anti-counterfeiting information of the target object from the tag data of the target object, and perform authenticity verification on the target object according to the anti-counterfeiting information of the target object.
- the image in this embodiment may be an image in a video, or may be an image in a non-video, such as an image in a webpage.
- the information processing apparatus parses the tag data of the target object from the data stream corresponding to the image during the process of playing the image, and then displays the tag data of the object in the image, so that the user can acquire the information of the object in the image, and operate. Simple and efficient.
- FIG. 8 is a schematic structural diagram of an information processing apparatus according to another embodiment of the present disclosure. As shown in FIG. 8, the apparatus includes a determination module 81, an acquisition module 82, and a formation module 83.
- the determining module 81 is configured to determine a target object in the image that needs to be added with tag data.
- the obtaining module 82 is configured to acquire tag data of the target object determined by the determining module 81.
- the forming module 83 is configured to form a data stream corresponding to the image according to the tag data of the target object acquired by the obtaining module 82 and the content data of the image.
- the determining module 81 is specifically configured to:
- the target object is determined according to the object selection instruction.
- the determining module 81 is further configured to: before receiving the object selection instruction sent by the user on the image, receive a label data adding instruction sent by the user during the video playing process; and according to the label data adding instruction, pause the video playing, The video screen that was paused is taken as the image.
- the determining module 81 is specifically configured to:
- All objects in the image are automatically recognized as the target object.
- the obtaining module 82 is specifically configured to:
- the obtaining module 82 is specifically configured to:
- the tag description information of the target object is obtained through an Internet search.
- the forming module 83 is specifically operable to:
- a tag type packet is inserted into the content data of the image to form a data stream corresponding to the image.
- the forming module 83 may further perform signature processing on the data packet of the tag type to ensure the authenticity of the tag data. Sex and reliability.
- the tag data of the above target object may be an XML tag.
- the tag data of the target object includes at least one of the following: detailed information of the target object, a service entry of the target object, and detailed information of the service of the target object.
- the information processing apparatus provided in this embodiment cooperates with the information processing apparatus provided in the foregoing embodiment.
- the label data of the object inserted in the image forms a data stream corresponding to the image, so that the image process is played.
- the tag data of the target object is parsed from the data stream corresponding to the image, and the tag data of the object in the image is displayed to the user, so that the user can acquire the information of the object in the image, and the operation is simple and the acquisition efficiency is high.
- the video playback device generally has the functions of the information processing apparatus shown in FIGS. 7 and 8.
- the following embodiment will introduce a structure and working principle of a video playing device capable of implementing the technical solution of the present application.
- the tag data of the target object in the video image may be in an XML format, which is simply referred to as an XML tag.
- FIG. 9 is a schematic structural diagram of a video playing device according to an embodiment of the present disclosure.
- the video playback device includes a video player, a web engine, and a display.
- the video player includes at least: a demultiplexer (Demux), an audio decoder, a video decoder, a tag filter module (XPreFilter), a tag recording module (TSRecorder), and a tag processing module (XTAG).
- the multiplexer, the audio decoder, and the video decoder belong to the existing module, and the working principle thereof can be referred to the prior art, and details are not described herein again. The following focuses on the working principle of the tag filtering module, the tag recording module, and the tag processing module.
- the tag filtering module is an XML tag preprocessing (filtering) module, and the tag filtering module can exist alone or in a demultiplexer.
- the tag filtering module is mainly responsible for the following two functions:
- the tag filtering module is responsible for filtering out the XML tag type PES packet from the TS code stream corresponding to the video image, and sending it to the tag processing module for parsing. Specifically, the tag filtering module detects whether a PES packet of an XML tag type exists in the TS code stream corresponding to the video image in real time, and if so, notifies the web engine to transparently pop up the “view” control in the lower right corner of the video image, if the user clicks “ The view” control pauses the video, obtains the PTS value of the current video image, and filters out the corresponding PES packet from the TS stream according to the PTS value and the XML tag type tag, and then sends the corresponding PES packet to the tag processing module for unpacking processing.
- the tag filtering module is responsible for sending the original TS code stream to the tag recording module for recording.
- the tag recording module is mainly responsible for receiving the original TS code stream sent by the tag filtering module, and receiving the PES packet of the XML tag type formed by encapsulating the XML tag of the target object sent by the tag processing module, and the PES packet of the XML tag type. Insert the original TS code stream, and insert the PAT and PMT associated with the XML tag type to form a data stream corresponding to the video image, such as a PS stream, and then cut the PS stream into TS packets according to the requirements of the data packet size of the transmission protocol. Each TS packet has 188 bytes) and is saved as the final TS stream.
- the saved TS stream can use a third-party tool to generate a publishing format, such as HLS, MPEG2, etc., in order to be published.
- the tag processing module is mainly responsible for unpacking and packaging of the PES package of the XML tag type, and keeping the event synchronized with the web engine.
- the events here mainly include: pause, play, add, view. , Long touch, touch, save, view returned, mark (xtag), add back, etc.
- the following mainly introduces the process of unpacking and packaging:
- the tag processing module is responsible for parsing the PES packet of the XML tag type sent by the tag filtering module, parsing the PES packet of the XML tag type into XML format data, and transmitting the data to the web.
- the engine is parsed by the web engine to display XML tags about the object under the control of the web engine.
- the label processing module when the label processing module unpacks the PES packet of the XML tag type, the PES packet of the XML tag type may be reorganized (if there is no need to reorganize in a NALU) as an index of the coordinate value of the target object in the video image.
- the XML file is sent to the web engine, and after processing by the web engine, an interface corresponding to the size of the video frame is displayed on the current video image, and the clickable cursor control is presented on the interface corresponding to the position of each target object.
- the web engine parses the XML tag of the target object and displays it to the user.
- the tag processing module is mainly responsible for packaging the tag description information of the user input sent by the web engine into a PES packet of the XML tag type, and transmitting it to the tag recording module for recording to form a final TS code stream.
- each XML tag is placed in a NALU, and the NALU that stores the XML tags is customized into an XML-type NALU (abbreviated as XNALU).
- XNALU XML-type NALU
- the position coordinate value of the target object corresponding to the XML tag in the video image is included, and the position coordinate may be a coordinate of the long-pressed position on the video image when the user determines the target object to which the tag data needs to be added.
- Each video image may correspond to a plurality of XML tags, and the XNALU sequence may be formed in an input order, and the sequence is packaged into a PES packet of an XML tag type.
- the header of the PES packet of the XML tag type uses the current video image.
- the PTS value is synchronized with the video image and the type of the PES packet is set to the XML tag type.
- the web engine includes at least: a web core module, a network module, and a web application module.
- the web core module and the network module belong to existing modules in the web engine, and the functions thereof can be referred to the description of the prior art. The following focuses on the functions of the web application module.
- the web application module is mainly responsible for the following four aspects:
- the web engine is responsible for interacting with the UI of the user, and displaying the XML tag sent by the tag processing module to the user according to the user's instruction; in the second aspect, the web engine receives the tag description information input by the user and converts the tag information into an XML tag. Send the XML tag to the tag processing module; in the third aspect, the web engine is also responsible for the video image Display cursor commands such as “add” and “view” to obtain the coordinates of the clicked position when the user selects the target object during the process of adding tags or displaying labels. In the fourth aspect, the web engine is also responsible for interacting with the remote network service provider. .
- FIG. 9b a process for adding an XML tag to an object in a video image is as shown in FIG. 9b, including:
- the label filtering module sends the received original TS code stream to the label recording module for recording;
- the tag processing module responds to the pause play event of the video
- the tag processing module acquires a PTS value of the current video image
- the tag processing module notifies the web application module that there is a pause play event
- the web application module pops up an "add" control on the current video image
- the web application module waits for the user to select a target object that needs to add tag data
- the web application module receives an object selection instruction issued by the user by long pressing an object on the video image
- the web application module determines, according to the object selection instruction, the location coordinates of the target object and the target object that need to be added with the tag data;
- the web application module pops up an information input box at the target object, so that the user inputs the label description information
- the web application module receives the label description information input by the user through the information input box, and converts the label description information into an XML label;
- the web application module sends the XML tag to the tag processing module
- the tag processing module packages all the XML tags corresponding to the current video image into PES packets of the XML tag type;
- the tag processing module sends the PES packet of the XML tag type to the tag recording module;
- the tag recording module inserts the PES packet of the XML tag type, PAT, PMT, etc. into the original TS code stream to form a final TS code stream.
- FIG. 9c a process for extracting an XML tag of an object in a video image is as shown in FIG. 9c, and includes:
- the tag filtering module receives the TS code stream, and detects whether the PES packet of the XML tag type exists in the TS code stream; if yes, obtains the PES packet of the XML tag type from the PES packet, and sends the PES packet to the tag processing module;
- the tag processing module notifies the web application module of the tag event
- the web application module displays a "view” control on the current video image
- the web application module notifies the tag processing module that there is a tag data processing event
- the tag processing module acquires a PTS value of the current video image, and obtains a PES packet of an XML tag type having the same PTS value;
- the label processing module sends the parsed PES packet to the web application module
- the web application module parses the PES package into an XML file, and transparently presents an interface on the video image, and the cursor control appears on the interface corresponding to the position of the target object;
- the web application module displays to the user an XML tag of the target object corresponding to the tag data display instruction
- the web application module receives a service call instruction issued by the user to click on the entry of the web service of the target object provided on the XML tag;
- the web application module interacts with the web service provider of the target object to provide the user with relevant web services.
- the tag data of the object inserted in the video image forms a data stream corresponding to the video image
- the target is parsed from the data stream corresponding to the video image.
- the tag data of the object further displays the tag data of the object in the video image to the user, so that the user can obtain the information of the object in the video image, the operation is simple, and the acquisition efficiency is high.
- the disclosed system, apparatus, and method may be implemented in other manners.
- the device embodiments described above are merely illustrative.
- the division of the unit is only a logical function division.
- there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
- the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
- the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to implement the solution of the embodiment. purpose.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
- the above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
- the above-described integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium.
- the software functional unit described above is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform the methods described in various embodiments of the present application. Part of the steps.
- the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本申请提供一种信息处理方法及装置。一种方法包括:从图像对应的数据流中,解析出图像中的目标对象的标签数据,目标对象是图像中被添加标签数据的对象;展示图像中的目标对象的标签数据。本申请可以简化操作复杂度,提高获取图像中的对象信息的实时性。
Description
本申请要求2015年07月13日递交的申请号为201510407944.5、发明名称为“信息处理方法及装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
用户在观看视频时,往往会希望了解视频内容的具体信息,例如,视频中某个商品或者某个景点的具体信息等。当用户对视频中某个对象感兴趣时,一般是根据对感兴趣对象的简单了解在搜索引擎中搜索相关的信息。这种方式不够快捷,实时性较差。
随着互联网技术的发展,智能电视、数字视频变换盒的出现,使得电视节目系统也越来越智能化,除了传统的电视节目的播出之外,还可以进行互联网活动。
以基于数字视频变换盒实现的电视节目系统为例,数字视频变换盒(Set Top Box,简称STB,通常也可以称作机顶盒或机上盒)是一个连接电视终端与外部信号源的设备。数字视频变换盒可以将压缩的数字信号转成电视内容,并在电视终端上显示出来。
可见,在目前电视节目系统中,数字视频变换盒与电视机的连接是相对固定的,即,一个数字视频变换盒固定为一个电视机提供服务。然而,互联网技术的发展日新月异的、各种应用也在不断更新变化,当数字视频变换盒不能满足应用的更新变化时,则将不能正常为电视终端提供服务。
发明内容
本申请的多个方面提供一种信息处理方法及装置,用以简化操作复杂度,提高获取视频中的对象信息的实时性。
本申请的一方面,提供一种信息处理方法,包括:
从图像对应的数据流中,解析出所述图像中的目标对象的标签数据,所述目标对象是所述图像中被添加标签数据的对象;
展示所述图像中的目标对象的标签数据。
本申请的另一方面,提供一种信息处理方法,包括:
确定图像中需要添加标签数据的目标对象;
获取所述目标对象的标签数据;
根据所述目标对象的标签数据和所述图像的内容数据,形成所述图像对应的数据流。
本申请的又一方面,提供一种信息处理装置,包括:
解析模块,用于从图像对应的数据流中,解析出所述图像中的目标对象的标签数据,所述目标对象是所述图像中被添加标签数据的对象;
展示模块,用于展示所述图像中的目标对象的标签数据。
本申请的又一方面,提供一种信息处理装置,包括:
确定模块,用于确定图像中需要添加标签数据的目标对象;
获取模块,用于获取所述目标对象的标签数据;
形成模块,用于根据所述目标对象的标签数据和所述图像的内容数据,形成所述图像对应的数据流。
由上述技术方案可知,本申请在形成图像过程中,插入图像中对象的标签数据形成图像对应的数据流,在播放图像过程中,从图像对应的数据流中解析出目标对象的标签数据,进而展示图像中对象的标签数据,使得用户可以获取图像中对象的信息,操作简单,获取效率较高。
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1为本申请一实施例提供的信息处理方法的流程示意图;
图2为本申请另一实施例提供的信息处理方法的流程示意图;
图3-图6为本申请一实施例提供的添加标签数据或展示标签数据的过程示意图;
图7为本申请一实施例提供的信息处理装置的结构示意图;
图8为本申请另一实施例提供的信息处理装置的结构示意图;
图9a为本申请另一实施例提供的视频播放设备的结构示意图;
图9b为本申请一实施例提供的为图像中的对象添加XML标签的流程示意图;
图9c为本申请一实施例提供的提取图像中的对象的XML标签的流程示意图。
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
图1为本申请一实施例提供的信息处理方法的流程示意图。如图1所示,该方法包括:
101、从图像对应的数据流中,解析出该图像中的目标对象的标签数据,目标对象是该图像中被添加标签数据的对象。
102、展示图像中的目标对象的标签数据。
本实施例提供一种信息处理方法,可由信息处理装置来执行。该信息处理装置可以是具有图像处理功能的装置,例如可以是各种具有视频播放功能的装置,具体可以是电视、手机、个人电脑、平板电脑等各种视频播放设备。
首先说明,本实施例中的图像可以是视频播放过程中的每一帧图像。换句话说,对于视频播放过程中的每一帧图像均可采用本实施例方法进行处理。或者,本实施例中的图像也可以是非视频中的图像,例如网页中的图像。
图像中的各种内容,例如人物、动物、植物、物品等被称为图像中的对象。图像是对该图像的内容数据进行展现的结果。以视频中的图像为例,图像的内容数据主要包括视频数据和音频数据。
在本实施例中,为了能够在图像播放过程中,以简单快捷的方式向用户提供图像中对象的信息,预先生成包括图像中对象的标签数据的数据流。这样,在图像播放过程中,可以从图像对应的数据流中解析出图像中对象的标签数据,向用户展示图像中对象的标签数据,以供用户获取图像中对象的信息。其中,对象的标签数据可以包括与对象有关的任何信息。举例说明,对象的标签数据包括但不限于以下至少一种对象的详情信息、对象的服务入口、对象的服务的详情信息。
考虑到图像中对象的类型以及数量可能较多,用户可能只对其中部分对象的信息感兴趣,因此只需为部分对象添加标签数据。另外,为便于描述和区分,将图像中与标签数据有关的对象称为目标对象。在添加标签数据之前,目标对象是指图像中需要被添加标签数据的对象;在添加标签数据之后,目标对象是指图像中被添加标签数据的对象。
根据应用需求,可以为图像中的部分对象添加标签数据,也可以为图像中的全部对
象添加标签数据。也就是说,目标对象可以是图像中的部分对象,也可以是图像中的全部对象。目标对象的标签数据可以包括与目标对象有关的任何信息。举例说明,目标对象的标签数据包括但不限于以下至少一种目标对象的详情信息、目标对象的服务入口、目标对象的服务的详情信息。
其中,目标对象的详情信息主要是指与目标对象直接相关的信息。根据目标对象的不同,目标对象的详情信息一般会有所不同。以目标对象为一商品,如衣服为例,则其详情信息一般包括名称、产地、价格、品牌、推荐等级、材料、商户、线下交易时的防伪信息或凭据信息(防伪信息可以是防伪标签、二维码或条形码)等等。
目标对象的服务入口主要是指与该目标对象相关的各种服务的入口。通过目标对象的服务入口可以调用或访问与该目标对象有关的服务。该服务入口可以是一链接地址或二维码等。
目标对象的服务的详情信息主要是与该目标对象有关的服务的基本信息,例如服务的名称、服务的基本功能、服务的使用方法等等。
基于上述,在播放图像时,信息处理装置可以从图像对应的数据流中,解析出图像中目标对象的标签数据,向用户展示目标对象的标签数据,以供用户获取目标对象的信息。与现有技术相比,本实施例在形成图像过程中,插入图像中目标对象的标签数据进而形成图像对应的数据流,在播放图像过程中,从图像对应的数据流中解析出目标对象的标签数据,进而向用户展示图像中对象的标签数据,使得用户可以获取图像中对象的信息,操作简单,获取效率较高。
进一步,基于用户获取的目标对象的信息,用户可以使用目标对象的服务或者对用户进行导购,实现了获取图像中目标对象的服务或者购物的目的,目标对象的服务包括但不限于:物品广告、产品定制、社会化推荐、人物社交等等。
进一步,用户还可以根据目标对象的标签数据发出搜索指令;信息处理装置接收用户根据目标对象的标签数据发出的搜索指令,根据该搜索指令,从目标对象的标签数据中提取关键词进行搜索,向用户返回与目标对象的标签数据相匹配的搜索结果,以便于用户获取更为丰富的信息。
考虑到视频中图像的内容数据主要包括图像中的音频数据和视频数据,分别属于音频类型和视频类型。一般音频数据存储在音频类型的数据包,视频数据存储在视频类型的数据包中。在本实施的一可选实施方式中,将目标对象的标签数据作为一种新的数据类型来实现,该类型被称为标签类型,并被存储到标签类型的数据包中。在预先形成图
像对应的数据流的一种实施方式中,根据目标对象的标签数据和目标对象在图像中的位置信息,形成标签类型的数据包;将标签类型的数据包插入图像的内容数据中,以形成图像对应的数据流。在该实施方式中,图像对应的数据流主要包括音频类型的数据包、视频类型的数据包以及标签类型的数据包。其中,不同类型的数据包通过数据包中的类型标识字段来区分。
基于上述,一种从图像对应的数据流中,解析出图像中的目标对象的标签数据的实施方式为:
检测图像对应的数据流是否包括标签类型的数据包;当检测出图像对应的数据流包括标签类型的数据包时,从该标签类型的数据包中解析出目标对象的标签数据。
可选的,在检测图像对应的数据流是否包括标签类型的数据包的实施方式中,可以通过检测图像对应的数据流中各数据包的类型标识字段,若发现标签类型的类型标识,则确定该图像对应的数据流包括标签类型的数据包;若未发现标签类型的类型标识,确定该图像对应的数据流不包括标签类型的数据包。
可选的,从标签类型的数据包中解析出目标对象的标签数据的一种实施方式包括:
在检测出图像对应的数据流包括标签类型的数据包时,信息处理装置向用户展示提示信息,以提示用户可以进行标签数据处理;例如,可以在图像的右下角展示一视图(view)控件,以提示用户在该图像中有被添加标签数据的对象,可以进行标签数据处理;
对用户来说,根据该提示信息可以获知针对该图像可以进行标签数据处理;当用户确定要进行标签数据处理时,可以发出标签数据处理指令,例如用户可以点击、触摸、长按等方式操作该视图控件,从而发出标签数据处理指令;
信息处理装置接收用户根据上述提示信息发送的标签数据处理指令;根据该标签数据处理指令,从图像对应的数据流中提取出标签类型的数据包;例如,可以根据标签类型的类型标识,从图像对应的数据流中提取出标签类型的数据包;其中,图像对应的数据流可以由图像的PTS值来确定,每帧图像的PTS值是唯一的;
之后,信息处理装置从上述标签类型的数据包中,提取目标对象的标签数据和目标对象在图像中的位置信息。值得说明的是,该标签类型的数据包包括所有目标对象的标签数据以及所有目标对象在图像中的位置信息。可选的,目标对象的标签数据可以按照目标对象在图像中的位置关系进行排序,并且目标对象的标签数据及目标对象在图像中的位置信息在存储位置上具有一定映射关系,例如两者可以相邻存储。
基于上述,一种展示目标对象的标签数据的实施方式包括:
根据目标对象在图像中的位置信息,在图像中标注出目标对象;接收用户发出的标签数据展示指令;根据标签数据展示指令,展示目标对象的标签数据。
进一步可选的,一种在图像中标注出目标对象的方式为:根据目标对象在图像中的位置信息,确定目标对象在图像所在界面上的位置,直接在所述位置处显示可操作控件,以实现对目标对象的标注。
进一步可选的,一种在图像中标注出目标对象的方式为:在图像上面展示一个界面,优选的,该界面是透明的,这样不影响用户观看图像的效果,用户体现较好;根据目标对象在图像中的位置信息,在该界面上对应于目标对象的位置处显示可控操作控件,以实现对目标对象的标注。
基于上述,用户发出标签数据展示指令的方式可以是:用户通过操作上述界面上目标对象的位置处的可操作控件,以发出标签数据展示指令。用户对可操作控件的操作方式包括点击、双击、长按、触摸等。对信息处理装置来说,接收用户通过界面上对应于目标对象的位置处的可操作控件发出的标签数据展示指令。
值得说明的是,在目标对象有多个的情况下,若用户希望展示其中部分目标对象的标签数据,可以操作希望展示标签数据的目标对象对应的可操作控件,以发出标签数据展示指令。
进一步,标签数据展示指令包括目标对象的位置信息。基于此,信息处理装置具体可以根据位置信息与标签数据在存储位置上的映射关系和目标标签的位置信息,确定目标对象的标签数据;进而展示目标对象的标签数据。
在一种可选实施方式中,根据标签数据展示指令,展示目标对象的标签数据,可以采用但不限于以下几种方式:
第一种方式:在图像所在窗口中显示目标对象的标签数据。举例说明,假设信息处理装置为电视,则可以在电视屏幕上播放图像的窗口中显示目标对象的标签数据。
第二种方式:在独立于图像所在窗口的另一窗口中显示目标对象的标签数据。举例说明,假设信息处理装置为电视,电视屏幕上显示两个窗口,一个窗口用于播放图像,另一窗口用于显示目标对象的标签数据。这两个窗口之间的排列方式可以是层叠或平铺。优选的,用于显示目标对象的标签数据的窗口小于用于播放图像的窗口。
第三种方式:在独立于图像所在显示器的另一显示器中显示目标对象的标签数据。举例说明,假设信息处理装置为电视,电视屏幕展示一窗口,用于播放图像。同时,该
电视与用户的个人电脑连接,则可以通过个人电脑上的显示器显示目标对象的标签数据。
在一可选实施方式中,在预先形成图像对应的数据流的过程中,可以对目标对象的标签数据进行签名处理,以防止目标对象的标签数据被篡改,这样可以提高目标对象的标签数据的真实性和可靠性。基于此,在向用户展示目标对象的标签数据之前,还可以对目标对象的标签数据进行签名验证,只有通过签名验证时,才展示图像中目标对象的标签数据。例如,可以采用RSA签名算法,对目标对象的标签数据进行签名处理,具体签名处理过程可参见现有技术。
在一可选实施方式中,目标对象的标签数据包括目标对象的防伪信息。基于此,在展示目标对象的标签数据之后,信息处理装置可以从目标对象的标签数据中提取目标对象的防伪信息,根据目标对象的防伪信息,对目标对象进行真伪验证。例如,当用户需要在线下购买或获取目标对象时,可以通过标签数据中的防伪信息,对目标对象进行真伪验证,当验证结果为真时,再行购买或获取该目标对象,以防被骗。
上述防伪信息可以是但不限于:防伪标签、二维码或条形码。
值得说明的是,本申请各实施例中目标对象的标签数据可以是可扩展标记语言(Extensible Markup Language,XML)标签,但不限于此。
图2为本申请另一实施例提供的信息处理方法的流程示意图。该方法主要描述预先形成图像对应的数据流的过程。如图2所示,该方法包括:
201、确定图像中需要添加标签数据的目标对象。
202、获取目标对象的标签数据。
203、根据目标对象的标签数据和图像的内容数据,形成图像对应的数据流。
本实施例提供一种信息处理方法,可由信息处理装置来执行。该信息处理装置可以是具有图像处理功能的装置,例如可以是具有视频播放功能的装置,具体可以是电视、手机、个人电脑、平板电脑等各种视频播放设备。
首先说明,本实施例中的图像可以是视频播放过程中的每一帧图像。换句话说,对于视频播放过程中的每一帧图像均可采用本实施例方法进行处理。或者,本实施例中的图像也可以是非视频中的图像,例如可以是网页上的图像。
图像中的各种内容,例如人物、动物、植物、物品等被称为图像中的对象。图像是对该图像的内容数据进行展现的结果。以视频中的图像为例,图像的内容数据主要包括视频数据和音频数据。
在本实施例中,为了能够在图像播放过程中,以简单快捷的方式向用户提供图像中
对象的信息,生成包括图像中对象的标签数据的数据流,以便于在图像播放过程中向用户展示图像中对象的标签数据,以供用户获得图像中对象的信息。
考虑到图像中对象的类型以及数量可能较多,用户可能只对其中部分对象的信息感兴趣,因此只需为部分对象添加标签数据。另外,为便于描述和区分,将图像中与标签数据有关的对象称为目标对象。在添加标签数据之前,目标对象是指图像中需要被添加标签数据的对象;在添加标签数据之后,目标对象是指图像中被添加标签数据的对象。
根据应用需求,可以为图像中的部分对象添加标签数据,也可以为图像中的全部对象添加标签数据。也就是说,目标对象可以是图像中的部分对象,也可以是图像中的全部对象。目标对象的标签数据可以包括与目标对象有关的任何信息。
在给目标对象添加标签数据之前,需要确定图像中需要添加标签数据的对象作为目标对象。
在一可选实施方式中,信息处理装置可以自动从图像中识别出符合预设条件的对象作为目标对象。所述预设条件可以是各种条件,例如可以是用于限定对象类型、大小、形状、颜色等特征的条件。这种方式适用于对图像中部分对象添加标签数据,通过识别目标对象,可以提高添加标签数据的准确度。或者,信息处理装置可以自动识别出图像中全部对象作为目标对象。这种方式适用于对图像中所有对象添加标签数据,添加标签数据的效率较高。
在另一可选实施方式中,信息处理装置可以接收用户在图像上发出的对象选择指令,根据对象选择指令,确定目标对象。该实施方式适用于静态图像,也适用于动态图像。
进一步,对于视频播放场景,信息处理装置可以在确定目标对象之前,先确定图像。例如,信息处理装置可以将当前播放的画面作为本实施例中的图像。或者,信息处理装置可以在视频播放过程中,接收用户发出的标签数据添加指令;根据标签数据添加指令,暂停视频播放,并将暂停到的视频画面作为图像。
具体的,对于动态应用场景中的图像,在图像播放过程中,可以在图像的左下角向用户展示添加(add)控件,用户可以通过操作该添加控件发出标签数据添加指令。用户对该添加控件的操作方式包括但不限于:点击、触摸、长按等。信息处理装置接收用户发出的标签数据添加指令,暂停视频播放,以供用户选择需要添加标签数据的目标对象。用户可以触摸、点击或长按图像中需要添加标签数据的对象,以发出对象选择指令。信息处理装置接收用户发出的对象选择指令,确定对象选择指令所操作的对象作为目标对象。
在确定目标对象之后,可以获取目标对象的标签数据。
在一可选实施方式中,信息处理装置可以获取目标对象的标签描述信息,对目标对象的标签描述信息进行格式转换,以生成目标对象的标签数据。举例说明,标签描述信息是文本格式,而标签数据可以是XML格式,则通过对文本格式的标签描述信息进行格式转换,以获得XML格式的标签数据,简称为XML标签。
进一步,信息处理装置可以向用户展示一信息输入框,例如可以在图像所在窗口中向用户展示一信息输入框,以供用户输入标签描述信息;接收用户通过信息输入框输入的标签描述信息。这样信息获取方式实现对象简单,便于用户操作,获取标签描述信息的效率较高。
另外,信息处理装置也可以通过互联网搜索获取目标对象的标签描述信息。
考虑到视频中图像的内容数据主要包括图像中的音频数据和视频数据,分别属于音频类型和视频类型。一般音频数据存储在音频类型的数据包,视频数据存储在视频类型的数据包中。在本实施的一可选实施方式中,将目标对象的标签数据作为一种新的数据类型来实现,该类型被称为标签类型,并被存储到标签类型的数据包中。
基于上述,在根据目标对象的标签数据和图像的内容数据,形成图像对应的数据流的一种实施方式中,可以根据目标对象的标签数据和目标对象在图像中的位置信息,形成标签类型的数据包;将标签类型的数据包插入图像的内容数据中,以形成图像对应的数据流。在该实施方式中,图像对应的数据流主要包括音频类型的数据包、视频类型的数据包以及标签类型的数据包。其中,不同类型的数据包通过数据包中的类型标识字段来区分。
上述目标对象在图像中的位置信息可以根据用户发出对象选择指令来获取,例如可以将用户发出对象选择指令时点击、触摸或长按的位置坐标,作为目标对象在图像中的位置信息。
可选的,若图像中有多个目标对象,则可以按照目标对象在图像中的位置关系,依次将目标对象的标签数据添加到标签类型的数据包中。
进一步,在将标签类型的数据包插入图像的内容数据中,以形成图像对应的数据流之前,可以对标签类型的数据包进行签名处理,以保证标签数据的真实性和可信性。例如,可以采用但不限于:RSA算法。
进一步,标签类型的数据包可以包括但不限于:图像的帧号、时戳、目标对象在图像中的位置信息、目标对象的标签数据、标签类型的类型标识等信息。
举例说明,目标对象的标签数据包括但不限于以下至少一种目标对象的详情信息、目标对象的服务入口、目标对象的服务的详情信息。
其中,目标对象的详情信息主要是指与目标对象直接相关的信息。根据目标对象的不同,目标对象的详情信息一般会有所不同。以目标对象为一商品,如衣服为例,则其详情信息一般包括名称、产地、价格、品牌、推荐等级、材料、商户、线下交易时的防伪信息或凭据信息(防伪信息可以是防伪标签、二维码或条形码)等等。
目标对象的服务入口主要是指与该目标对象相关的各种服务的入口。通过目标对象的服务入口可以调用或访问与该目标对象有关的服务。该服务入口可以是一链接地址或二维码等。
目标对象的服务的详情信息主要是与该目标对象有关的服务的基本信息,例如服务的名称、服务的基本功能、服务的使用方法等等。
由上述可见,本实施例在形成图像过程中,插入图像中目标对象的标签数据进而形成图像对应的数据流,使得在播放图像过程中,从图像对应的数据流中解析出目标对象的标签数据,进而向用户展示图像中对象的标签数据,使得用户可以获取图像中对象的信息,操作简单,获取效率较高。
图3-图6所示为在图像中添加或展示标签数据的过程示意图。在图3-图6中,信息处理装置在其显示器上显示有一图像,该图像中一人物的上衣、裙子、手提包、相机、指甲油等均可作为目标对象,被添加标签数据或提取标签数据。在图3-图6中,该图像的左下角显示有一“+”号图标,该图标实际为一“add”控件,用于供用户发出标签添加指令;该图像的右下角显示有一“放大镜”图标,该图标实际为一“view”控件,用于供用户发出标签数据处理指令。值得说明的是,为便于简化描述,图3-图6中同时示出“add”控件和view”控件,实际应用中“add”控件可以在标签添加过程中显示,“view”控件可以只在标签提取过程中显示。
结合图3-图6说明添加标签数据的过程如下:
在图3中,在视频播放过程中,在每帧图像的左下角向用户展示一“add”控件,具体为“+”图标。若用户希望对图像中的对象添加标签数据,则可以点击上述“+”图标,发出标签数据添加指令,信息处理装置暂停视频播放。
在图4中,用户在图像上点击或触摸图像中想要添加标签数据的对象,例如手提包,相当于发出对象选择指令;信息处理装置根据该对象选择指令,确定被点击或触摸的对象,例如手提包,然后在点击或触摸点浮现透明光标,并弹出指定格式的信息输入框,
例如可以是XML页框。用户在信息输入框中输入各种标签描述信息。信息处理装置对标签描述信息进行格式转换,形成标签数据,之后将当前帧号、时戳、手提包的位置信息和XML格式的标签数据一起保存到图像对应的数据流的指定数据层(具体是标签类型的数据包)中。
如图5所示,采用同样的方式对图像中人物的相机、裙子、毛衣、皮鞋、指甲油添加标签数据。值得说明的是,在图4和图5中未示出信息输入框。
图4和图5形成的标签数据的一种样式如图6所示。
结合图3-图6说明展示标签数据的过程如下:
在图3中,在视频播放过程中,信息处理装置检测每帧图像对应的数据流中是否有标签类型的数据包;若检测到有标签类型的数据包时,在图像的右下角向用户展示一“view”控件,具体为“放大镜”图标。
在图5中,若用户希望获取图像图中目标对象的标签数据,可以点击上述“放大镜”图标,发出标签数据处理指令,信息处理装置暂停视频播放,并在所有目标对象位置处透明的浮现光标(具体在添加标签数据时的点击或触摸位置位置处浮现光标)。
在图4中,用户点击或触摸某个目标对象位置处的透明光标后,如手提包,信息处理装置获取该目标对象的标签数据。目标对象的标签数据可以在一个独立的窗口/显示器中显示,或透明的叠加在当前图像中显示。为便于展示用户点击或触摸的手提包,图4中其它目标对象上的透明光标未示出。
图4中手提包的标签数据的一种样式如图6所示。
基于图6所示的标签数据,用户通过标签数据中的网络链接地址或二维码扫码入口,可以便捷的获取特定对象(物品)或进入特定对象的网络服务。
基于图6所示的标签数据,用户可以从标签数据中获取线下购物身份识别码或防伪标签,例如下载下来,在O2O线下交易时出示,以作为该对象的线下交易凭据(享受优惠或防伪策略)。
基于图6所示的标签数据,用户可以发出搜索指令,以便于信息处理装置从标签数据中提取关键字进行搜索,进而输出与标签数据匹配的搜索结果,实现基于图像的搜索。
需要说明的是,对于前述的各方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请并不受所描述的动作顺序的限制,因为依据本申请,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定
是本申请所必须的。
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。
图7为本申请一实施例提供的信息处理装置的结构示意图。如图7所示,该装置包括:确定模块71和展示模块72。
解析模块71,用于从图像对应的数据流中,解析出图像中的目标对象的标签数据,目标对象是图像中被添加标签数据的对象。
展示模块72,用于展示解析模块71解析出的图像中的目标对象的标签数据。
在一可选实施方式中,解析模块71具体用于:
检测图像对应的数据流是否包括标签类型的数据包;
若图像对应的数据流包括标签类型的数据包,从标签类型的数据包中解析出目标对象的标签数据。
进一步可选的,解析模块71在用于从标签类型的数据包中解析出目标对象的标签数据时,具体用于:
向用户展示提示信息,以提示用户可以进行标签数据处理;
接收用户根据提示信息发送的标签数据处理指令;
根据标签数据处理指令,从图像对应的数据流中提取出标签类型的数据包;
从标签类型的数据包中,提取目标对象的标签数据和目标对象在图像中的位置信息。
在一可选实施方式中,展示模块72具体用于:
根据目标对象在图像中的位置信息,在图像中标注出目标对象;
接收用户发出的标签数据展示指令;
根据标签数据展示指令,向用户展示目标对象的标签数据。
进一步可选的,展示模块72在用于根据目标对象在图像中的位置信息,在图像中标注出目标对象时,具体用于:
在图像上面展示一个界面;
根据目标对象在图像中的位置信息,在界面上对应于目标对象的位置处显示可操作控件。
进一步可选的,展示模块72在用于接收用户发出的标签数据展示指令时,具体用于:
接收用户通过界面上对应于目标对象的位置处的可操作控件发出的标签数据展示指令。
可选的,标签数据展示指令包括:目标标签的位置信息。基于此,展示模块72在根据标签数据展示指令,向用户展示目标对象的标签数据时,具体用于:根据位置信息与标签数据在存储位置上的映射关系和目标标签的位置信息,确定目标对象的标签数据;展示目标对象的标签数据。
在一可选实施方式中,展示模块72在用于根据标签数据展示指令,展示目标对象的标签数据时,具体用于:
在图像所在窗口中显示目标对象的标签数据;或者
在独立于图像所在窗口的另一窗口中显示目标对象的标签数据;或者
在独立于图像所在显示器的另一显示器中显示目标对象的标签数据。
在一可选实施方式中,展示模块72具体用于:
对目标对象的标签数据进行签名验证;
当通过签名验证时,执行展示图像中的目标对象的标签数据的操作。
在一可选实施方式中,信息处理装置还可以包括:搜索模块,用于接收用户根据目标对象的标签数据发出的搜索指令;根据搜索指令,向用户返回与目标对象的标签数据相匹配的搜索结果。
上述目标对象的标签数据包括以下至少一种:
目标对象的详情信息、目标对象的服务入口、目标对象的服务的详情信息。
上述目标对象的标签数据可以为XML标签。
上述目标对象的标签数据可以包括:目标对象的防伪信息。基于此,该装置还可以包括:防伪模块。
防伪模块,用于从目标对象的标签数据中提取目标对象的防伪信息;根据目标对象的防伪信息,对目标对象进行真伪验证。
值得说明的是,本实施例中的图像可以是视频中的图像,也可以是非视频中的图像,例如网页中的图像。
本实施例提供的信息处理装置,在播放图像过程中,从图像对应的数据流中解析出目标对象的标签数据,进而展示图像中对象的标签数据,使得用户可以获取图像中对象的信息,操作简单,获取效率较高。
图8为本申请另一实施例提供的信息处理装置的结构示意图。如图8所示,该装置包括:确定模块81、获取模块82和形成模块83。
确定模块81,用于确定图像中需要添加标签数据的目标对象。
获取模块82,用于获取确定模块81确定出的目标对象的标签数据。
形成模块83,用于根据获取模块82获取的的目标对象的标签数据和图像的内容数据,形成图像对应的数据流。
在一可选实施方式中,确定模块81具体可用于:
接收用户在图像上发出的对象选择指令;
根据对象选择指令,确定目标对象。
进一步,确定模块81还用于:在接收用户在图像上发出的对象选择指令之前,在视频播放过程中,接收用户发出的标签数据添加指令;根据所述标签数据添加指令,暂停视频播放,将暂停到的视频画面作为所述图像。
在一可选实施方式中,确定模块81具体可用于:
自动从所述图像中识别出符合预设条件的对象作为所述目标对象;或者
自动识别出所述图像中的全部对象作为所述目标对象。
在一可选实施方式中,获取模块82具体可用于:
获取目标对象的标签描述信息;
对目标对象的标签描述信息进行格式转换,以生成目标对象的标签数据。
进一步,获取模块82在用于获取目标对象的标签描述信息时,具体用于:
向用户展示信息输入框,接收用户通过信息输入框输入的标签描述信息;或者
通过互联网搜索获取所述目标对象的标签描述信息。
在一可选实施方式中,形成模块83具体可用于:
根据目标对象的标签数据和目标对象在图像中的位置信息,形成标签类型的数据包;
将标签类型的数据包插入图像的内容数据中,以形成图像对应的数据流。
可选的,在将标签类型的数据包插入图像的内容数据中,以形成图像对应的数据流之前,形成模块83还可以对所述标签类型的数据包进行签名处理,以保证标签数据的真实性和可靠性。
上述目标对象的标签数据可以是XML标签。
可选的,目标对象的标签数据包括以下至少一种:目标对象的详情信息、目标对象的服务入口、目标对象的服务的详情信息。
本实施例提供的信息处理装置,与前述实施例提供的信息处理装置相配合,在形成图像过程中,插入图像中对象的标签数据形成图像对应的数据流,使得在播放图像过程
中,从图像对应的数据流中解析出目标对象的标签数据,进而向用户展示图像中对象的标签数据,使得用户可以获取图像中对象的信息,操作简单,获取效率较高。
在实际应用中,视频播放设备一般会同时具有图7和图8所示信息处理装置的功能。下面实施例将介绍一种能够实现本申请技术方案的视频播放设备的结构及工作原理。在以下实施例中,以视频图像为例,视频图像中目标对象的标签数据可以采用XML格式,简称为XML标签。
图9a为本申请一实施例提供的视频播放设备的结构示意图。如图9a所示,该视频播放设备包括:视频播放器(video player)、web引擎(web Engine)和显示器(display)。
视频播放器至少包括:多路分路器(Demux)、音频解码器、视频解码器、标签过滤模块(XPreFilter)、标签录制模块(TSRecorder)和标签处理模块(XTAG)。其中,多路分路器、音频解码器以及视频解码器属于现有模块,其工作原理可参见现有技术,在此不再赘述。下面重点论述标签过滤模块、标签录制模块和标签处理模块的工作原理。
标签过滤模块是XML标签预处理(过滤)模块,标签过滤模块可以单独存在或放到多路分路器中。标签过滤模块主要负责以下两方面的功能:
一方面,在视频播放过程中,标签过滤模块负责从视频图像对应的TS码流中过滤出XML标签(XML tag)类型的PES包,发给标签处理模块进行解析。具体的,标签过滤模块实时检测视频图像对应的TS码流中是否存在XML标签类型的PES包,如果存在,通知web引擎在视频图像的右下角透明浮出“view”控件,如果用户点击了“view”控件,则暂停视频,获取当前视频图像的PTS值,根据该PTS值和XML tag类型标记,从TS码流中过滤出对应的PES包,然后发送给标签处理模块进行拆包处理。
另一方面,在XML标签序列形成过程中,标签过滤模块负责把原始TS码流发送给标签录制模块进行录制。
标签录制模块主要负责接收标签过滤模块发送的原始TS码流,并接收来自标签处理模块发送的对目标对象的XML标签进行封装后形成的XML标签类型的PES包,将该XML标签类型的PES包插入原始TS码流中,并插入与XML标签类型相关的PAT、PMT形成视频图像对应的数据流,如PS流,然后按照传输协议对数据包大小的要求,将PS流切割成TS包(每个TS包有188字节),保存为最终的TS码流。可选的,保存后的TS码流可以使用第三方工具生成发布格式,如HLS、MPEG2等,以便于发布出去。
标签处理模块主要负责XML标签类型的PES包的拆包、打包,并和web引擎保持事件同步,这里的事件主要包括:暂停(pause)、播放(play)、添加(add)、视图(view)、
长按(long touch)、点击(touch)、保存(saved)、回放(view returned)、标记(xtag),回添加(add returned)等。下面主要介绍拆包和打包的过程:
在对XML标签类型的PES包进行拆包过程中,标签处理模块负责解析标签过滤模块发来的XML标签类型的PES包,将该XML标签类型的PES包解析成XML格式的数据,传送给web引擎,以供web引擎解析处理,在web引擎的控制下展示有关对象的XML标签。
其中,标签处理模块在对XML标签类型的PES包进行拆包时,可以以视频图像中目标对象的坐标值为索引,把XML标签类型的PES包重组(如果在一个NALU中无须重组)为一个XML文件,交给web引擎,经web引擎处理后显示为一个和视频帧大小相当的界面浮现在当前视频图像上,该界面上对应于每个目标对象的位置处呈现可点击光标控件。当用户点击了对应目标对象上的光标控件,web引擎将该目标对象的XML标签解析出来并显示给用户。
在打包形成XML标签类型的PES包的过程中,标签处理模块主要负责把web引擎发送的用户输入的标签描述信息打包成XML标签类型的PES包,并传给标签录制模块进行录制以形成最终的TS码流。
在本实施例中,标签处理模块对XML标签打包时,每个XML标签放在一个NALU中,将这种存放XML标签的NALU自定义为XML类型的NALU(简写为XNALU)。在XNALU中,除了XML标签,还包括XML标签对应的目标对象在视频图像中的位置坐标值,该位置坐标可以是用户确定需要添加标签数据的目标对象时在视频图像上长按位置的坐标。每一视频图像可能对应多个XML标签,则可以按输入顺序形成XNALU序列,该序列被打包成XML标签类型的PES包,可选的,该XML标签类型的PES包的包头使用当前视频图像的PTS值,以便和视频图像同步,并将该PES包的类型设置为XML标签类型。
web引擎至少包括:web核心模块、网络模块和web应用模块(web app)。web核心模块和网络模块属于web引擎中的现有模块,其功能可参见现有技术的描述。下面重点介绍web应用模块的功能。
Web应用模块主要负责以下四个方面的功能:
第一方面,web引擎负责和用户进行UI交互,根据用户的指令向用户显示标签处理模块传来的XML标签;第二方面,web引擎接收用户输入的标签描述信息并将其转化成XML标签,将XML标签发给标签处理模块;第三方面,web引擎还负责在视频图像上
显示“add”、“view”等光标控件,获取用户在添加标签或显示标签过程中选择目标对象时点击位置的坐标等;第四方面,web引擎还负责用户和远端网络服务提供端进行交互。
结合图9a所示视频播放设备,一种为视频图像中的对象添加XML标签的流程如图9b所示,包括:
标签过滤模块把接收到的原始TS码流发送给标签录制模块进行录制;
标签处理模块响应视频的暂停播放事件;
标签处理模块获取当前视频图像的PTS值;
标签处理模块通知web应用模块有暂停播放事件;
web应用模块在当前视频图像上弹出“add”控件;
用户点击“add”控件发出的标签数据添加指;web应用模块接收用户通过点击“add”控件发出的标签数据添加指令;
web应用模块等待用户选择需要添加标签数据的目标对象;
web应用模块接收用户通过长按视频图像上的对象发出的对象选择指令;
web应用模块根据上述对象选择指令,确定需要添加标签数据的目标对象及目标对象的位置坐标;
web应用模块在上述目标对象处弹出信息输入框,以供用户输入标签描述信息;
web应用模块接收用户通过信息输入框输入的标签描述信息,并将标签描述信息转换成XML标签;
web应用模块将XML标签发送给标签处理模块;
标签处理模块将当前视频图像对应的所有XML标签打包成XML标签类型的PES包;
标签处理模块将XML标签类型的PES包发送给标签录制模块;
标签录制模块将XML标签类型的PES包、PAT、PMT等插入原始的TS码流,形成最终的TS码流。
结合图9a所示视频播放设备,一种提取视频图像中的对象的XML标签的流程如图9c所示,包括:
标签过滤模块接收TS码流,检测TS码流中是否存在XML标签类型的PES包;若存在,则从中获取XML标签类型的PES包,并发送给标签处理模块;
标签处理模块向web应用模块通知标签事件;
web应用模块在当前视频图像上显示“view”控件;
用户点击“view”控件发出的标签数据处理指令;web应用模块接收用户通过点击“view”控件发出的标签数据处理指令;
web应用模块通知标签处理模块有标签数据处理事件;
标签处理模块获取当前视频图像的PTS值,获取PTS值相同的XML标签类型的PES包;
标签处理模块将解析出的PES包发送给web应用模块;
web应用模块解析PES包为XML文件,并在视频图像上透明浮现一界面,在界面上对应于目标对象的位置浮现光标控件;
用户点击光标控件发出的标签数据展示指令;web应用模块接收用户点击光标控件发出的标签数据展示指令;
web应用模块向用户展示上述标签数据展示指令对应的目标对象的XML标签;
web应用模块接收用户点击XML标签上提供的目标对象的网络服务的入口发出的服务调用指令;
web应用模块与目标对象的网络服务提供端进行交互,以向用户提供有关网络服务。
由上述技术方案可知,本实施例在形成视频图像过程中,插入视频图像中对象的标签数据形成视频图像对应的数据流,在播放视频图像过程中,从视频图像对应的数据流中解析出目标对象的标签数据,进而向用户展示视频图像中对象的标签数据,使得用户可以获取视频图像中对象的信息,操作简单,获取效率较高。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的
目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。
上述以软件功能单元的形式实现的集成的单元,可以存储在一个计算机可读取存储介质中。上述软件功能单元存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器(processor)执行本申请各个实施例所述方法的部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。
Claims (46)
- 一种信息处理方法,其特征在于,包括:从图像对应的数据流中,解析出所述图像中的目标对象的标签数据,所述目标对象是所述图像中被添加标签数据的对象;展示所述图像中的目标对象的标签数据。
- 根据权利要求1所述的方法,其特征在于,所述从图像对应的数据流中,解析出所述图像中的目标对象的标签数据,包括:检测所述图像对应的数据流是否包括标签类型的数据包;若所述图像对应的数据流包括标签类型的数据包,从所述标签类型的数据包中解析出所述目标对象的标签数据。
- 根据权利要求2所述的方法,其特征在于,所述从所述标签类型的数据包中解析出所述目标对象的标签数据,包括:向用户展示提示信息,以提示所述用户可以进行标签数据处理;接收所述用户根据所述提示信息发送的标签数据处理指令;根据所述标签数据处理指令,从所述图像对应的数据流中提取出所述标签类型的数据包;从所述标签类型的数据包中,提取所述目标对象的标签数据和所述目标对象在所述图像中的位置信息。
- 根据权利要求3所述的方法,其特征在于,所述展示所述图像中的目标对象的标签数据,包括:根据所述目标对象在所述图像中的位置信息,在所述图像中标注出所述目标对象;接收所述用户发出的标签数据展示指令;根据所述标签数据展示指令,展示所述目标对象的标签数据。
- 根据权利要求4所述的方法,其特征在于,所述根据所述目标对象在所述图像中的位置信息,在所述图像中标注出所述目标对象,包括:在所述图像上面展示一个界面;根据所述目标对象在所述图像中的位置信息,在所述界面上对应于所述目标对象的位置处显示可操作控件;所述接收所述用户发出的标签数据展示指令,包括:接收所述用户通过所述界面上对应于所述目标对象的位置处的可操作控件发出的 所述标签数据展示指令。
- 根据权利要求4所述的方法,其特征在于,所述标签数据展示指令包括:所述目标标签的位置信息;所述根据所述标签数据展示指令,展示所述目标对象的标签数据,包括:根据位置信息与标签数据在存储位置上的映射关系和所述目标标签的位置信息,确定所述目标对象的标签数据;展示所述目标对象的标签数据。
- 根据权利要求4所述的方法,其特征在于,所述根据所述标签数据展示指令,展示所述目标对象的标签数据,包括:在所述图像所在窗口中显示所述目标对象的标签数据;或者在独立于所述图像所在窗口的另一窗口中显示所述目标对象的标签数据;或者在独立于所述图像所在显示器的另一显示器中显示所述目标对象的标签数据。
- 根据权利要求1-7任一项所述的方法,其特征在于,所述展示所述图像中的目标对象的标签数据之前,还包括:对所述目标对象的标签数据进行签名验证;当通过签名验证时,执行展示所述图像中的目标对象的标签数据的操作。
- 根据权利要求1-7任一项所述的方法,其特征在于,还包括:接收所述用户根据所述目标对象的标签数据发出的搜索指令;根据所述搜索指令,向所述用户返回与所述目标对象的标签数据相匹配的搜索结果。
- 根据权利要求1-7任一项所述的方法,其特征在于,所述目标对象的标签数据包括以下至少一种:目标对象的详情信息、目标对象的服务入口、目标对象的服务的详情信息。
- 根据权利要求1-7任一项所述的方法,其特征在于,所述目标对象的标签数据为XML标签。
- 根据权利要求1-7任一项所述的方法,其特征在于,所述目标对象的标签数据包括:所述目标对象的防伪信息;所述方法还包括:从所述目标对象的标签数据中提取所述目标对象的防伪信息;根据所述目标对象的防伪信息,对所述目标对象进行真伪验证。
- 根据权利要求12所述的方法,其特征在于,所述目标对象的防伪信息为防伪标签、二维码或条形码。
- 根据权利要求1-7任一项所述的方法,其特征在于,所述图像为视频中的图像。
- 一种信息处理方法,其特征在于,包括:确定图像中需要添加标签数据的目标对象;获取所述目标对象的标签数据;根据所述目标对象的标签数据和所述图像的内容数据,形成所述图像对应的数据流。
- 根据权利要求15所述的方法,其特征在于,所述确定图像中需要添加标签数据的目标对象,包括:接收用户在所述图像上发出的对象选择指令;根据所述对象选择指令,确定所述目标对象。
- 根据权利要求16所述的方法,其特征在于,所述接收所述用户在图像上发出的对象选择指令之前,包括:在视频播放过程中,接收所述用户发出的标签数据添加指令;根据所述标签数据添加指令,暂停视频播放,将暂停到的视频画面作为所述图像。
- 根据权利要求15所述的方法,其特征在于,所述确定图像中需要添加标签数据的目标对象,包括:自动从所述图像中识别出符合预设条件的对象作为所述目标对象;或者自动识别出所述图像中的全部对象作为所述目标对象。
- 根据权利要求15所述的方法,其特征在于,所述获取所述目标对象的标签数据,包括:获取所述目标对象的标签描述信息;对所述目标对象的标签描述信息进行格式转换,以生成所述目标对象的标签数据。
- 根据权利要求19所述的方法,其特征在于,所述获取所述目标对象的标签描述信息,包括:向用户展示信息输入框,接收所述用户通过所述信息输入框输入的所述标签描述信息;或者通过互联网搜索获取所述目标对象的标签描述信息。
- 根据权利要求15所述的方法,其特征在于,所述根据所述目标对象的标签数 据和所述图像的内容数据,形成所述图像对应的数据流,包括:根据所述目标对象的标签数据和所述目标对象在所述图像中的位置信息,形成标签类型的数据包;将所述标签类型的数据包插入所述图像的内容数据中,以形成所述图像对应的数据流。
- 根据权利要求21所述的方法,其特征在于,所述将所述标签类型的数据包插入所述图像的内容数据中,以形成所述图像对应的数据流之前,包括:对所述标签类型的数据包进行签名处理。
- 根据权利要求15-22任一项所述的方法,其特征在于,所述目标对象的标签数据包括以下至少一种:目标对象的详情信息、目标对象的服务入口、目标对象的服务的详情信息。
- 一种信息处理装置,其特征在于,包括:解析模块,用于从图像对应的数据流中,解析出所述图像中的目标对象的标签数据,所述目标对象是所述图像中被添加标签数据的对象;展示模块,用于展示所述图像中的目标对象的标签数据。
- 根据权利要求24所述的装置,其特征在于,所述解析模块具体用于:检测所述图像对应的数据流是否包括标签类型的数据包;若所述图像对应的数据流包括标签类型的数据包,从所述标签类型的数据包中解析出所述目标对象的标签数据。
- 根据权利要求25所述的装置,其特征在于,所述解析模块具体用于:向用户展示提示信息,以提示所述用户可以进行标签数据处理;接收所述用户根据所述提示信息发送的标签数据处理指令;根据所述标签数据处理指令,从所述图像对应的数据流中提取出所述标签类型的数据包;从所述标签类型的数据包中,提取所述目标对象的标签数据和所述目标对象在所述图像中的位置信息。
- 根据权利要求26所述的装置,其特征在于,所述展示模块具体用于:根据所述目标对象在所述图像中的位置信息,在所述图像中标注出所述目标对象;接收所述用户发出的标签数据展示指令;根据所述标签数据展示指令,展示所述目标对象的标签数据。
- 根据权利要求27所述的装置,其特征在于,所述展示模块具体用于:在所述图像上面展示一个界面;根据所述目标对象在所述图像中的位置信息,在所述界面上对应于所述目标对象的位置处显示可操作控件;接收所述用户通过所述界面上对应于所述目标对象的位置处的可操作控件发出的所述标签数据展示指令。
- 根据权利要求27所述的装置,其特征在于,所述标签数据展示指令包括:所述目标标签的位置信息;所述展示模块具体用于:根据位置信息与标签数据在存储位置上的映射关系和所述目标标签的位置信息,确定所述目标对象的标签数据;展示所述目标对象的标签数据。
- 根据权利要求27所述的装置,其特征在于,所述展示模块具体用于:在所述图像所在窗口中显示所述目标对象的标签数据;或者在独立于所述图像所在窗口的另一窗口中显示所述目标对象的标签数据;或者在独立于所述图像所在显示器的另一显示器中显示所述目标对象的标签数据。
- 根据权利要求24-30任一项所述的装置,其特征在于,所述展示模块具体用于:对所述目标对象的标签数据进行签名验证;当通过签名验证时,执行展示所述图像中的目标对象的标签数据的操作。
- 根据权利要求24-30任一项所述的装置,其特征在于,还包括:搜索模块,用于接收所述用户根据所述目标对象的标签数据发出的搜索指令;根据所述搜索指令,向所述用户返回与所述目标对象的标签数据相匹配的搜索结果。
- 根据权利要求24-30任一项所述的装置,其特征在于,所述目标对象的标签数据包括以下至少一种:目标对象的详情信息、目标对象的服务入口、目标对象的服务的详情信息。
- 根据权利要求24-30任一项所述的装置,其特征在于,所述目标对象的标签数据为XML标签。
- 根据权利要求24-30任一项所述的装置,其特征在于,所述目标对象的标签数据包括:所述目标对象的防伪信息;所述装置还包括:防伪模块,用于从所述目标对象的标签数据中提取所述目标对象的防伪信息;根据所述目标对象的防伪信息,对所述目标对象进行真伪验证。
- 根据权利要求35所述的装置,其特征在于,所述目标对象的防伪信息为防伪标签、二维码或条形码。
- 根据权利要求24-30任一项所述的装置,其特征在于,所述图像为视频中的图像。
- 一种信息处理装置,其特征在于,包括:确定模块,用于确定图像中需要添加标签数据的目标对象;获取模块,用于获取所述目标对象的标签数据;形成模块,用于根据所述目标对象的标签数据和所述图像的内容数据,形成所述图像对应的数据流。
- 根据权利要求38所述的装置,其特征在于,所述确定模块具体用于:接收用户在所述图像上发出的对象选择指令;根据所述对象选择指令,确定所述目标对象。
- 根据权利要求39所述的装置,其特征在于,所述确定模块还用于:在视频播放过程中,接收所述用户发出的标签数据添加指令;根据所述标签数据添加指令,暂停视频播放,将暂停到的视频画面作为所述图像。
- 根据权利要求38所述的装置,其特征在于,所述确定模块具体用于:自动从所述图像中识别出符合预设条件的对象作为所述目标对象;或者自动识别出所述图像中的全部对象作为所述目标对象。
- 根据权利要求38所述的装置,其特征在于,所述获取模块具体用于:获取所述目标对象的标签描述信息;对所述目标对象的标签描述信息进行格式转换,以生成所述目标对象的标签数据。
- 根据权利要求42所述的装置,其特征在于,所述获取模块具体用于:向用户展示信息输入框,接收所述用户通过所述信息输入框输入的所述标签描述信息;或者通过互联网搜索获取所述目标对象的标签描述信息。
- 根据权利要求38所述的装置,其特征在于,所述形成模块具体用于:根据所述目标对象的标签数据和所述目标对象在所述图像中的位置信息,形成标签类型的数据包;将所述标签类型的数据包插入所述图像的内容数据中,以形成所述图像对应的数据流。
- 根据权利要求44所述的装置,其特征在于,所述形成模块还用于:对所述标签类型的数据包进行签名处理。
- 根据权利要求38-45任一项所述的装置,其特征在于,所述目标对象的标签数据包括以下至少一种:目标对象的详情信息、目标对象的服务入口、目标对象的服务的详情信息。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510407944.5A CN106358092B (zh) | 2015-07-13 | 2015-07-13 | 信息处理方法及装置 |
| CN201510407944.5 | 2015-07-13 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2017008652A1 true WO2017008652A1 (zh) | 2017-01-19 |
Family
ID=57756788
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2016/088322 Ceased WO2017008652A1 (zh) | 2015-07-13 | 2016-07-04 | 信息处理方法及装置 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106358092B (zh) |
| WO (1) | WO2017008652A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112584091A (zh) * | 2019-09-29 | 2021-03-30 | 杭州海康威视数字技术股份有限公司 | 报警信息生成方法、报警信息解析方法、系统和装置 |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10796157B2 (en) * | 2018-03-13 | 2020-10-06 | Mediatek Inc. | Hierarchical object detection and selection |
| CN109091869B (zh) * | 2018-08-10 | 2022-07-26 | 腾讯科技(深圳)有限公司 | 虚拟对象的动作控制方法、装置、计算机设备及存储介质 |
| CN109274999A (zh) * | 2018-10-08 | 2019-01-25 | 腾讯科技(深圳)有限公司 | 一种视频播放控制方法、装置、设备及介质 |
| CN109218750B (zh) * | 2018-10-30 | 2022-01-04 | 百度在线网络技术(北京)有限公司 | 视频内容检索的方法、装置、存储介质和终端设备 |
| CN109947988B (zh) * | 2019-03-08 | 2022-12-13 | 百度在线网络技术(北京)有限公司 | 一种信息处理方法、装置、终端设备及服务器 |
| CN110347456B (zh) * | 2019-05-28 | 2023-05-09 | 北京奇艺世纪科技有限公司 | 图像数据处理方法、装置、计算机设备和存储介质 |
| CN110929076A (zh) * | 2019-12-03 | 2020-03-27 | 深圳集智数字科技有限公司 | 一种信息的处理方法及装置 |
| CN111582993A (zh) * | 2020-05-13 | 2020-08-25 | 汉海信息技术(上海)有限公司 | 获取目标对象的方法、装置、电子设备及存储介质 |
| CN111698550B (zh) * | 2020-05-29 | 2023-08-15 | 维沃移动通信有限公司 | 信息显示的方法、装置、电子设备及介质 |
| CN114637890A (zh) * | 2020-12-16 | 2022-06-17 | 花瓣云科技有限公司 | 在图像画面中显示标签的方法、终端设备及存储介质 |
| CN113010069A (zh) * | 2021-03-12 | 2021-06-22 | 浙江大华技术股份有限公司 | 图片标注的切换方法、设备、电子装置和存储介质 |
| CN115550682A (zh) * | 2021-06-29 | 2022-12-30 | 上海数字电视国家工程研究中心有限公司 | 一种图文视频的合成方法和系统 |
| CN117194714A (zh) * | 2023-09-19 | 2023-12-08 | 鑫达物管(北京)科技有限公司 | 一种视频处理方法、装置、电子设备及可读存储介质 |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120131043A1 (en) * | 2010-11-19 | 2012-05-24 | Lg Electronics Inc. | Mobile terminal and method of managing video using metadata therein |
| WO2013003957A1 (en) * | 2011-07-05 | 2013-01-10 | Shunock Michael Stewart | System and method for annotating images |
| CN103235678A (zh) * | 2013-03-22 | 2013-08-07 | 东莞宇龙通信科技有限公司 | 视频中特定对象背景信息的显示方法及视频终端 |
| CN103443816A (zh) * | 2011-03-17 | 2013-12-11 | 电子湾有限公司 | 用于在视频帧中识别物品的视频处理系统 |
| CN103780973A (zh) * | 2012-10-17 | 2014-05-07 | 三星电子(中国)研发中心 | 视频标签添加方法及装置 |
| CN104065979A (zh) * | 2013-03-22 | 2014-09-24 | 北京中传数广技术有限公司 | 一种动态显示和视频内容相关联信息方法及系统 |
| CN104113768A (zh) * | 2014-06-26 | 2014-10-22 | 小米科技有限责任公司 | 关联信息生成方法和装置 |
| CN104184923A (zh) * | 2014-08-27 | 2014-12-03 | 天津三星电子有限公司 | 用于视频中检索人物信息的系统和方法 |
| CN104618814A (zh) * | 2014-01-30 | 2015-05-13 | 吴松珀 | 电视交互通信方法及电视终端、电视遥控器 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100654455B1 (ko) * | 2005-05-26 | 2006-12-06 | 삼성전자주식회사 | 확장형 자막 파일을 이용하여 부가정보를 제공하는 장치 및방법 |
| CN102104582A (zh) * | 2009-12-18 | 2011-06-22 | 陈红 | 一种多路实时多媒体流共享通道的传输控制协议与方法 |
| CN103731631B (zh) * | 2012-10-16 | 2017-12-29 | 华为软件技术有限公司 | 一种传输视频图像的方法、装置及系统 |
| CN103079092B (zh) * | 2013-02-01 | 2015-12-23 | 华为技术有限公司 | 在视频中获取人物信息的方法和装置 |
-
2015
- 2015-07-13 CN CN201510407944.5A patent/CN106358092B/zh active Active
-
2016
- 2016-07-04 WO PCT/CN2016/088322 patent/WO2017008652A1/zh not_active Ceased
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120131043A1 (en) * | 2010-11-19 | 2012-05-24 | Lg Electronics Inc. | Mobile terminal and method of managing video using metadata therein |
| CN103443816A (zh) * | 2011-03-17 | 2013-12-11 | 电子湾有限公司 | 用于在视频帧中识别物品的视频处理系统 |
| WO2013003957A1 (en) * | 2011-07-05 | 2013-01-10 | Shunock Michael Stewart | System and method for annotating images |
| CN103780973A (zh) * | 2012-10-17 | 2014-05-07 | 三星电子(中国)研发中心 | 视频标签添加方法及装置 |
| CN103235678A (zh) * | 2013-03-22 | 2013-08-07 | 东莞宇龙通信科技有限公司 | 视频中特定对象背景信息的显示方法及视频终端 |
| CN104065979A (zh) * | 2013-03-22 | 2014-09-24 | 北京中传数广技术有限公司 | 一种动态显示和视频内容相关联信息方法及系统 |
| CN104618814A (zh) * | 2014-01-30 | 2015-05-13 | 吴松珀 | 电视交互通信方法及电视终端、电视遥控器 |
| CN104113768A (zh) * | 2014-06-26 | 2014-10-22 | 小米科技有限责任公司 | 关联信息生成方法和装置 |
| CN104184923A (zh) * | 2014-08-27 | 2014-12-03 | 天津三星电子有限公司 | 用于视频中检索人物信息的系统和方法 |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112584091A (zh) * | 2019-09-29 | 2021-03-30 | 杭州海康威视数字技术股份有限公司 | 报警信息生成方法、报警信息解析方法、系统和装置 |
| CN112584091B (zh) * | 2019-09-29 | 2022-04-26 | 杭州海康威视数字技术股份有限公司 | 报警信息生成方法、报警信息解析方法、系统和装置 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106358092A (zh) | 2017-01-25 |
| CN106358092B (zh) | 2019-11-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017008652A1 (zh) | 信息处理方法及装置 | |
| US10643264B2 (en) | Method and computer readable medium for presentation of content items synchronized with media display | |
| US12015807B2 (en) | System and method for providing image-based video service | |
| US12394164B2 (en) | Interaction analysis systems and methods | |
| US10313726B2 (en) | Distributing media content via media channels based on associated content being provided over other media channels | |
| CN109729420B (zh) | 图片处理方法及装置、移动终端及计算机可读存储介质 | |
| US20180152767A1 (en) | Providing related objects during playback of video data | |
| WO2021068558A1 (zh) | 一种同声字幕翻译方法、智能电视及存储介质 | |
| US20130339857A1 (en) | Modular and Scalable Interactive Video Player | |
| WO2021136363A1 (zh) | 视频数据的处理、显示方法、装置、电子设备及存储介质 | |
| US10255243B2 (en) | Data processing method and data processing system | |
| CN105072460B (zh) | 一种基于视频内容元素的信息标注和关联方法、系统和设备 | |
| CN105580355A (zh) | 内容交易型项目的动态绑定 | |
| CN104602128A (zh) | 视频处理方法和视频处理装置 | |
| CN105069005A (zh) | 一种数据搜索方法和装置 | |
| CN105893404A (zh) | 基于自然信息识别的推送系统和方法及一种客户端 | |
| WO2015107424A1 (en) | System and method for product placement | |
| US20130205334A1 (en) | Method and apparatus for providing supplementary information about content in broadcasting system | |
| KR101181732B1 (ko) | 동영상 핑거프린트 정보에 기반한 동영상 마크업 데이터 생성 방법 및 이를 이용한 정보 제공 방법 및 시스템 | |
| TW201828155A (zh) | 資訊處理方法及裝置 | |
| CN113657928B (zh) | 广告展示方法、装置、存储介质以及终端设备 | |
| HK1233100B (zh) | 信息处理方法及装置 | |
| HK1233100A1 (zh) | 信息处理方法及装置 | |
| HK1233100A (zh) | 信息處理方法及裝置 | |
| KR101664000B1 (ko) | 감성광고를 위한 범위 커서를 이용한 타임테이블 생성 기반의 광고대상물 구매 시스템 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16823799 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 16823799 Country of ref document: EP Kind code of ref document: A1 |