TWI517683B - Content-based control system - Google Patents

Description

Content-oriented control system

The present application is related to the technical field of data processing, and more particularly to methods and apparatus related to the consumption of personalized video content using shared video devices and personal devices.

The prior art descriptions provided herein are for the purpose of presenting the disclosure. The matters described in this section are not prior art to the extent of the patent application in this application and are not considered to be prior art in this section unless otherwise indicated herein.

With advances in integrated circuits, computing, and networking technologies, personal devices such as smart phones, tablets, and the like that are configured to be used by users are becoming more and more popular. Currently, for example, television sets, or set-top boxes coupled to television sets, etc., are configured to be shared video devices used by multiple users, in part due to their additional functions such as high definition video, surround sound, and the like. Still popular. At present, except for the use of personal devices such as conventional remote controls that share a video device, there is still some integration or cooperation between the individual and the shared video device.

The present disclosure generally illustrates a method of controlling system operation based on decisions made on content broadcast on a channel. The method includes transmitting at least one message including a plurality of instructions to sample content from the channel; receiving a content on the marked channel is completed a message; and a notification to activate the completion of a content on the marked channel. Another method includes: receiving a message comprising a plurality of instructions to sample content from a channel; sampling content from a channel; transmitting a message containing a sample of the content; receiving a message including information related to the sampling of the content; and, based on the received information , to determine whether a content is completed on the channel.

Methods, devices, and storage media associated with personal video content consumption using shared and personal devices are disclosed herein. In various embodiments, a personal device (PD) method can include registration by a user's personal device to a shared video device configured for use by a plurality of users, or a shared video device and personal device used by the personal device. Related. The PD method, in turn, may be included in the certificate or associated, by the personal device in conjunction with the shared video device to facilitate personalization of video content consumption by the user.

For example, personalized video content consumption may include a content-oriented control method. The content-directed control can be automatically (eg, when changing channels in a shared video device) or manually actuated by an entity or code-based configuration, recognized gestures performed by the user, and the like. Content-oriented control causes content to be sampled from the channel, and samples are passed to remote processing resources (eg, cloud servers) for identification. Content samples are transmitted at predetermined or configured intervals. The personal device then receives a message indicating that certain content (e.g., advertisement) is determined to be completed on the channel. The personal device then performs the activity based on the received message. An exemplary activity includes actuating a user notification on a personal device, switching the shared video device back to the pass Road, and so on.

Terms commonly used by those skilled in the art are used to convey the substance of their work to others skilled in the art to illustrate various aspects of the illustrated embodiments. However, it will be apparent to those skilled in the art that <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; The number, materials, and configurations are disclosed for the purpose of illustration and description. However, it will be apparent to those skilled in the art that alternative embodiments may be practiced without these specific details. In other instances, well-known features are omitted or simplified to avoid obscuring the illustrated embodiments.

Moreover, various manners of operation will be described as a plurality of discrete operations in a manner that is most helpful in understanding the illustrated embodiments; however, the order of the description should not be construed as meaning that the operations must be in the order Dependent. In particular, these operations need not be implemented in the order presented.

The term "smartphone" as used herein, including the scope of the patent application, means having, for example, a personal digital assistant (PDA), a media player, a camera, a touch display screen, a web browser, a global positioning system (GPS). Navigation, WiFi mobile broadband, and other mobile phones beyond the mobile phone. The term "mobile phone", including the scope of the patent application, or its variations, is intended to be used in mobile electronic devices that make mobile calls across a wide geographic area served by many public cells.

Words such as "in one embodiment" or "in the embodiment" are used repeatedly. These terms are generally not meant to refer to the same embodiment; however, it may mean the same embodiment. Unless otherwise stated in the text, the words "including", "having" and "including" are agreed. "A/B" means "A Or B". The phrase "A and / or B" means "(A), (B), or (A and B)". The phrase "at least one of A, B and C" means "(A), (B), (C), (A and B), (A and C), (B and C), or (A) , B and C)". The use of "one of A or B" as used herein means "A" or "B", and does not mean or require that the "select" operation be performed.

Referring now to Figure 1, a block diagram shows an example of a shared and personal device usage configuration in accordance with various embodiments. As shown, configuration 100 can include a shared video device (SVD) 102, and a personal device (PD) 112 configured to receive and enable audio/video (A/V) content 134 for multiple For personal use, the personal device (PD) 112 is configured to provide various personal functions, such as mobile calls, for use by the user. In addition, SVD 102 and PD 112 may be configured with PD protocol function 152 and SVD cooperation function 162, respectively, to cooperate with each other to provide a more complete description of personal video content consumption as described below. In addition to the PD and SVD cooperative functions 152 and 162 provided in accordance with embodiments of the present disclosure, examples of SVD 102 may include a multi-device coupling combination of television 106 and set-top box 104, or television 106 and set-top box The single device integration of 104 can be combined, and the PD 112 example can include a mobile phone, a smart phone, a laptop, a pen memory computer, a slim notebook computer, a notebook computer, a tablet computer, and the like. In various embodiments, television set 106 can include picture-in-picture (PIP) features having one or more PIP 108 features, and set-top box 104 can include digital image capture device 154, such as a camera. Similarly, the PD 112 can also include a digital image capture device 164, such as Like a camera.

As shown, SVD 102 can be configured to couple to, and selectively receive, A/V content 134 from one or more A/V content sources (not shown), while PD 112 can be configured to be wireless The wide area network (WWAN) 120 is wirelessly coupled 148 to the cellular communication service 136. Examples of A/V content sources may include, but are not limited to, television program broadcasters, cable television operators, satellite television program providers. Internet-based program provider, digital video recorder (DVR), compact disc (CD) or digital video disc (DVD) player, or video tape recorder (VCR). The mobile communication service 136 can be a code division multiple access (CDMA) service, an enhanced GPRS (EDGE) service, a 3G or 4G service (GPRS = general packet radio service).

Still referring to FIG. 1, in various embodiments, SVD 102 and PD 112 can be coupled to each other wirelessly 142 and 144 via access point 110. The SVD 102 and PD 112 are then coupled to the remote cloud computing/network server 132 via one or more private or public network access points 110, such as the Internet 122. In other words, SVD 102, PD 112, and access point 110 may form a regional network, such as a home network. The remote cloud computing/web server 132 may include a search service such as Google® or Bing®, an e-commerce website such as Amazon®, or a social networking site such as Facebook® or MySpace®. Moreover, in various embodiments, SVD 102 and PD 112 can each be configured to enable the device to be wirelessly coupled 146 using personal and/or near field communication protocols, respectively. In various embodiments, wireless couplings 142 and 144 can include The WiFi connection, while the wireless coupling 146 can include a Bluetooth connection. In various embodiments, the PD cooperation function 152 and the SVD cooperation function 162 can communicate with one another in accordance with a Transmission Control Protocol (TCP), a User Diagram Protocol, or other messaging protocol.

In various embodiments, SVD 102 and PD 112 may have respective associated identifiers. For the embodiment, where the SVD 102 includes a television set 106 with a PIP 108, the SVD 102, in turn, may include logical identifiers that identify the home screen and the PIP 108, respectively. Moreover, in various embodiments, the identifiers can be included in at least the discovery communication transmitted by SVD 102 and PD 112, respectively, such that receivers such as PD 112 and SVD 102 can resolve the transmitter of the communication. .

Figure 2 shows various examples of SVD 102 and PD 112 in accordance with various embodiments in more detail. As previously shown and described, SVD 102 can include SVD function 151 and PD cooperation function 152, while PD 112 can include PD function 161 and SVD cooperation function 162.

In various embodiments, the SVD function 151 can include one or more communication interfaces 202 having separate transceivers, and a media player 204 having one or more A/V decoders. The communication interface 202 having separate transceivers can include, but is not limited to, configured to receive A/V content from a television connection broadcaster, a cable television operator, or a satellite program provider, an internet-based program provider. a communication interface, a communication interface configured to receive A/V content from a DVR, a CD/DVD/Blu-ray player or a VCR, a communication interface configured to communicate with the access point 110, and/or configured to communicate directly with the PD 112 Communication interface. Have one or more The media player 204 of the A/V decoder can be configured to decode and implement a wide variety of A/V content strings. A wide variety of A/V decoders can be configured to decode A/V content strings having a wide variety of formats and/or coding designs.

In various embodiments, the PD cooperation function 152 can include a PD registration/association function 212, a PD video/image/data service 214, and a PD-enabled control 216. Additionally, the PD collaboration function 152 can include a face/posture recognition function 218 and a recommendation function 220.

The PD registration/interconnection function 212 can be configured to register with the SVD 102 by the PD 112 or to associate the PD 112 with the SVD 102. In various embodiments, the registration/interconnection function 212 can be configured to register the SVD 102 with the PD 112/to associate the SVD 102 with the PD 112 by exchanging identification and/or configuration messages. In an alternate embodiment, the registration/interconnection function 212 can be configured to cooperate with the face/posture recognition service 218 to use the face recognition service, and the PD 112 to register/associate the SVD 102 with the PD 112. In various embodiments, the registration/interconnection function 212 can be configured to register with the SVD 102 and a map of the PDs 112 associated with the SVD 102. For a wide variety of set-top boxes 104 and television 106 embodiments, where the television set 106 includes PID features having one or more PIPs 108, the registration/interconnection function 212 can be configured to be in PIP-granules. The level is registered by the PD 112 to the SVD 102 or the SVD 102 is associated with the PD 112 to enable the video frames implemented in the main picture and PIP 108 to be logically associated with different PDs 112. Moreover, the PD registration/association function 212 can be configured to maintain the previously described SVD 102 to PD 112 at a PIP granulation level. In a variety of In an embodiment, the PD registration/association function 212 is in turn configured to maintain a map to include the current state of the user of the PD 112, for example, whether the user is among the current users of the SVD 102. When the user becomes the current user of SVD 102 (or one of the current users of SVD 102), or stops becoming the current user of SVD 102, PD registration/association function 212 can be configured to update status.

The PD video/image/data service 214 can be configured to enable the SVD 102 to exchange video, images, and/or materials associated with the video strings implemented at the SVD 102 with the PD 112 (eg, metadata, audio clips/sampling, etc.) Wait). The video, video and/or material associated with the video string provided by the SVD 102 to the PD 112 may be taken by the SVD 102 or taken from other third parties. In particular, the PD video/image/data service 214 can be configured to capture video clips, video clips, audio clips, and the like from a video string implemented on the SVD 102 or to capture images from a camera of the SVD 102. In addition to being provided to the PD 112, captured images, video clips, metadata, audio clips/sampling, etc. may be stored to and/or provided to the PD 112.

In addition, the PD video/image/data service 214 can be configured to provide video clips, video clips, audio clips, and the like captured from the video string to the cloud computing server to resolve the video string (eg, via video search, video search) , audio refers to search, etc.), and/or obtains metadata associated with the video string. The metadata can be provided by the video string producer/owner, the creator or the associated advertiser. Metadata associated with the video string can also be stored or provided to the PD 112. In addition, the viewing history can be It is stored on the SVD 102.

The PD-enabled control 216 can be configured to be controlled by the PD 112 and, thus, responsively control the SVD 102 to facilitate personalized video consumption. Control includes, but is not limited to, controlling video images taken from the SVD 102, or controlling the implementation of video strings on the SVD 102, such as stopping, pausing, forwarding, or reversing the video strings. The PD-enabled control 216 can also be configured to be controlled by the PD 112 to control the implementation parameters of the 3D TV video string on the SVD 102 to monitor the quality of the implemented 3D TV image. Parameter control includes the depth range that controls the 3D video. Quality monitoring can include monitoring for, for example, the presence of non-horizontal disparity, excessive convergence, color inconsistency between left and right viewing, synchronization issues, and the like.

The face/posture recognition function 218 can be configured to provide some facial recognition and/or gesture recognition services. The face recognition service can include face recognition in the picture, including age, gender, ethnicity, and the like. The face recognition service may further include recognition of facial expressions, such as consent, disagreement, interest, no interest, happiness, sadness, anger, or calm. Face recognition can be based on one or more facial or biometric features. The gesture recognition service is based on one or more facial biometrics. The gesture recognition service may include identification of some gestures, including but not limited to the gesture of pointing up to the "like" of the thumb, and the gesture of the thumb pointing to "dislike". The two fingers are separated from each other to represent "zoom in". The two fingers face each other to represent "shrinking", and the two fingers or two hands are intertwined to represent "exchange."

The recommendation function 220 can be configured to be between the SVD cooperation function 162 and the PD function 161, and/or to use the SVD 102 and the PD 112. Interaction/cooperation, individually or in conjunction with recommendation function 242, provides personalized recommendations to users of PD 112. Personalized recommendations may be other content potentially useful to users of PD 112, other websites, other advertisements, other goods, and the like.

In various embodiments, the PD registration/interconnection function 212 can be configured to cooperate with the face/posture recognition function 218, and the SVD can be implemented by different PDs 112, or by the association of different PDs 112. 102 or registration of the logical unit of SVD 102 (eg, if SVD 102 includes television 106 with PIP 108).

As used herein, "associated" means the relationship between two entities, such as SVD 102 and PD 112, and the term "registration" as used herein refers to the action of one entity and another entity, for example, to form an entity. The "action" between the "related" purposes. In other words, the present disclosure contemplates that the "related" between SVD 102 and PD 112 can be formed unidirectionally or bidirectionally. For example, SVD 102 unilaterally considers a particular PD 112 to be associated with SVD 102 by knowing, for example, a particular PD 112, such as identification, without registering itself with a particular PD 112 or requiring PD 112 to register itself. On the other hand, SVD 102 and/or PD 112 recognize each other ("Registration") to form an association.

With continued reference to FIG. 2, in various embodiments, the PD function 161 can include one or more communication interfaces 222 having respective transceivers, a media player having one or more A/V decoders. 224. Input device 226, and browser 228. The communication interface 222 can include a communication interface configured to communicate with the cellular communication service, configured to communicate with the access point 110. Communication interface, communication interface configured to communicate directly with SVD 102. Media player 224 having one or more A/V decoders can be configured to decode and cause a wide variety of A/V content strings. A wide variety of A/V decoders can be configured to decode A/V content strings having a wide variety of formats and/or coding designs.

Input device 226 can be configured to enable a user of PD 112 to provide a wide variety of user inputs. Input device 226 includes a keyboard (real or virtual) to enable a user to provide text input, and/or cursor control devices such as touch pads, trackballs, and the like. In various embodiments, input device 226 can include a visual and/or tactile sensing display screen to enable a user to provide gesture input. The gesture input contains gestures that are the same or different than the gestures previously described with respect to the face/posture recognition service 218.

Browser 228 can be configured to enable a user of PD 112 to access a remote search service, an e-commerce website, or a social network on the Internet. Examples of search services may include Google®, Bing®, and the like. E-commerce sites can include Amazon®, Best Buy®, and more. Social networks can include Facebook®, MySpace®, and more. The browser 228 can also be configured to enable a user of the PD 112 to participate in a special interest group (SIG) associated with the video string program implemented on the SVD 102. This SIG can be dynamically formed or preformed based on the current content delivered by the content provider. Such SIGs can also be geographically divided or divided according to the type of PD device.

In various embodiments, the SVD cooperation function 162 can include an SVD registration function 232, an SVD video/data service 234, and an SVD control function. Can 236. The SVD collaboration function 162, in turn, can include a recommendation function 242, and a face/posture recognition service 244.

Similar to the PD registration/interconnection function 212 of the SVD 102, the SVD registration/interconnection function 232 can be configured to register with the SVD 102 or associate the SVD 102 with the PD 112. For a variety of set-top boxes 104 and television 106 embodiments in which the television set 106 includes PIP features, the SVD registration function 232 can be configured to register with the PD 112 at the granulating level by the SVD 102 or to enable the SVD 102 and the PD 112. The association is such that the video strings implemented on the home screen and PIP 108 can be independently associated with the same or different PDs 112.

Similar to the PD video/image/data service 214 of the SVD 102, the SVD video/image/data service 234 can be configured to exchange video, images, and/or materials associated with the video strings implemented on the SVD 102 with the SVD 102 ( For example, metadata, audio clips/sampling, etc.). Similarly, the SVD video/image/data service 234 can also be configured to transmit and/or accept video, images, and/or materials to the cloud computing server. The SVD video/image/data service 234 can be configured to cooperate with the browser 228 to enable transmission and/or acceptance of video, images, and/or materials to the cloud computing server.

SVD control 236 can be configured to provide content to SVD 102 to control SVD 102. As previously described with respect to SVD 102 as controlled by PD 216, control includes, but is not limited to, zooming in or out of PIP 108, exchanging video strings between the home screen and PIP 108, stopping, pausing, fast forwarding, or reversing video strings. . The SVD control 236 can also be configured to provide the SVD 102 to adjust the 3D TV video string on the SVD 102 to control its products. quality. In addition, SVD control 236 can be configured to provide automatic video string switching during commercials and to automatically switch back when commercials are over. The SVD control 236 can also be configured to provide control to the SVD 102 to adjust the implementation of the 3D TV video string on the SVD 102 to control the quality of the implemented 3D TV image. Controls the control of the relative depth between the component images, reducing the color and/or sharpness of the edges.

Similar to the recommended function 220 of the SVD 102, the recommendation function 242 can be configured to individually or with the recommended function based on interaction/cooperation with the SVD 102 between the SVD cooperation function 162 and the PD function 161, and/or using the PD 112. The combination of 220 provides personalized video content recommendations to the users of the PD 112. The recommendation function 242, in turn, can be configured to utilize other material available on the PD 112, such as, for example, a visited location, a location recorded by a GPS on the PD 112, and the like.

Before proceeding with further explanation, it should be noted that although the embodiments of SVD 102 and PD 112 are shown in FIG. 2, with the two devices having recommended functions 220 and 242, respectively, and face/posture recognition services 218 and 244, Other embodiments are implemented with only one or none of the SVD 102 and PD 112 having a recommended function or a face/posture recognition service. Similarly, although the video/image/data services 214 and 234, and the face/posture recognition services 218 and 244 are illustrated as a combined service for ease of understanding, in alternative embodiments, the disclosure may be subdivided into One or both of these services are implemented separately, such as video/image/data services that are then segmented into separate video, video, and data services, or segmented into separate faces, And posture discrimination Identify the face/pose recognition service of the service.

Thus, upon registration or association, the PD cooperation function 152 and the SVD cooperation function 162 can cooperate to facilitate the consumption of personalized video content by the users of the PD 112. For example, the PD-enabled control 216 and the SVD control function 236 can cooperate to enable the user of the PD 112 to control the operation of the SVD 102. More specifically, by identifying the face/pose recognition service for a particular user gesture, the PD-enabled control 216 and SVD control function 236 can cooperate to respond and enable the segments of the video string implemented on the SVD 102 to Play on PD 112. In addition, the PD function control 216 and the SVD control function 236 can cooperate to enable the video string implemented on the SVD 102 to be stopped, paused, quickly forwarded, or reversed in response to the identification of another user's gesture input. Similarly, the PD-enabled control 216 and SVD control functions 236 can cooperate to enable the PIP 108 of the SVD 102 to zoom in or out, or to enable the two video strings implemented in the main picture and in the PIP 108 to be exchanged.

In yet another example, recommendation functions 220 and/or 242 are used individually or in combination to analyze past interactions or collaborations, as well as to make a variety of recommendations, such as other video content that is viewed on SVD 102, Other websites or content that are visited/browsed on the PD 112, and/or other items to be purchased.

3 shows an example of a method of using personalized video content consumption for shared and personal devices in accordance with various embodiments. As shown, method 300 can begin with blocks 302 and/or 304, register with SVD 102 and/or PD 112, or be associated with each other, as will be more fully described below with reference to FIG. Description. In various embodiments, the PD 112 itself may register with the SVD 102 or associate the SVD 102 with itself to implement the method 300. In another embodiment, SVD 102 itself may register with PD 112 or associate PD 112 with itself to implement method 300. In still other embodiments, SVD 102 and PD 112 may be registered with one another or they may be associated with each other to implement method 300.

In various embodiments, SVD 102 and PD 112 may also exchange configuration information as part of the registration process for subsequent communication. For example, SVD 102 and PD 112 can exchange their respective capability information, such as processing power, supported encoding/decoding designs, supported messaging protocols, and the like. In various embodiments, SVD 102 and/or PD 112 may also be configured as part of the registration process to cause the required software and/or updates to be pushed to and/or installed on other devices.

Upon registration or association, method 300 can proceed to block 306 where PD 112 can receive a selection or indication from a user of PD 112 to cause SVD 102 and PD 112 to cooperate to provide personalized user functionality. The method 300 can proceed from block 306 to block 308 where the PD 112 and the SVD 102 can cooperate to facilitate cooperation to provide personalized user functionality to the user.

At block 308, control of the SVD 102 is received. As described earlier, the control can be input via the gesture of the user of the PD 112. As described earlier, control may include, but is not limited to, requesting to play a section of a video string implemented on the SVD 102 on the PD 112, requesting the SVD 102 to stop, pause, fast forward or reverse the video string implemented on the SVD 102, requesting a PIP 108 Zoom in or out, and/or request the main screen and PIP 108 to exchange. Upon receiving control, method 300 may proceed from block 308 to block 318, and then to block 320 to cause control to be transferred from PD 112 to SVD 102, and to cause control to be processed and responded on SVD 102. If control is to play a video segment on PD 112, method 300 may return from block 320 via blocks 312 and 310 to block 308, otherwise method 300 may return to block 308 via block 318.

Additionally, or in lieu of the operations described earlier, at block 308, method 300 can proceed to block 322 where a historical video content consumption analysis, user actions associated with the consumed video content, and SVD 102 and PD 112 can be performed. The interaction/cooperation between, as well as personalized recommendations for other content consumption or user actions, can be presented to the user of PD 112.

Thereafter, the above operations are repeated in response to a variety of further user inputs. Finally, method 300 can proceed from block 308 to block 324, where user input provided by the user function cooperation can be received. Method 300 can terminate upon receiving this input.

In various embodiments, in addition to facilitating the use of SVD 102 and PD 112 to consume personalized content by users of PD 112, method 300 can also include SVD 102 that cooperates to provide personalized user functionality and PD 112. Examples of such personalized user functions may include images and/or annotations of objects within the image associated with the video content being consumed, based at least in part on or resulting from images associated with the video content being consumed Images and/or objects within the site, performing online searches, and social networks Station interaction, and / or perform e-commerce transactions. For this collaborative personalization function provision, method 300 can in turn transition from block 308 to blocks 310 and 312, and back, or to blocks 314 and 316, and back. The co-operative personalized user function is provided as the subject of the co-pending application of the co-pending application number 110466-182901. For further details, reference is made to the co-pending application.

4 shows various examples of face recognition based methods for registration and/or association between shared and personal devices in accordance with various embodiments. As shown, method 400 can begin, for example, at block 402, taking a picture of its user with SVD 102 (equipped with an image capture device such as a camera). In various embodiments, the SVD 102 can take a picture of its user by taking a picture of the space in front of the SVD 102, and then analyze the picture for the user's face (eg, using face/posture recognition) Service 218). Upon identifying a new user's face, the SVD 102 (using, for example, the registration/interconnection function 212) can generate a new user's picture. The SVD 102 can periodically perform shooting and generating operations, for example, at power-on, and thus periodically on a time-based or event-based basis, which can be, for example, implemented video string changes on an event basis. Or when the picture of the video string being implemented changes.

The method 400 can proceed from block 402 to block 404, wherein the SVD 102 can transmit a picture of the user of the SVD 102 to the PD 112 in response to the detection of the PD 112 or the contact of the PD 112. The method 400 can proceed from block 404 to block 406, wherein the PD 112 can display a screen of the user of the received PD 112 for certain "manual" embodiments to confirm One of the received pictures is the picture of the user of the PD 112. Alternatively, for some "automatic" embodiments, the PD 112 may compare the received picture with the reference picture of the user of the PD 112 using, for example, the face/posture recognition service 244. The reference picture of the user of the PD 112 can be previously provided to the PD 112 or taken by the PD 112 (for an embodiment equipped with an image capture device such as a camera).

The method 400 can proceed from block 406 to block 408, wherein for a "manual" embodiment, the PD 112 can receive a selection of one of the pictures received by the user of the PD 112, the selection indicating the user selection of the SVD 102 The picture corresponds to the user of the PD 112. For an "automatic" embodiment, PD 112 may select one of the received pictures that substantially conform to the reference picture.

Method 400 can proceed from block 408 to block 410, where PD 112 can be associated with SVD 102 using itself. Upon associating itself with SVD 102, PD 112 may transmit selection information (provided by the user or comparison operation) to SVD 102 to direct itself to SVD 102 (or a logical unit of SVD 102, such as SVD 102's television) The PIP 108 of the machine 106 is registered.

The method 400 can proceed from block 410 to block 412, wherein the SVD 102 can respond to the provided selection and associate itself with the PD 112, including associating the user of the selected picture with the PD 112. The PD 112 can also maintain a map of the various SVDs 102 associated with it (e.g., in the SVD 102 of the home residence, the SVD 102 at the beach house, etc.), in various embodiments, SVD 102 can turn itself PD 112 is registered.

In an alternate embodiment, method 400 may alternatively proceed from block 404 to block 422, where at block 422, the user-captured/generated picture may be used, and SVD 102 contacts an external source, such as a cloud computing server, to The identification and/or configuration information of the PD 112 is obtained. The method 400 can proceed from block 422 to block 412, wherein the SVD 102 can associate itself with all of the PDs 112 capable of obtaining at least the identification information, including enabling the plurality of user screens to obtain identification information based on the user's screen, respectively. PD 112 is associated.

In an alternate embodiment, method 400 may alternatively begin at block 432 with the PD 112 contacting an external source, such as a cloud computing server, to obtain identification and/or configuration information for the SVD 102. If successful, from block 432, PD 112 may proceed to block 410 where PD 112 may associate SVD 102 with itself. At block 410, the PD 112 may register itself with the SVD 102. Method 400 may proceed from block 410 to block 412 as previously described.

5 shows a user perspective of an example of a personalized user function providing cooperation for a shared and personal device in accordance with various embodiments of the present disclosure. As shown, initially, the cooperating personalized user function can provide a 500 instance to present an option to the user of the PD 112 via, for example, an image displayed on the PD 112 to initiate the SVD collaboration function 162. In response to the selection of options, an option to select SVD registration/interconnection function 232, or SVD control 236 for facilitating personalized video content consumption, may be presented to the user of PD 112. In a wide variety of embodiments, SVD video/image/ The selection of the data service 234 can in turn be presented to the user of the PD 112.

Upon selection of the SVD registration/interconnection function 232, various registration and/or associated operations, such as message-based or face recognition-based registration/related connections, are performed as previously described. . Upon selection of the SVD control function 236, the user of the PD 112 can provide a gesture recognition function 516 to receive and accept gestures to control the SVD 102, for example, zooming in or out of the PIP 108, exchanging between the home screen and the PIP 108. The video string, either stop, pause, quickly forward or reverse the video string implemented on the SVD 102.

In an embodiment that also provides an option for the SVD video/image/data service 234, upon requesting the SVD video/image/data service 234, a request 502 for a video segment requesting a video string implemented on the SVD 102, or A request 504 for requesting an image frame of a video string implemented on the SVD 102 is presented to the user of the PD 112. Upon selection request 502 or request 504, 506 the requested video segment may be played 506, the image grid or one or more objects being annotated 238, and/or stored annotated or untouched 240. In addition, a wide variety of browser 228 related functions can be performed. 6 shows a user perspective 616 of a cloth image or an annotation within an article in accordance with various embodiments of the present disclosure. 6 shows an image 612 with one of a plurality of objects 614 selected, with a pop-out area 618 for inputting annotations, and a pop-up menu 620 provided with various functional options provided by the SVD 102 and PD 112 in cooperation. These features are the subject of the above related applications. For further details, please refer to the above related application.

Figure 7 shows a common and various embodiments in accordance with the present disclosure. An example of a personalized recommendation for a human device collaboration. As shown, method 700 can be initiated at block 702 by PD 112 alone or in cooperation with SVD 102, wherein video content consumption, user actions associated with the video content being consumed, PD 112 and SVD 102 The interaction and cooperation between the two is recorded and stored in the PD 112, SVD 102, or cloud computing server. The operation of block 702 can continue.

Method 700 can be performed periodically from block 702 to block 704, where the SVD 102 and/or PD 112 can analyze the stored information individually or in combination. The method 700 can proceed from block 704 to block 706, wherein the SVD 102 or the PD 112 can make personalized video content and/or other relevant recommendations to the user of the PD 112 based, at least in part, on the results of the analysis. As mentioned earlier, personalized recommendations can include video feeds, websites, and the like.

Method 700 can return from block 706 to block 702 and continue from here as previously described.

FIG. 8 shows a non-transitory computer readable storage medium in accordance with various embodiments of the present disclosure. As shown, the non-transitory computer readable storage medium 802 can include a plurality of program instructions 804. The plurality of program instructions 804 can be configured to enable the SVD 102 or PD 112 to perform operations of the SVD or PD portion of the methods 300-400 previously described with reference to Figures 3-4 in response to a corresponding program of the SVD 102 or PD 112. Instruction execution. In an alternate embodiment, the program instructions may alternatively be configured in two or more storage media.

Figure 9 shows suitable as an SVD in accordance with various embodiments of the present disclosure. Or a computing system instance of PD. As shown, computing system 900 can include multiple processors or processor cores 902, and system memory 904. For the purposes of this application, including the scope of the patent application, the "processor" and "processor core" may be considered synonymous unless otherwise indicated. Moreover, computing system 900 can include a number of storage devices 906 (eg, magnetic disks, hard disks, CD-ROMs, etc.), input/output devices 908 (eg, display, keyboard, cursor control, touch) Pads, cameras, etc.) and communication interface 910 (eg, WiFi, Bluetooth, 3G/4G network interface cards, modems, etc.). These elements may be coupled to each other via a system bus 912 that represents one or more bus bars. In the case of multiple busbars, they may be bridged by one or more busbar bridges (not shown).

Each of these elements performs conventional functions as are known in the art. In particular, system memory 904 and mass storage 906 can be used to store working and permanent copies of program instructions for implementing the SVD or PD portion of methods 300-400 previously described with reference to Figures 3 and 4, i.e., The PD cooperation function 152 or the SVD cooperation function 162, or a portion thereof, is collectively referred to herein as computational logic 922. Calculation logic 922, in turn, can include program instructions to implement or support SVD function 151 or PD function 161, or portions thereof. A wide variety of components can be implemented by machine language instructions supported by processor 902 or higher level languages such as C language that can be compiled into these instructions.

Place a permanent copy of the program instructions on the spot or in the factory via a distribution medium (not shown) such as a CD (CD) or via a communication interface 910 (from a scatter server (not shown)) Mass storage In 906. That is, one or more of the distributed media having implementations of computing logic 922 can be used to spread computing logic 922 to program a wide variety of computing devices.

The construction of these elements 902-912 is known and will therefore not be further described.

Content-oriented control

As described herein, content-directed control (CBC) can include decisions based on content propagated on the channel to control the operation of the devices in configuration 100. As described herein, a channel is defined as a stream of incoming content associated with a content provider. Examples of content providers associated with a channel may include, but are not limited to, a television program broadcaster, a cable television operator, a satellite television program provider, an internet based program provider, and the like.

Many content providers play advertisements on their channels. While advertising is inconvenient and/or confusing to the user, the content provider can earn revenue from the inclusion of the advertisement. Therefore, the content provider has no incentive to eliminate or even limit the amount of advertising on the channel. If the user is not interested in the advertisement, the user can view other content, roam the Internet, etc. as the advertisement spreads on the channel. In one embodiment, the advertisement is detected and monitored, allowing the user to perform other activities as the advertisement propagates over the channel, and, when the advertisement is completed, notifying the user that content viewing on the channel can continue.

FIG. 10 shows an example of Content Oriented Control (CBC) in accordance with at least one embodiment. The PD 112 can be configured to communicate via, for example, wireless 146 (shown in FIG. 1, omitted for simplicity in FIG. 10) interacts with the content recognition module 1000 in the SVD 102. The content recognition module 1000 can also be configured to communicate with the cloud computing/network service 132 via the access point 110 and the Internet 122 (shown in FIG. 1, omitted for simplicity in FIG. 10). The CBC can be actuated automatically or manually in the PD 112. For example, when the PD 112 senses that the channel being viewed on the SVD 102 changes, the automatic actuation can be actuated. For example, sensing channel changes are performed by control of the PD function 216 (as shown, for example, in Figure 2). Manual actuation may include configuration of a physical interface in the PD 112 (eg, pressing a button) or code based keys, switches, and the like. Manual actuation may also include a face/posture recognition service 218 (eg, as shown in FIG. 2) to identify that a particular facial expression, gesture, etc. made by the user is related to actuation of the CBC in the PD 112. even.

Actuation of the CBC may cause the PD 112 to transmit a CBC command 1002 (eg, CBC command 1, CBC command 2 ... CBC command n) to instruct the content to be sampled on the channel (eg, to determine when something is completed on the channel) ). The CBC command 1002 can be transmitted by the PD 112 at intervals of, for example, 1004 every ten seconds. Interval 1004 may be predetermined, may be automatically configured (eg, based on device processing capacity and/or availability of communication bandwidth), manually configured by a user in PD 112 or SVD 102, and the like. In one embodiment, the CBC command 1002 can identify the channel to be sampled (eg, the channel being viewed on the SVD 102 when the CBC is actuated). In the same or another embodiment, the CBC instruction 1002 can in turn identify certain content (eg, content under control), and the like. Alternatively, Some content may be defined in the content recognition module 1000 (for example, if the control is always based on the advertisement), may be configured by the user in the PD 112 or SVD 102, and the like. The content recognition module 1000 can receive the CBC command 1002, sample content from the identified channel, and transmit the content sample 1006 to the cloud computing/network server 132 (eg, sample 1, sample 2, sample n). Content sampling and transmission can be performed by, for example, an SVD video/image/data service 234 (e.g., as shown in FIG. 2).

As described with respect to the video/image/data service 214 in FIG. 2, the cloud computing/web server 132 can include a search service configured to identify content and/or obtain metadata associated with the content. Upon receiving the content sample 1006 from the content recognition module 1000, the cloud computing/network server 132 can identify the content from which the content sample 1006 was sampled, and transmit the information 1008 (eg, information 1, information 2... information) n) to the content recognition module 1000, wherein the information 1008 can identify and/or provide metadata about the content sample 1006. The content recognition module 1000 can then be configured to determine whether a content (eg, an advertisement) has ended on the channel based on the information 1008 provided by the cloud computing/web server 132. For example, the content recognition module receives the information 1008, allowing it to determine that the program content is restored on the channel. The content recognition module 1000 can then transmit a content completion message 1010 to the PD 112.

Upon receiving the content completion message 1010, the PD 112 can actuate the notification 1012. The notification 1012 to the user of the PD 112 can indicate that the content is completed on the channel (eg, the end of the advertisement and/or the content of the program is restored on the channel). Notification 1012 can be provided via a user interface in PD 112. The user interface may include elements typically associated with smart phones, mobile phones, and the like, including visual elements such as displays, LEDs, etc., auditory elements such as speakers, and/or electromechanical devices configured to cause vibration of the PD 112, for example. A tactile component such as a component. The notification 1012 can include at least one of a visual, audible, or tactile warning, for example, including illuminated and/or flashing markers, noise, alarms, vibrations, and the like. In one embodiment, the code-based marker can be displayed on the user interface, indicating that a content (eg, an advertisement) is completed on the channel, and that the channel is displayed by touching the code-based marker. In the SVD 102. If the user continues to touch the code-based marker, the PD-enabled control 216 (e.g., as shown in FIG. 2) then causes the SVD 102 to display the channel. In another embodiment, the PD 112 may automatically cause the SVD 102 to display channels in addition to providing notifications to the user.

Although the content recognition module 1000 is disclosed as being completely disposed in the SVD 102, various embodiments are not limited to this configuration. The functions performed by the content recognition module 1000 may also be split between the PD 112 and the SVD 102 depending on, for example, the capabilities of the various devices. For example, if SVD 102 does not have processing capacity to sample content and/or transmit content samples to cloud computing/network server 132, one or both of these operations may be performed by PD 112 (for example, As shown in FIG. 2, executed by PD video/image/data service 214). In case the PD 112 can be configured to perform at least a content sampling operation, additional functionality is also provided to the user to view and/or annotate the content samples. For example, the user views the content, and samples the samples associated with the content (for example, the identification is wide). The report is then annotated to indicate that the sample is related to the advertisement, the product/service associated with the advertisement, etc., prior to transmission to the cloud computing/web server 132. Providing the ability for the user to submit input (e.g., also referred to as "crowd sourcing") increases the knowledge available in the cloud computing/network server 132 and thus increases the accuracy and/or speed of the CBC. In addition, the PD 112 individually or partially processes the final decision as to whether a content is completed on the channel.

A flow chart of the CBC operation example from the viewpoint of the PD 112 is shown in FIG. In operation 1100, the CBC can be actuated. As described above, CBC actuation can occur automatically or manually. Then, in operation 1102, the PD 112 can transmit a CBC command message. Then, in operation 1104, it may be determined whether a message indicating that the content (eg, an advertisement) is completed on the channel is received in the PD 112. In the event that it is determined in operation 1104 that the message has not been received, the PD 112 may delay an interval in operation 1106 that is set for CBC command transmission. Following the interval, another CBC command can be transmitted in operation 1102. Alternatively, if, in operation 1104, it may be determined that a message indicating completion of the content on the channel is received in the PD 112, then the notification is actuated in operation 1108 to notify the user that the content is complete. Along with the options for displaying channels, notifications can be provided, channels can be automatically displayed, and so on.

A flow chart of the CBC operation example of the viewpoint of the SVD 102 is shown in FIG. In operation 1200, a CBC command can be received in the SVD 102. In operation 1202, the content from the channel (eg, the channel indicated in the received CBC command) is sampled, and the content sample is transmitted. Sent (eg, to the cloud computing/web server 132). Then, in operation 1204, the SVD 102 can receive information related to previously transmitted content samples (eg, from the cloud computing/web server 132). In operation 1206, a decision can then be made based on whether a piece of content (eg, an advertisement) has received information on the channel. If at operation 1206 it is determined that something is not complete on the channel (eg, the advertisement is still propagating in the channel), then processing returns to operation 1200 to prepare to receive further CBC instructions. In the event that it is determined in operation 1206 that a certain content is completed on the channel, then in operation 1208, a content completion message may be transmitted.

Although Figures 11-12 illustrate operations in accordance with various embodiments, it is to be understood that not all of the operations illustrated in Figures 11-12 are necessary for other embodiments. Indeed, it is fully contemplated herein that in other embodiments of the present disclosure, the operations illustrated in Figures 11-12 and/or other operations described herein may not be specifically shown in any of the Figures but still fully comply with this disclosure. The way of revealing is combined. Therefore, the scope of the patents relating to the features and/or operations that are not specifically shown in the drawings are considered to be within the scope and content of the disclosure.

As used in any embodiment herein, the term "module" means a software, firmware, and/or circuit configured to perform any of the above operations. The software can be embodied as a package of software, code, instructions, instruction sets, and/or materials stored on a non-transitory computer readable storage medium. The firmware may be embodied as a code, instruction or set of instructions and/or data that is hard coded (eg, non-electrically) in the memory device. As used in any embodiment herein, "circuitry" includes, for example, a single or any combination of solid wires. A firmware, such as a computer processor including one or more individual instruction processing cores, a state machine circuit, and/or a firmware that stores instructions executed by the programmable circuit. Modules may be implemented, in whole or in part, as circuits that form part of a larger system, such as integrated circuits (ICs), system-on-chip (SoCs), desktops, laptops, tablets, Servers, smart phones, and more.

Accordingly, the present disclosure provides methods and systems for content directed control. During content-oriented control, a sequence of content (eg, a channel) can be sampled, and each sample is transmitted to a remote processing source. The remote processing source identifies at least each sample and responds with information related to each sample. Information can be used to determine when something (eg, an ad) is completed on the channel. When it is determined that a content is completed on the channel, the notification can be actuated in the device, possibly in conjunction with an option to select or automatically select a channel for viewing.

According to one aspect, a system is provided. The system includes: at least one communication interface configured to send and receive messages; a user interface configured to provide notifications; and one or more storage media. Moreover, one or more storage media store, individually or in combination, a plurality of instructions that, when executed by one or more processors, cause the operations of: transmitting at least one message comprising a plurality of instructions, Sampling content from the channel; receiving a message indicating completion of a content on the channel; and initiating notification of completion of a content on the marked channel.

According to another aspect, a system is provided. The system includes: at least one communication interface configured to send a message, receive a message, and receive sound/video content; and one or more storage media. In addition, one or more Each of the storage media stores, separately or in combination, a plurality of instructions that, when executed by one or more processors, cause an operation comprising: receiving a message comprising a plurality of instructions to sample content from the channel; sampling from the channel Content; transmitting a message containing a sample of the content; receiving a message including information related to the content sampling; and, based on the received information, determining whether the content is completed on the channel.

According to another aspect, a system is provided. The system includes one or more storage media, the one or more storage media storing, individually or in combination, a plurality of instructions that, when executed by one or more processors, cause the operations of: At least one message of the plurality of instructions to sample content from the channel; receive a message indicating completion of a content on the channel; and actuate a notification indicating completion of a content on the channel.

According to another aspect, a system is provided. The system includes one or more storage media, the one or more storage media storing, individually or in combination, a plurality of instructions that, when executed by one or more processors, cause an operation comprising: receiving a plurality of instruction messages for sampling content from the channel; sampling content from the channel; transmitting a message containing the content sample; receiving a message including information related to the content sampling; and, based on the received information, determining whether the content is on the channel carry out.

According to another aspect, a method is provided. The method includes: transmitting at least one message including a plurality of instructions to sample content from a channel; receiving a message indicating completion of a content on the channel; and initiating notification of completion of a content on the marked channel.

According to another aspect, a method is provided. The method includes: receiving a package a message containing multiple instructions to sample content from the channel; to sample content from the channel; to send a message containing the content sample; to receive a message including information related to the content sample; and, based on the received information, to determine that the content is on the channel Whether it is completed.

While many specific embodiments have been shown and described herein, it will be understood by those skilled in the art that many different alternative and/or And the specific embodiments described. This application is intended to cover any adaptations or variations of the embodiments described herein. Therefore, the embodiments of the present disclosure are obviously limited only by the scope of the claims and their equivalents.

100‧‧‧Configuration

102‧‧‧Shared video device

104‧‧‧Machine box

106‧‧‧TV

110‧‧‧ access point

112‧‧‧Personal devices

122‧‧‧Internet

132‧‧‧Cloud Computing/Web Server

142‧‧‧Wireless coupling

144‧‧‧Wireless coupling

146‧‧‧Wireless coupling

802‧‧‧ computer readable media

900‧‧‧Computation System

902‧‧‧ processor

904‧‧‧System Memory

906‧‧‧Many storage devices

908‧‧‧Input/output devices

910‧‧‧Communication interface

912‧‧‧System Bus

922‧‧‧ Calculation logic

1000‧‧‧Content Identification Module

The present invention is illustrated by way of example, and not by way of limitation, in the Figure 2 shows in more detail a separate example of a shared video device and personal device; Figure 3 shows an example of a method for using personalized video content for shared and personal devices; Figure 4 shows registration and association between shared and personal devices A variety of examples of face recognition-based methods; Figure 5 shows the consumption of personalized video content using shared and personal devices User view; Figure 6 shows the user's point of view of the selected personalized user function provided by the shared and personal device; Figure 7 shows an example of a method for personalization recommendation for sharing and personal device cooperation; Figure 8 shows the command An example of a storage medium readable by a non-transitory computer, the instructions being configured to implement all or selected methods of FIGS. 3-4; FIG. 9 shows an example of a computing environment suitable as a shared or personal device; FIG. An example of content-directed control (CBC) according to at least one embodiment is shown; FIG. 11 shows a flowchart of an example of a content-oriented control (CBC) operation from the perspective of a personal device; and FIG. 12 shows content from the viewpoint of a shared video device Flowchart of an example of a guided control (CBC) operation.

While the "Implementation" section is made with reference to the illustrated embodiments, many alternatives, modifications, and variations will be apparent to those skilled in the art.

100‧‧‧Configuration

102‧‧‧Shared video device

104‧‧‧Machine box

106‧‧‧TV

108‧‧‧Picture in picture

110‧‧‧ access point

112‧‧‧Personal devices

120‧‧‧Wireless WAN

122‧‧‧Internet

132‧‧‧Cloud Computing/Web Server

134‧‧‧A/V content

136‧‧‧Hive Communication Service

142‧‧‧Wireless coupling

144‧‧‧Wireless coupling

146‧‧‧Wireless coupling

148‧‧‧ wirelessly

152‧‧‧PD cooperation function

154‧‧‧Digital image capture device

162‧‧‧SVD cooperation function

164‧‧‧Digital image capture device

Claims (33)

A system comprising: a mobile phone configured to wirelessly communicate with a cellular communication service, the mobile phone further comprising: at least one communication interface configured to send and receive messages; and a user interface configured to Providing a notification; and one or more storage media having instructions stored thereon, individually or in combination, when the instructions are executed by one or more processors, resulting in: Transmitting, by the at least one communication interface, at least one message including an instruction to sample content from the channel; receiving, by the at least one communication interface, a message indicating completion of a content on the channel; and causing a message on the user interface A notification indicating the completion of the content on the channel. For example, in the system of claim 1, wherein more than one message is sent, and the messages are sent at intervals. A system as claimed in claim 1, wherein more than one message is sent, the messages being sent until a message indicating completion of the content on the channel is received. For example, the system of claim 1 is wherein the content is an advertisement. A system as claimed in claim 1, wherein the notification is at least one of a visual, audible or tactile notification. The system of claim 1, wherein the notification provides an option to select the channel for viewing on the device. For example, the system of claim 1 of the patent scope also includes selecting the channel for viewing on the device. A system comprising: at least one communication interface configured to send a message, receive a message, and receive an audible/visual content; and one or more storage media having instructions stored thereon separately or in combination When the instructions are executed by one or more processors, the operations include: receiving, by the at least one communication interface, a message from the mobile phone that includes an instruction to sample content from the channel; a communication interface for sampling content from the channel; transmitting, by the at least one communication interface, a message including the sample of the content; receiving, by the at least one communication interface, a message including information related to the sampling of the content; a communication interface, based on the received information, determining whether a content is completed on the channel; and, by the at least one communication interface, after determining that the content is completed on the channel, indicating that the content is completed A message on the channel is sent to the mobile phone. The system of claim 8, wherein the received message identifies the content. The system of claim 8 wherein the message is sent to a remote processing resource, the remote processing resource comprising at least one server. The system of claim 8 wherein the information relating to the sampling of the content identifies at least the content from which the sampling system was taken. A system comprising one or more storage media having instructions stored thereon separately or in combination, the instructions being caused by one or more processors of a mobile phone The operations include: transmitting at least one message including an instruction to sample content from the channel; receiving a message indicating completion of a content on the channel; and actuating the channel on a user interface of the mobile phone The notification of the completion of the content. For example, in the system of claim 12, wherein more than one message is sent, the messages are sent at intervals. A system as claimed in claim 12, wherein more than one message is sent, the messages being sent until a message indicating completion of the content on the channel is received. For example, the system of claim 12, wherein the content is an advertisement. A system as claimed in claim 12, wherein the notification is at least one of a visual, audible or tactile notification. A system of claim 12, wherein the notification provides an option to select the channel for viewing on the device. The system of claim 12, further comprising selecting the channel for viewing on the device. A system comprising one or more storage media having instructions stored thereon separately or in combination, the instructions being executed by one or more processors resulting in the following operations The operations include: receiving a message from the mobile phone containing instructions to sample content from the channel; sampling content from the channel; transmitting a message containing the sample of the content; receiving a message including information related to the content sampling; Receiving information, determining whether a content is completed on the channel; and after determining that the content is completed on the channel, transmitting a message indicating that the content is completed on the channel to the mobile phone. The system of claim 19, wherein the received message identifies the content. The system of claim 19, wherein the message is sent to a remote processing resource, the remote processing resource comprising at least one server. The system of claim 19, wherein the information relating to the sampling of the content identifies at least the content from which the sampling system was taken. A method comprising: transmitting at least one message from a mobile phone containing an instruction to Channel sampling content; receiving, at the mobile phone, a message indicating completion of a content on the channel; and initiating a notification on the user interface of the mobile phone indicating completion of the content on the channel. The method of claim 23, wherein one or more messages are sent, and the messages are sent at intervals. The method of claim 23, wherein one or more messages are sent, the messages being sent until a message indicating completion of the content on the channel is received. The method of claim 23, wherein the content is an advertisement. The method of claim 23, wherein the notification is at least one of a visual, audible or tactile notification. The method of claim 23, wherein the notification provides an option to select the channel for viewing on the device. The method of claim 23, further comprising selecting the channel for viewing on the device. A method comprising: receiving a message from a mobile phone containing instructions to sample content from a channel; sampling content from the channel; transmitting a message containing the sample of the content; receiving a message including information related to the sampling of the content; Determining whether a certain content is completed on the channel according to the received information; and after determining that the content is completed on the channel, transmitting a message indicating that the content is completed on the channel to the mobile phone. The method of claim 30, wherein the received message identifies the content. The method of claim 30, wherein the message is sent to a remote processing resource, the remote processing resource comprising at least one server. The method of claim 30, wherein the information relating to the sampling of the content identifies at least the content from which the sampling system was taken.