WO2008018102A2 - Interactive system - Google Patents

Interactive system Download PDF

Info

Publication number
WO2008018102A2
WO2008018102A2 PCT/IT2007/000487 IT2007000487W WO2008018102A2 WO 2008018102 A2 WO2008018102 A2 WO 2008018102A2 IT 2007000487 W IT2007000487 W IT 2007000487W WO 2008018102 A2 WO2008018102 A2 WO 2008018102A2
Authority
WO
WIPO (PCT)
Prior art keywords
user
control unit
basis
remote control
media
Prior art date
Application number
PCT/IT2007/000487
Other languages
French (fr)
Other versions
WO2008018102A3 (en
Inventor
Pierangelo Bonini
Alberto Sanna
Original Assignee
Diagnostica E Ricerca San Raffaele S:P.A.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Diagnostica E Ricerca San Raffaele S:P.A. filed Critical Diagnostica E Ricerca San Raffaele S:P.A.
Publication of WO2008018102A2 publication Critical patent/WO2008018102A2/en
Publication of WO2008018102A3 publication Critical patent/WO2008018102A3/en

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265—The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/04—Arrangements for transmitting signals characterised by the use of a wireless electrical link using magnetically coupled devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25891—Management of end-user data being end-user preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4131—Peripherals receiving signals from specially adapted client devices home appliance, e.g. lighting, air conditioning system, metering devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4532—Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
    • H04N7/163—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing by receiver means only
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/30—User interface
    • G08C2201/31—Voice input
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/50—Receiving or transmitting feedback, e.g. replies, status updates, acknowledgements, from the controlled devices
    • G08C2201/51—Remote controlling of devices based on replies, status thereof
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/90—Additional features
    • G08C2201/91—Remote control based on location and proximity

Definitions

  • the present invention concerns a, preferably domestic, interactive system, that allows, in a simple, reliable, and efficient way, one or more users to interact with one or more domestic appliances and/or one or more objects.
  • the present invention further concerns the interaction method ⁇ executable by the interactive system and the apparatuses and instruments allowing the same method to be executed. It is known that, in the field of domestic appliances, we are now observing a progressively increase of interactivity level and automatic functions. In particular the field of multimedia applications inherent to the home environment is involved in a process providing for the increase of the interactive functions. Interactivity is here intended according to its most general meaning, i.e. the interaction between user and appliance occurring thanks to the possibility of transmitting information to the same appliance, modifying the flow of its operations depending on the user's needs.
  • Appliances belonging to this category are classical apparatuses controlling audio/video applications, such as televisions, radios, HI-FI stereo equipments, projectors, video recorders recording on digital media (such as magnetic tape ones, like VHS, or optical ones, such as CD, DVD, etc.) and with fixed or removable memory (such as those having hard disk connectable via USB port, etc.), as well as last generation systems such as digital terrestrial and satellite television and cable television (and the related decoding apparatus or " set-top-box") or personal video recorder or PVR. Also more advanced systerns, such as personal computers, game consoles or so-called home theatre systems, allowing to replicate audio and video high quality of a cinema room, belong to this category.
  • appliances as conditioners, Heating systems, lighting control electric systems, water distribution hydr ⁇ tulic systems, systems for controlling air and other types of gases, window and door frames, roller shutters, anti-intrusion and safety systems, and the like, belong to this technological field, generally known with the term "domotics".
  • white goods Another category that is involved in the technological process of increasing interactivity level and automatic functions is that of the white goods, which are provided with the necessary electronic intelligence and, possibly, with displays and/or speakers, such as, by way of example, but not by way of limitation, washing machines, refrigerators, freezers, dishwashing machines, ovens of various types, "food processor” devices, and the like.
  • New services increasing interactivity and automatisation of all these appliances are often provided, besides through classic control functions (usually by means of keypads), through the use of a remote control allowing appliances to be remotely controlled, by enabling the interaction by the user.
  • PCT International Application No. WO 00/49838 A1 concerns an intelligent apparatus for preparing foods according to multiple modes, in particular a microwave or other heating type oven, that is capable to acquire and process encoded information on food packages for optimising its own operation and preparation of foods.
  • PCT International Application No. WO 03/038581 A1 concerns an apparatus, such as an bread making oven or a microwave oven, provided with a controller capable to communicate with a remote database having a plurality of user profiles, preferably configurable (e.g. through the
  • controller on the basis of a code acquired from a product package, retrieves instructions for operating the apparatus so as to prepare the product.
  • US Patent No. US 4837414 discloses an oven, in particular a microwave one, electronically controlled, having a remote control provided with a scanner capable to acquire a code corresponding to a cooking program and to send it to an oven control unit, that operates the oven on the basis of stored instructions corresponding to such cooking program.
  • an interactive system comprising:
  • a remote control unit operable by at least one user, capable to communicate with the control device, the remote control unit being capable to read data stored in one or more media attached to objects, the system comprising processing means capable to receive and process said data for generating one or more commands for controlling the operation of said one'or more appliances, characterised in that said one or more appliances comprise a decoding apparatus or decoder for digital television signals, connected to a television, said one or more control commands being generated on the basis of a profile of said at least one user stored in memory means accessible by said processing means.
  • said one or more control commands may control the operation of the decoder so as to provide an information service and/or an entertainment service and/or a .loyalising service.
  • the decoder may comprise memory means capable to store one or more contents cyclically transmitted on the same broadcast channel, through a data carousel.
  • said one or more contents may comprise the profile of said at least one user.
  • said processing means of the system may be at least partially integrated into the control device. Still according to the invention, said processing means of the system may be at least partially integrated into the remote control unit.
  • said memory means of the system storing the profile of said at least one user may be at least partially integrated into the control device.
  • said memory means of the system storing the profile of said at least one user may be at least partially integrated into the remote control unit.
  • said memory means of the system storing the profile of said at least one user may be memory media capable to be removably connected to the control device and/or to the remote control unit.
  • the decoder may be connected to at least one remote station through a connection.
  • said at least one remote station may store the profile of said at least one user and may send it to said memory means of the system through the connection.
  • the control device may be integrated into said one or more appliances, preferably into the decoder.
  • the decoder may be integrated into the television.
  • the' control device may be provided with a display.
  • said one or more appliances may be selected from the group comprising appliances concerning control of multimedia applications, such as televisions, radios, HI-FI stereo equipments, projectors, video recorders recording on digital media, video recorders with fixed or removable memory, apparatus for decoding terrestrial and/or satellite digital television and/or cable television signals, digital video recorder or PVR (Personal Video Recorder),, personal computers, game consoles, and so-called home theatre apparatuses, domestic appliances controlling the environment and its conditions, such as conditioners, heating systems, lighting control electric systems, water distribution hydraulic systems, systems for controlling air and/or other types of gases, window and door frames, roller shutters, anti-intrusion and/or safety systems, and white goods, preferably provided with displays and/on audio speakers, such as washing machines, refrigerators, freezers, dish-washing machines, ovens. '
  • the remote control unit may be provided with electronic means capable to read media selected from the group comprising optical media, such as one-dimension and/or two-dimension bar codes, and/or composite codes, and/or holograms, and/or signs recognisable through optical character recognition or OCR, and/or symbols recognisable through pattern recognition, magnetic media, such as magnetic strips, radio frequency media, such as R-FId (Radio Frequency Identification) tags incorporated into transponders, and ultrasound media.
  • optical media such as one-dimension and/or two-dimension bar codes, and/or composite codes, and/or holograms, and/or signs recognisable through optical character recognition or OCR, and/or symbols recognisable through pattern recognition
  • magnetic media such as magnetic strips
  • radio frequency media such as R-FId (Radio Frequency Identification) tags incorporated into transponders, and ultrasound media.
  • R-FId Radio Frequency Identification
  • said at least one remote station may store the profile of said at least one user and may send it to said memory means of the system through the connection.
  • the control device may be integrated into said one or more appliances, preferably into the decoder.
  • the decoder may be integrated into the television.
  • the' control device may be provided with a display.
  • said one or more appliances may be selected from the group comprising appliances concerning control of multimedia applications, such as televisions, radios, HI-FI stereo equipments, projectors, video recorders recording on digital media, video recorders with fixed or removable memory, apparatus for decoding terrestrial and/or satellite digital television and/or cable television signals, digital video recorder or PVR (Personal Video Recorder),, personal computers, game consoles, and so-called home theatre apparatuses, domestic appliances controlling the environment and its conditions, such as conditioners, heating systems, lighting control electric systems, water distribution hydraulic systems, systems for controlling air and/or other types of gases, window and door frames, roller shutters, anti-intrusion and/or safety systems, and white goods, preferably provided with displays and/or- audio speakers, such as washing machines, refrigerators, freezers, dish-washing machines, ovens.
  • multimedia applications such as televisions, radios, HI-FI stereo equipments, projectors, video recorders recording on digital media, video recorders with fixed or removable memory
  • the remote control unit may be provided with electronic means capable to read media selected from the group comprising optical media, such as one-dimension and/or two-dimension bar codes, and/or composite codes, and/or holograms, and/or signs recognisable through optical character recognition or OCR, and/or symbols recognisable through pattern recognition, magnetic media, such as magnetic strips, radio frequency media, such as R-FId (Radio Frequency Identification) tags incorporated into transponders, and ultrasound media.
  • optical media such as one-dimension and/or two-dimension bar codes, and/or composite codes, and/or holograms, and/or signs recognisable through optical character recognition or OCR, and/or symbols recognisable through pattern recognition
  • magnetic media such as magnetic strips
  • radio frequency media such as R-FId (Radio Frequency Identification) tags incorporated into transponders, and ultrasound media.
  • said processing means of the system may be capable to execute at least one OCR method and/or at least one pattern recognition method on the data read by the remote control unit.
  • said at least one remote station may be capable to execute at least one OCR method and/or at least one pattern recognition method on the data read by the remote control unit that this sends, through the control device and the decoder, to said at least one remote station, said at least one remote station returning to the decoder the results of said at least one OCR method and/or of said at least one pattern recognition method.
  • the data stored in said one or more media that the remote control unit is capable to read may have a data structure comprising an identification code of an object.
  • said data structure may further comprise an identification serial number of the object.
  • said data structure may further comprise information related to the object.
  • the remote control unit may be provided with electronic means for acquiring and transducing a voice signal pronounced by said at least one user.
  • said processing means of the system may be capable to execute at least one Voice Recognition method on the voice signal acquired and transduced by the remote control unit.
  • said at least one remote station may be capable to execute at least one Voice Recognition method on the voice signal acquired and transduced by the remote control unit that this sends, through the control device and the decoder, to said at least one remote station, said at least one remote station (2) returning to the decoder the results of said at least one OCR method and/or, of said at least one pattern recognition method.
  • a remote control device comprising receiving means, capable to read data stored in one or more media attached to objects, transmitting means, capable to transmit 6 the data read by the receiving means to a control device, and control means, that receives from said receiving means, connected thereto, the data read by said receiving means for sending them to said transmitting means, also connected to said control means, the remote control device being characterised in that it is capable to be used as remote control unit in an interactive system as previously described.
  • said control means may be capable to process said data read by the receiving means for generating at least one portion of said one or more control commands for sending them to said transmitting means, that transmits them to the control device.
  • said- control means may comprise said memory means of the system that stores at least one portion of the profile of said at least one user.
  • the device may comprise interface means capable to connect control means to memory media.
  • said receiving means may be provided with electronic means capable to read media selected from the group comprising optical media, such as one-dimension and/or two- dimension bar codes, and/or composite codes, and/or holograms, and/or signs recognisable through optical character recognition or OCR, and/or symbols recognisable through pattern recognition, magnetic media, such as magnetic strips, radio frequency media, such as RFId (Radio
  • Frequency Identification tags incorporated into transponders, and ultrasound media.
  • said control means may be capable to execute at least one OCR method and/or at least one pattern recognition method on the data read by the receiving means.
  • said receiving means may be provided with electronic means for acquiring and transducing a voice signal pronounced by said at least one user.
  • said control means may be capable to execute at least one Voice Recognition method on the voice signal acquired and transduced by said receiving means.
  • the device may further comprise one or more luminous devices controlled by said control means on the basis of the profile of said at least one user.
  • the device may further comprise one or more keys, capable to send signals to said control means, said one or more luminous devices being capable to backlight said one or more keys.
  • said control means may control said one or more luminous devices also on the basis of the signals received by said one or more keys.
  • the device may further comprise one or more sensors, capable to send signals to .said control means, that controls said one or more luminous devices ajso on the basis of the signals received from said one or more sensors.
  • said one or more sensors may comprise at least one sensor selected from the group comprising light intensity sensors, presence sensors, and sensors sensing movement of the same device, that sends at least one sensing signal to said control means, that assesses the intensity of said at least one sensing signal with respect to at least one corresponding threshold value, controlling said one or more luminous devices accordingly.
  • said control .means may control said one or more luminous devices also on the basis of the data read by said receiving means. Still according to the invention, said control means may control said one or more luminous devices also on the basis of the results of said at least one OCR method and/or of said at least one pattern recognition method on the data read by the receiving means *
  • said control means may control said one or more luminous devices also on the basis of the results of said at least one Voice Recognition method on the voice signal acquired and transduced by said receiving means.
  • said control means may process the signals coming from said one or more keys, associating the signal coming from each key with a corresponding signal to send to said transmitting means.
  • control . means may 8 • comprise electronic anti-theft key means.
  • said receiving means and/or said transmitti ng means may be integrated into said control means.
  • the device may comprise cellular telecommunication means, whereby the device may operate as cellular telephone.
  • the method may provide an information service and/or an entertainment service and/or a loyalising service.
  • the method may comprise the following steps:
  • said one or more contents may comprise the profile of said at least one user.
  • the method may further comprise the following steps: » - storing the profile of said at least one user in at least one remote station, and
  • the method may further comprise the following step:
  • the method may further comprise the following step:
  • the method may further comprise the following steps:
  • the method may further comprise the following step:
  • control of said one or more luminous devices may be also executed on the basis of the signals received from one or more keys of the remote control unit.
  • control of said one or more luminous devices may be also executed on the basis of the signals received from one or more sensors of the remote pontrol unit.
  • said one or more sensors may comprise at least one sensor selected from the group comprising light intensity sensors, presence sensors, and sensors sensing movement of the remote control unit, and the method may comprise the following step: - assessing the intensity of at least one sensing signal coming from said one or more sensors with respect to at least one corresponding threshold value, 10 the control of said one or more luminous devices being dependant on the result of such assessment.
  • control of said one or more luminous devices may be also executed on the basis of the data read from said one or more media.
  • control of said one or more luminous devices may be also executed on the basis of the results of said at least one OCR method.
  • control of said one or more luminous devices may be also executed on the basis of the results of said at least one pattern recognition method.
  • control of said one or more luminous devices may be also executed on the basis of the results of said at least one Voice Recognition method.
  • processing of said data read from said one or more media may comprise associating each signal coming from one or more keys of the remote control unit with a corresponding code, whereby a dynamic allocation of the codes to said one or more keys is executed.
  • the method may further comprise the following step:
  • the method may further comprise the following step:
  • the method may further comprise the following step: »
  • the method may further comprise the following step:
  • the method may further comprise the following step:
  • the method may further comprise the following step:
  • Figure 1 schematically shows a first embodiment of the interactive system according to the invention
  • Figure 2 schematically shows a second embodiment of the interactive system according to the invention
  • FIG. 3 schematically shows the flow, of operations executed by the system of Figure 2.
  • the inventors have developed an interactive system wherein a user (or even more than one) is capable to interact through an interactive remote control, that is capable to read data stored in media of various types attached to objects, preferably products, and that, on the basis of the read data, may control the domestic appliances by using specific information concerning the objects corresponding to the read data.
  • the interaction of the user with the domestic appliance that is enabled may be of various types and, by way of example, and not by way of limitation, may comprise delivery of information audio/video contents through speakers/displays/monitors concerning the product, and setting/change of operations carried out by the -appliance depending on the user's needs and product features. »
  • the system may find application in the care of the user's health status, for instance by delivering information contents through the television (or more in general through the domestic appliances) customised for the user's specific needs.
  • An example thereof is the delivery of advices and/or suggestions on diet which are not in 12 contrast with user's health probiems (such as, for instance, in case of elder people with diabetes and/or cardiovascular problems for whom a careful evaluation of ingredients or nutritional properties of foods they are going to eat is required).
  • This application will be enabled by the storage of • the user's profile in digital media present on a remote server with which the domestic appliance under consideration will be able to connect, or on an additional module of the same domestic appliance and/or remote control (such as USB memory keys).
  • This profile may be dynamically updated when the same information varies and thanks to a history of the previous interactions occurred with the system (i.e. of the choices previously made by the user, which substantially give an indication on the preferences of the same user).
  • the invention introduces a new model of interactivity that does not involve only a remote control and a corresponding domestic appliance, but also a third entity that is the one of the objects, preferably products.
  • the user is capable to interact with one or more appliances, through the remote cpntrol, using information concerning specific objects or products, modifying, for instance, the flow of predetermined operations of an appliance depending on the user's needs by using characteristic data of the specific object/product which are read by the same remote control (and hence possibly even in a way transparent to the user).
  • the remote control may transmit data read from the product and/or corresponding information to the appliance under consideration.
  • Objects are preferably intended as products belonging to various categories, among which, by way of example, and not by way of limitation, consumable products (such as food products, textile products and cosmetics), consumer electronics (such as mobile and wired telephony products, stationary or portable or handheld computers, accessory products and peripherals of personal computers, digital photo cameras and video cameras, stationary or portable digital audio and video players, digital data media, televisions, Hi-Fi equipments, video recorders, and the like), audio/video products (such as audio CDs or DVDs containing movies or other type of multimedia programmes, or VHS tapes or the like), and medical products (such as medicines, medical devices and related consumable products, electromedical equipments and related consumable products). 13
  • consumable products such as food products, textile products and cosmetics
  • consumer electronics such as mobile and wired telephony products, stationary or portable or handheld computers, accessory products and peripherals of personal computers, digital photo cameras and video cameras, stationary or portable digital audio and video players, digital data media, televisions, Hi-Fi equipments, video recorders, and the
  • Data communication between object/product and remote control is made possible by the use of suitable data media to attach to the product, in particular to the package/container or to the same product, which a ⁇ e read by the remote control.
  • Data media attached to the products may be of various types, such as for instance: optical ones (such as one- dimension or two-dimension bar codes, composite codes, holograms, signs read through optical character recognition or OCR methods, symbols read through pattern recognition methods, and the like), magnetic ones (such as magnetic strips), radio frequency ones (such as RFId - Radio Frequency Identification - tags incorporated in transponders), ultrasound ones.
  • the structure of the data under consideration may comprise by way of example, and not by way of limitation: a product identifier code
  • Figure 1 schematically shows a first embodiment of the interactive system according to the invention, that comprises one or more domestic appliances 1 , such as, for instance, appliances belonging to the previously described categories such appliances concerning control of multimedia applications, domestic appliances controlling the environment and its conditions, or white goods.
  • domestic appliances 1 such as, for instance, appliances belonging to the previously described categories such appliances concerning control of multimedia applications, domestic appliances controlling the environment and its conditions, or white goods.
  • a control device 3 is connected to the appliances 1 , that communicates with the same in two-way mode, which is capable to talk with a remote control unit 4, operated by a user 10.
  • the control device 3 may be unitised in a domestic appliance 1.
  • the control device 3 receives data sent by the remote control unit 4, through suitable hardware/software components, and it processes them so as to generate starting from them commands for subsequent interaction with the hardware and software components already present in the domestic appliances 1.
  • the control device 3 is capable to interact with the hardware and software components already present in the domestic appliances 1 for enabling the functions required in a 14 conventional way by the user 10.
  • the control device 3 is advantageously provided with a display or monitor and/or an acoustic device for carrying out the interaction with the user 10; alternatively, the control device 3 may carry out the interaction with the user 10 through suitable hardware and software components of command operation, and/or it may possibly use audio and/or video playing devices of one or more of the appliances 1 for carrying out this interaction.
  • the control device 3, and possibly one or more of the domestic appliances 1, is advantageously connected through a connection 14 to non-domestic systems 2, such as for instance data analysis stations or remote processors, preferably accessible through the Internet network (that in this case implements the connection 14), with which it communicates in two-way manner in wired or wireless mode (for instance with UMTS, WIFI, WI-MAX, Blue-Tooth, Zigbee technology).
  • the remote control unit 4 comprises a receiving module 5, capable to read and store data stored in one or more types of media 8 placed on objects/products 7, a transmitting module 6, capable to transmit data, in wired or wireless mode, to the control device 3, and a control module 9 connected to the modules 5 and 6.
  • the control module 9 is further connected to one or more sensors 11 , haying one or more keys 12, and to one or more luminous, preferably LED, devices 13.
  • the control module 9 is capable to receive and process data coming from the receiving module 5, from the sensors 11 , and from the keys 12, for controlling the luminous devices 13 and sending data to transmit, preferably commands for the domestic appliances 1 , to the transmitting module 6.
  • the control module 9 may advantageously also comprise devices capable to implement an electronic anti-theft key that renders the remote control unit 4 or even the whole system unusable in case of theft.
  • said one or more sensors 11 are selected from the group comprising sensors capable to detect the intensity of light from the surrounding environment, sensors capable to detect the presence and/or the movement (of persons, objects, animals) in the surrounding environment, sensors capable to detect the movements of the same remote control unit 4.
  • the sensors capable to detect the presence and/or the movement in the surrounding environment may comprise for instance proximity sensors, pressure sensors, ultrasound and/or infrared sensors; the sensors capable to detect the movements of the remote control unit 4 15 may comprise accelerometers and gyroscopic sensors.
  • the luminous devices 13, internal to the remote control unit 4, are capable to backlight the keys 12, according to modes which will be described later.
  • the keys 12 may be connected to the transmitting module 6 that may thus transmit signals related to conventional functions of a remote control of a domestic appliance 1 to * the control device 3.
  • the receiving module 5 and/or the transmitting module 6 may be integrated into the control module 9.
  • the control module 9 processes the signals coming from the keys 12 operated by the user 10 in order to send the suitable signals to the transmitting module 6. Processing consists in associating a corresponding signal (to which a determined feature of interactivity with one or more of the domestic appliances 1 will correspond) to send to the transmitting module 6 with the signal deriving from each key.
  • the signals sent to the transmitting module 6 may be: codes statically assigned to the various keys 12 which, once transmitted by the transmitting module 6 to the control device 3, are decoded and the corresponding command is used by the specific program implementing the interactive application controlled by the remote control unit 4 ahd/or by the control device 3 (e.g., a command corresponding to a conventional interaction through remote control with a domestic appliance 1 ); codes dynamically assigned to the various keys 12 of the remote control unit 4, depending on the specific interactive application that the user 10 is using, which dynamic assigning is possible thanks to the fact that the control module 9 is pre-programmed for the specific interactive application that requires dynamic allocation of the codes to the various keys 12 of the remote control unit 4. Moreover, in the case where a two- way communication between the control device 3 and the transmitting module 6 is enabled, such dynamic allocation may also occur following specific commands sent by the control device 3 to the control module 9 through the transmitting module 6.
  • control module 9 may further make the functions of a conventional remote control in relation to one or more domestic appliances 1 with which the same remote control unit 4 interacts.
  • control module 9 processes data received from the receiving module 5 and sensors 11 associating such data with 16 commands for controlling the luminous devices 13, which preferably backlight the keys 12.
  • Processing of signals deriving from -the light intensity sensors and from the sensors sensing presence and/or movement in the surrounding environment first consists in evaluating the intensity of the sensed signals (of luminosity and presence and/or movement) when compared to predefined threshold values, and in controlling backlighting of the keys 12 through the luminous devices 13 depending on the result of this comparison.
  • selection of the keys 12 to backlight preferably occurs according to customisation criteria and/or context criteria.
  • Customisation criteria allow to backlight some specific keys on the basis of the profile of the user 10: if a part of the profile of the user 10 is in the control module 9, it is possible to guide the interaction of the user with the domestic appliance 1 according to such profile by backlighting the keys 12 to press; otherwise, of the profile of the user 10 is in the control device 3 and/or in the non-domestic systems 2 (such as a remote server controlled by the, e.g. sanitary, institution offering the interactivity service) this customisation of the backlighting of keys 12 occurs thanks to the potential possibility of a two-way communication between the control device 3 and the transmitting module 6 of the remote control unit 4, that enables data reception by the transmitting module 6 and the subsequent step of sending data to the control module 9. In this way, it is possible to adapt the appearance of the remote control unit 4 to the sensorial
  • Context criteria allow to backlight specific keys 12 depending on reading of data stored in the media 8 attached to the products 7: the control module 9 may be programmed so that a particular category of products 7 may make some specific keys 12 be backlighted and thus it may guide the interaction of the user 10 indicating the possible keys 12 to press.
  • the keys 12 may be also automatically backlighted depending on the intensity of light of the surrounding environment (once suitable threshold values of light intensity, sensed by respective sensors 11 , are fixed) or on possible movements in the surrounding environment (once suitable threshold values of movements, sensed by respective sensors 11 , are fixed).
  • the keys 12 may be hence backlighted also following movements of objects in 17 the surrounding environment which change context conditions, such as for instance a door opening (thus the entry of the user 10 or other persons into a room), or following approaching of the user 10, or other persons, to the remote control (making, e.g., a localisation of the remote control in dark rooms).
  • the objects/products 7 may be, for instance, the products belonging to the previously described product categories, such as consumable products, consumer electronics * products, audio/video products, and medical products. » Similarly, data media 7 attached to the products may be, for instance, as previously described, optical and/or magnetic and/or radiofrequency media.
  • control device 3 is connected to (or integrated into) a terrestrial digital TV signal decoder 1 , in turn connected to (or .integrated into) a television 1'.
  • the control device 3 is capable to receive the information transmitted by the remote control unit 4' and then to process it, thus enabling the interactivity of a user 10 with the decoder 1.
  • terrestrial digital TV that is presently in fast diffusion, makes services which are interactive in respect to normal television (analog) programmes available.
  • the decoder 1 also technically called IRD - Integrated Receiver ' and Decoder
  • a return channel 14 allows transmission of data from the decoder 1 to a remote station 2 of the service provider (such as a data analysis station) and vice versa.
  • the thus implemented return channel 14 allows a more advanced form of interactivity, since this may occur either in real time (e.g. for obtaining customised information on the required programme) along with or separately from the television programme.
  • the interactive services with return channel 14 comprise, e.g., games, quizzes, tv-shopping, pay-per- view, tv-banking, interactive advertisements, electronic mail.
  • the terrestrial digital television also allows providing interactive services without return channel, through the so-called local 18 interactivity, wherein the application operating in the decoder 1 uses a series of contents cyclically transmitted on the same broadcast channel, through a data carousel, and possibly stored in the decoder 1.
  • the so-called enhanced broadcasting services electronic programme -guide - or EPG - and browser, super teletext, subtitles, image aspect variation, audio multilanguage - surround - home theatre
  • data stored in media 8 attached to the 7 are read by the receiving module 5 of the remote control unit 4', and sent by the latter (in either wired or wireless mode), through the transmitting module 6, to the control device 3.
  • This processes such data associating command (and/or input files), for the decoder 1 controlling the interactive multimedia playing, with the identification code (and/or other type of information), that is read from media 8 by the receiving module 5.
  • the decoder 1 is advantageously provided with a return channel 14 (wired or wireless one, e.g. with UMTS, WIFI, WI-MAX, Blue-Tooth, Zigbee technology), capable to transmit, to a remote data analysis . station 2 suitable information and thus to enable an advanced form of interactivity.
  • the remote station 2 may send to the device 3, through the decoder 1 , the profile of the user 10, that is capable, along with the data read from media 8 of the products 7, to modify the control of terrestrial digital transmission.
  • the profile of the user 10 is subdivided into several categories (subsets of data of the whole profile) and each category (or group of categories) may be sent on a specific distribution channel.
  • a commercial identification code stored in a medium 8 attached to a product 7 may enable specific services, integrated into the multimedia platform, which are customised, i.e. adapted to the profile of the user 10, such as information services, as e.g. information and/or suggestions related to ingredients and/or recipes concerning food products 7, or services of entertainment (enogastronomic culture), of loyalization (prizes), of delivery of products or related services.
  • RFId or other type tags 8 which may contain, thanks to the possibility of carrying a memory on board, information additional to the simple code or serial number, it is possible to enable a more complex type of interactivity.
  • the operative modes are very simple: in fact it is sufficient to bring the remote control unit 4' near to the tags 8, or to press a key 12 for enabling optical or other type (e.g. magnetic) reading of the codes stored in the media 8, for automatically activating interactivity.
  • Semantic Zapping Another example of interactive function that the present invention may enable is the so-called Semantic Zapping, which may occur in particular in the case when the remote control unit 4' is provided with the components necessary to the implementation of either Optical 20
  • the receiving module 5 of the remote control unit 4' comprises a digital video camera and/or photo camera, in case of Optical Character Recognition, or a microphone and audio sampler, in case of Voice Recognition.
  • the system is capable to recognise words spoken by the user 10 and to activate the related commands.
  • the commands associated with the words spoken by the user 10 depends on the particular considered interactive application.
  • the microphone of the receiving module 5, or similar transducer device converts the voice of the user 10 (who pronounces a word or a series of words) in an analog electric signal, that the audio sampler transforms in a
  • the control module 9 may (at least partially) carry out the voice recognition, by comparing the digital signal generated by the audio sampler with the words (or a plurality of series of words) stored in digital format in the data memory, and if the word (or series of words) corresponds to one of the words (or a plurality of words) present in memory, the commands associated with the considered word (or series of words) are sent to the control device 3 through the transmitting module 6; otherwise, if the word (or series of words) spoken by the user 10 does not correspond to any word (or
  • control module 9 may have suitable software and/or hardware components integrated for a word recognition technologically more advanced than the previous one, wherein the digital signal is processed for the recognition of the word (or series of words) and for the related activation of the associated commands, where processing consists in associating to the input digital signal the possible word (or series of words), using suitable algorithms and term libraries; afterwards related commands are 21 associated to the recognised word(s) which are then sent through the transmitting module 6 to the control device 3.
  • a further alternative concerns the possibility of entrusting the recognition of the word (or series of words) spoken by the user 10 to an extra-domestic system 2 that will return the recognised word (or series of words), or more preferably the commands associated to it (or to them), to the control device 3, that will activate the associated commands.
  • the Semantic Zapping is a technology based on a semantic engine formed by software and/or hardware components capable to receive as input the words recognised by the Optical Character
  • the semantic engine substantially gives a meaning to the words received as input, and on the basis of this it will make a zapping.
  • the Semantic Zapping may be activated also on the basis of the profile of the user using the system, searching programmes, files, information concerning the information stored in the profile.
  • the semantic engine may be integrated into the control device 3, or, in the case when the return channel 14 is present, it may be on a remote station 2 (e.g. of a service provider) and thus it may remotely work on the specific client application that is in the control device 3.
  • a remote station 2 e.g. of a service provider
  • the Semantic Zapping may be also activated by the reading of the data stored in the media 8 attached to the products 7 (e.g. bar code or two-dimension code).
  • the control device 3 is capable to associate the proper input for the semantic engine with the received data.
  • a further example of application scenario enabled by the interactive remote control is the possibility of making an identification of the user 10 owning the remote control unit 4' through the same remote control unit 4' (thus enabling customised services, such as the application concerning the care of the health status of the user 10 according to his/her profile) and an identification of other users who typically do not use (i.e. who do not own) the considered remote control unit 4'. In this way for specific applications profiles of users not owning the remote control unit 4' 22
  • the user 10 owning the remote control unit 4' programs this one by inputting elements identifying the non owner users who may have access to use the remote control unit 4' (e.g. a password and a part of user profile, or other identification forms such as recognition of identification codes stored in media as for instance bar codes, composite codes, holograms, magnetic codes, RFId tags, codes read through Optical Character Recognition technology, or even identification through biometrics, or still through audio frequency analysis and/or through Voice Recognition technology).
  • the system may use his/her profile. In this case, if the system allows voice recognition of users, the system advantageously uses only the library of stored words corresponding to the identified user.
  • the remote control unit 4' interacts, through the control device 3, with the extra-domestic system 2 (that in this case may be a cellular phone) which asks the specific service provider for authorisation. If the non owner user gets access, the system may use his/her profile that may be sent by the extra-domestic system 2 to the control device 3 and possibly by the latter to the remote control unit 4'. It is also possible that, should the user be the owner of a different similar interactive system, this system may transmit the user's profile.- In both modes, the non owner user's profile may be, wholly or partially, either "locally" in the control device 3 and/or in the control module 9 or "remotely" in extra-domestic systems 2.
  • the system may adapt audio and video playing to the sensorial capabilities of the user, as well as it may modify the screenplay of a movie to the specific user who is using the system.
  • remote control unit (4, 4') is provided with hardware and software components for being capable of operating as cellular phone.

Abstract

The invention concerns an interactive system comprising: - one or more appliances (1) the operation of which is electronically controllable, - a control device (3), capable to communicate with said one or more appliances (1), - a remote control unit (4, 4'), operable by at least one user (10), capable to communicate with the control device (3), the remote control unit (4, 4') being capable to read data stored in one or more media (8) attached to objects (7), the system comprising processing means (3, 9) capable to receive and process said data for generating one or more commands for controlling the operation of said one or more appliances (1), characterised in that said one or more appliances comprise a decoding apparatus or decoder (1) for digital television signals, connected to a television (1 '), said one or more control commands being generated on the basis of a profile of said at least one user (10) stored in memory means accessible by said processing means (3, 9). The invention further concerns the related remote control device and the interaction method.

Description

INTERACTIVE SYSTEM
The present invention concerns a, preferably domestic, interactive system, that allows, in a simple, reliable, and efficient way, one or more users to interact with one or more domestic appliances and/or one or more objects.
The present invention further concerns the interaction method ■ executable by the interactive system and the apparatuses and instruments allowing the same method to be executed. It is known that, in the field of domestic appliances, we are now observing a progressively increase of interactivity level and automatic functions. In particular the field of multimedia applications inherent to the home environment is involved in a process providing for the increase of the interactive functions. Interactivity is here intended according to its most general meaning, i.e. the interaction between user and appliance occurring thanks to the possibility of transmitting information to the same appliance, modifying the flow of its operations depending on the user's needs.
This process involves, in particular, all the appliances related to control of multimedia applications. Appliances belonging to this category are classical apparatuses controlling audio/video applications, such as televisions, radios, HI-FI stereo equipments, projectors, video recorders recording on digital media (such as magnetic tape ones, like VHS, or optical ones, such as CD, DVD, etc.) and with fixed or removable memory (such as those having hard disk connectable via USB port, etc.), as well as last generation systems such as digital terrestrial and satellite television and cable television (and the related decoding apparatus or " set-top-box") or personal video recorder or PVR. Also more advanced systerns, such as personal computers, game consoles or so-called home theatre systems, allowing to replicate audio and video high quality of a cinema room, belong to this category.
Moreover, last technological developments do not exclude from this process of increasing interactive and automatic functions also all those domestic appliances controlling the environment and its conditions. Among others, appliances as conditioners, Heating systems, lighting control electric systems, water distribution hydrεtulic systems, systems for controlling air and other types of gases, window and door frames, roller shutters, anti-intrusion and safety systems, and the like, belong to this technological field, generally known with the term "domotics".
Another category that is involved in the technological process of increasing interactivity level and automatic functions is that of the white goods, which are provided with the necessary electronic intelligence and, possibly, with displays and/or speakers, such as, by way of example, but not by way of limitation, washing machines, refrigerators, freezers, dishwashing machines, ovens of various types, "food processor" devices, and the like.
New services increasing interactivity and automatisation of all these appliances are often provided, besides through classic control functions (usually by means of keypads), through the use of a remote control allowing appliances to be remotely controlled, by enabling the interaction by the user.
PCT International Application No. WO 00/49838 A1 concerns an intelligent apparatus for preparing foods according to multiple modes, in particular a microwave or other heating type oven, that is capable to acquire and process encoded information on food packages for optimising its own operation and preparation of foods.
PCT International Application No. WO 03/038581 A1 concerns an apparatus, such as an bread making oven or a microwave oven, provided with a controller capable to communicate with a remote database having a plurality of user profiles, preferably configurable (e.g. through the
Internet), which controller, on the basis of a code acquired from a product package, retrieves instructions for operating the apparatus so as to prepare the product.
US Patent No. US 4837414 discloses an oven, in particular a microwave one, electronically controlled, having a remote control provided with a scanner capable to acquire a code corresponding to a cooking program and to send it to an oven control unit, that operates the oven on the basis of stored instructions corresponding to such cooking program.
It is an object of the present invention to further increase the level of interactivity of the user with one or more domestic appliances and/or one or more objects in a simple, reliable, and efficient way.
It is specific subject matter of this invention an interactive system comprising:
- one or more appliances the operation of which is electronically controllable, » - a control device, capable to communicate with said one or more appliances,
- a remote control unit, operable by at least one user, capable to communicate with the control device, the remote control unit being capable to read data stored in one or more media attached to objects, the system comprising processing means capable to receive and process said data for generating one or more commands for controlling the operation of said one'or more appliances, characterised in that said one or more appliances comprise a decoding apparatus or decoder for digital television signals, connected to a television, said one or more control commands being generated on the basis of a profile of said at least one user stored in memory means accessible by said processing means.
Always according to the invention, said one or more control commands may control the operation of the decoder so as to provide an information service and/or an entertainment service and/or a .loyalising service.
Still according to the invention, the decoder may comprise memory means capable to store one or more contents cyclically transmitted on the same broadcast channel, through a data carousel.
Furthermore according to the invention, said one or more contents may comprise the profile of said at least one user.
Always according to the invention, said processing means of the system may be at least partially integrated into the control device. Still according to the invention, said processing means of the system may be at least partially integrated into the remote control unit.
Furthermore according to the invention, said memory means of the system storing the profile of said at least one user may be at least partially integrated into the control device. Always according to the invention, said memory means of the system storing the profile of said at least one user may be at least partially integrated into the remote control unit.
Still according to the invention, said memory means of the system storing the profile of said at least one user may be memory media capable to be removably connected to the control device and/or to the remote control unit.
Furthermore according to the invention, the decoder may be connected to at least one remote station through a connection.
Always according to the invention, said at least one remote station may store the profile of said at least one user and may send it to said memory means of the system through the connection. Still according to the invention, the control device may be integrated into said one or more appliances, preferably into the decoder.
Furthermore according to the invention, the decoder may be integrated into the television.
. Always according to the invention, the' control device may be provided with a display. v
Still according to the invention, said one or more appliances may be selected from the group comprising appliances concerning control of multimedia applications, such as televisions, radios, HI-FI stereo equipments, projectors, video recorders recording on digital media, video recorders with fixed or removable memory, apparatus for decoding terrestrial and/or satellite digital television and/or cable television signals, digital video recorder or PVR (Personal Video Recorder),, personal computers, game consoles, and so-called home theatre apparatuses, domestic appliances controlling the environment and its conditions, such as conditioners, heating systems, lighting control electric systems, water distribution hydraulic systems, systems for controlling air and/or other types of gases, window and door frames, roller shutters, anti-intrusion and/or safety systems, and white goods, preferably provided with displays and/on audio speakers, such as washing machines, refrigerators, freezers, dish-washing machines, ovens. '
Furthermore according to the invention, the remote control unit may be provided with electronic means capable to read media selected from the group comprising optical media, such as one-dimension and/or two-dimension bar codes, and/or composite codes, and/or holograms, and/or signs recognisable through optical character recognition or OCR, and/or symbols recognisable through pattern recognition, magnetic media, such as magnetic strips, radio frequency media, such as R-FId (Radio Frequency Identification) tags incorporated into transponders, and ultrasound media. Always according to the invention, when the remote control unit is provided with electronic means capable to read optical media recognisable through OCR and/or optical symbols recognisable through 4 connected to at least one remote station through a connection.
Always according to the invention, said at least one remote station may store the profile of said at least one user and may send it to said memory means of the system through the connection. Still according to the invention, the control device may be integrated into said one or more appliances, preferably into the decoder.
Furthermore according to the invention, the decoder may be integrated into the television.
Always according to the invention, the' control device may be provided with a display. *
Still according to the invention, said one or more appliances may be selected from the group comprising appliances concerning control of multimedia applications, such as televisions, radios, HI-FI stereo equipments, projectors, video recorders recording on digital media, video recorders with fixed or removable memory, apparatus for decoding terrestrial and/or satellite digital television and/or cable television signals, digital video recorder or PVR (Personal Video Recorder),, personal computers, game consoles, and so-called home theatre apparatuses, domestic appliances controlling the environment and its conditions, such as conditioners, heating systems, lighting control electric systems, water distribution hydraulic systems, systems for controlling air and/or other types of gases, window and door frames, roller shutters, anti-intrusion and/or safety systems, and white goods, preferably provided with displays and/or- audio speakers, such as washing machines, refrigerators, freezers, dish-washing machines, ovens. *
Furthermore according to the invention, the remote control unit may be provided with electronic means capable to read media selected from the group comprising optical media, such as one-dimension and/or two-dimension bar codes, and/or composite codes, and/or holograms, and/or signs recognisable through optical character recognition or OCR, and/or symbols recognisable through pattern recognition, magnetic media, such as magnetic strips, radio frequency media, such as R-FId (Radio Frequency Identification) tags incorporated into transponders, and ultrasound media. Always according to the invention, when the remote control unit is provided with electronic means capable to read optical media recognisable through OCR and/or optical symbols recognisable through 5 pattern recognition, said processing means of the system may be capable to execute at least one OCR method and/or at least one pattern recognition method on the data read by the remote control unit.
Still according to the invention, when the remote control unit is provided with electronic means capable to read optical media recognisable through OCR and/or optical symbols recognisable through pattern recognition, said at least one remote station may be capable to execute at least one OCR method and/or at least one pattern recognition method on the data read by the remote control unit that this sends, through the control device and the decoder, to said at least one remote station, said at least one remote station returning to the decoder the results of said at least one OCR method and/or of said at least one pattern recognition method.
Furthermore according to the invention, the data stored in said one or more media that the remote control unit is capable to read may have a data structure comprising an identification code of an object.
Always according to the invention, said data structure may further comprise an identification serial number of the object.
Still according to the invention, said data structure may further comprise information related to the object.
Furthermore according to the invention, the remote control unit may be provided with electronic means for acquiring and transducing a voice signal pronounced by said at least one user.
Always according to the invention, said processing means of the system may be capable to execute at least one Voice Recognition method on the voice signal acquired and transduced by the remote control unit.
Still according to the invention, said at least one remote station may be capable to execute at least one Voice Recognition method on the voice signal acquired and transduced by the remote control unit that this sends, through the control device and the decoder, to said at least one remote station, said at least one remote station (2) returning to the decoder the results of said at least one OCR method and/or, of said at least one pattern recognition method. It is still specific subject matter of this invention a remote control device comprising receiving means, capable to read data stored in one or more media attached to objects, transmitting means, capable to transmit 6 the data read by the receiving means to a control device, and control means, that receives from said receiving means, connected thereto, the data read by said receiving means for sending them to said transmitting means, also connected to said control means, the remote control device being characterised in that it is capable to be used as remote control unit in an interactive system as previously described.
Always according to the invention, said control means may be capable to process said data read by the receiving means for generating at least one portion of said one or more control commands for sending them to said transmitting means, that transmits them to the control device. Still according to the invention, said- control means may comprise said memory means of the system that stores at least one portion of the profile of said at least one user.
Furthermore according to the invention, the device may comprise interface means capable to connect control means to memory media.
Always according to the invention, said receiving means may be provided with electronic means capable to read media selected from the group comprising optical media, such as one-dimension and/or two- dimension bar codes, and/or composite codes, and/or holograms, and/or signs recognisable through optical character recognition or OCR, and/or symbols recognisable through pattern recognition, magnetic media, such as magnetic strips, radio frequency media, such as RFId (Radio
Frequency Identification) tags incorporated into transponders, and ultrasound media.
Still according to the invention, when said receiving means is provided with electronic means capable to read optical media recognisable through OCR and/or optical symbols recognisable through pattern recognition, said control means may be capable to execute at least one OCR method and/or at least one pattern recognition method on the data read by the receiving means.
Furthermore according to the invention, said receiving means may be provided with electronic means for acquiring and transducing a voice signal pronounced by said at least one user. Always according to the invention, said control means may be capable to execute at least one Voice Recognition method on the voice signal acquired and transduced by said receiving means. 7
Still according to the invention, the device may further comprise one or more luminous devices controlled by said control means on the basis of the profile of said at least one user.
Furthermore according to the invention, the device may further comprise one or more keys, capable to send signals to said control means, said one or more luminous devices being capable to backlight said one or more keys.
Always according to the invention, said control means may control said one or more luminous devices also on the basis of the signals received by said one or more keys.
Still according to the invention, the device may further comprise one or more sensors, capable to send signals to .said control means, that controls said one or more luminous devices ajso on the basis of the signals received from said one or more sensors. Furthermore according to the invention, said one or more sensors may comprise at least one sensor selected from the group comprising light intensity sensors, presence sensors, and sensors sensing movement of the same device, that sends at least one sensing signal to said control means, that assesses the intensity of said at least one sensing signal with respect to at least one corresponding threshold value, controlling said one or more luminous devices accordingly.
Always according to the invention, said control .means may control said one or more luminous devices also on the basis of the data read by said receiving means. Still according to the invention, said control means may control said one or more luminous devices also on the basis of the results of said at least one OCR method and/or of said at least one pattern recognition method on the data read by the receiving means*
Furthermore according to the invention, said control means may control said one or more luminous devices also on the basis of the results of said at least one Voice Recognition method on the voice signal acquired and transduced by said receiving means.
Always according to the invention, said control means may process the signals coming from said one or more keys, associating the signal coming from each key with a corresponding signal to send to said transmitting means.
Still according to the invention, said control . means may 8 • comprise electronic anti-theft key means.
Furthermo re according to the invention, said receiving means and/or said transmitti ng means may be integrated into said control means. Always according to the invention, the device may comprise cellular telecommunication means, whereby the device may operate as cellular telephone.
It is always specific subject matter of this invention a niethod of interaction among one or more appliances, a remote control unit, operable by at least one user, and one or more objects, characterised in that it is capable to be executed by an interactive system as previously described, and in that it comprises the following steps:
- reading data from one or more media attached to said one or more objects,
- processing said read data for generating one or more control commands for operating said one or more appliances, on the basis of a profile of said at least one user stored in memory means.
Always according to the invention, the method may provide an information service and/or an entertainment service and/or a loyalising service.
Still according to the invention, the method may comprise the following steps:
- cyclically transmitting one or more contents on the same broadcast channel, through a data carousel, and - storing said one or more contents.
Furthermore according to the invention, said one or more contents may comprise the profile of said at least one user.
Always according to the invention, the method may further comprise the following steps: » - storing the profile of said at least one user in at least one remote station, and
- sending said profile of said at least one user from said at least one remote station to memory means of the system through a connection. Still according to the invention, the method may further comprise the following step:
- executing at least one OCR method on one or more signs 9 read by the remote control unit, for generating one or more control commands for operating said one or more appliances on the basis of the result of said at least one OCR method. Furthermore according to the invention, the method may further comprise the following step:
- executing at least one pattern recognition method on one or more symbols read by the remote control unit (4, 4'), for generating one or more control commands for operating said one or more appliances (1) on the basis of the result of said at least one pattern recognition method.
Always according to the invention, the method may further comprise the following steps:
- acquiring and transducing a voice signal pronounced by said at least one user, - executing at least one Voice Recognition method on the voice signal acquired and transduced,
- generating one or more control commands for operating said one or more appliances on the basis of the result of said at least one Voice Recognition method. Still according to the invention, the method may further comprise the following step:
- controlling one or more luminous devices of said remote control unit on the basis of the profile of said at least one user. Furthermore according to the invention, the control of said one or more luminous devices may be also executed on the basis of the signals received from one or more keys of the remote control unit.
Always according to the invention, the control of said one or more luminous devices may be also executed on the basis of the signals received from one or more sensors of the remote pontrol unit.
Still according to the invention, said one or more sensors may comprise at least one sensor selected from the group comprising light intensity sensors, presence sensors, and sensors sensing movement of the remote control unit, and the method may comprise the following step: - assessing the intensity of at least one sensing signal coming from said one or more sensors with respect to at least one corresponding threshold value, 10 the control of said one or more luminous devices being dependant on the result of such assessment.
Furthermore according to the invention, the control of said one or more luminous devices may be also executed on the basis of the data read from said one or more media.
Always according to the invention, the control of said one or more luminous devices may be also executed on the basis of the results of said at least one OCR method.
Still according to the invention, the control of said one or more luminous devices may be also executed on the basis of the results of said at least one pattern recognition method.
Furthermore according to the invention, the control of said one or more luminous devices may be also executed on the basis of the results of said at least one Voice Recognition method. Always according to the invention, processing of said data read from said one or more media may comprise associating each signal coming from one or more keys of the remote control unit with a corresponding code, whereby a dynamic allocation of the codes to said one or more keys is executed. Still according to the invention, the method may further comprise the following step:
- dynamically updating the profile of said at least one user on the basis of a history of said one or more previously generated control commands for operating said one or more appliances.
Furthermore according to the invention, the method may further comprise the following step:
- executing a Semantic Zapping on the basis of the profile of said at least one user. . Always according to the invention, the method may further comprise the following step: »
- executing a Semantic Zapping on the basis of the data read from said one or more media.
Still according to the invention, the method may further comprise the following step:
- executing a Semantic Zapping on the basis of the results of said at least one OCR method. 11
Furthermore according to the invention, the method may further comprise the following step:
- executing a Semantic Zapping on the basis of the results of said at least one pattern recognition method. Always according to the invention, the method may further comprise the following step:
- executing a Semantic Zapping on the basis of the results of said at least one Voice Recognition method.
The present invention will be now described, by way of illustration and not by way of limitation, according to its preferred embodiments, by particularly referring to the Figures of the enclosed drawings, in which:
Figure 1 schematically shows a first embodiment of the interactive system according to the invention; Figure 2 schematically shows a second embodiment of the interactive system according to the invention; e
Figure 3 schematically shows the flow, of operations executed by the system of Figure 2.
In the following of the description same reference numbers will be used for indicating alike elements in the Figures.
The inventors have developed an interactive system wherein a user (or even more than one) is capable to interact through an interactive remote control, that is capable to read data stored in media of various types attached to objects, preferably products, and that, on the basis of the read data, may control the domestic appliances by using specific information concerning the objects corresponding to the read data.
The interaction of the user with the domestic appliance that is enabled may be of various types and, by way of example, and not by way of limitation, may comprise delivery of information audio/video contents through speakers/displays/monitors concerning the product, and setting/change of operations carried out by the -appliance depending on the user's needs and product features. »
In particular, the system may find application in the care of the user's health status, for instance by delivering information contents through the television (or more in general through the domestic appliances) customised for the user's specific needs. An example thereof is the delivery of advices and/or suggestions on diet which are not in 12 contrast with user's health probiems (such as, for instance, in case of elder people with diabetes and/or cardiovascular problems for whom a careful evaluation of ingredients or nutritional properties of foods they are going to eat is required). This application will be enabled by the storage of • the user's profile in digital media present on a remote server with which the domestic appliance under consideration will be able to connect, or on an additional module of the same domestic appliance and/or remote control (such as USB memory keys).
This profile may be dynamically updated when the same information varies and thanks to a history of the previous interactions occurred with the system (i.e. of the choices previously made by the user, which substantially give an indication on the preferences of the same user).
In other words, the invention introduces a new model of interactivity that does not involve only a remote control and a corresponding domestic appliance, but also a third entity that is the one of the objects, preferably products. In this way, the user is capable to interact with one or more appliances, through the remote cpntrol, using information concerning specific objects or products, modifying, for instance, the flow of predetermined operations of an appliance depending on the user's needs by using characteristic data of the specific object/product which are read by the same remote control (and hence possibly even in a way transparent to the user). The remote control may transmit data read from the product and/or corresponding information to the appliance under consideration. Objects are preferably intended as products belonging to various categories, among which, by way of example, and not by way of limitation, consumable products (such as food products, textile products and cosmetics), consumer electronics (such as mobile and wired telephony products, stationary or portable or handheld computers, accessory products and peripherals of personal computers, digital photo cameras and video cameras, stationary or portable digital audio and video players, digital data media, televisions, Hi-Fi equipments, video recorders, and the like), audio/video products (such as audio CDs or DVDs containing movies or other type of multimedia programmes, or VHS tapes or the like), and medical products (such as medicines, medical devices and related consumable products, electromedical equipments and related consumable products). 13
Data communication between object/product and remote control is made possible by the use of suitable data media to attach to the product, in particular to the package/container or to the same product, which aϊe read by the remote control. Data media attached to the products may be of various types, such as for instance: optical ones (such as one- dimension or two-dimension bar codes, composite codes, holograms, signs read through optical character recognition or OCR methods, symbols read through pattern recognition methods, and the like), magnetic ones (such as magnetic strips), radio frequency ones (such as RFId - Radio Frequency Identification - tags incorporated in transponders), ultrasound ones.
The structure of the data under consideration may comprise by way of example, and not by way of limitation: a product identifier code
(univocal, i.e. that identifies the type of the product or the same product in a unique way, but this is not necessary the case), an identification
(univocal or not) number of the product series, and possible other information (for instance for information purposes for the consumer, for loyalizing customers, for participating in games and lotteries, for information related to the use of the product vsuch as manuals or its consumable products as spare parts).
Figure 1 schematically shows a first embodiment of the interactive system according to the invention, that comprises one or more domestic appliances 1 , such as, for instance, appliances belonging to the previously described categories such appliances concerning control of multimedia applications, domestic appliances controlling the environment and its conditions, or white goods.
A control device 3 is connected to the appliances 1 , that communicates with the same in two-way mode, which is capable to talk with a remote control unit 4, operated by a user 10. In particular, the control device 3 may be unitised in a domestic appliance 1.
The control device 3 receives data sent by the remote control unit 4, through suitable hardware/software components, and it processes them so as to generate starting from them commands for subsequent interaction with the hardware and software components already present in the domestic appliances 1. In particular, the control device 3 is capable to interact with the hardware and software components already present in the domestic appliances 1 for enabling the functions required in a 14 conventional way by the user 10. Moreover, the control device 3 is advantageously provided with a display or monitor and/or an acoustic device for carrying out the interaction with the user 10; alternatively, the control device 3 may carry out the interaction with the user 10 through suitable hardware and software components of command operation, and/or it may possibly use audio and/or video playing devices of one or more of the appliances 1 for carrying out this interaction.
The control device 3, and possibly one or more of the domestic appliances 1, is advantageously connected through a connection 14 to non-domestic systems 2, such as for instance data analysis stations or remote processors, preferably accessible through the Internet network (that in this case implements the connection 14), with which it communicates in two-way manner in wired or wireless mode (for instance with UMTS, WIFI, WI-MAX, Blue-Tooth, Zigbee technology). The remote control unit 4 comprises a receiving module 5, capable to read and store data stored in one or more types of media 8 placed on objects/products 7, a transmitting module 6, capable to transmit data, in wired or wireless mode, to the control device 3, and a control module 9 connected to the modules 5 and 6. The control module 9 is further connected to one or more sensors 11 , haying one or more keys 12, and to one or more luminous, preferably LED, devices 13. The control module 9 is capable to receive and process data coming from the receiving module 5, from the sensors 11 , and from the keys 12, for controlling the luminous devices 13 and sending data to transmit, preferably commands for the domestic appliances 1 , to the transmitting module 6. The control module 9 may advantageously also comprise devices capable to implement an electronic anti-theft key that renders the remote control unit 4 or even the whole system unusable in case of theft.
In particular, said one or more sensors 11 are selected from the group comprising sensors capable to detect the intensity of light from the surrounding environment, sensors capable to detect the presence and/or the movement (of persons, objects, animals) in the surrounding environment, sensors capable to detect the movements of the same remote control unit 4. The sensors capable to detect the presence and/or the movement in the surrounding environment may comprise for instance proximity sensors, pressure sensors, ultrasound and/or infrared sensors; the sensors capable to detect the movements of the remote control unit 4 15 may comprise accelerometers and gyroscopic sensors.
The luminous devices 13, internal to the remote control unit 4, are capable to backlight the keys 12, according to modes which will be described later. Alternatively, the keys 12 may be connected to the transmitting module 6 that may thus transmit signals related to conventional functions of a remote control of a domestic appliance 1 to* the control device 3. Moreover, the receiving module 5 and/or the transmitting module 6 may be integrated into the control module 9. The control module 9 processes the signals coming from the keys 12 operated by the user 10 in order to send the suitable signals to the transmitting module 6. Processing consists in associating a corresponding signal (to which a determined feature of interactivity with one or more of the domestic appliances 1 will correspond) to send to the transmitting module 6 with the signal deriving from each key. By way of example and not by way of limitation, the signals sent to the transmitting module 6 may be: codes statically assigned to the various keys 12 which, once transmitted by the transmitting module 6 to the control device 3, are decoded and the corresponding command is used by the specific program implementing the interactive application controlled by the remote control unit 4 ahd/or by the control device 3 (e.g., a command corresponding to a conventional interaction through remote control with a domestic appliance 1 ); codes dynamically assigned to the various keys 12 of the remote control unit 4, depending on the specific interactive application that the user 10 is using, which dynamic assigning is possible thanks to the fact that the control module 9 is pre-programmed for the specific interactive application that requires dynamic allocation of the codes to the various keys 12 of the remote control unit 4. Moreover, in the case where a two- way communication between the control device 3 and the transmitting module 6 is enabled, such dynamic allocation may also occur following specific commands sent by the control device 3 to the control module 9 through the transmitting module 6.
As mentioned, the control module 9 may further make the functions of a conventional remote control in relation to one or more domestic appliances 1 with which the same remote control unit 4 interacts.
Moreover, the control module 9 processes data received from the receiving module 5 and sensors 11 associating such data with 16 commands for controlling the luminous devices 13, which preferably backlight the keys 12. Processing of signals deriving from -the light intensity sensors and from the sensors sensing presence and/or movement in the surrounding environment first consists in evaluating the intensity of the sensed signals (of luminosity and presence and/or movement) when compared to predefined threshold values, and in controlling backlighting of the keys 12 through the luminous devices 13 depending on the result of this comparison.
In particular, selection of the keys 12 to backlight preferably occurs according to customisation criteria and/or context criteria.
Customisation criteria allow to backlight some specific keys on the basis of the profile of the user 10: if a part of the profile of the user 10 is in the control module 9, it is possible to guide the interaction of the user with the domestic appliance 1 according to such profile by backlighting the keys 12 to press; otherwise, of the profile of the user 10 is in the control device 3 and/or in the non-domestic systems 2 (such as a remote server controlled by the, e.g. sanitary, institution offering the interactivity service) this customisation of the backlighting of keys 12 occurs thanks to the potential possibility of a two-way communication between the control device 3 and the transmitting module 6 of the remote control unit 4, that enables data reception by the transmitting module 6 and the subsequent step of sending data to the control module 9. In this way, it is possible to adapt the appearance of the remote control unit 4 to the sensorial
• capabilities of the user 10, improving enjoyment thereof. Context criteria allow to backlight specific keys 12 depending on reading of data stored in the media 8 attached to the products 7: the control module 9 may be programmed so that a particular category of products 7 may make some specific keys 12 be backlighted and thus it may guide the interaction of the user 10 indicating the possible keys 12 to press.
Moreover, the keys 12 (all or only some) may be also automatically backlighted depending on the intensity of light of the surrounding environment (once suitable threshold values of light intensity, sensed by respective sensors 11 , are fixed) or on possible movements in the surrounding environment (once suitable threshold values of movements, sensed by respective sensors 11 , are fixed). In this case the keys 12 may be hence backlighted also following movements of objects in 17 the surrounding environment which change context conditions, such as for instance a door opening (thus the entry of the user 10 or other persons into a room), or following approaching of the user 10, or other persons, to the remote control (making, e.g., a localisation of the remote control in dark rooms).
The objects/products 7 may be, for instance, the products belonging to the previously described product categories, such as consumable products, consumer electronics * products, audio/video products, and medical products. » Similarly, data media 7 attached to the products may be, for instance, as previously described, optical and/or magnetic and/or radiofrequency media.
With reference to Figure 2, an application of a second embodiment of the interactive system according to the invention is now described, wherein the control device 3 is connected to (or integrated into) a terrestrial digital TV signal decoder 1 , in turn connected to (or .integrated into) a television 1'. The control device 3 is capable to receive the information transmitted by the remote control unit 4' and then to process it, thus enabling the interactivity of a user 10 with the decoder 1. As it is known, terrestrial digital TV, that is presently in fast diffusion, makes services which are interactive in respect to normal television (analog) programmes available. In fact, the decoder 1 (also technically called IRD - Integrated Receiver' and Decoder") allows, besides decoding of the received TV signal, interactive functions to be enabled.
First of all, this may occur thanks to the presence of an additional transmitting module along a return channel 14, that allows transmission of data from the decoder 1 to a remote station 2 of the service provider (such as a data analysis station) and vice versa. The thus implemented return channel 14 allows a more advanced form of interactivity, since this may occur either in real time (e.g. for obtaining customised information on the required programme) along with or separately from the television programme. The interactive services with return channel 14 comprise, e.g., games, quizzes, tv-shopping, pay-per- view, tv-banking, interactive advertisements, electronic mail.
However, the terrestrial digital television also allows providing interactive services without return channel, through the so-called local 18 interactivity, wherein the application operating in the decoder 1 uses a series of contents cyclically transmitted on the same broadcast channel, through a data carousel, and possibly stored in the decoder 1. Also the so- called enhanced broadcasting services (electronic programme -guide - or EPG - and browser, super teletext, subtitles, image aspect variation, audio multilanguage - surround - home theatre) do not require the presence of a return channel 14.
With reference to Figure 2, data stored in media 8 attached to the 7 are read by the receiving module 5 of the remote control unit 4', and sent by the latter (in either wired or wireless mode), through the transmitting module 6, to the control device 3. This processes such data associating command (and/or input files), for the decoder 1 controlling the interactive multimedia playing, with the identification code (and/or other type of information), that is read from media 8 by the receiving module 5. The decoder 1 is advantageously provided with a return channel 14 (wired or wireless one, e.g. with UMTS, WIFI, WI-MAX, Blue-Tooth, Zigbee technology), capable to transmit, to a remote data analysis . station 2 suitable information and thus to enable an advanced form of interactivity.
The flow of operations executed by the system of Figure 2 is schematised in Figure 3.
Through the return channel 14, the remote station 2 may send to the device 3, through the decoder 1 , the profile of the user 10, that is capable, along with the data read from media 8 of the products 7, to modify the control of terrestrial digital transmission. Even in the case when the return channel 14 is not present, by exploiting the so-called data carousel, i.e. by dynamically allocating band over the signals of distribution of the various channels used by the decoder 1 depending on the specific interactive application, it is possible to receive the profile of the user 10 by a remote server. In this case, the profile of the user 10 is subdivided into several categories (subsets of data of the whole profile) and each category (or group of categories) may be sent on a specific distribution channel. These categories of the profile will be advantageously indexed on several distribution channels; once this indexing table is received by the decoder 1, and hence by the control device 3, the program of the specific application (that is itself on the device 3) may retrieve the information necessary for the operation of the same application. Capacity of available bandwidth of the single distribution 19 channel is hence dynamically allocated on the basis of the profile specific categories which must be transmitted on that channel.
The system shown in Figure 2 allows a new type of interaction between the user 10 and the digital television decoder 1 , thanks to the use of the information contained e.g. in the bar codes or RFId tags. By way of example, and not by way of limitation, a commercial identification code stored in a medium 8 attached to a product 7 may enable specific services, integrated into the multimedia platform, which are customised, i.e. adapted to the profile of the user 10, such as information services, as e.g. information and/or suggestions related to ingredients and/or recipes concerning food products 7, or services of entertainment (enogastronomic culture), of loyalization (prizes), of delivery of products or related services.
Moreover, by providing the possibility of reading, through the remote control unit 4', RFId or other type tags 8 which may contain, thanks to the possibility of carrying a memory on board, information additional to the simple code or serial number, it is possible to enable a more complex type of interactivity. By way of example, and not by way of limitation, it is possible to get information on the manufacturer of particular goods, thanks to tracking data contained in the same tag 8, or to show on the television screen instructions related to a medicine (which are usually written in a so minute way that they are difficult to be read, most of all by elder or visually impaired persons), the tag 8 (or other medium) of which has been read.
Moreover, the operative modes are very simple: in fact it is sufficient to bring the remote control unit 4' near to the tags 8, or to press a key 12 for enabling optical or other type (e.g. magnetic) reading of the codes stored in the media 8, for automatically activating interactivity.
Moreover, by exploiting in particular features of RFId technology, it is possible to obtain a series of additional services, such as for instance a sort of automatic domestic inventory (thanks to the possibility of multiple simultaneous reading of a plurality of tags RFIds 8) or a greater ease of use for home environment (thanks to the reading of the tags 8 from a certain distance and without an effective optical path between receiving module 5 and tag 8).
Another example of interactive function that the present invention may enable is the so-called Semantic Zapping, which may occur in particular in the case when the remote control unit 4' is provided with the components necessary to the implementation of either Optical 20
Character Recognition or Voice Recognition technology, for recognising words written on media or pronounced by the user 10. In particular, in this case the receiving module 5 of the remote control unit 4' comprises a digital video camera and/or photo camera, in case of Optical Character Recognition, or a microphone and audio sampler, in case of Voice Recognition.
Specifically, in case of Voice Recognition, the system is capable to recognise words spoken by the user 10 and to activate the related commands. The commands associated with the words spoken by the user 10 depends on the particular considered interactive application.
The microphone of the receiving module 5, or similar transducer device, converts the voice of the user 10 (who pronounces a word or a series of words) in an analog electric signal, that the audio sampler transforms in a
• digital signal and that the control module 9 transmits, through the transmitting module 6, to the control device 3. Hence, the recognition of the word (or series of words) spoken by the user 10, and the related activation of the associated commands, preferably occurs in the control device 3. Alternatively, in the case when the control module 9 also comprises a sufficiently large data memory (even a programmable and/or re-programmable one) containing words (or a plurality of series Of words) in digital format, the control module 9 of the remote control unit 4' may (at least partially) carry out the voice recognition, by comparing the digital signal generated by the audio sampler with the words (or a plurality of series of words) stored in digital format in the data memory, and if the word (or series of words) corresponds to one of the words (or a plurality of words) present in memory, the commands associated with the considered word (or series of words) are sent to the control device 3 through the transmitting module 6; otherwise, if the word (or series of words) spoken by the user 10 does not correspond to any word (or any plurality of words) present in memory, no command is sent. Still alternatively, the control module 9 may have suitable software and/or hardware components integrated for a word recognition technologically more advanced than the previous one, wherein the digital signal is processed for the recognition of the word (or series of words) and for the related activation of the associated commands, where processing consists in associating to the input digital signal the possible word (or series of words), using suitable algorithms and term libraries; afterwards related commands are 21 associated to the recognised word(s) which are then sent through the transmitting module 6 to the control device 3. A further alternative concerns the possibility of entrusting the recognition of the word (or series of words) spoken by the user 10 to an extra-domestic system 2 that will return the recognised word (or series of words), or more preferably the commands associated to it (or to them), to the control device 3, that will activate the associated commands.
The Semantic Zapping is a technology based on a semantic engine formed by software and/or hardware components capable to receive as input the words recognised by the Optical Character
Recognition or Voice Recognition, and making a zapping, i.e. sequentially scrolling all television programmes (or even files stored in the system or appliances, e.g. in a PVR) having a connection with the considered words.
Alternatively it is also possible to show only a list of these programmes. The semantic engine substantially gives a meaning to the words received as input, and on the basis of this it will make a zapping.
In other embodiments of the interactive system according to the invention, the Semantic Zapping may be activated also on the basis of the profile of the user using the system, searching programmes, files, information concerning the information stored in the profile.
With reference to Figure 2, the semantic engine may be integrated into the control device 3, or, in the case when the return channel 14 is present, it may be on a remote station 2 (e.g. of a service provider) and thus it may remotely work on the specific client application that is in the control device 3.
The Semantic Zapping may be also activated by the reading of the data stored in the media 8 attached to the products 7 (e.g. bar code or two-dimension code). In this case the control device 3 is capable to associate the proper input for the semantic engine with the received data. A further example of application scenario enabled by the interactive remote control is the possibility of making an identification of the user 10 owning the remote control unit 4' through the same remote control unit 4' (thus enabling customised services, such as the application concerning the care of the health status of the user 10 according to his/her profile) and an identification of other users who typically do not use (i.e. who do not own) the considered remote control unit 4'. In this way for specific applications profiles of users not owning the remote control unit 4' 22
(e.g. relatives or friends of the owner of the remote control unit 4') are also available.
This may occur through the two following exemplary and not limitative modes. According to the first one, the user 10 owning the remote control unit 4' programs this one by inputting elements identifying the non owner users who may have access to use the remote control unit 4' (e.g. a password and a part of user profile, or other identification forms such as recognition of identification codes stored in media as for instance bar codes, composite codes, holograms, magnetic codes, RFId tags, codes read through Optical Character Recognition technology, or even identification through biometrics, or still through audio frequency analysis and/or through Voice Recognition technology). Once the non owner user has been identified, the system may use his/her profile. In this case, if the system allows voice recognition of users, the system advantageously uses only the library of stored words corresponding to the identified user.
According to the second mode, the remote control unit 4' interacts, through the control device 3, with the extra-domestic system 2 (that in this case may be a cellular phone) which asks the specific service provider for authorisation. If the non owner user gets access, the system may use his/her profile that may be sent by the extra-domestic system 2 to the control device 3 and possibly by the latter to the remote control unit 4'. It is also possible that, should the user be the owner of a different similar interactive system, this system may transmit the user's profile.- In both modes, the non owner user's profile may be, wholly or partially, either "locally" in the control device 3 and/or in the control module 9 or "remotely" in extra-domestic systems 2.
With management of multiple user profiles, the system may adapt audio and video playing to the sensorial capabilities of the user, as well as it may modify the screenplay of a movie to the specific user who is using the system.
Other embodiments of the system according to the invention may provide that the remote control unit (4, 4') is provided with hardware and software components for being capable of operating as cellular phone.
The preferred embodiments have been above described and some modifications of this invention have been suggested, but.it should be 23 understood that those skilled in the art can make other variations and changes, without so departing from the related scope of protection, as • defined by the attached claims.

Claims

24
CLAIMS 1. Interactive system comprising:
- one or more appliances (1) the operation of which is electronically controllable, - a control device (3), capable to communicate with said one or more appliances (1),
- a remote control unit (4, 4'), operable by at least one user (10), capable to communicate with the control device (3), the remote control unit (4, 4') being capable to read data stored in one or more media (8) attached to objects (7), the system comprising processing means (3, 9) capable to receive and process said data for generating one or more commands for controlling the operation of said one or more appliances (1), characterised in that said one or more appliances comprise a decoding apparatus or decoder (1) for digital television signals, connected to a television (1'), said one or more control commands being generated on the basis of a profile of said at least one user (10) stored in memory means accessible by said processing means (3, 9). »
2. Interactive system according to claim 1 , characterised in that said one or more control commands control the operation of the decoder
(1) so as to provide an information service and/or an entertainment service and/or a loyalising service.
3. Interactive system according to claim 1 or 2, characterised in that the decoder (1) comprises memory means capable to store one or more contents cyclically transmitted on the same broadcast channel, through a data carousel.
4. Interactive system according to claim 3, characterised in that said one or more contents comprise the profile of said at least one user (10).
5. Interactive system according to any one of the preceding claims, characterised in that said processing means of the system is at least partially integrated into the control device (3).
6. Interactive system according to έny one of the preceding claims, characterised in that said processing means of the system is at least partially integrated into the remote control unit (4, 4').
7. Interactive system according to any one of the preceding claims, characterised in that said memory means of the system storing the 25 profile of said at least one user (10) is at least partially integrated into the control device (3).
8. Interactive system according to any one of the preceding claims, characterised in that said memory means of the system storing the profile of said at least one user (10) is at least partially integrated into the remote control unit (4, 4').
9. Interactive system according to any one of the preceding claims, characterised in that said memory means of the system storing the profile of said at least one user (10) is memory media capable to be removably connected to the control device (3) and/or to the remote control unit (4, 4').
10. Interactive system according to any one of the preceding claims, characterised in that the decoder (1) is connected to at least one remote station (2) through a connection (14).
11. Interactive system according to claim 10, characterised in that said at least one remote station (2) stores the profile of said at least one user (10) and sends it to said memory means of the system through the connection (14).
12. Interactive system according to any one of the preceding claims, characterised in that the control device (3) is integrated into said one or more appliances, preferably into the decoder (1).
13. Interactive system according to any one of the preceding claims, characterised in that the decoder (1) is integrated into the television (1').
14. Interactive system according to any one of the preceding claims, characterised in that the control device (3) is provided with a display.
15. Interactive system according to any one of the preceding claims, characterised in that said one or more appliances are selected from the group comprising appliances concerning control of multimedia applications, such as televisions, radios, HI-FI stereo equipments, projectors, video recorders recording on digital media, video recorders with fixed or removable memory, apparatus for decoding terrestrial and/or satellite digital television and/or cable television signals, digital video recorder or PVR (Personal Video Recorder), personal computers, game consoles, and so-called home theatre apparatuses, domestic appliances controlling the environment and its conditions, such as conditioners, 26 heating systems, lighting control electric systems, water distribution hydraulic systems, systems for controlling air and/or other types of gases, window and door frames, roller shutters, anti-intrusion and/or safety systems, and white goods, preferably provided with displays and/or audio speakers, such as washing machines, refrigerators,- freezers, dish-washing machines, ovens.
16. Interactive system according to any one of the preceding claims, characterised in that the remote control unit (4, 4') is provided with electronic means capable to read media (8) selected from the group comprising optical media, such as one-dimension and/or two-dimension bar codes, and/or composite codes, and/or holograms, and/or signs recognisable through optical character recognition or OCR, and/or symbols recognisable through pattern recognition, magnetic media, such as magnetic strips, radio frequency media, such as RFId (Radio Frequency Identification) tags incorporated into transponders, and ultrasound media.
17. Interactive system according to claim 16, characterised in that, when the remote control unit (4, 4') is provided with electronic means capable to read optical media recognisable through OCR and/or optical symbols recognisable through pattern recognition, said processing means of the system is capable to execute at least one OCR method and/or at least one pattern recognition method on the data read by the remote control unit (4, 4').
18. Interactive system according to claim 16, when depending on claim 10, characterised in that, when the remote control unit (4, 4') is provided with electronic means capable to read optical media recognisable through OCR and/or optical symbols recognisable through pattern recognition, said at least one remote station (2) is capable to execute at least one OCR method and/or at least one pattern recognition method on the data read by the remote control unit (4, 4') that this sends, through the control device (3) and the decoder (1), to said at least one remote station (2), said at least one remote station (2) returning to the decoder (1) the results of said at least one OCR method and/or of said at least one pattern recognition method. -
19. Interactive system according to any one of the preceding claims, characterised in that the data stored in said one or more media (8) that the remote control unit (4, 4') is capable to read have a data structure 27 comprising an identification code of an object.
20. Interactive system according to claim 17, characterised in that said data structure further comprises an identification serial number of the object.
21. Interactive system according to claim 17 or 18, characterised in that said data structure further comprises information related to the object.
22. Interactive system according to any one of the preceding claims, characterised in that the remote control unit (4, 4') is provided with electronic means for acquiring and transducing a voice signal pronounced by said at least one user (10).
23. Interactive system according to claim 22, characterised in that said processing means of the system is capable to execute at least one Voice Recognition method on the voice signal acquired and transduced by the remote control unit (4, 4').
24. Interactive system according to claim 22, when depending on claim 10, characterised in that said at least one remote station (2) is capable to execute at least one Voice Recognition method on the voice signal acquired and transduced by the remote control unit (4, 4') that this sends, through the control device (3) and the decoder (1), to said at least one remote station (2), said at least one remote station (2) returning to the decoder (1) the results of said at least one OCR method and/or of said at least one pattern recognition method. l
25. Remote control device (4, 4') comprising receiving means (5), capable to read data stored in one or more media (8) attached to objects (7), transmitting means (6), capable to transmit the data read by the receiving means (5) to a control device (3), and control means (9), that receives from said receiving means (5), connected thereto, the data read by said receiving means (5) for sending them to said transmitting means (6), also connected to said control means (9), the remote control device being characterised in that it is capable to be used as remote control unit in an interactive system according to any one of claims 1 to 24.
26. Device according to claim 25, characterised in that said control means (9) is capable to process said data read by the receiving means (5) for generating at least one portion of said one or more control commands for sending them to said transmitting means (6), that transmits them "to the control device (3). 28
27. Device according to claim 25 or 26, characterised in that said control means (9) comprises said memory means of the system that stores at least one portion of the profile of said at least one user (10).
28. Device according to any one of claims 25 to 27, characterised in that it comprises interface means capable to connect control means (9) to memory media.
29. Device according to any one of claims 25 to 28, characterised in that said receiving means (5) is provided with electronic means capable to read media (8) selected from the group comprising optical media, such as one-dimension and/or two-dimension bar codes, and/or composite codes, and/or holograms, and/or signs recognisable through optical character recognition or OCR, and/or symbols recognisable through pattern recognition, magnetic media, such as magnetic strips, radio frequency media, such as RFId (Radio Frequency Identification) tags incorporated into transponders, and ultrasound media.
30. Device according to claim 29, characterised in that, when said receiving means (5) is provided with electronic means capable to read optical media recognisable through OCR and/or optical symbols recognisable through pattern recognition, said control means (9) is capable to execute at least one OCR method and/or at least one pattern recognition method on the data read by the receiving means (5).
31. Device according to any one of claims 25 to 30, characterised in that said receiving means (5) is provided with electronic means for acquiring and transducing a voice signal pronounced by said at least one user (10).
32. Device according to claim 31 , characterised in that said control means (9) is capable to execute at least one Voice Recognition method on the voice signal acquired and transduced by said receiving means (5).
33. Device according to any one of claims 25 to 32, characterised in that it further comprises one or more luminous devices (13) controlled by said control means (9) on the basis of the profile of said at least one user (10).
34. Device according to claim 33, characterised in that it further comprises one or more keys (12), capable to send signals to said control means (9), said one or more luminous devices (13) being capable to backlight said one or more keys (12). 29
35. Device according to claim 34, characterised in that said control means (9) controls said one or more luminous devices (13) also on the basis of the signals received by said one or more keys (12).
36. Device according to any one of claims 33 to 35, characterised in that it further comprises one or more sensors (11), capable to send signals to said control means (9), that controls said one or more luminous devices (13) also on the basis of the signals received from said one or more sensors (11).
37. Device according to claim 36, characterised in that said one or more sensors (11) comprise at least one sensor selected from the group comprising light intensity sensors, presence sensors, and sensors sensing movement of the same device, that sends at least one sensing signal to said control means (9), that assesses the intensity of said at least one sensing signal with respect to at least one corresponding threshold value, controlling said one or more luminous devices (13) accordingly.
38. Device according to any one of claims 33 to 37, characterised in that said control means (9) controls said one or more luminous devices (13) also on the basis of the data read by said receiving means (5).
39. Device according to any one of claims 33 to 38, when depending on claim 30, characterised in that said control means (9) controls said one or more luminous devices (13) also on the basis of the results of said at least one OCR method and/or of said at least one pattern recognition method on the data read by the receiving means (5).
40. Device according to any one of. claims 33 to 39, when depending on claim 32, characterised in thatv said control means (9) controls said one or more luminous devices (13) also on the basis of the results of said at least one Voice Recognition method on the voice signal acquired and transduced by said receiving means (5).
41. Device according to claim 34 or 35, or according to any one of claims 36 to 40, when depending on claim 34 or 35, characterised in that said control means (9) processes the signals coming from said one or more keys (12), associating the signal coming from each key (12) with a corresponding signal to send to said transmitting means (6).
42. Device according to any one of claims. 25 to 41 , characterised in that said control means (9) comprises electronic anti-theft key means. 30
43. Device according to any one of claims 25 to 42, characterised in that said receiving means (5) and/or said transmitting means (6) are integrated into said control means (9).
44. Device according to any one of claims 25 to 43, characterised in that it comprises cellular telecommunication means, whereby the device may operate as cellular telephone.
45. Method of interaction among one or more appliances (1), a remote control unit (4, 4'), operable by at least one user (10), and one or more objects (7), characterised in that it is capable to be executed by an interactive system according to any one of claims 1 to 24, and in that it comprises the following steps:
- reading data from one or more media (8) attached to said one or more objects (7), *
- processing said read data for generating one or more control commands for operating said one or more appliances (1), on the basis of a profile of said at least one user (10) stored in memory means.
46. Method according to claim 45, characterised in that it provides an information service and/or an entertainment service and/or a loyalising service.
47. Method according to claim 45 or 46, characterised in that it comprises the following steps:
- cyclically transmitting one or more contents on the same broadcast channel, through a data carousel, and - storing said one or more contents.
48. Method according to claim 47, characterised in that said one or more contents comprise the profile of said at least one user (10).
49. Method according to any one of claims according to any one of claims 45 to 48, characterised in that it further comprises the following steps:
- storing the profile of said at least one user (10) in at least one remote station (2), and
- sending said profile of said at least one user (10) from said at least one remote station (2) to memory means of the system through a connection (14).
50. Method according to any one of claims 45 to 49, characterised in that it further comprises the following step: 31
- executing at least one OCR method on one or more signs read by the remote control unit (4, 4'), for generating one or more control commands for operating said one or more appliances (1) on the basis of the result of said at least one OCR method.
51. Method according to any one of claims 45 to 50, characterised in that it further comprises the following step:
- executing at least one pattern recognition method on one or more symbols read by the remote control unit (4, 41), for generating one or more control commands for operating said one or more appliances (1) on the basis of the result of said at least one pattern recognition method.
52. Method according to any one of claims 45 to 51 , characterised in that it further comprises the following steps: - acquiring and transducing a voice signal pronounced by said at least one user (10),
- executing at least one Voice Recognition method on the voice signal acquired and transduced,
- generating one or more control commands for operating said one or more appliances (1) on the basis of the result of said at least one Voice Recognition method.
53. Method according to any one of claims 45 to 52, characterised in that it further comprises the following step:
- controlling one or more luminous devices (13) of said remote control unit (4, 4') on the basis of the profile of said at least one user (10).
54. Method according to claim 53, characterised in that the control of said one or more luminous devices (13) is also executed on the basis "of the signals received from one or more keys (12) of the remote control unit (4, 4').
55. Method according to claim 53 or 54, characterised in that the control of said one or more luminous devices (13) is also executed on the basis of the signals received from one or more sensors (11) of the remote control unit (4, 4').
56. Method according to claim 55, characterised in that said one or more sensors (11) comprise at least one sensor selected from the group comprising light intensity sensors, presence sensors, and sensors 32 sensing • movement of the remote control unit (4, 4'), and in that it comprises the following step:
- assessing the intensity of at least one sensing signal coming from said one or more sensors (11) with respect to at least one corresponding threshold value, the control of said one or more luminous devices (13) being dependant on the result of such assessment.
57. Method according to any one of claims 53 to 56, characterised in that the control of said one or more luminous devices (13) is also executed on the basis of the data read from said one or more media (8).
58. Method according to any one of claims 53 to 57, when depending on claim 50, characterised in that the control of said one or more luminous devices (13) is also executed on the basis of the results of said at least one OCR method.
59. Method according to any one of claims 53 to 58, when depending on claim 51 , characterised in that the control of said one or more luminous devices (13) is also executed on the basis of the results of said at least one pattern recognition method.
60. Method according to any one of claims 53 to 59, when depending on claim 52, characterised in that the control of said one or more luminous devices (13) is also executed on the basis of the results of said at least one Voice Recognition method.
61. Method according to any one of claims 53 to 60, characterised in that processing of said data read from said one or more media (8) comprises associating each signal coming from one or more keys of the remote control unit (4, 4') with a corresponding code, whereby a dynamic allocation of the codes to said one or more keys (12) is executed.
62. Method according to any one of claims 44 to 61, characterised in that it further comprises the following step:
- dynamically updating the profile of said at least one user on the basis of a history of said one or more previously generated control commands for operating said one or more appliances (1).
63. Method according to any one of claims 44 to 62, characterised in that it further comprises the following step: 33
- executing a Semantic Zapping on the basis of the profile of said at least one user (10).
64. Method according to any one of claims 44 to 63, characterised in that it further comprises the following step: - executing a Semantic Zapping on the basis of the data read from said one or more media (8).
65. Method according to claim 50 or according to any one of claims 51 to 64, when depending on claim 50, characterised in that it further comprises the following step: - executing a Semantic Zapping on the basis of the results of said at least one OCR method.
66. Method according to claim 51 or according to any one of claims 52 to 65, when depending on claim 51 , characterised in that it further comprises the following step: - executing a Semantic Zapping on the basis of the results of said at least one pattern recognition method.
67. Method according to claim 52 or according to any one of claims 53 to 66, when depending on claim 52% characterised in that it further comprises the following step: - executing a Semantic Zapping on the basis of the results of said at least one Voice Recognition method.
PCT/IT2007/000487 2006-08-07 2007-07-05 Interactive system WO2008018102A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IT000432A ITRM20060432A1 (en) 2006-08-07 2006-08-07 INTERACTIVE SYSTEM
ITRM2006A000432 2006-08-07

Publications (2)

Publication Number Publication Date
WO2008018102A2 true WO2008018102A2 (en) 2008-02-14
WO2008018102A3 WO2008018102A3 (en) 2008-03-20

Family

ID=38800849

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IT2007/000487 WO2008018102A2 (en) 2006-08-07 2007-07-05 Interactive system

Country Status (2)

Country Link
IT (1) ITRM20060432A1 (en)
WO (1) WO2008018102A2 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2949012A1 (en) * 2009-08-10 2011-02-11 Richard Thibert ELECTRONIC DEVICE FOR CONTROLLING ELECTRICAL EQUIPMENT BY SOUND
WO2012028461A1 (en) * 2010-08-31 2012-03-08 BSH Bosch und Siemens Hausgeräte GmbH Method for processing data in a domestic appliance, domestic appliance and system having a domestic applicance and at least one external unit
CN102592039A (en) * 2011-01-18 2012-07-18 四川火狐无线科技有限公司 Interaction method for processing cantering and entertainment service data and device and system for realizing same
DE102016114601A1 (en) * 2016-08-05 2018-02-08 Aesculap Ag System and method for changing the operating state of a device
US10030878B2 (en) 2013-08-21 2018-07-24 Honeywell International Inc. User interaction with building controller device using a remote server and a duplex connection
US10047970B2 (en) 2013-08-21 2018-08-14 Honeywell International Inc. Devices and methods for interacting with an HVAC controller
US10088853B2 (en) 2012-05-02 2018-10-02 Honeywell International Inc. Devices and methods for interacting with an HVAC controller
US10145579B2 (en) 2013-05-01 2018-12-04 Honeywell International Inc. Devices and methods for interacting with a control system that is connected to a network
EP2943946B1 (en) * 2013-01-14 2019-06-19 BSH Hausgeräte GmbH Communications module
US10514677B2 (en) 2014-04-11 2019-12-24 Honeywell International Inc. Frameworks and methodologies configured to assist configuring devices supported by a building management system
US11770649B2 (en) 2017-12-06 2023-09-26 Ademco, Inc. Systems and methods for automatic speech recognition
US11841156B2 (en) 2018-06-22 2023-12-12 Honeywell International Inc. Building management system with natural language interface

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6275991B1 (en) * 1996-02-06 2001-08-14 Fca Corporation IR transmitter with integral magnetic-stripe ATM type credit card reader and method therefor
US20020059588A1 (en) * 2000-08-25 2002-05-16 Thomas Huber Personalized remote control
WO2002082796A1 (en) * 2001-04-03 2002-10-17 Raoul Parienti Video image display system that is used for interactive television, videoconferencing and telemonitoring

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6275991B1 (en) * 1996-02-06 2001-08-14 Fca Corporation IR transmitter with integral magnetic-stripe ATM type credit card reader and method therefor
US20020059588A1 (en) * 2000-08-25 2002-05-16 Thomas Huber Personalized remote control
WO2002082796A1 (en) * 2001-04-03 2002-10-17 Raoul Parienti Video image display system that is used for interactive television, videoconferencing and telemonitoring

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011018562A1 (en) * 2009-08-10 2011-02-17 Richard Thibert Electronic device for controlling electrical apparatuses by means of sound
FR2949012A1 (en) * 2009-08-10 2011-02-11 Richard Thibert ELECTRONIC DEVICE FOR CONTROLLING ELECTRICAL EQUIPMENT BY SOUND
WO2012028461A1 (en) * 2010-08-31 2012-03-08 BSH Bosch und Siemens Hausgeräte GmbH Method for processing data in a domestic appliance, domestic appliance and system having a domestic applicance and at least one external unit
CN102592039A (en) * 2011-01-18 2012-07-18 四川火狐无线科技有限公司 Interaction method for processing cantering and entertainment service data and device and system for realizing same
US10088853B2 (en) 2012-05-02 2018-10-02 Honeywell International Inc. Devices and methods for interacting with an HVAC controller
EP2943946B1 (en) * 2013-01-14 2019-06-19 BSH Hausgeräte GmbH Communications module
US10145579B2 (en) 2013-05-01 2018-12-04 Honeywell International Inc. Devices and methods for interacting with a control system that is connected to a network
US10508824B2 (en) 2013-05-01 2019-12-17 Ademco Inc. Devices and methods for interacting with a control system that is connected to a network
US10054327B2 (en) 2013-08-21 2018-08-21 Honeywell International Inc. Devices and methods for interacting with an HVAC controller
US10047970B2 (en) 2013-08-21 2018-08-14 Honeywell International Inc. Devices and methods for interacting with an HVAC controller
US10837667B2 (en) 2013-08-21 2020-11-17 Ademco Inc. Devices and methods for interacting with an HVAC controller
US10030878B2 (en) 2013-08-21 2018-07-24 Honeywell International Inc. User interaction with building controller device using a remote server and a duplex connection
US11543143B2 (en) 2013-08-21 2023-01-03 Ademco Inc. Devices and methods for interacting with an HVAC controller
US10670289B2 (en) 2013-08-21 2020-06-02 Ademco Inc. Devices and methods for interacting with an HVAC controller
US10782043B2 (en) 2013-08-21 2020-09-22 Ademco Inc. User interaction with building controller device using a remote server and a duplex connection
US10514677B2 (en) 2014-04-11 2019-12-24 Honeywell International Inc. Frameworks and methodologies configured to assist configuring devices supported by a building management system
DE102016114601A1 (en) * 2016-08-05 2018-02-08 Aesculap Ag System and method for changing the operating state of a device
US11770649B2 (en) 2017-12-06 2023-09-26 Ademco, Inc. Systems and methods for automatic speech recognition
US11841156B2 (en) 2018-06-22 2023-12-12 Honeywell International Inc. Building management system with natural language interface

Also Published As

Publication number Publication date
ITRM20060432A1 (en) 2008-02-08
WO2008018102A3 (en) 2008-03-20

Similar Documents

Publication Publication Date Title
WO2008018102A2 (en) Interactive system
EP2154882B1 (en) Techniques for automatically distinguishing between users of a handheld device
US8341669B2 (en) Systems and methods for controlling an electronic device
US9402102B2 (en) System and method for using television schedule information
US8387084B1 (en) Systems and methods for detecting unauthorized use of a user equipment device
US9445146B2 (en) Multimedia arrangement
US9239837B2 (en) Remote control system for connected devices
KR101925016B1 (en) Digital media content management system and method
US9147342B2 (en) Techniques for configuring and remotely controlling a multimedia system
US7650319B2 (en) Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore
US6075575A (en) Remote control device and method for using television schedule information
US20160330522A1 (en) Apparatus, systems and methods for a content commentary community
US20030005431A1 (en) PVR-based system and method for TV content control using voice recognition
US20170347148A1 (en) Set-Top Box with Enhanced Content and System and Method for Use of Same
CN102918835A (en) Controllable device companion data
US20020019732A1 (en) Interactivity using voice commands
CN103035267B (en) Content-driven input device and method for controlling electric appliance
KR20010109328A (en) Method and apparatus for presentation of intelligent, adaptive alarms, icons and other information
US20080244634A1 (en) System and Method for Inputting Preferences Into Recommender/Profiling System
US9917703B2 (en) Portable control device for controlling playback streams in distributed system
EP1830570A2 (en) Method and system for configuring media-playing sets
CN105474652B (en) For user monitoring and it is intended to the system and method judged

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07805699

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU

122 Ep: pct application non-entry in european phase

Ref document number: 07805699

Country of ref document: EP

Kind code of ref document: A2