WO2010020924A1 - Method, portable device and system for providing feedback related to a user's physical state - Google Patents

Method, portable device and system for providing feedback related to a user's physical state Download PDF

Info

Publication number
WO2010020924A1
WO2010020924A1 PCT/IB2009/053598 IB2009053598W WO2010020924A1 WO 2010020924 A1 WO2010020924 A1 WO 2010020924A1 IB 2009053598 W IB2009053598 W IB 2009053598W WO 2010020924 A1 WO2010020924 A1 WO 2010020924A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
signal
remote
measurement signal
measurement
Prior art date
Application number
PCT/IB2009/053598
Other languages
French (fr)
Inventor
Bastiaan Zoetekouw
Martijn Krans
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Publication of WO2010020924A1 publication Critical patent/WO2010020924A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309Transmission or handling of upstream communications
    • H04N7/17318Direct or substantially direct transmission and handling of requests
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/486Bio-feedback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42201Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42202Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508Management of client data or end-user data
    • H04N21/4532Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/654Transmission by server directed to the client
    • H04N21/6543Transmission by server directed to the client for forcing some client operations, e.g. recording
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2560/00Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
    • A61B2560/02Operational features
    • A61B2560/0242Operational features adapted to measure environmental factors, e.g. temperature, pollution
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/01Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
    • A61B5/053Measuring electrical impedance or conductance of a portion of the body
    • A61B5/0531Measuring skin impedance
    • A61B5/0533Measuring galvanic skin response
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/1455Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/318Heart-related electrical modalities, e.g. electrocardiography [ECG]

Definitions

  • the invention relates to a method of providing feedback related to a user's physical state using a portable unit for carrying on the user and capable of communicating with a remote system.
  • the invention also relates to a portable device for carrying on a user, capable of communication with a remote system.
  • the invention also relates to a system for processing information corresponding to at least one measurement signal representative of at least one measurement of one of: - a physiological parameter of a user of a remote portable unit for carrying on a user and a parameter associated with ambient conditions experienced by the user of the remote portable unit.
  • the invention also relates to a computer program.
  • US 2003/0126593 discloses a system to assist a person to monitor a physiological parameter, comprising: a monitor module comprising a transducer providing physiological data correlated with the physiological parameter; an interactive television system; a remote computer system; and a software application program on the interactive television receiver, adapted to process physiological data, to transmit the physiological data over a communications network to the remote computer system, to receive feedback data from the remote computer system and to provide a visual presentation of the feedback on its display.
  • the monitor module has the ability to receive and transmit data. Data transfer between the monitor module and the interactive TV is person-initiated and/or an automatic process.
  • the interactive TV can have a separate remote control which is used to control data transfer, or the monitor module can act as a remote control for the interactive TV.
  • the method of providing feedback includes: obtaining at least one measurement signal representative of at least one measurement of one of a physiological parameter of the user and a parameter associated with ambient conditions experienced by the user transmitting information corresponding to the at least one measurement signal to the remote system for processing by the system, and enabling at least one feedback signal based on the transmitted information to be rendered in a form perceptible to the user, wherein at least a part of the process of converting the at least one measurement signal into a rendered feedback signal is carried out by the portable unit in dependence on a signal received from the remote system.
  • the portable unit may require the information carried by the signal as input or merely use the signal as a trigger.
  • At least some processing of data - examples include the background execution of logic determining when to execute certain steps of the method and the provision of output data when the process of converting measurements into feedback - is actually being carried out, need not be carried out continually by the portable unit. This is achieved without the need to delegate control to the user, making the system simpler to use.
  • the portable unit transmit information corresponding to the at least one measurement signal to the system controlled by the portable unit, for processing by the system, the processing requirements imposed on the portable unit can be kept at a relatively low level.
  • An embodiment, wherein the portable unit comprises a remote control unit includes transmitting control signals for controlling at least part of the functionality of the remote system in response to manipulation by the user.
  • the remote control unit controls remotely at least part of the functionality of a system in response to manipulation by the user, it is likely to be kept in relatively close proximity to the user. By having the remote control unit obtain the measurement signal, the measurement will reflect relatively accurately the context that particular user is in. Moreover, by combining the controls of the remote system and the monitoring function in one device, more efficient use is made of transceivers for two-way communication between the portable unit and the remote system.
  • An embodiment of the method includes receiving at least one feedback signal transmitted to the portable unit from the remote system, and causing the feedback signal to be rendered in a form perceptible by the user.
  • transmission of information corresponding to the at least one measurement signal to the remote system for processing by the system is triggered by a signal received from the remote system.
  • An effect is to lower the background power consumption of the portable unit, since it need not continuously transmit information corresponding to the measurement signal or signals. Instead, the remote system polls the portable device. This effect also makes it easier to implement a system in which the remote system processes information corresponding to measurement signals for several portable units.
  • the remote system includes functionality independent of the processing of the information corresponding to the at least one measurement signal, which functionality is at least partly controlled by the remote control unit.
  • the biofeedback functionality is integrated into an assembly comprising a remote control unit and an appliance with functionality more or less unrelated to the provision of biofeedback.
  • the remote control unit used to operate the appliance requires frequent handling, making it suitable for use as a means for providing information corresponding to measurement signals characterizing the context the user is in.
  • the remote system renders in perceptible form an output signal at least partly derived from an input signal independent of the at least one measurement signal.
  • An effect is to increase the range of use of the assembly of portable unit and remote system.
  • a further effect is that the feedback based on the at least one measurement signal is rendered in a less obtrusive perceptible form.
  • the information content of the feedback can be provided together with the information content of the input signal.
  • the remote system modifies the output signal in dependence on the information corresponding to the at least one measurement signal.
  • An effect is to enable all perceptible output to be consistent, and appropriate to the personal context of the user.
  • the remote system comprises an ambient system, wherein the ambient system is adjusted at least partly in accordance with the information corresponding to the at least one measurement signal.
  • An effect is to provide a form of output that can always be adapted to the physical state of the user, since this is the primary function of an ambient system.
  • This variant takes account of the fact that it is not always possible or desirable to modify the playback or selection of content such as movies or music in accordance with the physical state of a user. Even where such modification is possible, and is carried out, appropriate adaptation of an ambient system enhances the effect provided by the content rendering system.
  • the information is transmitted to a remote system arranged to process information received from at least one further portable unit and corresponding to at least one measurement signal representative of at least one measurement of one of: a physiological parameter of a user of the portable unit concerned and a parameter associated with ambient conditions experienced by the user of the portable unit concerned.
  • a remote system arranged to process information received from at least one further portable unit and corresponding to at least one measurement signal representative of at least one measurement of one of: a physiological parameter of a user of the portable unit concerned and a parameter associated with ambient conditions experienced by the user of the portable unit concerned.
  • the portable device includes: an arrangement for obtaining at least one measurement signal representative of at least one measurement of one of a physiological parameter of the user and a parameter associated with ambient conditions experienced by the user; and a transceiver arrangement for two-way communication with the remote system, wherein the portable device is arranged to transmit information corresponding to the at least one measurement signal to the remote system, for processing by the system, and to carry out at least a part of a process of converting the at least one measurement signal into a feedback signal rendered in a form perceptible to a user in dependence on a signal received from the remote system.
  • the level of resources required to be present in the portable device to provide it with the feedback functionality is relatively low.
  • An embodiment is configured to execute a method according to the invention.
  • the system according to the invention includes: a transceiver arrangement for receiving the information corresponding to the at least one measurement signal from the remote portable unit, and for providing a control signal causing the remote portable unit to carry out at least a part of a process of converting the at least one measurement signal into a feedback signal rendered in a form perceptible to a user.
  • the system is specially adapted for use in conjunction with a fairly simple portable device to provide tailored feedback to a particular user.
  • An embodiment of the system is configured to function as the remote system in a method according to the invention.
  • a computer program including a set of instructions capable, when incorporated in a machine-readable medium, of causing a system having information processing capabilities to perform a method according to the invention or to provide the system with the functionality of a system according to the invention.
  • Fig. 1 is a schematic block diagram of a remotely controlled digital television
  • Fig. 2 is a flow chart showing steps in a method executed by the remote control unit of Fig. 1
  • Fig. 3 is a flow chart showing steps executed by the digital television and remote control unit in order to provide feedback to a user
  • Fig. 4 is a schematic diagram of a multi-user configuration including the digital television.
  • a digital television system 1 is adapted to provide feedback based on the physical state of a user of a remote control unit 2.
  • the digital television system 1 receives information corresponding to at least one measurement signal representative of a physiological parameter of the user or a parameter associated with ambient conditions experienced by the user and measured in close proximity to the user.
  • different types of feedback are provided to the user according to a heuristic or algorithm.
  • the feedback may be informative, or it may be functional, for example intended to influence the physical state of the user, e.g. by making him or her relax, feel more alert, more comfortable, etc.
  • Such feedback based at least indirectly on a measurement in the user's personal context will also be referred to herein as biofeedback.
  • a digital television system 1 it is possible to implement the methods outlined herein using other types of remotely controlled systems with an interface for two-way communication with a remote control unit.
  • Examples include other types of consumer electronic appliances, but also industrial equipment, so long as they are provided with data processing capacity.
  • Such systems will have functionality that is independent of the provision of biofeedback, but which is already controlled using a remote control unit. To control this functionality, the user will be making frequent user of the remote control unit. This situation is exploited to obtain up-to-date measurements.
  • the remote control unit 2 is provided with an interface 3 for two-way communication with the digital television 1, which is provided with a corresponding interface 4.
  • the interfaces 3,4 are generally adapted for communication over a distance greater than the personal space of the user, e.g. more than about 1 m.
  • Suitable interfaces are wireless interfaces, e.g. for optical or radio frequency communication. Possible embodiments include infra-red interfaces and interfaces based on the Bluetooth or Zigbee communication protocols. For continuous feedback, a wireless radio link would be useful, because it does not require a line of sight that can be interrupted.
  • the remote control unit 2 includes a controller 5 for signal processing. It also includes user controls 6 for manipulation by the user. These may be in the form of mechanical buttons, a touch screen interface, accelerometers, optical movement sensors like those comprised in computer mice or other suitable types of interface. Direct manipulation is not required. Any interface for detecting expressions of will by a user in close proximity is suitable.
  • the remote control unit 2 although being arranged to move about with the user, need not be carried in the hand, but can be strapped to the user's body, comprise a head-set, etc.
  • the remote control unit 2 comprises both an internal sensor 7 and an interface 8 to an also portable sensor unit 9.
  • the portable sensor unit 9 includes a similar interface 10, a sensor 11 and a controller 12.
  • the portable sensor unit 9 may be strapped to the user's body whilst the remote control unit 2 is handheld. In any event, the remote control unit 2 is thus enabled to obtain measurement signals of a physiological parameter of the user or a parameter associated with ambient conditions experienced by the user.
  • Typical sensor for measuring a physiological parameter include photoplethysmographs, skin thermometers, electrodes for measuring the galvanic skin response, electrodes for obtaining an Electro Cardiogram, etc.
  • sensors for measuring a parameter associated with ambient conditions experienced by the user include optical sensors for measuring the intensity and/or color of ambient light in the vicinity of the user, a temperature sensor to measure room temperature, a microphone to measure the ambient noise level, etc.
  • the remote control unit 2 further includes at least one output device 13 for rendering a signal in a form perceptible to the user.
  • Feedback may be visual, audible, or tactile or a combination.
  • the output device 13 can include a loudspeaker, a light that changes color or intensity, or an arrangement of lights, a so-called nimbler or other type of device for providing force feedback. It may even include a heating or cooling device for adjusting the temperature experienced by the user handling the remote control unit 2.
  • the remote control unit 2 includes a simple data processing unit 14 for processing the measurement signals and converting them into at least one signal for rendering by the output device 13 according to a simplified algorithm.
  • the purpose of this is to enable the remote control unit 2 to function in a stand-alone mode in situations where the digital television 1 is not available, as will be explained. However, the digital television will under normal circumstances determine the appropriate values of the feedback signal that is to be rendered in perceptible form.
  • the controller 5 and data processing unit 14 may be combined in an alternative embodiment.
  • the digital television 1 includes a receiver interface 15, e.g. a terrestrial, cable or satellite interface, a tuner 16, a demodulator 17 and a demultiplexer 18, as well as a switching device 19 for switching between streams of digital audio, video or data streams.
  • content data can also be retrieved from a mass storage device 20, representative of a class of devices that includes optical disk drives, hard disk drives, solid state storage devices, etc.
  • Video data is rendered in perceptible form by means of a display 21 and display driver 22.
  • Audio data is rendered in perceptible form by an audio decoder 23 and output stage 24 for providing audio signals to a sound system (not shown).
  • an ambient system comprising an ambient output device 25 is integrated into the digital television 1 , which is also provided with the appropriate output stage 26 for providing a signal for adjusting an external device 27, e.g. an ambient lighting device.
  • the ambient system is connected to a bus for home automation to control a variety of devices in the user's house.
  • the integrated ambient output device 25 can be part of a system known as ambilight, comprising a series of Light Emitting Diodes arranged around a screen of the display 21, which change color and/or intensity in accordance with a script provided with the content, so as to match the content in terms of the mood conveyed.
  • ambilight comprising a series of Light Emitting Diodes arranged around a screen of the display 21, which change color and/or intensity in accordance with a script provided with the content, so as to match the content in terms of the mood conveyed.
  • the digital television 1 operates under the control of a central processing unit 28 having access to main memory 29 and arranged to execute software stored in nonvolatile memory 30.
  • the user controls 6 on the remote control unit 2 allow the user to control the biofeedback functionality of the digital television 1 and remote control unit 2. This may be via dedicated keys on the remote control unit 2 or via general purpose keys that control a menu provided on-screen by the digital television 1. Thus, the user will activate (step 31) the biofeedback function using the user controls 6.
  • the remote control unit 2 will, at the latest at this stage, commence (step 32) obtaining measurement signals representative of the measurements of one or more physiological parameters of the user and/or one or more parameters associated with ambient conditions experienced by the user.
  • step 33 it is also determined (step 33) whether the digital television 1 can be used to process information corresponding to the measurement signals obtained by the remote control unit 2 for the purpose of converting it into appropriate feedback signals.
  • this determination 33 is carried out by the remote control unit 2, and can therefore comprise determining whether the digital television 1 is within range and/or switched on.
  • the digital television 1 determines whether its settings allow it to participate.
  • the remote control unit 2 executes (step 34) a simple routine to determine locally the appropriate feedback to be provided. Using the information obtained in the preceding step 32, the measurement signals are converted into a feedback signal for local rendering in accordance with the predetermined, simple routine.
  • the routine may be stored in memory (not illustrated separately) or hard-wired into the data processing unit 14. It can be in the form of characteristics, using e.g. stored support values and an interpolation algorithm.
  • the support values are based on empirically derived relations.
  • the types of signals required to obtain a certain biological effect are known. Representative examples of the effects of such signals are given in the following three references, for example: Schein, M. et ah, "Treating hypertension with a device that slows and regularizes breathing: A randomized, double-blind controlled study", Journal of Human Hypertension, Ii, pp. 271-278;
  • the remote control unit 2 can be used for breathing exercises, using e.g. colored lights as the output device 13 to indicate whether the user's breathing is too fast or too slow.
  • the feedback is limited to that which can be provided using the output device 13 available locally to the remote control unit 2. It is further limited by the processing capacity of the data processing unit 14.
  • the user of the remote control unit 2 can obtain biofeedback without disturbing other persons present in the vicinity of the television 1. Indeed, the user can take the remote control unit 2 to another room, or at least out of range of the television 1.
  • the remote control unit 2 carries out at least one of the steps in the process of converting measurement signals into rendered feedback signals in dependence on a signal received from the digital television 1. In the variant of Fig. 3, two such steps depend on a preceding signal from the digital television 1.
  • the digital television 1 can poll (step 36) the remote control unit 2 for information corresponding to at least one measurement signal representative of a physiological parameter of the user and/or a parameter associated with ambient conditions as experienced by the user.
  • the remote control unit 2 returns (step 37) such information, which may be a pre- processed version of the measurement signals obtained from the sensor unit 9 and/or the internal sensor 7, or may correspond directly to the sample values. Therefore, the transmission of information corresponding to at least one measurement signal for processing by the digital television 1 is triggered by a signal received from the digital television 1. It is noted that this feature may be implemented in such a way that the preceding step 32 of obtaining sensor data, at least where data from the sensor unit 9 is concerned, is also carried out only upon receiving the polling signal. In any case, it will be clear that the process of converting the part of the measurement signals obtained in the preceding step 32 into feedback to be rendered subsequently is dependent on receiving a polling signal from the digital television 1.
  • the digital television 1 receives the information corresponding to the measurement signals, and analyses (step 38) the information.
  • This analysis 38 can be more processing-intensive than the corresponding step 34.
  • the digital television 1 may carry out averaging, digital filtering or frequency analysis on the signals received from the remote control unit 2.
  • the digital television 1 determines (step 40) the appropriate feedback.
  • a first type of feedback uses the fact that the digital television 1 renders in perceptible form an output signal that is at least partly derived from an input signal that is independent of the measurement information received from the remote control unit 2.
  • the digital television 1 renders in perceptible form the audio-visual signals obtained using the tuner 16, demodulator 17 and demultiplexer 18, or audio-visual signals stored on the mass storage device 20, e.g. a DVD in an optical disk drive.
  • the digital television 1 modifies its selection of content from the content available in the input signal and/or edits the selected content (step 41).
  • a program carried in MPEG-2 elementary streams may comprise several variants, carried in separate elementary streams and identified in the Programme Map Table associated with these streams.
  • the digital television 1 can select the appropriate elementary streams based on the values of the measurement signals it has received. For example, if the measurement signals demonstrate that the user has a high pulse rate or is otherwise very agitated, the digital television 1 can select a less violent or less gory version of a horror movie played back from disk. Alternatively, it can edit the video signal by removing scenes of certain color. In another example, e.g. where the viewer is known to suffer from certain afflictions (e.g. migraine), biological measurements can be used to edit the video signal in an appropriate manner.
  • afflictions e.g. migraine
  • the digital television 1 can automatically adjust its settings, e.g. the amplification settings for the audio component of audiovisual signals and/or the brightness values of the video component, in dependence on the information based on the measurement signals and received from the remote control unit 2.
  • the digital television 1 comprises an ambient system, a system to generate perceptible effects corresponding at least partly to the content being rendered.
  • the perceptible effects are adapted also in dependence on the measurement signals obtained by the remote control unit 2. For example, lighting may change to a less aggressive color or lower intensity if the user is determined to be agitated. Alternatively, the lighting may start to flash, increase in intensity or adjust to a primary color if it is determined that the use is less alert.
  • the remote control unit 2 is employed to render at least one of the feedback signals provided by the digital television 1 in perceptible form.
  • the digital television 1 transmits (step 44) a control signal corresponding to the feedback signal to the remote control unit 2.
  • step 45 receives (step 45) the signal and proceeds to cause (step 46) the output device 13 to render the feedback signal in a form perceptible by the user.
  • step 46 like the first step 37 is thus carried out in dependence on a signal received from the digital television 1.
  • the remote control unit 2 can thus provide feedback perceptible primarily by the user thereof. Because the feedback is determined predominantly by the digital television 1 with its advanced data processing capacity, the feedback can depend in a quite elaborate way on the measured values of biological signals.
  • Fig. 4 illustrates a further variant, suitable for use in a multi-user environment.
  • a first remote control unit 47 corresponds to the remote control unit 2 described in detail hereinbefore. It thus comprises both user controls 48 and an output device 49.
  • Further portable units 50-52 comprise a sensor and/or sensor interface (not shown) for obtaining at least one measurement signal representative of at least one measurement of a physiological parameter of its respective user and/or a parameter associated with ambient conditions experienced by the respective user.
  • these portable units 50-52 comprise only a respective output device 53-55. Each transmits information based on measurement signals obtained by it to the digital television 56 or other remote system for processing. This may be done in response to a polling signal.
  • the digital television 56 calculates the appropriate values of feedback signals.
  • Feedback can be rendered in perceptible form using e.g. an ambient lighting device 57 comprised in the digital television 56.
  • Feedback signals are also transmitted to the first remote control unit 47 for rendering in perceptible form, as well as to the individual portable units 50-52. It is appropriate to transmit to the portable units 50-52 respective feedback signals based only on measurement information received from them individually, and to transmit to the first remote control unit 47 a feedback signal based on measurement signals received from at least one of the portable units 50,51,52.
  • the first remote control unit 47 can be used for instance by a teacher, and the other portable units 50,51,52 by his or her pupils.
  • the portable units 50-52 can be provided with limited user controls, allowing them to connect to selected ones of the other portable units 50-52 and/or the first remote control unit 47 so as to receive the feedback signal based on that unit's measurements from the digital television 56.
  • the user may select to receive feedback based on the physical state of the users collectively. This feature can be used to ascertain the mood in the room or the mood of another person in the room (without having to ask them).
  • the digital television 1 can be used to suggest TV content to a user based on his current physiological state, or to restrict access to users that are in certain physiological states. It can also be used to assess the age of the user and restrict content based on this inference, e.g. using heuristics to infer the user's age from biological data.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Databases & Information Systems (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Pathology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Social Psychology (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Neurosurgery (AREA)
  • Business, Economics & Management (AREA)
  • Ecology (AREA)
  • Emergency Management (AREA)
  • Environmental & Geological Engineering (AREA)
  • Environmental Sciences (AREA)
  • Remote Sensing (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

A method of providing feedback related to a user's physical state using a portable unit (2;47,50-52) for carrying on the user and capable of communicating with a remote system (1;56) includes: obtaining at least one measurement signal representative of at least one measurement of one of a physiological parameter of the user and a parameter associated with ambient conditions experienced by the user transmitting information corresponding to the at least one measurement signal to the remote system (1;56) for processing by the system, and enabling at least one feedback signal based on the transmitted information to be rendered in a form perceptible to the user. At least a part of the process of converting the at least one measurement signal into a rendered feedback signal is carried out by the portable unit (2,47;50-52) in dependence on a signal received from the remote system (1;56).

Description

Method, portable device and system for providing feedback related to a user's physical state
FIELD OF THE INVENTION
The invention relates to a method of providing feedback related to a user's physical state using a portable unit for carrying on the user and capable of communicating with a remote system. The invention also relates to a portable device for carrying on a user, capable of communication with a remote system.
The invention also relates to a system for processing information corresponding to at least one measurement signal representative of at least one measurement of one of: - a physiological parameter of a user of a remote portable unit for carrying on a user and a parameter associated with ambient conditions experienced by the user of the remote portable unit.
The invention also relates to a computer program.
BACKGROUND OF THE INVENTION
US 2003/0126593 discloses a system to assist a person to monitor a physiological parameter, comprising: a monitor module comprising a transducer providing physiological data correlated with the physiological parameter; an interactive television system; a remote computer system; and a software application program on the interactive television receiver, adapted to process physiological data, to transmit the physiological data over a communications network to the remote computer system, to receive feedback data from the remote computer system and to provide a visual presentation of the feedback on its display. The monitor module has the ability to receive and transmit data. Data transfer between the monitor module and the interactive TV is person-initiated and/or an automatic process. The interactive TV can have a separate remote control which is used to control data transfer, or the monitor module can act as a remote control for the interactive TV.
A problem of the known method is that it imposes relatively many additional requirements on the specifications of the equipment, in particular the remote control unit. SUMMARY OF THE INVENTION
It is desirable to provide a method, portable device, system and computer program that can be implemented with relatively few demands on the specifications of the portable device, e.g. in terms of its background power consumption and required dedicated user controls, but still provide biofeedback appropriate to a particular user.
This is achieved by the method of providing feedback according to the invention, which method includes: obtaining at least one measurement signal representative of at least one measurement of one of a physiological parameter of the user and a parameter associated with ambient conditions experienced by the user transmitting information corresponding to the at least one measurement signal to the remote system for processing by the system, and enabling at least one feedback signal based on the transmitted information to be rendered in a form perceptible to the user, wherein at least a part of the process of converting the at least one measurement signal into a rendered feedback signal is carried out by the portable unit in dependence on a signal received from the remote system. The portable unit may require the information carried by the signal as input or merely use the signal as a trigger. In either case, at least some processing of data - examples include the background execution of logic determining when to execute certain steps of the method and the provision of output data when the process of converting measurements into feedback - is actually being carried out, need not be carried out continually by the portable unit. This is achieved without the need to delegate control to the user, making the system simpler to use. By having the portable unit transmit information corresponding to the at least one measurement signal to the system controlled by the portable unit, for processing by the system, the processing requirements imposed on the portable unit can be kept at a relatively low level. An embodiment, wherein the portable unit comprises a remote control unit, includes transmitting control signals for controlling at least part of the functionality of the remote system in response to manipulation by the user.
Because the remote control unit controls remotely at least part of the functionality of a system in response to manipulation by the user, it is likely to be kept in relatively close proximity to the user. By having the remote control unit obtain the measurement signal, the measurement will reflect relatively accurately the context that particular user is in. Moreover, by combining the controls of the remote system and the monitoring function in one device, more efficient use is made of transceivers for two-way communication between the portable unit and the remote system.
An embodiment of the method includes receiving at least one feedback signal transmitted to the portable unit from the remote system, and causing the feedback signal to be rendered in a form perceptible by the user.
Particularly in a situation where there are several persons in the environment in which the remote system and portable unit are located, this enables the feedback to be targeted at only one of them. Generally, this would be the person to whom the measurement signal on which the feedback is based applies. This embodiment is also suitable for providing certain types of feedback, such as tactile feedback, which cannot otherwise be provided readily. In an embodiment of the method, transmission of information corresponding to the at least one measurement signal to the remote system for processing by the system is triggered by a signal received from the remote system.
An effect is to lower the background power consumption of the portable unit, since it need not continuously transmit information corresponding to the measurement signal or signals. Instead, the remote system polls the portable device. This effect also makes it easier to implement a system in which the remote system processes information corresponding to measurement signals for several portable units.
In a variant, the remote system includes functionality independent of the processing of the information corresponding to the at least one measurement signal, which functionality is at least partly controlled by the remote control unit.
As a consequence, only one remote control unit is required. The biofeedback functionality is integrated into an assembly comprising a remote control unit and an appliance with functionality more or less unrelated to the provision of biofeedback. The remote control unit used to operate the appliance requires frequent handling, making it suitable for use as a means for providing information corresponding to measurement signals characterizing the context the user is in.
In an embodiment, the remote system renders in perceptible form an output signal at least partly derived from an input signal independent of the at least one measurement signal. An effect is to increase the range of use of the assembly of portable unit and remote system. A further effect is that the feedback based on the at least one measurement signal is rendered in a less obtrusive perceptible form. The information content of the feedback can be provided together with the information content of the input signal. In a variant, the remote system modifies the output signal in dependence on the information corresponding to the at least one measurement signal.
An effect is to enable all perceptible output to be consistent, and appropriate to the personal context of the user.
In an embodiment, the remote system comprises an ambient system, wherein the ambient system is adjusted at least partly in accordance with the information corresponding to the at least one measurement signal.
An effect is to provide a form of output that can always be adapted to the physical state of the user, since this is the primary function of an ambient system. This variant takes account of the fact that it is not always possible or desirable to modify the playback or selection of content such as movies or music in accordance with the physical state of a user. Even where such modification is possible, and is carried out, appropriate adaptation of an ambient system enhances the effect provided by the content rendering system.
In an embodiment, the information is transmitted to a remote system arranged to process information received from at least one further portable unit and corresponding to at least one measurement signal representative of at least one measurement of one of: a physiological parameter of a user of the portable unit concerned and a parameter associated with ambient conditions experienced by the user of the portable unit concerned. An effect is to enable the provision of feedback relating to the physical state of members of a group of persons. This can be used e.g. to gauge or moderate audience reaction to content being rendered. An alternative application is in the context of group training exercises. Feedback can be provided, for example, to the trainer.
According to another aspect, the portable device according to the invention includes: an arrangement for obtaining at least one measurement signal representative of at least one measurement of one of a physiological parameter of the user and a parameter associated with ambient conditions experienced by the user; and a transceiver arrangement for two-way communication with the remote system, wherein the portable device is arranged to transmit information corresponding to the at least one measurement signal to the remote system, for processing by the system, and to carry out at least a part of a process of converting the at least one measurement signal into a feedback signal rendered in a form perceptible to a user in dependence on a signal received from the remote system.
The level of resources required to be present in the portable device to provide it with the feedback functionality is relatively low.
An embodiment is configured to execute a method according to the invention.
According to another aspect, the system according to the invention includes: a transceiver arrangement for receiving the information corresponding to the at least one measurement signal from the remote portable unit, and for providing a control signal causing the remote portable unit to carry out at least a part of a process of converting the at least one measurement signal into a feedback signal rendered in a form perceptible to a user.
The system is specially adapted for use in conjunction with a fairly simple portable device to provide tailored feedback to a particular user. An embodiment of the system is configured to function as the remote system in a method according to the invention.
According to another aspect of the invention, there is provided a computer program including a set of instructions capable, when incorporated in a machine-readable medium, of causing a system having information processing capabilities to perform a method according to the invention or to provide the system with the functionality of a system according to the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention will be explained in further detail with reference to the accompanying drawings, in which:
Fig. 1 is a schematic block diagram of a remotely controlled digital television; Fig. 2 is a flow chart showing steps in a method executed by the remote control unit of Fig. 1; Fig. 3 is a flow chart showing steps executed by the digital television and remote control unit in order to provide feedback to a user; and
Fig. 4 is a schematic diagram of a multi-user configuration including the digital television.
DETAILED DESCRIPTION
A digital television system 1 is adapted to provide feedback based on the physical state of a user of a remote control unit 2. The digital television system 1 receives information corresponding to at least one measurement signal representative of a physiological parameter of the user or a parameter associated with ambient conditions experienced by the user and measured in close proximity to the user. Depending on the values of the parameters, different types of feedback are provided to the user according to a heuristic or algorithm. The feedback may be informative, or it may be functional, for example intended to influence the physical state of the user, e.g. by making him or her relax, feel more alert, more comfortable, etc. Such feedback based at least indirectly on a measurement in the user's personal context will also be referred to herein as biofeedback.
Although the example of a digital television system 1 is used, it is possible to implement the methods outlined herein using other types of remotely controlled systems with an interface for two-way communication with a remote control unit. Examples include other types of consumer electronic appliances, but also industrial equipment, so long as they are provided with data processing capacity. Generally, such systems will have functionality that is independent of the provision of biofeedback, but which is already controlled using a remote control unit. To control this functionality, the user will be making frequent user of the remote control unit. This situation is exploited to obtain up-to-date measurements. Returning to the specific example, the remote control unit 2 is provided with an interface 3 for two-way communication with the digital television 1, which is provided with a corresponding interface 4. The interfaces 3,4 are generally adapted for communication over a distance greater than the personal space of the user, e.g. more than about 1 m. Suitable interfaces are wireless interfaces, e.g. for optical or radio frequency communication. Possible embodiments include infra-red interfaces and interfaces based on the Bluetooth or Zigbee communication protocols. For continuous feedback, a wireless radio link would be useful, because it does not require a line of sight that can be interrupted.
In the illustrated embodiment, the remote control unit 2 includes a controller 5 for signal processing. It also includes user controls 6 for manipulation by the user. These may be in the form of mechanical buttons, a touch screen interface, accelerometers, optical movement sensors like those comprised in computer mice or other suitable types of interface. Direct manipulation is not required. Any interface for detecting expressions of will by a user in close proximity is suitable. In this respect, it is noted that the remote control unit 2, although being arranged to move about with the user, need not be carried in the hand, but can be strapped to the user's body, comprise a head-set, etc.
In the illustrated embodiment, the remote control unit 2 comprises both an internal sensor 7 and an interface 8 to an also portable sensor unit 9. The portable sensor unit 9 includes a similar interface 10, a sensor 11 and a controller 12. As an example, the portable sensor unit 9 may be strapped to the user's body whilst the remote control unit 2 is handheld. In any event, the remote control unit 2 is thus enabled to obtain measurement signals of a physiological parameter of the user or a parameter associated with ambient conditions experienced by the user.
Typical sensor for measuring a physiological parameter include photoplethysmographs, skin thermometers, electrodes for measuring the galvanic skin response, electrodes for obtaining an Electro Cardiogram, etc. Examples of sensors for measuring a parameter associated with ambient conditions experienced by the user include optical sensors for measuring the intensity and/or color of ambient light in the vicinity of the user, a temperature sensor to measure room temperature, a microphone to measure the ambient noise level, etc.
The remote control unit 2 further includes at least one output device 13 for rendering a signal in a form perceptible to the user. Feedback may be visual, audible, or tactile or a combination. For example, the output device 13 can include a loudspeaker, a light that changes color or intensity, or an arrangement of lights, a so-called nimbler or other type of device for providing force feedback. It may even include a heating or cooling device for adjusting the temperature experienced by the user handling the remote control unit 2.
In the illustrated embodiment, the remote control unit 2 includes a simple data processing unit 14 for processing the measurement signals and converting them into at least one signal for rendering by the output device 13 according to a simplified algorithm. The purpose of this is to enable the remote control unit 2 to function in a stand-alone mode in situations where the digital television 1 is not available, as will be explained. However, the digital television will under normal circumstances determine the appropriate values of the feedback signal that is to be rendered in perceptible form. The controller 5 and data processing unit 14 may be combined in an alternative embodiment. The digital television 1 includes a receiver interface 15, e.g. a terrestrial, cable or satellite interface, a tuner 16, a demodulator 17 and a demultiplexer 18, as well as a switching device 19 for switching between streams of digital audio, video or data streams. In the illustrated embodiment, content data can also be retrieved from a mass storage device 20, representative of a class of devices that includes optical disk drives, hard disk drives, solid state storage devices, etc.
Video data is rendered in perceptible form by means of a display 21 and display driver 22. Audio data is rendered in perceptible form by an audio decoder 23 and output stage 24 for providing audio signals to a sound system (not shown). In the illustrated embodiment, an ambient system comprising an ambient output device 25 is integrated into the digital television 1 , which is also provided with the appropriate output stage 26 for providing a signal for adjusting an external device 27, e.g. an ambient lighting device. In an alternative embodiment, the ambient system is connected to a bus for home automation to control a variety of devices in the user's house. The integrated ambient output device 25 can be part of a system known as ambilight, comprising a series of Light Emitting Diodes arranged around a screen of the display 21, which change color and/or intensity in accordance with a script provided with the content, so as to match the content in terms of the mood conveyed.
The digital television 1 operates under the control of a central processing unit 28 having access to main memory 29 and arranged to execute software stored in nonvolatile memory 30.
Turning to Fig. 2, the user controls 6 on the remote control unit 2 allow the user to control the biofeedback functionality of the digital television 1 and remote control unit 2. This may be via dedicated keys on the remote control unit 2 or via general purpose keys that control a menu provided on-screen by the digital television 1. Thus, the user will activate (step 31) the biofeedback function using the user controls 6.
The remote control unit 2 will, at the latest at this stage, commence (step 32) obtaining measurement signals representative of the measurements of one or more physiological parameters of the user and/or one or more parameters associated with ambient conditions experienced by the user.
Subsequent to the first step 31, it is also determined (step 33) whether the digital television 1 can be used to process information corresponding to the measurement signals obtained by the remote control unit 2 for the purpose of converting it into appropriate feedback signals. In an embodiment, this determination 33 is carried out by the remote control unit 2, and can therefore comprise determining whether the digital television 1 is within range and/or switched on. In another embodiment, the digital television 1 determines whether its settings allow it to participate.
If the digital television 1 cannot be used, then the remote control unit 2 executes (step 34) a simple routine to determine locally the appropriate feedback to be provided. Using the information obtained in the preceding step 32, the measurement signals are converted into a feedback signal for local rendering in accordance with the predetermined, simple routine.
The routine may be stored in memory (not illustrated separately) or hard-wired into the data processing unit 14. It can be in the form of characteristics, using e.g. stored support values and an interpolation algorithm. The support values are based on empirically derived relations. The types of signals required to obtain a certain biological effect are known. Representative examples of the effects of such signals are given in the following three references, for example: Schein, M. et ah, "Treating hypertension with a device that slows and regularizes breathing: A randomized, double-blind controlled study", Journal of Human Hypertension, Ii, pp. 271-278;
Yucha, CB. et ah, "The Effect of Biofeedback in Hypertension", Applied Nursing Research, 14 (1), February 2001, pp. 29-35; and Lehrer, P. et al, "Respiratory Sinus Arrhythmia Biofeedback Therapy for
Asthma: A Report of 20 Unmedicated Pediatric Cases Using the Smetankin Method", Applied Psychophysiology and Biofeedback, 21 (3), September 2000, pp. 193-200(8).
Thus, as an example, the remote control unit 2 can be used for breathing exercises, using e.g. colored lights as the output device 13 to indicate whether the user's breathing is too fast or too slow.
The feedback is limited to that which can be provided using the output device 13 available locally to the remote control unit 2. It is further limited by the processing capacity of the data processing unit 14. On the other hand, using the local feedback facility, the user of the remote control unit 2 can obtain biofeedback without disturbing other persons present in the vicinity of the television 1. Indeed, the user can take the remote control unit 2 to another room, or at least out of range of the television 1.
If it is determined that the television 1 can be used for facilitating the provision of feedback, some or all of the steps illustrated in Fig. 3 are carried out. The remote control unit 2 carries out at least one of the steps in the process of converting measurement signals into rendered feedback signals in dependence on a signal received from the digital television 1. In the variant of Fig. 3, two such steps depend on a preceding signal from the digital television 1. In order to keep the power consumption of the remote control unit 2 low, the digital television 1 can poll (step 36) the remote control unit 2 for information corresponding to at least one measurement signal representative of a physiological parameter of the user and/or a parameter associated with ambient conditions as experienced by the user. In response, the remote control unit 2 returns (step 37) such information, which may be a pre- processed version of the measurement signals obtained from the sensor unit 9 and/or the internal sensor 7, or may correspond directly to the sample values. Therefore, the transmission of information corresponding to at least one measurement signal for processing by the digital television 1 is triggered by a signal received from the digital television 1. It is noted that this feature may be implemented in such a way that the preceding step 32 of obtaining sensor data, at least where data from the sensor unit 9 is concerned, is also carried out only upon receiving the polling signal. In any case, it will be clear that the process of converting the part of the measurement signals obtained in the preceding step 32 into feedback to be rendered subsequently is dependent on receiving a polling signal from the digital television 1. The digital television 1 receives the information corresponding to the measurement signals, and analyses (step 38) the information. This analysis 38 can be more processing-intensive than the corresponding step 34. For example, the digital television 1 may carry out averaging, digital filtering or frequency analysis on the signals received from the remote control unit 2. Using, e.g. a database 39 storing pre-determined relations between measurement signal values and feedback signals, the digital television 1 determines (step 40) the appropriate feedback.
Different types of feedback can be provided, and in different ways, a multitude of which are illustrated in Fig. 3. Other embodiments may employ different or fewer types than those illustrated. A first type of feedback uses the fact that the digital television 1 renders in perceptible form an output signal that is at least partly derived from an input signal that is independent of the measurement information received from the remote control unit 2. In particular, the digital television 1 renders in perceptible form the audio-visual signals obtained using the tuner 16, demodulator 17 and demultiplexer 18, or audio-visual signals stored on the mass storage device 20, e.g. a DVD in an optical disk drive. Depending on the values of the measurement signals, the digital television 1 modifies its selection of content from the content available in the input signal and/or edits the selected content (step 41). For example, a program carried in MPEG-2 elementary streams may comprise several variants, carried in separate elementary streams and identified in the Programme Map Table associated with these streams. The digital television 1 can select the appropriate elementary streams based on the values of the measurement signals it has received. For example, if the measurement signals demonstrate that the user has a high pulse rate or is otherwise very agitated, the digital television 1 can select a less violent or less gory version of a horror movie played back from disk. Alternatively, it can edit the video signal by removing scenes of certain color. In another example, e.g. where the viewer is known to suffer from certain afflictions (e.g. migraine), biological measurements can be used to edit the video signal in an appropriate manner.
Secondly, the digital television 1 can automatically adjust its settings, e.g. the amplification settings for the audio component of audiovisual signals and/or the brightness values of the video component, in dependence on the information based on the measurement signals and received from the remote control unit 2.
In the illustrated embodiment, the digital television 1 comprises an ambient system, a system to generate perceptible effects corresponding at least partly to the content being rendered. In this case, the perceptible effects are adapted also in dependence on the measurement signals obtained by the remote control unit 2. For example, lighting may change to a less aggressive color or lower intensity if the user is determined to be agitated. Alternatively, the lighting may start to flash, increase in intensity or adjust to a primary color if it is determined that the use is less alert. Finally, the remote control unit 2 is employed to render at least one of the feedback signals provided by the digital television 1 in perceptible form. The digital television 1 transmits (step 44) a control signal corresponding to the feedback signal to the remote control unit 2. The latter receives (step 45) the signal and proceeds to cause (step 46) the output device 13 to render the feedback signal in a form perceptible by the user. It will be appreciated that this step 46, like the first step 37 is thus carried out in dependence on a signal received from the digital television 1. The remote control unit 2 can thus provide feedback perceptible primarily by the user thereof. Because the feedback is determined predominantly by the digital television 1 with its advanced data processing capacity, the feedback can depend in a quite elaborate way on the measured values of biological signals. Fig. 4 illustrates a further variant, suitable for use in a multi-user environment. A first remote control unit 47 corresponds to the remote control unit 2 described in detail hereinbefore. It thus comprises both user controls 48 and an output device 49. Further portable units 50-52 comprise a sensor and/or sensor interface (not shown) for obtaining at least one measurement signal representative of at least one measurement of a physiological parameter of its respective user and/or a parameter associated with ambient conditions experienced by the respective user. However, these portable units 50-52 comprise only a respective output device 53-55. Each transmits information based on measurement signals obtained by it to the digital television 56 or other remote system for processing. This may be done in response to a polling signal.
The digital television 56 calculates the appropriate values of feedback signals. Feedback can be rendered in perceptible form using e.g. an ambient lighting device 57 comprised in the digital television 56. Feedback signals are also transmitted to the first remote control unit 47 for rendering in perceptible form, as well as to the individual portable units 50-52. It is appropriate to transmit to the portable units 50-52 respective feedback signals based only on measurement information received from them individually, and to transmit to the first remote control unit 47 a feedback signal based on measurement signals received from at least one of the portable units 50,51,52. Thus, the first remote control unit 47 can be used for instance by a teacher, and the other portable units 50,51,52 by his or her pupils.
Alternatively, the portable units 50-52 can be provided with limited user controls, allowing them to connect to selected ones of the other portable units 50-52 and/or the first remote control unit 47 so as to receive the feedback signal based on that unit's measurements from the digital television 56. Optionally, the user may select to receive feedback based on the physical state of the users collectively. This feature can be used to ascertain the mood in the room or the mood of another person in the room (without having to ask them).
It should be noted that the above-mentioned embodiments illustrate, rather than limit, the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps other than those listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
For example, instead of automatically modifying or adapting the selection of content data, the digital television 1 can be used to suggest TV content to a user based on his current physiological state, or to restrict access to users that are in certain physiological states. It can also be used to assess the age of the user and restrict content based on this inference, e.g. using heuristics to infer the user's age from biological data.

Claims

CLAIMS:
1. Method of providing feedback related to a user's physical state using a portable unit (2;47,50-52) for carrying on the user and capable of communicating with a remote system (1;56), which method includes: obtaining at least one measurement signal representative of at least one measurement of one of a physiological parameter of the user and a parameter associated with ambient conditions experienced by the user transmitting information corresponding to the at least one measurement signal to the remote system (1;56) for processing by the system, and enabling at least one feedback signal based on the transmitted information to be rendered in a form perceptible to the user, wherein at least a part of the process of converting the at least one measurement signal into a rendered feedback signal is carried out by the portable unit (2,47;50-52) in dependence on a signal received from the remote system (1;56).
2. Method according to claim 1, wherein the portable unit (2;47) comprises a remote control unit, including transmitting control signals for controlling at least part of the functionality of the remote system (1;56) in response to manipulation by the user.
3. Method according to claim 1, including receiving at least one feedback signal transmitted to the portable unit (2;47,50-52) from the remote system, and causing the feedback signal to be rendered in a form perceptible by the user.
4. Method according to claim 1, wherein transmission of information corresponding to the at least one measurement signal to the remote system (1;56) for processing by the system is triggered by a signal received from the remote system (1;56).
5. Method according to claim 2, wherein the remote system (1;56) includes functionality independent of the processing of the information corresponding to the at least one measurement signal, which functionality is at least partly controlled by the remote control unit (2;47).
6. Method according to claim 1, wherein the remote system (1;56) renders in perceptible form an output signal at least partly derived from an input signal independent of the at least one measurement signal.
7. Method according to claim 6, wherein the remote system (1;56) modifies the output signal in dependence on the information corresponding to the at least one measurement signal.
8. Method according to claim 1, wherein the remote system (1;56) comprises an ambient system (25-27;57), wherein the ambient system (25-27;57) is adjusted at least partly in accordance with the information corresponding to the at least one measurement signal.
9. Method according to claim 1, wherein the information is transmitted to a remote system (1;56) arranged to process information received from at least one further portable unit (50-52) and corresponding to at least one measurement signal representative of at least one measurement of one of a physiological parameter of a user of the portable unit (50-52) concerned and a parameter associated with ambient conditions experienced by the user of the portable unit (50-52) concerned.
10. Portable device for carrying on a user, capable of communication with a remote system (50-52) and including: an arrangement (7,8) for obtaining at least one measurement signal representative of at least one measurement of one of a physiological parameter of the user and a parameter associated with ambient conditions experienced by the user; and a transceiver arrangement (3) for two-way communication with the remote system (50-52), wherein the portable device is arranged to transmit information corresponding to the at least one measurement signal to the remote system (50-52), for processing by the system (50-52), and to carry out at least a part of a process of converting the at least one measurement signal into a feedback signal rendered in a form perceptible to a user in dependence on a signal received from the remote system (50-52).
11. Portable device according to claim 10, configured to execute a method according to any one of claims 1-9.
12. System for processing information corresponding to at least one measurement signal representative of at least one measurement of one of a physiological parameter of a user of a remote portable unit (2;47,50-52) for carrying on a user and a parameter associated with ambient conditions experienced by the user of the remote portable unit (2;47,50-52), which system includes: a transceiver arrangement (4) for receiving the information corresponding to the at least one measurement signal from the remote portable unit (2;47,50-52), and for providing a control signal causing the remote portable unit (2;47,50-52) to carry out at least a part of a process of converting the at least one measurement signal into a feedback signal rendered in a form perceptible to a user.
13. System according to claim 12, configured to function as the remote system (50-52) in a method according to any one of claims 1-9.
14. Computer program including a set of instructions capable, when incorporated in a machine-readable medium, of causing a system having information processing capabilities to perform a method according to any one of claims 1-9 or to provide the system with the functionality of a system according to claim 12 or 13.
PCT/IB2009/053598 2008-08-20 2009-08-14 Method, portable device and system for providing feedback related to a user's physical state WO2010020924A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP08162679 2008-08-20
EP08162679.8 2008-08-20

Publications (1)

Publication Number Publication Date
WO2010020924A1 true WO2010020924A1 (en) 2010-02-25

Family

ID=41264242

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2009/053598 WO2010020924A1 (en) 2008-08-20 2009-08-14 Method, portable device and system for providing feedback related to a user's physical state

Country Status (1)

Country Link
WO (1) WO2010020924A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ITNA20100037A1 (en) * 2010-07-27 2012-01-28 Contact Tecnologie Spa METHOD AND EQUIPMENT FOR BIOMEDICAL AND ENVIRONMENTAL MONITORING WITH INTEGRATED VIDEO COMMUNICATION AND TELEALLARME
EP2429183A1 (en) * 2010-09-08 2012-03-14 Nagravision S.A. Remote control with sensor
NL1039294C2 (en) * 2012-01-17 2013-07-18 Stichting Heartlive METHOD FOR FEEDBACK INFORMATION VIA A SCREEN.
EP2646992A4 (en) * 2010-11-30 2013-10-09 Universal Electronics Inc System and method for non-intrusive health monitoring in the home
EP2723089A1 (en) * 2012-10-19 2014-04-23 Samsung Electronics Co., Ltd Apparatus and method of controlling display device
US20150228245A1 (en) * 2014-02-10 2015-08-13 Samsung Electronics Co., Ltd. Display apparatus and control method thereof
US11257573B2 (en) 2017-08-16 2022-02-22 Disney Enterprises, Inc. System for adjusting an audio/visual device based on health and wellness data

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030126593A1 (en) * 2002-11-04 2003-07-03 Mault James R. Interactive physiological monitoring system
US20050154264A1 (en) * 2004-01-08 2005-07-14 International Business Machines Corporation Personal stress level monitor and systems and methods for using same
WO2006003604A1 (en) * 2004-06-30 2006-01-12 Koninklijke Philips Electronics, N.V. Active frame system for ambient lighting using a video display as a signal s0urce
EP1686804A1 (en) * 2005-01-26 2006-08-02 Alcatel Predictor of multimedia system user behavior

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030126593A1 (en) * 2002-11-04 2003-07-03 Mault James R. Interactive physiological monitoring system
US20050154264A1 (en) * 2004-01-08 2005-07-14 International Business Machines Corporation Personal stress level monitor and systems and methods for using same
WO2006003604A1 (en) * 2004-06-30 2006-01-12 Koninklijke Philips Electronics, N.V. Active frame system for ambient lighting using a video display as a signal s0urce
EP1686804A1 (en) * 2005-01-26 2006-08-02 Alcatel Predictor of multimedia system user behavior

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ITNA20100037A1 (en) * 2010-07-27 2012-01-28 Contact Tecnologie Spa METHOD AND EQUIPMENT FOR BIOMEDICAL AND ENVIRONMENTAL MONITORING WITH INTEGRATED VIDEO COMMUNICATION AND TELEALLARME
EP2429183A1 (en) * 2010-09-08 2012-03-14 Nagravision S.A. Remote control with sensor
EP2646992A4 (en) * 2010-11-30 2013-10-09 Universal Electronics Inc System and method for non-intrusive health monitoring in the home
EP2646992A2 (en) * 2010-11-30 2013-10-09 Universal Electronics Inc. System and method for non-intrusive health monitoring in the home
US11931184B2 (en) 2010-11-30 2024-03-19 Universal Electronics Inc. System and method for non-intrusive health monitoring in the home
US11197638B2 (en) 2010-11-30 2021-12-14 Universal Electronics Inc. System and method for non-intrusive health monitoring in the home
US8905927B2 (en) 2010-11-30 2014-12-09 Universal Electronics Inc. System and method for non-intrusive health monitoring in the home
US10357202B2 (en) 2010-11-30 2019-07-23 Universal Electronics Inc. System and method for non-intrusive health monitoring in the home
NL1039294C2 (en) * 2012-01-17 2013-07-18 Stichting Heartlive METHOD FOR FEEDBACK INFORMATION VIA A SCREEN.
CN103826146B (en) * 2012-10-19 2019-03-08 三星电子株式会社 Show the remote control equipment and its method of equipment, control display equipment
RU2614519C2 (en) * 2012-10-19 2017-03-28 Самсунг Электроникс Ко., Лтд. Display device, remote control device to control display device, method of display device controlling, method of server controlling and remote control device controlling method
US9769413B2 (en) 2012-10-19 2017-09-19 Samsung Electronics Co., Ltd. Display device, remote control device to control display device, method of controlling display device, method of controlling server and method of controlling remote control device
US9210359B2 (en) 2012-10-19 2015-12-08 Samsung Electronics Co., Ltd. Display device, remote control device to control display device, method of controlling display device, method of controlling server and method of controlling remote control device
JP2019083564A (en) * 2012-10-19 2019-05-30 三星電子株式会社Samsung Electronics Co.,Ltd. Display device, remote control device for controlling display device, method of controlling display device, method of controlling server, and method of controlling remote control device
CN103826146A (en) * 2012-10-19 2014-05-28 三星电子株式会社 Display device, remote control device to control display device, method of controlling display device
EP2723089A1 (en) * 2012-10-19 2014-04-23 Samsung Electronics Co., Ltd Apparatus and method of controlling display device
US20150228245A1 (en) * 2014-02-10 2015-08-13 Samsung Electronics Co., Ltd. Display apparatus and control method thereof
US11257573B2 (en) 2017-08-16 2022-02-22 Disney Enterprises, Inc. System for adjusting an audio/visual device based on health and wellness data

Similar Documents

Publication Publication Date Title
US11676483B2 (en) System and method for facilitating appliance control via a smart device
WO2010020924A1 (en) Method, portable device and system for providing feedback related to a user's physical state
KR102516111B1 (en) Server and controlling user environment method of electronic device using electronic device and at least one smart device
US8633808B2 (en) Systems, methods and apparatus for locating a lost remote control
US20200177408A1 (en) System and method of controlling external apparatus connected with device
US9566410B2 (en) Sleep aid system and operation method thereof
EP1680729B1 (en) Method for saving and recalling state data for media and home appliances
ES2561035T3 (en) Web browser based remote control for programmable multimedia controller
JP5490415B2 (en) USB compatible audio / video switch
US9911321B2 (en) Simplified adaptable controller
US8808180B2 (en) Patient monitor having entertainment functions and control method thereof
EP2757797A1 (en) Electronic apparatus and method of controlling the same
US20060190559A1 (en) Multimedia contents moving method and system
WO2011071460A1 (en) System and method for adjusting presentation characteristics of audio/video content in response to detection of user sleeping patterns
CN102811658A (en) a system and a method for controlling an environmental physical characteristic, a computer program product, a color and intensity tunable lamp and an electronic device
TWI827825B (en) System and method to view occupant status and manage devices of building
CN108853679A (en) Intelligence, which helps, sleeps device and method thereof, server and system
WO2018078904A1 (en) Light output system
US20180369689A1 (en) Controller, input and output apparatus, and communication system
US20140248033A1 (en) Environment Control Device and Video/Audio Player
WO2019207900A1 (en) Information processing device and information processing method
US7717842B2 (en) Apparatus and method for generating pulsating noise in audio device
CN109326291A (en) Television mode control method, TV and storage medium
JP2013110527A (en) Remote control device, electronic apparatus, television receiver, control method, program, and recording medium
JP2009088627A (en) Viewing and listening device, parameter management means, viewing and listening system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09786943

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09786943

Country of ref document: EP

Kind code of ref document: A1