WO2004036338A2 - Context acquisition based on load sensing - Google Patents
Context acquisition based on load sensing Download PDFInfo
- Publication number
- WO2004036338A2 WO2004036338A2 PCT/IB2003/006461 IB0306461W WO2004036338A2 WO 2004036338 A2 WO2004036338 A2 WO 2004036338A2 IB 0306461 W IB0306461 W IB 0306461W WO 2004036338 A2 WO2004036338 A2 WO 2004036338A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- force
- information
- center
- computing
- sensors
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
Definitions
- This description relates to context acquisition based on load sensing.
- Load sensing includes measuring the force or pressure applied to a surface. It is widely used to measure the weight of goods, to monitor the strain on structures, and to gauge filling levels of containers.
- Load sensing has also been used, to a limited degree, to capture contextual information, such as identity and location of people and objects, and the detection of activity.
- segmented surfaces composed of load-sensitive tiles have been used to identify and track people.
- a grid of piezoelectric wires under a carpet has been used to track the movement of people in artistic performances.
- object identification by temporarily linking a virtual object with a physical item placed on a load sensitive surface which has embedded high precision scales. The link is maintained by reference to the weight of the physical item.
- a common approach to capturing contextual information is through the use of location sensing. For example, computer vision has been used to identify the location of people, and to detect their activity. This location information may then be provided as contextual information to another information processing system.
- force information is sensed at a plurality of points on a substantially continuous surface, the force information related to an object on the surface.
- a distribution of force exerted by the object, relative to the surface, is calculated based on the force information, and a location of the object on the surface is determined, based on the distribution of force.
- Implementations may have one or more of the following features. For example, in computing the center of force, a total force applied to the surface by the object may be computed, and a center of force of the object on the surface may be computed.
- a first component of the center of force may be determined by computing a first quotient of a first sum and a total force applied to the surface by the object, the first sum obtained by summing a first force applied at a first point and a second force applied at a second point, and a second component of the center of pressure, perpendicular to the first component, may be determined by computing a second quotient of a second sum and the total force, the second sum being obtained by summing the first force applied at the first point and a third force applied at a third point.
- the first and second components of the center of force of the object may be computed at a first period of time
- the first and second components of the center of force of the object may be computed at a second period of time
- a new location of the object on the surface may be detected, based on a change in the first and second components from the first period to the second period.
- a variation in the force information may be sensed, and a change in the location of the object, relative to the surface, may be detected based on the variation in the force information.
- the force information may be sensed at a later period of time, and a second location of a second object on the surface may be detected, based on the force information.
- a first component of the center of force may be determined by computing a first quotient of a first sum and a total force applied to the surface by the object, the first sum obtained by summing a first force applied at a first point and a second force applied at a second point, and a second component of the center of pressure, perpendicular to the first component, may be determined by computing a second quotient of a second sum and the total force, the second sum being obtained by summing the first force applied at the first point and a third force applied at a third point.
- the object may be identified as a person, and a position of the person may be tracked.
- the second object may be identified as a possession of the person, an absence of the person on the surface may be detected, and the person may be alerted that the second object has been left behind.
- the first and second objects may be identified as people, and a center of activity of the people may be tracked.
- a voltage level at a plurality of load cells may be measured, each of the load cells corresponding to each of the plurality of points. In this case, the force applied by the surface to the load cells may be compensated.
- a system includes a plurality of sensors below different points on a substantially continuous surface, the sensors operable to sense force information, and a processor connected to the sensors and operable to determine contextual information about a first object on the surface, based on the force information.
- Implementations may have one or more of the following features.
- a location determination module operable to determine a center of force of the object may be included.
- the location determination module may be operable to determine a change in a first location of the object relative to the surface.
- the location determination module may be operable to determine a second location of a second object .
- An interaction characterizer module for characterizing an interaction of the object with the surface may be included, where the interaction characterizer identifies a change in the number of objects on the surface. Also, a visualizer that is operable to generate visual representations of the force information may be included.
- the sensors may include four load sensors in a rectangular configuration.
- the surface may include a table or a shelf, and a personal computer may be connected to the processor.
- a second plurality of sensors may be included below different points on a second surface, a second processor connected to the second plurality of sensors, and a personal computer connected to the processor and second processor.
- sampling force information is sampled at points on a continuous surface during a plurality of time intervals, and an interaction is identified between an object and the surface based on the sampled information.
- Implementations may have one or more of the following features. For example, an average force on the surface during each of the time intervals may be computed. A variability in the force on the surface may be computed during each of the time intervals.
- a first average weight during a starting interval may be compared to a second average weight during an ending interval, a first variability during the starting interval may be determined to meet or exceed a variability threshold value, a second variability during the ending interval may be compared to a third variability during an intermediate interval, between the starting and ending intervals, and a change in a number of objects on the surface may be identified, based on the first and second average weights, and the first second, and third variabilities.
- a difference between the first average weight and the second average weight may be compared to an average weight threshold.
- FIG. 1 is a flow chart illustrating techniques for determining object location.
- FIG 2 is a diagram of a load sensing surface.
- FIG. 3 is a block diagram of a system for sensing position and interaction information.
- FIG. 4 is a block diagram of a data packet.
- FIG. 5 is a block diagram of a load sensing system.
- FIG. 6 is a flow chart of a method of determining object location.
- FIG 7 is a flow chart of a method of determining object location..
- FIG. 8 is a flow chart of a method of determining interaction information.
- FIG. 9 is a flow chart of a method of determining interaction information.
- FIG. 10 is a graph of interaction information with respect to time.
- FIG. 11 is a diagram of a room with load sensing surfaces.
- FIG 12 is a diagram of a system for processing information from multiple load sensing surfaces.
- FIG. 1 is a flowchart illustrating an overview of techniques for determining a location of an object on a single continuous surface.
- the object exerts a force or pressure on the surface (102).
- the pressure may be measured, using one or more of various types of sensors, at a plurality of points on the surface (104).
- the location of the object may then be determined based on the pressure information sensed by the sensors (106).
- FIG. 2 shows a rectangular surface 20 having four load sensors 22, 24, 26, 28 which sense the force or pressure exerted on them by one or more objects placed on the surface 20, in accordance with the techniques of FIG. 1 (102, 104).
- the load sensors 22, 24, 26, 28 are placed at, or beneath, the four corners of the rectangular surface 20.
- Each load sensor generates a pressure signal indicating the amount of pressure exerted on it.
- the pressure signals may be sent to a processor 30, such as a microcontroller or a personal computer, which analyzes the signals.
- the surface 20 may be, for example, a table top, and the sensors 22, 24, 26, 28 may be, for example, industrial load sensors, such as may detect forces up to 500N.
- each sensor is operable to emit a voltage signal that is linearly dependant on the amount of force applied to it.
- the sensors 22, 24, 26, 28 measure the distribution of force on the surface 20.
- an object 42 is shown placed on the surface 20. If the object is placed in a center 44 of the surface 20, the pressure at each of the corners of the surface will be the same. The sensors will then sense equal pressures at each of the comers. If, as FIG. 2 shows, the object 42 is located away from the center 44, closer to some comers than others, the pressure on the surface will be distributed unequally among the comers and the sensors will sense different pressures. For example, in FIG. 2, the object 42 is located closer to an edge of the surface including sensors 22 and 28 than to an edge including sensors 24 and 26. Likewise, the object is located closer to an edge including sensors 26 and 28 than to an edge including sensors 22 and 24. The processor 30 may thus evaluate the pressures at each of the sensors 22, 24, 26, 28 to determine the location of the object 42.
- the surface 20 may represent a floor in a room, and the object 42 may represent a person moving about on the floor. In this way, movements of the person may be tracked relative to other persons and items in the room.
- the surface 20 also may represent a table or shelf on which various items, such as computers and books, may be set. In this way, such items may be tracked for, for example, security purposes.
- multiple sets of the surface, sensors, and processors may be tracked at once, so as to analyze interactions between people and objects and the various surfaces.
- Each sensor 22, 24, 26, 28 outputs an analog signal that is converted to a digital signal by, for example a standard 16-bit analog to digital converter (ADC) 34.
- the ADC 34 links to a serial line of a personal computer (PC) 38.
- the sensors 22, 24, 26, 28 are powered with ION, and emit signals ranging from 0 to 40mV.
- the signals may be amplified by amplifiers 40 to, for example 0 to 2.5N, before being sampled by the ADC 34.
- the ADC 34 may be configured to sample at a low sampling frequency, for example 4 times per second.
- each sensor 22, 24, 26, 28 senses the force applied to it and generates a voltage signal that is proportional to that force, whereupon each signal is amplified by a discrete amplifier forming part of block 40 and sampled by the ADC 34, and the sampled signal is communicated to the processor 30 for processing.
- the industrial load cells 22, 24, 26, 28 used to sense position and interaction information may use resistive technology, such as a wheat stone bridge that provides a maximum output signal of 20m V at a driving voltage of 5V.
- the signals may be amplified by a factor of 220, to an output range of 0 to 4.4V, using LM324 amplifiers 40.
- instrumentation amplifiers such as an I ⁇ A118 from Analog Devices maybe used.
- Each amplified signal may be converted into a 10-bit sample at 250 Hz by the ADC 34, which may be included in the processor 30.
- the ADC 34 may be a higher resolution external 16-bit ADC, such as the ADS8320.
- a multiplexer 46 may be used to interface several sensors 22, 24, 26, 28 with a single ADC 34.
- the processor 30 may identify the location of objects, or detect events, and send location and event information to the PC 38.
- a memory 48 such as a FM24C64 FRAM chip from Ramtron, may be used to store history information.
- the location and event information may be sent using serial communication technology, such as, for example, RS-232 technology 50, or wireless technology, such as a RF transceiver 52.
- the RF transceiver 52 may be a Radiometrix BIM2 that offers data rates of up to 64kbits/s. The information may be transmitted at lower rates as well, for example 19,200 bits/s.
- the RF transceiver 52 may, alternately, use Bluetooth technology.
- the event information may be sent as data packets.
- FIG. 4 shows a data packet 54, which includes a preamble 56, a start- byte 58, a surface identifier 60, a type of event identified 62, and other event-dependent data 64.
- the surface identifier 60 indicates the identity of the surface on which the event information was generated, from among multiple surfaces being tracked.
- the processor 30 may be configured with parameters such as the size of the surface, a sampling rate, and the surface identifier 60.
- the PC 38 may send the configuration information to the processor 30 using, for example, the serial communication device 50 or 52.
- the configuration information may be stored in a processor memory associated with the processor 30.
- a location determiner which may be a location determiner software module 66, may be used to calculate the pressure on the surface 20, based on information from the sensors 22, 24, 26, 28.
- the location determiner 66 may include, for example, a Visual Basic program that reads periodically from the ADC 34 and calculates the center of pressure exerted by the object 42.
- the Visual Basic program also may be configured to visualize the result, as discussed in more detail with respect to FIG. 10.
- FIG. 6 shows a method of determining the location of an object 42 using the location determiner 66.
- the pressure is measured at each of the sensors 22, 24, 26, 28 (602).
- the pressure at each sensor may be represented as F 22 , F 24 , F 26 , and F 8 .
- the location determiner may be a location determiner software module 66.
- the location determiner 66 calculates the total pressure on the surface 20 (604) and determines directional components of the location of the object 42. For example, the location determiner 66 may determine that a component of the location of the object 42 that is parallel to the edge of the surface that includes sensors 26 and 28 (the x-component) (606), as well as a component of the location perpendicular to the x- component and parallel to the edge of the surface including sensors 24 and 26 (the y- component) (608). The center of pressure of the object 42 is determined as the point on the surface identified by an x-coordinate and a y-coordinate of the location of the object.
- the position of sensor 22 may be represented by the coordinates (0 , 0)
- the position of sensor 24 may be represented by the coordinates (x max , 0)
- position of sensor 26 may be represented by the coordinates (x ma , y max ) >
- the position of sensor 28 may be represented by the coordinates (0 , y max ), where x max and y max are the maximum values for the x and y coordinates (for example the length and width of the surface 20).
- the position of the center of pressure of the object 42 may be represented by the coordinates (x,y).
- FIG. 7 shows a more detailed method of determining the location of the object 42. Specifically, the total pressure on the surface (F x ) is computed by measuring pressure at each of the sensors 22, 24, 26, and 28 (702), and then summing the pressures measured at each of the sensors 22, 24, 26, 28 (704):
- the y- coordinate (y) of the center of pressure may be determined by first summing the pressure measured at sensors located along an edge parallel to the x-component (for example sensors 26 and 28) (710). The sum may then be divided by the total pressure on the surface to determine the y- coordinate of the center of pressure of the object (712):
- the surface 20 itself may exert a pressure, possibly unevenly, on the sensors 22, 24, 26, 28.
- a second object 68 already present on the surface 20, may exert a pressure, possibly unevenly, on the sensors. Nonetheless, the location determiner
- 66 may still calculate the location of the first object 42 by taking into account the distribution of pressure existing on the surface 20 (or contributed by the surface 20) prior to the placement of the first object 42 on the surface 20. For example, pre-load values at each of the sensors 22, 24, 26, 28 may be measured and the total pressure (F0 X ) on the surface 20 prior to placement of the first object 42 may be determined by summing the pre-load values (F0 22 , F0 24 , F0 26 , F0 28 ) at each of the sensors 22, 24, 26, 28:
- E0_ E0 22 +E0 24 +E0 26 +E0 28
- An object tracker 70 processes information from the location determiner 66. Specifically, the object tracker 70 tracks the movement of the object 42 by determining its location at different points in time.
- the object tracker 70 may be, for example, a software module controlled by the processor 30. Alternatively, it may be a software module controlled by the PC 38 that interfaces with the processor 30.
- the object tracker 70 may store a history of the location of the object with respect to time, using information from the location determiner 66 and the memory 48. In addition to position information, interactions or events between the object and the surface also may be determined. For example, the object 42 may be placed on the surface 20, or removed from the surface 20, or, if resting in an upright position on the surface 20, it may be knocked down.
- each sensor may be an industrial load cell that may handle a maximum of 20N.
- the voltage signals from the sensors may be amplified using the amplifiers 40 to a generate signals in the range of 0 to 4.4V.
- An interaction analyzer 72 shown in FIG. 5, may process interaction information from the sensors 22, 24, 26, 28.
- the interaction analyzer 72 may include a software module controlled by the processor 30.
- FIG. 8 shows a method of determining interaction information using the interaction analyzer 72. The total pressure on the surface is sampled and measured during several intervals that are defined by an occurrence of an event.
- the total pressure on the surface may be sampled during a first interval before the event (802), during an intermediate interval (804), in which the event takes place, and during an ending interval (806), after the event has taken place.
- the intervals may be part of a sliding window of time that incrementally moves forward over time.
- the sliding window may be, for example, a 500ms sliding window, where a first window is a period of time from 0ms to 500ms, a second window is a period of time from lms to 501ms, and so on.
- the final 500ms of the sliding window may be sampled at a frequency chosen to generate 125 sampling points.
- the starting interval may be the first 25 sampling points
- the intermediate interval may be the next 75 sampling points
- the ending interval may be the final 25 sampling points.
- the interaction analyzer 72 may compute characteristics of the load on the surface during each of the intervals. For example, the interaction analyzer 72 may compute the average total pressure on the surface 20 during each interval (steps 808, 810, 812). The interaction analyzer 72 may then compute a change value for each interval, representing how the total pressure on the surface 20 changes during each interval (steps 814, 816, 818). By comparing the characteristics of these intervals to each other, the interaction analyzer 72 may be operable to characterize the event.
- the average total pressure on the surface during each interval may be computed as follows (808, 810, 812):
- the change values for each interval may be computed as follows (814, 816, 818):
- FIG. 9 shows a method of characterizing an interaction or event.
- the average total pressure values and change values are computed as above (902).
- the interaction analyzer 72 may characterize the event, for example as a placement of an object on the surface (steps 904, 906, 908, 910), a removal of an object from the surface (steps 912, 914, 916, 918), or as a knocking over of an object on the surface (steps 920, 922, 924, 926, 928).
- An event that includes placing an object on the surface may be characterized by an increase in the average total pressure.
- the interaction analyzer may compare the starting and ending average total pressures by determining whether the average total ending pressure exceeds the average total starting pressure by a threshold value ⁇ (904): A s + 5 ⁇ A e
- the threshold value ⁇ may be chosen based on properties of the system components chosen, for example properties of the sensors 22, 24, 26, 28 (e.g. the maximum pressure and the sensor resolution) and the ADC 34 (e.g. the ADC resolution).
- the interaction analyzer module 72 determines that the average total pressure on the surface before the event was stable, by determining that the change value D s is close to zero (906).
- the interaction module 72 may compare D s to a small threshold value ⁇ and determine that D s ⁇ ⁇ .
- the threshold value ⁇ may be chosen based on properties of the system components.
- the interaction analyzer module 72 also may determine that the change in average total pressure is greater during the interval when an object is placed on the surface than in the ending interval, when the total pressure has stabilized (D m > D e ) (908). Thus the interaction analyzer module 72 may determine that an object has been placed on the surface 20 if the average total pressure on the surface 20 was stable in the starting interval, experienced a change in the intermediate interval, and stabilized at a higher average total pressure in the ending interval. Similarly, the interaction analyzer 72 may determine that an object has been removed from the surface.
- the average total pressure during the ending interval is determined to be less than during the starting interval (A s > A e + ⁇ ) (912); the average total pressure is determined to be stable in the starting interval (D s ⁇ ⁇ ) (914); and the average total pressure experiences a change in the intermediate interval and stabilizes in the ending interval (D m > D e ) (916).
- the interaction analyzer 72 also may determine that an object has been knocked over on the surface. Specifically, the interaction analyzer 72 may determine that the average total pressure does not change, since an object has not been added or removed from the surface (
- the threshold value ⁇ may be chosen based on properties of the system components, so as to avoid registering incidental or background measurements that do not correpond to actual object movement(s).
- a visualization may be created by the PC 38 to display events, perhaps using the location determiner 66 of FIG. 5.
- the visualization includes a graph 74 comparing the force measured with respect to time. For example, the graph 74 shows that an object is placed on the surface at time El, an object is knocked over on the surface at time
- the PC 38 also may create text messages, sounds, or voice messages that describe events on the surface 20.
- Contextual information such as position and interaction information may be used to characterize the behavior of a human in an environment.
- the environment may be a room 76
- the surface 20 may be the floor of the room 76, on which chairs 78, 80 and a coffee table 82 are placed.
- the floor surface 20 may be implemented as a position and interaction sensing floor.
- the floor 20 may be a wooden surface resting on four load cells 22, 24, 26, 28 (as shown in FIG.s 2 and 3).
- the load cells are positioned under the four comers of the surface 20.
- the load cells may be chosen based on the anticipated weight that will be applied to the surface. For example, S- load cells, each with a capacity of 1000N, may be chosen if a total load of 280kg is anticipated.
- the load cells may be connected to the processor " 3(5, which ' may be connected to the PC 38.
- the force, and the location of the force, applied to the floor 20 by the stationary objects may be measured and stored as the pre-load values F0], F0 2 , F0 , F0 4 , when the force applied to the floor 20 is determined to be stable.
- the interaction analyzer 72 may determine that the floor 20 is stable when the change value of the average pressure applied to the floor 20 is less than a threshold value. For example, when the D s , D m , and D e values are close to zero for more than 5 seconds, the pressure applied to the floor may be considered stable, and the pre-load values may be stored.
- a person 84 enters the room represented on FIG.
- the location determiner 66 calculates the center of pressure of the person 84, in terms of x and y coordinates, taking into account the pre-load values measured by the sensors 22, 24, 26, 28. As the person 84 walks about the room, changing location, the location determiner 66 periodically recalculates the center of pressure of the person 84.
- the interaction analyzer 72 may determine that the person 84 is changing position when one of the D s , D m , and D e values are above a threshold.
- the object tracker 70 tracks the position of the person 84 with information from the location determiner 66. Additionally, the location determiner 66 may compare the location of the person 84 to other objects in the room. For example, if the person 84 sits in chair 78, the location of the person's center of pressure will be the same as the location stored for the chair 78. Entry or exit from the room may be similarly identified. The location of the person with respect to time may be stored and analyzed. For example, the total distance the person 84 traveled during a period time may be determined, or the overall activity in the room may be estimated. Other surfaces, for example the coffee table 82, also may be configured to sense location and interaction information.
- the coffee table may be equipped with sensors that may be chosen based on the anticipated force that will be applied to the surface.
- the coffee table 82 may be configured to measure a maximum load of 8kg, which is appropriate for measuring items such as newspapers, magazines, and cups, which would normally be put on a coffee table.
- a dining room table may be configured with sensors that measure a maximum capacity of 500N each, resulting in an overall capacity of 200kg.
- surfaces that may be configured to sense location and interaction information include shelves and boards that may hang on a wall. More than one surface may be used simultaneously to sense location and interaction information.
- FIG. 12 shows multiple surfaces, each including sensors and a processor, interfacing with the PC 38.
- the surfaces may interface with the PC 38 using, for example, RS-232 or RF transceiver technology 90.
- a surface manager 92 such as a software module controlled by the PC 38, analyzes position and interaction information from the surfaces 76.
- the surface manager may identify the source surface for information received based on surface identifiers 60 included in the data packets 54 sent by the surfaces 76. Position and event information is also included in the data packets. 54
- the surface manager 92 may analyze the information from the multiple surfaces 76 and generate a response. For example, a person may be alerted that they have left an item behind in a room. As shown in FIG. 1 1, the surfaces may include the floor 20 and the coffee table 82. The person 84, carrying for example a book, may be tracked as she walks across the room 76 on the floor surface 20. Position and interaction information are sent by the floor surface 20 to the surface manager 92. When she sets the book on the coffee table 82, the coffee table 82 detects the event of placing the book on the table, and sends this position and interaction information to the surface manager 92. When the person 84 begins to exit the room 76, the surface manager 92 may interpret information from both surfaces 20, 82 (i.e.
- the coffee table surface 82 still senses the presence of the book, and the floor surface 20 senses the reduction in pressure indicating the absence of the person 84) and determine that the book has been left behind.
- the surface manager 92 may then trigger an alert, such as the sounding of an alarm, or an announcement of a message. It is also possible to record and compare the weight of the person 84 as she enters the room to the weight of the person 84 as she leaves the room to determine if an object has been left behind.
- the position and interactions of a person or persons with load sensing surfaces may be tracked for long periods of time to determine patterns. For example, activities such as drinking coffee, having lunch, reading the newspaper, or working, may be studied by tracking the person's relationship to the surface.
- the surfaces in a room such as the floor 20 and coffee table 82 of FIG. 1 1, collect and send positional and interaction information to the PC 38, where it is stored and analyzed.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Force Measurement Appropriate To Specific Purposes (AREA)
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE60317694T DE60317694T2 (en) | 2002-09-30 | 2003-09-30 | LOAD MEASUREMENT BASED CONTEXULATION |
EP03799733A EP1546854B1 (en) | 2002-09-30 | 2003-09-30 | Context acquisition based on load sensing |
AU2003299438A AU2003299438A1 (en) | 2002-09-30 | 2003-09-30 | Context acquisition based on load sensing |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US41433102P | 2002-09-30 | 2002-09-30 | |
US60/414,331 | 2002-09-30 | ||
US10/670,781 | 2003-09-26 | ||
US10/670,781 US7434459B2 (en) | 2002-09-30 | 2003-09-26 | Context acquisition based on load sensing |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2004036338A2 true WO2004036338A2 (en) | 2004-04-29 |
WO2004036338A3 WO2004036338A3 (en) | 2004-10-07 |
Family
ID=32110126
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2003/006461 WO2004036338A2 (en) | 2002-09-30 | 2003-09-30 | Context acquisition based on load sensing |
Country Status (5)
Country | Link |
---|---|
US (1) | US7434459B2 (en) |
EP (1) | EP1546854B1 (en) |
AU (1) | AU2003299438A1 (en) |
DE (1) | DE60317694T2 (en) |
WO (1) | WO2004036338A2 (en) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8290739B2 (en) * | 2006-10-20 | 2012-10-16 | Amfit, Inc. | Method for determining relative mobility of regions of an object |
US7617068B2 (en) * | 2006-10-20 | 2009-11-10 | Amfit, Inc. | Method for determining relative mobility or regions of an object |
US20080259046A1 (en) * | 2007-04-05 | 2008-10-23 | Joseph Carsanaro | Pressure sensitive touch pad with virtual programmable buttons for launching utility applications |
JP4382844B2 (en) | 2007-10-31 | 2009-12-16 | 任天堂株式会社 | Weighting machine for adjustment and weighting method for adjustment |
TWI399565B (en) * | 2008-12-31 | 2013-06-21 | Univ Nat Taiwan | Pressure sensing based localization and tracking system |
WO2011136763A1 (en) * | 2010-04-28 | 2011-11-03 | Empire Technology Development Llc | Estimating forces on complex surfaces |
CN103299257B (en) * | 2011-01-12 | 2016-08-17 | 阿尔卑斯电气株式会社 | Pressing type input device |
KR20120086055A (en) * | 2011-01-25 | 2012-08-02 | 삼성전기주식회사 | Touch screen apparatus detecting pressure of touching and electronic apparatus having thereof |
JP5458196B2 (en) * | 2012-03-02 | 2014-04-02 | 株式会社 資生堂 | Application operation evaluation apparatus, application operation evaluation method, and application operation evaluation program |
TWI486884B (en) * | 2013-03-12 | 2015-06-01 | Wistron Corp | Identification system and identification method for identifying an object |
US10371564B2 (en) * | 2015-04-29 | 2019-08-06 | Ncr Corporation | Force location apparatus, systems, and methods |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3657475A (en) * | 1969-03-19 | 1972-04-18 | Thomson Csf T Vt Sa | Position-indicating system |
GB1528581A (en) * | 1976-02-04 | 1978-10-11 | Secr Defence | Position sensors for displays |
GB2125971A (en) * | 1982-08-23 | 1984-03-14 | Rca Corp | Determining the location at which a force is applied to a member |
US4511760A (en) * | 1983-05-23 | 1985-04-16 | International Business Machines Corporation | Force sensing data input device responding to the release of pressure force |
US4598717A (en) * | 1983-06-10 | 1986-07-08 | Fondazione Pro Juventute Don Carlo Gnocchi | Apparatus for clinically documenting postural vices and quantifying loads on body segments in static and dynamic conditions |
GB2316177A (en) * | 1996-08-06 | 1998-02-18 | John Richards | Rigid plate touch screen |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4389711A (en) * | 1979-08-17 | 1983-06-21 | Hitachi, Ltd. | Touch sensitive tablet using force detection |
US4526043A (en) * | 1983-05-23 | 1985-07-02 | At&T Bell Laboratories | Conformable tactile sensor |
JPS60221288A (en) * | 1984-04-13 | 1985-11-05 | 株式会社 富士電機総合研究所 | Pressure sensing recognizing controller |
JPH061224B2 (en) * | 1985-09-26 | 1994-01-05 | 工業技術院長 | Surface pressure distribution detector |
US5054323A (en) * | 1989-04-04 | 1991-10-08 | The Charles Stark Draper Laboratory, Inc. | Pressure distribution characterization system |
US5253656A (en) * | 1991-05-23 | 1993-10-19 | Rincoe Richard G | Apparatus and method for monitoring contact pressure between body parts and contact surfaces |
US5476103A (en) * | 1991-10-10 | 1995-12-19 | Neurocom International, Inc. | Apparatus and method for assessment and biofeedback training of leg coordination and strength skills |
US6958451B2 (en) * | 1995-06-07 | 2005-10-25 | Automotive Technologies International, Inc. | Apparatus and method for measuring weight of an occupying item of a seat |
US6002994A (en) * | 1994-09-09 | 1999-12-14 | Lane; Stephen S. | Method of user monitoring of physiological and non-physiological measurements |
US5800480A (en) * | 1996-08-30 | 1998-09-01 | Augustine Medical, Inc. | Support apparatus with a plurality of thermal zones providing localized cooling |
DE19750940A1 (en) | 1996-11-15 | 1998-05-28 | Mikron Ges Fuer Integrierte Mi | Digitising table with projected keyboard or screen |
DE19750960C2 (en) * | 1996-11-26 | 2002-08-14 | Roland Man Druckmasch | Film inking unit for a rotary printing machine |
GB2321707B (en) | 1997-01-31 | 2000-12-20 | John Karl Atkinson | A means for determining the x, y and z co-ordinates of a touched surface |
US6347290B1 (en) * | 1998-06-24 | 2002-02-12 | Compaq Information Technologies Group, L.P. | Apparatus and method for detecting and executing positional and gesture commands corresponding to movement of handheld computing device |
US6715359B2 (en) * | 2001-06-28 | 2004-04-06 | Tactex Controls Inc. | Pressure sensitive surfaces |
US20070050271A1 (en) * | 2003-07-11 | 2007-03-01 | Rf Code, Inc. | Presence, pattern and weight sensor surface |
-
2003
- 2003-09-26 US US10/670,781 patent/US7434459B2/en active Active
- 2003-09-30 WO PCT/IB2003/006461 patent/WO2004036338A2/en active IP Right Grant
- 2003-09-30 AU AU2003299438A patent/AU2003299438A1/en not_active Abandoned
- 2003-09-30 EP EP03799733A patent/EP1546854B1/en not_active Expired - Lifetime
- 2003-09-30 DE DE60317694T patent/DE60317694T2/en not_active Expired - Lifetime
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3657475A (en) * | 1969-03-19 | 1972-04-18 | Thomson Csf T Vt Sa | Position-indicating system |
GB1528581A (en) * | 1976-02-04 | 1978-10-11 | Secr Defence | Position sensors for displays |
GB2125971A (en) * | 1982-08-23 | 1984-03-14 | Rca Corp | Determining the location at which a force is applied to a member |
US4511760A (en) * | 1983-05-23 | 1985-04-16 | International Business Machines Corporation | Force sensing data input device responding to the release of pressure force |
US4598717A (en) * | 1983-06-10 | 1986-07-08 | Fondazione Pro Juventute Don Carlo Gnocchi | Apparatus for clinically documenting postural vices and quantifying loads on body segments in static and dynamic conditions |
GB2316177A (en) * | 1996-08-06 | 1998-02-18 | John Richards | Rigid plate touch screen |
Also Published As
Publication number | Publication date |
---|---|
WO2004036338A3 (en) | 2004-10-07 |
DE60317694T2 (en) | 2008-10-30 |
US20040148089A1 (en) | 2004-07-29 |
DE60317694D1 (en) | 2008-01-03 |
AU2003299438A8 (en) | 2004-05-04 |
EP1546854A2 (en) | 2005-06-29 |
AU2003299438A1 (en) | 2004-05-04 |
EP1546854B1 (en) | 2007-11-21 |
US7434459B2 (en) | 2008-10-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20040138849A1 (en) | Load sensing surface as pointing device | |
US9727838B2 (en) | On-shelf tracking system | |
US7434459B2 (en) | Context acquisition based on load sensing | |
US7040455B2 (en) | System and method for tracking items at a scale of a self-checkout terminal | |
US11657617B1 (en) | Presentation of a user interface for confirming unreliable group data | |
US11946795B2 (en) | Weighing load cells and arrangements employing them in shelves | |
US11971293B2 (en) | Systems and methods for weighing products on a shelf | |
US11933661B2 (en) | Systems and methods for weighing products on a shelf | |
US20150120238A1 (en) | Monitoring adjustable workstations | |
JPH0315206B2 (en) | ||
CN107862360A (en) | Destination object and the correlating method of merchandise news, apparatus and system | |
WO2007149341A2 (en) | System to associate a demographic to a user of an electronic system | |
JP2021193611A (en) | Gravimeter, advice information providing system, and bottle | |
TW201143715A (en) | Sleeping efficiency analyzer and analyzing method thereof | |
US20130096982A1 (en) | Interest level estimation apparatus, interest level estimation method, and computer-readable recording medium | |
JP2760473B2 (en) | Body sway meter | |
US10726378B2 (en) | Interaction analysis | |
CN117593830A (en) | Article identification system, article identification method, computer-readable recording medium, and article acquisition judgment system | |
CN102551731B (en) | Tumbling movement detecting method based on data curve comparison | |
CN103207686B (en) | A kind of TrackPoint, TrackPoint information conversion method, device and electronic equipment | |
WO2022081518A3 (en) | Methods and systems for retail environments | |
Tani et al. | Estimating user interruptibility by measuring table-top pressure | |
CN109643177B (en) | Writing control method and handwriting input device | |
TW201246092A (en) | On-shelf tracking (OST) system | |
US20240257049A1 (en) | Methods and systems employing load cells in shelving arrangements |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SK SL SY TJ TM TR TT TZ UA UG UZ VN YU ZA ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2003799733 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 2003799733 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: JP |
|
WWW | Wipo information: withdrawn in national office |
Country of ref document: JP |
|
WWG | Wipo information: grant in national office |
Ref document number: 2003799733 Country of ref document: EP |