US8199055B2 - Method and system for locating an object on a surface - Google Patents

Method and system for locating an object on a surface Download PDF

Info

Publication number
US8199055B2
US8199055B2 US12/524,728 US52472808A US8199055B2 US 8199055 B2 US8199055 B2 US 8199055B2 US 52472808 A US52472808 A US 52472808A US 8199055 B2 US8199055 B2 US 8199055B2
Authority
US
United States
Prior art keywords
transmitter
further object
receiver
receivers
pairs
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US12/524,728
Other versions
US20100045530A1 (en
Inventor
Sander Bernard Francis Van De Wijdeven
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Assigned to KONINKLIJKE PHILIPS ELECTRONICS N V reassignment KONINKLIJKE PHILIPS ELECTRONICS N V ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: VAN DE WIJDEVEN, SANDER BERNARD FRANCIS
Publication of US20100045530A1 publication Critical patent/US20100045530A1/en
Application granted granted Critical
Publication of US8199055B2 publication Critical patent/US8199055B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen

Definitions

  • the invention relates to a method of locating an object placed on a surface, and a system for locating an object placed on a surface.
  • the invention also relates to an object for movable arrangement on or over a surface, and a computer programme.
  • WO 2006/095320 discloses a method for detecting the location, shape and size of at least one object placed on a plane within the touch sensor boundaries of a touch screen.
  • the touch screen display includes on its periphery, N light transmitters and M sensors.
  • the method is generally comprised of two stages: a calibration stage and an operational stage.
  • the calibration stage as each light transmitter is switched on during its respective turn-on time, the light beam that is cast may be detected by certain ones of the sensors.
  • the identification of the sensors that detect the respective light transmitter's light beam is recorded as calibration data.
  • Non-calibration data is recorded over a cycle of operation in the presence of an object.
  • the overall measurement accuracy may be increased by increasing the density of transmitters and/or receivers in certain areas of the screen where detection proves to be less accurate than other areas. This non-even configuration of transmitters and/or receivers can compensate for the less accurate detection.
  • the non-even configuration is less appropriate for remedying a decrease in accuracy caused by one object casting a shadow on another object to be detected.
  • the method according to the invention comprises steps of:
  • each such pair defining one of a plurality of normally clear lines of sight, at least some of which are at an angle to each other,
  • identifying normally clear lines of sight blocked by the object by evaluating responses of the receivers of at least some of the pairs of a transmitter and a receiver able to detect a signal from the transmitter, wherein at least one element of one of the pairs of which the response of the receiver is evaluated is included in a further object, which further object is movable across the surface.
  • Objects placed on the surface may include objects placed over, but not touching, the surface.
  • the term encompasses animate and inanimate objects.
  • An embodiment includes establishing a communication link between the further object and a control apparatus associated with the surface.
  • the communication link allows the elements included in the further object to be activated at the appropriate times and/or their response signals to be transmitted to a central logic unit for determining at least the position of the object to be located. It further allows the use of a varying number of further objects including wireless transmitters and/or receivers, because the presence of these further objects can be discovered.
  • the communication link is a wireless communication link.
  • a control apparatus locates the further object on the surface.
  • An effect is that at least approximate locations of lines of sight terminating at the further object can be determined. This improves the accuracy with which the position of the actual object to be located can be determined. In this embodiment, it is not necessary, for example, to restrain the movements of the further object to only those movements that do not alter the orientation of lines of sight terminating at the further object, or to use directional receivers.
  • An embodiment, wherein the further object signals its presence to the control apparatus includes:
  • An effect is that the method can employ a varying number of further objects including wireless transmitters and/or receivers.
  • An embodiment of the method includes determining an orientation of the further object relative to a co-ordinate system fixed with respect to the surface.
  • An effect is that, for a known configuration of the further object, the areas of the surface covered by light beams from transmitters included in the further object and/or the areas covered by incident light receivable by receivers included in the further object, can be determined.
  • the further object is provided with plurality of edges at an angle to each other in a plane parallel to the surface, including determining the shape of the further object by identifying normally clear lines of sight blocked by the further object and defined by pairs of a transmitter and a receiver arranged around the further object.
  • orientation of the further object is determined, without the need for an auxiliary sensor system.
  • the orientation of the further object provides information about the orientation of lines of sight terminating at the further object in relation to a co-ordinate system fixed with respect to the surface.
  • This embodiment is thus relatively accurate. It need not, for instance, use an approximation of the further object as a point source or sink of lines of sight.
  • the further object extends across at least a major part of a dimension of the surface, so as to define regions of the surface separated by the further object.
  • a user can partition the surface into regions of variable extent by moving the further object.
  • the further object simplifies the determination of the position of the object to be located, by cutting out signals crossing a region other than that in which the object to be located is present. This effect is pronounced where other objects are placed on the surface in the other region. Under such circumstances and in the absence of the further object, the pattern of normally clear lines of sight would be quite complicated. Because the further object includes wireless transmitters and/or receivers, the accuracy of the method is not impaired to the extent that it would be if only a screen were to be placed across the surface.
  • a variant of this method includes identifying normally clear lines of sight blocked by the object by evaluating responses of the receivers of at least some of only those pairs of a transmitter and a receiver able to detect a signal from the transmitter that define lines of sight across one of the regions.
  • the object to be located can only block a sub-set of all normally clear lines of sight. Consequently only a sub-set of all receiver responses needs to be evaluated.
  • the further object is constrained in its movement across the surface to translations substantially parallel to a line of sight defined by a pair of a wireless transmitter and receiver of which one is included in the further object.
  • An effect is that it is easier to locate the further object, and from its position to infer the locations of lines of sight terminating at the further object.
  • whether the movement is substantially parallel is measured with reference to the divergence angle of a beam of radiation emitted by the transmitter of the pair and the angle of the field of view of the receiver of the pair of elements defining the line of sight.
  • the method includes controlling the drive apparatus remotely from the further object to position the further object on the surface.
  • an effect is that automatic control of the further object to improve the accuracy with which the position of the object to be located is determined is made possible.
  • the position of the further object can be estimated by dead reckoning on the basis of the directed movements of the further object.
  • system of the present invention comprises
  • control apparatus for controlling a plurality of elements including a plurality of wireless transmitters and a plurality of wireless receivers, in such a configuration as to form a plurality of pairs of a transmitter and a receiver able to detect a signal from the transmitter in the absence of the object, each such pair defining one of a plurality of normally clear lines of sight, at least some of which are at an angle to each other,
  • control apparatus being arranged to activate the wireless transmitters in the presence of the object, and to identify normally clear lines of sight blocked by the object by evaluating responses of the receivers of at least some of the pairs of a transmitter and a receiver able to detect a signal from the transmitter, wherein
  • the system further includes at least one further object, movable across the surface and including an element of at least one of the pairs of which the control apparatus is arranged to evaluate the response of the receiver.
  • control apparatus is associated with the surface, and the system further includes a communication link between the further object and the control apparatus.
  • the control apparatus is associated with the surface in the sense that is in position that is stationary with respect to the surface.
  • system is arranged to carry out a method according to the invention.
  • the invention provides an object for movable arrangement on or over a surface and including an element of at least one of the pairs of which the control apparatus in a system according to the invention is arranged to evaluate the response of the receiver.
  • the computer programme according to the invention includes a set of instructions capable, when incorporated in a machine readable medium, of causing a system having information processing capabilities and including a plurality of elements including a plurality of wireless transmitters and a plurality of wireless receivers, in such a configuration as to form a plurality of pairs of a transmitter and a receiver able to detect a signal from the transmitter in the absence of the object, each such pair defining one of a plurality of normally clear lines of sight, at least some of which are at an angle to each other, to perform a method according to the invention and/or to constitute a system according to the invention.
  • FIG. 1 is a schematic top view of a first system for locating an object on a surface
  • FIG. 2 is a flow chart representing an outline of a method for use in connection with the first system
  • FIG. 3 is a schematic top view of a second system for locating an object on a surface
  • FIG. 4 is a flow chart representing an outline of a method for use in connection with the second system
  • FIG. 5 is a schematic top view of the second system at a first stage in the method of FIG. 4 ;
  • FIG. 6 is a schematic top view of the second system at a second stage in the method of FIG. 4 ;
  • FIG. 7 is a schematic top view of the second system at a third stage in the method of FIG. 4 ;
  • FIG. 8 is a schematic top view of the second system at a fourth stage in the method of FIG. 4 .
  • an interactive system 1 is shown. It includes a surface 2 of finite extent, on which an object 3 may be placed, either in touching relationship or in close proximity to the surface 2 .
  • the surface 2 covers a screen of a display device.
  • the surface 2 is patterned into a playing surface for a board game.
  • the surface 2 is rectangular, but in other embodiments it has another simply connected shape, for example a convex shape.
  • the interactive system 1 has the ability to locate the object 3 , and any further objects (not shown), on the surface 2 .
  • the system 1 is provided with logic to infer an input signal from the location of the object 2 .
  • the interactive system 1 functions as a touch screen.
  • the object 2 is an inanimate object, e.g. a pawn
  • the interactive system 1 is equally suitable for locating the position of a user's finger placed on or over the surface 2 .
  • the interactive system is provided with a plurality of active elements. These include peripheral transmitters 4 a - 4 p and peripheral receivers 5 a - 5 l .
  • the peripheral transmitters 4 and peripheral receivers 5 are placed at a perimeter of the surface 2 .
  • the peripheral transmitters 4 comprise wireless transmitters, arranged, in use, to emit a directed beam of radiation with a divergence angle, determining a particular region of coverage of the surface 2 . It is noted that the beams are emitted in a direction lying in a plane substantially parallel to the surface 2 .
  • the peripheral transmitters 4 are optical transmitters, e.g. Light Emitting Diodes (LEDs).
  • LEDs Light Emitting Diodes
  • the peripheral receivers 5 comprise photodiodes. In other embodiments, another type of optical sensor may be used. In the embodiments to be discussed herein, the peripheral receivers 5 have a relatively wide-angled field of view. They are thus able to detect light from peripheral transmitters 4 not located directly opposite them.
  • peripheral transmitters 4 a - 4 p and peripheral receivers 5 a - 5 l are positioned such that, in the absence of the object 3 , light emitted by one of the transmitters 4 a - 4 p can be detected by one or more peripheral receivers 5 a - 5 l .
  • a peripheral transmitter 4 a - 4 p forms a pair with each peripheral receiver 5 a - 5 p able to detect light emitted by it in the absence of objects on the surface 2 .
  • An imaginary line between the elements of such a pair is termed a line of sight herein.
  • the interactive system 1 illustrated in FIG. 1 further includes a movable barrier 6 .
  • the movable barrier 6 extends over more than half of a dimension corresponding to a short side 7 of the surface 2 . In fact, it extends completely over the surface 2 , so as to divide the surface 2 into a left region 8 and a right region 9 .
  • the movable barrier 6 extends over a major part of a dimension of the surface 2 corresponding to a long side 10 .
  • a major part corresponds to a value between 50% and 100% of the distance between opposite edge points of the surface 2 , e.g. 70%, 80% or 90%.
  • the movable barrier 6 is constrained to carry out translational movements in a direction substantially parallel to the long side 10 . It is to be noted that, in the illustrated embodiment, this direction is also substantially parallel to lines 11 a - 11 e defined by pairs of elements in a set formed by peripheral transmitters 4 f - 4 h on the short side 7 , peripheral receivers 5 e , 5 f on the short side 7 , and receivers 12 a - 12 c and transmitters 13 a - 13 b included in the movable barrier 6 .
  • the aperture of the receivers 5 e , 5 f , 12 a - 12 c is so small that only the light from transmitters 4 f - 4 h , 13 a , 13 b directly opposite is detected, movement of the movable barrier 6 in a direction parallel to the lines 11 a - 11 e of sight does not need to be followed by re-calibration.
  • the constrained movement simplifies the re-calibration process, in which normally clear lines of sight are identified for each peripheral transmitter.
  • a control apparatus 14 is associated with the surface 2 , by being included in the device of which the surface 2 is a part.
  • the control apparatus 14 includes a processor 15 and memory 16 , as well as a transceiver 17 .
  • the transceiver 17 is provided for signalling between the control apparatus 14 and the peripheral transmitters 4 a - 4 p , the peripheral receivers 5 a - 5 l , receivers 12 a - 12 f included in the movable barrier 6 , transmitters 13 a - 13 d included in the movable barrier 6 and a drive apparatus 18 included in the movable barrier 6 .
  • the drive apparatus 18 allows the control apparatus 14 to position the movable barrier 6 with respect to the surface 2 .
  • the relative sizes of the left and right regions 8 , 9 can be adjusted.
  • the peripheral transmitters 4 and/or transmitters 13 included in the movable barrier 6 emit light over a relatively wide angle, movement of the barrier 6 will affect the number of peripheral receivers 5 and/or receivers 12 included in the movable barrier 6 with which they define lines of sight.
  • FIG. 2 illustrates a method carried out by the control apparatus 14 .
  • a first step 19 the position of the movable barrier 6 is determined.
  • this step 19 can involve a form of dead reckoning.
  • a row of transducers (not shown) at the long side 10 of the surface 2 communicates the position of the movable barrier 6 to the control apparatus 14 through the transceiver 17 .
  • one or more of the peripheral transmitters 4 a - 4 p may be activated in turn, with the position of the movable barrier 6 being inferred from the identity of those peripheral receivers 5 a - 5 l and/or receivers 12 a - 12 f included in the movable barrier 6 able to detect the emitted light.
  • the movable barrier 6 is located on the surface 2 in this first step 19 .
  • a next step 20 it is determined in which of the left and right regions 8 , 9 the object 3 is to be located. In the illustrated embodiment, only those elements covering the right region 9 are used to locate the object 3 .
  • a calibration measurement is performed (step 21 ) in the absence of the object 3 .
  • it is determined for each of the selected peripheral transmitters 4 d - 4 j and transmitters 13 a , 13 b included in the movable barrier 6 , which of the peripheral receivers 5 c - 5 h and receivers 12 a - 12 c included in the movable barrier 6 are able to detect a signal from that peripheral transmitter or transmitter included in the movable barrier 6 .
  • pairs of elements defining normally clear lines of sight are determined, wherein elements of at least some of the pairs are included in the movable barrier 6 .
  • the normally clear lines of sight blocked by the object 3 are identified (step 22 ) by evaluating for each transmitter 4 d - 4 j , 13 a , 13 b in turn, the responses of peripheral receivers 5 c - 5 h and receivers 12 a - 12 c included in the movable barrier 6 able to detect the signal from that transmitter in the absence of the movable object 3 .
  • the shape and location of the (passive) object 3 can be determined.
  • the accuracy with which the shape and location are determined depends on the number and placement of the elements. To that extent, an estimate of the shape and location is determined in the final step 22 .
  • the method by which the shape and location of the object 3 is inferred from the identification of blocked normally clear lines of sight may be one of several.
  • peripheral transmitters 4 d - 4 j , transmitters 13 a , 13 b included in the movable barrier 6 , peripheral receivers 5 c - 5 h and receivers 12 a - 12 c included in the movable barrier 6 are configured such that there is only one line of sight from each transmitter, and the lines of sight form a regular grid, then it is simply enough to approximate the location and shape by the squares or rectangles of the grid defined by crossing blocked lines of sight.
  • the method involves continuous execution of the final step 22 over multiple cycles of operation.
  • each transmitter is turned on for a pre-determined turn-on time.
  • minimum and maximum area estimates are made and stored for each light transmitter.
  • a minimum area estimate is determined as a region bounded by lines from the transmitter and the outermost ones of the blocked normally clear lines of sight and the edge of the right region 9 between those receivers.
  • the maximum area estimate is defined by points including the receivers adjacent to those defining corners of the minimum area.
  • the minimum and maximum area estimates, once determined, are stored for each light transmitter for the current cycle of operation.
  • the stored minimum and maximum area estimates are retrieved.
  • the maximum area estimates for each of the light transmitters over one cycle of operation are combined through a mathematical intersection to derive a maximum area result.
  • the minimum area estimates are combined through a mathematical intersection to achieve a total minimum area result.
  • the minimum area result is then combined through a mathematical intersection with the maximum area result to ensure that the minimum area is completely inside the maximum area.
  • FIG. 3 shows a second interactive system 23 . It includes a surface 24 of finite extent, on which objects may be placed, either in touching relationship or in close proximity to the surface 24 . Also in variants of this embodiment, the surface 24 covers a screen of a display device. In other variants, the surface 24 is opaque and patterned into a playing surface for a board game.
  • the second interactive system 23 is provided with a plurality of active elements. These include peripheral transmitters 25 a - 25 p and peripheral receivers 26 a - 26 l .
  • the peripheral transmitters 25 and peripheral receivers 26 are placed at a perimeter of the surface 24 .
  • the peripheral transmitters 25 and peripheral receivers 26 correspond to the peripheral transmitters 4 and peripheral receivers 5 of the interactive system 1 illustrated in FIG. 1 and described above.
  • a control apparatus 27 includes a processor 28 and memory 29 .
  • the control apparatus 27 further includes a wired transceiver 30 for individually activating the peripheral transmitters 25 and for obtaining response signals from the peripheral receivers 26 .
  • a wireless transceiver 31 is provided as well. An example is compliant with the Bluetooth or Zigbee standards. In an alternative embodiment, the wireless transceiver 31 is configured to emit and receive Infrared communications signals.
  • the active object 32 is movable across the surface 24 , in the sense that it can be lifted off the surface 24 and placed at a different location.
  • the active object 32 includes a controller 33 and a wireless transceiver 34 configured to exchange data with the wireless transceiver 31 of the control apparatus 27 .
  • the wireless transceiver 31 is omitted, the active object 32 includes a wired transceiver, and a wired communications link is provided between the control apparatus 27 and the active object 32 .
  • the active object 32 includes a drive apparatus for propelling the active object 32 across the surface 24 .
  • the control apparatus 27 controls the drive apparatus remotely to position the active object 32 on the surface 24 . In one variant, this allows the second system 23 to implement a game, where the active object 32 represents one of the playing pieces of the player's opponent, for example.
  • the active object 32 also participates in locating further objects on the surface 24 . To this end, it includes further transmitters 35 a - 35 d and further receivers 36 a - 36 d of the same type as the peripheral receivers 26 and peripheral transmitters 25 .
  • the peripheral transmitters 25 , further transmitters 35 , peripheral receivers 26 and further receivers 36 are, as can be seen, in such a configuration as to form a plurality of pairs of a transmitter and a receiver able to detect a signal from the transmitter in the absence of the object or objects to be located.
  • each such pair of transmitter and receiver defines one of a plurality of normally clear lines of sight, at least some of which are at an angle to each other. This is true regardless of the position of the active object 32 .
  • FIG. 4 illustrates an embodiment of a method carried out by the second interactive system 23 under the control of the control apparatus 27 .
  • FIGS. 5-8 illustrate phases during the execution of the method.
  • a first step 37 includes registering the active object 32 and any further active objects (not shown, for reasons of clarity).
  • the active object 32 signals its presence to the control apparatus 27 , for example using the communications link provided by the wireless transceivers 31 , 34 . In one embodiment, it signals its presence in response to a signal emitted by the control apparatus 27 and addressed to no active object in particular. In another embodiment, it continually signals its presence until an acknowledgment is received from the control apparatus 27 associated with the surface 24 .
  • the control apparatus 27 determines its position on the surface 24 (step 38 ). In variants in which the control apparatus 27 controls a drive apparatus in the active object 32 to position the active object 32 on the surface 24 , it may be sufficient to use a system of dead reckoning to implement this step 38 . In the illustrated example, the position of the active object 32 is determined using the method described in WO 2006/095320 and above, but using only the peripheral transmitters 25 and the peripheral receivers 26 .
  • FIG. 5 shows one step in a calibration cycle, carried out in the absence of the active object 32 .
  • Each of the peripheral transmitters 25 a - 25 p is activated in turn, and those of the peripheral receivers 26 a - 26 l able to detect the light emitted by that peripheral transmitter 25 are recorded in a table against the activated peripheral transmitter 25 .
  • peripheral receivers 26 f - 26 l are recorded against the first peripheral transmitter 25 a .
  • the pairs of the first peripheral transmitter 25 a and each respective one of those peripheral receivers 26 f - 26 l able to detect its signal define normally clear lines of sight.
  • the area covered by the active object 32 is determined in the manner outlined above with regard to the first interactive system 1 and in WO 2006/095320.
  • the shape of the active object 32 is determined in relation to the surface 24 .
  • its orientation about an axis normal to the surface 24 can be determined.
  • the control apparatus 27 is able to infer the locations of the further transmitters 35 and further receivers 36 included in the active object 32 .
  • this knowledge can be used to skip a next step 40 of the example, in which a further calibration measurement is carried out, in the presence of the active object 32 , but in the absence of any inactive objects.
  • the further transmitters 35 a - 35 d are also activated in turn, and the responses of the further receivers 36 a - 36 d and peripheral receivers 26 a - 26 l are evaluated to identify normally clear lines of sight. Some of these lines of sight terminate at the active object 32 , of course.
  • FIGS. 7 and 8 illustrate a final step 41 , which is carried out repeatedly for as long as the active object 32 does not change position.
  • this step 41 each of the peripheral transmitters 25 a - 25 p and further transmitters 35 a - 35 d is activated in turn, and the responses of the peripheral receivers 26 a - 26 l and further receivers 36 a - 36 d are evaluated in order to identify normally clear lines of sight blocked by an inactive object 42 placed on the surface 24 . Having identified the normally clear lines of sight that are blocked, respective minimum area estimates and maximum area estimates of the inactive object 42 are made for each of the peripheral transmitters 25 a - 25 p and further transmitters 35 a - 35 d . These are combined to determine the shape and location of the inactive object 42 .
  • the use of the active object 32 including the further transmitters 35 a - 35 d and further receivers 36 a - 36 d improves the accuracy of the estimate due to the proximity of the further transmitters 35 a - 35 d and further receivers 36 a - 36 d to the inactive object, and the close mutual spacing of these elements.
  • FIG. 7 shows the situation where the first peripheral transmitter 25 a is activated.
  • the inactive object 32 casts a shadow defining a shadow area 43 on the surface 24 .
  • a first and fourth receiver 36 a , 36 d counting clockwise around the edges of the active object 32 , are normally able to detect light from the first peripheral transmitter 25 a .
  • the minimum area is defined by the first peripheral transmitter 25 a itself, the fourth further receiver 36 d and a peripheral receiver 26 h .
  • the maximum area is defined by the first peripheral transmitter 25 a , the first further receiver 36 a and another peripheral receiver 26 i . It will be apparent that the elements included in the active object 32 reduce the minimum and maximum area estimates associated with the first peripheral transmitter 25 a.
  • FIG. 8 illustrates the situation where the first further transmitter 35 a included in the active object 32 is activated.
  • the minimum and maximum area estimates are empty, because the inactive object 42 blocks no normally clear lines of sight between the first further transmitter 35 a and one of the peripheral receivers 26 a - 26 l . These estimates are not taken into account when determining the position and shape of the inactive object 42 .
  • the active object 32 may be moved at this stage, in order to establish lines of sight that are blocked by the inactive object. In that case, the two preceding steps 38 , 40 would be repeated.
  • additional lines of sight can be provided in a region of the surface 24 in which an inactive object 42 is present.
  • further minimum area and maximum area estimates with a higher resolution are provided to establish the total minimum area estimate and total maximum are estimate.
  • the shape and position of the inactive object 42 can thus be determined with a higher resolution.
  • separate inactive objects located in close proximity to each other can be distinguished where they would otherwise be perceived as a single object.
  • fewer than all of the transmitters may be activated in turn to obtain fewer than the maximum possible number of minimum and maximum area estimates, if it is determined that some of the transmitters emit signals in a direction away from the object to be located.
  • the embodiments of FIG. 1 and FIGS. 5-7 may be combined, such that both the active object 32 and the movable barrier 6 are placed over a particular surface.
  • the number of peripheral transmitters 4 , 25 and peripheral receivers 5 , 26 will tend to be higher in practical embodiments than is shown in the drawings.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • Position Fixing By Use Of Radio Waves (AREA)
  • Length Measuring Devices With Unspecified Measuring Means (AREA)
  • Manipulator (AREA)
  • Polishing Bodies And Polishing Tools (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)

Abstract

A method of locating an object (3;42) placed on a surface (2:24) includes identifying normally clear lines of sight blocked by the object (3:42) by evaluating responses of the receivers of at least some of pairs of a transmitter and a receiver able to detect a signal from the transmitter. At least one element of one of the pairs of which the response of the receiver is evaluated is included in a further object (6;32), which is movable across the surface (2;24).

Description

FIELD OF THE INVENTION
The invention relates to a method of locating an object placed on a surface, and a system for locating an object placed on a surface. The invention also relates to an object for movable arrangement on or over a surface, and a computer programme.
BACKGROUND OF THE INVENTION
WO 2006/095320 discloses a method for detecting the location, shape and size of at least one object placed on a plane within the touch sensor boundaries of a touch screen. The touch screen display includes on its periphery, N light transmitters and M sensors. The method is generally comprised of two stages: a calibration stage and an operational stage. During the calibration stage, as each light transmitter is switched on during its respective turn-on time, the light beam that is cast may be detected by certain ones of the sensors. For each light transmitter, the identification of the sensors that detect the respective light transmitter's light beam is recorded as calibration data. Non-calibration data is recorded over a cycle of operation in the presence of an object. A comparison is made of the calibration data and non-calibration data allowing the shadow area cast by the object to be determined. In certain embodiments, the overall measurement accuracy may be increased by increasing the density of transmitters and/or receivers in certain areas of the screen where detection proves to be less accurate than other areas. This non-even configuration of transmitters and/or receivers can compensate for the less accurate detection.
The non-even configuration is less appropriate for remedying a decrease in accuracy caused by one object casting a shadow on another object to be detected.
SUMMARY OF THE INVENTION
It is desirable to provide a method, system, object and computer programme of the types defined in the opening paragraphs that allow relatively accurate detection of a particular object in an area of the surface where other objects are liable to obstruct lines of sight that would otherwise have been blocked by that particular object.
The method according to the invention comprises steps of:
providing a plurality of elements including a plurality of wireless transmitters and a plurality of wireless receivers, in such a configuration as to form a plurality of pairs of a transmitter and a receiver able to detect a signal from the transmitter in the absence of the object, each such pair defining one of a plurality of normally clear lines of sight, at least some of which are at an angle to each other,
activating at least some of the wireless transmitters in the presence of the object, and
identifying normally clear lines of sight blocked by the object by evaluating responses of the receivers of at least some of the pairs of a transmitter and a receiver able to detect a signal from the transmitter, wherein at least one element of one of the pairs of which the response of the receiver is evaluated is included in a further object, which further object is movable across the surface.
Objects placed on the surface may include objects placed over, but not touching, the surface. The term encompasses animate and inanimate objects.
Because at least some of the lines of sight are at an angle to each other, it is possible to locate the object in two dimensions by identifying normally clear lines of sight blocked by the object. Evaluating responses of the receivers of at least some of the pairs of a transmitter and a receiver able to detect a signal from the transmitter allows the blocked ones of the normally clear lines of sight to be identified. Because at least one element forming one of the pairs of which the response of the receiver is evaluated is included in a further object, movable across the surface, additional, shorter lines of sight can be provided that stay clear of other objects on the surface. An added advantage is that the density of normally clear lines of sight can be increased locally only where needed, so that the method is relatively efficient compared to, for example, an indiscriminate increase in the number of wireless receivers and transmitters.
An embodiment includes establishing a communication link between the further object and a control apparatus associated with the surface.
The communication link allows the elements included in the further object to be activated at the appropriate times and/or their response signals to be transmitted to a central logic unit for determining at least the position of the object to be located. It further allows the use of a varying number of further objects including wireless transmitters and/or receivers, because the presence of these further objects can be discovered.
In a variant, the communication link is a wireless communication link.
An effect is that the footprint of the further object, representative of the area occupied by the further object itself, need only be limited.
In an embodiment, a control apparatus locates the further object on the surface.
An effect is that at least approximate locations of lines of sight terminating at the further object can be determined. This improves the accuracy with which the position of the actual object to be located can be determined. In this embodiment, it is not necessary, for example, to restrain the movements of the further object to only those movements that do not alter the orientation of lines of sight terminating at the further object, or to use directional receivers.
An embodiment, wherein the further object signals its presence to the control apparatus, includes:
registering the further object including the at least one element; and
locating the further object on the surface upon its registration.
An effect is that the method can employ a varying number of further objects including wireless transmitters and/or receivers.
An embodiment of the method includes determining an orientation of the further object relative to a co-ordinate system fixed with respect to the surface.
An effect is that, for a known configuration of the further object, the areas of the surface covered by light beams from transmitters included in the further object and/or the areas covered by incident light receivable by receivers included in the further object, can be determined.
In an embodiment, the further object is provided with plurality of edges at an angle to each other in a plane parallel to the surface, including determining the shape of the further object by identifying normally clear lines of sight blocked by the further object and defined by pairs of a transmitter and a receiver arranged around the further object.
An effect is that the orientation of the further object is determined, without the need for an auxiliary sensor system. For a known distribution of transmitters and/or receivers around the edges of a further object of finite extent, the orientation of the further object provides information about the orientation of lines of sight terminating at the further object in relation to a co-ordinate system fixed with respect to the surface. This embodiment is thus relatively accurate. It need not, for instance, use an approximation of the further object as a point source or sink of lines of sight.
In an embodiment, the further object extends across at least a major part of a dimension of the surface, so as to define regions of the surface separated by the further object.
A user can partition the surface into regions of variable extent by moving the further object. The further object simplifies the determination of the position of the object to be located, by cutting out signals crossing a region other than that in which the object to be located is present. This effect is pronounced where other objects are placed on the surface in the other region. Under such circumstances and in the absence of the further object, the pattern of normally clear lines of sight would be quite complicated. Because the further object includes wireless transmitters and/or receivers, the accuracy of the method is not impaired to the extent that it would be if only a screen were to be placed across the surface.
A variant of this method includes identifying normally clear lines of sight blocked by the object by evaluating responses of the receivers of at least some of only those pairs of a transmitter and a receiver able to detect a signal from the transmitter that define lines of sight across one of the regions.
An effect is that the method operates relatively efficiently. The object to be located can only block a sub-set of all normally clear lines of sight. Consequently only a sub-set of all receiver responses needs to be evaluated.
In an embodiment, the further object is constrained in its movement across the surface to translations substantially parallel to a line of sight defined by a pair of a wireless transmitter and receiver of which one is included in the further object.
An effect is that it is easier to locate the further object, and from its position to infer the locations of lines of sight terminating at the further object. In this respect, whether the movement is substantially parallel is measured with reference to the divergence angle of a beam of radiation emitted by the transmitter of the pair and the angle of the field of view of the receiver of the pair of elements defining the line of sight.
An embodiment, wherein the further object includes a drive apparatus for propelling the further object across the surface, the method includes controlling the drive apparatus remotely from the further object to position the further object on the surface.
An effect is that automatic control of the further object to improve the accuracy with which the position of the object to be located is determined is made possible. In another embodiment, the position of the further object can be estimated by dead reckoning on the basis of the directed movements of the further object.
According to another aspect, the system of the present invention comprises
a control apparatus for controlling a plurality of elements including a plurality of wireless transmitters and a plurality of wireless receivers, in such a configuration as to form a plurality of pairs of a transmitter and a receiver able to detect a signal from the transmitter in the absence of the object, each such pair defining one of a plurality of normally clear lines of sight, at least some of which are at an angle to each other,
the control apparatus being arranged to activate the wireless transmitters in the presence of the object, and to identify normally clear lines of sight blocked by the object by evaluating responses of the receivers of at least some of the pairs of a transmitter and a receiver able to detect a signal from the transmitter, wherein
the system further includes at least one further object, movable across the surface and including an element of at least one of the pairs of which the control apparatus is arranged to evaluate the response of the receiver.
In an embodiment, the control apparatus is associated with the surface, and the system further includes a communication link between the further object and the control apparatus.
The control apparatus is associated with the surface in the sense that is in position that is stationary with respect to the surface.
In an embodiment, the system is arranged to carry out a method according to the invention.
According to another aspect, the invention provides an object for movable arrangement on or over a surface and including an element of at least one of the pairs of which the control apparatus in a system according to the invention is arranged to evaluate the response of the receiver.
According to another aspect, the computer programme according to the invention includes a set of instructions capable, when incorporated in a machine readable medium, of causing a system having information processing capabilities and including a plurality of elements including a plurality of wireless transmitters and a plurality of wireless receivers, in such a configuration as to form a plurality of pairs of a transmitter and a receiver able to detect a signal from the transmitter in the absence of the object, each such pair defining one of a plurality of normally clear lines of sight, at least some of which are at an angle to each other, to perform a method according to the invention and/or to constitute a system according to the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention will be explained in further detail with reference to the accompanying drawings, in which:
FIG. 1 is a schematic top view of a first system for locating an object on a surface;
FIG. 2 is a flow chart representing an outline of a method for use in connection with the first system;
FIG. 3 is a schematic top view of a second system for locating an object on a surface;
FIG. 4 is a flow chart representing an outline of a method for use in connection with the second system;
FIG. 5 is a schematic top view of the second system at a first stage in the method of FIG. 4;
FIG. 6 is a schematic top view of the second system at a second stage in the method of FIG. 4;
FIG. 7 is a schematic top view of the second system at a third stage in the method of FIG. 4; and
FIG. 8 is a schematic top view of the second system at a fourth stage in the method of FIG. 4.
DETAILED DESCRIPTION OF EMBODIMENTS
In FIG. 1, an interactive system 1 is shown. It includes a surface 2 of finite extent, on which an object 3 may be placed, either in touching relationship or in close proximity to the surface 2. Although not shown in further detail in FIG. 1, in some embodiments, the surface 2 covers a screen of a display device. In other embodiments, the surface 2 is patterned into a playing surface for a board game. In the example, the surface 2 is rectangular, but in other embodiments it has another simply connected shape, for example a convex shape.
The interactive system 1 has the ability to locate the object 3, and any further objects (not shown), on the surface 2. In some embodiments, the system 1 is provided with logic to infer an input signal from the location of the object 2. In these embodiments, the interactive system 1 functions as a touch screen. In this connection, it is observed that, although examples are illustrated herein where the object 2 is an inanimate object, e.g. a pawn, the interactive system 1 is equally suitable for locating the position of a user's finger placed on or over the surface 2.
The interactive system is provided with a plurality of active elements. These include peripheral transmitters 4 a-4 p and peripheral receivers 5 a-5 l. The peripheral transmitters 4 and peripheral receivers 5 are placed at a perimeter of the surface 2. The peripheral transmitters 4 comprise wireless transmitters, arranged, in use, to emit a directed beam of radiation with a divergence angle, determining a particular region of coverage of the surface 2. It is noted that the beams are emitted in a direction lying in a plane substantially parallel to the surface 2. In the examples detailed herein, the peripheral transmitters 4 are optical transmitters, e.g. Light Emitting Diodes (LEDs). Ultrasonic transmitters or transmitters of electromagnetic radiation at non-visible wavelengths are used in other embodiments. The peripheral receivers 5 comprise photodiodes. In other embodiments, another type of optical sensor may be used. In the embodiments to be discussed herein, the peripheral receivers 5 have a relatively wide-angled field of view. They are thus able to detect light from peripheral transmitters 4 not located directly opposite them.
The peripheral transmitters 4 a-4 p and peripheral receivers 5 a-5 l are positioned such that, in the absence of the object 3, light emitted by one of the transmitters 4 a-4 p can be detected by one or more peripheral receivers 5 a-5 l. A peripheral transmitter 4 a-4 p forms a pair with each peripheral receiver 5 a-5 p able to detect light emitted by it in the absence of objects on the surface 2. An imaginary line between the elements of such a pair is termed a line of sight herein.
In order to allow the object 3 to be located in two dimensions, at least some of all the lines of sight defined by all possible pairs of peripheral transmitters 4 a-4 p and peripheral receivers 5 a-5 l cross at least some other lines of sight.
The interactive system 1 illustrated in FIG. 1 further includes a movable barrier 6. The movable barrier 6 extends over more than half of a dimension corresponding to a short side 7 of the surface 2. In fact, it extends completely over the surface 2, so as to divide the surface 2 into a left region 8 and a right region 9. In another embodiment, the movable barrier 6 extends over a major part of a dimension of the surface 2 corresponding to a long side 10. In other embodiments, a major part corresponds to a value between 50% and 100% of the distance between opposite edge points of the surface 2, e.g. 70%, 80% or 90%.
The movable barrier 6 is constrained to carry out translational movements in a direction substantially parallel to the long side 10. It is to be noted that, in the illustrated embodiment, this direction is also substantially parallel to lines 11 a-11 e defined by pairs of elements in a set formed by peripheral transmitters 4 f-4 h on the short side 7, peripheral receivers 5 e,5 f on the short side 7, and receivers 12 a-12 c and transmitters 13 a-13 b included in the movable barrier 6. Where the aperture of the receivers 5 e,5 f,12 a-12 c is so small that only the light from transmitters 4 f-4 h,13 a,13 b directly opposite is detected, movement of the movable barrier 6 in a direction parallel to the lines 11 a-11 e of sight does not need to be followed by re-calibration. In embodiments where light is emitted and detected at wider angles, the constrained movement simplifies the re-calibration process, in which normally clear lines of sight are identified for each peripheral transmitter.
In the illustrated embodiment, a control apparatus 14 is associated with the surface 2, by being included in the device of which the surface 2 is a part. The control apparatus 14 includes a processor 15 and memory 16, as well as a transceiver 17. The transceiver 17 is provided for signalling between the control apparatus 14 and the peripheral transmitters 4 a-4 p, the peripheral receivers 5 a-5 l, receivers 12 a-12 f included in the movable barrier 6, transmitters 13 a-13 d included in the movable barrier 6 and a drive apparatus 18 included in the movable barrier 6.
The drive apparatus 18 allows the control apparatus 14 to position the movable barrier 6 with respect to the surface 2. Thus, the relative sizes of the left and right regions 8,9 can be adjusted. Where the peripheral transmitters 4 and/or transmitters 13 included in the movable barrier 6 emit light over a relatively wide angle, movement of the barrier 6 will affect the number of peripheral receivers 5 and/or receivers 12 included in the movable barrier 6 with which they define lines of sight.
FIG. 2 illustrates a method carried out by the control apparatus 14. In a first step 19, the position of the movable barrier 6 is determined. Where the control apparatus 14 controls the position of the movable barrier 6 by means of the drive apparatus 18, this step 19 can involve a form of dead reckoning. In an alternative embodiment, a row of transducers (not shown) at the long side 10 of the surface 2 communicates the position of the movable barrier 6 to the control apparatus 14 through the transceiver 17. In yet another embodiment, one or more of the peripheral transmitters 4 a-4 p may be activated in turn, with the position of the movable barrier 6 being inferred from the identity of those peripheral receivers 5 a-5 l and/or receivers 12 a-12 f included in the movable barrier 6 able to detect the emitted light. Thus, the movable barrier 6 is located on the surface 2 in this first step 19.
In a next step 20, it is determined in which of the left and right regions 8,9 the object 3 is to be located. In the illustrated embodiment, only those elements covering the right region 9 are used to locate the object 3.
A calibration measurement is performed (step 21) in the absence of the object 3. With this measurement, it is determined for each of the selected peripheral transmitters 4 d-4 j and transmitters 13 a,13 b included in the movable barrier 6, which of the peripheral receivers 5 c-5 h and receivers 12 a-12 c included in the movable barrier 6 are able to detect a signal from that peripheral transmitter or transmitter included in the movable barrier 6. Thus, pairs of elements defining normally clear lines of sight are determined, wherein elements of at least some of the pairs are included in the movable barrier 6.
Next, the normally clear lines of sight blocked by the object 3 are identified (step 22) by evaluating for each transmitter 4 d-4 j, 13 a,13 b in turn, the responses of peripheral receivers 5 c-5 h and receivers 12 a-12 c included in the movable barrier 6 able to detect the signal from that transmitter in the absence of the movable object 3. With this information, the shape and location of the (passive) object 3 can be determined. Of course, the accuracy with which the shape and location are determined depends on the number and placement of the elements. To that extent, an estimate of the shape and location is determined in the final step 22.
The method by which the shape and location of the object 3 is inferred from the identification of blocked normally clear lines of sight may be one of several. Where the peripheral transmitters 4 d-4 j, transmitters 13 a,13 b included in the movable barrier 6, peripheral receivers 5 c-5 h and receivers 12 a-12 c included in the movable barrier 6 are configured such that there is only one line of sight from each transmitter, and the lines of sight form a regular grid, then it is simply enough to approximate the location and shape by the squares or rectangles of the grid defined by crossing blocked lines of sight.
In most embodiments, a variant of the methods outlined in WO 2006/095320 is used. Reference is made to that publication for implementation details. Briefly stated, the method involves continuous execution of the final step 22 over multiple cycles of operation. Within a single cycle of operation each transmitter is turned on for a pre-determined turn-on time. During each cycle of operation in the operational mode, minimum and maximum area estimates are made and stored for each light transmitter. A minimum area estimate is determined as a region bounded by lines from the transmitter and the outermost ones of the blocked normally clear lines of sight and the edge of the right region 9 between those receivers. The maximum area estimate is defined by points including the receivers adjacent to those defining corners of the minimum area. The minimum and maximum area estimates, once determined, are stored for each light transmitter for the current cycle of operation. After a complete cycle of operation, the stored minimum and maximum area estimates are retrieved. The maximum area estimates for each of the light transmitters over one cycle of operation are combined through a mathematical intersection to derive a maximum area result. The minimum area estimates are combined through a mathematical intersection to achieve a total minimum area result. The minimum area result is then combined through a mathematical intersection with the maximum area result to ensure that the minimum area is completely inside the maximum area.
It will be clear from the above that the final step 22 is repeatedly carried out in the presence of a moving object, whereas the preceding steps 19-21 need only be carried out once at the start and every time the movable barrier 6 is displaced.
FIG. 3 shows a second interactive system 23. It includes a surface 24 of finite extent, on which objects may be placed, either in touching relationship or in close proximity to the surface 24. Also in variants of this embodiment, the surface 24 covers a screen of a display device. In other variants, the surface 24 is opaque and patterned into a playing surface for a board game.
The second interactive system 23 is provided with a plurality of active elements. These include peripheral transmitters 25 a-25 p and peripheral receivers 26 a-26 l. The peripheral transmitters 25 and peripheral receivers 26 are placed at a perimeter of the surface 24. The peripheral transmitters 25 and peripheral receivers 26 correspond to the peripheral transmitters 4 and peripheral receivers 5 of the interactive system 1 illustrated in FIG. 1 and described above.
A control apparatus 27 includes a processor 28 and memory 29. The control apparatus 27 further includes a wired transceiver 30 for individually activating the peripheral transmitters 25 and for obtaining response signals from the peripheral receivers 26. A wireless transceiver 31 is provided as well. An example is compliant with the Bluetooth or Zigbee standards. In an alternative embodiment, the wireless transceiver 31 is configured to emit and receive Infrared communications signals.
One active object 32 is illustrated in FIG. 3. The active object 32 is movable across the surface 24, in the sense that it can be lifted off the surface 24 and placed at a different location. The active object 32 includes a controller 33 and a wireless transceiver 34 configured to exchange data with the wireless transceiver 31 of the control apparatus 27. In an alternative embodiment, the wireless transceiver 31 is omitted, the active object 32 includes a wired transceiver, and a wired communications link is provided between the control apparatus 27 and the active object 32.
In a variant of the second interactive system 23, the active object 32 includes a drive apparatus for propelling the active object 32 across the surface 24. The control apparatus 27 controls the drive apparatus remotely to position the active object 32 on the surface 24. In one variant, this allows the second system 23 to implement a game, where the active object 32 represents one of the playing pieces of the player's opponent, for example.
The active object 32 also participates in locating further objects on the surface 24. To this end, it includes further transmitters 35 a-35 d and further receivers 36 a-36 d of the same type as the peripheral receivers 26 and peripheral transmitters 25. The peripheral transmitters 25, further transmitters 35, peripheral receivers 26 and further receivers 36 are, as can be seen, in such a configuration as to form a plurality of pairs of a transmitter and a receiver able to detect a signal from the transmitter in the absence of the object or objects to be located. As in the embodiment of FIG. 1, each such pair of transmitter and receiver defines one of a plurality of normally clear lines of sight, at least some of which are at an angle to each other. This is true regardless of the position of the active object 32.
FIG. 4 illustrates an embodiment of a method carried out by the second interactive system 23 under the control of the control apparatus 27. FIGS. 5-8 illustrate phases during the execution of the method.
In order to accommodate a variable number of further active objects in addition to the active object 32, a first step 37 includes registering the active object 32 and any further active objects (not shown, for reasons of clarity). The active object 32 signals its presence to the control apparatus 27, for example using the communications link provided by the wireless transceivers 31,34. In one embodiment, it signals its presence in response to a signal emitted by the control apparatus 27 and addressed to no active object in particular. In another embodiment, it continually signals its presence until an acknowledgment is received from the control apparatus 27 associated with the surface 24.
Upon registering the active object 32, the control apparatus 27 determines its position on the surface 24 (step 38). In variants in which the control apparatus 27 controls a drive apparatus in the active object 32 to position the active object 32 on the surface 24, it may be sufficient to use a system of dead reckoning to implement this step 38. In the illustrated example, the position of the active object 32 is determined using the method described in WO 2006/095320 and above, but using only the peripheral transmitters 25 and the peripheral receivers 26.
FIG. 5 shows one step in a calibration cycle, carried out in the absence of the active object 32. Each of the peripheral transmitters 25 a-25 p is activated in turn, and those of the peripheral receivers 26 a-26 l able to detect the light emitted by that peripheral transmitter 25 are recorded in a table against the activated peripheral transmitter 25. Thus, as illustrated in FIG. 5, when a first peripheral transmitter 25 a is activated by the control apparatus 27 by providing the appropriate signal through the wired transceiver 30, peripheral receivers 26 f-26 l are recorded against the first peripheral transmitter 25 a. The pairs of the first peripheral transmitter 25 a and each respective one of those peripheral receivers 26 f-26 l able to detect its signal define normally clear lines of sight.
In the presence of the active object 32 (FIG. 6), the peripheral transmitters 25 a-25 p are again activated in turn by the control apparatus 27. FIG. 6 shows the situation when the first peripheral transmitter 25 a is activated. The shadow cast by the active object 32 covers an area 39. The minimum estimate of this area is empty in this case, because only one line of sight between the first peripheral transmitter 25 a and a peripheral receiver 26 g is blocked. The maximum area estimate is an area defined by the first peripheral transmitter 25 a, the lower right-hand corner of the surface 24 and the first peripheral receivers 26 f, 26 h not covered by the shadow area 39.
After minimum and maximum area estimates have been obtained for each of the peripheral transmitters 25 a-25 p, the area covered by the active object 32 is determined in the manner outlined above with regard to the first interactive system 1 and in WO 2006/095320.
It is noted that in this step 38, the shape of the active object 32 is determined in relation to the surface 24. Using knowledge of its configuration, in particular the relative location of the edges of the active object 32, its orientation about an axis normal to the surface 24 can be determined. Thus, the control apparatus 27 is able to infer the locations of the further transmitters 35 and further receivers 36 included in the active object 32. In principle, this knowledge can be used to skip a next step 40 of the example, in which a further calibration measurement is carried out, in the presence of the active object 32, but in the absence of any inactive objects.
In this step 40, the further transmitters 35 a-35 d are also activated in turn, and the responses of the further receivers 36 a-36 d and peripheral receivers 26 a-26 l are evaluated to identify normally clear lines of sight. Some of these lines of sight terminate at the active object 32, of course.
FIGS. 7 and 8 illustrate a final step 41, which is carried out repeatedly for as long as the active object 32 does not change position. In this step 41, each of the peripheral transmitters 25 a-25 p and further transmitters 35 a-35 d is activated in turn, and the responses of the peripheral receivers 26 a-26 l and further receivers 36 a-36 d are evaluated in order to identify normally clear lines of sight blocked by an inactive object 42 placed on the surface 24. Having identified the normally clear lines of sight that are blocked, respective minimum area estimates and maximum area estimates of the inactive object 42 are made for each of the peripheral transmitters 25 a-25 p and further transmitters 35 a-35 d. These are combined to determine the shape and location of the inactive object 42.
The use of the active object 32 including the further transmitters 35 a-35 d and further receivers 36 a-36 d improves the accuracy of the estimate due to the proximity of the further transmitters 35 a-35 d and further receivers 36 a-36 d to the inactive object, and the close mutual spacing of these elements.
FIG. 7 shows the situation where the first peripheral transmitter 25 a is activated. The inactive object 32 casts a shadow defining a shadow area 43 on the surface 24. Of the four further receivers 36 a-36 d, a first and fourth receiver 36 a, 36 d, counting clockwise around the edges of the active object 32, are normally able to detect light from the first peripheral transmitter 25 a. Thus, for the first peripheral transmitter 25 a, the minimum area is defined by the first peripheral transmitter 25 a itself, the fourth further receiver 36 d and a peripheral receiver 26 h. The maximum area is defined by the first peripheral transmitter 25 a, the first further receiver 36 a and another peripheral receiver 26 i. It will be apparent that the elements included in the active object 32 reduce the minimum and maximum area estimates associated with the first peripheral transmitter 25 a.
FIG. 8 illustrates the situation where the first further transmitter 35 a included in the active object 32 is activated. In this case, the minimum and maximum area estimates are empty, because the inactive object 42 blocks no normally clear lines of sight between the first further transmitter 35 a and one of the peripheral receivers 26 a-26 l. These estimates are not taken into account when determining the position and shape of the inactive object 42. In a variant in which the active object 32 includes a drive apparatus, the active object 32 may be moved at this stage, in order to establish lines of sight that are blocked by the inactive object. In that case, the two preceding steps 38,40 would be repeated.
By including at least one further element, e.g. at least one further transmitter 35 and/or receiver 36 in the movable active object 32, additional lines of sight can be provided in a region of the surface 24 in which an inactive object 42 is present. Thus, further minimum area and maximum area estimates with a higher resolution are provided to establish the total minimum area estimate and total maximum are estimate. In the end, the shape and position of the inactive object 42 can thus be determined with a higher resolution. Moreover, separate inactive objects located in close proximity to each other can be distinguished where they would otherwise be perceived as a single object.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. Use of the verb “comprise” and its conjugations does not exclude the presence of elements or steps other than those stated in a claim. The article “a” or “an” preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
In variants, fewer than all of the transmitters may be activated in turn to obtain fewer than the maximum possible number of minimum and maximum area estimates, if it is determined that some of the transmitters emit signals in a direction away from the object to be located. The embodiments of FIG. 1 and FIGS. 5-7 may be combined, such that both the active object 32 and the movable barrier 6 are placed over a particular surface. The number of peripheral transmitters 4,25 and peripheral receivers 5,26 will tend to be higher in practical embodiments than is shown in the drawings.

Claims (17)

1. A method of locating an object placed on a surface, the method comprising the steps of:
providing a plurality of elements including a plurality of wireless transmitters and a plurality of wireless receivers, in such a configuration as to form a plurality of pairs of a transmitter and a receiver able to detect a signal from the transmitter in the absence of the object, each such pair defining one of a plurality of normally clear lines of sight, at least some of which are at an angle to each other;
providing a further object that comprises at least one element of the plurality of pairs of a transmitter and a receiver;
activating at least some of the wireless transmitters in the presence of the object; and
identifying normally clear lines of sight blocked by the object by evaluating responses of the receivers of at least some of the pairs of a transmitter and a receiver able to detect a signal from the transmitter, wherein identifying normally clear lines of sight blocked by the object further comprises (i) evaluating responses of the receivers of the at least one element of one of the pairs included in said further object, and (ii) partitioning the surface into regions of variable extent by moving said further object across the surface, wherein the further object simplifies determination of a position of the object to be located by cutting out signals crossing a region other than that in which the object to located is present.
2. The method as claimed in claim 1, wherein the method further comprising the step of:
establishing a communication link between the further object and a control apparatus associated with the surface.
3. The method as claimed in claim 2, wherein the communication link is a wireless communication link.
4. The method as claimed in claim 1, wherein a control apparatus locates the further object on the surface.
5. The method as claimed in claim 2, wherein the further object signals its presence to the control apparatus, and wherein the method further comprises the steps of:
registering the further object including the at least one element; and
locating the further object on the surface upon its registration.
6. The method as claimed in claim 1, wherein said method further comprises the step of:
determining an orientation of the further object relative to a co-ordinate system fixed with respect to the surface.
7. The method as claimed in claim 1, wherein the further object is provided with plurality of edges at an angle to each other in a plane parallel to the surface, and wherein the method further comprises the step of:
determining the shape of the further object by identifying normally clear lines of sight blocked by the further object and defined by pairs of a transmitter and a receiver arranged around the further object.
8. The method as claimed in claim 1, wherein the further object extends across at least a major part of a dimension of the surface, so as to define regions of the surface separated by the further object.
9. The method as claimed in claim 8, wherein said method further comprises the step of:
identifying normally clear lines of sight blocked by the object by evaluating responses of the receivers of at least some of only those pairs of a transmitter and a receiver able to detect a signal from the transmitter that define lines of sight across one of the regions.
10. The method as claimed in claim 1, wherein the further object is constrained in its movement across the surface to translations parallel to a line of sight defined by a pair of a wireless transmitter and receiver of which one is included in the further object.
11. The method as claimed in claim 1, wherein the further object includes a drive apparatus for propelling the further object across the surface, and wherein the method further comprises the step of:
controlling the drive apparatus remotely from the further object to position the further object on the surface.
12. A system for locating an object placed on a surface, the system comprising:
a control apparatus for controlling a plurality of elements including a plurality of wireless transmitters and a plurality of wireless receivers, in such a configuration as to form a plurality of pairs of a transmitter and a receiver able to detect a signal from the transmitter in the absence of the object, each such pair defining one of a plurality of normally clear lines of sight, at least some of which are at an angle to each other;
the control apparatus further for activating at least some of the wireless transmitters in the presence of the object, and identifying normally clear lines of sight blocked by the object by evaluating responses of the receivers of at least some of the pairs of a transmitter and a receiver able to detect a signal from the transmitter; and
at least one further object that comprises at least one element of the plurality of pairs of a transmitter and a receiver, wherein said control apparatus is further for identifying normally clear lines of sight blocked by the object that further comprises (i) evaluating responses of the receivers of the at least one element of one of the pairs included in said at least one further object, and (ii) partitioning the surface into regions of variable extent by moving said at least one further object across the surface, wherein said at least one further object simplifies determination of a position of the object to be located by cutting out signals crossing a region other than that in which the object to located is present.
13. The system as claimed in claim 12, wherein the control apparatus is associated with the surface, and wherein the system further comprises a communication link between the further object and the control apparatus.
14. The system as claimed in claim 12, wherein said system is arranged to carry out a method of locating an object placed on a surface, the method comprising the steps of:
providing a plurality of elements including a plurality of wireless transmitters and a plurality of wireless receivers, in such a configuration as to form a plurality of pairs of a transmitter and a receiver able to detect a signal from the transmitter in the absence of the object, each such pair defining one of a plurality of normally clear lines of sight, at least some of which are at an angle to each other;
activating at least some of the wireless transmitters in the presence of the object; and
identifying normally clear lines of sight blocked by the object by evaluating responses of the receivers of at least some of the pairs of a transmitter and a receiver able to detect a signal from the transmitter, wherein at least one element of one of the pairs of which the response of the receiver is evaluated is included in a further object, said further object being movable across the surface.
15. An object for movable arrangement on or over a surface and including an element in such a configuration to form part of at least some of the pairs of a transmitter and a receiver of which the control apparatus in the system as claimed in claim 12 is arranged to evaluate the response of the receiver.
16. A non-transitory computer-readable medium having stored thereon a computer program including a set of instructions for causing a system, having information processing capabilities and including a plurality of elements including a plurality of wireless transmitters and a plurality of wireless receivers, in such a configuration as to form a plurality of pairs of a transmitter and a receiver able to detect a signal from the transmitter in the absence of the object, each such pair defining one of a plurality of normally clear lines of sight, at least some of which are at an angle to each other, to perform the method as claimed in claim 1.
17. The object as claimed in claim 15, wherein said object further comprises a drive apparatus for positioning the object with respect to the surface.
US12/524,728 2007-01-29 2008-01-23 Method and system for locating an object on a surface Expired - Fee Related US8199055B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP07101284 2007-01-29
EP07101284.3 2007-01-29
EP07101284 2007-01-29
PCT/IB2008/050228 WO2008093258A1 (en) 2007-01-29 2008-01-23 Method and system for locating an object on a surface

Publications (2)

Publication Number Publication Date
US20100045530A1 US20100045530A1 (en) 2010-02-25
US8199055B2 true US8199055B2 (en) 2012-06-12

Family

ID=39296039

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/524,728 Expired - Fee Related US8199055B2 (en) 2007-01-29 2008-01-23 Method and system for locating an object on a surface

Country Status (9)

Country Link
US (1) US8199055B2 (en)
EP (1) EP2126674B1 (en)
JP (1) JP5302216B2 (en)
CN (1) CN101595448B (en)
AT (1) ATE475135T1 (en)
BR (1) BRPI0807426A8 (en)
DE (1) DE602008001883D1 (en)
RU (1) RU2468415C2 (en)
WO (1) WO2008093258A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8712679B1 (en) * 2010-10-29 2014-04-29 Stc.Unm System and methods for obstacle mapping and navigation

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130217491A1 (en) * 2007-11-02 2013-08-22 Bally Gaming, Inc. Virtual button deck with sensory feedback
US8540569B2 (en) * 2008-09-05 2013-09-24 Eric Gustav Orlinsky Method and system for multiplayer multifunctional electronic surface gaming apparatus
MX2012010864A (en) 2010-03-22 2013-04-03 Mattel Inc Electronic device and the input and output of data.
US9977503B2 (en) * 2012-12-03 2018-05-22 Qualcomm Incorporated Apparatus and method for an infrared contactless gesture system
CN103914165B (en) * 2013-01-05 2018-04-27 联想(北京)有限公司 A kind of recognition methods and device based on multiconductor screen, electronic equipment
CN104216549B (en) * 2013-06-04 2018-10-12 联想(北京)有限公司 A kind of information processing method and electronic equipment
EP3623920A1 (en) * 2018-09-13 2020-03-18 Vestel Elektronik Sanayi ve Ticaret A.S. Interactive display screen

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997013563A1 (en) 1995-10-10 1997-04-17 Durand (Assignees) Limited Game board with light directing means
US20020067348A1 (en) 1999-12-02 2002-06-06 Masters Timothy E. Apparatus and method to improve resolution of infrared touch systems
US20020075243A1 (en) 2000-06-19 2002-06-20 John Newton Touch panel display system
US6761634B1 (en) 2001-06-07 2004-07-13 Hasbro, Inc. Arcade table
US20050251800A1 (en) 2004-05-05 2005-11-10 Microsoft Corporation Invoking applications with virtual objects on an interactive display
WO2006033036A2 (en) 2004-09-21 2006-03-30 Koninklijke Philips Electronics N.V. Game board, pawn, sticker and system for detecting pawns on a game board
WO2006095320A2 (en) 2005-03-10 2006-09-14 Koninklijke Philips Electronics, N.V. System and method for detecting the location, size and shape of multiple objects that interact with a touch screen display
US20060224598A1 (en) 2005-03-29 2006-10-05 Jeffrey Thielman Communication device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2029353C1 (en) * 1992-07-15 1995-02-20 Владимир Михайлович Киселев Touch-sensitive control panel for data input
JP3980798B2 (en) * 1999-08-19 2007-09-26 株式会社リコー Written information input system
JP4014535B2 (en) * 2003-04-25 2007-11-28 シャープ株式会社 Optical movement amount detection device, electronic apparatus, and conveyance processing system
US7636449B2 (en) * 2004-11-12 2009-12-22 Cognex Technology And Investment Corporation System and method for assigning analysis parameters to vision detector using a graphical interface

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997013563A1 (en) 1995-10-10 1997-04-17 Durand (Assignees) Limited Game board with light directing means
US20020067348A1 (en) 1999-12-02 2002-06-06 Masters Timothy E. Apparatus and method to improve resolution of infrared touch systems
US20020075243A1 (en) 2000-06-19 2002-06-20 John Newton Touch panel display system
US6761634B1 (en) 2001-06-07 2004-07-13 Hasbro, Inc. Arcade table
US20050251800A1 (en) 2004-05-05 2005-11-10 Microsoft Corporation Invoking applications with virtual objects on an interactive display
WO2006033036A2 (en) 2004-09-21 2006-03-30 Koninklijke Philips Electronics N.V. Game board, pawn, sticker and system for detecting pawns on a game board
WO2006095320A2 (en) 2005-03-10 2006-09-14 Koninklijke Philips Electronics, N.V. System and method for detecting the location, size and shape of multiple objects that interact with a touch screen display
US20060224598A1 (en) 2005-03-29 2006-10-05 Jeffrey Thielman Communication device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8712679B1 (en) * 2010-10-29 2014-04-29 Stc.Unm System and methods for obstacle mapping and navigation

Also Published As

Publication number Publication date
RU2009132508A (en) 2011-03-10
JP5302216B2 (en) 2013-10-02
EP2126674A1 (en) 2009-12-02
CN101595448B (en) 2013-09-04
US20100045530A1 (en) 2010-02-25
ATE475135T1 (en) 2010-08-15
BRPI0807426A2 (en) 2014-07-22
RU2468415C2 (en) 2012-11-27
CN101595448A (en) 2009-12-02
EP2126674B1 (en) 2010-07-21
JP2010517157A (en) 2010-05-20
WO2008093258A1 (en) 2008-08-07
DE602008001883D1 (en) 2010-09-02
BRPI0807426A8 (en) 2015-10-13

Similar Documents

Publication Publication Date Title
US8199055B2 (en) Method and system for locating an object on a surface
EP3387516B1 (en) Improved stylus identification
US8963088B2 (en) Passive infrared range, size, and direction finding proximity detector
CN104094594B (en) 3D scales imager
JP7364570B2 (en) Interaction systems and methods
JP2020500310A5 (en)
JP5016049B2 (en) Determining target direction
US10441866B2 (en) Method and system for determining whether a spherical element impacts with a component of a playing field, or arranged on or proximate thereto
US11058280B2 (en) Dishwasher
JP6347918B2 (en) System and method for guiding a mobile device
AU2014255637B2 (en) Method and system for determining if a spherical element strikes a component of a playing field, or on or close to same
CN102597796A (en) Two-dimensional position sensing systems and sensors therefor
EP2165249A1 (en) Method of processing data generated by a user input device for indicating positions
JP2018097388A (en) User interface apparatus and user interface system
JP2010145328A (en) System and method for detection of object, and tag communication apparatus
JP5637786B2 (en) Camera calibration device
TWI725329B (en) Two-dimensional code and two-dimensional code reading device
JP5793055B2 (en) Platform door safety device
US20070194215A1 (en) Directional input device with a light directing shaft
JP2021029677A (en) Placement state management device, placement state management method, and placement state management program
JP7184187B2 (en) Wireless tag position detection system
JP2019045381A (en) Space recognition device, space recognition method, and program
JP2007183179A (en) Position detecting system and program
JP2007035076A (en) Position detection apparatus using area image sensor
JP2022030365A (en) Information processor, program, and information processing method

Legal Events

Date Code Title Description
AS Assignment

Owner name: KONINKLIJKE PHILIPS ELECTRONICS N V,NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:VAN DE WIJDEVEN, SANDER BERNARD FRANCIS;REEL/FRAME:023012/0132

Effective date: 20080129

Owner name: KONINKLIJKE PHILIPS ELECTRONICS N V, NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:VAN DE WIJDEVEN, SANDER BERNARD FRANCIS;REEL/FRAME:023012/0132

Effective date: 20080129

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20200612