WO2005029310A2

WO2005029310A2 - Communication through arrangement of symbolic objects

Info

Publication number: WO2005029310A2
Application number: PCT/IB2004/051790
Authority: WO
Inventors: George Marmaropoulos; Giang Vu; Yassar Alsafadi; Amr Yassin; Katie Zhu
Original assignee: Koninklijke Philips Electronics, N.V.
Priority date: 2003-09-22
Filing date: 2004-09-17
Publication date: 2005-03-31
Also published as: TW200521850A; WO2005029310A3

Abstract

E-mail communication is afforded to young children not yet able to operate the user interface or to form or read e-mail messages. The child arranges symbolic blocks on a peg board in an arrangement that conveys a message which the system translates into language. The child also places on or near the pegboard a token to which a picture is affixed, the token containing the e-mail address of an intended recipient of the message, e.g. daddy. The language-form message is then transmitted by the system to the recipient as an e-mail message. The recipient can send back a symbolic counterpart of a message by entering the message in language form so that the symbolic counterpart is then displayed on the LCD of the peg board.

Description

COMMUNICATION THROUGH ARRANGEMENT OF SYMBOLIC OBJECTS

The present invention relates to communication and particularly to communication through arrangement of symbolic objects. The World Wide Web and its Internet infrastructure have changed the way people communicate. Despite this fact, it is still a world based on a specific paradigm: the browser/e-mail paradigm, which restricts access and use by children of 2-4 years of age for example. Although children of this age are eager to communicate with other children or loved ones, the current interaction paradigm makes it impossible for children of this age to take advantage of this amazing communication tool. The present invention is directed to overcoming the above -mentioned shortcomings of the prior art. In an aspect of the present invention, there is provided a symbolic -interfaced communicating apparatus that includes a surface for supporting different symbolic objects arranged laterally across the surface in any one of multiple lateral arrangements . The apparatus further includes a symbolic interpreter configured for detecting a current one of the arrangements and for producing, based on the detected arrangement, an encoded message semantically representative of the detected arrangement. A user of the present invention, typically a child young enough to lack the ability to effectively send e-mail messages, can instead manually insert symbolic objects such as blocks into a peg board to form an arrangement semantically representative of the intended message. In an exemplary embodiment, embedded in each of the blocks is a unique identifier which can be read by the peg board. Upon completion of the message, the child may operate an actuator such as by pressing a button to send the message. Alternati vely and preferably, the child is provided with a token into which is physically encoded an e-mail address of the recipient, and the child places the token into a token reader that may be attached or incorporated into the peg board. Each token uniquely id entities a respective e-mail destination. The peg board preferably includes a screen for displaying received messages. Accordingly, a child or other individual lacking in computer facility can easily communicate via e-mail with others. Details of the invention disclosed herein shall be described with the aid of the figures listed below, wherein like features are numbered identically throughout the several views: FIG. 1 is a block diagram depicting a system for communicating by e-mail between a symbolic-interfaced communicating apparatus and another e-mail correspondent apparatus in accordance with the present invention; FIG. 2 is a perspective diagram of a symbolic -interfaced communicating apparatus and symbolic objects usable to communicate by e-mail in the system of FIG. 1 in accordance with the present invention; and; FIG. 3 is a conceptual diagram illustrating invariance of message selection with positional translation of the symbolic object arrangement in accordance with the present invention; FIG. 1 depicts, by way of non -limitative example, a system 100 for communicating by e-mail between a symbolic -interfaced communicating apparatus 104 and another e-mail correspondent apparatus 108 in accordance with the present invention. Communication between the child or user 112 and a recipient user of the correspondent apparatus 108 such as an adult or older child via respective local electronic mail servers 116, 120 located throughout the Internet 124 or via another network. The symbolic-interfaced communicating apparatus 104 includes a peg board or pad 128, a symbolic interpreter 132 and a transmitter 136. The pad 128 which may be designed to resemble a LEGO™ block pad has a top surface 140 with an array of pegs (not shown) onto which symbolic objects 144 such as blocks can be inserted or otherwise supported. The blocks are designed to represent common words, people and emotions, such as boy, girl, mom, dad, grandpa, grandma, dog, love, house, etc. This representation is conveyed by the shape of the block and/or, for instance, an image affixed to or engraved in the block. For example, a block shaped like a heart may represent the verb "love." In a preferred embodiment, each block 144 is equipped internally with a radio frequency identifier (RF-ID) tag 148 for wireless communication of an identifier that is unique to the block, or to the type of block if a number of blocks are identical. A tag reader 152 may be located near the bottom of the pad 128 or underneath the pad surface 140 and comprises, in one embodiment, a grid of tag reading devices aligned positionally in one-to- one correspondence with the pegs above on the peg board surface 140. The RF-ID tag 148 is a passive device having an antenna circuit and an integrated circuit (IC). The antenna is tuned to a transmitting frequency of the tag reading devices, typically for example 125 kHz or 13.56 MHZ. The received signal is modulated with the unique identifier of the respective block 144 to create a modulated signal that is then transmitted back to the tag reading device, as described in U.S. Patent No. 6,268,796 to

Gnadinger et al. ("Gnadinger"), the entire disclosure of which is hereby incorporated herein by reference. Each tag reading device comprises an antenna circuit an d an IC incorporating a frequency generator for generating the transmitting frequency. The IC also has circuitry for detecting the unique identifier in the received signal to identify the block 144 and for measuring the RF voltage level in its antenna circuit. The latter quantity is used to determine where on the pad surface 140 the block 144 is located. A tag reading device which measures RF voltage level in its antenna circuit is described in U.S. Patent No. 6,317,027 to Watkins, the entire disclosure of which is incorporated herein by reference. The pad 128 further includes a token reader 156 and a display 160 such a liquid crystal display (LCD) for displaying transmitted messages in alphanumeric and received messages in symbolic form. The token reader 156 and the tokens may be configured for wireless communication in a manner similar to that of the tag reader 152 and blocks 144, respectively, except that the voltage measurement circuitry of the tag reader 152 would not be needed for the token reader 156. Preferably, the token is marked externally for easy identification by the child, as with a photograph or other depiction of the person to receive the e-mail. Although the peg board 128 is shown in a horizontal position, it is not limited to that position, and may for example be disposed vertically to support blocks 144 that are inserted onto the surface 140. A pad 128 without pegs is also within the intended scope of the invention. In addition, communication between the tag reader 152 and the bio cks 144 and/or between the token reader 156 and the tokens is not limited to RF means or wireless implementation, but instead may operate by wire line connection or other known and appropriate means. Included within the symbolic interpreter 132 is a message locator 164 in a non- volatile electronic storage medium such a programmable read -only memory (PROM), flash memory, etc. The message locator may be represented in PROM for example as computer-executable instructions. An additional data memory 168 such as a random access memory (RAM) of the symbolic interpreter 132 stores data such as pre -stored messages. The symbolic interpreter 132 receives input signals from the tag reader 152 and token reader 156 and transmits signals to the LED 160. The transmitter 136 contains electronic mail client software 172, also in a non-volatile electronic storage medium, and a respective RAM 176 which serves as working data storage for the software. Two way communicative connections exist between the transmitter 136 and the message locator 164 and between the transmitter and the electronic mail server 116. Although the transmitter 136 is depicted in FIG. 1 as a separate module, it may be incorporated into the symbolic interpreter 132, e.g., as microprocessor chip and RAM in a microcomputer such as a personal computer (PC). The modules may alternatively be configured, for example, within a set -top box connected to a telephone line. It is also within the intended scope of the present invention that these processing elements may be implemented in any combination of software, hardware and firmware in any known and suitable manner. The e-mail correspondent apparatus includes a display 180, a recipient processor 184, and an input device 188 such as a keyboard or keypad. T he recipient processor 184 includes an electronic mail client 192 that communicates bi -directionally with the local electronic mail server 120. The recipient processor also has respective links to the input and output devices 188, 180. In a preferred emb odiment, the recipient processor includes the capability to not only formulate for display in alphanumeric form a message received over the Internet 124, but to translate language elements, such as words or phrases, of the message back into their symbolic counterparts 196 for display on the screen 180 along with the words of the message 198. That latter function is performed by a translation program 194. The translation may be accomplished by means of a table in a recipient processor memory module (not shown). In an additional aspect of that preferred embodiment, any return message entered by means of the input device 188 is similarly echoed on the screen 180 in real time both in language and symbolic form. FIG. 2 illustrates an exemplary embodiment 200 of the symbolic-interfaced communicating apparatus 104 in accordance with the present invention. Also shown is a block 204 depicting a dog, although other living beings, cartoon characters, etc. may be represented. As shown on the surface 140 of the peg board 128, the robot figurine 216 depicts on its chest the face of and individual recognized by the child 112 and represents that individual. A current lateral arrangement 208 of robot figurines 216, 218 and of a heart 220 is illustrated. The LED 160 shows the message "I love you grandpa." This message has previously been sent out to the recipient processor 184 by e-mail and corresponds to a previous arrangement defined by placement of the heart block 220 between the child's block and the grandpa block (not shown). Accordingly, that previous arrangement semantically represents the message "I love you grandpa." A proximity criterion of the respective blocks and a criterion as to when a block is deemed to be "between" two other blocks are utilized by the message locator 164 in determining whether the detected arrangement matches a predefined arrangement that has been stored in RAM 168, that predefined arrangement being linked by a pointer to the message represented by the predefined arrangement. Although in this example, the quality of one object being between two others is a characteristic that defines an arrangement and upon which respective message depends, the invention need not take into account this characteristic in defining a particular arrangement. For example, if a block 144 portrays a "happy face" icon, its placement on the peg board 128 along with a dog block might be detected as a predefined arrangement, or alternatively its placement within a predetermined proximity of the dog block may match a predefined arrangement. The embodiment 200 of the apparatus as shown in FIG. 2 features the token reader 160 formed in a dish shape, and the top surface 140 of the apparatus includes a send button 216 that flashes when a both a match is detected for the detected arrangement and a valid e-mail address is read from a token by the token reader 160. The apparatus further includes a speaker (not shown) for making a confirmation sound when the flashing button is pressed. It is within the intended scope of the invention to accommodate other iconic symbols not shown in FIG. 2, such as a block showing the number "2" usable to represent the word "too" for example, as in "I love you too." FIG. 3 demonstrates how the message retrieved by the message locator 164 from RAM 168 is invariant with the location of a matched arrangement in accordance with one embodiment of the present invention. An arrangement 304 of blocks on pegs of the top PHUS030340WO 7 PCT/. B2004/051790

surface 140 of the peg board 128 is translated, as indicated by the arrow 308, in two orthogonal directions to create an alternate arrangement 312. Yet, the respective messages 316, 320 represented by the two arrangements are identical. The invention however is not limited to such translational invariance. For example, respecti vely colored zones may be defined on the peg board such that an arrangement accrues meaning by residing in particular zone. In operation, the child 112 inserts blocks 144 onto the peg board 128 to form an arrangement and places a token in the token reader 156. The symbolic interpreter 132 recognizes the arrangement as matching a pre -stored arrangement and causes the button 216 to flash. The child 112 presses the button 216 to send the e-mail message. The symbolic interpreter 132 forwards the matched message from its RAM 168 to the transmitter along with the e-mail address read by the token reader 156. The symbolic inteφreter 132 also forwards the message to the LCD 160 of the child's peg board 128. The electronic mail client software 172, whether belonging separately to the transmitter 136 or whether incoφorated within the symbolic inteφreter 132, encodes the message for transmission and forwards the message and e-mail address to its local electronic mail server 116. The mail server 116 transmits t he message over the Internet 124 to the local electronic mail server 120 that serves the e -mail address. When the recipient processor 184 is operated by its user to access e-mail and, in particular, the e-mail message from the child 112, the message is de coded and displayed on the screen 180. The recipient may enter by the input device 188 a return message which is echoed 198 to the screen. The translation program 194 in the recipient processor 184 translates the message back into their symbolic counteφarts 196 which are then similarly echoed on the screen 180. When the recipient is satisfied with the displayed return message, a key on the input device 188 is pressed to transmit the symbolic counteφarts 196 of the return message to the child 112. The counteφarts 196 takes a reverse path back to the symbolic inteφreter 132, whose message locator 164 forwards them for display on the LCD 160. PHUS030340WO 8 PCT/IB2004/051790

While there have been shown and described what are considered to be preferred embodiments of the invention, it will, of course, be understood that various modifications and changes in form or detail could readily be made without departing from the spirit of the invention. It is therefore intended that the invention be not limited to the exact forms described and illustrated, but should be constructed to cover all modifications that may fall within the scope of the appended claims.

Claims

WHAT IS CLAIMED IS:

1. A symbolic-interfaced communicating apparatus (100) comprising: a surface (140) for supporting different symbolic objects (144) arranged laterally across said surface in any one of multiple lateral arrangements (208) of the symbolic objects; and a symbolic inteφreter (132) configured for detecting (164) a current one of said arrangements and for producing, based on the detected arrangement, an encoded message

(160) semantically representative of the detected arrangement.

2. The apparatus of claim 1, further comprising a message transmitter (136) for transmitting the produced message externally (124) from said apparatus.

3. The apparatus of claim 2, further comprising electronic mail client software for execution (172) by said transmitter to route said encoded message by electronic mail.

4. A system that includes the apparatus of claim 2, said system further including a recipient processor (184) configured for receiving the transmitted message and for displaying (180) the transmitted message, in one form, as alphanumeric characters (198) and, in another form, through depictions of respective ones of said different symbolic objects (196).

5. A system that includes the apparatus of claim 2, said system further including a recipient processor (184) configured for receiving the transmitted message and for translating (194) a responsive message entered by a user o f the recipient processor into depictions of corresponding ones of said different symbolic objects (196).

6. The apparatus of claim 1, further comprising a token reader (156) for reading a token into which a destination for said encoded message is physic ally encoded.

7. The apparatus of claim 1, wherein said symbolic inteφreter comprises: an electronic storage medium (168) for storing, for each of a plurality of predefined arrangements from among said multiple lateral arrangements, respective predetermined messages; and a message locator (164) configured for detecting from said objects comprising said current one of said arrangements and from among the plural predefined arrangements said detected arrangement and for locating a message of said respecti ve predetermined messages that corresponds to said detected arrangement to produce said produced message.

8. The apparatus of claim 1, wherein said symbolic inteφreter further comprises a tag reader (152), said apparatus being configured with said surface being disposed between the tag reader and at least one of the supported symbolic objects of said detected arrangement.

9. A child-motivating system that includes the apparatus of claim 1, said system further including said different symbolic objects of claim 1, wherein one or more of said different symbolic objects comprises a figurine of at least one of a living being (204) and a robot (216, 218).

10. A system that includes the apparatus of claim 1, said system further including said different symbolic objects of claim 1, wherein at least one of said different symbolic objects represents a verb (220) in a respective encoded message produced by the symbolic inteφreter (132).

11. A system that includes the apparatus of claim 1, said system further i ncluding said different symbolic objects of claim 1, wherein at least one of said different symbolic objects contains an identification tag (148) configured for wireless communication.

12. The apparatus of claim 1, wherein the inteφreter is further configured such that the produced message is invariant (316, 320) if a second arrangement is detected (312), wherein said second arrangement is a version of said detected arrangement translated (308) over said surface in either or both of two predetermined mutually orthogonal directions.

13. The apparatus of claim 1, wherein the message is a sentence.

14. The apparatus of claim 1, wherein said encoded message comprises a verb derived from a single one of said objects.

15. A method of communicating by mean s of a symbolic-interfaced communicating apparatus (100), the method comprising the steps of: providing a surface (140) for supporting different symbolic objects (144) arranged laterally across said surface in any one of multiple lateral arrangements (208 ,304,312) of the objects; detecting (132) a current one of said arrangements; and producing (132,136), based on the detected arrangement, an encoded message (160) semantically representative of the detected arrangement.

16. The method of claim 15, further comprising the step of transmitting (136,124) the produced message externally from said apparatus.

1 . The method of claim 16, wherein said transmitting step further includes the step of providing electronic mail client software (172) and a processor (136) for executing said software to route said encoded message by electronic mail.

18. The method of claim 15, further comprising the steps of: physically encoding into a token (148,156) a destination for said encoded message; and reading the token (156).

19. The method of claim 15, further including the step of configuring at least one of said different symbolic objects to contain an identification tag (148) operable for wireless communication.

20. A computer program product contained within a computer-readable medium and executable by a processor, the product comprising: a sequence of instructions for detecting (164) one of plural lateral arrangements (208,304,312) of symbolic objects across a supporting surface (140); and a sequence of instructions for producing an encoded message (160) semantically representative of the detected arrangement.