EP1885466B1 - Toys - Google Patents

Toys Download PDF

Info

Publication number
EP1885466B1
EP1885466B1 EP06726915.9A EP06726915A EP1885466B1 EP 1885466 B1 EP1885466 B1 EP 1885466B1 EP 06726915 A EP06726915 A EP 06726915A EP 1885466 B1 EP1885466 B1 EP 1885466B1
Authority
EP
European Patent Office
Prior art keywords
toy
data
expressive
responses
response
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP06726915.9A
Other languages
German (de)
French (fr)
Other versions
EP1885466B8 (en
EP1885466A2 (en
Inventor
Steven Lipman
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Muscae Ltd
Original Assignee
Muscae Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from GB0508466A external-priority patent/GB2425490A/en
Application filed by Muscae Ltd filed Critical Muscae Ltd
Publication of EP1885466A2 publication Critical patent/EP1885466A2/en
Application granted granted Critical
Publication of EP1885466B1 publication Critical patent/EP1885466B1/en
Publication of EP1885466B8 publication Critical patent/EP1885466B8/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63HTOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
    • A63H3/00Dolls
    • A63H3/28Arrangements of sound-producing means in dolls; Means in dolls for producing sounds
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63HTOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
    • A63H2200/00Computerized interactive toys, e.g. dolls

Definitions

  • This invention relates to toys.
  • this invention relates to toys such as dolls that interact with each other.
  • Embedded computers and micro-processors have improved toys for children. They have been used most extensively in educational toys, but have also been used in interactive toys. ActiMates® Barney®, is one example of an interactive toy which responds to interaction from a child by appropriate vocalisations, and can sing-a-long to videos.
  • the toy comprises means for analysing said expressive responses to select a suitable one such response.
  • the means for analysing said expressive responses to enable a suitable one such response to be selected preferably uses randomisation.
  • the means for analysing said expressive responses to select a suitable one such response is preferably operable to receive and respond to situation data concerning its situation.
  • the data is downloadable to the toy from said computer.
  • the data preferably includes a set of such expressive responses and the expressive responses comprises a set of responses and counter-responses.
  • the counter-responses are preferably compatible with the responses. These counter-responses are preferably adapted to be used by a further such toy in response to the responses of a further such toy.
  • the data is downloadable from a website via the internet.
  • An expressive response means output that communicates a message, such as emotion or language to a human onlooker.
  • This invention involves the realisation that interaction occurs between dolls, and other toys, when children play. By stimulating interaction between dolls, or other toys, this invention encourages such play.
  • the toy may store data, preferably trigger data, received in memory as an expressive response.
  • the expressive response may be a gesture.
  • the expressive response may be a vocalisation.
  • the expressive response may be a phrase, or music or sound.
  • the trigger data broadcast may indicate which expressive response was output.
  • a toy may be operable to broadcast trigger data and/or make an expressive response on a user command.
  • the user command may comprise moving or shaking the toy or squeezing the toy or pressing part of the toy.
  • the toy may be operable to broadcast trigger data and/or make an expressive response when in proximity of a transmitter, such as an infra-red transmitter.
  • the transmitter may be another toy, a docking station, a remote control, or an environment, such as a dolls house.
  • the toy may transmit a signal at timed intervals. Such a signal could act as a proximity signal for another toy.
  • the trigger data may be indicative of the proximity of a second toy.
  • the processor may be operable to analyse the trigger data received for an indication of which expressive response it represents and select an appropriate expressive response.
  • Expressive responses may be ranked and the response may be selected according to rank.
  • the rank of the expressive response may be dependent on the trigger data.
  • the expressive response may be selected using randomisation.
  • Expressive responses may be chosen, preferably randomly chosen from group of responses all of which may have a particular rank.
  • Preferably output of an expressive response depends on some input from child.
  • Such input may comprise triggering a sensor in the toy.
  • the toy may comprise a code segment operable to download expressive responses, themes, or personality data from the internet.
  • the toy may comprise a removable memory. Such a toy may be programmable.
  • the toy may comprise a physical connector.
  • the toy may comprise an electromagnetic transceiver, preferably an infrared, radio-frequency, or bluetooth transceiver.
  • the toy is a doll. It may be generic or a likeness of a sports star, celebrity, or pop star.
  • connection to the network may be physical.
  • the dock may comprise a recharging point for the toy.
  • the expressive response may be a gesture.
  • the expressive response may be a vocalisation.
  • the expressive response may be a phrase.
  • the trigger data broadcast may indicate which expressive response was output.
  • the method may comprise broadcasting trigger data on a user command.
  • the user command may comprise triggering a sensor in the toy, by, for example, shaking the toy or squeezing the toy or pressing part of the toy.
  • the trigger data may be indicative of the proximity of a second toy.
  • the method may comprise analysing the trigger data received for an indication of which expressive response the data represents and selecting an appropriate expressive response.
  • Expressive responses may be ranked and the response may be selected according to rank.
  • the rank of the expressive response may be dependent on the trigger data.
  • the expressive response may be selected using randomisation.
  • Expressive responses may be chosen, preferably randomly chosen, from group of responses all of which may have a particular rank.
  • the output of an expressive response may depend on some input from child.
  • the input may comprise triggering a sensor in the toy.
  • the method may comprise downloading expressive responses, themes, music, or personality data from the internet.
  • Expressive responses may be grouped into a theme.
  • a method of downloading data into a doll comprising logging onto a website; selecting a theme comprising a group of related data; and downloading the theme to the doll.
  • the theme may be expressed by triggers/responses by sound, expression, music or exclamations.
  • Milly 10 and Molly 12 are able to interact more fully with children, and with each other, in such play.
  • Milly 10 and Molly 12 are dolls having generic bodies 14, 16 which may be themed by adding dresses, shoes and accessories.
  • Milly 10 has a generic body 14 which represents a female adult and is themed as a ballerina, being dressed in a tutu with ballet shoes.
  • Molly 12 also has a generic body 16 which represents a female adult, and is themed as a tennis player, having appropriate clothing and bat and ball accessories.
  • the theme may be pre-programmed, determined by the downloaded/inputted data, or set by a key accessory (tennis bat, ballet shoes, or a theme tag) which can be sensed by the doll through its communication system described below.
  • the dolls' bodies may be manipulated into appropriate poses, as shown.
  • each doll has an integrated computer 18 using this computer the dolls are able to interact according to their theme.
  • an acceleration sensor 20 integrated into her body 16 provides a signal which acts as a trigger, causing her to say, for example, "Anyone for tennis?".
  • Molly 12 has a loudspeaker 22 sited under the feature representing her mouth through which her synthesised voice can be heard.
  • This interaction is heard by the children playing with her.
  • the statement is also transmitted via an infrared transceiver 24, conveniently located in her head 26, to any doll in line-of-sight, in this example Milly 10, who receives the transmission at her infrared transceiver 28.
  • Infrared signals may reach the transceivers through the dolls' eyes and ears.
  • Milly's transceiver receives a signal from Molly's transceiver it is decoded by a decoder 30 and passed to a processor 32.
  • the signal is tagged with data indicative of its theme (tennis) and of which of a number of classes of statement associated with the theme it is (in this example, invitation). Milly therefore "knows" that Molly has invited her to play tennis.
  • Milly then analyses the statements associated with her theme for a reply. These statements, which are stored in a memory 34 are also tagged both with data indicative of the doll's unique identification tag, of the manner in which the doll is currently themed and with data indicative of their class.
  • the processor 32 has been pre-programmed to select a statement from an appropriate class. In this example, appropriate classes would be either "accepting an invitation” or “declining an invitation” on a random basis.
  • the doll may also add a "comment”.
  • the processor may select, for example "Oh No! (a rejection) followed by "I like ballet” (a comment) and cause that statement to be output through Milly's loudspeaker 36. At the same time, the processor may activate motors 38 which cause Milly to shake her head.
  • Milly broadcasts trigger data through her transceiver 28 indicative of what she has said.
  • Molly can analyse the data in a similar manner to that set out above, and respond accordingly. For example, a rejection may cause her to make a sad noise or an angry noise, she may agree (“Yes, me too”) or disagree with (That's horrid), or not respond to, the comment, and she may make another suggestion ("Shall we watch Congress on TV?) or ask question ("What do you want to do?).
  • Milly may start interacting with her owner (or other doll or toy) saying, for example, "Can I put my tennis kit on now?".
  • Figure 3 illustrates an example of the interaction between two dolls.
  • One doll, 300 asks the other doll, 302, a question; simultaneously trigger data, associated with the question is sent wirelessly.
  • Doll 302 receives the trigger data and responds appropriately to the question.
  • the manner in which the dolls make their responses is preferably only partially random.
  • the dolls may be pre-programmed to be friends (or enemies), which causes them to be more (or less) likely to accept each other's invitations, or generally respond positively to each other.
  • the dolls may keep a record of how often their invitations are accepted or rejected by particular dolls, and reciprocate according to the value of this affective index.
  • the dolls may also keep a record of their own “mood”, which may vary according to time of day and pre-programmable "personality” factors such as "outgoing" or "sporty". These factors may change as the theme of a doll is changed.
  • the dolls may also keep a record of important dates, such as birthdays, anniversaries or public holidays. This mood value may also influence the response chosen. If one doll having a particular theme (for example sporty) interacts with another having the same theme, or a similar theme (adventure), they may be more likely to respond positively to each other. If the themes are not complementary (sleepy-time and adventure, for example) they may be more likely to respond negatively.
  • Each doll may have a serial port or similar connector through which she may be plugged in to a computer 40 either physically or through a wireless connection.
  • each doll may have a docking station, for example a bed 42 that they can be connected to, and which may function both as a charging point for a rechargeable battery and as a data link and / or as a database for themes etc.
  • the docking station may be the doll's body with the head of the doll containing all of the features illustrated in Figure 2 .
  • Figure 4 shows schematically the connection port within the body of the doll and the head of the doll separated from the doll.
  • the dolls may thereby receive data which could be drawn from a CD-ROM or downloaded from the internet. Indeed, it is envisaged that a web community could be formed with an on-line shop for buying dolls', themes, music, accessories and reward tokens, a fashion boutique to give accessory tips, a design-your-own-doll section where doll features such as hair colour, skin colour, eye colour, body type and age could be chosen, and an order placed, a membership club, on-line games and competitions, etc.
  • Themes in particular, could be purchased and downloaded from such a website. Such themes could be downloaded from a computer or docking station, or uploaded into the doll through a chip. The doll could itself access the internet, perhaps through a wireless connection.
  • a virtual doll may be designed. Clothes, accessories, speech, as well as doll features, can be chosen for the doll with a graphical representation of the doll shown during the process.
  • the user may compare his/her virtual doll with those stored on the website, as well as with the designs of other users, creating an on-line community.
  • the user may also, if required, order the requisite supplies to enable the user to create the virtual doll in real life. Previous purchases through the website will remain in the user profile, and purchases made from outside of the website (such as gifts, etc) may be entered into the user profile for future reference. If clothes, accessories, etc, already within the user profile are required for the virtual doll then only the required supplies, i.e. the supplies that the user does not already own, will be incorporated within the order.
  • Accessories including clothes, could also be bought separately through the online shop.
  • the accessories available would differ depending on the theme selected. For example, within the "Sporty” theme accessories such as tennis rackets and tracksuits would be listed, while in the “Urban” theme there could be hoodies and jeans etc.
  • Figure 4 illustrates the process of ordering an accessory, as shown with the doll 400 being connected to the internet website via the docking station, the accessory, 402, arriving and the doll 404 interacting with the new accessory.
  • the reward token system allows parents to purchase tokens associated with his/her child's user account. These tokens could then either be given to the child as a grift, allowing the child to purchase any item within the online store, or could be used as part of a reward scheme.
  • a parent could use the tokens as an incentive for the child to do his/her homework. For example: the parent buys 10 tokens, then tells his/her child that every time they do his/her homework on time they get a token. When the child has enough tokens they can use them on the website to purchase new dolls, accessories, etc.
  • the tokens would be in the form of codes that the parents would be given on purchase.
  • the tokens would be associated with the child's account as the parent would log-in to his/her child's account using a parental access password. These codes could then either be printed or simply written down prior to giving them to the child.
  • the tokens could be available for general purchase through the website, thereby allowing generic tokens to be purchased and posted, either directly to the child, as a gift for instance, or to the purchaser for use in a reward scheme.
  • the tokens would be redeemed by the child logging into his/her account and entering the token code, crediting his/her account with the value of the token.
  • Such a website would be personalised both for the doll and for the user.
  • a user could set up an account for herself, and sub-accounts for her dolls.
  • Each doll has its personal data, for example, a birthday, a calendar, a diary, a friends list which is continually updated based on the dolls interactions, a mailbox accessible from its sub-account.
  • Such a website allows a user many facilities for interaction with other users and other dolls. For example, a user could ask to organise a party for the dolls on Milly's friends list and mail them invitations.
  • Such an invitation would be made known both to the invited dolls, for example Molly, who might accept or reject the invitation, according to her current affective index value for Milly, and her mood and their personality and their users, who could edit this acceptance or rejection. Once acceptance or rejection is sent Molly would remind her owner about the party at appropriate intervals.
  • the dock 42 may itself have ports 44 from which preloaded themes and situations (see below) can be downloaded.
  • the theme downloaded from the internet would be dictated by the users. For example, two friends might wish to download appropriate themes to their respective dolls prior to a play session. These themes would ideally be matched so that full interaction may be made between the dolls. For example, two dolls both with a "Sporty” theme would be able to interact to a fuller extent than two dolls, one of which having a "Gangsta” theme, the other having a “Ballerina” theme. Although generic interaction could occur between these two themes ("Gangsta" doll asks “Do you want to listen to some hip hop?", "Ballerina” replies “Oh No!, I'd much rather practice my plié!), however, the conversation would end there.
  • the type of response given, and the set of responses, may also be influenced by the situation that one or more of the dolls are in. For example, when Milly's owner buys a dolls house different rooms in the dolls house have transmitters which emit an infrared signal which is coded to indicate different rooms. Alternatively or additionally, Milly's owner could buy tags and distribute them around her bedroom or the house in which she lives. Each situational tag, or product, such as a dolls house, stables etc. comes with an appropriate set of responses which can be downloaded into a doll's memory either through the dock 42 or over a wireless link.
  • the dolls may then select a subset of responses suitable for different situations as appropriate, or the probability of each response being selected may be enhanced or depressed. For example, in the garden, any positive responses in Milly's sports theme may be made more likely. If a theme has been registered for a doll, and the doll moves into an appropriate situation, she may ask her owner to start the theme by dressing her appropriately. For example, Milly's current theme is that of a ballerina, but one theme registered and so available for her is gardening. When taken into the garden she may ask “Can I get changed for gardening?" and if access to the theme depends on a key theme tag "Where is my spade?".
  • Accessories such as animals or cars, may also have such computer equipment integrated into them. So, for example, Milly's horse can whinney affectionately when she gets on it, her car may tell her to fasten her seat belt and, depending on her mood, and it's acceleration sensor say “Lets go racing” or "Slow down please”.
  • Dolls can also communicate their mood to each other and through their loudspeaker, on user command, when making a particularly expressive response, or on receiving appropriate trigger data (for example "How are you today?").
  • the user also can use a remote control to communicate with the dolls, and to give them commands, and to program them.
  • the user can construct themes through the website, and more advanced users can construct schemes of responses and download them to the dolls through software.
  • the remote could also contain downloaded data allowing the user to up date the doll remotely and separately from his/her computer. This could be stored on a memory stick or memory card that is placed in the remote.
  • the user constructed themes may be stored within the user's profile such that the doll may be easily returned to a previous user defined theme, effectively providing the dolls with multiple personalities. However, only one "personality" at a time may be downloaded to a doll.
  • the themes created via the website would also enable the user to specifically select speech for the doll from a list associated with particular generic themes; the list of phrases could number 1,000 or more per theme.
  • Each generic theme, "Gangsta”, “Sports”, “Urban”, etc (see Figure 3 ) would have a list of associated phrases to choose from.
  • the memory within the doll would be capable of holding a large number of phrases; however the number of phrases stored in the doll would be dependent on the length of conversation required. The length of conversation required could in turn be dependent on the user's age as defined within the user profile; a "speech architect" would determine the length of conversation. Conversations would therefore range from a couple of minutes to tens of minutes in length.
  • the list of phrases available through the website would be updated periodically, thus allowing the dolls to keep up-to-date with the latest trends.
  • the types of phrases would remain the same, i.e. questions, statements and answers, such that a doll with the latest phrases could still interact adequately with a doll with a previous set of phrases.
  • the user may also download music appropriate to the doll's theme.
  • the downloaded music may have associated data tags that allow the dolls to interact with the music (see Figure 5 ). This interaction may range from the dolls nodding their heads, 500, or moving their hands, 502, to, if the doll's theme does not correspond to the music, speech, for example "Oh dear!, What's this noise?".
  • the response of the dolls could allow the music to be changed to a more acceptable track or to have the volume increased or decreased depending on the response.
  • the doll through the use of personal headphones, may also be used as a standalone personal music player. In this instance a switch would be used on the doll to initiate a music only mode.
  • Dolls can also exchange information about their personalities. When two dolls meet for the first time they may be "introduced" by their owners as a form of play; and will simultaneously register basic personality information with each other, and create an affective index for the other doll.
  • the dolls owner can force them to respond in a certain way to a question by manipulating them so that they nod or shake their heads. This motion is picked up by a sensor, and forces a negative or positive response. It may well be thought appropriate to provide a master control, for use by the owner's parents, to mute the doll or switch it off. It is also possible to change a doll's parameters, such as her personality, her affective index in relation to the doll's she knows and her mood through the docking station. It is possible to reset a doll's parameters to their original values or to those of the previous day.
  • the level of control that the owner has can be pre-set in software as appropriate for the age and level of experience of the user.
  • various of the doll's functions can be turned off in software, or set to an age-appropriate level.
  • the aesthetics and vocabulary of the dolls can also be tailored so that it is age appropriate for a target audience.
  • Various themes may have an age appropriate rating. This allows hip hop themed dolls, for example, for a teenage market.
  • the dolls may track the time of day; and may request to be fed, or to be put to bed at an appropriate time. Whether the user performs the appropriate action (using the dock) will have an appropriate effect on the doll's mood.
  • the doll can sense through its acceleration sensor, whether it is being played with, or indeed, abused, and react accordingly.
  • the treatment of a doll may interact with its personality. For example, a doll with an outgoing personality may have its mood depressed if not provided with opportunity for interaction with its owner or other dolls.
  • An infrared transceiver provides a wireless data link for a doll. Infrared is the low-cost and low-range option, but the transceiver could, alternatively or additionally, be a radio transceiver, using a protocol such as "Bluetooth".
  • the microprocessor may be any suitable type, for example a 576 MHz 64 bit CPU.
  • Memory is a flash memory card for personality data, which may be used for temporary data such as themes or supplemented by a removable memory stick for individual themes.
  • Each expressive response in this theme has three data tags attached: one a sequencing tag in respect of the sequencing of the type of phrase to be used (starter, statement, question, answer, ending) which represents where it comes in the interaction; one an action tag (active, passive, functional) which indicates whether a course of action is proposed and provides an indication of the type of reply required, or whether a reply is required; and one an affective tag (positive - negative) which gives an idea of the affective quality of the remark.
  • a doll will begin with a starter, make statements for three minutes or so (the time may be varied with the likely concentration span of the owner, which may be judged according to the owner's age), or a certain number of statements, and then make an ending.
  • Certain categories of response for example questions
  • Certain categories of next response for example answers
  • the affective quality of the response may influence the further response.
  • only two starters may be allowed in a conversation, and a passive starter must follow an active starter.
  • statements can be made at any point in the conversation, and added to an answer. After a statement a further statement or a question may follow.
  • An ending may finish the conversation.
  • a large number of different conversations could occur between dolls programmed with even this, extremely simple, scheme. Functional statements relate to the rules of the game, and rules of response are programmed accordingly.
  • Any expressive responses that meet the requirements of the tag may be chosen randomly, or according to affective quality. Occasional nonsense conversations are possible, and give a humorous quality to the interaction. *The How are you question is a specific type of response which constrains the doll to answer according to the value of their affective index for which answers are built in, and do not usually alter according to the theme.
  • starters are merely particular forms of statements or questions, whilst endings are merely a special form of statement. Also, excluding starters or endings (since they may in certain circumstances be statements), it is only statements that have an action tag.
  • Figure 7a shows a flow diagram of a conversation progression using this form of conversational structure.
  • the box 702 Random path selector
  • the content of the conversation 704 is dependent on the theme of the dolls.
  • the box 706 (Another conversation?) decides whether another conversation is selected.
  • one doll triggers the other doll (by means of an appropriate sequencing tag) that the conversation has ended.
  • a conversation set would include multiple conversations allowing the dolls to be used many times without requiring new conversations to be downloaded every time the doll is used.
  • the speech architect may provide multiple conversation sets for every theme, thus allowing a new conversation set to be downloaded when the current one is exhausted. These conversation sets may be updated over time, thus allowing the dolls longevity to be increased by keeping them up to date with current trends. This type of conversation would allow the "speech architect" to create a conversation of an exact length in time, therefore the conversation can be easily tailored to the age of the user.
  • Figure 7b shows a flow diagram of a conversation using this form of conversational structure.
  • the phrases are selected entirely randomly, using boxes 730 (Random starter) and 732 (Random type of phrase), purely based on the type of phrase; the selection process is based on the previously described rules.
  • the box 732 may choose any of the further boxes 734 (Question), 736 (Statement), 738 (Answer) or 740 (Ending). If an ending phrase, 740, is chosen then box 742 (Continue conversation?) decides on whether another starter phrase should be selected. This decision will partly be based on the current length of the conversation.
  • the box 708 (End) will trigger the dolls to end the conversation.
  • the user may download any of the phrases associated with a theme to build up a database of phrases stored on his/her doll. For example, a starter phrase will always begin the conversation, 730, followed by a randomly chosen type of phrase 732, but not another starter phrase. If the phrase chosen were a question phrase then an answer phrase would follow. However, the answer chosen would be random and therefore may not correspond to the question. To avoid too many nonsense conversations the questions and answers created by the "speech architect" would be as generic as possible. This form of conversational structure would obviously provide the greatest number of possible conversations for any given number of phrases.
  • Starter Passive/Active A starter phrase initiates a conversation and may be any of the other types of phrases except an ending.
  • Positive/Neutral/Negative Statement Passive/Active/Functional/ Positive/Neutral/Negative A statement phrase is point of fact.
  • Question A question phrase is a question requiring an answer.
  • Answer Positive/Neutral/Negative An answer phrase answers the question and always follows a question.
  • Ending Passive/Active An ending phrase will end the conversation and is an answer or statement. This also may be followed by another starter phrase.
  • Positive/Neutral/Negative Positive/Neutral/Negative
  • the "speech architect" structures the phrases within a particular group of phrases 762, this particular group typically being a specific theme, such as "Sports". Each group of phrases would be self-consistent, so that for example it would contain answers consistent with the various questions, and so on. Each group is then associated with a set of data tags as described previously, thus facilitating an appropriate response to be randomly selected from within the group of phrases.
  • Figure 7c shows a flow diagram of this form of conversational structure.
  • box 730 selects a random starter.
  • An appropriate type of phrase is then selected by box 732 (Random type of phrase), then depending on the type of phrase selected an appropriate question (734), statement (736), answer (738) or ending (740) is chosen.
  • box 742 (Continue conversation?) decides whether the conversation should continue. If not then box 708 (End) triggers the dolls that the conversation has ended. This would provide a greater number of possible conversations than the first form of conversational structure. It would also provide the most natural conversations that would be different every time due to the random selection of phrases. Again the rules prescribed previously would be used to determine the type of phrase selected.
  • boxes 760 Random Group selector and 742 (Continue conversation) are optional.
  • the doll may be capable of randomly selecting the particular group of relevant phrases 762 (see the box 760). These may be sub-groups within the overall theme group; additionally or alterntatively, theme groups may be arranged into larger super-groups.
  • a theme group may be "Tennis", with a super-group being "Sports” and a sub-group "Wimbledon”.
  • the group "Tennis” would contain all phrases relevant to tennis in general with the sub-group "Wimbledon” containing all information relating to the Wimbledon tennis tournament. This would allow for more detailed conversations within a theme as the phrases contained within the groups or super-groups could be used to link different sub-groups, as terms within the group or super-group would appear in more than one sub-group.
  • the "speech architect” 800 determines the phrases and their associated theme, group and tags.
  • the "speech architect” then uploads the phrases either to the website, 802, to a CD-Rom 804, or to a memory card 805, or to any/all of these storage facilities. These phrases may then be downloaded to the users' doll(s), 812/814, using his/her personal computer, 806, via the interface 808.
  • the user 810 may also input phrases directly to his/her personal computer 806, or to the website 802. These phrases may then be saved for future use and/or downloaded to the doll(s), 812/814.
  • the user 810 may also interact directly with the doll(s), 812/814, via physical interaction, for example using buttons on the doll to initiate conversation, or via a remote control. In this way the user may prompt the doll(s) to initiate any of the above-described actions, for example a conversation or music playing.
  • the doll(s), 812/814 may also prompt the user to perform an action; as discussed previously the doll(s) may ask to be fed or to play a certain game.
  • Such toys and dolls provide children with different opportunities for interaction, and enhance their play.

Landscapes

  • Toys (AREA)

Description

  • This invention relates to toys. In particular, although not exclusively, this invention relates to toys such as dolls that interact with each other.
  • Embedded computers and micro-processors have improved toys for children. They have been used most extensively in educational toys, but have also been used in interactive toys. ActiMates® Barney®, is one example of an interactive toy which responds to interaction from a child by appropriate vocalisations, and can sing-a-long to videos.
  • US-A-2004/0082255 discloses an example of interactive toys.
  • According to the present invention there is provided a toy according to claim 1.
  • Preferably the toy comprises means for analysing said expressive responses to select a suitable one such response. The means for analysing said expressive responses to enable a suitable one such response to be selected preferably uses randomisation. The means for analysing said expressive responses to select a suitable one such response is preferably operable to receive and respond to situation data concerning its situation.
  • Preferably at least some of the data is downloadable to the toy from said computer. The data preferably includes a set of such expressive responses and the expressive responses comprises a set of responses and counter-responses. The counter-responses are preferably compatible with the responses. These counter-responses are preferably adapted to be used by a further such toy in response to the responses of a further such toy.
  • Preferably the data is downloadable from a website via the internet.
  • An expressive response, as used herein, means output that communicates a message, such as emotion or language to a human onlooker.
  • This invention involves the realisation that interaction occurs between dolls, and other toys, when children play. By stimulating interaction between dolls, or other toys, this invention encourages such play.
  • The toy may store data, preferably trigger data, received in memory as an expressive response.
  • The expressive response may be a gesture. The expressive response may be a vocalisation. The expressive response may be a phrase, or music or sound.
  • The trigger data broadcast may indicate which expressive response was output. A toy may be operable to broadcast trigger data and/or make an expressive response on a user command. The user command may comprise moving or shaking the toy or squeezing the toy or pressing part of the toy.
  • Alternatively the toy may be operable to broadcast trigger data and/or make an expressive response when in proximity of a transmitter, such as an infra-red transmitter. The transmitter may be another toy, a docking station, a remote control, or an environment, such as a dolls house. The toy may transmit a signal at timed intervals. Such a signal could act as a proximity signal for another toy.
  • The trigger data may be indicative of the proximity of a second toy.
  • The processor may be operable to analyse the trigger data received for an indication of which expressive response it represents and select an appropriate expressive response. Expressive responses may be ranked and the response may be selected according to rank. The rank of the expressive response may be dependent on the trigger data. The expressive response may be selected using randomisation. Expressive responses may be chosen, preferably randomly chosen from group of responses all of which may have a particular rank.
  • Preferably output of an expressive response depends on some input from child.
  • Such input may comprise triggering a sensor in the toy.
  • The toy may comprise a code segment operable to download expressive responses, themes, or personality data from the internet.
  • The toy may comprise a removable memory. Such a toy may be programmable.
  • The toy may comprise a physical connector. The toy may comprise an electromagnetic transceiver, preferably an infrared, radio-frequency, or bluetooth transceiver.
  • Preferably the toy is a doll. It may be generic or a likeness of a sports star, celebrity, or pop star.
  • The connection to the network may be physical. The dock may comprise a recharging point for the toy.
  • According to a still further aspect of this invention there is provided a method of communication between first and second toys according to claim 29.
  • The expressive response may be a gesture. The expressive response may be a vocalisation. The expressive response may be a phrase.
  • The trigger data broadcast may indicate which expressive response was output. The method may comprise broadcasting trigger data on a user command. The user command may comprise triggering a sensor in the toy, by, for example, shaking the toy or squeezing the toy or pressing part of the toy. The trigger data may be indicative of the proximity of a second toy.
  • The method may comprise analysing the trigger data received for an indication of which expressive response the data represents and selecting an appropriate expressive response. Expressive responses may be ranked and the response may be selected according to rank. The rank of the expressive response may be dependent on the trigger data. The expressive response may be selected using randomisation. Expressive responses may be chosen, preferably randomly chosen, from group of responses all of which may have a particular rank.
  • The output of an expressive response may depend on some input from child. The input may comprise triggering a sensor in the toy.
  • The method may comprise downloading expressive responses, themes, music, or personality data from the internet.
  • Expressive responses may be grouped into a theme.
  • According to a further aspect of this invention, there is provided a method of downloading data into a doll comprising logging onto a website; selecting a theme comprising a group of related data; and downloading the theme to the doll.
  • The theme may be expressed by triggers/responses by sound, expression, music or exclamations.
  • Any aspect of the invention outlined above may incorporate any of the preferred features described above, or below.
  • Embodiments of this invention will now be described, by way of example only, with reference to the accompanying drawings, of which:
    • Figure 1 shows schematically an illustration of two dolls and associated computer equipment;
    • Figure 2 shows schematically a block diagram of computer equipment inside a doll;
    • Figure 3 shows schematically an illustration of two dolls interacting with each other, and one doll (the female) connected to a computer by cable to download data from the internet;
    • Figure 4 shows schematically an illustration of a doll with a removable head/computer unit;
    • Figure 5 shows schematically an illustration of the ability to purchase accessories from a website on the internet, the associated interaction between the dolls and a male figure on a docking station receiving data from the internet via a computer;
    • Figure 6 shows schematically two dolls interacting with music being played;
    • Figures 7 show three possible forms of conversational structure, in the form of flow diagrams; and
    • Figure 8 shows schematically the flow of data from the various parties.
  • Children enjoy playing with dolls, and often incorporate them into their imaginary play. Dolls such as those shown in Figure 1, Milly 10 and Molly 12 are able to interact more fully with children, and with each other, in such play. Milly 10 and Molly 12 are dolls having generic bodies 14, 16 which may be themed by adding dresses, shoes and accessories.
  • As shown in Figure 1, Milly 10 has a generic body 14 which represents a female adult and is themed as a ballerina, being dressed in a tutu with ballet shoes. Molly 12 also has a generic body 16 which represents a female adult, and is themed as a tennis player, having appropriate clothing and bat and ball accessories.
  • The theme may be pre-programmed, determined by the downloaded/inputted data, or set by a key accessory (tennis bat, ballet shoes, or a theme tag) which can be sensed by the doll through its communication system described below. The dolls' bodies may be manipulated into appropriate poses, as shown.
  • As shown in Figure 2, each doll has an integrated computer 18 using this computer the dolls are able to interact according to their theme. For example, when Molly 12 is picked up an acceleration sensor 20 integrated into her body 16 provides a signal which acts as a trigger, causing her to say, for example, "Anyone for tennis?". Molly 12 has a loudspeaker 22 sited under the feature representing her mouth through which her synthesised voice can be heard.
  • This interaction is heard by the children playing with her. The statement is also transmitted via an infrared transceiver 24, conveniently located in her head 26, to any doll in line-of-sight, in this example Milly 10, who receives the transmission at her infrared transceiver 28. Infrared signals may reach the transceivers through the dolls' eyes and ears.
  • Once Milly's transceiver receives a signal from Molly's transceiver it is decoded by a decoder 30 and passed to a processor 32. The signal is tagged with data indicative of its theme (tennis) and of which of a number of classes of statement associated with the theme it is (in this example, invitation). Milly therefore "knows" that Molly has invited her to play tennis.
  • Milly then analyses the statements associated with her theme for a reply. These statements, which are stored in a memory 34 are also tagged both with data indicative of the doll's unique identification tag, of the manner in which the doll is currently themed and with data indicative of their class. The processor 32 has been pre-programmed to select a statement from an appropriate class. In this example, appropriate classes would be either "accepting an invitation" or "declining an invitation" on a random basis. The doll may also add a "comment". The processor may select, for example "Oh No!" (a rejection) followed by "I like ballet" (a comment) and cause that statement to be output through Milly's loudspeaker 36. At the same time, the processor may activate motors 38 which cause Milly to shake her head.
  • Also simultaneously, Milly broadcasts trigger data through her transceiver 28 indicative of what she has said. Molly can analyse the data in a similar manner to that set out above, and respond accordingly. For example, a rejection may cause her to make a sad noise or an angry noise, she may agree ("Yes, me too") or disagree with (That's horrid), or not respond to, the comment, and she may make another suggestion ("Shall we watch Wimbledon on TV?) or ask question ("What do you want to do?).
  • The conversation continues until one of the dolls does not make a response, or makes agreement or disagreement is reached.
  • If agreement is reached, so in the example above Milly selects "Yes, what fun", Milly may start interacting with her owner (or other doll or toy) saying, for example, "Can I put my tennis kit on now?".
  • Figure 3 illustrates an example of the interaction between two dolls. One doll, 300, asks the other doll, 302, a question; simultaneously trigger data, associated with the question is sent wirelessly. Doll 302 receives the trigger data and responds appropriately to the question.
  • The manner in which the dolls make their responses is preferably only partially random. The dolls may be pre-programmed to be friends (or enemies), which causes them to be more (or less) likely to accept each other's invitations, or generally respond positively to each other. Alternatively, the dolls may keep a record of how often their invitations are accepted or rejected by particular dolls, and reciprocate according to the value of this affective index.
  • The dolls may also keep a record of their own "mood", which may vary according to time of day and pre-programmable "personality" factors such as "outgoing" or "sporty". These factors may change as the theme of a doll is changed. The dolls may also keep a record of important dates, such as birthdays, anniversaries or public holidays. This mood value may also influence the response chosen. If one doll having a particular theme (for example sporty) interacts with another having the same theme, or a similar theme (adventure), they may be more likely to respond positively to each other. If the themes are not complementary (sleepy-time and adventure, for example) they may be more likely to respond negatively.
  • Each doll may have a serial port or similar connector through which she may be plugged in to a computer 40 either physically or through a wireless connection. Alternatively, each doll may have a docking station, for example a bed 42 that they can be connected to, and which may function both as a charging point for a rechargeable battery and as a data link and / or as a database for themes etc.
  • Alternatively, the docking station may be the doll's body with the head of the doll containing all of the features illustrated in Figure 2. Figure 4 shows schematically the connection port within the body of the doll and the head of the doll separated from the doll.
  • The dolls may thereby receive data which could be drawn from a CD-ROM or downloaded from the internet. Indeed, it is envisaged that a web community could be formed with an on-line shop for buying dolls', themes, music, accessories and reward tokens, a fashion boutique to give accessory tips, a design-your-own-doll section where doll features such as hair colour, skin colour, eye colour, body type and age could be chosen, and an order placed, a membership club, on-line games and competitions, etc.
  • Themes, in particular, could be purchased and downloaded from such a website. Such themes could be downloaded from a computer or docking station, or uploaded into the doll through a chip. The doll could itself access the internet, perhaps through a wireless connection.
  • Within the design-your-own-doll section a virtual doll may be designed. Clothes, accessories, speech, as well as doll features, can be chosen for the doll with a graphical representation of the doll shown during the process. The user may compare his/her virtual doll with those stored on the website, as well as with the designs of other users, creating an on-line community. The user may also, if required, order the requisite supplies to enable the user to create the virtual doll in real life. Previous purchases through the website will remain in the user profile, and purchases made from outside of the website (such as gifts, etc) may be entered into the user profile for future reference. If clothes, accessories, etc, already within the user profile are required for the virtual doll then only the required supplies, i.e. the supplies that the user does not already own, will be incorporated within the order.
  • Accessories, including clothes, could also be bought separately through the online shop. The accessories available would differ depending on the theme selected. For example, within the "Sporty" theme accessories such as tennis rackets and tracksuits would be listed, while in the "Urban" theme there could be hoodies and jeans etc.
  • Figure 4 illustrates the process of ordering an accessory, as shown with the doll 400 being connected to the internet website via the docking station, the accessory, 402, arriving and the doll 404 interacting with the new accessory.
  • Reference was made previously to reward tokens. The reward token system allows parents to purchase tokens associated with his/her child's user account. These tokens could then either be given to the child as a grift, allowing the child to purchase any item within the online store, or could be used as part of a reward scheme. In the case of the reward scheme a parent could use the tokens as an incentive for the child to do his/her homework. For example: the parent buys 10 tokens, then tells his/her child that every time they do his/her homework on time they get a token. When the child has enough tokens they can use them on the website to purchase new dolls, accessories, etc.
  • The tokens would be in the form of codes that the parents would be given on purchase. The tokens would be associated with the child's account as the parent would log-in to his/her child's account using a parental access password. These codes could then either be printed or simply written down prior to giving them to the child.
  • Alternatively, or additionally, the tokens could be available for general purchase through the website, thereby allowing generic tokens to be purchased and posted, either directly to the child, as a gift for instance, or to the purchaser for use in a reward scheme. The tokens would be redeemed by the child logging into his/her account and entering the token code, crediting his/her account with the value of the token.
  • Such a website would be personalised both for the doll and for the user. A user could set up an account for herself, and sub-accounts for her dolls. Each doll has its personal data, for example, a birthday, a calendar, a diary, a friends list which is continually updated based on the dolls interactions, a mailbox accessible from its sub-account. Such a website allows a user many facilities for interaction with other users and other dolls. For example, a user could ask to organise a party for the dolls on Milly's friends list and mail them invitations. Such an invitation would be made known both to the invited dolls, for example Molly, who might accept or reject the invitation, according to her current affective index value for Milly, and her mood and their personality and their users, who could edit this acceptance or rejection. Once acceptance or rejection is sent Molly would remind her owner about the party at appropriate intervals.
  • Alternatively or additionally, the dock 42 may itself have ports 44 from which preloaded themes and situations (see below) can be downloaded.
  • The theme downloaded from the internet would be dictated by the users. For example, two friends might wish to download appropriate themes to their respective dolls prior to a play session. These themes would ideally be matched so that full interaction may be made between the dolls. For example, two dolls both with a "Sporty" theme would be able to interact to a fuller extent than two dolls, one of which having a "Gangsta" theme, the other having a "Ballerina" theme. Although generic interaction could occur between these two themes ("Gangsta" doll asks "Do you want to listen to some hip hop?", "Ballerina" replies "Oh No!, I'd much rather practice my plié!"), however, the conversation would end there.
  • The type of response given, and the set of responses, may also be influenced by the situation that one or more of the dolls are in. For example, when Milly's owner buys a dolls house different rooms in the dolls house have transmitters which emit an infrared signal which is coded to indicate different rooms. Alternatively or additionally, Milly's owner could buy tags and distribute them around her bedroom or the house in which she lives. Each situational tag, or product, such as a dolls house, stables etc. comes with an appropriate set of responses which can be downloaded into a doll's memory either through the dock 42 or over a wireless link.
  • The dolls may then select a subset of responses suitable for different situations as appropriate, or the probability of each response being selected may be enhanced or depressed. For example, in the garden, any positive responses in Milly's sports theme may be made more likely. If a theme has been registered for a doll, and the doll moves into an appropriate situation, she may ask her owner to start the theme by dressing her appropriately. For example, Milly's current theme is that of a ballerina, but one theme registered and so available for her is gardening. When taken into the garden she may ask "Can I get changed for gardening?" and if access to the theme depends on a key theme tag "Where is my spade?".
  • Accessories, such as animals or cars, may also have such computer equipment integrated into them. So, for example, Milly's horse can whinney affectionately when she gets on it, her car may tell her to fasten her seat belt and, depending on her mood, and it's acceleration sensor say "Lets go racing" or "Slow down please".
  • Dolls can also communicate their mood to each other and through their loudspeaker, on user command, when making a particularly expressive response, or on receiving appropriate trigger data (for example "How are you today?").
  • The user also can use a remote control to communicate with the dolls, and to give them commands, and to program them. The user can construct themes through the website, and more advanced users can construct schemes of responses and download them to the dolls through software. The remote could also contain downloaded data allowing the user to up date the doll remotely and separately from his/her computer. This could be stored on a memory stick or memory card that is placed in the remote.
  • The user constructed themes may be stored within the user's profile such that the doll may be easily returned to a previous user defined theme, effectively providing the dolls with multiple personalities. However, only one "personality" at a time may be downloaded to a doll.
  • The themes created via the website would also enable the user to specifically select speech for the doll from a list associated with particular generic themes; the list of phrases could number 1,000 or more per theme. Each generic theme, "Gangsta", "Sports", "Urban", etc (see Figure 3), would have a list of associated phrases to choose from. The memory within the doll would be capable of holding a large number of phrases; however the number of phrases stored in the doll would be dependent on the length of conversation required. The length of conversation required could in turn be dependent on the user's age as defined within the user profile; a "speech architect" would determine the length of conversation. Conversations would therefore range from a couple of minutes to tens of minutes in length. The younger a user is, the shorter his/her attention span, and therefore less phrases would be required per theme. However, at least one question and one answer phrase would be downloaded to the doll. A random set of phrases may be selected by the website to allow the users to quickly and easily select and download phrases to the doll with little user input other than selecting the theme.
  • So that users do not become disinterested in the dolls the list of phrases available through the website would be updated periodically, thus allowing the dolls to keep up-to-date with the latest trends. The types of phrases would remain the same, i.e. questions, statements and answers, such that a doll with the latest phrases could still interact adequately with a doll with a previous set of phrases.
  • In addition to downloadable themes and speech the user may also download music appropriate to the doll's theme. The downloaded music may have associated data tags that allow the dolls to interact with the music (see Figure 5). This interaction may range from the dolls nodding their heads, 500, or moving their hands, 502, to, if the doll's theme does not correspond to the music, speech, for example "Oh dear!, What's this noise?". The response of the dolls could allow the music to be changed to a more acceptable track or to have the volume increased or decreased depending on the response.
  • The doll, through the use of personal headphones, may also be used as a standalone personal music player. In this instance a switch would be used on the doll to initiate a music only mode.
  • Dolls can also exchange information about their personalities. When two dolls meet for the first time they may be "introduced" by their owners as a form of play; and will simultaneously register basic personality information with each other, and create an affective index for the other doll.
  • An important aspect of the functionality of the dolls is their interaction with their owner. There are two aspects to this, firstly the control of the owner over the doll, and secondly the effect of the owner's actions on the doll.
  • In relation to the first aspect, the dolls owner can force them to respond in a certain way to a question by manipulating them so that they nod or shake their heads. This motion is picked up by a sensor, and forces a negative or positive response. It may well be thought appropriate to provide a master control, for use by the owner's parents, to mute the doll or switch it off. It is also possible to change a doll's parameters, such as her personality, her affective index in relation to the doll's she knows and her mood through the docking station. It is possible to reset a doll's parameters to their original values or to those of the previous day.
  • The level of control that the owner has can be pre-set in software as appropriate for the age and level of experience of the user. Similarly, various of the doll's functions can be turned off in software, or set to an age-appropriate level.
  • The aesthetics and vocabulary of the dolls can also be tailored so that it is age appropriate for a target audience. Various themes may have an age appropriate rating. This allows hip hop themed dolls, for example, for a teenage market.
  • In relation to the second aspect, the dolls may track the time of day; and may request to be fed, or to be put to bed at an appropriate time. Whether the user performs the appropriate action (using the dock) will have an appropriate effect on the doll's mood. The doll can sense through its acceleration sensor, whether it is being played with, or indeed, abused, and react accordingly. The treatment of a doll may interact with its personality. For example, a doll with an outgoing personality may have its mood depressed if not provided with opportunity for interaction with its owner or other dolls.
  • An example of the type of hardware that can be used in the applications described above is shown in Figure 2. An infrared transceiver provides a wireless data link for a doll. Infrared is the low-cost and low-range option, but the transceiver could, alternatively or additionally, be a radio transceiver, using a protocol such as "Bluetooth". The microprocessor may be any suitable type, for example a 576 MHz 64 bit CPU. Memory is a flash memory card for personality data, which may be used for temporary data such as themes or supplemented by a removable memory stick for individual themes.
  • A simple scheme of expressive responses for two themes is set out below:
    Tennis
    Expressive Response Category
    Lets Play Tennis! Starter - Active
    Anyone for Tennis? Starter - Active
    I love tennis. Starter - Passive
    Do you like tennis? Starter - Question
    Great Idea! Answer - positive
    Yes please! Answer - positive
    I dunno... Answer - neutral
    Not right now... Answer - negative
    Its my serve Statement - active
    Its your serve Statement - active
    15-love (etc) Statement - functional (positive-negative)
    love-15 (etc) Statement - functional (negative-positive)
    15 all (etc) Statement - functional (neutral)
    Oh No! Statement - passive - negative
    Great Shot! Statement - passive - positive
    Unlucky.... Statement - passive - positive
    Wow! Ace Play! Statement - passive - positive
    Lets have tea... Ending - active - positive
    Whew! I'm tired now! Ending - passive - negative
  • Each expressive response in this theme has three data tags attached: one a sequencing tag in respect of the sequencing of the type of phrase to be used (starter, statement, question, answer, ending) which represents where it comes in the interaction; one an action tag (active, passive, functional) which indicates whether a course of action is proposed and provides an indication of the type of reply required, or whether a reply is required; and one an affective tag (positive - negative) which gives an idea of the affective quality of the remark.
  • Different schemes may be put together using these tags, and a number of simple rules. For example, a doll will begin with a starter, make statements for three minutes or so (the time may be varied with the likely concentration span of the owner, which may be judged according to the owner's age), or a certain number of statements, and then make an ending. Certain categories of response (for example questions) trigger certain categories of next response (for example answers), and the affective quality of the response may influence the further response. For a further example, only two starters may be allowed in a conversation, and a passive starter must follow an active starter. In general, statements can be made at any point in the conversation, and added to an answer. After a statement a further statement or a question may follow. An ending may finish the conversation. A large number of different conversations could occur between dolls programmed with even this, extremely simple, scheme. Functional statements relate to the rules of the game, and rules of response are programmed accordingly.
  • Another example of a theme follows.
    Tea Party
    Expressive Response Category
    Hello Starter - passive
    Welcome to my tea party Starter - active
    Would you like some tea? Starter - question
    I love tea and cakes Starter - passive
    How are you? Question*
    Do you like tea? Question
    Do you like coffee? Question
    I like tea at teatime Statement - passive
    I love chocolate cake! Statement - passive
    We made carrot cake last Thursday Statement - passive
    I'll be mother Statement - active
    Yes - scrummy Answer
    Not really Answer
    I'm allergic to that Answer
    That was lovely, but I have to go now Ending - active
    Goodbye Ending - passive
  • Any expressive responses that meet the requirements of the tag may be chosen randomly, or according to affective quality. Occasional nonsense conversations are possible, and give a humorous quality to the interaction. *The How are you question is a specific type of response which constrains the doll to answer according to the value of their affective index for which answers are built in, and do not usually alter according to the theme.
  • It will be noted from the above examples that starters are merely particular forms of statements or questions, whilst endings are merely a special form of statement. Also, excluding starters or endings (since they may in certain circumstances be statements), it is only statements that have an action tag.
  • Possible forms of conversation are now described in more detail. In general, three forms of conversational structure are envisaged. In all cases the conversation is initiated, 700, by the user activating the doll using the above described method. Firstly; the "speech architect" preordains the entire conversation and as a consequence a limited number of conversations will be available, Figure 7a shows a flow diagram of a conversation progression using this form of conversational structure. In this scenario the box 702 (Random path selector) randomly selects the conversation, 704. The content of the conversation 704 is dependent on the theme of the dolls. When conversation 704 ends the box 706 (Another conversation?) decides whether another conversation is selected. If no further conversation is selected then via box 708 (End) one doll triggers the other doll (by means of an appropriate sequencing tag) that the conversation has ended. In this scenario all dolls due to interact would be required to download the same theme and conversation set. A conversation set would include multiple conversations allowing the dolls to be used many times without requiring new conversations to be downloaded every time the doll is used. To provide variation the speech architect may provide multiple conversation sets for every theme, thus allowing a new conversation set to be downloaded when the current one is exhausted. These conversation sets may be updated over time, thus allowing the dolls longevity to be increased by keeping them up to date with current trends. This type of conversation would allow the "speech architect" to create a conversation of an exact length in time, therefore the conversation can be easily tailored to the age of the user.
  • In Figures 7b and 7c (now described) like reference numerals refer to like parts.
  • Secondly, the "speech architect" simply creates phrases and associates them with the type of speech (see table below) and a theme. Figure 7b shows a flow diagram of a conversation using this form of conversational structure. The phrases are selected entirely randomly, using boxes 730 (Random starter) and 732 (Random type of phrase), purely based on the type of phrase; the selection process is based on the previously described rules. The box 732 may choose any of the further boxes 734 (Question), 736 (Statement), 738 (Answer) or 740 (Ending). If an ending phrase, 740, is chosen then box 742 (Continue conversation?) decides on whether another starter phrase should be selected. This decision will partly be based on the current length of the conversation. If it is decided not to continue the conversation the box 708 (End) will trigger the dolls to end the conversation. The user may download any of the phrases associated with a theme to build up a database of phrases stored on his/her doll. For example, a starter phrase will always begin the conversation, 730, followed by a randomly chosen type of phrase 732, but not another starter phrase. If the phrase chosen were a question phrase then an answer phrase would follow. However, the answer chosen would be random and therefore may not correspond to the question. To avoid too many nonsense conversations the questions and answers created by the "speech architect" would be as generic as possible. This form of conversational structure would obviously provide the greatest number of possible conversations for any given number of phrases.
    Type of phrase Expressive quality Meaning of phrase type
    Starter Passive/Active A starter phrase initiates a conversation and may be any of the other types of phrases except an ending.
    Positive/Neutral/Negative
    Statement Passive/Active/Functional/ Positive/Neutral/Negative A statement phrase is point of fact.
    Question A question phrase is a question requiring an answer.
    Answer Positive/Neutral/Negative An answer phrase answers the question and always follows a question.
    Ending Passive/Active An ending phrase will end the conversation and is an answer or statement. This also may be followed by another starter phrase.
    Positive/Neutral/Negative
  • Thirdly, and in the preferred embodiment; the "speech architect" structures the phrases within a particular group of phrases 762, this particular group typically being a specific theme, such as "Sports". Each group of phrases would be self-consistent, so that for example it would contain answers consistent with the various questions, and so on. Each group is then associated with a set of data tags as described previously, thus facilitating an appropriate response to be randomly selected from within the group of phrases. Figure 7c shows a flow diagram of this form of conversational structure. Within the group of relevant phrases box 730 selects a random starter. An appropriate type of phrase is then selected by box 732 (Random type of phrase), then depending on the type of phrase selected an appropriate question (734), statement (736), answer (738) or ending (740) is chosen. This continues until an ending is selected, at which point box 742 (Continue conversation?) decides whether the conversation should continue. If not then box 708 (End) triggers the dolls that the conversation has ended. This would provide a greater number of possible conversations than the first form of conversational structure. It would also provide the most natural conversations that would be different every time due to the random selection of phrases. Again the rules prescribed previously would be used to determine the type of phrase selected.
  • In the preferred embodiment, boxes 760 (Random Group selector) and 742 (Continue conversation) are optional. A more complex variant of the preferred embodiment is now described also with reference to Figure 7c in which the function of these boxes is described. The doll may be capable of randomly selecting the particular group of relevant phrases 762 (see the box 760). These may be sub-groups within the overall theme group; additionally or alterntatively, theme groups may be arranged into larger super-groups. For example a theme group may be "Tennis", with a super-group being "Sports" and a sub-group "Wimbledon". The group "Tennis" would contain all phrases relevant to tennis in general with the sub-group "Wimbledon" containing all information relating to the Wimbledon tennis tournament. This would allow for more detailed conversations within a theme as the phrases contained within the groups or super-groups could be used to link different sub-groups, as terms within the group or super-group would appear in more than one sub-group.
  • With reference to Figure 8 the flow of data between the various parties will now be described. As discussed previously the "speech architect" 800 determines the phrases and their associated theme, group and tags. The "speech architect" then uploads the phrases either to the website, 802, to a CD-Rom 804, or to a memory card 805, or to any/all of these storage facilities. These phrases may then be downloaded to the users' doll(s), 812/814, using his/her personal computer, 806, via the interface 808. The user 810 may also input phrases directly to his/her personal computer 806, or to the website 802. These phrases may then be saved for future use and/or downloaded to the doll(s), 812/814.
  • The user 810 may also interact directly with the doll(s), 812/814, via physical interaction, for example using buttons on the doll to initiate conversation, or via a remote control. In this way the user may prompt the doll(s) to initiate any of the above-described actions, for example a conversation or music playing. The doll(s), 812/814, may also prompt the user to perform an action; as discussed previously the doll(s) may ask to be fed or to play a certain game.
  • Such toys and dolls provide children with different opportunities for interaction, and enhance their play.
  • It is of course to be understood that the invention is not intended to be restricted to the details of the above embodiments which are described by way of example only.
  • It will be understood that the present invention has been described purely by way of example, and modifications of detail can be made within the scope of the invention, as defined by the appendent claims.

Claims (37)

  1. A toy comprising:
    a processor;
    a memory for storing at least one group of data, each said at least one group representing a particular theme and comprising a plurality of expressive responses;
    an output for said expressive responses; and
    means for connection to a computer to download each said group of data, the group of data for download being user-selectable to enable user selection of a particular theme;
    the toy being adapted to exchange such responses with another such toy, each said group of data comprising both responses and counter-responses, so that the toy may converse with another such toy on the particular theme;
    wherein a new such group of data can be loaded into said memory so that the toy can converse on a different user-selectable theme;
    whereby the toy can converse in a plurality of different user-selectable themes, one theme at a time.
  2. A toy according to Claim 1 further comprising means for analysing said expressive responses to select a suitable one such response, preferably using randomisation.
  3. A toy according to Claim 2 wherein said means for analysing said expressive responses to select a suitable one such response is operable to receive and respond to situation data concerning its situation.
  4. A toy according to any of the preceding claims in which expressive responses are ranked and the response is selected according to rank, preferably said rank being dependent on trigger data relating to expressive responses.
  5. A toy according to any of the preceding claims in which expressive responses are chosen from a group of responses all of which have a particular rank, and/or said expressive responses are chosen randomly from said group of responses.
  6. A toy according to any of the preceding claims in which output of an expressive response depends on some input from the user, said input preferably being triggering a sensor in the toy.
  7. A toy according to any of the preceding claims further comprising: a transceiver for transmitting and receiving data over a wireless link; means for receiving trigger data relating to said expressive responses, for selecting one such expressive response when trigger data is received, for expressing the said expressive response through the output, and for broadcasting via the transceiver trigger data indicative that a response has been output.
  8. A toy according to any of the preceding claims in which the trigger data indicates which expressive response was output, or the proximity of a second toy.
  9. A toy according to any of the preceding claims wherein at least some of said data is downloadable to the toy from said computer, or from a website via the internet, or from a CD-ROM.
  10. A toy according to any of the preceding claims wherein said counter-responses are compatible with said responses.
  11. A toy according to any of the preceding claims, wherein said data comprises speech data, preferably said speech data being organised into at least one group or theme, preferably said speech data including at least one of: a sequencing tag, an action tag, and an affective tag.
  12. A toy according to any of the preceding claims, wherein said data comprises music data.
  13. A toy according to any of the preceding claims, wherein said data relates to accessories, preferably said accessories including at least one of: clothes, buildings, equipment, and transportation.
  14. A toy according to any of the preceding claims, wherein said output includes a transducer, preferably the transducer being a loudspeaker, or being at least one motor operable to move at least one feature of said toy.
  15. A toy according to any of the preceding claims wherein the toy is further operable to receive and respond to situation data concerning its situation, preferably the situation being at least one of: the toy's environment, the time of day, and the date.
  16. A toy according to any of the preceding claims in which the expressive response is at least one of: a gesture, a vocalisation, a phrase, and music.
  17. A toy according to any of the preceding claims operable to broadcast trigger data on a user command, said user command preferably comprising shaking the toy or squeezing the toy or pressing part of the toy.
  18. A toy according to any of the preceding claims comprising a code segment operable to download expressive responses, grouped data, or personality data from the internet, and preferably to download music from the internet.
  19. A toy according to Claim 18 comprising means for reproducing the music audibly, preferably said music being audibly reproduced using personal headphones.
  20. A toy according Claim 18 or 19, wherein said downloaded music is in a digitally compressed format.
  21. A toy according to any of the preceding claims comprising a removable memory, said removable memory preferably containing a group of data representing a theme, preferably said theme being interchangeable in said memory.
  22. A toy according to any of the preceding claims comprising a physical connector to a computer.
  23. A toy according to any of the preceding claims comprising an electromagnetic transceiver, said toy preferably further comprising an infrared, radio-frequency, or bluetooth transceiver.
  24. A toy according to any of the preceding claims, wherein the toy is programmable.
  25. A combination of two toys, each according to any of the preceding claims, each toy being adapted to exchange expressive responses with the other.
  26. A toy according to any preceding claim, wherein the toy is a doll.
  27. A system comprising a toy according to any of the preceding claims and a dock for said toy, said dock comprising a physical connector for the said toy for downloading data into the said toy and which is operable to connect to a network for downloading data from the network, preferably said connection to the network being physical.
  28. A system according to Claim 27 comprising a recharging point for the toy.
  29. A method of communication between first and second toys comprising:
    grouping a plurality of expressive responses into at least one group of data, said at least one group representing a particular theme, each toy being adapted to exchange such responses with the other toy, each said group of data comprising both responses and counter-responses, so that the toys may converse on the particular theme;
    selecting, loading and storing a new such group of data into a memory so that the toys can converse on a different theme, the group of data being user-selectable to enable user selection of a particular theme;
    activating a first expressive response from said at least one group stored in said memory of the first toy, the first toy being in the presence of the second toy;
    sending trigger data from the first toy indicative of the first expressive response to the second toy;
    the second toy selecting a second expressive response from said at least one group of expressive responses, from said second toy's memory, on receipt of said trigger data, activating the second expressive response, and sending trigger data indicative of the second expressive response to the first toy;
    whereby the toys can converse in a plurality of different user-selectable themes, one theme at a time.
  30. A method according to Claim 29 including analysing said expressive responses to select a suitable one such response, preferably using at least one of randomisation and situation data concerning its situation.
  31. A method according to Claim 29 or 30 in which the expressive response is at least one of: a gesture, a vocalisation, a phrase, and music.
  32. A method according to any of Claims 29, 30 or 31 in which the trigger data broadcast indicates which expressive response was output, said trigger data preferably being broadcast on a user command, said user command preferably comprising triggering a sensor in the toy, by, for example, shaking the toy or squeezing the toy or pressing part of the toy.
  33. A method according to any of Claims 29 to 32 in which the trigger data is indicative of the proximity of a second toy.
  34. A method according to any of Claims 29 to 33 comprising analysing the trigger data received for an indication of which expressive response the data represents and selecting an appropriate expressive response.
  35. A method according to any of Claims 29 to 34 in which expressive responses are ranked and the response is selected according to rank, preferably the rank of the expressive response being dependent on the trigger data, preferably the expressive responses being chosen from a group of responses all of which have a particular rank.
  36. A method according to any of Claims 29 to 35 in which the output of an expressive response depends on some input from a user, preferably the input being triggering a sensor in the toy.
  37. A method according to any of Claims 29 to 36 comprising downloading expressive responses, themes, or personality data from the internet, preferably comprising downloading music from the internet.
EP06726915.9A 2005-04-26 2006-04-26 Toys Not-in-force EP1885466B8 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
GB0508466A GB2425490A (en) 2005-04-26 2005-04-26 Wireless communication toy
GB0604215A GB2423943B (en) 2005-04-26 2006-03-02 Toys
PCT/GB2006/001530 WO2006114625A2 (en) 2005-04-26 2006-04-26 Toys

Publications (3)

Publication Number Publication Date
EP1885466A2 EP1885466A2 (en) 2008-02-13
EP1885466B1 true EP1885466B1 (en) 2015-12-02
EP1885466B8 EP1885466B8 (en) 2016-01-13

Family

ID=36764485

Family Applications (1)

Application Number Title Priority Date Filing Date
EP06726915.9A Not-in-force EP1885466B8 (en) 2005-04-26 2006-04-26 Toys

Country Status (2)

Country Link
EP (1) EP1885466B8 (en)
WO (1) WO2006114625A2 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8353767B1 (en) * 2007-07-13 2013-01-15 Ganz System and method for a virtual character in a virtual world to interact with a user
GB0714148D0 (en) 2007-07-19 2007-08-29 Lipman Steven interacting toys
EP2341991A1 (en) * 2008-07-18 2011-07-13 Hydrae Limited Interacting toys
GB2511479A (en) * 2012-12-17 2014-09-10 Librae Ltd Interacting toys

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030124954A1 (en) * 2001-12-28 2003-07-03 Shu-Ming Liu Interactive toy system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2225060A1 (en) * 1997-04-09 1998-10-09 Peter Suilun Fong Interactive talking dolls
JP2001154681A (en) * 1999-11-30 2001-06-08 Sony Corp Device and method for voice processing and recording medium
MXPA02005373A (en) * 2000-02-11 2004-04-21 Mattel Inc Interacting toy figure for computer users.
US7252572B2 (en) * 2003-05-12 2007-08-07 Stupid Fun Club, Llc Figurines having interactive communication
US20050009443A1 (en) * 2003-05-20 2005-01-13 Martin Raymond J. Supra-voice sound-responsive toy

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030124954A1 (en) * 2001-12-28 2003-07-03 Shu-Ming Liu Interactive toy system

Also Published As

Publication number Publication date
WO2006114625A2 (en) 2006-11-02
EP1885466B8 (en) 2016-01-13
EP1885466A2 (en) 2008-02-13
WO2006114625A3 (en) 2007-03-15

Similar Documents

Publication Publication Date Title
US8540546B2 (en) Toys
US9480929B2 (en) Toy incorporating RFID tag
Littauer Personality plus
US9039482B2 (en) Interactive toy apparatus and method of using same
US20070128979A1 (en) Interactive Hi-Tech doll
JP3494567B2 (en) Portable communication toy and information storage medium
US20100041304A1 (en) Interactive toy system
US10643482B2 (en) Fill-in-the-blank audio-story engine
WO2008042671A2 (en) Interactive toy system
EP1885466B1 (en) Toys
EP1776990A2 (en) Interactive toy system
Kuntjara et al. Character design in games analysis of character design theory
Hurley The happy kid handbook: How to raise joyful children in a stressful world
Jenkins ‘Going Bonkers!’: Children, Play and Pee-Wee
Littauer Personality Plus For Parents: Understanding what makes your child tick
Menon There's Something about Sweetie
Morley Advertainers and their Audience: Power Relations and Promotionalism in HobbyKidsTV
Mian Planet Omar: Unexpected Super Spy
Donavan Let, Lift, & Listen: A Timeless Framework for Effective, Guilt-Free Parenting of All Ages and Stages
Matheson YouTube Famous: Making it big on the internet
Desi Deixis In the Song Lyrics of Ed Sheeran’s Divide
US20170312643A1 (en) Character based games and methods of play
Payleitner The Little Book of Big Ideas for Dads and Daughters
Buchanan Candid Conversations with Connie, Volume 2: A Girl's Guide to Boys, Peer Pressure, and Cliques
Bryan I want to teach my child about values

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20071121

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

DAX Request for extension of the european patent (deleted)
RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: MUSCAE LIMITED

RIN1 Information on inventor provided before grant (corrected)

Inventor name: LIPMAN, STEVEN

17Q First examination report despatched

Effective date: 20120629

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150508

GRAR Information related to intention to grant a patent recorded

Free format text: ORIGINAL CODE: EPIDOSNIGR71

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

INTG Intention to grant announced

Effective date: 20151015

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 763363

Country of ref document: AT

Kind code of ref document: T

Effective date: 20151215

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

RBV Designated contracting states (corrected)

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602006047406

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160302

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 763363

Country of ref document: AT

Kind code of ref document: T

Effective date: 20151202

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160303

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160402

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160430

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160404

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602006047406

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

26N No opposition filed

Effective date: 20160905

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160426

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160430

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 602006047406

Country of ref document: DE

Owner name: LIPMAN, STEVEN, GB

Free format text: FORMER OWNER: MUSCAE LTD., RAMSEY, ISLE OF MAN, GB

Ref country code: DE

Ref legal event code: R082

Ref document number: 602006047406

Country of ref document: DE

Representative=s name: SCHWABE SANDMAIR MARX PATENTANWAELTE RECHTSANW, DE

Ref country code: DE

Ref legal event code: R082

Ref document number: 602006047406

Country of ref document: DE

Representative=s name: SSM SANDMAIR PATENTANWAELTE RECHTSANWALT PARTN, DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160426

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20170428

Year of fee payment: 12

Ref country code: FR

Payment date: 20170425

Year of fee payment: 12

REG Reference to a national code

Ref country code: FR

Ref legal event code: TP

Owner name: STEVEN LIPMAN, GB

Effective date: 20170906

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20060426

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151202

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602006047406

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180430