EP2341991A1 - Interacting toys - Google Patents

Interacting toys

Info

Publication number
EP2341991A1
EP2341991A1 EP09784524A EP09784524A EP2341991A1 EP 2341991 A1 EP2341991 A1 EP 2341991A1 EP 09784524 A EP09784524 A EP 09784524A EP 09784524 A EP09784524 A EP 09784524A EP 2341991 A1 EP2341991 A1 EP 2341991A1
Authority
EP
European Patent Office
Prior art keywords
toy
doll
authoring tool
theme
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP09784524A
Other languages
German (de)
French (fr)
Inventor
Robert Frederick Kilbride-Newman
Alon Shmuel
Steven Lipman
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hydrae Ltd
Original Assignee
Hydrae Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from PCT/GB2008/002457 external-priority patent/WO2009010760A2/en
Application filed by Hydrae Ltd filed Critical Hydrae Ltd
Publication of EP2341991A1 publication Critical patent/EP2341991A1/en
Withdrawn legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63HTOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
    • A63H3/00Dolls
    • A63H3/28Arrangements of sound-producing means in dolls; Means in dolls for producing sounds
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63HTOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
    • A63H2200/00Computerized interactive toys, e.g. dolls
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63HTOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
    • A63H30/00Remote-control arrangements specially adapted for toys, e.g. for toy vehicles
    • A63H30/02Electrical arrangements
    • A63H30/04Electrical arrangements using wireless transmission

Definitions

  • This invention relates to toys.
  • this invention relates to toys such as dolls that interact with each other.
  • Embedded computers and micro-processors have improved toys for children. They have been used most extensively in educational toys, but have also been used in interactive toys.
  • ActiMates® Barney® is one example of an interactive toy which responds to interaction from a child by appropriate vocalisations, and can sing-a-long to videos.
  • a toy adapted to have an interaction with at least one other such toy, comprising: a processor and a memory coupled to said processor; wherein said processor comprises: means for generating an output signal representative of an action to be performed; and means for generating a trigger signal, for reception at at least one other such toy, to trigger said at least one other such toy to perform an action before the said toy has completed its own action.
  • said trigger signal is generated at pre-determined time interval after said toy has initiated its own action.
  • said trigger signal is generated at a pre-determined time interval before said toy has completed its own action.
  • the toy further comprises an input enabling a user to input a measure of said pre-determined time interval.
  • the pre-determined time interval is less than 1 second or half or quarter of a second, and is more preferably substantially 0 seconds.
  • the action is at least one of: emitting sound, emitting light, and movement.
  • the toy further comprises a wireless communication module adapted to wirelessly communicate with said at least one other such toy. More preferably, the wireless communication module transmits at least one of. the trigger signal; information relating to the interaction; and information relating to the toy.
  • said information relating to the interaction includes at least one of: the action output by the toy; the duration of the action; and the action for the at least one other toy to take.
  • the memory is adapted to store a pre-determined interaction.
  • the processor is adapted to determine said interaction pseudo-randomly.
  • said toy is adapted to interact as if it were animate.
  • said interaction is at least one of: a conversation, a vocal interaction, an inter-personal interaction, an educational interaction, playing music, and playing a game.
  • said toy is adapted to interact as a member in a group of such toys. More preferably, said group represents one of: a music band; a group of cars; or a group of military assets.
  • said trigger signal is used to synchronise the actions of the group.
  • the toy further comprises means for receiving a trigger signal from another such toy, and uses said trigger signal to determine a time to initiate an action.
  • said toy is one of: a doll, a game board, a vehicle, and a military asset.
  • a computer readable memory for use in a toy adapted to have an interaction with at least one other such toy, said memory containing a set of instructions comprising: code for generating an output signal representative of an action to be performed; and code for generating a trigger signal, for reception at at least one other such toy, to trigger said at least one other such toy to perform an action before the said toy has completed its own action.
  • code for generating an output signal representative of an action to be performed comprising: code for generating an output signal representative of an action to be performed; and code for generating a trigger signal, for reception at at least one other such toy, to trigger said at least one other such toy to perform an action before the said toy has completed its own action.
  • the term computer readable memory includes the term computer program product.
  • the computer readable memory further comprises code for generating said trigger signal at a pre-determined time interval after said toy has initiated its own action.
  • the computer readable memory further comprises code for generating said trigger signal at a pre-determined time interval before said toy has completed its own action.
  • the computer readable memory further comprises code for enabling a user to input a measure of said pre-determined time interval.
  • said pre-determined time interval is less than 1 second or half or quarter of a second, and is preferably substantially 0 seconds.
  • said action is at least one of: emitting sound, emitting light, and movement.
  • an authoring tool for creating themed data for toys comprising means for receiving content relating to a particular theme; means for processing said content to generate a set of instructions for operating said toy within said particular theme; and means for outputting said set of instructions.
  • said receiving means is adapted to receive content that comprises separately both scripting data relating to the particular theme, and expression data defining the personality of said toy.
  • said receiving means is adapted to receive content in discrete portions.
  • the authoring tool further comprises means for allocating a unique ID number to each expression data portion.
  • said processing means is adapted to utilise said unique ID numbers as references to said expression data portions in said set of instructions.
  • said expression data comprises at least one of: a theme name, the toys' names and statements used by the toys to interact.
  • said scripting data comprises at least one of: the number of toys that can interact within the theme, a method of interaction, theme related parameters, and toy related parameters.
  • the authoring tool further comprises means for storing together, in an array, said scripting data and expression data relating to a particular theme. More preferably, said processing means is adapted to generate said set of instructions from said array.
  • said processing means includes means for compiling at least one list comprising at least some of the expression data. More preferably, said list compiling means is adapted to compile a respective list for each toy in said particular theme.
  • the expression data is symbolic data.
  • Symbolic data as used herein connotes the written form of words, music or actions.
  • the authoring tool further comprises recording means for recording enacted data versions of the symbolic data.
  • Enacted data as used herein connotes the enacted form of words, music or actions.
  • the authoring tool comprises means for prompting an actor to generate the requisite portion of enacted data.
  • said processor is adapted to generate a look-up table between the symbolic data and enacted data.
  • said processing means is adapted to output the expression data. More preferably, said processing means is further adapted to output the expression data and set of instructions separately.
  • said processing means is adapted to generate a set of instructions that includes: a base set of instructions for controlling the basic functions of the toy; and a themed set of instructions for the base set of instructions to control the toy within the theme. More preferably, said processor is adapted to combine said base set and said themed set of instructions together.
  • the authoring tool further comprises a compiler. More preferably, said compiler is adapted to compile said base set and said themed set of instructions.
  • said processor includes a coding engine adapted to transform said set of instructions into computer readable code.
  • the output of the authoring tool is adapted to be used in a conversation engine as described herein.
  • the toy is a toy as described herein.
  • a user interface for an authoring tool for creating themed data for a toy comprising: means for providing a user with a set of input windows, each window corresponding to the input of a particular sub-set of content relating to a theme; and means for initiating output of the themed data.
  • said sub-sets of content include at least one of: theme related data, toy related data, and context related data.
  • the context related data includes at least one of: statements used by the toys to interact, a method of interaction, theme related parameters, and toy related parameters.
  • the receiving means is adapted to receive, in one operation, content that comprises an entire theme, or a substantial part of a theme. More preferably, the content is in the form of a pre-formatted file. Yet more preferably, the pre-formatted file is a text file.
  • the processing means generates the set of instructions using only the content of said pre-formatted file.
  • said toy related parameters include information relating to pre-defined rules for selecting the next toy to interact.
  • said method of interaction comprises timing related parameters. More preferably, said timing related parameters determine when the next toy interacts. Yet more preferably, said timing related parameters include at least one of: the time delay between the start of the current toy's interaction to the start of the next toy's interaction; and the time delay from the start of the next toy's interaction before the current toy's interaction ends.
  • the authoring tool further comprises means for receiving content relating to a game. More preferably, said content relating to a game includes logic for enabling the game to be executed.
  • the authoring tool is adapted to implement any of the methods of interaction as herein described.
  • a system for generating themed data for a toy comprising: an authoring tool for accessing, creating and editing said themed data; and a server, comprising a database for storing said themed data; wherein the authoring tool is adapted to access the themed data via the internet.
  • said authoring tool is adapted to process the themed data into an array
  • said database is adapted to store said themed data in said array.
  • said authoring tool is an authoring tool as described herein.
  • a device for providing wireless communications between at least one toy as described herein, and a computer comprising: a communication port for connecting the device to the computer; and means for establishing a network between the computer and the or each toy; wherein said device allows the computer to communicate with the or each toy as if it were another such toy.
  • said device enables said computer to act as a virtual toy.
  • said communication port is a USB communication port.
  • said network is wireless.
  • a system comprising: at least one toy as described herein; and at least one computer, each with a device for providing wireless communications as described herein; wherein the combination of said computer and device acts as if it were a toy as described herein.
  • said computer comprises a visual, and an audio output adapted to provide a virtual toy. More preferably, said virtual toy is an avatar.
  • a toy comprising: a processor; a memory coupled to said processor; an output coupled to said processor; and means for establishing a network connection with at least one further such toy; wherein the processor includes means for controlling the output of each toy with which a network connection has been established.
  • said controlling means is adapted to transmit, over said network connection, instructions to control a plurality of the outputs (preferably all of the outputs) of each toy with which a network connection has been established.
  • said network connection forms part of a personal area network.
  • said memory is adapted to store at least one group of data, each said at least one group representing a particular theme.
  • the toy further comprises means for determining the at least one theme stored in said memory.
  • said toy is adapted to only establish a connection with another toy when at least one theme stored in said memory is the same in both toys.
  • said controlling means is adapted to transmit/receive a control message to control the output of each said toy, and wherein preferably the control message comprises an ID of the toy for which it is intended, and a command segment, and more preferably further comprises an ID of the originating toy and/or a message ID.
  • said control message comprises instructions to access a reference database and perform a task.
  • the processor includes means for transmitting/receiving acknowledgement of a transmitted/received control message, and wherein preferably said transmitting/receiving means is adapted to request that the control message is re-sent if it does not receive acknowledgement.
  • said transmitting/receiving means is adapted to transmit a parameter associated with the time that such toy will take to generate an output in dependence on the control message, and wherein preferably the originating toy waits for a duration associated with said parameter before transmitting a further control message (the time such toy will take to generate such output may vary, according for example with a theme or sub-theme of the toy).
  • the processor comprises means for counting the number of re-sent control messages, and whereby communication with said toy that does not acknowledge said control message is stopped after 1,000 - 2,000, 2,000 - 5,000, 5,000 - 10,000 or more attempts to resend.
  • said processor further comprises a conversation engine adapted to construct a conversation between said toys.
  • the further such toy is identical or substantially identical to the first such toy. Therefore, no "Spoke and Hub” arrangement is required.
  • said means for establishing a network is a network controller, preferably a network controller utilising the Zigbee protocol.
  • the toy is adapted to interact with another such toy, wherein said processor includes means for defining at least one variable associated with said interaction, means for storing said variable in said memory and means for using said variable to control an (interactive) output of said toy.
  • said processor includes means for defining at least one variable associated with said interaction, means for storing said variable in said memory and means for using said variable to control an (interactive) output of said toy.
  • a toy adapted to interact with another such toy, comprising: a processor; a memory coupled to said processor; and an output coupled to said processor; wherein said processor includes means for defining at least one variable associated with said interaction, means for storing said variable in said memory and means for using said variable in association with an (interactive) output of said toy (thereby preferably more efficiently keeping track of the interaction).
  • said variable is used a plurality of times (more preferably a multiplicity of times) to control said output.
  • said variable is used to determine the number, type or nature of said interaction, and wherein preferably said variable is said interaction.
  • the toy further comprises means for generating an interaction.
  • the means for generating an interaction is preferably adapted to generate the interaction in dependence upon the stored parameter.
  • the storing means associates each variable with a toy.
  • the storing means is memory located within the toy.
  • the means for using the variable is adapted to access the variable from the storing means.
  • said interaction is a communication between the toys.
  • said variable is a word or phrase utilised in speech.
  • said processor is adapted to store themed data in said memory, said theme comprising scripting data and expression data, said expression data defining the personality of said toy.
  • a toy comprising: a processor; a memory coupled to said processor; and an output coupled to said processor; wherein said processor is adapted to store themed data in said memory, said theme comprising scripting data and expression data, said expression data defining the personality of said toy (thereby preferably providing multiple, themed, toy personalities more efficiently).
  • the toy is adapted to interact with at least one other similar toy, wherein said scripting data is shared by each such toy and said expression data is different between each such toy.
  • said scripting data is independent of said expression data.
  • the processor is adapted to output the scripting data as a control message to another such toy, and is adapted to respond to a control message with its individual expression data.
  • the scripting data is the same for each toy, and controls the output of each toy.
  • the processor is adapted to utilise the scripting data to reference the expression data, and preferably the expression data communicates the same information using different content.
  • the personality of the toy is defined by the content of the communication.
  • said processor includes means for selecting a toy to interact based on predefined rules.
  • a toy adapted to interact with other such toys comprising: a processor; a memory coupled to said processor; and an output coupled to said processor, wherein said processor includes means for selecting a toy to interact based on pre-defined rules, and wherein said selected toy may be the originating toy.
  • said selecting means is adapted to select the next toy to interact.
  • said pre-defined rules comprise: direct selection; random selection; and choose the current interacter to interact again.
  • the processor is adapted to output a control message comprising the ID of the selected toy and preferably the ID of the originating toy.
  • said interaction comprises communication and wherein preferably said communication includes speech and directions.
  • said communication includes speech and directions.
  • the toy is in the form of an animate object, suitable for playing games with other similar toys
  • said processor includes a games engine, wherein said games engine is adapted to allow said toy to play games as if the toy were animate.
  • a toy in the form of an animate object, suitable for playing games with other similar toys comprising: a processor; a memory coupled to said processor; an output coupled to said processor; wherein said processor includes a games engine that enables each said toy to play a game as if said toy were its relevant animate object.
  • said games engine is adapted to enable a human game.
  • said human game is played with games equipment.
  • said games engine is adapted to output an instruction to enable a human to adjust the games equipment to play the game.
  • said toy further comprises means for communicating with at least one further such toy.
  • said games engine is further adapted to play rules based games.
  • said game engine is adapted to store information regarding the game in said memory.
  • said information comprises the rules of the game.
  • said information further comprises the layout of at least one playing board.
  • said games engine comprises a random number generator adapted to be a virtual die.
  • the games engine comprises means for receiving an external input regarding the game.
  • said external input is associated with the playing piece of the game.
  • said external input is at least one sensor within the playing board.
  • said external input is a switch adapted to be used by a user of said toy.
  • said rules based games include Snakes and Ladders, and Ludo.
  • said output is a transducer.
  • said transducer is a loudspeaker.
  • said transducer is an actuator.
  • a combination comprising a plurality of such toys.
  • each one of said plurality of toys comprises means for controlling the other said toys, whereby only one toy controls the other said toys at a time.
  • said memory is adapted to store information relating to the game state.
  • the game state may be at least one of: the layout of a playing board; the position of at least one counter on a playing board; and the order of play for all of the toys and/or user.
  • a device for providing a plurality of toys with themed data comprising: means for storing said themed data, wherein each said theme comprises a plurality of sub-themes; means for identifying a specific toy; means for selecting a sub-theme according to the specific toy; and means for outputting said specific sub-theme to said toy (thereby preferably accessing themed downloads is accomplished more efficiently).
  • the toy further comprises means for storing a plurality of different themes.
  • the toy further comprises means for allowing a user to select one of the said plurality of themes.
  • said means for identifying a specific toy uses a unique identification number of said toy.
  • the toy further comprises means for encrypting each said sub-theme according to a parameter associated with said toy.
  • said parameter is the toy's unique identification number.
  • the device comprises a processor and associated memory for storing the themed data and identifying the specific toy.
  • the device further comprises a connection for outputting the sub-theme to the toy.
  • connection comprises the internet and a USB cable.
  • a conversation engine for a device such as a toy comprising means for selecting a theme for the conversation; randomly choosing a starting point from a plurality of starting points; randomly choosing phrases based on variables; and randomly choosing the next speaker based on variables.
  • said phrase choices are further based on weightings.
  • the toy incorporates a conversation engine.
  • the toy, or conversation engine is adapted to receive input data from the user.
  • the toy, or conversation engine is adapted to output data to the user.
  • the conversation engine is further adapted to utilise the input data from the user in random choosing process.
  • the conversation engine comprises a processor adapted to carry out the selecting operation.
  • the toy, or conversation engine is adapted to construct the conversation in realtime.
  • the toy, or conversation engine is adapted to pre-process a conversation.
  • the toy, or conversation engine is preferably further adapted to output the pre-processed conversation.
  • the toy, or conversation engine is adapted to utilise the parameters of the other toys present in the established network as a variable when constructing the conversation.
  • the toy, or conversation engine is adapted to output data in dependence on weightings.
  • the toy is adapted to store a plurality of sets of themed data.
  • the toy is preferably further adapted to utilise at least two of the plurality of sets of themed data during a single conversation.
  • the toy is adapted to enable a network to be established with a plurality of other such toys, preferably, 2, 3, 4 or more.
  • the toy is adapted to be animate.
  • the toy is adapted to communicate with other such toys, and said communication includes, speech, actions, and gestures.
  • the toy or conversation engine has one, some, or all of the following features in any combination:
  • Interaction includes communication; communication is defined in a broad sense
  • Authoring tool - provides the facility for inputting conversation data to be compiled into program code readable by the toys.
  • USB communications dongle - provides a device for enabling communication between a toy and a PC.
  • Scripting themes are a downloadable combination of expression and script / script and expression are integral / different script for each different theme.
  • Doll choice - controller decides which doll speaks next randomly; select randomly but no doll can speak twice in a row, or select a specific doll by name.
  • Game playing - dolls play games as if humans.
  • the invention also provides a computer program and a computer program product comprising software code adapted, when executed on a data processing apparatus, to perform any of the methods described herein, including any or all of their component steps.
  • the invention also provides a computer program and a computer program product comprising software code which, when executed on a data processing apparatus, comprises any of the apparatus features described herein.
  • the invention also provides a computer program and a computer program product having an operating system which supports a computer program for carrying out any of the methods described herein and/or for embodying any of the apparatus features described herein.
  • the invention also provides a computer readable medium having stored thereon the computer program as aforesaid.
  • the invention also provides a signal carrying the computer program as aforesaid, and a method of transmitting such a signal.
  • the invention extends to methods and/or apparatus substantially as herein described with reference to the accompanying drawings.
  • Apparatus and method features may be interchanged as appropriate, and may be provided independently one of another. Any feature in one aspect of the invention may be applied to other aspects of the invention, in any appropriate combination; equally, any feature in one invention may be applied to any other invention, in any appropriate combination.
  • method aspects may be applied to apparatus aspects, and vice versa. Again, for example, any "Controller doll” feature may be applied to any "Parameter storage” feature.
  • any use of the term "means for” plus a function may be replaced by the appropriate hardware component (for example a processor and/or memory) adapted to perform that function.
  • Figure 1 shows three types of doll
  • Figure 2 is a schematic illustration of a doll
  • Figure 3 is a schematic illustration of a controller toy, with slave toys
  • Figure 4 is a schematic illustration of a doll connected to a website enabled to download themes/sub-themes to the doll;
  • Figure 5 is a schematic illustration of a doll adapted to play games
  • Figure 6 is a flow diagram of the process of playing a game
  • Figure 7 is a schematic of an alternative embodiment
  • Figure 8 is one embodiment of a circuit diagram of the processor and associated electronics
  • Figure 9 is an alternative embodiment of a circuit diagram of the processor and associated electronics
  • Figure 10 shows user PCs in communication with an authoring tool server
  • Figure 11 shows an overview of the authoring tool, and associated systems
  • Figure 12a shows a conversation designer window
  • Figure 12b shows a theme generation window
  • Figure 12c shows a populated theme generation window
  • Figure 12d shows an alternative embodiment of a theme generation window
  • Figure 12e shows a flow diagram of the text file import feature
  • Figure 13a shows an add doll window
  • Figure 13b shows a create doll window
  • Figure 14 shows a doll context window
  • Figure 15a shows a conversation entry window
  • Figure 15b shows an alternative embodiment of the conversation entry window
  • Figure 16 shows a USB dongle in communication with multiple dolls
  • Figure 17a shows a schematic illustration of two dolls and a timeline of actions
  • Figures 17 b, c and d show examples of the various timings for triggering another toy.
  • Figure 1 shows three types of toy doll; 10 is a tennis playing doll, 20 is a ballerina doll, 30 is a generic doll shown walking a dog, and 40 is a toy in the form of a tank.
  • the toys are adapted to appear animate and in particular human, or human controlled in the case of the tank and the like.
  • the four toys shown are examples of types of themed toys.
  • the toys are adapted to communicate wirelessly with other such toys within the theme.
  • the following description relates to a toy, such as a toy doll, that is enabled to communicate with other such toys; the dolls are adapted to coordinate the speech between the dolls.
  • the toy is a tank or another such vehicle; again, the tanks are adapted to communicate wirelessly with other such tanks to coordinate the behaviour of the tanks instead of the speech between the dolls.
  • FIG. 2 shows a schematic representation of the doll, with the hardware components required to allow the doll to communicate, and perform other such tasks.
  • the doll 100 as shown in Figure 2, comprises a processor 102 that includes a wireless module 104.
  • the processor is in communication with memory 106, ROM 108, and RAM 110.
  • An IR/RF transmitter/receiver is connected to the processor/wireless module and is enabled to transmit/receive signals to/from other such dolls.
  • the doll is also connected to a loud speaker 114.
  • a USB controller 116 is used to update the memory 106, and also to charge, via the charger circuitry 118, the battery 120.
  • the doll is adapted to use replaceable batteries, rather than rechargeable batteries.
  • the memory 106 stores information relating to conversations that the dolls can have, and is accessed by the processor when it is compiling speech.
  • the ROM 108 is used to store permanent information relating to the doll, such as the doll's name and ID number. This information is used in the initialisation procedure when setting up a network of dolls.
  • the RAM 110 stores information relating to the current conversation and is used in order to produce more realistic conversation by storing information relating to the phrases already used for example.
  • Each doll 100 contains in memory 106: a data set containing the doll's name, and other variables defined during a conversation; a set of instructions which produces the conversation; and a set of audio data.
  • the variables defined during the conversation are only stored in the controller doll.
  • the processor is in the form as used in MP3 decoding, with the associated memory interfaces (such as SD cards).
  • This embodiment provides a significant amount of processing power (and hardware based compression technology) and would therefore allow for long and detailed conversations between the dolls.
  • the controller unit, 200 is in communication with a number of slave units, 202.
  • the controller includes a conversation engine 204, a speech compiler 206, a speech database 208, a loudspeaker (transducer) 210, a transmitter/receiver 212 capable of transmitting and receiving data from the slave units.
  • the conversation engine comprises a random speech selector 214, a parameter storage memory 216 and a speaker selector 218.
  • the slave unit has all of the components of the controller unit; not all of the slave unit's components are shown in Figure 3.
  • the first unit to be powered on is initialised to be the controller unit.
  • a unit When a unit is powered on it searches for an existing network, and when no network exists it creates a network and waits for other units to join the network. When further units are turned on they join the network and are initialised as slave units.
  • the controller unit awaits communications from both new units indicating they require the network details, and conversation initiation messages.
  • the slave units once they have joined the network, await instructions from the controller unit. It should be understood that all of the units (toys/dolls) are identical in as far as they are all able to become the controller unit, or a slave unit.
  • the units are adapted to communicate within themes, such as "The Zoo”, “Sport”, “Gangsta” or “Fashion”.
  • Themes allow the units to have detailed conversations without requiring extremely large databases of information relating to all of the possible conversation topics.
  • the themes/sub-themes can be downloaded to the units by the user from a website.
  • Each subsequent doll that is turned on transmits a doll ID number and theme/themes ID number that they have stored in memory - the information is transmitted via the transmitter 212.
  • the controller checks the theme/themes and only allows dolls with the same theme/themes as the controller to join - the controller unit performs a comparison of the transmitted data with the data is has stored in memory.
  • the user initiates the conversation by pressing a button or the like, and the controller starts a conversation instructing the other dolls what to say
  • the controller unit runs the program to generate conversations and then transmits information to the slave units to inform them which audio files to access (the audio files can be different for each personality type, but the reference to each of the audio files is the same for each unit).
  • the controller unit transmits the identifiers of the words/phrases to access from the slave unit's memory.
  • the slave unit acknowledges receipt of the message by transmitting a message verifying the phrase to be used, and the expected length of time required to say the phrase.
  • the slave unit then uses the speech compiler to compile the words/phrases and then uses the loudspeaker to say the phrase. Once the slave unit has finished saying the phrase it transmits a signal to the controller unit that it has finished and the conversation can carry on.
  • the controller unit then instructs the next speaker in the same way, and so on until the conversation comes to an end. Further detail regarding conversation construction is provided below.
  • the toys communicate using a communication protocol; the format of the messages is as follows:
  • the MessagelD is a unique number identifying the message. Each message sent from the controller toy has a unique identifying number.
  • the SendingToyJD indicates the toy sending the message.
  • the ReceivingToyJD indicates the toy that is to receive the message.
  • the MessageType indicates the type of message e.g. START, STOP, SAY.
  • the Parameters are any other required information related to the message type. Only the SAY message has a parameter, which identifies the phrase(s) to be spoken.
  • the range of messages comprises:
  • the parameter is only used for acknowledging the SAY message and it specifies the duration of the phrase.
  • the controller unit uses the duration of phrase parameter to wait for the appropriate length of time before sending the next message.
  • the START command instructs the receiving toy to expect to receive further incoming messages.
  • the controller doll then sends at least one message containing the phraselD of the phrase that the slave toy is required to use. Each phraselD is sent separately to the slave toy, and so multiple messages of this type may be sent to build up an entire sentence.
  • the STOP command is used to instruct that slave toy that there are no further messages in that sequence.
  • the slave toy upon receipt of a message, sends a message to the controller acknowledging the receipt of the message.
  • the controller continues with the conversation program immediately for the START and STOP acknowledgements; however, for the SAY command the controller doll continues after a delay equal to the DURATION for the SAY acknowledgement. If the acknowledgement is not received then the message is resent until an acknowledgment is received. This resending happens a large number of times at which point the dolls will reset and the conversation will stop; for example, the message is resent between 1 ,000 - 2000, 2000 - 5000, 5000 - 10,000 times, or more.
  • An "end of phrase flag" is also attached to the end of each phrase to inform the slave unit when the phrase has finished. At this point the slave unit will transmit a message to the controller indicating that it has finished speaking.
  • the controller instructs the next unit to speak, the next speaker may be the controller or another slave unit.
  • the controller toy is a tank the instructions communicated to the slave units take the form of directions that the slave unit tanks should move in. Therefore, the PhraselD would be replaced with a movementlD. In this way the controller tank would simulate a battle or the like.
  • the toy tanks are provided with means to locate the other toy tanks in the network so that they may move in a coordinated manner.
  • the means can take the form of a playing board with position sensors that the toys are in communication with, or other means of location such as a camera, transponders or the like.
  • each doll controls its own actions; i.e. each doll runs the program to generate the conversation. Therefore, effectively each doll in the network is a controller doll.
  • each doll transmits information to the other dolls relating to the point within the program that they have reached. This enables the next doll that is due to speak to continue running the program from the correct point.
  • information relating to variables set by the current controller doll are transmitted to all of the other relevant dolls; e.g. if it is a global variable it will be transmitted to all of the other dolls.
  • toys are adapted to interact with other such toys, in a more life-like manner.
  • the toys in the form of dolls, vehicles, or the like, are provided with an interaction engine that enables them to interact as if they were animate.
  • the interaction engine is adapted to enable the toys to output actions simultaneously, i.e. without requiring each toy to complete an action before another toy can begin a separate action.
  • the interaction engine is similar to the conversation engine as described herein, but it is enabled - additionally or alternatively - to handle the output of actions other than speech, such as movement.
  • Figure 17a is a schematic illustration of two dolls, A and B 1750, and the corresponding timelines showing the various timings available to synchronise the dolls' actions are shown in Figures 17b, c and d.
  • Both of dolls A and B are essentially the same, and include a processor 1700, a memory 1702 coupled to the processor, a transducer 1704 coupled to the processor, and a wireless communications module 1706.
  • the memory 1702 stores information relating to the prospective interaction between the dolls, such as a conversation or military manoeuvre.
  • the interaction engine 1708 is connected to the processor and enables the interaction to be constructed.
  • the processor 1700 is adapted to utilise the stored information to construct an interaction between two or more dolls.
  • the output of the processor 1700 outputs signals representative of the actions chosen by the processor, and this is forwarded to transducer 1704 to turn the output into the appropriate action.
  • the processor 1700 is also adapted to generate a trigger signal which is wirelessly communicated, via the wireless communications module 1706, to the other dolls within the network.
  • the trigger signal can be sent at any time before the current doll has completed its own action. This can enable the dolls within the network to be synchronised with respect to their outputs.
  • the toy triggers the next toy immediately after starting the current action; in this example, Doll A triggers Doll B to say Phrase 4 zero seconds after starting to say Phrase 3. o
  • this form of synchronisation is used to enable the Dolls to interact as if they were in a music band, with all members of the band starting to play music at the same time.
  • the toy triggers the next toy at a time interval before the end of the current action; in this example, Doll A triggers Doll B to say Phrase 6 y seconds before ending Phrase 5.
  • this form of synchronisation is used to enable Doll B to start "laughing" at Doll A's joke before Doll A has finished.
  • the trigger signal sent to the next toy can contain information relating to the current interaction, and information relating to the toy itself. For example, where a single controller doll controls the entire interaction, the trigger signal will request that the slave doll outputs a certain action. However, if each doll controls its own output, then the trigger signal will inform the next doll where in the interaction they should begin processing what to output next.
  • the trigger signal could include parameters that have been set; for example, if a doll randomly chooses a name for their pet that name is passed to all dolls so that they can use that information in constructing a conversation.
  • the trigger signal could include information relating to the timing; e.g. the trigger signal is not sent when the next doll must act, but at the beginning of the current doll's action with information indicating when the next doll should start.
  • An interaction such as a conversation, playing music or playing a game, can either be pre- determined, or can vary dependent on pseudo-random selection of what action to output next.
  • the toys are adapted to interact as if they were animate.
  • the ability for any toy to perform an action at any point provides a more life-like interaction than one where all actions occur in sequence.
  • the toys are also provided with an input, such as a port, that enables an interaction to be downloaded into the toy.
  • the interaction is in the form of a theme as herein described.
  • the synchronisation can allow for the dolls to act as if they were members of a group. For example, a number of dolls can act as if they were in a band.
  • the first doll initiates a piece of music
  • each of the other dolls plays a different part of that piece of music; i.e. one would act as the lead singer, one the drummer, one the guitar and one the bass guitar.
  • the doll would send a signal to each other doll to start playing their section of the music immediately, thereby creating a complete piece of music.
  • the music can be divided into phrases with control, and timing, being negotiated at the end of each phrase.
  • the toys could be grouped into two, or more, armies with tanks, soldiers and the like (i.e. military assets). Each army would act as a unit, and the one of the toys could trigger the other toys to move as a unit. The movement would be synchronised using the above described methods.
  • Another example of grouped actions would be racing cars, where one of the toys determines the actions of a group of cars to simulate a motor race.
  • a user can control one, or more, of the cars remotely and initiate a pre-determined set of actions for the other surrounding cars.
  • the synchronisation methods would be used to control the actions of the cars, so that they move together rather than in sequence.
  • one of the dolls in the group is adapted to be a game board, such as a chess board, ludo board, snakes & ladders board or the like.
  • the board comprises sensors that allow the position of the playing pieces to be known, and in this way the board can interact with the other dolls and the child by outputting information relating to the stage of game play and whether or not the playing pieces are in the correct position.
  • the dolls are adapted to act out a famous play, or a famous religious scene such as the nativity.
  • a famous play or a famous religious scene such as the nativity.
  • grouped actions would be used in an educational environment. For example, a group of dolls would be taught in any subject, whereby one doll is the teacher and asks questions which would be answered by all of the other dolls simultaneously, thus promoting learning for the child.
  • Conversation construction The conversation engine constructs the conversation on the fly. Alternatively, before initiating the conversation the entire conversation is constructed and then stored in memory and effectively the conversation is then run through until the end. However, in both cases the conversation constructed will be based on certain random choices.
  • the conversation is based on the units present in the network, and therefore the number of units present, and the type of units present, are used as control variables.
  • the start of each conversation is fixed, such as for when the toys are dolls "Wow, we're at the Zoo what shall we do now?". But there are multiple starting phrases.
  • the conversation will then be randomly chosen from that point on.
  • the controller unit selects the first unit to speak and then branches at random to any of the starting phrases.
  • the system is enabled to use an instruction set comprising a number of different types of commands as follows:
  • SWITCH - switches to next unit.
  • switch speaker - moves the speaker pointers to another speaker switch finish - this statement is used to finish the conversation
  • SAY - instructs the unit to say something.
  • SET - this statement is used to set a variable, such as "SET pet ([1,dog])".
  • the SET statement is used to set a variable of the current speaker, or it can be used to set a global variable.
  • TEST - this statement is used to test whether a variable has been set, or if a branch has been used for example. If the TEST is true a flag is set.
  • TEST EQ - this statement tests whether the two expressions are equal and will produce a positive flag if they are; for example, "TEST EQ &ME.PET &UNDEF" will test whether the current speaker's pet variable is undefined and will produce a positive flag if it is.
  • TEST NE this statement tests whether the two expressions are not equal, and will produce a positive flag if they are not equal.
  • BRANCH - this statement is used to branch off into another section of the conversation. For example, "BRANCH Gorillas:” would branch off into the Gorillas section of the "Zoo” theme; where "Gorillas:” is a label to a section of the theme. This is an unconditional statement and is always used when the program reaches a branch statement.
  • BRANCH_F conditionally branches on a flag from TEST. Therefore, only when the flag produced from the TEST statement is positive will the branch statement be used.
  • CHOOSE-F conditionally chooses based on a flag from TEST
  • the audio files are stored in a cropped form to reduce the storage requirements, i.e. there is no silence before or after each audio segment.
  • a number of silent audio files are provided of differing length that can be placed after the cropped audio files, between each phrase or word. These audio files are referenced in the same way as any of the other audio files by the SAY statement.
  • Variables can be defined, by the SET statement, to store parameters associated with each of the dolls; this is discussed in further detail below. There are two types of variables that can be defined:
  • Global variables - are variables that are associated with the "theme” and not with each Doll. Global variables are created by the DEFINE G_VARIABLE_NAME statement.
  • variables defined within the theme do not have a value assigned to them until a value is assigned during the conversation.
  • the SET statement consists of a random feature that allows the variable to be set with a value taken at random from a set of values as follows:
  • Doll variables are set in the context of the current Doll.
  • the SET_F statement is used to set a variable only when a TEST statement has produced a condition_flag situation. In this case if and only if the condition_flag is active the variable is set.
  • Context reference and switching Pointers are used to store information relating to the speakers, and to enable the controller doll to reference other dolls. When constructing conversations these are used to create sensible conversations; the following are the pointers used:
  • Previous speaker the ID number of the previous speaker current speaker
  • ME the ID number of the current toy next speaker
  • NXT the ID number of the chosen next speaker
  • the context refers to the variables that the current doll has access to. Only the previous, next and current doll's variables are available for access. The concept of context is handled by three reference pointers, as defined above.
  • Control of context is achieved by use of the SELECT commands and the SWITCH command.
  • SELECT commands There are a number of variations of the SELECT command. These are:
  • SWITCH command There are two variations of the SWITCH command:
  • SWITCH SPEAKER label This switches the speaker context and branches to the instruction specified by the label. On switching context the previous speaker (PREV) becomes equal to the current speaker (ME), the current speaker (ME) becomes equal to the next speaker (NEXT), and the next speaker (NEXT) is undefined.
  • TEST EQ &ME.NAME &PREV.NAME sets the condition_flag if the current speaker's (ME) name is the same as the previous speaker's (PREV) name.
  • the TEST statement is used to interrogate whether the variable is undefined, or is a specific value. This can then be used for flow control; for example, if the variable PET is undefined then the doll will ask the other doll what type of pet is has, and if the variable is set it will ask the other doll what colour the pet is, and so on. Unconditional flow control
  • SAY phrasel , phrase2,..., phrasen
  • This command causes the Doll that is the current speaker (ME) to utter the phrases phrasel , phrase2,..., phrasen.
  • This example can say nine different things for each Doll present by choosing one of three colours to go with one of three garments.
  • the conversation is constructed using multiple branches. Each branch is a different area of conversation related to the theme. For example, in the "Zoo" theme the branches available are “Gorillas”, “Reptiles” and “Ice cream”. Each branch has phrases/words associated with it and they are then chosen randomly from the selection. The doll's responses are dependent on the branch, the doll's personality type, and the weightings of the possible responses.
  • the conversation continues within a branch until a section is reached that enables the controller doll to select another branch to take. At this point another decision is made regarding the branch to take.
  • Weightings are attached to each variable that can be chosen randomly, such as Branch, Phrase, Word, or Next speaker. When the phrase/word or branch etc is chosen randomly the weightings alter the probability that that phrase/word branch, etc, is chosen. For example, if all of the phrases had a weighting of 1 then they would all have the same probability of being chosen.
  • the weightings can be adjusted to produce conversations that are more life like. Phrases such as "I fell off my bike today" are far less likely to arise than phrases such as "I had breakfast this morning”. As a result the latter phrase would have a far greater weighting than the former. Therefore, only occasionally the conversation engine would result in a unit saying "I fell off my bike this morning”.
  • the weightings used can be preferential to the previous doll and will therefore induce mini conversations between two dolls.
  • the amount of time within any one branch of the theme is controlled. This can be used as another weighting parameter to reduce the time spent in one branch and increase the amount of time spent in another branch for example. This aids in reaching an end to the conversation without the possibility of the continuing indefinitely.
  • the length of the conversation may be random; however, in some cases the conversation will continue until all of the variables have been set. For example, in the PET theme the conversation will continue until all of the dolls' pets have been fully described. This is accomplished by performing a check to determine whether all of the variables are defined, and only allowing the conversation to end if they are all defined.
  • the conversation will continue until all of the variables have been set for all three dolls in the current context, i.e. the current doll, the previous doll and the next doll.
  • the conversation will continue until all of the variables are known for two, or more, sets of dolls in a row.
  • the conversation engine can cope with multiple dolls, and potentially multiple dolls of the same type, e.g. 2 Jane dolls.
  • each doll that joins the network is associated with a network node.
  • the system then references the dolls using the associated network node, and not the name of the doll. This enables multiple dolls with the same name to be referenced without error.
  • Conversations can also be pre-determined in their entirety and then downloaded directly to the dolls. For example, an episode of The SimpsonsTM could be downloaded into a group of The SimpsonsTM dolls.
  • Pre-determined conversations enable the doll to have especially lifelike conversations, since they are generated by humans, or alternatively they could be generated by a conversation engine and then edited by humans. The same instructions are used when producing a pre-determined conversation; however, the random elements are removed such that the conversation is the same every time it is activated.
  • the above conversation engine could be used independently to generate conversations. For example, it could be used for automated script writing for a television show, such as a cartoon.
  • the theme is scripted, and then a compiler is used to compile the script.
  • a run-time error check is performed to ensure that the theme does not produce never ending conversations or any other errors, and then a sanity check is performed to ensure that the conversations are not completely nonsensical.
  • the theme is then able to be downloaded to the toy once the audio files have been recorded.
  • an authoring tool to simplify the generation of theme scripts.
  • the basic principles of the conversations within the themes still apply. For example, the same methods of choosing what to say are present in both embodiments.
  • the conversation engine has a speaker selector 218.
  • the speaker selector selects the next toy to speak.
  • choosing the next speaker by name a check must be performed to determine that the toy is in the network.
  • the select statement chooses who will speak next.
  • the options are to respond with relevant speech, select another doll and address them, or announce something about the current speaker.
  • the SELECT statement is used within the speaker selector 218 to initiate the random selection of the next speaker.
  • the SELECT statement can use logic to determine the reference to the next speaker. For example, if the next doll chosen to speak is Jane, then the current speaker can ask the following question "Jane, what is your favourite pet?". Jane is set as the next speaker and so the reply will come from Jane.
  • the & statement can be used to reference the next speaker, or any other general parameter without knowing the specific parameter. For example, &NEXT.NAME references the next speakers variable NAME, and can be used to say the next speakers name.
  • the parameter storage memory 216 stores information relating to the current conversation.
  • the information stored includes: the phrases that have already been used; the variables that have been used; flow control variables; and other such information like the dolls that are in the network.
  • the information is only stored within the controller doll.
  • the slave unit only receives information relating to the next thing to say.
  • variables that have been used in the conversation are stored so that they may be referred to later in the conversation.
  • Variables are pieces of information describing the doll, and are used to differentiate the characters. For example, the information stored from the phrase "My dog is called Fluffy" would be the information, dog and fluffy.
  • This variable can be used to set the type of pet that a doll has.
  • the variables can be set so that dolls can only have a certain sub-set of the variable. For example, girl dolls can not have a snake as a pet.
  • Flow control variables are used to store information regarding the branches that have already been used. For example, a branch may be going to see the Gorillas when at the Zoo. This piece of information will be stored so that the conversation does not return to the Zoo.
  • the phrases that have already been used are stored so that the conversation does not go on forever.
  • Limits can be set on the number of times a particular word/phrase can be used within a single conversation; this limit may be 1 , 2, 3 or more. This ensures that the conversation does not become too repetitive.
  • a global variable can be set and are stored within the parameter storage memory.
  • An example of a global variable would be anything that affects all of the dolls within the network, for example "it's raining outside", or the places that the doll's have been within the conversation.
  • a global variable can be accessed independently of the context of the doll, and so can be used at any point in the theme.
  • theme attributes/global variables store parameters associated with the entire theme and can be accessed by any doll at any time
  • doll attributes/local variables store parameters associated with each doll and are only accessible by the previous/current/next doll.
  • FIG 4 shows a schematic illustration of the process through which a doll can change, or update, the theme that it has stored in memory.
  • the doll 300 contains an ID number 302 which is used to identify the doll.
  • the doll is connected to a PC 304 via a USB connection, and the PC is in turn connected to the Internet 306 via a standard connection type.
  • the Internet provides the PC with a connection to the Website 308 that contains downloadable themes 310.
  • the themes contain sub- themes 312 that are not selectable by the user as they are dependent on the doll connected. For example, a Jack doll - identified using the doll's ID number - would not be presented with a Jill sub- theme.
  • the themes are generic to all of the personality types.
  • the sub-themes are identical to the main theme, except that the expression of the theme is different and dependent on the personality type of the doll.
  • the audio files are therefore different for each sub-theme - different voice, different wording (same meaning), etc.
  • the first personality downloaded into the doll can be used to restrict the subsequent downloaded personalities to be the same as the first type.
  • the website will recognise the Jack sub-theme when the doll is connected, and only present the user with Jack sub-themes.
  • the website recognises the sub-theme by accessing the doll's name variable, i.e. Jack, and comparing it to the list of names of sub-themes.
  • the downloaded sub-theme includes the script for the theme chosen, such as "The Zoo", the associated personality type, the corresponding audio files that enable the doll to vocalise the conversation, and a theme ID which is used to ensure all of the dolls within a network have the same theme.
  • the PC 304 is adapted to interface between the doll 300 and the website 310 to enable the theme to be downloaded in an efficient manner. Furthermore the theme is only stored on the doll and therefore each doll that requires the theme must be connected to the website. Therefore, if one user has two dolls and requires the same theme for each doll the user must connect to the website with each doll, and download the appropriate sub-theme.
  • the doll can store multiple themes at any one time.
  • the doll communicates using one theme at a time; however, the themes could be changed - by the controller - at any time. Therefore, the dolls could use the "Sport" theme and then progress onto using the "Zoo” theme. This enables the conversation to continue for longer and provides further combinations to extend the usability of the dolls.
  • the dolls all have a default theme so that they may communicate briefly when they do not have the same theme as other dolls.
  • the default theme contains a few basic phrases, and may direct the user to connect to the website to download a theme.
  • the data can be encrypted, using the doll's unique ID number before being downloaded to the doll.
  • Each doll's unique ID number can then be used to decrypt the data within a theme. This can be used to ensure that every doll connects to the website to download the theme. For example, even though each Jane doll would use the same sub-theme the data would be encoded differently for each specific doll, and is therefore effectively useless other then for that specific doll.
  • each different theme has various sub-themes that enable different personalities to be expressed.
  • the script for every theme is different and is used to generate conversations according to that theme.
  • each sub-theme within every theme has the same script to generate the conversations, but the language used in the sub-theme is different. This enables multiple personalities to be available for the same theme.
  • the name of the doll i.e. Jane
  • the name of the doll is linked to the personality type so the personality expressed by the Jane doll will be the same for every theme; only the content of the theme would change. This enables the doll to remain consistent and allow the doll to react in similar ways in different situations.
  • the user of the doll can select the doll's name and the dolls personality when the doll is first initialised by the website. This enables the user to be more involved with the doll.
  • the doll's name and personality type would then be stored in memory within the doll, each attribute associated with an ID, and used when downloading further sub-themes for example.
  • the downloadable themes are a combination of the expression and the script and dictate the type of conversation.
  • the aesthetics and vocabulary of the dolls can also be tailored so that it is age appropriate for a target audience.
  • Various themes may have an age appropriate rating. This allows hip hop themed dolls, for example, for a teenage market.
  • phrases can be provided that are only allowed to be used by a discrete set of dolls (this may be a single doll). When this phrase is selected a check is performed to ensure that it can be used by the current doll. If it can not be used by that doll then another phrase is selected.
  • sections of the instructions can be restricted to only a discrete set of the dolls to introduce further randomness into the conversations.
  • the toy is in the form of a tank, or other such toy.
  • the expression of the toy's personality in this case is in the form of movements as opposed to speech.
  • one toy tank could have a "defensive” personality and another toy tank could have an "aggressive" personality.
  • the authoring tool is an application which can be used to create conversation themes for multiple dolls.
  • the conversations as described above require a significant amount of time to create due to the large number of potential branches that the conversation can follow. Therefore, in order to make the process more efficient an authoring tool is provided to aid in this process.
  • the client application runs on a personal computer or the like, such as PC 1000 or laptop 1002 as shown in
  • the data is stored on a server 1004 to allow either multiple users to work on the same theme, or for a single user to work on the same theme from different locations.
  • a web service is provided on the server to interface the database with the client application.
  • the client application communicates with the server 1004 via the internet 306.
  • the client application formats requests to the web service, and hence the database, using XML, and transmits the data using the SOAP protocol.
  • FIG 11 shows an overview of the authoring tool.
  • a user interface 1100 is provided to allow theme developers to simply and efficiently output themes for toys. Using the user interface provided the developer follows the following steps: 1. Create a theme using a theme generation engine, 1102
  • context connotes a sub-set of content within the theme data, e.g. for each position within the themed conversation there is at least one context that determines what the doll says and which doll will speak next.
  • a context can also set theme/doll attributes.
  • the phrases are recorded using recording means and audio files are created and saved using the recorder 1112.
  • the recorder prompts an actor to generate each of the expression data required for the particular theme being created.
  • the recorder then allocates each audio file with the ID number corresponding to the appropriate expression data.
  • the audio files are referenced using the appropriate ID number by the code operated by the toy's processor and output using the toy's speaker.
  • a set of base instructions 1114 (the firmware for the toy's processor) are combined with a set of themed instructions (generated by the code generation engine 1108) and compiled using a compiler 1116 into binary files that are used by the toy's processor to operate the toy according to the theme.
  • the base set of instructions/firmware was located in the toy's processor memory, and only the set of themed instructions, and the audio files, were downloaded to the doll each time the theme was changed or updated.
  • each doll has an individual download, comprising the same themed instructions, but with personalised audio files).
  • the authoring tool has access to the server 1004 and a database 1122, where the themes are stored.
  • the themes are stored in different formats depending on whether they have been finalised by a theme developer.
  • the non-finalised themes are stored such that the information is readily accessible by the authoring tool; this is in the form of a database containing references to the theme name, toy name, contexts, etc.
  • Once the theme developer finalises the theme the theme is also stored as a set of instructions as described above, in addition to the non-finalised format. This enables a finalised theme to be amended, and a new theme created based on a previously finalised theme.
  • a website 1124 is provided that enables the users of the toys to download the themed data to his/her toy/doll 1126.
  • the authoring tool has several functions including those as described above:
  • the authoring tool application user interface is shown in Figures 12a to 15. Each window of the interface has numerous navigation buttons to either interface with input windows, or to proceed to the next interface window.
  • the user interface utilises the processor 1150, and associated memory
  • the processor 1150 and memory 1152 are situated within the PC 1000 or laptop 1002.
  • content connotes scripting data, expression data, theme data, doll data, and any other data type that may be input by the user into the authoring tool.
  • Figure 12a is the first interface window, and has the following options:
  • Name The name of the theme. This is a place holder for a spoken_text_string
  • Theme attributes The global attributes of the theme, such as the location
  • Dolls attributes The local attributes of the dolls such as a mood
  • theme attributes consist of a name and optionally a value.
  • the value can be a placeholder for spoken__text_string.
  • the spokerjext_string is created after the theme has been finalised, as described below.
  • the doll attributes are created in the interface window as each doll in a particular theme require a value for an attribute.
  • each doll will be attributed a value for this attribute, such as "happy”, “sad”, “angry”, etc.
  • the conversation engine can access any of the doll attributes (local variables) and use it in the conversation
  • Edit, 1202 This is used to edit an existing theme. For example, selecting the theme Alon#1 , 1206, and pressing edit will allow the user to edit the details of the Alon#1 theme.
  • Remove, 1204 This is used to delete the selected theme.
  • Figure 12a shows the window after three themes 1208, 1208 and 1210 have been created. It can be seen that each theme shows the overview of the theme's details, including a brief description of the theme, the number of dolls involved in the theme, and its ID number.
  • the information input into the theme form is stored in the database 1122 in the server 1004 for later retrieval when generating the output instructions.
  • Figure 13a shows the doll generation window, and when the user presses the "add doll” button 1300, the window shown in Figure 13b is displayed. This window allows a doll to be created named, and given a brief description.
  • dolls as required can be created using the windows shown in Figures 13a & b.
  • the number of dolls that can be created is limited by the previously determined maximum number of dolls for that particular theme.
  • Using these same windows it is also possible to edit existing dolls.
  • Each doll created in this way will lead to a sub-theme being generated.
  • the sub-theme, as described above, is the theme for each specific doll.
  • the voice used to record the speech is different for each toy, and the context data will be different.
  • the information input into the doll form is stored in the database 1122 in the server 1004 for later retrieval when generating the output instructions.
  • Figure 14 shows the context definition window where the different contexts are input against each doll in the theme.
  • Position 100 there are two contexts defined, 1400 and 1402, one for Doll#1 and one for Doll#2. Therefore, when Position 100 is accessed within the conversation, a doll is chosen by a method as described above, and the corresponding context is accessed.
  • Each context holds information relating to what the doll should say, and which doll should speak next. This simplifies the process of conversation construction as described above, by providing the theme developer with a structure for creating the conversation. The theme developer is no longer required to code the theme themselves, rather the authoring tool generates the required code in dependence on the theme developers input.
  • Figure 15 shows the context generation window for each position within the theme. In the example shown in Figure 15, this is the context for position 100 and Doll#1.
  • Each context requires the following information: • Position, 1500 - A text string labelling this position which is created automatically by the authoring tool when a new context is created in the context definition window shown in Figure 14. This is a convenient label for each context row. It can be any text; however, the default is to sequentially number the context rows starting at 100. The use of text labels is to aid clarity while creating and editing the conversation.
  • Position labels are converted to indexes into an array of youme_conversation_struct_t structures (C code naming convention utilised for this and the other structures described herein) which correspond to the context positions.
  • Statement, 1502 A list of statements that the doll can say together with weightings used in the random selection process.
  • the statements contain a list of phrases which are spoken_text_strings. This is a list of statements that can be said by the particular doll at this context point in the conversation.
  • Each statement is enclosed in square brackets and each statement can either be separated by a comma (e.g. [statement1],[statement2], [statements]), or entered on a separate line 1 of the context input window as shown in Figure 15.
  • Statements consist of a weighting, for random selection, and a list of phrases. The weighting in this case operates in a similar manner to the weightings as described above with reference to the conditional flow control, such as the SET, BRANCH or CHOOSE controls.
  • Each phrase is either an explicit spoken_text_string or a reference to a theme attribute or a doll attribute, e.g. the statement can reference to the location of the theme or the mood of the doll.
  • Explicit spoken_text_strings are defined as text within double quotes (e.g. "hello how are you").
  • References take the following forms: o theme. attribute for a theme/global attribute o me. attribute for the current speaker doll attribute o prev.attribute for the previous speaker doll attribute o next.attribute for the next speaker doll attribute o name.attribute for the named doll/local attribute
  • This list consists of the following built in transitions, and is accessed in the authoring tool via a drop down menu (each as described in detail above): o NOTME Selects any doll except the current speaker at random. o ANY Selects any doll at random. o ME Selects the current speaker o PREV Selects the previous speaker o Doll's name Selects that doll
  • Branch choices are a list of position labels together with weightings for random selection. They are similar in format to the BRANCH command as described above. The following are examples of valid input to this field (each as described in detail above): o [(1 ,label1),(1 ,label2)] - One branch choice containing a choice of two labels with equal weights.
  • Branch 1510 - The procedure used to effect the branch, and the format is the same as described above with reference to conversation construction. Otherwise some "C" code can be entered here. This field is used to specify the branch procedure to process the branch choices. If left blank then the default_branch_procedure is used. The default_branch_procedure uses the first branch choice in the Next list and chooses one of the labels at random using the provided weightings. The context is then changed to the context row with the chosen label as its position label. Alternatively, there is a pull down list of available built in branch procedures. The branch procedures as described above can be provided in this drop down list.
  • Attributes, 1512 - A list of attributes, a set_flag, and list of values and weightings for random selection. This field is used to specify any attributes to set with values at this context point, i.e. the theme developer can set the doll attribute "mood" to happy. If left blank then no attributes are set.
  • Each attribute to be set is enclosed in square brackets and delimited by commas. Within the square brackets the attribute is specified followed by a set_flag which specifies if the attribute is to be set once or can be reset, followed by a list of values and weightings for random selection.
  • the attributes field is the equivalent of the SET command as described above.
  • Attributes field o Blank No attributes to set o [me.attributel ,set,(1 ,”hello")] One attribute to be set, if not already set, to the value of spoken_text_string “hello” o [me.attributel ,reset,(1 ,”hello"),(1 ,”hi")], [me.attribute2,set,(1 ,”peter”),(1 ,”paul”)]
  • the fields, Statements, Say, Transition, Next, Branch, Attributes, and Set are replicated for each doll.
  • the fields Say, Transition, Next and Branch are all parameters that contribute to the method of interaction between the toys/dolls, and are all equivalent to commands as described above with reference to conversation construction.
  • Figure 15b shows an alternative embodiment of the context generation window.
  • the three options are: follow on; timed from start; and timed from end.
  • the follow on parameter allows for conversations to continue with the dolls speaking in series, i.e. one after the other with no overlap.
  • the timed from start parameter enables the user to enter a time interval after the doll starts speaking to trigger the next doll to speak. This allows two dolls to speak at the same time, for example, multiple dolls can laugh at the same time in response to a joke.
  • the timed from end parameter is similar to the timed from start parameter except that the user enters a time interval for the next doll to start speaking before the end of the current doll's speech. This feature enables more life-like conversations to be constructed.
  • the Context option is used repeatedly to add context rows to the conversation until the conversation is complete.
  • the authoring tool provides a save function.
  • This option is used to save the conversation, and in one example it creates the following directories: c: ⁇ youme ⁇ themes ⁇ theme_name c: ⁇ youme ⁇ themes ⁇ therne_name ⁇ doll_name - for each doll c: ⁇ youme ⁇ themes ⁇ theme_name ⁇ doll_name ⁇ audio - for each doll
  • each doll has a folder to store the audio files required for that doll.
  • the wav files created are place holders for each of the spoken_text_strings defined in the theme for each doll.
  • the spoken_text_strings are assigned file names A0000n.wav in sequence starting from A00001.wav.
  • the n used in the file name is also used as the index to the phrase when output of "C" code is required.
  • the recorder, 1112 in one embodiment, provides a prompt for the actor to enact the required spoken_text_string, and then automatically saves the file with the correct file name before prompting the actor with the next spoken_text_string.
  • the authoring tool is adapted to generate "C" code corresponding to the conversation.
  • the majority of the “C” code is predefined (a base set of instructions), and acts as the operating system for the toys/dolls processor.
  • the "C” code corresponding to the conversation is output (the themed set of instructions) it is combined with the predefined "C” code, see Figure 11 , and then compiled to create the binary file suitable to operate the processor in the doll, or in the PC. Incorporating the operating system/firmware into the doll each time a new theme is created allows the functionality of the doll to be altered simply and efficiently whenever required.
  • This code can be subsequently compiled and linked with a windows based conversation simulation engine
  • the resulting application can be saved as c: ⁇ youme ⁇ themes ⁇ theme_name ⁇ simulation.exe.
  • the simulator allows the user to specify which dolls should be considered as present and active. It then simulates an instance of the conversation as it would happen in real dolls. It selects one of the active dolls at random to be the current speaker and processes the first context row for that doll. It then executes each new row in turn outputting which doll is speaking and what they are saying. It continues until the conversation finishes. 2.
  • "C" code for the processor this code can be subsequently compiled and linked with the modified player to produce binary data files for each doll.
  • C code files can be saved, for each doll, as: c: ⁇ youme ⁇ themes ⁇ theme_name ⁇ doll_name ⁇ youme_chat.c; and c: ⁇ youme ⁇ themes ⁇ theme_name ⁇ do!l_name ⁇ youme_chat.h
  • the resulting binary data files can be saved as: c: ⁇ youme ⁇ themes ⁇ theme_name ⁇ doll_name ⁇ player.sb.
  • the binary data file contains the entire information set required to run the conversation on each doll.
  • This binary data file includes the firmware for the processor, and so additional features can be incorporated into the doll's functionality without the requirement for an additional process to update the firmware.
  • a list of all the distinct phrases (spoken_text_strings) for each doll is created and output using the dictionary generation engine 1110, as shown in Figure 11; this is a dictionary of phrases required for each doll.
  • the dictionary generation engine 1110 communicates with the database 1122 within the server 1004, and compiles the list based on the information stored on the theme within the database.
  • the dictionary is effectively a look-up table between the expression/statement and the ID number allocated to the expression/statement.
  • each doll is defined in the Statements field and the Attributes field of each context row. They can be explicitly defined spoken_text_strings or they can be references to custom attributes. Whenever an explicit spoken_text_string is defined it is allocated a file name such as A00xxx.wav in sequence starting at A00001.wav. The number xxx will also be the phrase index.
  • the list of spoken_text_strings can be saved in the following files: c: ⁇ youme ⁇ themes ⁇ theme_name ⁇ phrases.txt - this contains a list of all the phrases used in this theme c: ⁇ youme ⁇ themes ⁇ theme_name ⁇ doll_name ⁇ phrases.txt - these contain a list of all the phrases used by each doll
  • the process for generating the files is activated by the button 1212 "generate files".
  • the user selects the appropriate theme, that has been completed, and presses the button 1212. This then generates the files as described above.
  • the entire bundle of files is then uploaded to the doll; this bundle includes the binary file of the theme and accompanying operating system, the sound (wav) files for the speech, and the processor operating code (firmware).
  • the array of youme_conversation_struct_t conversation structures, as described above, is the main controlling data for the conversation.
  • the conversation engine starts at the context specified by index 1 of this array for the first doll. It then performs the following actions: 1. It calls the current context's transition procedure to decide which doll will be next.
  • step 1 It then starts at step 1 again with the new index and with the new doll, and continues this process until it hits a FINISH branch in one of steps 4.
  • an additional method of inputting a conversation is provided.
  • the "Import Theme” button 1250 allows the user to import a text file in order to create a themed conversation. In order to import a text file, the file must be formatted in an appropriate manner.
  • the import theme feature allows for a text file to be converted directly into a format suitable to be uploaded to the dolls, without further input from the user.
  • the content of the text file can be some, or all, of the content required to construct a theme.
  • the text file can contain an entire (preferably self-contained) conversation, about any topic. The entire conversation would then be imported into the authoring tool and converted into a format suitable for controlling the dolls.
  • the text file would appear similar to a script (such as for a play), with the doll's name followed by the words that the doll should say.
  • the authoring tool proceeds through the text file and extracts the doll's name, creates a doll with that name as described above with reference to Figures 13a and b, and then stores the corresponding text as a context (a context is described in further detail above).
  • the authoring tool only creates a new doll when that doll name has not been extracted previously from the text file. In that case, the corresponding text is stored as another context for that doll. This procedure continues until the entire text file has been parsed into the authoring tool.
  • Figure 12e shows a flow diagram of the process involved in importing a text file into the authoring tool.
  • the import means identifies a line of text associated with a doll name, then creates a doll if a doll with that name does not already exist.
  • the text is then imported into the authoring tool database and associated with the corresponding doll's context. This process continues until all of the lines of text are imported into the authoring tool.
  • the doll name In order for the text file to be parsed it must be formatted correctly, in this case, the doll name must be followed by a colon, and each entry for subsequent dolls must be on a new line.
  • Appendix I provides an example of a formatted text file, using the following formatting requirements: • $Theme: o The text following this statement is imported as the theme name • $Dolln: o The text following this statement is imported as a statement for a doll called DoIIn
  • the authoring tool generates the output instructions, as described above.
  • the text file conversation engine only allows for deterministic conversations to be created. However, once the text file is imported into the authoring tool it is possible for the user to amend the conversations to include further probabilistic outcomes as described below.
  • a USB communications dongle that enables a PC to wirelessly interact with a toy as described herein.
  • Figure 16 shows a schematic representation of the USB communications dongle 1600, attached to a PC 304, and in wireless communication with the dolls 100.
  • the dongle contains a wireless module 104, an IR/RF transmitter/receiver 212, and an interface 1602. These components, except the interface 1602, are the same as contained within the doll 100, as described above.
  • the PC 304 is utilised as the processor 1604, instead of the dongle having an independent processor as the doll 100 has, and so the PC effectively becomes a virtual doll able to communicate with the physical dolls 100.
  • the virtual doll is provided with an animated avatar shown on the PC monitor, that may be similar in appearance to the real doll, and whereby the animation of the avatar is synchronised with the speech of the doll.
  • the PC has stored in memory 1606 an emulator for emulating the processor of the toy.
  • the authoring tool outputs specific code for the PC based virtual doll.
  • the themed conversation data is used to run a conversation using an application running on the PC that emulates the firmware of the toy/doll.
  • the speech of the toy/doll is output via the PC speakers.
  • the interface 1602 is a USB connection, and provides an efficient way to connect the wireless communications dongle 1600 to the PC 304.
  • the wireless communications protocol used by the dongle is the same as that used between the dolls as described herein, i.e. IEEE 802.15.4.
  • the USB communications dongle When the user connects to the website he/she is able to use the USB communications dongle to facilitate a conversation between a physical doll, and a virtual doll animated within the website. In this way a single user can use the functionality of the doll's conversation engine without the requirement for multiple physical dolls.
  • the virtual doll can take part in a conversation with multiple physical dolls.
  • the virtual dolls can also interact with other virtual dolls, e.g. if two users each had a laptop computer with a USB communication dongle.
  • Game playing In a further embodiment the toy is also adapted to play games with the child.
  • board games such as Snakes and Ladders, Mousetrap, Ludo, or any other chance based game that can be played using dice can be played by the toy.
  • the toy is provided with a random number generator that is used to simulate a die, or dice. Furthermore, the toy is adapted to count the number of spaces to be progressed along the board by the playing piece. The toy audibly signals the child to move the playing piece the required number of spaces. Once the child has moved the playing piece the child indicates to the toy, by pressing a button or the like, that it is the next toys/child's turn.
  • the board is also interactive and contains sensors or the like to receive information from the playing board regarding the position of the counters. Play progresses in this way until there is a winner.
  • FIG 5 provides a schematic illustration of a controller toy 200 further comprising a games engine 400.
  • the remaining components are the same as described in Figures 2 and 3.
  • the games engine 400 comprises a board memory 402, a random number generator 404, position RAM 406 and an acknowledgement receiver 408.
  • the board memory 402 stores information relating to the layout of board games such as Snakes and Ladders or Ludo.
  • the random number generator is used to simulate dice, and is adapted to produce the numbers 1 , 2, 3, 4, 5 and 6 (or any other set of numbers appropriate to the game.
  • the position RAM is used to store information regarding the position on the board of each of the players, in this case the controller and the three slaves. This information is used in conjunction with the board memory and the virtual dice roll to count the appropriate number of positions for the playing piece to move, and to know whether the square the playing piece has moved to has any special relevance, such as is it the bottom of a ladder or the top of a snake.
  • the conversation engine 204 utilises the information obtained from the games engine to count the number of spaces, for example if the original position was square 13, and the virtual dice roll produce a 4, then the doll would vocalise through the loud speaker 210, "I've rolled a 4, 14, 15, 16, 17". In this example if square 17 was the top of a snake then the doll would go on to vocalise, "oh no, I've slipped down a snake to square 6!.
  • the counting mechanism cycles through the text the appropriate number of times, and then remembers the final position, within the position RAM 406. So, for example, when the virtual dice rolls a 4 the list of numbers is accessed 4 times to produce the end result.
  • the doll has the ability to receive information from an external random number generator that is activated by the child. In this way the child can play with the dolls, and the doll can keep track of all of the player's playing pieces including the child to determine when there is a winner.
  • Figure 6 shows a flow diagram of the process of playing a game.
  • the game is initiated by the user, step 500, and the controller doll will perform a check, step 502, to determine the number of players.
  • the controller doll will then decide on the first player, step 504, using the random number generator or the like.
  • the controller doll then rolls the virtual dice, step 506, for the first player, or if the child is the first player the controller doll asks the child to roll their dice.
  • the controller doll then instructs the player to move the counter/playing piece, the corresponding number of squares on the board, step 508, and then waits for acknowledgement that the child has moved the counter, step 510.
  • step 512 the controller doll waits a pre-determined number of seconds, such as 2, 3, 5, or 8 seconds, before prompting the child for acknowledgment that the counter has been moved. Once the controller doll receives acknowledgement a check is performed, step 514, to determine whether the player has won the game. If the player has not won the game then the play proceeds to the next player, step 516, and the process continues from step 506 until a player wins, step 518.
  • a pre-determined number of seconds such as 2, 3, 5, or 8 seconds
  • the games engine is adapted to play any rule based game in the manner described above.
  • the system could implement a conventional programming language, such as C, to run more complex algorithms to play more complex games such as chess.
  • C a conventional programming language
  • the same language as described above would be used to generate the conversations and would be referenced from the C program.
  • Such toys and dolls provide children with different opportunities for interaction, and enhance their play.
  • a conversation There are various examples of different methods of constructing a conversation. For example, it is possible to have randomly generated conversations, such as Zoo and Pet themes, a fully scripted (deterministic) conversation, or a game playing theme, such as to enable Snakes and Ladders to be played.
  • randomly generated conversations such as Zoo and Pet themes
  • a fully scripted (deterministic) conversation such as to enable Snakes and Ladders to be played.
  • game playing theme such as to enable Snakes and Ladders to be played.
  • the unit's processor 102 is used in conjunction with the other modules, such as the speech compiler 206, the speech database 208, and the parameter storage 216, to interpret the script within the themes. For example, when a variable is defined memory is allocated within the parameter storage. Each time the conversation is initiated the variables are allocated within the parameter storage. This enables the theme to be changed, i.e. from Zoo to Pets, and for the new variables to be allocated the appropriate memory resources without conflicting with the variables from a previous conversation. Furthermore, the parameters such as PREV, NEXT, and ME are also allocated memory within the parameter storage. This enables the SELECT statement to reference the parameter within the script.
  • the controller doll uses the communication protocol described above to transmit the command to the relevant doll using the wireless module and transmitter, or if the controller doll is the current speaker the controller doll's relevant modules are utilised.
  • the Speech compiler 206 within the doll required to speak is utilised to access the appropriate audio file within the Speech database 208.
  • the first line with a SAY statement within the Zoo theme is "SAY (i think we've seen everything now,p03,lets go home)”.
  • This statement consists of three references to audio files within the Speech database. Those references are "i think we've seen everything now"; "pO3"; and “lets go home”. They all refer to audio files but the "pO3" reference refers to a pause of a specific length. The pauses are blank audio files used to space the audio files appropriately.
  • the Speech compiler 206 then uses the loud speaker 210 to play the audio files. In each case the processor interprets the code and utilises the appropriate module to execute the statement.
  • the processor does not use an in-built interpreter, but instead each theme consists of a binary data file that includes all of the processor control instructions to enable the processor to function correctly. This effectively enables the firmware of the processor to be updated with new features whenever required.
  • the theme examples provided below can all be generated using the authoring tool.
  • the instructions to control the toys/dolls would be a binary file of compiled "C" code.
  • Figure 8 shows the schematic of a circuit diagram and parts list for a potential production version of the schematic diagram shown in Figures 2 and 3 - Appendix Il details the components within Figure 8.
  • Figure 9 shows the schematic of an alternative circuit diagram - Appendix III details the components within Figure 9. There are alternatives that could have been included in the production circuit, and these are discussed later.
  • the circuit includes:
  • the Jennie wireless controller uses the Jennie IC, contains the RF circuitry, and combines the firmware and data in to a single large Flash memory IC.
  • the Jennie wireless controller can use the Zigbee wireless communications protocol for example to communicate between the dolls.
  • the production circuit uses a part that is specifically designed to charge from the USB port and also power a circuit whilst charging.
  • the audio amplifier on the production circuit is a class-D audio amp. This is very efficient (-80%).
  • This component was chosen primarily as it a ready-to-use IC complete with USB driver software, reducing development effort. Its main disadvantage is that it uses most of the DIOx lines on the Jennie. Although this is not an issue with the current design, if DIOx lines are needed for other options, e.g. speech compression IC, then this part would be unsuitable.
  • the toy does not have complex USB requirements; the only requirement is to download data to be programmed in to Flash memory.
  • the device does not need to conform to any generic device functionality, e.g. memory sticks. This reduces the development effort required.
  • the circuits shown in Figures 8 and 9 use a Lithium-Ion (Li+) battery.
  • the Li+ battery was chosen for 3 reasons: i) Shape - it is available in a flat prismatic package that was convenient for the demonstrator project, ii) Ease of development - Li+ charging requirements are simpler than the alternatives, especially when the charger has to power an additional circuit at the same time, iii) Power capacity - a conservative estimate of power requirements at the start of the demonstrator project suggested that only Li technology would give enough power in the small space available. (See later).
  • NiMH has similar charging requirements to NiCad (more complex than Li+), but has similar (higher) power density (holds more power for a given physical volume) and price to that of Li+.
  • NiCad / NiMH batteries compared to Li+ will be considered in this section.
  • NiCad batteries usually come in standard sizes such as AA, and AAA, although other shapes are available. In a production environment where smaller components can be used, and where the cost of manufacturing more complex PCBs, such as two pieces and/or flexible circuits/connectors may not be inhibitive, the use of standard size batteries may be possible.
  • the circuit must be powered up (from the USB port) at the same time as the battery is charging (from the USB port), so that it can download new data. (The battery cannot simultaneously be charged and power the circuit.) It is possible to either isolate the circuit from the battery during charging or leave the circuit connected. Isolating the battery involves more complex circuitry. Leaving the circuit connected means that the charger sees both the normal current to the battery that it is controlling and the extra current our circuit takes.
  • NiCad batteries have a more complex charging profile, especially towards the end of charging. If this profile is not detected correctly, the battery is never fully charged, or the battery is overcharged resulting in damage to the battery and excessive temperature rises. Battery chargers use one of two methods to detect this profile. The first is by changes in current drawn by the battery. Unfortunately, the currents drawn by the present circuit will confuse the charger, resulting in potentially dangerous circumstances. The second method is by detecting changes in temperature of the battery. However, the battery charging components also get hot during normal use. In this application, it may be difficult to thermally isolate the battery enough to give reliable results.
  • the battery charger IC incorporates sophisticated power management circuitry and provides the isolation. This integrated power management is not available for NiCad technology in off-the-shelf products. So this would be implemented in discrete components or in a custom integrated IC.
  • the Li+ battery holds twice as much power for the same rating as the other batteries because its voltage is twice as large.
  • the single prismatic Li+ solution was the obvious choice for the demonstrator.
  • the Jennie is on all the time, listening for messages continually. With a change in the firmware, and the way the dolls communicate with one another, only one doll (the first to be powered up) needs to be listening continually. The other dolls can check periodically with the first doll if they need to speak, and only need to be powered for this short time. The rest of the time the Jennie can be in low-power sleep mode. If a 10% duty cycle is achievable this would cut the power consumption by a factor of 10 when not speaking. When speaking, the Jennie needs to be powered, but it does not need to listen for messages, so the RF stage can be unpowered. This reduces the Jennie power consumption by a factor of 4. Thus it may be possible to reduce the overall current consumption to 14mA when speaking and 4mA when not.
  • the current specification for the doll electronics is that an ON-OFF switch controls the powering of the circuit. Unlike other toys, it is not obvious when the doll is switched on, as it sits passively waiting for a button to be pressed in any one of the active dolls. This means that it is highly likely that the dolls will be forgotten to be switched off. The result is that the next time (e.g. next day) the doll is played with the batteries will be dead.
  • Speech compression allows more audio data to be stored in the same amount of memory.
  • the current designs do not contain any speech compression technology.
  • the current designs use 8-bit 8kHz audio data that results in a data rate of 64k bps (bits per second), and uses a 64Mbit serial flash memory enabling about 1000 seconds (17 minutes) of audio data to be stored.
  • Speech compression can be used to drop this data rate to between 2kbps and ⁇ kbps, the higher compression the lower the audio quality. So at 8kbps a 4Mbit flash memory can hold about 500 seconds (8 Vz minutes) of audio data.
  • Compressed audio data requires decompression as it is played out. This can be done in software or dedicated hardware. A few options are given below.
  • Sensory lnc has two microcontroller families.
  • the SC-6x family has the pre-programmed SC-691 slave synthesiser. This has a 4-bit MCU interface that requires 9 DIOx lines to interface to the Jennie and can direct drive a 32-ohm speaker.
  • the newer RSC-4x family does not have a pre- programmed slave synthesiser, and so requires custom firmware to be developed. It would interface to the Jennie with a 4-bit or 8-bit MCU interface (9 or 15 DOIx lines). However it has a more powerful processor (it can handle speech recognition algorithms), and can direct drive an 8-ohm speaker. Either of these parts could not be used with the USB FT245 chip, as the Jennie does not have enough DIOx lines for both. A slave SPI USB chip would be necessary (see USB section).
  • a speech synthesis microcontroller such as RSC-4x that has significant processing power suggests a possible alternative system architecture.
  • the synthesis microcontroller could run the main doll algorithms and use the wireless microcontroller as a slave co-processor for wireless communications. See the Wireless microcontroller section for further details.
  • the current design is based on the 2.4GHz IEEE 802.15.4 Personal-Area-Network communications standard. Wireless microcontroller products exist that contain the necessary RF hardware and firmware to take care of all low-level RF communications. Only the data in the communications needs to be defined by the doll application. The current design has selected the Jennie wireless microcontroller.
  • the IEEE 802.15.4 products take care of the low-level RF communications, there is one aspect that is not a good fit with the doll application.
  • the IEEE 802.15.4 is based on a hierarchical structure of nodes, with many reduced function devices communicating with a full function device.
  • the doll application has a peer-to-peer structure, where all devices are the same.
  • RF transceiver products that work in the same 2.4GHz or different ISM frequency bands are available. They contain all the necessary RF hardware, but do not impose a particular low-level protocol. These transceiver ICs work as a slave to either a general purpose microcontroller or dedicated microcontroller such as the RSC-4x speech synthesiser. Using these parts a proprietary peer-to-peer communications protocol could be developed.
  • RF transceivers examples include Tl CC2500 and Atmel ATA542x family. These parts potentially provide lower power consumption and lower unit costs than the Jennie IC.
  • $Dolll I say hit the second floor department store and work our way back to the shoe boutique .

Abstract

There is provided a toy (A) adapted to have an interaction with at least one other such toy (B), comprising: a processor (1700) and a memory (1702) coupled to said processor; wherein said processor comprises: means (1704) for generating an output signal representative of an action to be performed; and means for generating a trigger (1706) signal, for reception at at least one other such toy, to trigger said other such toy to perform an action before the said toy has completed its own action. Furthermore, the trigger signal is generated at pre-determined time interval after said toy has initiated its own action, or the trigger signal is generated at a pre-determined time interval before said toy has completed its own action.

Description

Interacting Toys
This invention relates to toys. In particular, although not exclusively, this invention relates to toys such as dolls that interact with each other. Embedded computers and micro-processors have improved toys for children. They have been used most extensively in educational toys, but have also been used in interactive toys. ActiMates® Barney® is one example of an interactive toy which responds to interaction from a child by appropriate vocalisations, and can sing-a-long to videos.
PCT patent application WO 2006/114625 is incorporated herein by reference.
Syncing
According to a first aspect of the present invention there is provided a toy adapted to have an interaction with at least one other such toy, comprising: a processor and a memory coupled to said processor; wherein said processor comprises: means for generating an output signal representative of an action to be performed; and means for generating a trigger signal, for reception at at least one other such toy, to trigger said at least one other such toy to perform an action before the said toy has completed its own action. By providing means for generating a trigger signal for triggering another such toy to perform an action before the said toy has completed its own action, a more versatile toy, and in particular a more life-like interaction, can be provided. For a more life-like interaction, preferably said trigger signal is generated at pre-determined time interval after said toy has initiated its own action. Preferably said trigger signal is generated at a pre-determined time interval before said toy has completed its own action.
For ease of use, preferably the toy further comprises an input enabling a user to input a measure of said pre-determined time interval. For ease of synchronisation, preferably the pre-determined time interval is less than 1 second or half or quarter of a second, and is more preferably substantially 0 seconds. By having a time interval of 0 seconds the actions of the toys are effectively synchronised.
Preferably the action is at least one of: emitting sound, emitting light, and movement.
For efficiency of communication, preferably the toy further comprises a wireless communication module adapted to wirelessly communicate with said at least one other such toy. More preferably, the wireless communication module transmits at least one of. the trigger signal; information relating to the interaction; and information relating to the toy.
Preferably said information relating to the interaction includes at least one of: the action output by the toy; the duration of the action; and the action for the at least one other toy to take. Preferably the memory is adapted to store a pre-determined interaction.
Preferably the processor is adapted to determine said interaction pseudo-randomly.
For a more life-like interaction, preferably said toy is adapted to interact as if it were animate. Preferably said interaction is at least one of: a conversation, a vocal interaction, an inter-personal interaction, an educational interaction, playing music, and playing a game. Preferably, said toy is adapted to interact as a member in a group of such toys. More preferably, said group represents one of: a music band; a group of cars; or a group of military assets. Yet more preferably, said trigger signal is used to synchronise the actions of the group. Preferably the toy further comprises means for receiving a trigger signal from another such toy, and uses said trigger signal to determine a time to initiate an action.
Preferably said toy is one of: a doll, a game board, a vehicle, and a military asset.
According to a further aspect of the present invention there is provided a computer readable memory, for use in a toy adapted to have an interaction with at least one other such toy, said memory containing a set of instructions comprising: code for generating an output signal representative of an action to be performed; and code for generating a trigger signal, for reception at at least one other such toy, to trigger said at least one other such toy to perform an action before the said toy has completed its own action. As used herein the term computer readable memory includes the term computer program product.
Preferably, the computer readable memory further comprises code for generating said trigger signal at a pre-determined time interval after said toy has initiated its own action.
Preferably, the computer readable memory further comprises code for generating said trigger signal at a pre-determined time interval before said toy has completed its own action. Preferably, the computer readable memory further comprises code for enabling a user to input a measure of said pre-determined time interval.
Preferably, said pre-determined time interval is less than 1 second or half or quarter of a second, and is preferably substantially 0 seconds.
Preferably, said action is at least one of: emitting sound, emitting light, and movement.
Authoring Tool
According to a further aspect of the present invention there is provided an authoring tool for creating themed data for toys, comprising means for receiving content relating to a particular theme; means for processing said content to generate a set of instructions for operating said toy within said particular theme; and means for outputting said set of instructions. By providing means for generating a set of instructions for operating a toy the process of generating themed instruction can be made substantially more efficient.
For efficiency of receiving the content, preferably said receiving means is adapted to receive content that comprises separately both scripting data relating to the particular theme, and expression data defining the personality of said toy. Preferably, said receiving means is adapted to receive content in discrete portions.
For efficiency of processing, preferably the authoring tool further comprises means for allocating a unique ID number to each expression data portion. Preferably, said processing means is adapted to utilise said unique ID numbers as references to said expression data portions in said set of instructions.
Preferably, said expression data comprises at least one of: a theme name, the toys' names and statements used by the toys to interact.
Preferably, said scripting data comprises at least one of: the number of toys that can interact within the theme, a method of interaction, theme related parameters, and toy related parameters. For efficiency of processing, preferably the authoring tool further comprises means for storing together, in an array, said scripting data and expression data relating to a particular theme. More preferably, said processing means is adapted to generate said set of instructions from said array. For efficiency of processing, preferably said processing means includes means for compiling at least one list comprising at least some of the expression data. More preferably, said list compiling means is adapted to compile a respective list for each toy in said particular theme.
Preferably, the expression data is symbolic data. Symbolic data as used herein connotes the written form of words, music or actions.
Preferably, the authoring tool further comprises recording means for recording enacted data versions of the symbolic data. Enacted data as used herein connotes the enacted form of words, music or actions.
Preferably, the authoring tool comprises means for prompting an actor to generate the requisite portion of enacted data.
Preferably, said processor is adapted to generate a look-up table between the symbolic data and enacted data.
Preferably, said processing means is adapted to output the expression data. More preferably, said processing means is further adapted to output the expression data and set of instructions separately.
Preferably, said processing means is adapted to generate a set of instructions that includes: a base set of instructions for controlling the basic functions of the toy; and a themed set of instructions for the base set of instructions to control the toy within the theme. More preferably, said processor is adapted to combine said base set and said themed set of instructions together. Preferably the authoring tool further comprises a compiler. More preferably, said compiler is adapted to compile said base set and said themed set of instructions.
Preferably, said processor includes a coding engine adapted to transform said set of instructions into computer readable code.
Preferably, the output of the authoring tool is adapted to be used in a conversation engine as described herein.
Preferably, the toy is a toy as described herein.
According to a second aspect of the present invention, there is provided a user interface for an authoring tool for creating themed data for a toy, comprising: means for providing a user with a set of input windows, each window corresponding to the input of a particular sub-set of content relating to a theme; and means for initiating output of the themed data.
Preferably, said sub-sets of content include at least one of: theme related data, toy related data, and context related data.
Preferably, the context related data includes at least one of: statements used by the toys to interact, a method of interaction, theme related parameters, and toy related parameters. Preferably, the receiving means is adapted to receive, in one operation, content that comprises an entire theme, or a substantial part of a theme. More preferably, the content is in the form of a pre-formatted file. Yet more preferably, the pre-formatted file is a text file.
Preferably, the processing means generates the set of instructions using only the content of said pre-formatted file. Preferably, said toy related parameters include information relating to pre-defined rules for selecting the next toy to interact.
Preferably, said method of interaction comprises timing related parameters. More preferably, said timing related parameters determine when the next toy interacts. Yet more preferably, said timing related parameters include at least one of: the time delay between the start of the current toy's interaction to the start of the next toy's interaction; and the time delay from the start of the next toy's interaction before the current toy's interaction ends.
Preferably, the authoring tool further comprises means for receiving content relating to a game. More preferably, said content relating to a game includes logic for enabling the game to be executed.
Preferably, the authoring tool is adapted to implement any of the methods of interaction as herein described.
According to a third aspect of the present invention, there is provided a system for generating themed data for a toy, comprising: an authoring tool for accessing, creating and editing said themed data; and a server, comprising a database for storing said themed data; wherein the authoring tool is adapted to access the themed data via the internet.
Preferably, said authoring tool is adapted to process the themed data into an array, and said database is adapted to store said themed data in said array.
Preferably, said authoring tool is an authoring tool as described herein. Preferably, the further comprises a user interface. More preferably, the user interface is an interface as described herein.
USB Communications Dongle
According to a further aspect of the present invention, there is provided a device for providing wireless communications between at least one toy as described herein, and a computer, comprising: a communication port for connecting the device to the computer; and means for establishing a network between the computer and the or each toy; wherein said device allows the computer to communicate with the or each toy as if it were another such toy. Preferably, said device enables said computer to act as a virtual toy. Preferably, said communication port is a USB communication port.
Preferably, said network is wireless.
According to a yet further aspect of the present invention, there is provided a system comprising: at least one toy as described herein; and at least one computer, each with a device for providing wireless communications as described herein; wherein the combination of said computer and device acts as if it were a toy as described herein.
Preferably, said computer comprises a visual, and an audio output adapted to provide a virtual toy. More preferably, said virtual toy is an avatar.
Controller doll According to a yet further aspect of the present invention, there is provided a toy comprising: a processor; a memory coupled to said processor; an output coupled to said processor; and means for establishing a network connection with at least one further such toy; wherein the processor includes means for controlling the output of each toy with which a network connection has been established. Preferably, said controlling means is adapted to transmit, over said network connection, instructions to control a plurality of the outputs (preferably all of the outputs) of each toy with which a network connection has been established.
Preferably, said network connection forms part of a personal area network.
Preferably, said memory is adapted to store at least one group of data, each said at least one group representing a particular theme. Preferably, the toy further comprises means for determining the at least one theme stored in said memory.
Preferably, said toy is adapted to only establish a connection with another toy when at least one theme stored in said memory is the same in both toys. Preferably, said controlling means is adapted to transmit/receive a control message to control the output of each said toy, and wherein preferably the control message comprises an ID of the toy for which it is intended, and a command segment, and more preferably further comprises an ID of the originating toy and/or a message ID.
Preferably, said control message comprises instructions to access a reference database and perform a task.
Preferably, the processor includes means for transmitting/receiving acknowledgement of a transmitted/received control message, and wherein preferably said transmitting/receiving means is adapted to request that the control message is re-sent if it does not receive acknowledgement.
Preferably, said transmitting/receiving means is adapted to transmit a parameter associated with the time that such toy will take to generate an output in dependence on the control message, and wherein preferably the originating toy waits for a duration associated with said parameter before transmitting a further control message (the time such toy will take to generate such output may vary, according for example with a theme or sub-theme of the toy).
Preferably, the processor comprises means for counting the number of re-sent control messages, and whereby communication with said toy that does not acknowledge said control message is stopped after 1,000 - 2,000, 2,000 - 5,000, 5,000 - 10,000 or more attempts to resend.
Preferably, said processor further comprises a conversation engine adapted to construct a conversation between said toys.
Preferably, the further such toy is identical or substantially identical to the first such toy. Therefore, no "Spoke and Hub" arrangement is required.
Preferably, said means for establishing a network is a network controller, preferably a network controller utilising the Zigbee protocol.
Parameter storage Preferably, the toy is adapted to interact with another such toy, wherein said processor includes means for defining at least one variable associated with said interaction, means for storing said variable in said memory and means for using said variable to control an (interactive) output of said toy.
According to a yet further aspect of the present invention, there is provided a toy adapted to interact with another such toy, comprising: a processor; a memory coupled to said processor; and an output coupled to said processor; wherein said processor includes means for defining at least one variable associated with said interaction, means for storing said variable in said memory and means for using said variable in association with an (interactive) output of said toy (thereby preferably more efficiently keeping track of the interaction). Preferably, said variable is used a plurality of times (more preferably a multiplicity of times) to control said output.
Preferably, said variable is used to determine the number, type or nature of said interaction, and wherein preferably said variable is said interaction.
Preferably, said variable is selected randomly or pseudo-randomly, and said random selection is affected by weightings. Preferably, the toy further comprises means for generating an interaction. The means for generating an interaction is preferably adapted to generate the interaction in dependence upon the stored parameter.
Preferably, the storing means associates each variable with a toy. Preferably, the storing means is memory located within the toy.
Preferably, the means for using the variable is adapted to access the variable from the storing means.
Preferably, said interaction is a communication between the toys. Preferably, said variable is a word or phrase utilised in speech.
Expressing personality and scripting themes
Preferably, said processor is adapted to store themed data in said memory, said theme comprising scripting data and expression data, said expression data defining the personality of said toy. According to a yet further aspect of the present invention, there is provided a toy comprising: a processor; a memory coupled to said processor; and an output coupled to said processor; wherein said processor is adapted to store themed data in said memory, said theme comprising scripting data and expression data, said expression data defining the personality of said toy (thereby preferably providing multiple, themed, toy personalities more efficiently). Preferably, the toy is adapted to interact with at least one other similar toy, wherein said scripting data is shared by each such toy and said expression data is different between each such toy.
Preferably, said scripting data is independent of said expression data. Preferably, the processor is adapted to output the scripting data as a control message to another such toy, and is adapted to respond to a control message with its individual expression data. Preferably, the scripting data is the same for each toy, and controls the output of each toy. Preferably, the processor is adapted to utilise the scripting data to reference the expression data, and preferably the expression data communicates the same information using different content. Preferably, the personality of the toy is defined by the content of the communication.
Doll choice
Preferably, said processor includes means for selecting a toy to interact based on predefined rules. According to a yet further aspect of the present invention, there is provided a toy adapted to interact with other such toys, comprising: a processor; a memory coupled to said processor; and an output coupled to said processor, wherein said processor includes means for selecting a toy to interact based on pre-defined rules, and wherein said selected toy may be the originating toy.
Preferably, said selecting means is adapted to select the next toy to interact. Preferably, said pre-defined rules comprise: direct selection; random selection; and choose the current interacter to interact again.
Preferably, the processor is adapted to output a control message comprising the ID of the selected toy and preferably the ID of the originating toy.
Preferably, said interaction comprises communication and wherein preferably said communication includes speech and directions. Game playing
Preferably, the toy is in the form of an animate object, suitable for playing games with other similar toys, wherein said processor includes a games engine, wherein said games engine is adapted to allow said toy to play games as if the toy were animate. According to a yet further aspect of the present invention, there is provided a toy in the form of an animate object, suitable for playing games with other similar toys, comprising: a processor; a memory coupled to said processor; an output coupled to said processor; wherein said processor includes a games engine that enables each said toy to play a game as if said toy were its relevant animate object. Preferably, said games engine is adapted to enable a human game.
Preferably, said human game is played with games equipment.
Preferably, said games engine is adapted to output an instruction to enable a human to adjust the games equipment to play the game.
Preferably, said toy further comprises means for communicating with at least one further such toy.
Preferably, said games engine is further adapted to play rules based games.
Preferably, said game engine is adapted to store information regarding the game in said memory.
Preferably, said information comprises the rules of the game. Preferably, said information further comprises the layout of at least one playing board.
Preferably, said games engine comprises a random number generator adapted to be a virtual die.
Preferably, the games engine comprises means for receiving an external input regarding the game. Preferably, said external input is associated with the playing piece of the game.
Preferably, said external input is at least one sensor within the playing board.
Preferably, said external input is a switch adapted to be used by a user of said toy.
Preferably, said rules based games include Snakes and Ladders, and Ludo.
Preferably, said output is a transducer. Preferably, said transducer is a loudspeaker. Preferably, said transducer is an actuator.
According to a yet further aspect of the present invention, there is provided a combination comprising a plurality of such toys.
Preferably, each one of said plurality of toys comprises means for controlling the other said toys, whereby only one toy controls the other said toys at a time. Preferably, said memory is adapted to store information relating to the game state. The game state may be at least one of: the layout of a playing board; the position of at least one counter on a playing board; and the order of play for all of the toys and/or user.
Doll specific download According to a yet further aspect of the present invention, there is provided a device for providing a plurality of toys with themed data comprising: means for storing said themed data, wherein each said theme comprises a plurality of sub-themes; means for identifying a specific toy; means for selecting a sub-theme according to the specific toy; and means for outputting said specific sub-theme to said toy (thereby preferably accessing themed downloads is accomplished more efficiently).
Preferably, the toy further comprises means for storing a plurality of different themes. Preferably, the toy further comprises means for allowing a user to select one of the said plurality of themes.
Preferably, said means for identifying a specific toy uses a unique identification number of said toy. Preferably, the toy further comprises means for encrypting each said sub-theme according to a parameter associated with said toy. Preferably, said parameter is the toy's unique identification number.
Preferably, the device comprises a processor and associated memory for storing the themed data and identifying the specific toy. Preferably, the device further comprises a connection for outputting the sub-theme to the toy.
Preferably the connection comprises the internet and a USB cable.
Conversation engine
According to a yet further aspect of the present invention, there is provided a conversation engine for a device such as a toy comprising means for selecting a theme for the conversation; randomly choosing a starting point from a plurality of starting points; randomly choosing phrases based on variables; and randomly choosing the next speaker based on variables. Preferably, said phrase choices are further based on weightings. Preferably, the toy incorporates a conversation engine. Preferably, the toy, or conversation engine, is adapted to receive input data from the user.
Preferably, the toy, or conversation engine, is adapted to output data to the user. Preferably, the conversation engine is further adapted to utilise the input data from the user in random choosing process.
Preferably, the conversation engine comprises a processor adapted to carry out the selecting operation.
Preferably, the toy, or conversation engine, is adapted to construct the conversation in realtime.
Preferably, the toy, or conversation engine, is adapted to pre-process a conversation. The toy, or conversation engine, is preferably further adapted to output the pre-processed conversation. Preferably, the toy, or conversation engine, is adapted to utilise the parameters of the other toys present in the established network as a variable when constructing the conversation.
Preferably, the toy, or conversation engine, is adapted to output data in dependence on weightings.
Preferably, the toy is adapted to store a plurality of sets of themed data. The toy is preferably further adapted to utilise at least two of the plurality of sets of themed data during a single conversation.
Preferably, the toy is adapted to enable a network to be established with a plurality of other such toys, preferably, 2, 3, 4 or more.
Preferably, the toy is adapted to be animate. Preferably, the toy is adapted to communicate with other such toys, and said communication includes, speech, actions, and gestures.
Preferably, the toy or conversation engine has one, some, or all of the following features in any combination:
• Child can play interactively with the toys • Conversation constructed on-the-fly • Conversation is pre-processed prior to starting the conversation
• Conversation is based on the dolls present in the network
• Conversation is based on the type of doll present in the network
• Weightings used to control the conversation length and direction • Ability to switch between themes mid conversation
• Two, three or more toys
• Toys are animate/human/dolls
• Interaction includes communication; communication is defined in a broad sense
In summary, the present invention refers amongst others to the following inventions:-
• Authoring tool - provides the facility for inputting conversation data to be compiled into program code readable by the toys.
• USB communications dongle - provides a device for enabling communication between a toy and a PC. • Controller doll - more than two dolls, control is conducted using as a single controller the first doll that is switched on.
• Expression of personality - same theme has different expression based on the personality factor of the doll.
• Scripting themes - themes are a downloadable combination of expression and script / script and expression are integral / different script for each different theme.
• Parameter storage - capability of storing information relevant to the current conversation, e.g. in the phrase "My dog is called Fluffy" the doll stores the information (pet = "dog" and name of pet = "fluffy") for use later in that conversation.
• Doll specific downloads - website download only has as expression the specific language relevant to the given personality / expression is downloaded according to personality
• Construction of conversations - dolls choose either to respond with relevant speech, select another doll and address them, or announce something about themselves.
• Doll choice - controller decides which doll speaks next randomly; select randomly but no doll can speak twice in a row, or select a specific doll by name. • Game playing - dolls play games as if humans.
The invention also provides a computer program and a computer program product comprising software code adapted, when executed on a data processing apparatus, to perform any of the methods described herein, including any or all of their component steps. The invention also provides a computer program and a computer program product comprising software code which, when executed on a data processing apparatus, comprises any of the apparatus features described herein.
The invention also provides a computer program and a computer program product having an operating system which supports a computer program for carrying out any of the methods described herein and/or for embodying any of the apparatus features described herein.
The invention also provides a computer readable medium having stored thereon the computer program as aforesaid.
The invention also provides a signal carrying the computer program as aforesaid, and a method of transmitting such a signal. The invention extends to methods and/or apparatus substantially as herein described with reference to the accompanying drawings.
Apparatus and method features may be interchanged as appropriate, and may be provided independently one of another. Any feature in one aspect of the invention may be applied to other aspects of the invention, in any appropriate combination; equally, any feature in one invention may be applied to any other invention, in any appropriate combination. For example, method aspects may be applied to apparatus aspects, and vice versa. Again, for example, any "Controller doll" feature may be applied to any "Parameter storage" feature.
Furthermore, features implemented in hardware may be implemented in software, and vice versa. Any reference to software and hardware features herein should be construed accordingly.
Herein, any use of the term "means for" plus a function may be replaced by the appropriate hardware component (for example a processor and/or memory) adapted to perform that function.
Embodiments of this invention will now be described, by way of example only, with reference to the accompanying drawings, of which:
Figure 1 shows three types of doll;
Figure 2 is a schematic illustration of a doll;
Figure 3 is a schematic illustration of a controller toy, with slave toys; Figure 4 is a schematic illustration of a doll connected to a website enabled to download themes/sub-themes to the doll;
Figure 5 is a schematic illustration of a doll adapted to play games;
Figure 6 is a flow diagram of the process of playing a game;
Figure 7 is a schematic of an alternative embodiment; Figure 8 is one embodiment of a circuit diagram of the processor and associated electronics;
Figure 9 is an alternative embodiment of a circuit diagram of the processor and associated electronics;
Figure 10 shows user PCs in communication with an authoring tool server;
Figure 11 shows an overview of the authoring tool, and associated systems; Figure 12a shows a conversation designer window;
Figure 12b shows a theme generation window;
Figure 12c shows a populated theme generation window;
Figure 12d shows an alternative embodiment of a theme generation window;
Figure 12e shows a flow diagram of the text file import feature; Figure 13a shows an add doll window;
Figure 13b shows a create doll window;
Figure 14 shows a doll context window;
Figure 15a shows a conversation entry window;
Figure 15b shows an alternative embodiment of the conversation entry window; Figure 16 shows a USB dongle in communication with multiple dolls;
Figure 17a shows a schematic illustration of two dolls and a timeline of actions;
Figures 17 b, c and d, show examples of the various timings for triggering another toy.
Figure 1 shows three types of toy doll; 10 is a tennis playing doll, 20 is a ballerina doll, 30 is a generic doll shown walking a dog, and 40 is a toy in the form of a tank. In general the toys are adapted to appear animate and in particular human, or human controlled in the case of the tank and the like. The four toys shown are examples of types of themed toys. The toys are adapted to communicate wirelessly with other such toys within the theme.
The following description relates to a toy, such as a toy doll, that is enabled to communicate with other such toys; the dolls are adapted to coordinate the speech between the dolls. In another embodiment the toy is a tank or another such vehicle; again, the tanks are adapted to communicate wirelessly with other such tanks to coordinate the behaviour of the tanks instead of the speech between the dolls.
Figure 2 shows a schematic representation of the doll, with the hardware components required to allow the doll to communicate, and perform other such tasks. The doll 100, as shown in Figure 2, comprises a processor 102 that includes a wireless module 104. The processor is in communication with memory 106, ROM 108, and RAM 110. An IR/RF transmitter/receiver is connected to the processor/wireless module and is enabled to transmit/receive signals to/from other such dolls. The doll is also connected to a loud speaker 114. A USB controller 116 is used to update the memory 106, and also to charge, via the charger circuitry 118, the battery 120. Alternatively, the doll is adapted to use replaceable batteries, rather than rechargeable batteries.
The memory 106 stores information relating to conversations that the dolls can have, and is accessed by the processor when it is compiling speech. The ROM 108 is used to store permanent information relating to the doll, such as the doll's name and ID number. This information is used in the initialisation procedure when setting up a network of dolls. The RAM 110 stores information relating to the current conversation and is used in order to produce more realistic conversation by storing information relating to the phrases already used for example.
Each doll 100 contains in memory 106: a data set containing the doll's name, and other variables defined during a conversation; a set of instructions which produces the conversation; and a set of audio data. The variables defined during the conversation are only stored in the controller doll.
In one embodiment the processor is in the form as used in MP3 decoding, with the associated memory interfaces (such as SD cards). This embodiment provides a significant amount of processing power (and hardware based compression technology) and would therefore allow for long and detailed conversations between the dolls.
Controller doll
As can be seen in Figure 3 the controller unit, 200, is in communication with a number of slave units, 202. The controller includes a conversation engine 204, a speech compiler 206, a speech database 208, a loudspeaker (transducer) 210, a transmitter/receiver 212 capable of transmitting and receiving data from the slave units. The conversation engine comprises a random speech selector 214, a parameter storage memory 216 and a speaker selector 218. The slave unit has all of the components of the controller unit; not all of the slave unit's components are shown in Figure 3.
The first unit to be powered on is initialised to be the controller unit. When a unit is powered on it searches for an existing network, and when no network exists it creates a network and waits for other units to join the network. When further units are turned on they join the network and are initialised as slave units. The controller unit awaits communications from both new units indicating they require the network details, and conversation initiation messages. The slave units, once they have joined the network, await instructions from the controller unit. It should be understood that all of the units (toys/dolls) are identical in as far as they are all able to become the controller unit, or a slave unit.
The units are adapted to communicate within themes, such as "The Zoo", "Sport", "Gangsta" or "Fashion". Themes allow the units to have detailed conversations without requiring extremely large databases of information relating to all of the possible conversation topics. The themes/sub-themes can be downloaded to the units by the user from a website.
The following process is used to initiate a network of toys:
• When a doll is turned on it performs a check to determine whether there is an existing network to join - this is accomplished using the transmitter/receiver 212.
• If there is not a network available then that doll becomes the controller, and automatically sets up a network - the wireless module 104 is adapted to create a network where necessary.
• Each subsequent doll that is turned on transmits a doll ID number and theme/themes ID number that they have stored in memory - the information is transmitted via the transmitter 212. • The controller checks the theme/themes and only allows dolls with the same theme/themes as the controller to join - the controller unit performs a comparison of the transmitted data with the data is has stored in memory.
• Once two or more dolls have joined the network it is possible to initiate a conversation
• The user initiates the conversation by pressing a button or the like, and the controller starts a conversation instructing the other dolls what to say
• The user can press the button again to stop the conversation at any point
The controller unit runs the program to generate conversations and then transmits information to the slave units to inform them which audio files to access (the audio files can be different for each personality type, but the reference to each of the audio files is the same for each unit). The controller unit transmits the identifiers of the words/phrases to access from the slave unit's memory. The slave unit acknowledges receipt of the message by transmitting a message verifying the phrase to be used, and the expected length of time required to say the phrase. The slave unit then uses the speech compiler to compile the words/phrases and then uses the loudspeaker to say the phrase. Once the slave unit has finished saying the phrase it transmits a signal to the controller unit that it has finished and the conversation can carry on.
The controller unit then instructs the next speaker in the same way, and so on until the conversation comes to an end. Further detail regarding conversation construction is provided below.
Communication protocol
The toys communicate using a communication protocol; the format of the messages is as follows:
[MessagelD, SendingToyJD, ReceivingToyJD, MessageType, Parameters] The MessagelD is a unique number identifying the message. Each message sent from the controller toy has a unique identifying number.
The SendingToyJD indicates the toy sending the message.
The ReceivingToyJD indicates the toy that is to receive the message.
The MessageType indicates the type of message e.g. START, STOP, SAY.
The Parameters are any other required information related to the message type. Only the SAY message has a parameter, which identifies the phrase(s) to be spoken.
Therefore, the range of messages comprises:
[MessagelD, SendingToyJD, ReceivingToyJD, START]
[MessagelD, SendingToyJD, ReceivingToyJD, STOP] [MessagelD, SendingToyJD, ReceivingToyJD, SAY, PhraselD]
Each of these messages will produce an acknowledgement of the following form:
[MessagelD, SendingToyJD, ReceivingToyJD, Ack, Parameter]
The parameter is only used for acknowledging the SAY message and it specifies the duration of the phrase. The controller unit uses the duration of phrase parameter to wait for the appropriate length of time before sending the next message.
So the normal sequence of events for each message, assuming Toy 1 is communicating with Toy 2, is as follows:
[MessagelD,1 , 2, START] [MessagelD, 2, 1 , ACK]
[MessagelD, 1 , 2, SAY, PhraselD] [MessagelD, 2, 1 , ACK, DURATION]
[MessagelD, 1 , 2, STOP] [MessagelD, 2, 1 , ACK]
The START command instructs the receiving toy to expect to receive further incoming messages. The controller doll then sends at least one message containing the phraselD of the phrase that the slave toy is required to use. Each phraselD is sent separately to the slave toy, and so multiple messages of this type may be sent to build up an entire sentence. The STOP command is used to instruct that slave toy that there are no further messages in that sequence.
The slave toy, upon receipt of a message, sends a message to the controller acknowledging the receipt of the message. The controller continues with the conversation program immediately for the START and STOP acknowledgements; however, for the SAY command the controller doll continues after a delay equal to the DURATION for the SAY acknowledgement. If the acknowledgement is not received then the message is resent until an acknowledgment is received. This resending happens a large number of times at which point the dolls will reset and the conversation will stop; for example, the message is resent between 1 ,000 - 2000, 2000 - 5000, 5000 - 10,000 times, or more. An "end of phrase flag" is also attached to the end of each phrase to inform the slave unit when the phrase has finished. At this point the slave unit will transmit a message to the controller indicating that it has finished speaking. Upon receipt of the message the controller instructs the next unit to speak, the next speaker may be the controller or another slave unit.
Alternatively to instructing speech, when the controller toy is a tank the instructions communicated to the slave units take the form of directions that the slave unit tanks should move in. Therefore, the PhraselD would be replaced with a movementlD. In this way the controller tank would simulate a battle or the like. The toy tanks are provided with means to locate the other toy tanks in the network so that they may move in a coordinated manner. The means can take the form of a playing board with position sensors that the toys are in communication with, or other means of location such as a camera, transponders or the like.
In an alternative embodiment, each doll controls its own actions; i.e. each doll runs the program to generate the conversation. Therefore, effectively each doll in the network is a controller doll. In this example, each doll transmits information to the other dolls relating to the point within the program that they have reached. This enables the next doll that is due to speak to continue running the program from the correct point. In addition, information relating to variables set by the current controller doll are transmitted to all of the other relevant dolls; e.g. if it is a global variable it will be transmitted to all of the other dolls. By enabling each doll within the network to be a controller, the robustness of the network can be increased. This is due to the fact that any doll can be removed from the network, even the current controller doll, and the remaining dolls can work around the missing doll.
Synchronisation
In another embodiment the toys are adapted to interact with other such toys, in a more life-like manner. The toys, in the form of dolls, vehicles, or the like, are provided with an interaction engine that enables them to interact as if they were animate. The interaction engine is adapted to enable the toys to output actions simultaneously, i.e. without requiring each toy to complete an action before another toy can begin a separate action. The interaction engine is similar to the conversation engine as described herein, but it is enabled - additionally or alternatively - to handle the output of actions other than speech, such as movement.
Figure 17a is a schematic illustration of two dolls, A and B 1750, and the corresponding timelines showing the various timings available to synchronise the dolls' actions are shown in Figures 17b, c and d. Both of dolls A and B are essentially the same, and include a processor 1700, a memory 1702 coupled to the processor, a transducer 1704 coupled to the processor, and a wireless communications module 1706. The memory 1702 stores information relating to the prospective interaction between the dolls, such as a conversation or military manoeuvre. The interaction engine 1708 is connected to the processor and enables the interaction to be constructed. The processor 1700 is adapted to utilise the stored information to construct an interaction between two or more dolls. The output of the processor 1700 outputs signals representative of the actions chosen by the processor, and this is forwarded to transducer 1704 to turn the output into the appropriate action. The processor 1700 is also adapted to generate a trigger signal which is wirelessly communicated, via the wireless communications module 1706, to the other dolls within the network. The trigger signal can be sent at any time before the current doll has completed its own action. This can enable the dolls within the network to be synchronised with respect to their outputs.
As can be seen in Figures 17b, c and d, there are three types of synchronisation that can be employed:
• Timed from the start of an action o The toy triggers the next toy after a time interval from starting the current action; in this example Doll A triggers Doll B to say Phrase 2 after x seconds from starting to say Phrase 1. o For example, this form of synchronisation is used to enable Doll B to interrupt Doll A because Doll B is getting "bored" of what Doll A is saying.
• Zero time interval between actions o The toy triggers the next toy immediately after starting the current action; in this example, Doll A triggers Doll B to say Phrase 4 zero seconds after starting to say Phrase 3. o For example, this form of synchronisation is used to enable the Dolls to interact as if they were in a music band, with all members of the band starting to play music at the same time.
• Timed from the end of an action o The toy triggers the next toy at a time interval before the end of the current action; in this example, Doll A triggers Doll B to say Phrase 6 y seconds before ending Phrase 5. o For example, this form of synchronisation is used to enable Doll B to start "laughing" at Doll A's joke before Doll A has finished.
The trigger signal sent to the next toy can contain information relating to the current interaction, and information relating to the toy itself. For example, where a single controller doll controls the entire interaction, the trigger signal will request that the slave doll outputs a certain action. However, if each doll controls its own output, then the trigger signal will inform the next doll where in the interaction they should begin processing what to output next. In addition, the trigger signal could include parameters that have been set; for example, if a doll randomly chooses a name for their pet that name is passed to all dolls so that they can use that information in constructing a conversation. Lastly, the trigger signal could include information relating to the timing; e.g. the trigger signal is not sent when the next doll must act, but at the beginning of the current doll's action with information indicating when the next doll should start.
An interaction, such as a conversation, playing music or playing a game, can either be pre- determined, or can vary dependent on pseudo-random selection of what action to output next. In either case, the toys are adapted to interact as if they were animate. The ability for any toy to perform an action at any point provides a more life-like interaction than one where all actions occur in sequence. The toys are also provided with an input, such as a port, that enables an interaction to be downloaded into the toy. The interaction is in the form of a theme as herein described. The synchronisation can allow for the dolls to act as if they were members of a group. For example, a number of dolls can act as if they were in a band. In this example, the first doll initiates a piece of music, and each of the other dolls plays a different part of that piece of music; i.e. one would act as the lead singer, one the drummer, one the guitar and one the bass guitar. The doll would send a signal to each other doll to start playing their section of the music immediately, thereby creating a complete piece of music. In order to avoid problems of maintaining synchronisation, the music can be divided into phrases with control, and timing, being negotiated at the end of each phrase.
In a similar way, the toys could be grouped into two, or more, armies with tanks, soldiers and the like (i.e. military assets). Each army would act as a unit, and the one of the toys could trigger the other toys to move as a unit. The movement would be synchronised using the above described methods.
Another example of grouped actions would be racing cars, where one of the toys determines the actions of a group of cars to simulate a motor race. Alternatively a user can control one, or more, of the cars remotely and initiate a pre-determined set of actions for the other surrounding cars. Again, the synchronisation methods would be used to control the actions of the cars, so that they move together rather than in sequence.
In another example, one of the dolls in the group is adapted to be a game board, such as a chess board, ludo board, snakes & ladders board or the like. The board comprises sensors that allow the position of the playing pieces to be known, and in this way the board can interact with the other dolls and the child by outputting information relating to the stage of game play and whether or not the playing pieces are in the correct position.
In a further example, the dolls are adapted to act out a famous play, or a famous religious scene such as the nativity. Thus, children can be provided with an educational experience while having fun.
Other examples of grouped actions would be used in an educational environment. For example, a group of dolls would be taught in any subject, whereby one doll is the teacher and asks questions which would be answered by all of the other dolls simultaneously, thus promoting learning for the child.
Conversation construction The conversation engine constructs the conversation on the fly. Alternatively, before initiating the conversation the entire conversation is constructed and then stored in memory and effectively the conversation is then run through until the end. However, in both cases the conversation constructed will be based on certain random choices.
The conversation is based on the units present in the network, and therefore the number of units present, and the type of units present, are used as control variables. The start of each conversation is fixed, such as for when the toys are dolls "Wow, we're at the Zoo what shall we do now?". But there are multiple starting phrases. The conversation will then be randomly chosen from that point on. The controller unit selects the first unit to speak and then branches at random to any of the starting phrases. The system is enabled to use an instruction set comprising a number of different types of commands as follows:
• Definition of variables and variable setting
• Context reference and switching • Conditional flow control
• Unconditional flow control
• Uttering phrases
A number of statements are defined to control the flow of the conversation and are as follows: SELECT NEXT - selects the next unit to speak. There are a number of variations of this statement that will be discussed in further detail below.
SWITCH - switches to next unit. switch speaker - moves the speaker pointers to another speaker switch finish - this statement is used to finish the conversation
SAY - instructs the unit to say something.
SET - this statement is used to set a variable, such as "SET pet ([1,dog])". The SET statement is used to set a variable of the current speaker, or it can be used to set a global variable.
TEST - this statement is used to test whether a variable has been set, or if a branch has been used for example. If the TEST is true a flag is set. There are two forms of the TEST statement: TEST EQ - this statement tests whether the two expressions are equal and will produce a positive flag if they are; for example, "TEST EQ &ME.PET &UNDEF" will test whether the current speaker's pet variable is undefined and will produce a positive flag if it is.
TEST NE - this statement tests whether the two expressions are not equal, and will produce a positive flag if they are not equal.
BRANCH - this statement is used to branch off into another section of the conversation. For example, "BRANCH Gorillas:" would branch off into the Gorillas section of the "Zoo" theme; where "Gorillas:" is a label to a section of the theme. This is an unconditional statement and is always used when the program reaches a branch statement.
BRANCH_F - conditionally branches on a flag from TEST. Therefore, only when the flag produced from the TEST statement is positive will the branch statement be used.
CHOOSE - this statement enables the controller to randomly select a label to proceed to. This statement is similar to the SET statement in that weights can be used to control the probability of proceeding to a label.
CHOOSE-F - conditionally chooses based on a flag from TEST The audio files are stored in a cropped form to reduce the storage requirements, i.e. there is no silence before or after each audio segment. To produce more realistic speech a number of silent audio files are provided of differing length that can be placed after the cropped audio files, between each phrase or word. These audio files are referenced in the same way as any of the other audio files by the SAY statement.
Variables can be defined, by the SET statement, to store parameters associated with each of the dolls; this is discussed in further detail below. There are two types of variables that can be defined:
• Local variables - These are variables that are associated with each Toy/Doll. The local variables are created within each Doll's data set. Doll variables are created by the DEFINE VARIABLE_NAME statement.
• Global variables - These are variables that are associated with the "theme" and not with each Doll. Global variables are created by the DEFINE G_VARIABLE_NAME statement.
The variables defined within the theme do not have a value assigned to them until a value is assigned during the conversation.
Setting values to variables During the conversation it is necessary to set values to the variables that have been defined. This is accomplished with the SET statement. The SET statement consists of a random feature that allows the variable to be set with a value taken at random from a set of values as follows:
SET VARIABLE_NAME ([w1 ,value1],[w2,value2] [wn.valuen])
The operation of this statement is to set the value of VARIABLE_NAME to one of valuel , value2, .valuen based on the outcome of a random number. The probability of which value is chosen is based on the weights w1 , w2,..., wn.
For example the statement
SET COLOUR ([1 ,red],[1 ,blue],[1, green])
Will set the variable COLOUR to red, blue or green with equal probability. Doll variables are set in the context of the current Doll.
Additionally the SET_F statement is used to set a variable only when a TEST statement has produced a condition_flag situation. In this case if and only if the condition_flag is active the variable is set.
Context reference and switching Pointers are used to store information relating to the speakers, and to enable the controller doll to reference other dolls. When constructing conversations these are used to create sensible conversations; the following are the pointers used:
Previous speaker (PREV) = the ID number of the previous speaker current speaker (ME) = the ID number of the current toy next speaker (NEXT) = the ID number of the chosen next speaker An important feature of the Doll's conversation engine is the context of which Doll is the current speaker. The context refers to the variables that the current doll has access to. Only the previous, next and current doll's variables are available for access. The concept of context is handled by three reference pointers, as defined above.
Control of context is achieved by use of the SELECT commands and the SWITCH command. There are a number of variations of the SELECT command. These are:
• SELECT NOTME - This selects the next speaker to be any of the group of Dolls chosen at random except the current Doll. • SELECT NEXT - This selects the next speaker to be any of the group of Dolls chosen at random.
• SELECT PREV - This selects the next speaker to be the same as the previous speaker.
• SELECT NAME - This selects the Doll with the name NAME to be the next speaker. This variation of the SELECT command is for fully scripted conversations.
The context is then changed by use of the SWITCH command. There are two variations of the SWITCH command:
• SWITCH SPEAKER label - This switches the speaker context and branches to the instruction specified by the label. On switching context the previous speaker (PREV) becomes equal to the current speaker (ME), the current speaker (ME) becomes equal to the next speaker (NEXT), and the next speaker (NEXT) is undefined.
• SWITCH FINISH - This is the command used to end a conversation
Conditional flow control
At times during the conversation the flow will depend on the values of various variables. This is accomplished with the following commands:
• TEST EQ valuel value2 - This sets a condition_flag if valuel equals value2.
• TEST NE valuel value2 - This sets a condition_flag if valuel is not equal to value2. • Variables can be referenced by valuel and/or value2 by using the
&CONTEXT.VARIABLE_NAME reference. For example the instruction TEST EQ &ME.NAME &PREV.NAME sets the condition_flag if the current speaker's (ME) name is the same as the previous speaker's (PREV) name.
• BRANCH_F label - This branches to the instruction specified by the label if the condition_flag is set, otherwise the next instruction is used.
• CHOOSE_F ([w1 ,label1],[w2,label2], [wn.labeln]) - If the conditionjlag is set this branches to the instruction specified by one of labeH , Iabel2,..., labeln based on a random selection using the weights w1 , w2,... , wn, otherwise the next instruction is used.
Each time that a doll requires knowledge of a variable relating to another doll the TEST statement is used to interrogate whether the variable is undefined, or is a specific value. This can then be used for flow control; for example, if the variable PET is undefined then the doll will ask the other doll what type of pet is has, and if the variable is set it will ask the other doll what colour the pet is, and so on. Unconditional flow control
At times it is necessary to be able to change the flow of instructions unconditionally. In this case a TEST statement is not used and the BRANCH or CHOOSE statements are always executed. This is accomplished using the following statements: • BRANCH label - This unconditionally branches to the instruction specified by the label.
• CHOOSE ([w1 ,label1],[w2,label2], [wnjabeln]) - This branches to the instruction specified by one of labeH , Iabel2,..., labeln based on a random selection using the weights w1 , w2, ... , wn.
Uttering phrases
An important part of the conversation engine is the uttering of phrases. This is accomplished with the following statement
SAY (phrasel , phrase2,..., phrasen) command. This command causes the Doll that is the current speaker (ME) to utter the phrases phrasel , phrase2,..., phrasen.
Example script
The following is a short example of a script. DEFINE COLOUR
DEFINE GARMENT Loop:
SET COLOUR ([1 ,red],[1 ,blue],[1 ,green]) SET GARMENT ([1 ,dress],[1 ,blouse],[1 ,hat]) SAY (hello my name is, &ME.NAME, and I have a, &ME.COLOUR, &ME.GARMENT)
SELECT NOTME SWITCH SPEAKER Loop
This example can say nine different things for each Doll present by choosing one of three colours to go with one of three garments.
The conversation is constructed using multiple branches. Each branch is a different area of conversation related to the theme. For example, in the "Zoo" theme the branches available are "Gorillas", "Reptiles" and "Ice cream". Each branch has phrases/words associated with it and they are then chosen randomly from the selection. The doll's responses are dependent on the branch, the doll's personality type, and the weightings of the possible responses.
For example, when a choice is required to determine the next branch to take the conversation will continue until two (or more) dolls choose the same place to go in a row. This provides a more realistic conversation as the agreement is required before choosing a branch to take.
The conversation continues within a branch until a section is reached that enables the controller doll to select another branch to take. At this point another decision is made regarding the branch to take. To limit the length of the conversation only branches that have not been used are available to be selected. Weightings are attached to each variable that can be chosen randomly, such as Branch, Phrase, Word, or Next speaker. When the phrase/word or branch etc is chosen randomly the weightings alter the probability that that phrase/word branch, etc, is chosen. For example, if all of the phrases had a weighting of 1 then they would all have the same probability of being chosen. The weightings can be adjusted to produce conversations that are more life like. Phrases such as "I fell off my bike today" are far less likely to arise than phrases such as "I had breakfast this morning". As a result the latter phrase would have a far greater weighting than the former. Therefore, only occasionally the conversation engine would result in a unit saying "I fell off my bike this morning".
In a further example, the weightings used can be preferential to the previous doll and will therefore induce mini conversations between two dolls.
In order to limit the conversation length the amount of time within any one branch of the theme is controlled. This can be used as another weighting parameter to reduce the time spent in one branch and increase the amount of time spent in another branch for example. This aids in reaching an end to the conversation without the possibility of the continuing indefinitely.
The length of the conversation may be random; however, in some cases the conversation will continue until all of the variables have been set. For example, in the PET theme the conversation will continue until all of the dolls' pets have been fully described. This is accomplished by performing a check to determine whether all of the variables are defined, and only allowing the conversation to end if they are all defined.
As the current speaker only has the context of the previous speaker and the next speaker it is not always possible to determine when all of the dolls' variables have been set. Therefore, in another example the conversation will continue until all of the variables have been set for all three dolls in the current context, i.e. the current doll, the previous doll and the next doll. Alternatively, the conversation will continue until all of the variables are known for two, or more, sets of dolls in a row.
The conversation engine can cope with multiple dolls, and potentially multiple dolls of the same type, e.g. 2 Jane dolls. When the network is initialised each doll that joins the network is associated with a network node. The system then references the dolls using the associated network node, and not the name of the doll. This enables multiple dolls with the same name to be referenced without error.
Conversations can also be pre-determined in their entirety and then downloaded directly to the dolls. For example, an episode of The Simpsons™ could be downloaded into a group of The Simpsons™ dolls. Pre-determined conversations enable the doll to have especially lifelike conversations, since they are generated by humans, or alternatively they could be generated by a conversation engine and then edited by humans. The same instructions are used when producing a pre-determined conversation; however, the random elements are removed such that the conversation is the same every time it is activated.
The above conversation engine could be used independently to generate conversations. For example, it could be used for automated script writing for a television show, such as a cartoon. In one particular embodiment, to generate the themes the theme is scripted, and then a compiler is used to compile the script. A run-time error check is performed to ensure that the theme does not produce never ending conversations or any other errors, and then a sanity check is performed to ensure that the conversations are not completely nonsensical. The theme is then able to be downloaded to the toy once the audio files have been recorded. In an alternative embodiment, described in further detail below, there is provided an authoring tool to simplify the generation of theme scripts. However, the basic principles of the conversations within the themes still apply. For example, the same methods of choosing what to say are present in both embodiments.
Doll choice
As shown in Figure 3, the conversation engine has a speaker selector 218. The speaker selector selects the next toy to speak. There are three possibilities for choosing the next toy to speak: choose at random any of the toys within the network; choose a toy by name (ID number); and choose the current speaker to speak again. Therefore, the first process in choosing the next speaker is to select, at random, which one of the above three possibilities to use. When choosing the next speaker by name, a check must be performed to determine that the toy is in the network.
As described above the select statement chooses who will speak next. When deciding on the next speaker the options are to respond with relevant speech, select another doll and address them, or announce something about the current speaker.
The SELECT statement is used within the speaker selector 218 to initiate the random selection of the next speaker. Alternatively, the SELECT statement can use logic to determine the reference to the next speaker. For example, if the next doll chosen to speak is Jane, then the current speaker can ask the following question "Jane, what is your favourite pet?". Jane is set as the next speaker and so the reply will come from Jane. As can be seen in the examples below the & statement can be used to reference the next speaker, or any other general parameter without knowing the specific parameter. For example, &NEXT.NAME references the next speakers variable NAME, and can be used to say the next speakers name.
Further options are available such as no doll can speak twice in a row, so for example if Jane announces that she has a pet dog, then Jane would not be selected to speak again directly afterwards.
Similar methods are utilised by the authoring tool to choose the next doll to speak, this will be described in further detail below.
Parameter storage
The parameter storage memory 216 stores information relating to the current conversation. The information stored includes: the phrases that have already been used; the variables that have been used; flow control variables; and other such information like the dolls that are in the network. The information is only stored within the controller doll. The slave unit only receives information relating to the next thing to say.
The variables that have been used in the conversation are stored so that they may be referred to later in the conversation. Variables are pieces of information describing the doll, and are used to differentiate the characters. For example, the information stored from the phrase "My dog is called Fluffy" would be the information, dog and fluffy. This variable can be used to set the type of pet that a doll has. The variables can be set so that dolls can only have a certain sub-set of the variable. For example, girl dolls can not have a snake as a pet.
Flow control variables are used to store information regarding the branches that have already been used. For example, a branch may be going to see the Gorillas when at the Zoo. This piece of information will be stored so that the conversation does not return to the Zoo.
Alternatively, the phrases that have already been used are stored so that the conversation does not go on forever. Limits can be set on the number of times a particular word/phrase can be used within a single conversation; this limit may be 1 , 2, 3 or more. This ensures that the conversation does not become too repetitive.
There are also global variables that can be set and are stored within the parameter storage memory. An example of a global variable would be anything that affects all of the dolls within the network, for example "it's raining outside", or the places that the doll's have been within the conversation. A global variable can be accessed independently of the context of the doll, and so can be used at any point in the theme.
Parameters are also defined using the authoring tool to store attributes relating to the theme/doll, this will be described in further detail below. In brief, theme attributes/global variables store parameters associated with the entire theme and can be accessed by any doll at any time, and doll attributes/local variables store parameters associated with each doll and are only accessible by the previous/current/next doll.
Doll specific downloads
Figure 4 shows a schematic illustration of the process through which a doll can change, or update, the theme that it has stored in memory. The doll 300 contains an ID number 302 which is used to identify the doll. The doll is connected to a PC 304 via a USB connection, and the PC is in turn connected to the Internet 306 via a standard connection type. The Internet provides the PC with a connection to the Website 308 that contains downloadable themes 310. The themes contain sub- themes 312 that are not selectable by the user as they are dependent on the doll connected. For example, a Jack doll - identified using the doll's ID number - would not be presented with a Jill sub- theme. The themes are generic to all of the personality types. The sub-themes are identical to the main theme, except that the expression of the theme is different and dependent on the personality type of the doll. The audio files are therefore different for each sub-theme - different voice, different wording (same meaning), etc.
Alternatively, the first personality downloaded into the doll can be used to restrict the subsequent downloaded personalities to be the same as the first type. For example, if the doll is set up to be Jack, the website will recognise the Jack sub-theme when the doll is connected, and only present the user with Jack sub-themes. The website recognises the sub-theme by accessing the doll's name variable, i.e. Jack, and comparing it to the list of names of sub-themes. The downloaded sub-theme includes the script for the theme chosen, such as "The Zoo", the associated personality type, the corresponding audio files that enable the doll to vocalise the conversation, and a theme ID which is used to ensure all of the dolls within a network have the same theme.
The PC 304 is adapted to interface between the doll 300 and the website 310 to enable the theme to be downloaded in an efficient manner. Furthermore the theme is only stored on the doll and therefore each doll that requires the theme must be connected to the website. Therefore, if one user has two dolls and requires the same theme for each doll the user must connect to the website with each doll, and download the appropriate sub-theme.
Alternatively, the doll can store multiple themes at any one time. The doll communicates using one theme at a time; however, the themes could be changed - by the controller - at any time. Therefore, the dolls could use the "Sport" theme and then progress onto using the "Zoo" theme. This enables the conversation to continue for longer and provides further combinations to extend the usability of the dolls.
The dolls all have a default theme so that they may communicate briefly when they do not have the same theme as other dolls. The default theme contains a few basic phrases, and may direct the user to connect to the website to download a theme.
To ensure the themes are secure the data can be encrypted, using the doll's unique ID number before being downloaded to the doll. Each doll's unique ID number can then be used to decrypt the data within a theme. This can be used to ensure that every doll connects to the website to download the theme. For example, even though each Jane doll would use the same sub-theme the data would be encoded differently for each specific doll, and is therefore effectively useless other then for that specific doll.
Expression of personality and scripting themes As mentioned previously, each different theme has various sub-themes that enable different personalities to be expressed. The script for every theme is different and is used to generate conversations according to that theme. However, each sub-theme within every theme has the same script to generate the conversations, but the language used in the sub-theme is different. This enables multiple personalities to be available for the same theme.
To increase the variability of the conversations there are multiple random choices available to ask the same questions. So for example there are multiple ways of asking a simple question, and this may be dependent of the themes/sub-themes for example: "What shall we do next?"; "What are we going to do now?"; or "What's next?". Each sub-theme can have different expressions that are used to mean the same thing. For example, one sub-theme may say "Hello, how are you?", and another says "Hi, how's it going?". The meaning of the phrase is effectively the same but the expression, and therefore the personality, is different. In this way each theme can have any number of sub- themes to create a colourful and interesting conversation. In this way the user experience is enhanced and allows for a more varied game play without the requirement for large amounts of memory. Personality traits can be attributed to one and the same theme. It is therefore possible to have a Jack version and a Jill version of the same theme. The Jack version is a sub-theme, and the Jill version is a sub-theme.
The name of the doll, i.e. Jane, is linked to the personality type so the personality expressed by the Jane doll will be the same for every theme; only the content of the theme would change. This enables the doll to remain consistent and allow the doll to react in similar ways in different situations.
Alternatively, the user of the doll can select the doll's name and the dolls personality when the doll is first initialised by the website. This enables the user to be more involved with the doll. The doll's name and personality type would then be stored in memory within the doll, each attribute associated with an ID, and used when downloading further sub-themes for example.
The downloadable themes are a combination of the expression and the script and dictate the type of conversation.
The aesthetics and vocabulary of the dolls can also be tailored so that it is age appropriate for a target audience. Various themes may have an age appropriate rating. This allows hip hop themed dolls, for example, for a teenage market.
Furthermore, phrases can be provided that are only allowed to be used by a discrete set of dolls (this may be a single doll). When this phrase is selected a check is performed to ensure that it can be used by the current doll. If it can not be used by that doll then another phrase is selected.
Similarly, sections of the instructions can be restricted to only a discrete set of the dolls to introduce further randomness into the conversations.
Alternatively, the toy is in the form of a tank, or other such toy. The expression of the toy's personality in this case is in the form of movements as opposed to speech. For example, one toy tank could have a "defensive" personality and another toy tank could have an "aggressive" personality.
Authoring tool
The authoring tool is an application which can be used to create conversation themes for multiple dolls. The conversations as described above require a significant amount of time to create due to the large number of potential branches that the conversation can follow. Therefore, in order to make the process more efficient an authoring tool is provided to aid in this process. Although the client application runs on a personal computer or the like, such as PC 1000 or laptop 1002 as shown in
Figure 10, the data is stored on a server 1004 to allow either multiple users to work on the same theme, or for a single user to work on the same theme from different locations. A web service is provided on the server to interface the database with the client application. The client application communicates with the server 1004 via the internet 306. The client application formats requests to the web service, and hence the database, using XML, and transmits the data using the SOAP protocol. Overview of the Authoring Tool
Figure 11 shows an overview of the authoring tool. A user interface 1100 is provided to allow theme developers to simply and efficiently output themes for toys. Using the user interface provided the developer follows the following steps: 1. Create a theme using a theme generation engine, 1102
2. Create toys for that theme using a toy generation engine, 1104
3. Create multiple contexts for each toy, using a context input window 1106
4. Output the instructions ("C" code), using the code generation engine 1108
5. Output the "dictionary" of phrases to be recorded for each doll, using the dictionary generation engine 1110
6. Output, when required, the theme as a simulation using simulation engine 1111 for use in testing the themes on a PC
The term context, as used herein, connotes a sub-set of content within the theme data, e.g. for each position within the themed conversation there is at least one context that determines what the doll says and which doll will speak next. A context can also set theme/doll attributes.
Once the instructions and "dictionary" have been output using the code generation engine and dictionary generation engine 1110 respectively, the phrases are recorded using recording means and audio files are created and saved using the recorder 1112. The recorder prompts an actor to generate each of the expression data required for the particular theme being created. The recorder then allocates each audio file with the ID number corresponding to the appropriate expression data. In use, the audio files are referenced using the appropriate ID number by the code operated by the toy's processor and output using the toy's speaker.
A set of base instructions 1114 (the firmware for the toy's processor) are combined with a set of themed instructions (generated by the code generation engine 1108) and compiled using a compiler 1116 into binary files that are used by the toy's processor to operate the toy according to the theme. In the previous embodiment, described above, the base set of instructions/firmware was located in the toy's processor memory, and only the set of themed instructions, and the audio files, were downloaded to the doll each time the theme was changed or updated.
Once the instructions are compiled they are bundled together with the audio files using the combiner engine 1120 so that they can be downloaded to each doll (each doll has an individual download, comprising the same themed instructions, but with personalised audio files).
The authoring tool has access to the server 1004 and a database 1122, where the themes are stored. The themes are stored in different formats depending on whether they have been finalised by a theme developer. The non-finalised themes are stored such that the information is readily accessible by the authoring tool; this is in the form of a database containing references to the theme name, toy name, contexts, etc. Once the theme developer finalises the theme the theme is also stored as a set of instructions as described above, in addition to the non-finalised format. This enables a finalised theme to be amended, and a new theme created based on a previously finalised theme. A website 1124 is provided that enables the users of the toys to download the themed data to his/her toy/doll 1126. The authoring tool has several functions including those as described above:
1) It can be used to import a conversation from a pre-formatted text file.
2) It can be used to create and to edit themed conversations for multiple dolls, using the theme generation engine 1102. 3) It can be used to simulate the conversation process, producing a text output of the resultant themed conversation, using the simulation engine 1111.
4) It can be used to assemble a list of all the phrases to be recorded for each doll, using the dictionary generation engine 1110.
5) It can be used to produce "C" code output (sets of instructions), using the code generation engine 1108, which can then be compiled and linked with the modified processor firmware to produce a binary data file for each doll ready for download.
Entering Conversation data
The authoring tool application user interface is shown in Figures 12a to 15. Each window of the interface has numerous navigation buttons to either interface with input windows, or to proceed to the next interface window. The user interface utilises the processor 1150, and associated memory
1152 to display to the theme developer the various aspects of the user interface, and the receiver
1153 to receive the content input by the user. The processor 1150 and memory 1152 are situated within the PC 1000 or laptop 1002. The term content, as used herein, connotes scripting data, expression data, theme data, doll data, and any other data type that may be input by the user into the authoring tool.
Figure 12a is the first interface window, and has the following options:
Add Theme, 1100: This is used to create a new theme and is normally the first option used. It brings up a theme form, as shown in Figures 12b & 12c, which requires the following inputs:
Name: The name of the theme. This is a place holder for a spoken_text_string
Number of Dolls: The total number of dolls supported in this theme Description: The description of the theme
Theme attributes: The global attributes of the theme, such as the location
Dolls attributes: The local attributes of the dolls such as a mood
These inputs are equivalent to the inputs required in the construction of conversations as described above. The theme and doll attributes, as described with reference to the authoring tool embodiment, are equivalent to the global and local variables respectively, as described above. However, the authoring tool provides the theme developer with structured input windows to enable the information to be input more efficiently.
In further detail, theme attributes consist of a name and optionally a value. The value can be a placeholder for spoken__text_string. The spokerjext_string is created after the theme has been finalised, as described below. A spoken_text_string, is a sound file that can be accessed during the conversation. For example, if the theme was located in the Zoo, a possible theme attribute would be location = "Zoo", and can be used by the dolls; e.g. to say "Hi, I'm really having fun at the Zoo", where the word "Zoo" was accessed using the theme attribute "location". The doll attributes are created in the interface window as each doll in a particular theme require a value for an attribute. For example, if the attribute set is "mood", then each doll will be attributed a value for this attribute, such as "happy", "sad", "angry", etc. During the conversation the conversation engine can access any of the doll attributes (local variables) and use it in the conversation
Edit, 1202: This is used to edit an existing theme. For example, selecting the theme Alon#1 , 1206, and pressing edit will allow the user to edit the details of the Alon#1 theme.
Remove, 1204: This is used to delete the selected theme.
Figure 12a shows the window after three themes 1208, 1208 and 1210 have been created. It can be seen that each theme shows the overview of the theme's details, including a brief description of the theme, the number of dolls involved in the theme, and its ID number. The information input into the theme form is stored in the database 1122 in the server 1004 for later retrieval when generating the output instructions.
Once the theme has been created, the user moves on to the next window to create the dolls within the theme. Figure 13a shows the doll generation window, and when the user presses the "add doll" button 1300, the window shown in Figure 13b is displayed. This window allows a doll to be created named, and given a brief description.
As many dolls as required can be created using the windows shown in Figures 13a & b. However, the number of dolls that can be created is limited by the previously determined maximum number of dolls for that particular theme. Using these same windows it is also possible to edit existing dolls. Each doll created in this way will lead to a sub-theme being generated. The sub-theme, as described above, is the theme for each specific doll. For example, the voice used to record the speech is different for each toy, and the context data will be different. Again, the information input into the doll form is stored in the database 1122 in the server 1004 for later retrieval when generating the output instructions.
Figure 14 shows the context definition window where the different contexts are input against each doll in the theme. As shown in Figure 14, at Position 100 there are two contexts defined, 1400 and 1402, one for Doll#1 and one for Doll#2. Therefore, when Position 100 is accessed within the conversation, a doll is chosen by a method as described above, and the corresponding context is accessed. Each context holds information relating to what the doll should say, and which doll should speak next. This simplifies the process of conversation construction as described above, by providing the theme developer with a structure for creating the conversation. The theme developer is no longer required to code the theme themselves, rather the authoring tool generates the required code in dependence on the theme developers input.
Figure 15 shows the context generation window for each position within the theme. In the example shown in Figure 15, this is the context for position 100 and Doll#1. Each context requires the following information: • Position, 1500 - A text string labelling this position which is created automatically by the authoring tool when a new context is created in the context definition window shown in Figure 14. This is a convenient label for each context row. It can be any text; however, the default is to sequentially number the context rows starting at 100. The use of text labels is to aid clarity while creating and editing the conversation. When output of "C" code is required all Position labels are converted to indexes into an array of youme_conversation_struct_t structures (C code naming convention utilised for this and the other structures described herein) which correspond to the context positions.
• Statement, 1502 - A list of statements that the doll can say together with weightings used in the random selection process. The statements contain a list of phrases which are spoken_text_strings. This is a list of statements that can be said by the particular doll at this context point in the conversation. Each statement is enclosed in square brackets and each statement can either be separated by a comma (e.g. [statement1],[statement2], [statements]), or entered on a separate line1 of the context input window as shown in Figure 15. Statements consist of a weighting, for random selection, and a list of phrases. The weighting in this case operates in a similar manner to the weightings as described above with reference to the conditional flow control, such as the SET, BRANCH or CHOOSE controls. Each phrase is either an explicit spoken_text_string or a reference to a theme attribute or a doll attribute, e.g. the statement can reference to the location of the theme or the mood of the doll. Explicit spoken_text_strings are defined as text within double quotes (e.g. "hello how are you"). References take the following forms: o theme. attribute for a theme/global attribute o me. attribute for the current speaker doll attribute o prev.attribute for the previous speaker doll attribute o next.attribute for the next speaker doll attribute o name.attribute for the named doll/local attribute
The following are examples of valid input to the Statements field: o Blank - This means there is nothing to say by this doll at this point. o [1 , "hello how are you"] - Only one statement specified "hello how are you" will be spoken by this doll at this point. o [1, "hello", prev.name, "how are you"] - Only one statement "hello" followed by the previous speakers name followed by "how are you" will be spoken by this doll at this point. o [1 ,"hello"],[1 ,"hi"] - Two statements with equal weighting. If the default_say_procedure is used then "hello" will be said 50% of the time by this doll at this point and "hi" will be said the other 50% of the time. o [3, "hello"], [1 , "howdy"] - Two statements with unequal weighting. If the default_say_procedure is used then "hello" will be said 75% of the time by this doll at this point and "howdy" will be said the other 25% of the time.
• Say, 1504 - The procedure used to say the statements. If left blank then the default_say_procedure is used. The default_say_procedure randomly selects one of the available statements using the weights. Alternatively, any available built in say procedures providing different behaviour can be selected using the drop down list. The say procedures as described above can be provided in the drop down list. Finally, if custom behaviour is required "C" code of the required say procedure can be entered here. • Transition, 1506 - The procedure used to select the next doll. It can be any of the procedures described above including: NOTME, ANY, ME, PREV, FINISH or one of the dolls names or some "C" code can be entered here. If left blank the default_transition_procedure is used, which is the NOTME transition. Alternatively, there is a pull down list of available transition procedures. This list consists of the following built in transitions, and is accessed in the authoring tool via a drop down menu (each as described in detail above): o NOTME Selects any doll except the current speaker at random. o ANY Selects any doll at random. o ME Selects the current speaker o PREV Selects the previous speaker o Doll's name Selects that doll
Additionally, if a custom transition behaviour is required "C" code of the required transition procedure can be entered here.
• Next, 1508 - A list of branch choices of where to go next together with weightings used in the random selection process. This is a list of branch choices for the next context position. Each branch choice is enclosed in square brackets and delimited by commas. Branch choices themselves consist of a list of position labels together with weightings for random selection. They are similar in format to the BRANCH command as described above. The following are examples of valid input to this field (each as described in detail above): o [(1 ,label1),(1 ,label2)] - One branch choice containing a choice of two labels with equal weights. o [(1,label1),(1,label2)],[(2,label3),(3,label4)] - Two branch choices, the first containing a choice of two labels with equal weights, the second containing a choice of two labels with weights 2 and 3.
• Branch, 1510 - The procedure used to effect the branch, and the format is the same as described above with reference to conversation construction. Otherwise some "C" code can be entered here. This field is used to specify the branch procedure to process the branch choices. If left blank then the default_branch_procedure is used. The default_branch_procedure uses the first branch choice in the Next list and chooses one of the labels at random using the provided weightings. The context is then changed to the context row with the chosen label as its position label. Alternatively, there is a pull down list of available built in branch procedures. The branch procedures as described above can be provided in this drop down list.
• Attributes, 1512 - A list of attributes, a set_flag, and list of values and weightings for random selection. This field is used to specify any attributes to set with values at this context point, i.e. the theme developer can set the doll attribute "mood" to happy. If left blank then no attributes are set. Each attribute to be set is enclosed in square brackets and delimited by commas. Within the square brackets the attribute is specified followed by a set_flag which specifies if the attribute is to be set once or can be reset, followed by a list of values and weightings for random selection. The attributes field is the equivalent of the SET command as described above. The following are valid input to the Attributes field: o Blank No attributes to set o [me.attributel ,set,(1 ,"hello")] One attribute to be set, if not already set, to the value of spoken_text_string "hello" o [me.attributel ,reset,(1 ,"hello"),(1 ,"hi")], [me.attribute2,set,(1 ,"peter"),(1 ,"paul")]
Two attributes to be set. The first to be set, even if already set, to either "hello" or "hi". The second to be set, if not already set, to either "peter" or "paul".
• Set, 1514 - The procedure used to effect the setting of attribute values. If left blank then the default_set_procedure is used. The default_set_procedure sets each specified attribute to the appropriate choice of values taking account of the set_flag. A set_flag of "set" means that the attribute can only be set if it has not already been set. A set_flag of "reset" means the attribute can be reset over and over again. Alternatively, there is a pull down list of available built in set procedures. Finally, if some special custom set behaviour is required
"C" code of the required set procedure can be entered here.
As described above, the fields, Statements, Say, Transition, Next, Branch, Attributes, and Set are replicated for each doll. The fields Say, Transition, Next and Branch are all parameters that contribute to the method of interaction between the toys/dolls, and are all equivalent to commands as described above with reference to conversation construction.
Figure 15b shows an alternative embodiment of the context generation window. As area 1550 shows, there are additional parameters that can be set to enable the user to determine when the next doll will speak. The three options are: follow on; timed from start; and timed from end. The follow on parameter allows for conversations to continue with the dolls speaking in series, i.e. one after the other with no overlap. The timed from start parameter enables the user to enter a time interval after the doll starts speaking to trigger the next doll to speak. This allows two dolls to speak at the same time, for example, multiple dolls can laugh at the same time in response to a joke. The timed from end parameter is similar to the timed from start parameter except that the user enters a time interval for the next doll to start speaking before the end of the current doll's speech. This feature enables more life-like conversations to be constructed.
The Context option is used repeatedly to add context rows to the conversation until the conversation is complete.
When the theme has been completed, including defining each doll, and each context, the authoring tool provides a save function. This option is used to save the conversation, and in one example it creates the following directories: c:\youme\themes\theme_name c:\youme\themes\therne_name\doll_name - for each doll c:\youme\themes\theme_name\doll_name\audio - for each doll
Therefore, all of the files required for a single theme are saved within the master directory folder "theme name". Sub-folders are created for each doll to enable the downloads for each doll to be managed efficiently. Finally, each doll sub-folder has a folder to store the audio files required for that doll.
It also creates the following files: c:\youme\themes\theme_name\theme.txt - containing the theme data as a text file c:\youme\themes\theme_name\doll_name\doll.txt - containing the doll data as a text file. c:\youme\themes\theme_name\doll_name\audio\A00001.wav c:\youme\themes\theme_name\doll_name\audio\A00002.wav
c:\youme\themes\theme_name\doll_name\audio\A00Q10.wav
c:\youme\themes\theme_name\doll_name\audio\Annnnn.wav
The wav files created are place holders for each of the spoken_text_strings defined in the theme for each doll. The spoken_text_strings are assigned file names A0000n.wav in sequence starting from A00001.wav. The n used in the file name is also used as the index to the phrase when output of "C" code is required. The recorder, 1112, in one embodiment, provides a prompt for the actor to enact the required spoken_text_string, and then automatically saves the file with the correct file name before prompting the actor with the next spoken_text_string.
In addition, the authoring tool is adapted to generate "C" code corresponding to the conversation. The majority of the "C" code is predefined (a base set of instructions), and acts as the operating system for the toys/dolls processor. Once the "C" code corresponding to the conversation is output (the themed set of instructions) it is combined with the predefined "C" code, see Figure 11 , and then compiled to create the binary file suitable to operate the processor in the doll, or in the PC. Incorporating the operating system/firmware into the doll each time a new theme is created allows the functionality of the doll to be altered simply and efficiently whenever required.
Two varieties of "C" code can be output:
1. "C" code for windows - This "C" code can be saved as: c:\youme\themes\theme_name\theme_simulation.c; and c:\youme\themes\theme_name\theme_simulation.h
This code can be subsequently compiled and linked with a windows based conversation simulation engine The resulting application can be saved as c:\youme\themes\theme_name\simulation.exe. The simulator allows the user to specify which dolls should be considered as present and active. It then simulates an instance of the conversation as it would happen in real dolls. It selects one of the active dolls at random to be the current speaker and processes the first context row for that doll. It then executes each new row in turn outputting which doll is speaking and what they are saying. It continues until the conversation finishes. 2. "C" code for the processor - this code can be subsequently compiled and linked with the modified player to produce binary data files for each doll. These "C" code files can be saved, for each doll, as: c:\youme\themes\theme_name\doll_name\youme_chat.c; and c:\youme\themes\theme_name\do!l_name\youme_chat.h
The resulting binary data files can be saved as: c:\youme\themes\theme_name\doll_name\player.sb.
The binary data file contains the entire information set required to run the conversation on each doll. This binary data file includes the firmware for the processor, and so additional features can be incorporated into the doll's functionality without the requirement for an additional process to update the firmware.
In order that the correct phrases are recorded as wav files for the dolls a list of all the distinct phrases (spoken_text_strings) for each doll is created and output using the dictionary generation engine 1110, as shown in Figure 11; this is a dictionary of phrases required for each doll. The dictionary generation engine 1110 communicates with the database 1122 within the server 1004, and compiles the list based on the information stored on the theme within the database. The dictionary is effectively a look-up table between the expression/statement and the ID number allocated to the expression/statement.
The phrases used by each doll are defined in the Statements field and the Attributes field of each context row. They can be explicitly defined spoken_text_strings or they can be references to custom attributes. Whenever an explicit spoken_text_string is defined it is allocated a file name such as A00xxx.wav in sequence starting at A00001.wav. The number xxx will also be the phrase index. The list of spoken_text_strings can be saved in the following files: c:\youme\themes\theme_name\phrases.txt - this contains a list of all the phrases used in this theme c:\youme\themes\theme_name\doll_name\phrases.txt - these contain a list of all the phrases used by each doll
These files will contain text in the following format:
AOOxxxThe associated phrase as text
In this way, the process of creating the large number of wav files is simplified as the list of phrases can be recorded sequentially, saved with the appropriate file name, and prepared for downloading for use in the doll, or PC in the case where the PC acts as a virtual doll.
As shown in Figure 12a, the process for generating the files is activated by the button 1212 "generate files". The user selects the appropriate theme, that has been completed, and presses the button 1212. This then generates the files as described above. The entire bundle of files is then uploaded to the doll; this bundle includes the binary file of the theme and accompanying operating system, the sound (wav) files for the speech, and the processor operating code (firmware). The array of youme_conversation_struct_t conversation structures, as described above, is the main controlling data for the conversation. In outline, when the conversation is operated in the controller doll, the conversation engine starts at the context specified by index 1 of this array for the first doll. It then performs the following actions: 1. It calls the current context's transition procedure to decide which doll will be next.
2. It calls the current context's set procedure to set the values of any attributes specified in the context.
3. It calls the current context's say procedure to select which statement to speak according to the data specified in the context. This will result in wireless communication to a remote doll if the current doll is not the controller doll. In either case, the engine waits until the audio output has completed before proceeding.
4. It calls the context's branch procedure to select the next index into the conversation array to use.
5. It sets the previous doll pointer (prev) equal to the current doll pointer (me). 6. It sets the current doll pointer (me) equal to the next doll pointer (next). The next doll pointer has been set in step 1.
7. It then starts at step 1 again with the new index and with the new doll, and continues this process until it hits a FINISH branch in one of steps 4.
In an alternative embodiment, shown in Figure 12d, an additional method of inputting a conversation is provided. The "Import Theme" button 1250 allows the user to import a text file in order to create a themed conversation. In order to import a text file, the file must be formatted in an appropriate manner. The import theme feature allows for a text file to be converted directly into a format suitable to be uploaded to the dolls, without further input from the user.
The content of the text file can be some, or all, of the content required to construct a theme. For example, the text file can contain an entire (preferably self-contained) conversation, about any topic. The entire conversation would then be imported into the authoring tool and converted into a format suitable for controlling the dolls. The text file would appear similar to a script (such as for a play), with the doll's name followed by the words that the doll should say. The authoring tool proceeds through the text file and extracts the doll's name, creates a doll with that name as described above with reference to Figures 13a and b, and then stores the corresponding text as a context (a context is described in further detail above). During the extraction procedure, the authoring tool only creates a new doll when that doll name has not been extracted previously from the text file. In that case, the corresponding text is stored as another context for that doll. This procedure continues until the entire text file has been parsed into the authoring tool.
Figure 12e shows a flow diagram of the process involved in importing a text file into the authoring tool. The import means identifies a line of text associated with a doll name, then creates a doll if a doll with that name does not already exist. The text is then imported into the authoring tool database and associated with the corresponding doll's context. This process continues until all of the lines of text are imported into the authoring tool. In order for the text file to be parsed it must be formatted correctly, in this case, the doll name must be followed by a colon, and each entry for subsequent dolls must be on a new line. Appendix I provides an example of a formatted text file, using the following formatting requirements: • $Theme: o The text following this statement is imported as the theme name • $Dolln: o The text following this statement is imported as a statement for a doll called DoIIn
Once the text file has been parsed, the authoring tool generates the output instructions, as described above. In this embodiment the text file conversation engine only allows for deterministic conversations to be created. However, once the text file is imported into the authoring tool it is possible for the user to amend the conversations to include further probabilistic outcomes as described below.
USB Communications Dongle
In a further embodiment, a USB communications dongle is provided that enables a PC to wirelessly interact with a toy as described herein. Figure 16 shows a schematic representation of the USB communications dongle 1600, attached to a PC 304, and in wireless communication with the dolls 100. The dongle contains a wireless module 104, an IR/RF transmitter/receiver 212, and an interface 1602. These components, except the interface 1602, are the same as contained within the doll 100, as described above. However, the PC 304 is utilised as the processor 1604, instead of the dongle having an independent processor as the doll 100 has, and so the PC effectively becomes a virtual doll able to communicate with the physical dolls 100. The virtual doll is provided with an animated avatar shown on the PC monitor, that may be similar in appearance to the real doll, and whereby the animation of the avatar is synchronised with the speech of the doll. In order to run the conversations, the PC has stored in memory 1606 an emulator for emulating the processor of the toy. Alternatively, the authoring tool, as described above, outputs specific code for the PC based virtual doll. In both cases the themed conversation data is used to run a conversation using an application running on the PC that emulates the firmware of the toy/doll. The speech of the toy/doll is output via the PC speakers.
The interface 1602 is a USB connection, and provides an efficient way to connect the wireless communications dongle 1600 to the PC 304. The wireless communications protocol used by the dongle is the same as that used between the dolls as described herein, i.e. IEEE 802.15.4.
When the user connects to the website he/she is able to use the USB communications dongle to facilitate a conversation between a physical doll, and a virtual doll animated within the website. In this way a single user can use the functionality of the doll's conversation engine without the requirement for multiple physical dolls. In addition, the virtual doll can take part in a conversation with multiple physical dolls. The virtual dolls can also interact with other virtual dolls, e.g. if two users each had a laptop computer with a USB communication dongle.
Game playing In a further embodiment the toy is also adapted to play games with the child. For example, board games such as Snakes and Ladders, Mousetrap, Ludo, or any other chance based game that can be played using dice can be played by the toy.
The toy is provided with a random number generator that is used to simulate a die, or dice. Furthermore, the toy is adapted to count the number of spaces to be progressed along the board by the playing piece. The toy audibly signals the child to move the playing piece the required number of spaces. Once the child has moved the playing piece the child indicates to the toy, by pressing a button or the like, that it is the next toys/child's turn. Alternatively, the board is also interactive and contains sensors or the like to receive information from the playing board regarding the position of the counters. Play progresses in this way until there is a winner.
Figure 5 provides a schematic illustration of a controller toy 200 further comprising a games engine 400. The remaining components are the same as described in Figures 2 and 3. The games engine 400 comprises a board memory 402, a random number generator 404, position RAM 406 and an acknowledgement receiver 408.
The board memory 402 stores information relating to the layout of board games such as Snakes and Ladders or Ludo. The random number generator is used to simulate dice, and is adapted to produce the numbers 1 , 2, 3, 4, 5 and 6 (or any other set of numbers appropriate to the game. The position RAM is used to store information regarding the position on the board of each of the players, in this case the controller and the three slaves. This information is used in conjunction with the board memory and the virtual dice roll to count the appropriate number of positions for the playing piece to move, and to know whether the square the playing piece has moved to has any special relevance, such as is it the bottom of a ladder or the top of a snake.
The conversation engine 204 utilises the information obtained from the games engine to count the number of spaces, for example if the original position was square 13, and the virtual dice roll produce a 4, then the doll would vocalise through the loud speaker 210, "I've rolled a 4, 14, 15, 16, 17". In this example if square 17 was the top of a snake then the doll would go on to vocalise, "oh no, I've slipped down a snake to square 6!". The counting mechanism cycles through the text the appropriate number of times, and then remembers the final position, within the position RAM 406. So, for example, when the virtual dice rolls a 4 the list of numbers is accessed 4 times to produce the end result.
Additionally, the doll has the ability to receive information from an external random number generator that is activated by the child. In this way the child can play with the dolls, and the doll can keep track of all of the player's playing pieces including the child to determine when there is a winner.
Figure 6 shows a flow diagram of the process of playing a game. The game is initiated by the user, step 500, and the controller doll will perform a check, step 502, to determine the number of players. The controller doll will then decide on the first player, step 504, using the random number generator or the like. The controller doll then rolls the virtual dice, step 506, for the first player, or if the child is the first player the controller doll asks the child to roll their dice. The controller doll then instructs the player to move the counter/playing piece, the corresponding number of squares on the board, step 508, and then waits for acknowledgement that the child has moved the counter, step 510. At step 512 the controller doll waits a pre-determined number of seconds, such as 2, 3, 5, or 8 seconds, before prompting the child for acknowledgment that the counter has been moved. Once the controller doll receives acknowledgement a check is performed, step 514, to determine whether the player has won the game. If the player has not won the game then the play proceeds to the next player, step 516, and the process continues from step 506 until a player wins, step 518.
The games engine is adapted to play any rule based game in the manner described above. Alternatively, the system could implement a conventional programming language, such as C, to run more complex algorithms to play more complex games such as chess. The same language as described above would be used to generate the conversations and would be referenced from the C program.
Such toys and dolls provide children with different opportunities for interaction, and enhance their play.
Theme examples
There are various examples of different methods of constructing a conversation. For example, it is possible to have randomly generated conversations, such as Zoo and Pet themes, a fully scripted (deterministic) conversation, or a game playing theme, such as to enable Snakes and Ladders to be played.
The unit's processor 102 is used in conjunction with the other modules, such as the speech compiler 206, the speech database 208, and the parameter storage 216, to interpret the script within the themes. For example, when a variable is defined memory is allocated within the parameter storage. Each time the conversation is initiated the variables are allocated within the parameter storage. This enables the theme to be changed, i.e. from Zoo to Pets, and for the new variables to be allocated the appropriate memory resources without conflicting with the variables from a previous conversation. Furthermore, the parameters such as PREV, NEXT, and ME are also allocated memory within the parameter storage. This enables the SELECT statement to reference the parameter within the script.
When the SAY statement is used either the controller doll uses the communication protocol described above to transmit the command to the relevant doll using the wireless module and transmitter, or if the controller doll is the current speaker the controller doll's relevant modules are utilised. The Speech compiler 206 within the doll required to speak is utilised to access the appropriate audio file within the Speech database 208. For example, the first line with a SAY statement within the Zoo theme is "SAY (i think we've seen everything now,p03,lets go home)". This statement consists of three references to audio files within the Speech database. Those references are "i think we've seen everything now"; "pO3"; and "lets go home". They all refer to audio files but the "pO3" reference refers to a pause of a specific length. The pauses are blank audio files used to space the audio files appropriately. The Speech compiler 206 then uses the loud speaker 210 to play the audio files. In each case the processor interprets the code and utilises the appropriate module to execute the statement.
In an alternative embodiment, as described herein, the processor does not use an in-built interpreter, but instead each theme consists of a binary data file that includes all of the processor control instructions to enable the processor to function correctly. This effectively enables the firmware of the processor to be updated with new features whenever required. The theme examples provided below can all be generated using the authoring tool. However, the instructions to control the toys/dolls would be a binary file of compiled "C" code. Processor and associated electronics
Figure 8 shows the schematic of a circuit diagram and parts list for a potential production version of the schematic diagram shown in Figures 2 and 3 - Appendix Il details the components within Figure 8. Figure 9 shows the schematic of an alternative circuit diagram - Appendix III details the components within Figure 9. There are alternatives that could have been included in the production circuit, and these are discussed later.
The circuit includes:
• The Jennie wireless controller The production circuit uses the Jennie IC, contains the RF circuitry, and combines the firmware and data in to a single large Flash memory IC. The Jennie wireless controller can use the Zigbee wireless communications protocol for example to communicate between the dolls.
• The battery charger
The production circuit uses a part that is specifically designed to charge from the USB port and also power a circuit whilst charging.
• The Audio amplifier
The audio amplifier on the production circuit is a class-D audio amp. This is very efficient (-80%).
Technical Options This section discusses possible alternatives that have not been included in the production circuit in Figure 8.
• USB interface FTDI FT245RQ
This component was chosen primarily as it a ready-to-use IC complete with USB driver software, reducing development effort. Its main disadvantage is that it uses most of the DIOx lines on the Jennie. Although this is not an issue with the current design, if DIOx lines are needed for other options, e.g. speech compression IC, then this part would be unsuitable.
Alternative embodiments Both the alternatives below are 8-bit microcontroller ICs with built-in USB and SPI slave interfaces. They both need to have firmware and software drivers developed to make them functional, although both manufacturers provide reference designs, application notes etc to aid in this process. The advantage of these parts are that they can interface with the Jennie SPI interface, and only need 1 DIOx line, freeing up the other DIOx lines for other uses.
The toy does not have complex USB requirements; the only requirement is to download data to be programmed in to Flash memory. The device does not need to conform to any generic device functionality, e.g. memory sticks. This reduces the development effort required.
The parts identified below were chosen as they are targeted at simple low-power embedded applications and have an SPI slave interface. However, other devices from the manufacturers' families or from other manufacturers may well be equally suitable.
Cypress CY7C63833-LFXC
Atmel AT90USB82-16MU Battery
Lithium-Ion
The circuits shown in Figures 8 and 9 use a Lithium-Ion (Li+) battery. The Li+ battery was chosen for 3 reasons: i) Shape - it is available in a flat prismatic package that was convenient for the demonstrator project, ii) Ease of development - Li+ charging requirements are simpler than the alternatives, especially when the charger has to power an additional circuit at the same time, iii) Power capacity - a conservative estimate of power requirements at the start of the demonstrator project suggested that only Li technology would give enough power in the small space available. (See later).
Alternative rechargeable technologies are NiMH and NiCad. NiMH has similar charging requirements to NiCad (more complex than Li+), but has similar (higher) power density (holds more power for a given physical volume) and price to that of Li+.
NiCad / NiMH
The characteristics of NiCad / NiMH batteries compared to Li+ will be considered in this section. For simplicity, read NiMH for NiCad in the sections below.
i) Shape
NiCad batteries usually come in standard sizes such as AA, and AAA, although other shapes are available. In a production environment where smaller components can be used, and where the cost of manufacturing more complex PCBs, such as two pieces and/or flexible circuits/connectors may not be inhibitive, the use of standard size batteries may be possible.
H) Ease of development
The circuit must be powered up (from the USB port) at the same time as the battery is charging (from the USB port), so that it can download new data. (The battery cannot simultaneously be charged and power the circuit.) It is possible to either isolate the circuit from the battery during charging or leave the circuit connected. Isolating the battery involves more complex circuitry. Leaving the circuit connected means that the charger sees both the normal current to the battery that it is controlling and the extra current our circuit takes.
Leaving the circuit connected for Li+ battery chargers is not so critical. The main disadvantage is that it is normal to switch off the charger once the Li+ battery is fully charged. This function has to be inhibited otherwise our circuit would be switched off as well. The result is a shorter lifetime for the battery.
Leaving the circuit connected for NiCad battery chargers is critical. NiCad batteries have a more complex charging profile, especially towards the end of charging. If this profile is not detected correctly, the battery is never fully charged, or the battery is overcharged resulting in damage to the battery and excessive temperature rises. Battery chargers use one of two methods to detect this profile. The first is by changes in current drawn by the battery. Unfortunately, the currents drawn by the present circuit will confuse the charger, resulting in potentially dangerous circumstances. The second method is by detecting changes in temperature of the battery. However, the battery charging components also get hot during normal use. In this application, it may be difficult to thermally isolate the battery enough to give reliable results.
Isolating the battery is the solution adopted by the circuit in Figure 8. The battery charger IC incorporates sophisticated power management circuitry and provides the isolation. This integrated power management is not available for NiCad technology in off-the-shelf products. So this would be implemented in discrete components or in a custom integrated IC.
iii) Power capacity A discussion of the power requirements on the doll electronics is given in this section. Battery lives used in this section are based on the following battery capacities:
• AAA Alkaline = 115OmAh @ 1.5V
• AAA NiCad = 30OmAh @ 1.2V
• AAA NiMH = 75OmAh @ 1.2V • Li+ prismatic = 62OmAh @ 3.7V
Note: The Li+ battery holds twice as much power for the same rating as the other batteries because its voltage is twice as large. Either two AAA batteries must be used in series, or a single AAA is used with a step-up converter and its capacity is halved.
Power estimates for circuit shown in Figure 9.
Estimated current consumption = 136mA when speaking, 48mA otherwise. This is made up from:
• Jennie module = 48mA
• Audio Driver:
25OmW max 8 ohm speaker power = 175mA, but in a conversation between 2 dolls each doll speaks for half the time => 88mA.
Note: It is unlikely that the speaker will be driven at maximum power the whole time, however the audio amp is not 100% efficient, so 88mA is a reasonable compromise.
• Rest of circuit = negligible
Battery lives based on Demonstrator estimates.
The single prismatic Li+ solution was the obvious choice for the demonstrator.
Power requirements of the circuit shown in Figure 8. As the audio power is the most significant factor in the overall power consumption, it is important to get a more precise value. The best method is a direct measurement, but this is only possible once the audio performance is finalised.
However, there are a number of factors that suggest the audio power will not be as great as the estimates:
• The characteristics of speech make the average power of a waveform a lot less than its peak amplitude. For instance, speech contains a lot of pauses. So it is likely that the circuit will drive at less than the maximum average power levels.
• The class-D amplifier used in the production circuit has much better efficiencies than the one in the circuit shown in Figure 9, resulting in a significant power saving.
More detailed calculations and analysis of the demonstration conversations suggest that the average audio power will be only 10mA whilst speaking, so for a conversation between 2 dolls gives and average of 5mA. This makes the Jennie power dominate giving a total of 53mA when speaking and 48mA when not.
Note: This audio power level is only for spoken voices, not music.
Battery lives based on improved estimates for audio power
There are ways to reduce the power consumption of the Jennie. Currently, the Jennie is on all the time, listening for messages continually. With a change in the firmware, and the way the dolls communicate with one another, only one doll (the first to be powered up) needs to be listening continually. The other dolls can check periodically with the first doll if they need to speak, and only need to be powered for this short time. The rest of the time the Jennie can be in low-power sleep mode. If a 10% duty cycle is achievable this would cut the power consumption by a factor of 10 when not speaking. When speaking, the Jennie needs to be powered, but it does not need to listen for messages, so the RF stage can be unpowered. This reduces the Jennie power consumption by a factor of 4. Thus it may be possible to reduce the overall current consumption to 14mA when speaking and 4mA when not.
Although the most dolls would have this reduced power requirement, one doll (the first to be switched on) would not have this power saving. With a change in the way the dolls are activated it may be possible to reduce this as well. Further investigations are needed to determine what is feasible.
Battery lives based on reduced Jennie power requirement
If these power requirements can be achieved then the use of dual AAA standard, NiCad or NiMH batteries becomes possible.
Automatic Power-off function
The current specification for the doll electronics is that an ON-OFF switch controls the powering of the circuit. Unlike other toys, it is not obvious when the doll is switched on, as it sits passively waiting for a button to be pressed in any one of the active dolls. This means that it is highly likely that the dolls will be forgotten to be switched off. The result is that the next time (e.g. next day) the doll is played with the batteries will be dead.
It is possible for the circuit to switch itself in to a 'standby' mode, drawing very little current, but this has not been included in the current functional specification. When the electronics goes in to this standby mode and how it is re-activated has implications for the overall behaviour and performance of the doll.
Speech compression
Speech compression allows more audio data to be stored in the same amount of memory. The current designs do not contain any speech compression technology. The current designs use 8-bit 8kHz audio data that results in a data rate of 64k bps (bits per second), and uses a 64Mbit serial flash memory enabling about 1000 seconds (17 minutes) of audio data to be stored.
Speech compression can be used to drop this data rate to between 2kbps and δkbps, the higher compression the lower the audio quality. So at 8kbps a 4Mbit flash memory can hold about 500 seconds (8 Vz minutes) of audio data.
Compressed audio data requires decompression as it is played out. This can be done in software or dedicated hardware. A few options are given below.
Software decompression on Jennie controller This option has not been widely investigated. Firstly, the source code of suitable compression / decompression algorithms must be found, so that the algorithms can be ported on to the Jennie controller. Secondly, and analysis of processing power required by the algorithms and available on the Jennie controller must be done. Sensory lnc Speech Synthesis ICs
Sensory lnc has two microcontroller families. The SC-6x family has the pre-programmed SC-691 slave synthesiser. This has a 4-bit MCU interface that requires 9 DIOx lines to interface to the Jennie and can direct drive a 32-ohm speaker. The newer RSC-4x family does not have a pre- programmed slave synthesiser, and so requires custom firmware to be developed. It would interface to the Jennie with a 4-bit or 8-bit MCU interface (9 or 15 DOIx lines). However it has a more powerful processor (it can handle speech recognition algorithms), and can direct drive an 8-ohm speaker. Either of these parts could not be used with the USB FT245 chip, as the Jennie does not have enough DIOx lines for both. A slave SPI USB chip would be necessary (see USB section).
Using a speech synthesis microcontroller such as RSC-4x that has significant processing power suggests a possible alternative system architecture. Instead of the Jennie wireless microcontroller running the main doll algorithms, and using the synthesis microcontroller as a slave co-processor to simply decompress the audio, the synthesis microcontroller could run the main doll algorithms and use the wireless microcontroller as a slave co-processor for wireless communications. See the Wireless microcontroller section for further details.
Wireless microcontroller
The current design is based on the 2.4GHz IEEE 802.15.4 Personal-Area-Network communications standard. Wireless microcontroller products exist that contain the necessary RF hardware and firmware to take care of all low-level RF communications. Only the data in the communications needs to be defined by the doll application. The current design has selected the Jennie wireless microcontroller.
Although the IEEE 802.15.4 products take care of the low-level RF communications, there is one aspect that is not a good fit with the doll application. The IEEE 802.15.4 is based on a hierarchical structure of nodes, with many reduced function devices communicating with a full function device. The doll application has a peer-to-peer structure, where all devices are the same.
Other RF transceiver products that work in the same 2.4GHz or different ISM frequency bands are available. They contain all the necessary RF hardware, but do not impose a particular low-level protocol. These transceiver ICs work as a slave to either a general purpose microcontroller or dedicated microcontroller such as the RSC-4x speech synthesiser. Using these parts a proprietary peer-to-peer communications protocol could be developed.
Examples of RF transceivers are Tl CC2500 and Atmel ATA542x family. These parts potentially provide lower power consumption and lower unit costs than the Jennie IC.
It is of course to be understood that the invention is not intended to be restricted to the details of the above embodiments which are described by way of example only, and modifications of detail can be made within the scope of the invention.
Each feature disclosed in the description, and (where appropriate) the claims and drawings may be provided independently or in any appropriate combination. Appendix I - Example of formatted text file for import into the Authoring Tool
$Theme: MALL SCENARIO ONE
$Dolll: Hi - Thanks for coming!
$Doll2: Are you kidding - I'd never miss a trip to the mall with you guys!
$Doll3: Or a chance to check out the sales!
$Doll4: I've got all my spending money with me! $Doll3: This is gonna be super fun!
$Doll2: So what do we hit first - The department stores - Shoe sale or the cosmetic stand?
$Dolll: I don't mind but I can't leave without buying a new glitter gloss.
$Doll4 : And I have to check out the new ribbon tie sandals at the shoe boutique!
$Dolll: They would totally go with your boot cut jeans.
$Doll4: Totally.
$Doll3: Oh and I need to check if that pussy bow dress comes in pink yet -
They only ever have blah blue ! $Dolll: Are you sure it's the dress you wanna check out?
$Doll2: And not the boy working on the coffee counter outside?
$Doll4: (Giggles) Totally!
$Dolll: (Gigglesl) .
$Doll2: (Giggles2) . $Doll3: No way - That's SO not happening - It's all about the dress!
$Doll4: Oh - You're so couture!
$Doll3: (Giggling) Totally!
$Doll2: So where shall we start?
$Dolll: I say hit the second floor department store and work our way back to the shoe boutique .
$Doll4: And make sure we hit the purse stall.
$Doll2: And the Bling Box.
$Doll3: Ooh - And the nail bar!
$Dolll: I think I'm gonna need a smoothie before all that! $Doll2: Great idea - Let's split a raspberry crush.
$Doll3: No - Orange cream!
$Doll4: Peppermint delight?
$Doll2: Maybe we should just get our own - We don't have to share everything.
$Dolll: And let's decide when we get to the smoothie lounge - or we'll never get started!
$Doll3: Cool!
$Dolll: So what are we waiting for?
$Doll2: Let's roll!
$Doll4: Totally!
Appendix Il - Details of components relating to Figure 8
Appendix III - Details of components relating to Figure 9

Claims

Claims
1. A toy adapted to have an interaction with at least one other such toy, comprising: a processor and a memory coupled to said processor; wherein said processor comprises: means for generating an output signal representative of an action to be performed; and means for generating a trigger signal, for reception at at least one other such toy, to trigger said at least one other such toy to perform an action before the said toy has completed its own action.
2. A toy according to Claim 1 , wherein said trigger signal is generated at a pre-determined time interval after said toy has initiated its own action.
3. A toy according to Claim 1 or 2, wherein said trigger signal is generated at a pre-determined time interval before said toy has completed its own action.
4. A toy according to Claim 2 or 3, further comprising an input enabling a user to input a measure of said pre-determined time interval.
5. A toy according to Claim 2, 3 or 4, wherein said pre-determined time interval is less than 1 second or half or quarter of a second, and is preferably substantially 0 seconds.
6. A toy according to any of the preceding claims, wherein said action is at least one of: emitting sound, emitting light, and movement.
7. A toy according to any of the preceding claims, further comprising a wireless communication module adapted to wirelessly communicate with said at least one other such toy.
8. A toy according to Claim 7, wherein said wireless communication module transmits at least one of: the trigger signal; information relating to the interaction; and information relating to the toy.
9. A toy according to Claim 8, wherein said information relating to the interaction includes at least one of: the action output by the toy; the duration of the action; and the action for said at least one other toy to take.
10. A toy according to any of the preceding claims, wherein the memory is adapted to store a pre-determined interaction.
11. A toy according to any of the preceding claims, wherein said processor is adapted to determine said interaction pseudo-randomly.
12. A toy according to any of the preceding claims, wherein said toy is adapted to interact as if it were animate.
13. A toy according to any of the preceding claims, wherein said interaction is at least one of: a conversation, a vocal interaction, an inter-personal interaction, an educational interaction, playing music, and playing a game.
14. A toy according to Claim 13, wherein said toy is adapted to interact as a member in a group of such toys.
15. A toy according to Claim 14, wherein said group represents one of: a music band; a group of cars; or a group of military assets.
16. A toy according to Claim 14 or 15, wherein said trigger signal is used to synchronise the actions of the group.
17. A toy according to any of the preceding claims, further comprising means for receiving a trigger signal from another such toy, and using said trigger signal to determine a time to initiate an action.
18. A toy according to any of the preceding claims, wherein said toy is one of: a doll, a game board, a vehicle, and a military asset.
19. A computer readable memory, for use in a toy adapted to have an interaction with at least one other such toy, said memory containing a set of instructions comprising: code for generating an output signal representative of an action to be performed; and code for generating a trigger signal, for reception at at least one other such toy, to trigger said at least one other such toy to perform an action before the said toy has completed its own action.
20. A computer readable memory according to Claim 19, wherein said memory further comprises code for generating said trigger signal at a pre-determined time interval after said toy has initiated its own action.
21. A computer readable memory according to Claim 19 or 20, wherein said memory further comprises code for generating said trigger signal at a pre-determined time interval before said toy has completed its own action.
22. A computer readable memory according to Claim 20 or 21 , wherein said memory further comprises code for enabling a user to input a measure of said pre-determined time interval.
23. A computer readable memory according to Claim 20, 21 or 22, wherein said pre-determined time interval is less than 1 second or half or quarter of a second, and is preferably substantially 0 seconds.
24. A computer readable memory according to any of Claims 19 to 23, wherein said action is at least one of: emitting sound, emitting light, and movement.
25. An authoring tool for creating themed data for toys, comprising: means for receiving content relating to a particular theme; means for processing said content to generate a set of instructions for operating said toy within said particular theme; and means for outputting said set of instructions.
26. An authoring tool according to Claim 25, wherein said receiving means is adapted to receive content that comprises separately both scripting data relating to the particular theme, and expression data defining the personality of said toy.
27. An authoring tool according to Claim 26, wherein said receiving means is adapted to receive content in discrete portions.
28. An authoring tool according to Claim 27, further comprising means for allocating a unique ID number to each expression data portion.
29. An authoring tool according to Claim 28, wherein said processing means is adapted to utilise said unique ID numbers as references to said expression data portions in said set of instructions.
30. An authoring tool according to any of Claims 25 to 29, wherein said receiving means is adapted to receive, in one operation, content that comprises an entire theme, or a substantial part of a theme.
31. An authoring tool according to Claim 30, wherein said content is in the form of a pre- formatted file.
32. An authoring tool according to Claim 31 , wherein said pre-formatted file is a text file.
33. An authoring tool according to Claim 31 or 32, wherein said processing means generates said set of instructions using only the content of said pre-formatted file.
34. An authoring tool according to any of Claims 25 to 33, wherein said expression data comprises at least one of: a theme name, the toys' names and statements used by the toys to interact.
35. An authoring tool according to any of Claims 25 to 34, wherein said scripting data comprises at least one of: the number of toys that can interact within the theme, a method of interaction, theme related parameters, and toy related parameters.
36. An authoring tool according to Claim 35, wherein said toy related parameters include information relating to pre-defined rules for selecting the next toy to interact.
37. An authoring tool according to Claim 36, wherein said method of interaction comprises timing related parameters.
38. An authoring tool according to Claim 37, wherein said timing related parameters determine when the next toy interacts.
39. An authoring tool according to Claim 38, wherein said timing related parameters include at least one of: the time delay between the start of the current toy's interaction to the start of the next toy's interaction; and the time delay from the start of the next toy's interaction before the current toy's interaction ends.
40. An authoring tool according to any of Claims 25 to 39, further comprising means for receiving content relating to a game.
41. An authoring tool according to Claim 40, wherein said content relating to a game includes logic for enabling the game to be executed.
42. An authoring tool according to any of Claims 25 to 41 , further comprising means for storing together, in an array, said scripting data and expression data relating to a particular theme.
43. An authoring tool according to Claim 42, wherein said processing means is adapted to generate said set of instructions from said array.
44. An authoring tool according to any of Claims 25 to 43, wherein said processing means includes means for compiling at least one list comprising at least some of the expression data.
45. An authoring tool according to Claim 44, wherein said list compiling means is adapted to compile a respective list for each toy in said particular theme.
46. An authoring tool according to any of Claims 25 to 45, wherein the expression data is symbolic data.
47. An authoring tool according to Claim 46, further comprising recording means for recording enacted data versions of the symbolic data.
48. An authoring tool according to Claim 47, further comprising means for prompting an actor to generate the requisite portion of enacted data.
49. An authoring tool according to Claim 47 or 48, wherein said processor is adapted to generate a look-up table between the symbolic data and enacted data.
50. An authoring tool according to any of Claims 25 to 49, wherein said processing means is adapted to output the expression data.
51. An authoring tool according to Claim 50, wherein said processing means is further adapted to output the expression data and set of instructions separately.
52. An authoring tool according to any of Claims 25 to 51 wherein said processing means is adapted to generate a set of instructions that includes: a base set of instructions for controlling the basic functions of the toy; and a themed set of instructions for the base set of instructions to control the toy within the theme.
53. An authoring tool according to Claim 52, wherein said processor is adapted to combine said base set and said themed set of instructions together.
54. An authoring tool according to Claim 52 or 53, further comprising a compiler.
55. An authoring tool according to Claim 54, wherein said compiler is adapted to compile said base set and said themed set of instructions.
56. An authoring tool according to any of the preceding claims, wherein said processor includes a coding engine adapted to transform said set of instructions into computer readable code.
57. An authoring tool according to any of Claims 25 to 56, wherein the output of the authoring tool is adapted to be used in a conversation engine, wherein said conversation engine comprises: means for selecting a theme for the conversation; means for randomly choosing a starting point from a plurality of starting points; means for randomly choosing phrases based on variables; and means for randomly choosing the next speaker based on variables.
58. A user interface for an authoring tool for creating themed data for a toy, comprising: means for providing a user with a set of input windows, each window corresponding to the input of a particular sub-set of content relating to a theme; and means for initiating output of the themed data.
59. A user interface according to Claim 58, wherein said sub-sets of content include at least one of: theme related data, toy related data, and context related data.
60. A user interface according to Claim 59, wherein said context related data includes at least one of: statements used by the toys to interact, a method of interaction, theme related parameters, and toy related parameters.
61. A system for generating themed data for a toy, comprising: an authoring tool for accessing, creating and editing said themed data; and a server, comprising a database for storing said themed data; wherein the authoring tool is adapted to access the themed data via the internet.
62. A system according to Claim 61 , wherein said authoring tool is adapted to process the themed data into an array, and said database is adapted to store said themed data in said array.
63. A system according to Claim 62, wherein said authoring tool is an authoring tool according to any of Claims 25 to 57.
64. A system according to any of Claims 61 to 63, further comprising a user interface.
65. A system according to Claim 64, wherein said interface is an interface according to any of Claims 58 to 60.
66. A device for providing wireless communications between at least one toy and a computer, the toy being adapted to interact with at least one other such toy, comprising: a communication port for connecting the device to the computer; and means for establishing a network between the computer and the or each toy; wherein said device allows the computer to communicate with the or each toy as if it were another such toy.
67. A device according to Claim 66 wherein said device enables said computer to act as a virtual toy.
68. A device according to Claim 66 or 67, wherein said communication port is a USB communication port.
69. A device according to Claim 66, 67 or 68, wherein said network is wireless.
70. A system comprising: at least one toy adapted to interact with at least one other such toy; and at least one computer, each with a device according to any of Claims 66 to 69; wherein the combination of said computer and device acts as if it were a further such toy.
71. A system according to Claim 70, wherein said computer comprises a visual, and an audio output adapted to provide a virtual toy.
72. A system according to Claim 71 , wherein said virtual toy is an avatar.
EP09784524A 2008-07-18 2009-01-21 Interacting toys Withdrawn EP2341991A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
PCT/GB2008/002457 WO2009010760A2 (en) 2007-07-19 2008-07-18 Interacting toys
PCT/GB2009/000160 WO2010007336A1 (en) 2008-07-18 2009-01-21 Interacting toys

Publications (1)

Publication Number Publication Date
EP2341991A1 true EP2341991A1 (en) 2011-07-13

Family

ID=40651476

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09784524A Withdrawn EP2341991A1 (en) 2008-07-18 2009-01-21 Interacting toys

Country Status (3)

Country Link
EP (1) EP2341991A1 (en)
JP (2) JP5404781B2 (en)
WO (1) WO2010007336A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0714148D0 (en) 2007-07-19 2007-08-29 Lipman Steven interacting toys
WO2012142936A1 (en) * 2011-04-19 2012-10-26 玩具概念有限公司 Electronic interactive toy device
CN102881198A (en) * 2011-09-15 2013-01-16 徐菲 Interaction train learning machine toy device and method
CN102836549B (en) * 2011-06-24 2014-12-31 徐菲 Electronic interactive toy (shooting toy) device and method
CN102836548A (en) * 2011-06-24 2012-12-26 徐菲 Electronic interactive toy (merry-go-round) device and method
CN102799155B (en) * 2012-07-27 2014-08-20 宁波华亿第三极科技有限公司 Game equipment intelligent control system and control method thereof
GB2511479A (en) * 2012-12-17 2014-09-10 Librae Ltd Interacting toys
CA2957265C (en) * 2014-08-15 2022-05-17 Vtech Electronics, Ltd. Electronic toy with radial independent connector and associated communication protocol

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5746602A (en) * 1996-02-27 1998-05-05 Kikinis; Dan PC peripheral interactive doll
JPH09281985A (en) * 1996-04-11 1997-10-31 Kirindou:Kk Speech generator capable of making conversation maintaining matching property
JP3179370B2 (en) * 1997-06-25 2001-06-25 神戸日本電気ソフトウェア株式会社 Talking parrot utterance device
JP2000135384A (en) * 1998-10-30 2000-05-16 Fujitsu Ltd Information processing device and animal-mimicking apparatus
WO2000066239A1 (en) * 1999-04-30 2000-11-09 Sony Corporation Electronic pet system, network system, robot, and storage medium
JP4337167B2 (en) * 1999-05-31 2009-09-30 ソニー株式会社 Information incoming notification device, information transmission method, and information incoming notification system
JP2002063505A (en) * 2000-08-16 2002-02-28 Nippon Telegr & Teleph Corp <Ntt> Information distributing method, information distribution center device, information distributing terminal device, and character figure
JP4670136B2 (en) * 2000-10-11 2011-04-13 ソニー株式会社 Authoring system, authoring method, and storage medium
JP2002307354A (en) * 2000-11-07 2002-10-23 Sega Toys:Kk Electronic toy
JP2002259376A (en) * 2001-02-28 2002-09-13 Vivarium Inc Natural language generating system for electronic pet
JP2002292154A (en) * 2001-03-30 2002-10-08 Bandai Co Ltd Moving body control system
JP2002337079A (en) * 2001-05-11 2002-11-26 Sony Corp Device/method for processing information, recording medium and program
JP2003205483A (en) * 2001-11-07 2003-07-22 Sony Corp Robot system and control method for robot device
US7252572B2 (en) * 2003-05-12 2007-08-07 Stupid Fun Club, Llc Figurines having interactive communication
US20050157668A1 (en) * 2003-12-24 2005-07-21 Michael Sivan Wireless remote control and data transfer system
GB2425490A (en) * 2005-04-26 2006-11-01 Steven Lipman Wireless communication toy
EP1885466B8 (en) * 2005-04-26 2016-01-13 Muscae Limited Toys
GB0714148D0 (en) * 2007-07-19 2007-08-29 Lipman Steven interacting toys

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2010007336A1 *

Also Published As

Publication number Publication date
JP2014028284A (en) 2014-02-13
JP5404781B2 (en) 2014-02-05
WO2010007336A1 (en) 2010-01-21
JP2011528246A (en) 2011-11-17

Similar Documents

Publication Publication Date Title
US8827761B2 (en) Interacting toys
EP2341991A1 (en) Interacting toys
CN101208141B (en) Toy
US8324492B2 (en) Musically interacting devices
JP6086601B2 (en) Immersive storytelling environment
US20130059284A1 (en) Interactive electronic toy and learning device system
JP2011528246A5 (en)
US10643482B2 (en) Fill-in-the-blank audio-story engine
US20110070935A1 (en) Traveling virtual pet game system
EP1569129A1 (en) Dialogue control device and method, and robot device
US20140170929A1 (en) Interacting toys
WO2008042671A2 (en) Interactive toy system
US20140206253A1 (en) Method and apparatus for interactive play
Angulo et al. Aibo jukeBox–A robot dance interactive experience
JP2003305677A (en) Robot device, robot control method, recording medium and program
TWI412393B (en) Robot
EP1885466A2 (en) Toys
JP2004195636A (en) Interaction control device and method and robot device
WO2003007273A2 (en) Seemingly teachable toys

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110218

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA RS

DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1153974

Country of ref document: HK

17Q First examination report despatched

Effective date: 20151209

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20160621

REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1153974

Country of ref document: HK