WO2016032835A1 - Interactive smart doll - Google Patents

Interactive smart doll

Info

Publication number
WO2016032835A1
WO2016032835A1 PCT/US2015/046023 US2015046023W WO2016032835A1 WO 2016032835 A1 WO2016032835 A1 WO 2016032835A1 US 2015046023 W US2015046023 W US 2015046023W WO 2016032835 A1 WO2016032835 A1 WO 2016032835A1
Authority
WO
Grant status
Application
Patent type
Prior art keywords
doll
microcontroller
interactive
instructions
child
Prior art date
Application number
PCT/US2015/046023
Other languages
French (fr)
Inventor
Jaroslaw KROLEWSKI
Dominik Nowak
Alina GROBLICKA
Radoslaw JAREMA
Original Assignee
Krolewski Jaroslaw
Dominik Nowak
Groblicka Alina
Jarema Radoslaw
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63HTOYS, e.g. TOPS, DOLLS, HOOPS, BUILDING BLOCKS
    • A63H30/00Remote-control arrangements specially adapted for toys, e.g. for toy vehicles
    • A63H30/02Electrical arrangements
    • A63H30/04Electrical arrangements using wireless transmission
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63HTOYS, e.g. TOPS, DOLLS, HOOPS, BUILDING BLOCKS
    • A63H3/00Dolls
    • A63H3/28Arrangements of sound-producing means in dolls; Means in dolls for producing sounds
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63HTOYS, e.g. TOPS, DOLLS, HOOPS, BUILDING BLOCKS
    • A63H2200/00Computerized interactive toys, e.g. dolls

Abstract

An interactive child's doll may include: an electronic circuit housed in a body, the electronic circuit including a microcontroller, a motion/position/orientation determining module coupled to the microcontroller, a sensor module coupled to the microcontroller for providing data related to the environment in which the body is located, a sound generating module coupled to the microcontroller for generating audio signals for interacting with the child, a memory module coupled to the microcontroller for storing instructions and data received from the wireless device and for storing preprogrammed instructions and data for controlling interactivity with the wireless device, and a power supply for providing power to the electronic circuit. A wireless remote control device that commands and interacts with the doll and may receive wirelessly instructions for commanding the interactive doll is also described.

Description

INTERACTIVE SMART DOLL

CROSS-REFERENCE TO RELATED APPLICATION

[0001] The present non-provisional patent application claims the benefit of priority from U.S. Provisional Patent Application No. 62/043,099, filed August 28, 2014, and U.S Patent Application 14/830,1 15, filed August 19, 2015 the entire contents of both applications being incorporated herein by reference.

BACKGROUND

Field of the Disclosure

[0002] The present invention relates to the field of interactive smart dolls and to smartphones with applications and remote controllers that interact therewith.

Related Art

[0003] Children have been playing with dolls for a very long time. Interactive toys, remote controlled dolls and the like are well known. A toy or other plaything may stimulate a child's imagination and an interactive toy can enhance the child's experience. A doll that interacts with a child and can initiate interaction, and can be controlled through a smartphone or other remote control device would provide a more engaging experience for the child or user.

SUMMARY OF THE INVENTION

[0004] The present disclosure describes an interactive smart doll that can interact with a child or adult via a wireless device such as a smartphone or remote control device and that includes an on-board microprocessor controller that receives wireless commands that enable the doll to interact with the child and/or adult. The interactive doll may be shaped and have the appearance of a toy or stuffed animal that includes a control module with an integrated chip that can communicate via Bluetooth, including BLE (Bluetooth Low Energy), Wi-Fi or the like, and can interact with children or adults using speakers and sensors that are on board or that are communicatively linked so as to be attractive to children and adults.

[0005] The doll includes sensors and controls for determining its position/orientation and temperature and peripheral interactive devices such as audio transducers and servo/motor devices to enable interaction with the child/adult.

[0006] Disclosed are an interactive doll, a non-transitory computer or processor- readable medium that controls the doll, a system that may include the doll and a wireless remote control device, a method and means for performing the method that provide the features described herein. Such an interactive child's doll may include:

[0007] a body;

[0008] an electronic circuit housed in the body, the electronic circuit comprising: [0009] a microcontroller;

[0010] a motion/position/orientation determining module coupled to the

microcontroller;

[0011] a wireless receiving and transmitting module coupled to the microcontroller for providing data and instructions to the microcontroller received from a remote wireless device and for transmitting data and instructions to the remote wireless device;

[0012] a sensor module coupled to the microcontroller for providing data related to the environment in which the body is located;

[0013] a sound generating module coupled to the microcontroller for generating audio signals for interacting with the child; [0014] a memory module coupled to the microcontroller for storing instructions and data received from the wireless device and for storing preprogrammed instructions and data for controlling interactivity with the wireless device; and

[0015] a power supply for providing power to the electronic circuit.

[0016] A wireless remote control device is also contemplated in combination with the interactive doll. Such a wireless remote control device may be a mobile device that includes a memory incorporating instructions for commanding the interactive doll.

[0017] Also contemplated is a system that includes the interactive doll and a mobile device that receives wirelessly instructions for commanding the interactive doll.

[0018] In such an interactive doll, the sensor module may include a temperature sensor for sensing the temperature of the doll's environment.

[0019] In such an interactive doll, the sound generating module may include one or more speakers positioned in or at the body of the doll.

[0020] Such an interactive doll may also include motor controls and servos for moving parts of the doll body.

BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The invention will be described in greater detail in the following detailed description with reference to the drawings, in which:

[0022] Fig. 1 shows an example of an on-board controller in the doll;

[0023] Fig. 2 shows an example of an operating environment;

[0024] Fig. 3 shows an example of an on-board microcontroller circuit;

[0025] Fig. 4 shows an example of a wireless component, specifically a Bluetooth controller; [0026] Fig. 5 shows an example of a memory card and connection, specifically an SD card:

[0027] Fig. 6 shows an example of a power supply circuit for the on-board controller;

[0028] Fig. 7 shows an example of a motion processing unit circuit;

[0029] Fig. 8 shows an example of a temperature sensing circuit; and

[0030] Fig. 9 shows an example of an audio circuit.

[0031] Other features and advantages of the present invention will become apparent from the following description of the invention that refers to the accompanying drawings.

DETAILED DESCRIPTION OF THE EMBODIMENTS

[0032] As illustrated in Figure 2, doll 21 can interact with a child if the child uses a wireless mobile device 23, which may be a smartphone, mobile or cordless phone or other handheld device, a tablet, a desktop, laptop computer or via other types of processor-based device or other types of electronic communication device or system. Instead or in addition, a user can use a dedicated wireless remote control device 24 (which may also be a universal remote control device). An application (App) for controlling interactive doll 21 may be downloaded by user to mobile device 23.

[0033] For example, the proximity of the child holding the mobile device 23 or remote control device 24 may be detected and when the mobile device 23 or remote controller 24 is. within range of Bluetooth communication of doll 21, or is within a pre-specified distance of interactive doll 21, the doll can greet the child. The greeting may specify the child's name, using previously provided programming identifying the user of mobile device 23 or remote controller 24, and can include a greeting suitable for the time of day, such as "good morning," "good evening" or the like or for the time of year, such as "Merry Christmas" or the like, since the application in mobile device 23 or

microcontroller inside interactive doll 21 can know the time of day and the dates on the calendar. A Bluetooth low energy module can be in mobile device 23 and in the doll to allow wireless sharing of information. A controller card inside interactive doll 21 can generate signals to produce sound waves provided ,to a speaker. One or more speakers can be provided inside interactive doll 21 , and/or one or more speakers can be used inside of mobile device 23. As an alternative, speakers in the vicinity around the house may also be controlled, or some combination of speakers as described in the foregoing may be controlled and provided with signals to generate the desired speech, music, alarm or other sounds..

[0034] When a certain time of the day is reached, interactive doll 21 can announce to the child that it is time to go to sleep. For example, the child can be told "Let's go to sleep" and this and similar messages can be repeated until a sensor detects that interactive doll 21 is in, or substantially in, a horizontal position. Similarly, interactive doll 21 can prod the child to get up with pleasant pre-recorded messages, music, chime, or the like, and such messages can be repeated until the sensor detects that doll 21 is in the vertical position or in a position close to the vertical position.

[0035] Mobile device 23 can also communicate with interactive doll 21 via wireless router 26 connected via modem 27 and the cloud to and on premises or off premises server 31. Also, mobile device 23 can communicate with doll 21 using a cellular telephone link via cell tower 35 connected via cell network internet gateway 36 to the cloud and to server 31.

[0036] Optionally, server 31 may store information about each user, and each interactive doll, such as last known position of doll, last known orientation of doll, user preferences for greetings, names of child and parents, parental controls for emergency alarms, user programming and settings for the doll, payment and subscription information for app downloads and for doll use, last time user communicated with doll, last time app was downloaded, and so forth.

[0037] As discussed, remote control 24 may communicate directly with interactive doll 21 via Bluetooth or other radiofrequencies or via an infrared link. A microcontroller may be included in doll 21 and may be connected to a speaker either on board doll 21 or wirelessly in the surrounding environment. Sound data can be processed from files written on SD cards positioned in interactive doll 21 or in mobile device 23. As a child or the person holding remote control 24 or holding mobile device 23 configured with the application approaches the doll, the doll can greet with "Good Morning" or some other greeting, and can customize the greeting to the child's name if the doll is programmed. For example, the BLE module in mobile device 23 and inside interactive doll 21 can allow passing of information about who is coming near interactive doll 21, and how far the person is from interactive doll 21.

[0038] At a certain time of the day, the doll can remind the child of a task to be performed, such as brushing teeth or going to sleep with an appropriate greeting, that may include the child's name. For example, a motion processing unit module 9DOF-IMU 34 available from InvenSense, Inc. that includes a 3 axis gyroscope, 3 axis accelerometer, 3 axis magnetometer and digital motion processor may be used. As shown in Fig. 1, the accelerometer can detect motion and directional orientation of the doll, and thus can know whether the doll is standing up or sitting down. Via the magnetometer, the doll can recognize spatial orientation, such as north, south, east or west, as well as latitude and longitude. A GPS device may also be included in interactive doll 21 or in mobile device 23 or in a device in communication with the foregoing. This may provide a tracking feature for interactive doll 21 and/or mobile device 23 and/or remote control 24 to enhance safety and to support other features.

[0039] Interactive doll 21 may include a temperature sensor. A temperature sensor may be included in interactive doll 21, or such information may be received by interactive doll 21 or by mobile device 23 with suitable application. When it is hot or cold, the doll may be able to announce a warning to the child, including the temperature information, and advice about putting on or taking off clothing. For example, a temperature sensor inside doll 21 or inside mobile device 23 may transmit using BLE such temperature information, and the doll can receive data by the current temperature and what text to say at the various temperatures. Alternatively, such information may be transmitted via WIFI 26 and modem 27 through cloud to server 31. Server 31 may store user preferences for various temperatures, e.g. prompt child to put on long sleeve shirt when temperature dips below 68 degrees Fahrenheit, and prompt child to put on sweater when temperature reaches below 60 degrees Fahrenheit, such settings being default or being set by parents in advance via mobile device 23.

[0040] Using mobile device 23, parents can send a text message if they want the child to be advised of something, such as "You did a great job today" or "Peter, you were awesome today." An application on mobile device 23 canJhave_an_areaJbr text to be transmitted. The text can be typed by the parent into mobile device 23 and sent as an audio file with for example extension ".wav." This file can be created by text-to-speech program, such as IVONA, and then can be sent via BLE (or any other radio-link) to the SD card in interactive doll 21. When the transmission is received, interactive doll 21 can retrieve the sound file. Alternatively, the text can be sent as text to interactive doll 21 for decoding into sound files by interactive doll 21. The latter may be a faster transmission but require more processing by microcontroller in interactive doll 21.

[0041] ' At certain times of the day, interactive doll 21 can generate reminders about activities or can announce a previously provided text. For example, on child's birthday, the, interactive doll 21 can say "Happy Birthday, Liliana!" or before bedtime can inquire of the child whether the child brushed her teeth. With a real-time clock module, interactive doll 21 may replace certain sounds stored as sound files in interactive doll 21. Actual time may be synchronized with mobile device 23. For example, messages can be programmed using mobile device 23, and sent as a sound file or in some other way to interactive doll 21, where they can be stored for later use. Many of the settings of interactive doll 21 can be programmed using the application provided on mobile device 23.

[0042] Instead of or in addition to mobile device 23, remote control 24, necklace or band worn on a body may include a BLE module or other microcontroller. For example, a child may wear as an accessory such a band to allow interactive doll 21 to recognize when the child is nearby, for example, within a previously set distance, or within range of Bluetooth. In such an arrangement, mobile device 23 used by the parents or other people in the household can be used to program interactive doll 21 , and to provide texts to be announced by interactive doll 21. In such a scenario, the child may not know where the text is coming from, i.e., the parents, family members, teachers, friends, etc.

Accordingly, birthday wishes, other information, prompts or directions can be sent by caregivers to interactive doll 21 for the child. A remote controller or band can have its own power source, such as a small battery.

[0043] Limbs, eyes, ears and mouth and the like of interactive doll 21 may also be controlled to move, extend, open, close and the like using servo-motor controls. Such motions can simulate or augment emotional responses as appropriate for various things interactive doll 21 is heard to "say" or as dictated by other circumstances, such as birthdays and the like.

[0044] By way of illustrative example, particular implementations will be described with respect to electronic devices inside interactive doll 21. However, it will be understood that many other implementations are also contemplated, and some of the features recited may be provided in mobile device 23 or in other devices with which mobile device 23 and/or interactive doll 21 is in communication.

[0045] Fig. 1 shows a microcontroller that may be provided inside interactive doll 21. Fig. 3 illustrates an example of a microcontroller, which may be an STM32F405XX or STM32F407XX type controller with an ARM 32 bit cortex, a memory, an LCD parallel interface, a clock, 140 ports, fifty or more communication interfaces and other components, available from ST Microelectronics.

[0046] Fig. 4 illustrates a Bluetooth low-energy (BLE) circuit, which, for example, may be a BLE 1 12 product available from Bluegiga, and may use Bluetooth version 4.0 or other versions. Ultra low current consumption may be implemented to prolong battery life, and a programmable 8051 processor may be used.

[0047] Fig. 5 illustrates a Micro SD card interface. [0048] Fig. 6 illustrates an example of a power supply circuit for the on board circuit. The power supply is illustratively four AA cells. An on-off switch SW2A is provided. The on-off switch controls the channels of two FETs T3 and T6. When on, FET T6 provides battery power to line VBAT. Two regulators are illustratively shown, one (U4) providing 3.3V DC and one (U4) providing 5V for the various on board circuits. A control line + 5 V ON is provided to turn on the +5V regulator via transistors T7 and T8. Transistor T5 and zener diode Dl provide over voltage protection. Illustratively, if VBAT exceeds 6.8V, transistor T6 is turned off via transistor T5. The regulators U2 and U4 may be type API 1 1 7 E50/AP1 1 17 E33, 5 V and 3.3V respectively.

[0049] Fig. 7 illustrates a motion sensor, which may be an MPU-9150-type product, available from InvenSense, Inc., which can include a gyroscope, an accelerometer, a magnetometer, motion processing, a clock and additional features.

[0050] Fig. 8 illustrates an example of a temperature sensor employing two digital thermometers that may be used. The digital thermometer may be type DS 18B20 available from Maxim Integrated. One or more temperature sensors may be used, for example, at' different parts of the body of interactive doll 21 for more accurate readings. For example, one side of interactive doll 21 may be exposed to direct sunlight and thus give an inaccurate reading. Such readings can be discounted or ignored.

[0051] Fig. 9 illustrates an audio circuit using a type TPA301 D audio amplifier IC available from Texas Instruments. It will be understood that other combinations and other implementations are also contemplated.

[0052] Disclosed is a device, a non-transitory computer or processor readable medium that stores instructions that provide the functionality described, a system and method that provide such functionality, and means for implementing such functionality. The present methods for controlling the interactive doll and its functions may be implemented using hardware, software, firmware or a combination of the foregoing, and may be implemented by one or more microcontroller and chips. The functions for the interactive doll eould be performed entirely automatically through automated operations, but need not be entirely performed by machines.

[0053] A computing device or chip as described herein for the interactive doll, the mobile device, and/or the remote control may include one or more processors located in one ;or more units for performing the system according to the present disclosure. One or more of these processors may be located away from the interactive doll and the mobile device, or may be off premises and communicate with the interactive doll and /or the mobile device via a radio or other wireless connection. Similarly, information stored, such as greeting information, name of the child, and the like, may be stored in a cloud or may be stored locally or remotely.

[0054] The application downloaded to the mobile device for controlling or for interacting with the interactive doll may include a GUI (Graphical User Interface), or may include graphics, text and other types of information. The interactive doll may also receive software and software updates for adding or improving functions, for example, from the mobile device or from a wireless router or the like. The mobile device and the interactive doll may include a memory, preferably a random access memory, and may include a secondary memory, and may be implemented using any appropriate storage medium. Examples of a memory or a computer-readable storage medium product include a removable memory chip, such as an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), removable storage unit or the like.

[0055] The communication interface may include a wired or wireless interface communieating over TCP/IP paradigm or other types of protocols, and may communicate via a wire, cable, fiber optics, a telephone line, a cellular link, an infrared link, a radio frequency link, such as WI-FI or Bluetooth, a LAN, a WAN, VPNy-the world wide web or other such communication channels and networks, or via a combination of the foregoing.

[0056] While the preferred embodiments of the invention have been illustrated and described, modifications and adaptations, and other combinations or arrangements of the structures and steps described come within the spirit and scope of the application and the claim scope.

Claims

WHAT IS CLAIMED IS:
1. An interactive child's doll comprising:
a body;
an electronic circuit housed in the body, the electronic circuit comprising:
a microcontroller;
a motion/position/orientation determining module coupled to the microcontroller; a wireless receiving and transmitting module coupled to the microcontroller for providing data and instructions to the microcontroller received from a remote wireless device and for transmitting data and instructions to the remote wireless device;
a sensor module coupled to the microcontroller for providing data related to the environment in which the body is located;
a sound generating module coupled to the microcontroller for generating audio signals for interacting with the child;
a memory module coupled to the microcontroller for storing instructions and data received from the wireless device and for storing preprogrammed instructions and data for controlling interactivity with the wireless device; and
a power supply for providing power to the electronic circuit.
2. The remote control wireless device in combination with the interactive doll of claim 1.
3. The interactive doll of claim 1 , wherein the remote control wireless device is a mobile device comprising a memory incorporating instructions for commanding the interactive doll.
4. A system including the interactive doll of claim ϊ , and a mobile device configured to receive wirelessly instructions for commanding the interactive doll.
5. The interactive doll of claim 1, wherein the sensor module comprises a temperature sensor for sensing the temperature of the doll's environment.
6. The interactive doll of claim 1 , wherein the sound generating module comprises a speaker disposed in the body of the doll.
7. The interactive doll of claim 1 , further comprising motor controls and servos for moving parts of the doll body.
PCT/US2015/046023 2014-08-28 2015-08-20 Interactive smart doll WO2016032835A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US201462043099 true 2014-08-28 2014-08-28
US62/043,099 2014-08-28
US14/830,115 2015-08-19
US14830115 US20160059142A1 (en) 2014-08-28 2015-08-19 Interactive smart doll

Publications (1)

Publication Number Publication Date
WO2016032835A1 true true WO2016032835A1 (en) 2016-03-03

Family

ID=55400358

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/046023 WO2016032835A1 (en) 2014-08-28 2015-08-20 Interactive smart doll

Country Status (2)

Country Link
US (1) US20160059142A1 (en)
WO (1) WO2016032835A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5851579B1 (en) * 2014-11-04 2016-02-03 摩豆創意科技股▲ふん▼有限公司 Method and apparatus of community activities centered on the toys
KR20180012561A (en) * 2016-07-27 2018-02-06 주식회사 네이블커뮤니케이션즈 Offline character doll control apparatus and method using user's emotion information

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002039739A1 (en) * 2000-11-08 2002-05-16 Koninklijke Philips Electronics N.V. Method and device for communicating a command
WO2011078796A1 (en) * 2009-12-21 2011-06-30 National University Of Singapore Tele-puppetry platform
RU2458722C2 (en) * 2009-03-13 2012-08-20 Евгений Николаевич Сметанин Wireless interactive toy with electronic control unit

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040198175A1 (en) * 2002-11-01 2004-10-07 Orrin Shively Consumer electronics device
US20140206289A1 (en) * 2011-06-10 2014-07-24 Aliphcom Data-capable band management in an integrated application and network communication data environment
US9814993B2 (en) * 2013-11-11 2017-11-14 Mera Software Services, Inc. Interactive toy plaything having wireless communication of interaction-related information with remote entities

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002039739A1 (en) * 2000-11-08 2002-05-16 Koninklijke Philips Electronics N.V. Method and device for communicating a command
RU2458722C2 (en) * 2009-03-13 2012-08-20 Евгений Николаевич Сметанин Wireless interactive toy with electronic control unit
WO2011078796A1 (en) * 2009-12-21 2011-06-30 National University Of Singapore Tele-puppetry platform

Also Published As

Publication number Publication date Type
US20160059142A1 (en) 2016-03-03 application

Similar Documents

Publication Publication Date Title
Saffran et al. The Infant's Auditory World: Hearing, Speech, and the Beginnings of Language.
US20090121894A1 (en) Magic wand
US20030124954A1 (en) Interactive toy system
US20120178431A1 (en) Proximity-Enabled Remote Control
Gárate et al. GENIO: an ambient intelligence application in home automation and entertainment environment
US20150334772A1 (en) Contextual information usage in systems that include accessory devices
US20100302032A1 (en) System and method to locate misplaced personal items
US20130143185A1 (en) Determining user emotional state
Strong GATHERING MUSIC, PRAYER, INVOCATION & MEDITATION
JP2002205291A (en) Leg type robot and movement control method for leg type robot, as well as recording medium
US20120295510A1 (en) Doll Companion Integrating Child Self-Directed Execution of Applications with Cell Phone Communication, Education, Entertainment, Alert and Monitoring Systems
CN104951077A (en) Man-machine interaction method and device based on artificial intelligence and terminal equipment
US20160147506A1 (en) Internet of things platforms, apparatuses, and methods
Clark An Education Programme for Psychotic Children
US20020072293A1 (en) Personal computer system having and operating an external animated doll device
US20150133025A1 (en) Interactive toy plaything having wireless communication of interaction-related information with remote entities
US20070217586A1 (en) Animatronic creatures that act as intermediaries between human users and a telephone system
US9173052B2 (en) Bluetooth low energy watch with event indicators and activation
Kumar et al. Android based smart home system with control via Bluetooth and internet connectivity
KR101281806B1 (en) Personal service robot
CN103079003A (en) Reminding method and reminding device for alarm clock of mobile terminal
US20150349556A1 (en) Mobile communication devices
US20060047362A1 (en) Dialogue control device and method, and robot device
CN103942938A (en) Intelligent interactive system provided with portable intelligent device as control center
US20150258301A1 (en) Sleep state management by selecting and presenting audio content

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15836288

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15836288

Country of ref document: EP

Kind code of ref document: A1