WO2018208243A1 - Plurally controllable automated robotic system for children - Google Patents

Plurally controllable automated robotic system for children Download PDF

Info

Publication number
WO2018208243A1
WO2018208243A1 PCT/TR2017/050183 TR2017050183W WO2018208243A1 WO 2018208243 A1 WO2018208243 A1 WO 2018208243A1 TR 2017050183 W TR2017050183 W TR 2017050183W WO 2018208243 A1 WO2018208243 A1 WO 2018208243A1
Authority
WO
WIPO (PCT)
Prior art keywords
robotic device
set forth
control panel
real
robotic
Prior art date
Application number
PCT/TR2017/050183
Other languages
French (fr)
Inventor
Sema OZGU
Mustafa KILIC
Original Assignee
Inovent Fikri Mulkiyet Haklari Yonetim Ticaret Ve Yatirim A.S.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inovent Fikri Mulkiyet Haklari Yonetim Ticaret Ve Yatirim A.S. filed Critical Inovent Fikri Mulkiyet Haklari Yonetim Ticaret Ve Yatirim A.S.
Priority to PCT/TR2017/050183 priority Critical patent/WO2018208243A1/en
Publication of WO2018208243A1 publication Critical patent/WO2018208243A1/en

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61JCONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J7/00Devices for administering medicines orally, e.g. spoons; Pill counting devices; Arrangements for time indication or reminder for taking medicine
    • A61J7/04Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers
    • A61J7/0409Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers with timers
    • A61J7/0454Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers with timers for dispensing of multiple drugs
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61JCONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J7/00Devices for administering medicines orally, e.g. spoons; Pill counting devices; Arrangements for time indication or reminder for taking medicine
    • A61J7/04Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers
    • A61J7/0409Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers with timers
    • A61J7/0481Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers with timers working on a schedule basis
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00Manipulators not otherwise provided for
    • B25J11/0005Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00Controls for manipulators
    • B25J13/006Controls for manipulators by means of a wireless system for controlling one or several manipulators
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00Controls for manipulators
    • B25J13/06Control stands, e.g. consoles, switchboards
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02Sensing devices
    • B25J19/021Optical sensing devices
    • B25J19/023Optical sensing devices including video camera means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J5/00Manipulators mounted on wheels or on carriages
    • B25J5/007Manipulators mounted on wheels or on carriages mounted on wheels
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61JCONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J2200/00General characteristics or adaptations
    • A61J2200/70Device provided with specific sensor or indicating means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61JCONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J2205/00General identification or selection means
    • A61J2205/20Colour codes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61JCONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J2205/00General identification or selection means
    • A61J2205/40General identification or selection means by shape or form, e.g. by using shape recognition
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control

Definitions

  • the present invention relates to a remotely controllable robotic device which could be controlled by parents and children simultaneously.
  • a robotic device can be a machine capable of performing a complex arrangement of activities automatically and executing tasks with speed and precision.
  • Robots can be controlled by an external control gadget or the control scheme might be internally programmed using a dedicated interface.
  • Such robotic devices can be developed to perform certain tasks in a physical design relation with the intended function, yet regardless of what they look like, many different types of robots with distinct forms may accomplish different tasks.
  • robotic devices may have a significant role in improving quality of life for certain people, more precisely as units providing assistance for disabled people or educational setups and applications such as in schools. Some of these robots particularly designed to interact with children may exhibit human-like features to provide more convenient and personal relation with children.
  • a robot can typically be remotely controlled by an operator, sometimes from very large distances.
  • a telechir is a complex robot remotely controlled by a human operator for a telepresence system that gives an individual the feeling of being on the ground in a dangerous environment and the ability to interact with the same. Telepresence robots that allow this kind of experience and some of the abilities one would have if physically present, can enable remote health care function, home surveillance and child care, including several other possibilities.
  • KR100814330 disclosing a robot system for providing learning aid and assisting a teacher is provided to offer a self-controlled and creative learning environment, assist a teacher and express a thought like a human being by having a chat with students while moving in a classroom.
  • a contents server storing various kinds of learning contents, a home PC communicating with a teacher at home through the Internet and a modem are placed in a remote location.
  • a classroom is equipped with a teacher PC enabling the teacher to control a mobile robot and the projection TV, the projection TV outputting various kinds of learning information in video/audio, the LAN (Local Area Network) connecting the contents server and the home PC to the teacher PC and an AP (Access Point) sharing device and the mobile robot.
  • the mobile robot assists the teacher by having a chat with students and expressing an opinion while moving in the classroom according to a control signal output from the teacher PC and a remote controller.
  • the AP sharing device transmits data between the mobile robot and the teacher PC, the contents server and the home PC to the mobile robot through the wireless network.
  • Primary object of the present invention is to provide a communication device in the form of a robotic device between parents and their children. Another object of the present invention is to provide a real-time controlled communication device as a robotic device between parents and their children in separate locations.
  • Another object of the present invention is to provide a real-time controlled communication device suitable for performing tasks programmed remotely in real-time by parents and adapted to provide in return real-time programmed movement or movement patterns as a communicational feed-back by children, therefore establishing a communication platform between parents and their children in separate locations. Further an object of the present invention is to provide real-time controlled gestures or movements carried out by the robotic device and transmit in return real-time audio or visual content to the remote parent(s).
  • Still further an object of the present invention is to transmit real-time audio or visual content in tracked mode by which the robotic device visually monitors the face or movements of the children.
  • an object of the present invention is to provide a daily assistance device to disabled people/children.
  • FIG. 1 demonstrates a general block diagram of a robot system's working structure layers according to the present invention.
  • Fig. 2 demonstrates a front view of a robot system according to the present invention.
  • Fig. 3 demonstrates a back view of a robot system according to the present invention.
  • the present invention provides a robotic device (1) that works in harmony with intervening commands by multiple controllers as in the case of a remotely located parent and children in the vicinity of the robotic system (1).
  • the functions of the robotic device (1) are for instance designed to allow use of social media in a safer and more useful manner, also enabling playing of games and performing educational tasks for children. For instance, as will be delineated in more detail hereinafter, children can play games using the robotic device (1) and also use the same for educational purposes.
  • a robotic device (1) according to the present invention can be conventionally controlled by means of a tablet or PC using a dedicated software interface, i.e. to control various physical functions (such as movements, audio and visual data acquiring/recording functions etc.) of the robotic device (1).
  • said dedicated software interface is provided with various tools such as social media connection, foreign language learning mode, mathematics learning mode, gaming options and programming modes.
  • the robotic device (1) is conventionally provided with a network interface card so that it can establish a remote Internet connection, for instance by connecting to a Wi-Fi network.
  • the tablet, PC or any type of controller environment is able to remotely transmit control data to the robotic device (1), including among other options to connect to the same LAN.
  • the robotic device (1) may for instance be configured to access predefined social media accounts in place of the child, can monitor and manage friendship or any interaction requests.
  • Any social media user activity by children can be subject to parental control in order to ensure the child's safety and clean social media use. Accordingly, a distant parent is priorly notified of social media activities real-time and parental control can be exercised to allow certain activities to take place. Therefore, the distant parent has remote access to the robotic device (1) by way of establishing a remote connection with the same.
  • the robotic device (1) can conventionally provide foreign language learning schemes with different preconfigured exercise selections depending on the age of the child. Simple foreign language teaching modes or communication examples/ patterns performed by the robotic device (1) will substantially contribute to language skills of the child.
  • the child can typically control the robotic system (1) through a tablet or a PC to accomplish the desired movements.
  • the robotic device (1) can be basically used as a communication tool to reach parents or the movement patterns as performed by the robotic device (1) can be relayed to the control interface of a parent, on the screen of which any movement performed by the robotic device (1) is recreated by the software interface.
  • bodily movements in the form of real-time controlled/programmed gestures or movements carried out by the robotic device (1) such as hand waving, moving around, activating certain lights (12), performing prerecorded actions etc. are communicated to the parent in the form of communicational information.
  • Main components of the robotic device (1) body parts are the arms (11). Arms (11) typically have a junction and simple finger structure to provide basic movement forms.
  • the robotic device (1) can capture a video record or record an audio session to transmit the same to the parent when activated. It is further possible to transmit real-time audio or visual content in tracked mode by which the robotic device (1) visually monitors the face or movements of the child.
  • preconfigured programs by the manufacturer or by children
  • programs can include any sequence of actions such as dancing (moving sideways), hand waving, playing preloaded audio records, voice recording, activating predefined lights etc.
  • the camera of the robotic device (1) is remotely accessible by the parents so that they will be able to connect to the device via any desired device such as a mobile phone or PC.
  • the parent When activating this function, the parent will be able to connect to a 360-degree camera (8) while at the same time controlling movements of the robotic device (1).
  • the 360-degree camera (8) can be an omnidirectional camera that is able to capture images from different angles in the room where the robotic device (1) is present. This feature substantially ensures safety of a child when he/she is not accompanied by an adult.
  • a programming mode can be provided by which the software interface will enable visual format programming in the form of inter-engaging program blocks and steps to increase the ability of children to create programming algorithms.
  • the code will be typically generated by the program at the background and will be sent to the robotic device (1). Children are able to share their programs with their friends via social media and these programs can be rated by their friend community.
  • Language selection part of the robotic device (1) is designed to cover a plurality of languages.
  • the system consists of several layers. Presence of any of these layers provides a conventional software system in control of the hardware. The layers and the communication scheme between layers can also be seen in Fig. 1.
  • administration interface layer can contain tablet/PC, smartphone or any other remote control unit interfaces and programs.
  • the programs provide access to specific settings of the robotic device (1), ensuring management and/or programming thereof.
  • the interface can be customized by the user.
  • the program is preferably designed as a web-based multi-device platform, providing that any control unit such as PC or smartphone can run the control program independent of the operating system.
  • the program can preferably be controlled in drag-and-drop and touch-enabled manner, or typically in more conventional ways with the mouse and keys as in the case of a desktop computer.
  • Parental control interface enables to control all the settings in relation to the robotic device (1).
  • Parent can remotely control and manage incoming friendship calls by other robotic devices (1) and set administrative and operational parameters of the robotic device (1).
  • the parental control interface can advantageously establish real-time connection to directly control the robotic device (1).
  • a special visual indication is generated on the robotic device (1), when the latter is remotely controlled, i.e. fulfills tasks not directly programmed or preprogrammed by the child.
  • a dedicated light (12) is continuously activated in blinking mode.
  • an audio indication in the form of a predetermined sound sequence can be generated in real-time remote control mode.
  • the robotic device (1) is simultaneously controlled by at least two remote control panels (first control panel (2) and second control panel (3)), such control panels being smartphones, tablets, computers etc. Therefore, the two control panels securely establish a remote connection to access the robotic device (1), which simultaneously process commands from both control panels.
  • the robotic device (1) detects the received commands from both control panels and performs the specified functions in predetermined modes. Once the robotic device (1) is turned on, it connects to the predetermined network and starts broadcasting. Once a connection is available to the first or second control panel (2, 3), the robotic device (1) starts listening to detect any program commands from any of the control panels.
  • the robotic device (1) may establish a simultaneous second network connection used to connect to the internet backbone. When the parent adjusts and saves operational settings for the robotic device (1), then the robotic device (1) can also fulfills any tasks programmed by the child.
  • the robotic device (1) can have access to a preconfigured social media account to make friends and interact with other social media users also in possession of similar robotic devices (1). Any user can conventionally send text messages to another user.
  • a message is received by the robotic device (1), a respective visual indication is generated and a light (12) starts to blink.
  • the light (12) can be programmed for different events.
  • a head display (4) is provided to display different screen images.
  • the head display (4) is an auxiliary display tool in addition to the remote control panel screen in programming mode. Otherwise, the head display (4) can be used as a conventional video display screen by which children can watch videos thereon. For instance a live video connection can be established with the parents and a parent can be directly viewed on the head display (4).
  • the robotic device (1) is also provided with embedded speakers.
  • One of the sensors in the front side of robotic device (1) works as a touch sensor (7). Touch sensor (7) can be triggered easily by the children so that active or passive status of the touch sensor (7) can determine behavior of the robotic device (1) during different programming scenarios.
  • the robotic device (1) of the invention is also provided with a plurality of color indicators other than the light (12), these color indicators can be used to light up in different colors and children can change the color of any of the color indicators in a color indicator array.
  • the color and/or blinking or continuous mode of any color indicator can also depend on a current specific behavior/function of the robotic device (1) during different programming scenarios.
  • the brightness level of the color indicators can be adjusted.
  • color indicators can be created during different operational modes.
  • a so-called light cycle mode can be activated during real-time motion control during which preselected lights in the color indicators are sequentially turned on and off to create a moving/rotating light effect.
  • Another mode can be rainbow mode in which, the lights are in motion in rainbow colors.
  • a front sensor (5) in the form of a proximity sensor is provided in the front side of the robotic device (1).
  • the front sensor (5) senses a nearby object in a distance of 5 cm to 10 cm. In this way, the robotic device (1) can avoid crashes in real-time control mode.
  • the robotic device (1) can be used to reach predetermined objects or locations in the house. This is particularly advantageous in assisting disabled people and particularly people with impaired vision.
  • the robotic device (1) can be programmed to automatically guide a disabled person with audio indications to accompany him/her to a certain location in the house (dining room or kitchen) or near a predetermined object (such as smartphone or a handbag).
  • a location identification module such as a Bluetooth tracking device adhered to a non-electronic device such as a handbag broadcasting its location can be used to find location of the item in an advantageous manner.
  • At least one microphone is provided on the robotic device (1).
  • the robotic device (1) is preconfigured to recognize certain preloaded voice patterns. For instance, the robotic device (1) is responsive to a situation where the child starts crying. This automatically activates a night lamp during night time and sends a predefined warning message to the control panel of the parent. Distinguishing crying voice from other environmental sounds can be effected based on the volume and frequency threshold of the received voice.
  • conventional speech recognition algorithms can be used to activate voice activity detection so that parents can be informed if certain keywords are identified in a given conversation. This is particularly advantageous if the child tells that he/she feels sick, feels ill, his/her stomach hurts, he/she has a fever etc.
  • the robotic device (1) can be auto-programmed to optically classify a plurality of pills to timely give a number of predetermined pills according to a dosing schedule to a patient.
  • the robotic device (1) is provided with an internal storage where a plurality of different pills are stored and a number of predetermined pills are selected and separated from other pills according to their forms and colors analyzed by an optical sensor.
  • a storage inlet (9) located at the rear side of the robotic device (1) is used.
  • the internal storage has specifically allocated vertical tubular portions, each tube storing pills of the same medication.
  • each tube contains pills with different sizes and shapes in a vertically arranged manner.
  • a given pill with a certain shape and color in a certain tube is releasable on an individual basis.
  • Selected pills from the tubular containers are then stored in an intermediate storage room for size and color analysis by said optical sensor according to the predefined dosing schedule.
  • selected pills drop to a storage outlet (10) from where the patient can take the medication.
  • the robotic device (1) is provided with an additional bottom sensor (6) that can detect and avoid obstacles particularly when assisting disabled people and particularly people with impaired vision in object retrieval or so-called guiding/accompanying mode.
  • the robotic device (1) is provided with a software function in the form of face recognition function by which the robotic device (1) continuously visually monitors the face or movements of the child and transmits real-time audio or visual content in tracked mode. The child is monitored using said 360-degree camera (8) on top of the robotic device (1). The remote parent can take control of the 360-degree camera (8) to interact with the child.
  • the robotic device (1) is controllable by both the child and the parent who is in a location other than a location where the robotic device (1) and the child are present.
  • the robotic device (1) When the robotic device (1) is controlled by the parents, their commands have priority over the child's commands.
  • the parents can use the robotic device (1) to communicate with the child in realtime.
  • the robotic device (1) that is controlled by remote access can transmit messages of the parents (real-time video, real voice or generated audio, robot movements and body gestures) to the child and in response to these messages, the robotic device (1) can transmit the child's messages (real-time video, real voice or generated audio, robot movements and body gestures) to the remote parent.
  • Robotic movements and body gestures are to be realized by the robotic device (1) itself if programmed by the parent on his/her control panel and are visually generated on the parent's control panel screen if programmed by the child on his/her control panel.
  • an on/off switch is used to turn the robot (1) on and off.
  • This button is designed below the outer body surface of the robotic device (1) to avoid accidental pressing while moving around. When turned on, the red light on the button becomes active.
  • programs in class, function and compiler level layer are written to fulfill robotic functions. Class and function specific program inputs are parts that can parametrically edit and manipulate any type of program input and output processing on the robotic device (1). After the compilation, the robotic device (1) is ready to perform the desired sequence of actions. Sequence of actions programmed and saved can be edited again later on or alternatively can be run as many times as needed.
  • the present invention proposes a robotic device (1) in simultaneous remote communication with a first control panel (2) in the location of the robotic device (1) and a second control panel (3) in a location other than the location of the robotic device (1), said robotic device (1) having at least one movable part to perform gestures and bodily movements and robotic wheels to displace in different directions.
  • said at least one movable part and said robotic wheels are simultaneously controllable in real-time by said first and second control panels (2, 3) to program gestures and bodily movements and displace said robotic device (1) in predetermined directions.
  • a visual or audio indication is generated by said robotic device (1) when said device is controlled in real time by said second control panel (3).
  • commands by said second control panel (3) have priority over commands by said first control panel (3).
  • the robotic device (1) being controlled by said second control panel (3) by remote access receives real- time video, real-time voice, machine-generated voice, gestures, bodily movements or environmental movement patterns from said second control panel (3) and plays real-time video, real-time voice or machine-generated voice or performs gestures, bodily movements or environmental movement patterns.
  • the robotic device (1) transmits real-time voice, machine-generated voice, gestures, bodily movements or environmental movement patterns to said second control panel (3) and the latter second control panel (3) plays real-time video, real-time voice or machine-generated voice or performs gestures, bodily movements or environmental movement patterns in a computer-generated manner.
  • gestures, bodily movements or environmental movement patterns received from said second control panel (3) and realized by the robotic device (1) are programmed on said second control panel (3).
  • a visual indication in the form of a continuous or blinking light (12) is activated on the robotic device (1) when said second control panel (3) establishes a real-time connection to directly control gestures, bodily movements or environmental movement patterns of the robotic device (1).
  • an audio indication in the form of a predetermined sound or sound sequence is generated by the robotic device (1) when said second control panel (3) establishes a real-time connection to directly control gestures, bodily movements or environmental movement patterns of the robotic device (1).
  • said first and second control panel (2, 3) are a smartphone, tablet computer or desktop computer.
  • said robotic device (1) is configured to access at least one predefined social media account in the manner that social media interaction through said first control panel (2) is priorly communicated to said second control panel (3) whereby said second control panel monitors and manages any social media interaction and/or interaction request.
  • said at least one movable part is an arm (11) having at least one junction.
  • said gestures and bodily movements include hand waving, and predetermined combination of arm (11) movements.
  • said environmental movement patterns include moving sideways in certain directions and in certain repetitions.
  • said gestures, bodily movements and environmental movement patterns are real-time programmed or preconfigured sequence of actions that can be repeated or recorded to be repeated.
  • said robotic device (1) comprises a remotely accessible omnidirectional 360-degree camera (8) to capture images from different angles.
  • the robotic device (1) captures a video record or records an audio session in a remotely controlled or preprogrammed mode.
  • the robotic device (1) transmits real-time audio and video content to said second control panel (3) in tracked mode by which face recognition function is activated and the robotic device continuously visually monitors the face or movements of an individual and transmits real-time audio and video content using said 360-degree camera (8) on top of the robotic device (1).
  • the robotic device (1) comprises a head display (4) to display visual content.
  • the robotic device (1) comprises a selectively triggered touch sensor (7) in the manner that active or passive status thereof determines specific behavior of the robotic device (1) during different programming scenarios.
  • the robotic device (1) comprises a plurality of color indicators lighting up in different colors in blinking or continuous modes depending on a current specific behavior of the robotic device (1) during different programming scenarios.
  • the robotic device (1) comprises a front sensor (5) in the form of a proximity sensor to sense a nearby object by which the robotic device (1) avoids crashes in real-time or preprogrammed control modes.
  • the robotic device (1) is preprogrammed to automatically guide a disabled person using audio indications to a predetermined location or near a predetermined object in a house.
  • the robotic device (1) is configured to communicate with a location identification module such as a Bluetooth tracking device placed at said predetermined location or adhered to said predetermined object.
  • the robotic device (1) is preconfigured to recognize certain preloaded voice patterns based on the volume and frequency threshold of the detected voice.
  • the robotic device (1) is responsive to a situation where a child cries by automatically activating a night lamp during night time and sending a predefined warning message to said second control panel (3).
  • the robotic device (1) activates voice activity detection to identify certain keywords in a nearby conversation using speech recognition.
  • the robotic device (1) is auto- programmed to optically classify a plurality of pills to timely give a number of predetermined pills according to a dosing schedule to a patient.
  • the robotic device (1) is provided with an internal storage where a plurality of different pills are stored and a number of predetermined pills are selected and separated from other pills according to their forms and colors analyzed by an optical sensor of the robotic device (1).
  • said internal storage has vertical tubular portions, each tube storing pills of the same medication such that a given pill with a certain shape and color in a certain tube is releasable on an individual basis.
  • said released pills from the vertical tubular portions are stored in an intermediate storage room for size and color analysis by said optical sensor according to the predefined dosing schedule.
  • said the robotic device (1) is provided with a bottom sensor (6) to detect and avoid obstacles.

Abstract

The present invention relates to a robot which could be controlled by parents and children simultaneously. A robotic system comprising a robot (1), a first control panel (2) and a second control panel (3) wherein said robot (1) applies remotely transmitted body movement commands according to the robot access sequence, said robot (1) shows external commands to the child based on real-time body movements, commands from the child through control panel are transmitted to the other control panel on the parent side through on-screen software on the screen with the simulation software.

Description

PLU RALLY CONTROLLABLE AUTOMATED ROBOTIC SYSTEM FOR
CHILDREN
Technical Field of the Present Invention The present invention relates to a remotely controllable robotic device which could be controlled by parents and children simultaneously.
Background of the Present Invention
It is widely known that there exist user-controlled automated devices which are mainly designed as entertainment devices also fulfilling educational purposes. Such devices basically involve in a practical manner use of automated and programmable tasks, remote and real-time control.
Said robotic devices may help humans in carrying out repeated and/or dangerous tasks which people prefers not to do also due to size limitations, or which take place in extreme environments such as deep water levels. A robotic device can be a machine capable of performing a complex arrangement of activities automatically and executing tasks with speed and precision. Robots can be controlled by an external control gadget or the control scheme might be internally programmed using a dedicated interface. Such robotic devices can be developed to perform certain tasks in a physical design relation with the intended function, yet regardless of what they look like, many different types of robots with distinct forms may accomplish different tasks. It is also noted that robotic devices may have a significant role in improving quality of life for certain people, more precisely as units providing assistance for disabled people or educational setups and applications such as in schools. Some of these robots particularly designed to interact with children may exhibit human-like features to provide more convenient and personal relation with children.
Industrial robots, on the other hand, are often designed to perform repetitive tasks which are not facilitated by human intervention. A robot can typically be remotely controlled by an operator, sometimes from very large distances. A telechir is a complex robot remotely controlled by a human operator for a telepresence system that gives an individual the feeling of being on the ground in a dangerous environment and the ability to interact with the same. Telepresence robots that allow this kind of experience and some of the abilities one would have if physically present, can enable remote health care function, home surveillance and child care, including several other possibilities.
Existing educational robots are generally limited, however, in their modes of interaction with the children and their ability to dynamically adapt to varying environments and changing needs of the children. One of the prior art disclosures in the technical field of the present invention can be referred to as KR100814330, disclosing a robot system for providing learning aid and assisting a teacher is provided to offer a self-controlled and creative learning environment, assist a teacher and express a thought like a human being by having a chat with students while moving in a classroom. A contents server storing various kinds of learning contents, a home PC communicating with a teacher at home through the Internet and a modem are placed in a remote location. A classroom is equipped with a teacher PC enabling the teacher to control a mobile robot and the projection TV, the projection TV outputting various kinds of learning information in video/audio, the LAN (Local Area Network) connecting the contents server and the home PC to the teacher PC and an AP (Access Point) sharing device and the mobile robot. The mobile robot assists the teacher by having a chat with students and expressing an opinion while moving in the classroom according to a control signal output from the teacher PC and a remote controller. The AP sharing device transmits data between the mobile robot and the teacher PC, the contents server and the home PC to the mobile robot through the wireless network.
Objects of the Present Invention
Primary object of the present invention is to provide a communication device in the form of a robotic device between parents and their children. Another object of the present invention is to provide a real-time controlled communication device as a robotic device between parents and their children in separate locations.
Another object of the present invention is to provide a real-time controlled communication device suitable for performing tasks programmed remotely in real-time by parents and adapted to provide in return real-time programmed movement or movement patterns as a communicational feed-back by children, therefore establishing a communication platform between parents and their children in separate locations. Further an object of the present invention is to provide real-time controlled gestures or movements carried out by the robotic device and transmit in return real-time audio or visual content to the remote parent(s).
Still further an object of the present invention is to transmit real-time audio or visual content in tracked mode by which the robotic device visually monitors the face or movements of the children.
Yet still further an object of the present invention is to provide a daily assistance device to disabled people/children.
Brief Description of the Figures of the Present Invention Accompanying drawings are given solely for the purpose of exemplifying a robot system, whose advantages over prior art were outlined above and will be explained in brief hereinafter.
The drawings are not meant to delimit the scope of protection as identified in the claims nor should they be referred to alone in an effort to interpret the scope identified in said claims without recourse to the technical disclosure in the description of the present invention.
The drawings are only exemplary in the sense that they do not necessarily reflect the actual dimensions and relative proportions of the respective components of the system if not otherwise explicitly stated. Fig. 1 demonstrates a general block diagram of a robot system's working structure layers according to the present invention.
Fig. 2 demonstrates a front view of a robot system according to the present invention. Fig. 3 demonstrates a back view of a robot system according to the present invention.
Detailed Description of the Present Invention
The following numerals are used to refer to various parts and definitions in the detailed description of the present invention:
1) Robotic device
2) First control panel
3) Second control panel
4) Head display
5) Front sensor
6) Bottom sensor
7) Touch sensor
8) Camera
9) Storage inlet
10) Storage outlet
11) Arms
12) Light
The present invention provides a robotic device (1) that works in harmony with intervening commands by multiple controllers as in the case of a remotely located parent and children in the vicinity of the robotic system (1).
The functions of the robotic device (1) are for instance designed to allow use of social media in a safer and more useful manner, also enabling playing of games and performing educational tasks for children. For instance, as will be delineated in more detail hereinafter, children can play games using the robotic device (1) and also use the same for educational purposes.
A robotic device (1) according to the present invention can be conventionally controlled by means of a tablet or PC using a dedicated software interface, i.e. to control various physical functions (such as movements, audio and visual data acquiring/recording functions etc.) of the robotic device (1).
Preferably, said dedicated software interface is provided with various tools such as social media connection, foreign language learning mode, mathematics learning mode, gaming options and programming modes. The robotic device (1) is conventionally provided with a network interface card so that it can establish a remote Internet connection, for instance by connecting to a Wi-Fi network. The tablet, PC or any type of controller environment is able to remotely transmit control data to the robotic device (1), including among other options to connect to the same LAN. The robotic device (1) may for instance be configured to access predefined social media accounts in place of the child, can monitor and manage friendship or any interaction requests.
Any social media user activity by children can be subject to parental control in order to ensure the child's safety and clean social media use. Accordingly, a distant parent is priorly notified of social media activities real-time and parental control can be exercised to allow certain activities to take place. Therefore, the distant parent has remote access to the robotic device (1) by way of establishing a remote connection with the same. The robotic device (1) can conventionally provide foreign language learning schemes with different preconfigured exercise selections depending on the age of the child. Simple foreign language teaching modes or communication examples/ patterns performed by the robotic device (1) will substantially contribute to language skills of the child.
Using the robotic device (1) in mathematics mode, mathematics education can be provided to the child using a gaming approach, i.e. by vocally describing preloaded scenarios involving basic mathematics problems.
In manual mode, the child can typically control the robotic system (1) through a tablet or a PC to accomplish the desired movements. The robotic device (1) can be basically used as a communication tool to reach parents or the movement patterns as performed by the robotic device (1) can be relayed to the control interface of a parent, on the screen of which any movement performed by the robotic device (1) is recreated by the software interface. In other words, bodily movements in the form of real-time controlled/programmed gestures or movements carried out by the robotic device (1), such as hand waving, moving around, activating certain lights (12), performing prerecorded actions etc. are communicated to the parent in the form of communicational information. Main components of the robotic device (1) body parts are the arms (11). Arms (11) typically have a junction and simple finger structure to provide basic movement forms. Besides, the robotic device (1) can capture a video record or record an audio session to transmit the same to the parent when activated. It is further possible to transmit real-time audio or visual content in tracked mode by which the robotic device (1) visually monitors the face or movements of the child. In automatic mode, preconfigured programs (by the manufacturer or by children) can be run automatically, such programs can include any sequence of actions such as dancing (moving sideways), hand waving, playing preloaded audio records, voice recording, activating predefined lights etc. The camera of the robotic device (1) is remotely accessible by the parents so that they will be able to connect to the device via any desired device such as a mobile phone or PC. When activating this function, the parent will be able to connect to a 360-degree camera (8) while at the same time controlling movements of the robotic device (1). As illustrated in Fig. 2, the 360-degree camera (8) can be an omnidirectional camera that is able to capture images from different angles in the room where the robotic device (1) is present. This feature substantially ensures safety of a child when he/she is not accompanied by an adult.
In a variation of the robotic device (1), a programming mode can be provided by which the software interface will enable visual format programming in the form of inter-engaging program blocks and steps to increase the ability of children to create programming algorithms. The code will be typically generated by the program at the background and will be sent to the robotic device (1). Children are able to share their programs with their friends via social media and these programs can be rated by their friend community. Language selection part of the robotic device (1) is designed to cover a plurality of languages.
As it can be seen from Fig. 1, the system consists of several layers. Presence of any of these layers provides a conventional software system in control of the hardware. The layers and the communication scheme between layers can also be seen in Fig. 1.
As mentioned, administration interface layer can contain tablet/PC, smartphone or any other remote control unit interfaces and programs. The programs provide access to specific settings of the robotic device (1), ensuring management and/or programming thereof. The interface can be customized by the user. The program is preferably designed as a web-based multi-device platform, providing that any control unit such as PC or smartphone can run the control program independent of the operating system. The program can preferably be controlled in drag-and-drop and touch-enabled manner, or typically in more conventional ways with the mouse and keys as in the case of a desktop computer.
Parental control interface enables to control all the settings in relation to the robotic device (1). Parent can remotely control and manage incoming friendship calls by other robotic devices (1) and set administrative and operational parameters of the robotic device (1). The parental control interface can advantageously establish real-time connection to directly control the robotic device (1). A special visual indication is generated on the robotic device (1), when the latter is remotely controlled, i.e. fulfills tasks not directly programmed or preprogrammed by the child. For instance when the robotic devices (1) is in real-time control mode through a remote connection by any parent not accompanying the child, a dedicated light (12) is continuously activated in blinking mode. Alternatively or additionally, an audio indication in the form of a predetermined sound sequence can be generated in real-time remote control mode. If a real-time audio message is generated by the robotic devices (1), a specific voice can be preselected. According to the present invention, the robotic device (1) is simultaneously controlled by at least two remote control panels (first control panel (2) and second control panel (3)), such control panels being smartphones, tablets, computers etc. Therefore, the two control panels securely establish a remote connection to access the robotic device (1), which simultaneously process commands from both control panels. The robotic device (1) detects the received commands from both control panels and performs the specified functions in predetermined modes. Once the robotic device (1) is turned on, it connects to the predetermined network and starts broadcasting. Once a connection is available to the first or second control panel (2, 3), the robotic device (1) starts listening to detect any program commands from any of the control panels. The robotic device (1) may establish a simultaneous second network connection used to connect to the internet backbone. When the parent adjusts and saves operational settings for the robotic device (1), then the robotic device (1) can also fulfills any tasks programmed by the child.
As previously noted, the robotic device (1) can have access to a preconfigured social media account to make friends and interact with other social media users also in possession of similar robotic devices (1). Any user can conventionally send text messages to another user. When a message is received by the robotic device (1), a respective visual indication is generated and a light (12) starts to blink. In addition, the light (12) can be programmed for different events.
According to the invention, a head display (4) is provided to display different screen images. The head display (4) is an auxiliary display tool in addition to the remote control panel screen in programming mode. Otherwise, the head display (4) can be used as a conventional video display screen by which children can watch videos thereon. For instance a live video connection can be established with the parents and a parent can be directly viewed on the head display (4). The robotic device (1) is also provided with embedded speakers. One of the sensors in the front side of robotic device (1) works as a touch sensor (7). Touch sensor (7) can be triggered easily by the children so that active or passive status of the touch sensor (7) can determine behavior of the robotic device (1) during different programming scenarios.
The robotic device (1) of the invention is also provided with a plurality of color indicators other than the light (12), these color indicators can be used to light up in different colors and children can change the color of any of the color indicators in a color indicator array. The color and/or blinking or continuous mode of any color indicator can also depend on a current specific behavior/function of the robotic device (1) during different programming scenarios. The brightness level of the color indicators can be adjusted.
For example, specific effects can be created by color indicators during different operational modes. For example, a so-called light cycle mode can be activated during real-time motion control during which preselected lights in the color indicators are sequentially turned on and off to create a moving/rotating light effect. Another mode can be rainbow mode in which, the lights are in motion in rainbow colors.
In a further variation according to the present invention, a front sensor (5) in the form of a proximity sensor is provided in the front side of the robotic device (1). The front sensor (5) senses a nearby object in a distance of 5 cm to 10 cm. In this way, the robotic device (1) can avoid crashes in real-time control mode.
In addition, according to an alternative embodiment of the present invention, the robotic device (1) can be used to reach predetermined objects or locations in the house. This is particularly advantageous in assisting disabled people and particularly people with impaired vision. In object retrieval or so- called guiding/accompanying mode, the robotic device (1) can be programmed to automatically guide a disabled person with audio indications to accompany him/her to a certain location in the house (dining room or kitchen) or near a predetermined object (such as smartphone or a handbag). In the latter case, a location identification module such as a Bluetooth tracking device adhered to a non-electronic device such as a handbag broadcasting its location can be used to find location of the item in an advantageous manner. At least one microphone is provided on the robotic device (1). According to the present invention, the robotic device (1) is preconfigured to recognize certain preloaded voice patterns. For instance, the robotic device (1) is responsive to a situation where the child starts crying. This automatically activates a night lamp during night time and sends a predefined warning message to the control panel of the parent. Distinguishing crying voice from other environmental sounds can be effected based on the volume and frequency threshold of the received voice.
In a further variation according to the present invention, conventional speech recognition algorithms can be used to activate voice activity detection so that parents can be informed if certain keywords are identified in a given conversation. This is particularly advantageous if the child tells that he/she feels sick, feels ill, his/her stomach hurts, he/she has a fever etc.
In a further variation according to the present invention, the robotic device (1) can be auto-programmed to optically classify a plurality of pills to timely give a number of predetermined pills according to a dosing schedule to a patient. This is particularly advantageous in the case of elderly people adhering to a medication regimen. Accordingly, the robotic device (1) is provided with an internal storage where a plurality of different pills are stored and a number of predetermined pills are selected and separated from other pills according to their forms and colors analyzed by an optical sensor. To load the internal storage, a storage inlet (9) located at the rear side of the robotic device (1) is used. The internal storage has specifically allocated vertical tubular portions, each tube storing pills of the same medication. Therefore, each tube contains pills with different sizes and shapes in a vertically arranged manner. A given pill with a certain shape and color in a certain tube is releasable on an individual basis. Selected pills from the tubular containers are then stored in an intermediate storage room for size and color analysis by said optical sensor according to the predefined dosing schedule. Upon verification, selected pills drop to a storage outlet (10) from where the patient can take the medication.
In a further variation according to the present invention, the robotic device (1) is provided with an additional bottom sensor (6) that can detect and avoid obstacles particularly when assisting disabled people and particularly people with impaired vision in object retrieval or so-called guiding/accompanying mode. In a further variation according to the present invention, the robotic device (1) is provided with a software function in the form of face recognition function by which the robotic device (1) continuously visually monitors the face or movements of the child and transmits real-time audio or visual content in tracked mode. The child is monitored using said 360-degree camera (8) on top of the robotic device (1). The remote parent can take control of the 360-degree camera (8) to interact with the child.
The robotic device (1) is controllable by both the child and the parent who is in a location other than a location where the robotic device (1) and the child are present. When the robotic device (1) is controlled by the parents, their commands have priority over the child's commands. At the same time, the parents can use the robotic device (1) to communicate with the child in realtime. In other words, the robotic device (1) that is controlled by remote access can transmit messages of the parents (real-time video, real voice or generated audio, robot movements and body gestures) to the child and in response to these messages, the robotic device (1) can transmit the child's messages (real-time video, real voice or generated audio, robot movements and body gestures) to the remote parent.
Robotic movements and body gestures (such as hand waving) are to be realized by the robotic device (1) itself if programmed by the parent on his/her control panel and are visually generated on the parent's control panel screen if programmed by the child on his/her control panel.
Typically an on/off switch is used to turn the robot (1) on and off. This button is designed below the outer body surface of the robotic device (1) to avoid accidental pressing while moving around. When turned on, the red light on the button becomes active. Typically, programs in class, function and compiler level layer are written to fulfill robotic functions. Class and function specific program inputs are parts that can parametrically edit and manipulate any type of program input and output processing on the robotic device (1). After the compilation, the robotic device (1) is ready to perform the desired sequence of actions. Sequence of actions programmed and saved can be edited again later on or alternatively can be run as many times as needed.
In a nutshell, the present invention proposes a robotic device (1) in simultaneous remote communication with a first control panel (2) in the location of the robotic device (1) and a second control panel (3) in a location other than the location of the robotic device (1), said robotic device (1) having at least one movable part to perform gestures and bodily movements and robotic wheels to displace in different directions.
In one aspect of the present invention, said at least one movable part and said robotic wheels are simultaneously controllable in real-time by said first and second control panels (2, 3) to program gestures and bodily movements and displace said robotic device (1) in predetermined directions.
In a further aspect of the present invention, a visual or audio indication is generated by said robotic device (1) when said device is controlled in real time by said second control panel (3).
In a further aspect of the present invention, commands by said second control panel (3) have priority over commands by said first control panel (3).
In a further aspect of the present invention, the robotic device (1) being controlled by said second control panel (3) by remote access receives real- time video, real-time voice, machine-generated voice, gestures, bodily movements or environmental movement patterns from said second control panel (3) and plays real-time video, real-time voice or machine-generated voice or performs gestures, bodily movements or environmental movement patterns. In a further aspect of the present invention, the robotic device (1) transmits real-time voice, machine-generated voice, gestures, bodily movements or environmental movement patterns to said second control panel (3) and the latter second control panel (3) plays real-time video, real-time voice or machine-generated voice or performs gestures, bodily movements or environmental movement patterns in a computer-generated manner.
In a further aspect of the present invention, gestures, bodily movements or environmental movement patterns received from said second control panel (3) and realized by the robotic device (1) are programmed on said second control panel (3). In a further aspect of the present invention, a visual indication in the form of a continuous or blinking light (12) is activated on the robotic device (1) when said second control panel (3) establishes a real-time connection to directly control gestures, bodily movements or environmental movement patterns of the robotic device (1). In a further aspect of the present invention, an audio indication in the form of a predetermined sound or sound sequence is generated by the robotic device (1) when said second control panel (3) establishes a real-time connection to directly control gestures, bodily movements or environmental movement patterns of the robotic device (1). In a further aspect of the present invention, said first and second control panel (2, 3) are a smartphone, tablet computer or desktop computer.
In a further aspect of the present invention, said robotic device (1) is configured to access at least one predefined social media account in the manner that social media interaction through said first control panel (2) is priorly communicated to said second control panel (3) whereby said second control panel monitors and manages any social media interaction and/or interaction request.
In a further aspect of the present invention, said at least one movable part is an arm (11) having at least one junction.
In a further aspect of the present invention, said gestures and bodily movements include hand waving, and predetermined combination of arm (11) movements.
In a further aspect of the present invention, said environmental movement patterns include moving sideways in certain directions and in certain repetitions.
In a further aspect of the present invention, said gestures, bodily movements and environmental movement patterns are real-time programmed or preconfigured sequence of actions that can be repeated or recorded to be repeated.
In a further aspect of the present invention, said robotic device (1) comprises a remotely accessible omnidirectional 360-degree camera (8) to capture images from different angles. In a further aspect of the present invention, the robotic device (1) captures a video record or records an audio session in a remotely controlled or preprogrammed mode.
In a further aspect of the present invention, the robotic device (1) transmits real-time audio and video content to said second control panel (3) in tracked mode by which face recognition function is activated and the robotic device continuously visually monitors the face or movements of an individual and transmits real-time audio and video content using said 360-degree camera (8) on top of the robotic device (1). In a further aspect of the present invention, the robotic device (1) comprises a head display (4) to display visual content.
In a further aspect of the present invention, the robotic device (1) comprises a selectively triggered touch sensor (7) in the manner that active or passive status thereof determines specific behavior of the robotic device (1) during different programming scenarios.
In a further aspect of the present invention, the robotic device (1) comprises a plurality of color indicators lighting up in different colors in blinking or continuous modes depending on a current specific behavior of the robotic device (1) during different programming scenarios. In a further aspect of the present invention, the robotic device (1) comprises a front sensor (5) in the form of a proximity sensor to sense a nearby object by which the robotic device (1) avoids crashes in real-time or preprogrammed control modes. In a further aspect of the present invention, the robotic device (1) is preprogrammed to automatically guide a disabled person using audio indications to a predetermined location or near a predetermined object in a house. In a further aspect of the present invention, the robotic device (1) is configured to communicate with a location identification module such as a Bluetooth tracking device placed at said predetermined location or adhered to said predetermined object.
In a further aspect of the present invention, the robotic device (1) is preconfigured to recognize certain preloaded voice patterns based on the volume and frequency threshold of the detected voice.
In a further aspect of the present invention, the robotic device (1) is responsive to a situation where a child cries by automatically activating a night lamp during night time and sending a predefined warning message to said second control panel (3).
In a further aspect of the present invention, the robotic device (1) activates voice activity detection to identify certain keywords in a nearby conversation using speech recognition.
In a further aspect of the present invention, the robotic device (1) is auto- programmed to optically classify a plurality of pills to timely give a number of predetermined pills according to a dosing schedule to a patient.
In a further aspect of the present invention, the robotic device (1) is provided with an internal storage where a plurality of different pills are stored and a number of predetermined pills are selected and separated from other pills according to their forms and colors analyzed by an optical sensor of the robotic device (1).
In a further aspect of the present invention, said internal storage has vertical tubular portions, each tube storing pills of the same medication such that a given pill with a certain shape and color in a certain tube is releasable on an individual basis.
In a further aspect of the present invention, said released pills from the vertical tubular portions are stored in an intermediate storage room for size and color analysis by said optical sensor according to the predefined dosing schedule.
In a further aspect of the present invention, said the robotic device (1) is provided with a bottom sensor (6) to detect and avoid obstacles.

Claims

1) A robotic device (1) in simultaneous remote communication with a first control panel (2) in the location of the robotic device (1) and a second control panel (3) in a location other than the location of the robotic device (1), said robotic device (1) having at least one movable part to perform gestures and bodily movements and robotic wheels to displace in different directions characterized in that; said at least one movable part and said robotic wheels are simultaneously controllable in real-time by said first and second control panels (2, 3) to program gestures and bodily movements and displace said robotic device (1) in predetermined directions and, a visual or audio indication is generated by said robotic device (1) when said device is controlled in real time by said second control panel (3). 2) A robotic device (1) as set forth in Claim 1 characterized in that commands by said second control panel (3) have priority over commands by said first control panel (3).
3) A robotic device (1) as set forth in Claim 1 or 2 characterized in that the robotic device (1) being controlled by said second control panel (3) by remote access receives real-time video, real-time voice, machine- generated voice, gestures, bodily movements or environmental movement patterns from said second control panel (3) and plays real-time video, realtime voice or machine-generated voice or performs gestures, bodily movements or environmental movement patterns. 4) A robotic device (1) as set forth in Claim 3 characterized in that the robotic device (1) transmits real-time voice, machine-generated voice, gestures, bodily movements or environmental movement patterns to said second control panel (3) and the latter second control panel (3) plays real- time video, real-time voice or machine-generated voice or performs gestures, bodily movements or environmental movement patterns in a computer- generated manner.
5) A robotic device (1) as set forth in Claim 3 characterized in that gestures, bodily movements or environmental movement patterns received from said second control panel (3) and realized by the robotic device (1) are programmed on said second control panel (3).
6) A robotic device (1) as set forth in Claim 3 or 5 characterized in that a visual indication in the form of a continuous or blinking light (12) is activated on the robotic device (1) when said second control panel (3) establishes a real-time connection to directly control gestures, bodily movements or environmental movement patterns of the robotic device (1).
7) A robotic device (1) as set forth in Claim 3 or 5 characterized in that an audio indication in the form of a predetermined sound or sound sequence is generated by the robotic device (1) when said second control panel (3) establishes a real-time connection to directly control gestures, bodily movements or environmental movement patterns of the robotic device (!)
8) A robotic device (1) as set forth in any preceding Claim characterized in that said first and second control panel (2, 3) are a smartphone, tablet computer or desktop computer. 9) A robotic device (1) as set forth in any preceding Claim characterized in that said robotic device (1) is configured to access at least one predefined social media account in the manner that social media interaction through said first control panel (2) is priorly communicated to said second control panel (3) whereby said second control panel monitors and manages any social media interaction and/or interaction request.
10) A robotic device (1) as set forth in any preceding Claim characterized in that said at least one movable part is an arm (11) having at least one junction. 11) A robotic device (1) as set forth in Claim 10 characterized in that said gestures and bodily movements include hand waving, and predetermined combination of arm (11) movements.
12) A robotic device (1) as set forth in Claim 3 characterized in that said environmental movement patterns include moving sideways in certain directions and in certain repetitions.
13) A robotic device (1) as set forth in Claim 11 and 12 characterized in that said gestures, bodily movements and environmental movement patterns are real-time programmed or preconfigured sequence of actions that can be repeated or recorded to be repeated. 14) A robotic device (1) as set forth in any preceding Claim characterized in that said robotic device (1) comprises a remotely accessible omnidirectional 360-degree camera (8) to capture images from different angles. 15) A robotic device (1) as set forth in Claim 14 characterized in that the robotic device (1) captures a video record or records an audio session in a remotely controlled or preprogrammed mode.
16) A robotic device (1) as set forth in Claim 15 characterized in that the robotic device (1) transmits real-time audio and video content to said second control panel (3) in tracked mode by which face recognition function is activated and the robotic device continuously visually monitors the face or movements of an individual and transmits real-time audio and video content using said 360-degree camera (8) on top of the robotic device (1). 17) A robotic device (1) as set forth in Claim 1 characterized in that the robotic device (1) comprises a head display (4) to display visual content.
18) A robotic device (1) as set forth in Claim 1 characterized in that the robotic device (1) comprises a selectively triggered touch sensor (7) in the manner that active or passive status thereof determines specific behavior of the robotic device (1) during different programming scenarios.
19) A robotic device (1) as set forth in Claim 1 characterized in that the robotic device (1) comprises a plurality of color indicators lighting up in different colors in blinking or continuous modes depending on a current specific behavior of the robotic device (1) during different programming scenarios.
20) A robotic device (1) as set forth in Claim 1 characterized in that the robotic device (1) comprises a front sensor (5) in the form of a proximity sensor to sense a nearby object by which the robotic device (1) avoids crashes in real-time or preprogrammed control modes. 21) A robotic device (1) as set forth in Claim 1 characterized in that the robotic device (1) is preprogrammed to automatically guide a disabled person using audio indications to a predetermined location or near a predetermined object in a house. 22) A robotic device (1) as set forth in Claim 21 characterized in that the robotic device (1) is configured to communicate with a location identification module such as a Bluetooth tracking device placed at said predetermined location or adhered to said predetermined object.
23) A robotic device (1) as set forth in Claim 21 characterized in that the robotic device (1) is preconfigured to recognize certain preloaded voice patterns based on the volume and frequency threshold of the detected voice.
24) A robotic device (1) as set forth in Claim 23 characterized in that the robotic device (1) is responsive to a situation where a child cries by automatically activating a night lamp during night time and sending a predefined warning message to said second control panel (3).
25) A robotic device (1) as set forth in Claim 1 characterized in that the robotic device (1) activates voice activity detection to identify certain keywords in a nearby conversation using speech recognition.
26) A robotic device (1) as set forth in Claim 1 characterized in that the robotic device (1) is auto-programmed to optically classify a plurality of pills to timely give a number of predetermined pills according to a dosing schedule to a patient.
27) A robotic device (1) as set forth in Claim 26 characterized in that the robotic device (1) is provided with an internal storage where a plurality of different pills are stored and a number of predetermined pills are selected and separated from other pills according to their forms and colors analyzed by an optical sensor of the robotic device (1).
28) A robotic device (1) as set forth in Claim 27 characterized in that said internal storage has vertical tubular portions, each tubular portion storing pills of the same medication such that a given pill with a certain shape and color in a certain tube is releasable on an individual basis.
29) A robotic device (1) as set forth in Claim 28 characterized in that said released pills from the vertical tubular portions are stored in an intermediate storage room for size and color analysis by said optical sensor according to the predefined dosing schedule.
30) A robotic device (1) as set forth in Claim 1 characterized in that said the robotic device (1) is provided with a bottom sensor (6) to detect and avoid obstacles.
PCT/TR2017/050183 2017-05-10 2017-05-10 Plurally controllable automated robotic system for children WO2018208243A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/TR2017/050183 WO2018208243A1 (en) 2017-05-10 2017-05-10 Plurally controllable automated robotic system for children

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/TR2017/050183 WO2018208243A1 (en) 2017-05-10 2017-05-10 Plurally controllable automated robotic system for children

Publications (1)

Publication Number Publication Date
WO2018208243A1 true WO2018208243A1 (en) 2018-11-15

Family

ID=64105697

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/TR2017/050183 WO2018208243A1 (en) 2017-05-10 2017-05-10 Plurally controllable automated robotic system for children

Country Status (1)

Country Link
WO (1) WO2018208243A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112140099A (en) * 2019-06-28 2020-12-29 百度在线网络技术(北京)有限公司 Light effect control method, device, equipment and medium for robot

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060154642A1 (en) * 2004-02-20 2006-07-13 Scannell Robert F Jr Medication & health, environmental, and security monitoring, alert, intervention, information and network system with associated and supporting apparatuses
WO2007041295A2 (en) * 2005-09-30 2007-04-12 Irobot Corporation Companion robot for personal interaction
US20130078600A1 (en) * 2011-08-29 2013-03-28 Worcester Polytechnic Institute System and method of pervasive developmental disorder interventions
US20150133025A1 (en) * 2013-11-11 2015-05-14 Mera Software Services, Inc. Interactive toy plaything having wireless communication of interaction-related information with remote entities
WO2016210327A1 (en) * 2015-06-25 2016-12-29 Websafety, Inc. Management and control of mobile computing device using local and remote software agents
US20170015445A1 (en) * 2012-06-01 2017-01-19 Rxsafe Llc Pharmacy packaging system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060154642A1 (en) * 2004-02-20 2006-07-13 Scannell Robert F Jr Medication & health, environmental, and security monitoring, alert, intervention, information and network system with associated and supporting apparatuses
WO2007041295A2 (en) * 2005-09-30 2007-04-12 Irobot Corporation Companion robot for personal interaction
US20130078600A1 (en) * 2011-08-29 2013-03-28 Worcester Polytechnic Institute System and method of pervasive developmental disorder interventions
US20170015445A1 (en) * 2012-06-01 2017-01-19 Rxsafe Llc Pharmacy packaging system
US20150133025A1 (en) * 2013-11-11 2015-05-14 Mera Software Services, Inc. Interactive toy plaything having wireless communication of interaction-related information with remote entities
WO2016210327A1 (en) * 2015-06-25 2016-12-29 Websafety, Inc. Management and control of mobile computing device using local and remote software agents

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112140099A (en) * 2019-06-28 2020-12-29 百度在线网络技术(北京)有限公司 Light effect control method, device, equipment and medium for robot
CN112140099B (en) * 2019-06-28 2022-05-13 百度在线网络技术(北京)有限公司 Light effect control method, device, equipment and medium for robot

Similar Documents

Publication Publication Date Title
Cooper et al. ARI: The social assistive robot and companion
KR102502228B1 (en) Social robots with environmental control features
Gross et al. Robot companion for domestic health assistance: Implementation, test and case study under everyday conditions in private apartments
US10864453B2 (en) Automatic mobile robot for facilitating activities to improve child development
JP5203499B2 (en) Companion robot for personal interaction
US20190240842A1 (en) Robot assisted interaction system and method thereof
Zachiotis et al. A survey on the application trends of home service robotics
Portugal et al. SocialRobot: An interactive mobile robot for elderly home care
Tsui et al. Design challenges and guidelines for social interaction using mobile telepresence robots
US20130078600A1 (en) System and method of pervasive developmental disorder interventions
Weidemann et al. The role of frustration in human–robot interaction–What is needed for a successful collaboration?
CN107658016A (en) The Nounou intelligent guarding systems accompanied for health care for the aged
Hai et al. Remote healthcare for the elderly, patients by tele-presence robot
JP7375770B2 (en) Information processing device, information processing method, and program
US11393352B2 (en) Reading and contingent response educational and entertainment method and apparatus
US10748437B2 (en) Learning aid apparatus and system
CN107895101A (en) The Nounou intelligent monitoring devices accompanied for health care for the aged
Maheux et al. T-Top, a SAR experimental platform
WO2018208243A1 (en) Plurally controllable automated robotic system for children
US20220319714A1 (en) Atmospheric mirroring and dynamically varying three-dimensional assistant addison interface for behavioral environments
US20220319713A1 (en) Atmospheric mirroring and dynamically varying three-dimensional assistant addison interface for interior environments
Maneewarn Survey of social robots in Thailand
Cooper et al. Robot to support older people to live independently
Feil-Seifer Data-driven interaction methods for socially assistive Robotics: validation with children with Autism spectrum disorders
US20220319696A1 (en) Atmospheric mirroring and dynamically varying three-dimensional assistant addison interface for external environments

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17909249

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC , EPO FORM 1205A DATED 12.02.2020.

122 Ep: pct application non-entry in european phase

Ref document number: 17909249

Country of ref document: EP

Kind code of ref document: A1