WO2006110011A1 - Multimedia message service by mobile robot - Google Patents

Multimedia message service by mobile robot Download PDF

Info

Publication number
WO2006110011A1
WO2006110011A1 PCT/KR2006/001384 KR2006001384W WO2006110011A1 WO 2006110011 A1 WO2006110011 A1 WO 2006110011A1 KR 2006001384 W KR2006001384 W KR 2006001384W WO 2006110011 A1 WO2006110011 A1 WO 2006110011A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile robot
multimedia message
message
user
behavior
Prior art date
Application number
PCT/KR2006/001384
Other languages
French (fr)
Inventor
Changsu Lee
Shinyoung Park
Seongho Won
Kyunghee Han
Kyungjin Kim
Original Assignee
Sk Telecom Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sk Telecom Co., Ltd. filed Critical Sk Telecom Co., Ltd.
Publication of WO2006110011A1 publication Critical patent/WO2006110011A1/en

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J5/00—Manipulators mounted on wheels or on carriages
    • D—TEXTILES; PAPER
    • D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
    • D06M—TREATMENT, NOT PROVIDED FOR ELSEWHERE IN CLASS D06, OF FIBRES, THREADS, YARNS, FABRICS, FEATHERS OR FIBROUS GOODS MADE FROM SUCH MATERIALS
    • D06M11/00—Treating fibres, threads, yarns, fabrics or fibrous goods made from such materials, with inorganic substances or complexes thereof; Such treatment combined with mechanical treatment, e.g. mercerising
    • D06M11/77—Treating fibres, threads, yarns, fabrics or fibrous goods made from such materials, with inorganic substances or complexes thereof; Such treatment combined with mechanical treatment, e.g. mercerising with silicon or compounds thereof
    • D06M11/79—Treating fibres, threads, yarns, fabrics or fibrous goods made from such materials, with inorganic substances or complexes thereof; Such treatment combined with mechanical treatment, e.g. mercerising with silicon or compounds thereof with silicon dioxide, silicic acids or their salts
    • D—TEXTILES; PAPER
    • D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
    • D06M—TREATMENT, NOT PROVIDED FOR ELSEWHERE IN CLASS D06, OF FIBRES, THREADS, YARNS, FABRICS, FEATHERS OR FIBROUS GOODS MADE FROM SUCH MATERIALS
    • D06M11/00—Treating fibres, threads, yarns, fabrics or fibrous goods made from such materials, with inorganic substances or complexes thereof; Such treatment combined with mechanical treatment, e.g. mercerising
    • D06M11/32—Treating fibres, threads, yarns, fabrics or fibrous goods made from such materials, with inorganic substances or complexes thereof; Such treatment combined with mechanical treatment, e.g. mercerising with oxygen, ozone, ozonides, oxides, hydroxides or percompounds; Salts derived from anions with an amphoteric element-oxygen bond
    • D06M11/36—Treating fibres, threads, yarns, fabrics or fibrous goods made from such materials, with inorganic substances or complexes thereof; Such treatment combined with mechanical treatment, e.g. mercerising with oxygen, ozone, ozonides, oxides, hydroxides or percompounds; Salts derived from anions with an amphoteric element-oxygen bond with oxides, hydroxides or mixed oxides; with salts derived from anions with an amphoteric element-oxygen bond
    • D06M11/45—Oxides or hydroxides of elements of Groups 3 or 13 of the Periodic System; Aluminates
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/58—Message adaptation for wireless communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W24/00—Supervisory, monitoring or testing arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/12—Messaging; Mailboxes; Announcements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W8/00—Network data management
    • H04W8/18—Processing of user or subscriber data, e.g. subscribed services, user preferences or user profiles; Transfer of user or subscriber data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W80/00—Wireless network protocols or protocol adaptations to wireless operation

Definitions

  • the present invention relates to a multimedia message service system and method using a mobile robot, and more particularly to a multimedia message service system and method using a mobile robot recognizing and tracking a user, in which the mobile robot performs operation corresponding to content of a multimedia message, thereby enhancing a delivery effect of the multimedia message to the user.
  • Multimedia Messaging Service is defined in the international standard recommendations, 3 rd Generation Partnership Project (3GPP) Technical Specification (TS) 22.140 and 23.140, and is a service that allows text messages as well as various multimedia data such as voice, image, audio, and video data to be transmitted/received to/from a mobile communication terminal.
  • 3GPP 3 rd Generation Partnership Project
  • TS Technical Specification
  • MMS specified in the standard recommendations adopts a store and forward messaging system as a message transmission system.
  • a multimedia message is forwarded with content of media, information required to describe the media content, and information on an address for identifying a receiver of the message encapsulated together.
  • the multimedia message is forwarded from the terminal of a transmitter to an MMS center (MMSC) .
  • MMSC MMS center
  • the MMSC notifies the reception of the message to the terminal of a receiver.
  • the multimedia message stored in the MMSC is forwarded to the receiver terminal by request of the receiver.
  • the multimedia message is forwarded to the receiver terminal by interaction between MMS client and server mounted on the mobile communication terminal rather than by a callback Uniform Resource Locator (URL) .
  • URL Uniform Resource Locator
  • this multimedia message service can forward the multimedia message alone, but not a message containing another behavior due to limitation to a device.
  • multimedia e.g. Macromedia Flash
  • the message service provided by the robot also forwards the multimedia message from which a behavior of the robot is excluded as in the MMS. Due to the possibility of various behaviors, the robot can be used as a medium forwarding the multimedia message together with moving picture and music. In this case, the transmitter can forward its intent to the receiver with higher precision, and it is possible to perform more abundant communication compared to the conventional multimedia message service.
  • the present invention has been made in view of the above-mentioned problems, and it is an objective of the present invention to provide a multimedia message service system and method using a mobile robot recognizing and tracking a user, in which the mobile robot performs operation corresponding to content of a multimedia message, thereby enhancing a delivery effect of the multimedia message to the user.
  • a multimedia message service system comprising: a subscriber database storing information for certification, information on whether or not a subscriber owns a mobile robot, and information on whether or not a user is currently located at the same place as the mobile robot; a content database storing information on contents for constructing a multimedia message; a service server certifying a transmitter, referring to the subscriber database to check whether or not a service can be provided using information of a receiver which is input by the transmitter, and if the service can be provided, constructing the multimedia message, and transmitting both an operation command message of the mobile robot which is selectively input by the transmitter and the multimedia message to a wireless internet network; and the mobile robot controlling operation thereof based on the operation command message transmitted from the service server, synchronizing with a "main behavior" command message, which is prepared by synchronization with content of the multimedia message, among the operation command messages thereof, and playing back the transmitted multimedia message.
  • the mobile robot may include: a wireless communication means for providing radio access to the service server; a user recognition means for receiving a signal from a transmitter which the user carries with him/her to recognize an owner, and measuring direction and distance to the user; a speech recognition means for receiving and recognizing voice from the user; a media playback means for playing back the multimedia message; a memory means for storing programs and various pieces of information; a behavior and movement control means for controlling behavior and movement of the mobile robot; and a control means for, when the multimedia message and the operation command message of the mobile robot are received through the wireless communication means, analyzing the operation command message, delivering an operation control signal to the behavior and movement control means, synchronizing with the operation control signal corresponding to the "main behavior" command message, and instructing playback of the multimedia message using the media playback means.
  • a wireless communication means for providing radio access to the service server
  • a user recognition means for receiving a signal from a transmitter which the user carries with him/her to recognize an owner, and measuring direction and distance to the user
  • control means may transmit the control signal to the behavior and movement control means on the basis of information on the direction and distance to the user which is received from the user recognition means.
  • control means may periodically transmit to the service server a message notifying whether or not the user is currently located at the same place on the basis of information received from the user recognition means.
  • the operation command messages of the mobile robot may include a "prior behavior” operation command message defining the operation of the mobile robot when the mobile robot approaches the user, the "main behavior” operation command message defining the operation of the mobile robot when the multimedia message is played back, and a "post behavior” operation command message defining the operation of the mobile robot after the playback of the multimedia message is completed.
  • a multimedia message service method using a mobile robot comprising: a first step of looking up subscriber information of a receiver using receiver information input from a transmitter; a second step of, when in the first step the receiver owns the mobile robot, and the mobile robot is near the receiver, providing the transmitter with a list of commands for controlling operation of the mobile robot; a third step of transmitting a robot operation command message selected by the transmitter and a prepared multimedia message to the mobile robot; a fourth step of playing back the received multimedia message while controlling the operation and movement of the mobile robot on the basis of the operation command message which the mobile robot receives.
  • the fourth step may comprise the sub-steps of: detecting a location of the user while controlling the mobile robot on the basis of the "prior behavior" operation command message; playing back the multimedia message while controlling the mobile robot on the basis of the "main behavior” operation command message; and controlling the mobile robot on the basis of the "post behavior” operation command message.
  • FIG. 1 illustrates a schematic configuration of a multimedia message service system according to the present invention
  • FIG. 2 illustrates a detailed block configuration of a mobile robot according to the present invention
  • FIG. 3 is a processing flowchart for a multimedia message service at a service server according to the present invention.
  • FIG. 4 is a processing flowchart for a multimedia message service at a mobile robot according to the present invention.
  • FIG. 1 is a block configuration diagram of a multimedia message service system using a mobile robot, according to the present invention.
  • a multimedia message service server 11 is connected to a wireless internet network and an internet network.
  • a subscriber database (DB) 12 stores personal information about a subscriber, information for certification, information on whether or not a receiver owns a mobile robot, and so on.
  • a content DB 13 stores information on contents for preparing a multimedia message.
  • a transmitter prepares the multimedia message by accessing the service server 11, and selecting or directly inputting multimedia contents.
  • the service server 11 performs certification using an identifier of the transmitter first, and receives information of the receiver.
  • the service server 11 checks whether or not the receiver owns the mobile robot using the input receiver information. If the receiver does not own the mobile robot, a service according to the present invention is not provided, but an ordinary multimedia message service is only provided. In contrast, if the receiver owns the mobile robot, the service server 11 checks whether or not the receiver is at home together with the robot through an up-to-date record on which the mobile robot looks up members who are at home.
  • the service server 11 notifies the transmitter of checked final place and time of the receiver at the same time, thereby allows the transmitter to determine whether or not to transmit the message.
  • the service server 11 provides command lists to the transmitter so as to select any one of the command lists for instructing operation of the mobile robot of the receiver.
  • a behavior of the mobile robot is generally made up of three types.
  • the first type is a "prior behavior” that is a behavior when the mobile robot receives the multimedia message, and then approaches a user in order to notify the reception to the user.
  • a speed, a behavior, etc. of the mobile robot when approaching the receiver are determined by classification of the messages and selection of the user.
  • the mobile robot quietly approaches the receiver at a slow speed.
  • the mobile robot approaches the receiver at a fast speed.
  • the mobile robot moves while showing various behaviors without moving linearly.
  • the second type is a "main behavior" that is a behavior when the mobile robot plays back the multimedia message in order to forward the multimedia message to the receiver.
  • the multimedia message can be used in various types, for example, as a message utilizing a flash moving picture, a message utilizing a photograph etc., a text message, etc., and can be forwarded to the user.
  • the text message is forwarded to the user in a voice using Text To Speech (TTS)
  • TTS Text To Speech
  • the message utilizing the flash moving picture or the photograph is forwarded through a display unit 27.
  • the main behavior is performed upon playback of the multimedia message, and performs an operation which the user selects depending on content of the multimedia message.
  • the third type is a "post behavior" that prescribes a behavior when, after completing the playback of the multimedia message, the mobile robot moves to an original place before starting the playback of the multimedia message.
  • the post behavior is preferably configured to correspond to the prior behavior.
  • the transmitter can designate each of the "prior behavior, " the "main behavior, " and the "post behavior” of the mobile robot, and the multimedia message, and may designate all of them in the type of package in which the three types of behaviors and the multimedia message are all collected.
  • the service server 11 transmits a prepared multimedia message and a command message for instructing the operation of the mobile robot to the mobile robot 14 of the receiver through the wireless internet network.
  • the mobile robot 14 When receiving the multimedia message and the command message for instructing the operation of the mobile robot from the service server 11, the mobile robot 14 analyzes the command message, and then controls the operation of the mobile robot based on the command message, synchronizes with the "main behavior" to play back the multimedia message.
  • FIG. 2 illustrates a detailed block configuration of a mobile robot according to the present invention.
  • the mobile robot according to the present invention comprises a controller 21 controlling overall operation; a wireless communication module 22 getting the control of the controller 21, and setting a communication link with the service server 11; a user recognition wireless receiver 24 receiving a radio signal containing generic information of a user in order to recognize the user, calculating distance and angle between the mobile robot and the user, and providing the calculated results to the controller 21; a behavior and movement controller 23 receiving a control command from the controller 21, and moving the mobile robot or controlling movement of the mobile robot, a media player 25 getting the control of the controller 21, and playing a multimedia message; a speech recognizer 28 recognizing voice of the user; an input unit 26 getting the input of various data from the user; a display unit 27 displaying the various data into text and image; a memory 29 temporarily storing the various data; and a hard disk drive (HDD) 30 storing programs and data.
  • HDD hard disk drive
  • the mobile robot according to the present invention can discriminate the user.
  • the user has a transmitter originating a generic identifier.
  • the transmitter is attached to a thing which the user carries with him/her at all times.
  • the transmitter is preferably a wireless transmission device having a transmission output within about 5 meters.
  • the mobile robot receives a radio signal sent from the transmitter which the user carries with him/her, and identifies the generic identifier, thereby recognizing the user to be its owner. In other words, even when several radio signals are received, the mobile robot detects the generic identifier obtained through demodulation of the received radio signals, thereby checking a real owner, and estimating a location of the real owner.
  • the mobile robot has the user recognition wireless receiver 24.
  • the user recognition wireless receiver 24 calculates distance and angle between a wake-up call device and the user on the basis of the radio signal received from the wireless transmitter which the user carries with him/her, demodulates the radio signal, and provides the demodulated radio signal to the controller 21. Further, in order to allow the mobile robot to follow the user anytime at a fixed distance, the controller 21 provides information on moving direction and speed, and acceleration to the behavior and movement controller 23 on the basis of information of the distance and angle with respect to the user which is delivered from the user recognition wireless receiver 24 to the controller 21.
  • the controller 21 transmits current location information of the user which is received from the user recognition wireless receiver 24 to the service server through the wireless communication module by periods.
  • the mobile robot periodically transmits the current location information of the user in order to notify whether or not the user, its owner, is at home at the present time and, if not, that it is impossible to deliver the message to the user.
  • the wireless communication module 22 gets the control of the controller 21, and sets the communication link with the service server 11.
  • the wireless communication module 22 may be a typical mobile communication modem or wireless internet modem.
  • the HDD 30 can store programs and various pieces of information for playback, both of which are for operating the mobile robot, indoor map information and various data.
  • the display unit 27 may be a typical liquid crystal display
  • the input unit 26 may be a touch screen or keypad for the user inputting the data.
  • the media player 25 includes typical video and audio codecs. A detailed operation of the controller 21 will be described with reference to FIG. 4.
  • FIG. 3 is a processing flowchart of a service server according to the present invention.
  • the service server when a transmitter accesses the service server through a terminal (SlOl) , the service server performs certification of a user on the transmitter (S102) .
  • the user certification can be performed using an identifier of the transmitter or transmitter's terminal.
  • the service server receives information about a receiver which the transmitter inputs (S103), and looks up a subscriber DB (S104) . As a result of the lookup, when the receiver does not own the mobile robot (S105) , the service server provides an ordinary multimedia message service (S106) .
  • the service server provides various pieces of information to the transmitter so as to prepare a multimedia message, as well as a list of commands for instructing operation of the mobile robot.
  • the service server can know whether or not the mobile robot is located at the same place as the receiver, on the basis of the information periodically transmitted from the mobile robot.
  • the transmitter constructs a command message instructing the operation of the mobile robot which corresponds with content of the multimedia message which the transmitter intends to deliver to the receiver (S107).
  • the transmitter can designate each of "prior behavior," "main behavior,” and "post behavior” of the mobile robot, and the multimedia message, and may designate all of them in the type of package in which the three types of behaviors and the multimedia message are all collected.
  • the service server detects an identifier of the mobile robot
  • a method of transmitting the multimedia message to the service server makes use of a typical method according to a wireless communication means.
  • a wireless communication means e.g. a Wireless Broadband (WiBro) service
  • the multimedia message is transmitted using a typical TCP/IP protocol.
  • the multimedia message is transmitted using a method of transmitting it to a mobile communication terminal, and preferably a method of transmitting it through an MMS client.
  • the robot it is preferable for the robot to automatically receive the multimedia message through interaction with the server, and play back it immediately.
  • FIG. 4 is a processing flowchart of a mobile robot according to the present invention.
  • the mobile robot When receiving a multimedia message on standby (S201) , the mobile robot stores the received multimedia message, and checks whether or not a command message instructing operation of the mobile robot is contained. If the command message instructing the operation is not contained, the mobile robot performs an ordinary process of receiving the multimedia message (S203) .
  • the mobile robot analyzes content of the command message (S204). Then, the mobile robot moves on the basis of a command instructing a "prior behavior," and detects the location of a user (S205) . In other words, the mobile robot moves on the basis of the command message instructing the prior behavior, and detects a current location of the user.
  • its prior behavior is defined in various types according to content of the multimedia message. For example, the prior behavior for delivering the multimedia message of a smooth feeling is defined in a type in which the maximum speed and acceleration during movement can deliver the smooth feeling in order to deliver smooth movement.
  • the prior behavior for delivering the multimedia message of a strong feeling is defined in a type in which the maximum speed and acceleration correspond to the strong feeling.
  • the operation of the mobile robot is controlled on the basis of a command message that is for instructing a main behavior and synchronizes with the content of the multimedia message, and at the same time the multimedia message is played back (S206).
  • the mobile robot When the playback of the multimedia message is completed (S207), the mobile robot is controlled on the basis of a command instructing a post behavior, and moves to a place before the multimedia message is played back (S208). Then, the mobile robot is transited into a standby state. At this time, the post behavior is defined in various types according to the content of the multimedia message, as in the prior behavior.
  • the present invention concurrently shows the operation of the mobile robot according to the command instructed by the user in delivering the multimedia message to the user, so that it is possible to multiply delivery effects of the multimedia message, and arouse the interest of the service users.

Abstract

Disclosed is a multimedia message service system and method using a mobile robot recognizing and tracking a user, in which the mobile robot performs operation corresponding to content of a multimedia message, thereby enhancing a delivery effect of the multimedia message to the user. The multimedia message service system includes a subscriber database storing information for certification, information on whether or not a subscriber owns a mobile robot, and information on whether or not a user is currently located at the same place as the mobile robot; a content database storing information on contents for constructing a multimedia message; a service server certifying a transmitter, referring to the subscriber database to check whether or not a service can be provided using information of a receiver which is input by the transmitter, and if the service can be provided, constructing the multimedia message, and transmitting both an operation command message of the mobile robot which is selectively input by the transmitter and the multimedia message to a wireless internet network; and the mobile robot controlling operation thereof based on the operation command message transmitted from the service server, synchronizing with a 'main behavior' command message, which is prepared by synchronization with content of the multimedia message, among the operation command messages thereof, and playing back the transmitted multimedia message.

Description

Multimedia Message Service by Mobile Robot
Technical Field
The present invention relates to a multimedia message service system and method using a mobile robot, and more particularly to a multimedia message service system and method using a mobile robot recognizing and tracking a user, in which the mobile robot performs operation corresponding to content of a multimedia message, thereby enhancing a delivery effect of the multimedia message to the user.
Background Art
In general, Multimedia Messaging Service (MMS) is defined in the international standard recommendations, 3rd Generation Partnership Project (3GPP) Technical Specification (TS) 22.140 and 23.140, and is a service that allows text messages as well as various multimedia data such as voice, image, audio, and video data to be transmitted/received to/from a mobile communication terminal.
MMS specified in the standard recommendations adopts a store and forward messaging system as a message transmission system. A multimedia message is forwarded with content of media, information required to describe the media content, and information on an address for identifying a receiver of the message encapsulated together. The multimedia message is forwarded from the terminal of a transmitter to an MMS center (MMSC) . The MMSC notifies the reception of the message to the terminal of a receiver. The multimedia message stored in the MMSC is forwarded to the receiver terminal by request of the receiver. Recently, owing to development of MMS and wireless Internet, the multimedia message is forwarded to the receiver terminal by interaction between MMS client and server mounted on the mobile communication terminal rather than by a callback Uniform Resource Locator (URL) .
However, this multimedia message service can forward the multimedia message alone, but not a message containing another behavior due to limitation to a device. With a conventional robot, it has been possible to provide the message service utilizing multimedia (e.g. Macromedia Flash) . However, the message service provided by the robot also forwards the multimedia message from which a behavior of the robot is excluded as in the MMS. Due to the possibility of various behaviors, the robot can be used as a medium forwarding the multimedia message together with moving picture and music. In this case, the transmitter can forward its intent to the receiver with higher precision, and it is possible to perform more abundant communication compared to the conventional multimedia message service.
_ 9 _ Disclosure of the Invention
Therefore, the present invention has been made in view of the above-mentioned problems, and it is an objective of the present invention to provide a multimedia message service system and method using a mobile robot recognizing and tracking a user, in which the mobile robot performs operation corresponding to content of a multimedia message, thereby enhancing a delivery effect of the multimedia message to the user.
According to an aspect of the present invention, there is provided a multimedia message service system comprising: a subscriber database storing information for certification, information on whether or not a subscriber owns a mobile robot, and information on whether or not a user is currently located at the same place as the mobile robot; a content database storing information on contents for constructing a multimedia message; a service server certifying a transmitter, referring to the subscriber database to check whether or not a service can be provided using information of a receiver which is input by the transmitter, and if the service can be provided, constructing the multimedia message, and transmitting both an operation command message of the mobile robot which is selectively input by the transmitter and the multimedia message to a wireless internet network; and the mobile robot controlling operation thereof based on the operation command message transmitted from the service server, synchronizing with a "main behavior" command message, which is prepared by synchronization with content of the multimedia message, among the operation command messages thereof, and playing back the transmitted multimedia message. Preferably, the mobile robot may include: a wireless communication means for providing radio access to the service server; a user recognition means for receiving a signal from a transmitter which the user carries with him/her to recognize an owner, and measuring direction and distance to the user; a speech recognition means for receiving and recognizing voice from the user; a media playback means for playing back the multimedia message; a memory means for storing programs and various pieces of information; a behavior and movement control means for controlling behavior and movement of the mobile robot; and a control means for, when the multimedia message and the operation command message of the mobile robot are received through the wireless communication means, analyzing the operation command message, delivering an operation control signal to the behavior and movement control means, synchronizing with the operation control signal corresponding to the "main behavior" command message, and instructing playback of the multimedia message using the media playback means.
Preferably, the control means may transmit the control signal to the behavior and movement control means on the basis of information on the direction and distance to the user which is received from the user recognition means.
Preferably, the control means may periodically transmit to the service server a message notifying whether or not the user is currently located at the same place on the basis of information received from the user recognition means.
Preferably, the operation command messages of the mobile robot may include a "prior behavior" operation command message defining the operation of the mobile robot when the mobile robot approaches the user, the "main behavior" operation command message defining the operation of the mobile robot when the multimedia message is played back, and a "post behavior" operation command message defining the operation of the mobile robot after the playback of the multimedia message is completed.
According to another aspect of the present invention, there is provided a multimedia message service method using a mobile robot, comprising: a first step of looking up subscriber information of a receiver using receiver information input from a transmitter; a second step of, when in the first step the receiver owns the mobile robot, and the mobile robot is near the receiver, providing the transmitter with a list of commands for controlling operation of the mobile robot; a third step of transmitting a robot operation command message selected by the transmitter and a prepared multimedia message to the mobile robot; a fourth step of playing back the received multimedia message while controlling the operation and movement of the mobile robot on the basis of the operation command message which the mobile robot receives.
Preferably, the fourth step may comprise the sub-steps of: detecting a location of the user while controlling the mobile robot on the basis of the "prior behavior" operation command message; playing back the multimedia message while controlling the mobile robot on the basis of the "main behavior" operation command message; and controlling the mobile robot on the basis of the "post behavior" operation command message.
Brief Description of the Drawings
The foregoing and other objects, features and advantages of the present invention will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings in which:
FIG. 1 illustrates a schematic configuration of a multimedia message service system according to the present invention; FIG. 2 illustrates a detailed block configuration of a mobile robot according to the present invention; FIG. 3 is a processing flowchart for a multimedia message service at a service server according to the present invention; and
FIG. 4 is a processing flowchart for a multimedia message service at a mobile robot according to the present invention.
Best Mode for Carrying Out the Invention
Reference will now be made in detail to the preferred embodiments of the present invention.
FIG. 1 is a block configuration diagram of a multimedia message service system using a mobile robot, according to the present invention. A multimedia message service server 11 is connected to a wireless internet network and an internet network. A subscriber database (DB) 12 stores personal information about a subscriber, information for certification, information on whether or not a receiver owns a mobile robot, and so on. A content DB 13 stores information on contents for preparing a multimedia message.
A transmitter prepares the multimedia message by accessing the service server 11, and selecting or directly inputting multimedia contents. When the transmitter accesses the service server 11 through the wireless internet network or the internet network, the service server 11 performs certification using an identifier of the transmitter first, and receives information of the receiver. The service server 11 checks whether or not the receiver owns the mobile robot using the input receiver information. If the receiver does not own the mobile robot, a service according to the present invention is not provided, but an ordinary multimedia message service is only provided. In contrast, if the receiver owns the mobile robot, the service server 11 checks whether or not the receiver is at home together with the robot through an up-to-date record on which the mobile robot looks up members who are at home. This information is also included in the receiver information together with the information on whether or not the receiver owns the mobile robot. The service server 11 notifies the transmitter of checked final place and time of the receiver at the same time, thereby allows the transmitter to determine whether or not to transmit the message. In order to provide the multimedia service according to the present invention, the service server 11 provides command lists to the transmitter so as to select any one of the command lists for instructing operation of the mobile robot of the receiver.
A behavior of the mobile robot is generally made up of three types. The first type is a "prior behavior" that is a behavior when the mobile robot receives the multimedia message, and then approaches a user in order to notify the reception to the user. A speed, a behavior, etc. of the mobile robot when approaching the receiver are determined by classification of the messages and selection of the user. In the case of being classified into a message of surprise, the mobile robot quietly approaches the receiver at a slow speed. In the case of being classified into a message of love expression, the mobile robot approaches the receiver at a fast speed. In order to show a message of pleasure, the mobile robot moves while showing various behaviors without moving linearly.
The second type is a "main behavior" that is a behavior when the mobile robot plays back the multimedia message in order to forward the multimedia message to the receiver. The multimedia message can be used in various types, for example, as a message utilizing a flash moving picture, a message utilizing a photograph etc., a text message, etc., and can be forwarded to the user. For example, the text message is forwarded to the user in a voice using Text To Speech (TTS) , and the message utilizing the flash moving picture or the photograph is forwarded through a display unit 27. In practice, the main behavior is performed upon playback of the multimedia message, and performs an operation which the user selects depending on content of the multimedia message. The third type is a "post behavior" that prescribes a behavior when, after completing the playback of the multimedia message, the mobile robot moves to an original place before starting the playback of the multimedia message. The post behavior is preferably configured to correspond to the prior behavior. The transmitter can designate each of the "prior behavior, " the "main behavior, " and the "post behavior" of the mobile robot, and the multimedia message, and may designate all of them in the type of package in which the three types of behaviors and the multimedia message are all collected.
When the list of commands for controlling the operation of the mobile robot of the receiver is selected, the service server 11 transmits a prepared multimedia message and a command message for instructing the operation of the mobile robot to the mobile robot 14 of the receiver through the wireless internet network.
When receiving the multimedia message and the command message for instructing the operation of the mobile robot from the service server 11, the mobile robot 14 analyzes the command message, and then controls the operation of the mobile robot based on the command message, synchronizes with the "main behavior" to play back the multimedia message.
FIG. 2 illustrates a detailed block configuration of a mobile robot according to the present invention. The mobile robot according to the present invention comprises a controller 21 controlling overall operation; a wireless communication module 22 getting the control of the controller 21, and setting a communication link with the service server 11; a user recognition wireless receiver 24 receiving a radio signal containing generic information of a user in order to recognize the user, calculating distance and angle between the mobile robot and the user, and providing the calculated results to the controller 21; a behavior and movement controller 23 receiving a control command from the controller 21, and moving the mobile robot or controlling movement of the mobile robot, a media player 25 getting the control of the controller 21, and playing a multimedia message; a speech recognizer 28 recognizing voice of the user; an input unit 26 getting the input of various data from the user; a display unit 27 displaying the various data into text and image; a memory 29 temporarily storing the various data; and a hard disk drive (HDD) 30 storing programs and data.
The mobile robot according to the present invention can discriminate the user. To this end, the user has a transmitter originating a generic identifier. The transmitter is attached to a thing which the user carries with him/her at all times. The transmitter is preferably a wireless transmission device having a transmission output within about 5 meters. The mobile robot receives a radio signal sent from the transmitter which the user carries with him/her, and identifies the generic identifier, thereby recognizing the user to be its owner. In other words, even when several radio signals are received, the mobile robot detects the generic identifier obtained through demodulation of the received radio signals, thereby checking a real owner, and estimating a location of the real owner.
For this purpose, the mobile robot according to the present invention has the user recognition wireless receiver 24. The user recognition wireless receiver 24 calculates distance and angle between a wake-up call device and the user on the basis of the radio signal received from the wireless transmitter which the user carries with him/her, demodulates the radio signal, and provides the demodulated radio signal to the controller 21. Further, in order to allow the mobile robot to follow the user anytime at a fixed distance, the controller 21 provides information on moving direction and speed, and acceleration to the behavior and movement controller 23 on the basis of information of the distance and angle with respect to the user which is delivered from the user recognition wireless receiver 24 to the controller 21.
The controller 21 transmits current location information of the user which is received from the user recognition wireless receiver 24 to the service server through the wireless communication module by periods. In other words, the mobile robot periodically transmits the current location information of the user in order to notify whether or not the user, its owner, is at home at the present time and, if not, that it is impossible to deliver the message to the user.
The wireless communication module 22 gets the control of the controller 21, and sets the communication link with the service server 11. Here, the wireless communication module 22 may be a typical mobile communication modem or wireless internet modem.
The HDD 30 can store programs and various pieces of information for playback, both of which are for operating the mobile robot, indoor map information and various data.
The display unit 27 may be a typical liquid crystal display
(LCD) , and displays information relating to the operation of the mobile robot, received multimedia information, and so on. The input unit 26 may be a touch screen or keypad for the user inputting the data. The media player 25 includes typical video and audio codecs. A detailed operation of the controller 21 will be described with reference to FIG. 4.
FIG. 3 is a processing flowchart of a service server according to the present invention.
First, when a transmitter accesses the service server through a terminal (SlOl) , the service server performs certification of a user on the transmitter (S102) . The user certification can be performed using an identifier of the transmitter or transmitter's terminal.
When the user certification ends in success, the service server receives information about a receiver which the transmitter inputs (S103), and looks up a subscriber DB (S104) . As a result of the lookup, when the receiver does not own the mobile robot (S105) , the service server provides an ordinary multimedia message service (S106) .
Meanwhile, when the receiver owns the mobile robot, and is located at the same place as the mobile robot (S105) , the service server provides various pieces of information to the transmitter so as to prepare a multimedia message, as well as a list of commands for instructing operation of the mobile robot. The service server can know whether or not the mobile robot is located at the same place as the receiver, on the basis of the information periodically transmitted from the mobile robot. The transmitter constructs a command message instructing the operation of the mobile robot which corresponds with content of the multimedia message which the transmitter intends to deliver to the receiver (S107). At this time, the transmitter can designate each of "prior behavior," "main behavior," and "post behavior" of the mobile robot, and the multimedia message, and may designate all of them in the type of package in which the three types of behaviors and the multimedia message are all collected.
When the preparation of the multimedia message to be transmitted is completed, and when the command message instructing the operation of the mobile robot is constructed, the service server detects an identifier of the mobile robot
(e.g. a phone number or IP address) (S108), and then transmits the prepared multimedia message and the command message instructing the operation of the mobile robot to the mobile robot (S109) .
Although the above-described embodiment has been described to detect the information of the receiver and then prepare the multimedia message, it may prepare the multimedia message, input the information of the receiver, and select the command message instructing the operation of the mobile robot to the mobile robot.
A method of transmitting the multimedia message to the service server makes use of a typical method according to a wireless communication means. Specifically, in the case of using ordinary wireless internet technology (e.g. a Wireless Broadband (WiBro) service) , the multimedia message is transmitted using a typical TCP/IP protocol. In the case of using a mobile communication network based on a cellular communication system, the multimedia message is transmitted using a method of transmitting it to a mobile communication terminal, and preferably a method of transmitting it through an MMS client. In other words, it is preferable for the robot to automatically receive the multimedia message through interaction with the server, and play back it immediately.
FIG. 4 is a processing flowchart of a mobile robot according to the present invention.
When receiving a multimedia message on standby (S201) , the mobile robot stores the received multimedia message, and checks whether or not a command message instructing operation of the mobile robot is contained. If the command message instructing the operation is not contained, the mobile robot performs an ordinary process of receiving the multimedia message (S203) .
In contrast, if the command message instructing the operation is contained (S202), the mobile robot analyzes content of the command message (S204). Then, the mobile robot moves on the basis of a command instructing a "prior behavior," and detects the location of a user (S205) . In other words, the mobile robot moves on the basis of the command message instructing the prior behavior, and detects a current location of the user. When the mobile robot approaches the user, its prior behavior is defined in various types according to content of the multimedia message. For example, the prior behavior for delivering the multimedia message of a smooth feeling is defined in a type in which the maximum speed and acceleration during movement can deliver the smooth feeling in order to deliver smooth movement. The prior behavior for delivering the multimedia message of a strong feeling is defined in a type in which the maximum speed and acceleration correspond to the strong feeling. When the current location of the user is detected, the operation of the mobile robot is controlled on the basis of a command message that is for instructing a main behavior and synchronizes with the content of the multimedia message, and at the same time the multimedia message is played back (S206).
When the playback of the multimedia message is completed (S207), the mobile robot is controlled on the basis of a command instructing a post behavior, and moves to a place before the multimedia message is played back (S208). Then, the mobile robot is transited into a standby state. At this time, the post behavior is defined in various types according to the content of the multimedia message, as in the prior behavior.
Although the invention has been shown and described with reference to exemplary embodiments thereof, it will be apparent to those skilled in the art that various changes in form and details may be made therein without departing from the scope and spirit of the invention as disclosed in the accompanying claims. Accordingly, it should be understood that the above-described embodiments are illustrative rather than restrictive in all aspects. In other words, the scope of the invention is represented by the claims below, rather than the detailed description, and thus all changes or modifications derived from the meanings and scope of the claims, and their equivalent concepts should be interpreted as falling within the scope of the present invention. Industrial Applicability
As can be seen from the foregoing, according to the present invention concurrently shows the operation of the mobile robot according to the command instructed by the user in delivering the multimedia message to the user, so that it is possible to multiply delivery effects of the multimedia message, and arouse the interest of the service users.

Claims

Claims
1. A multimedia message service system comprising: a subscriber database storing information for certification, information on whether or not a subscriber owns a mobile robot, and information on whether or not a user is currently located at the same place as the mobile robot ; a content database storing information on contents for constructing a multimedia message; a service server certifying a transmitter, referring to the subscriber database to check whether or not a service can be provided using information of a receiver which is input by the transmitter, and if the service can be provided, constructing the multimedia message, and transmitting both an operation command message of the mobile robot which is selectively input by the transmitter and the multimedia message to a wireless internet network; and the mobile robot controlling operation thereof based on the operation command message transmitted from the service server, synchronizing with a "main behavior" command message, which is prepared by synchronization with content of the multimedia message, among the operation command messages thereof, and playing back the transmitted multimedia message.
2. The multimedia message service system according to claim 1, wherein the mobile robot includes: a wireless communication means for providing radio access to the service server; a user recognition means for receiving a signal from a transmitter which the user carries with him/her to recognize an owner, and measuring direction and distance to the user; a speech recognition means for receiving and recognizing voice from the user; a media playback means for playing back the multimedia message; a memory means for storing programs and various pieces of information; a behavior and movement control means for controlling behavior and movement of the mobile robot; and a control means for, when the multimedia message and the operation command message of the mobile robot are received through the wireless communication means, analyzing the operation command message, delivering an operation control signal to the behavior and movement control means, synchronizing with the operation control signal corresponding to the "main behavior" command message, and instructing playback of the multimedia message using the media playback means.
3. The multimedia message service system according to claim 1 or 2, wherein the control means transmits the control signal to the behavior and movement control means on the basis of information on the direction and distance to the user which is received from the user recognition means.
4. The multimedia message service system according to claim 1 or 2, wherein the control means periodically transmits to the service server a message notifying whether or not the user is currently located at the same place on the basis of information received from the user recognition means .
5. The multimedia message service system according to claim 3, wherein the operation command messages of the mobile robot include a "prior behavior" operation command message defining the operation of the mobile robot when the mobile robot approaches the user, the "main behavior" operation command message defining the operation of the mobile robot when the multimedia message is played back, and a "post behavior" operation command message defining the operation of the mobile robot after the playback of the multimedia message is completed.
6. A multimedia message service method using a mobile robot, comprising: a first step of looking up subscriber information of a receiver using receiver information input from a transmitter; a second step of, when in the first step the receiver owns the mobile robot, and the mobile robot is near the receiver, providing the transmitter with a list of commands for controlling operation of the mobile robot; a third step of transmitting a robot operation command message selected by the transmitter and a prepared multimedia message to the mobile robot; a fourth step of playing back the received multimedia message while controlling the operation and movement of the mobile robot on the basis of the operation command message which the mobile robot receives.
7. The multimedia message service method according to claim 6, wherein the operation command messages of the mobile robot include a "prior behavior" operation command message defining the operation of the mobile robot when the mobile robot approaches a user, a "main behavior" operation command message defining the operation of the mobile robot when the multimedia message is played back, and a "post behavior" operation command message defining the operation of the mobile robot after the playback of the multimedia message is completed.
8. The multimedia message service method according to claim 7, wherein the fourth step comprises the sub-steps of: detecting a location of the user while controlling the mobile robot on the basis of the "prior behavior" operation command message; playing back the multimedia message while controlling the mobile robot on the basis of the "main behavior" operation command message; and controlling the mobile robot on the basis of the "post behavior" operation command message.
9. The multimedia message service method according to claim 8, further comprising a step of collecting, by the mobile robot, information about the user prior to the first step, and periodically transmitting information on a current location of the user to a service server.
PCT/KR2006/001384 2005-04-14 2006-04-14 Multimedia message service by mobile robot WO2006110011A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2005-0030918 2005-04-14
KR1020050030918A KR100627851B1 (en) 2005-04-14 2005-04-14 Multimedia message service by mobile robot

Publications (1)

Publication Number Publication Date
WO2006110011A1 true WO2006110011A1 (en) 2006-10-19

Family

ID=37087252

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2006/001384 WO2006110011A1 (en) 2005-04-14 2006-04-14 Multimedia message service by mobile robot

Country Status (2)

Country Link
KR (1) KR100627851B1 (en)
WO (1) WO2006110011A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7805131B2 (en) 2007-05-03 2010-09-28 Sonus Networks, Inc. Personal service integration on a network
US11057236B2 (en) 2019-01-09 2021-07-06 Disney Enterprises, Inc. Systems and methods for interactive responses by toys and other connected devices

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101064948B1 (en) 2008-12-10 2011-09-16 한국전자통신연구원 Home network service method using of ubiquitious robotic companion
KR101629442B1 (en) * 2014-04-30 2016-06-10 주식회사 엘지유플러스 Method and system for providing communication service using figure
WO2016137049A1 (en) * 2015-02-24 2016-09-01 주식회사 한컴 Cheering service using cheering robot, and method therefor
US10064006B2 (en) * 2016-08-26 2018-08-28 Microsoft Technology Licensing, Llc Location based access control for artificial conversational entities

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1122038A1 (en) * 1998-06-23 2001-08-08 Sony Corporation Robot and information processing system
KR20010091843A (en) * 2000-03-15 2001-10-23 김덕우 System and Method for Providing Information Service for Character Doll and the Character Doll Suitable for the Same
KR20020025159A (en) * 2002-03-12 2002-04-03 변승환 Interactive communication apparatus using robot
WO2004036932A2 (en) * 2002-10-18 2004-04-29 Jean-Pierre Garnier Information transmission system and method using, for example, sms
JP2004230479A (en) * 2003-01-28 2004-08-19 Advanced Telecommunication Research Institute International Communication robot and communication system using the same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1122038A1 (en) * 1998-06-23 2001-08-08 Sony Corporation Robot and information processing system
KR20010091843A (en) * 2000-03-15 2001-10-23 김덕우 System and Method for Providing Information Service for Character Doll and the Character Doll Suitable for the Same
KR20020025159A (en) * 2002-03-12 2002-04-03 변승환 Interactive communication apparatus using robot
WO2004036932A2 (en) * 2002-10-18 2004-04-29 Jean-Pierre Garnier Information transmission system and method using, for example, sms
JP2004230479A (en) * 2003-01-28 2004-08-19 Advanced Telecommunication Research Institute International Communication robot and communication system using the same

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7805131B2 (en) 2007-05-03 2010-09-28 Sonus Networks, Inc. Personal service integration on a network
US11057236B2 (en) 2019-01-09 2021-07-06 Disney Enterprises, Inc. Systems and methods for interactive responses by toys and other connected devices

Also Published As

Publication number Publication date
KR100627851B1 (en) 2006-09-26

Similar Documents

Publication Publication Date Title
US8346862B2 (en) Mobile communication terminal and method
JP5027229B2 (en) Subscriber unit for cellular communication system
CN1984413B (en) Mobile terminal for sending and receiving contents using message service and methods thereof
US8171516B2 (en) Methods, systems, and storage mediums for providing multi-viewpoint media sharing of proximity-centric content
US9565551B2 (en) Systems, methods, circuits and associated software for augmenting contact details stored on a communication device with data relating to the contact contained on social networking sites
JP4407555B2 (en) Communication terminal
US20060161872A1 (en) Marking and/or sharing media stream in the cellular network terminal
CN101681462A (en) Method, apparatus, and computer program product for determining user status indicators
CN106101756A (en) Barrage display packing, barrage adding method, Apparatus and system
CA2916110C (en) Group management method and server in mobile social network service application
CN102158822A (en) User equipment and information sending method
CN104796743A (en) Content item display system, method and device
CN104303492B (en) Voice note in seamless call
WO2006110011A1 (en) Multimedia message service by mobile robot
JP5305493B2 (en) Server, communication terminal, and device linkage system including them
CN106506437B (en) Audio data processing method and device
CN103220310A (en) Calling card exchange method and terminal and calling card server used for calling card exchange
US8140093B2 (en) Wireless landmark-based operation of a wireless device
WO2010092484A2 (en) Employment of a text message by a user of a first mobile telephone to invoke a process that provides information to a user of a second mobile telephone
CN109194998A (en) Data transmission method, device, electronic equipment and computer-readable medium
KR100806354B1 (en) Data processing system and method using of a mobile phone
CN107039054B (en) The way of recording and device
CN106899882B (en) Video progress update method and terminal
CN110169107A (en) A kind of method and device for realizing wireless network edge calculations
KR20020061697A (en) Providing method for morning call service using a mobile station

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC

122 Ep: pct application non-entry in european phase

Ref document number: 06757451

Country of ref document: EP

Kind code of ref document: A1