TWI503099B - Multimodal interpersonal communication system for home telehealth with telepresence robot - Google Patents

Description

Remote home-based robot for remote home care in multi-person interaction system

BACKGROUND OF THE INVENTION 1. Field of the Invention This invention relates to a robot, and more particularly to a robot and system thereof that incorporates a portable device, and a remotely controlled combined portable device.

Robots are a common name for robots. Robots include everything that simulates human behavior or ideas and simulates other creatures (such as robotic dogs, robot cats, etc.). There are many classifications and controversies in the definition of robots in the narrow sense. Some computer programs are even called robots. In contemporary industry, robots are man-made machine devices that automate tasks to replace or assist humans.

Today, for humans, work that is too dirty, too dangerous, too fine, too heavy, or too boring is often done by robots. Many industrial robots are used in production lines in manufacturing plants. Other applications include: injection molding, construction, oil drilling, ore mining, space exploration, underwater exploration, poison removal, search and rescue, medicine, military. Fields, etc.

However, according to the current technology, the robot has not been further studied for the application of remote care or remote interaction, and the solution to the human psychology has not been deeply studied. The applicant has been deeply involved in the field of robots for many years, and has proposed solutions to the needs of human body and mind, and accordingly filed patent applications according to law.

The present invention provides a multi-personal interactive communication system that allows a near-end user to have a sense of presence in contact with a remote user through the robot.

The invention further provides a multi-person interactive communication system, which enables a remote user to make an action instruction to the robot combined with the portable device through a robot combined with the portable device, so that the combination of the near-end user can be The robot carrying the device makes an action corresponding to an instruction issued by the remote user.

The invention proposes a multi-person interactive communication system, which comprises a remote server and a robot combined with a portable device. The robot combined with the portable device includes a body and a portable device. The body is configured with a wireless transmission device, wherein the wireless transmission device uses a wireless transmission protocol for communication. When the portable device is placed on the body, the wireless transmission device communicates with the portable device via a wireless transmission protocol. The portable device is connected to the remote server through a wireless network, and the remote server controls the robot combined with the portable device through the wireless network.

According to the multi-person interactive communication system according to the preferred embodiment of the present invention, the robot combined with the portable device further includes a physiological signal detecting device. The physiological signal detecting device performs physiological detection on a near-end user, and transmits the detected physiological data to the remote server.

According to the multiplex interactive communication system of the preferred embodiment of the present invention, the remote server includes an action capture device for capturing the action of a remote user. Wherein, when the remote user makes an action, the action capture device transmits the action data to the remote server, and the remote server transmits the action data to the portable device through the wireless network, which is portable The device controls the making of the robot combined with the portable device according to the data of the action The remote user has essentially the same action.

The present invention additionally provides a multi-personal interactive communication system including a first robot incorporating a portable device and a second robot incorporating a portable device. The first combined robot of the portable device includes a first body and a first portable device. The first body is configured with a first wireless transmission device, wherein the first wireless transmission device uses a first wireless transmission protocol for communication. When the first portable device is placed on the first body, the first wireless transmission device communicates with the first portable device through the first wireless transmission protocol.

The second combined robot of the portable device includes a second body, a second portable device and a motion detector. The second body is configured with a second wireless transmission device, wherein the second wireless transmission device uses a second wireless transmission protocol for communication. When the second portable device is placed on the second body, the second wireless transmission device communicates with the second portable device through the second wireless transmission protocol. The second robot combined with the portable device connects the first combined robot of the portable device through a wireless network. When the remote user touches the motion detector, the second robot that combines the portable device transmits the motion data of the remote user to the first robot combined with the portable device through the wireless network, when the first combined portable device The robot receives the motion data of the remote user, and the first robot combined with the portable device performs a corresponding action according to the motion data of the remote user.

The spirit of the present invention is primarily to design an interactive control system for a robot incorporating a portable device for remote care and to monitor a physiological information of the user of the robot. Moreover, the multi-personal interactive communication system proposed by the present invention enables a remote user to make a near control The robot of the end user's combined tablet computer performs substantially the same action as the remote user to further realize the realism of the robot simulation. In addition, with the features of the present invention, the remote user can also interact or interact with the near-end user through the wireless network.

The detailed description of the present invention and the accompanying drawings are to be understood by the claims The scope is subject to any restrictions.

In the following, the invention will be described in detail by the embodiments of the invention, and the same reference numerals are used in the drawings.

First embodiment

1 is a block diagram showing a robot interaction system according to a first embodiment of the present invention. Referring to FIG. 1, the interactive system includes a robot 110 in combination with a portable device and a remote server 120. The robot 110 incorporating the portable device includes a body 101, a carrying device 102, and a connector 103. The body 101 is configured with a wireless transmission device 105, wherein the wireless transmission device 105 uses a wireless transmission protocol for communication, such as Bluetooth, Zigbee and IEEE 802.11b/g, and the like. The carrier device 102 is configured and connected to the body 101 for carrying or moving the body 101. The connector 103 is disposed above the body and includes a triggering component 106, such as a push switch. When a portable device 107 is placed on the connector 103, the triggering element 106 is triggered (the switch is turned on or depressed), and the wireless transmission device 105 transmits the wireless transmission protocol. The carrying device 107 communicates and activates a built-in control software inside the portable device 107. The portable device 107 is, for example, a lithographic computer or a smart phone. The robot 110 of the present invention in combination with the portable device may be mobile or non-mobilizable. Therefore, the carrying device 102 may be, for example, only a base for carrying the body 101. Alternatively, the carrier device 102 may also have mobility means such as a tire or mechanical foot or the like.

The robot 110 combined with the portable device is connected to a remote server 120 through a wireless network, and the remote server 120 controls the moving position and action of the robot 110 combined with the portable device and the portable device through the wireless network. 107. In order to make the "interactive" function better, when the portable device 107 activates the internal built-in control software, the display screen of the portable device 107 follows a facial expression. The user of the remote server 120 can execute an instruction to determine the facial expression displayed by the portable device 107 to indicate the expression of the remote user to achieve the interaction with the near-end user.

For convenience of description of the present embodiment, the design of the robot 110 incorporating the portable device described above is illustrated in Figures 2a, 2b and 2c. 2a is a 3D perspective view of a robot incorporating a portable device according to a first embodiment of the present invention. Figure 2b is a side elevational view of the robot incorporating the portable device in accordance with the first embodiment of the present invention. Figure 2c is a front elevational view of the robot incorporating the portable device in accordance with the first embodiment of the present invention. The above-mentioned robot combined with the portable device is a prototype (Prototype) developed by the applicant himself. A portable device 107 can be disposed above it. When the portable device 107 is placed on the interactive robot, the interactive robot is activated by the triggering element 106 being triggered, and the interactive robot connects the portable device 107, for example, using Bluetooth. In addition, this The interactive robot also includes a pair of robotic arms for performing motion commands issued by the remote server, such as waving, hugging, raising hands or hiding faces, and the like.

The carrying device 201 of this interactive robot, in this embodiment, is two tires and a tire driving device for driving the above two tires so that the robot can achieve 360 degrees of movement. However, those skilled in the art should know that the carrying device 201 can be changed according to different designs. For example, when the interactive robot is a crawler mobile robot, the carrying device 201 can be replaced by multiple crawlers and a crawler drive. When the interactive robot is a walking mobile robot, the carrying device 201 can be replaced by a plurality of mechanical feet and a mechanical foot driving device. Among them, the changes in robot design are not described here. The invention is not limited thereto.

Second embodiment

This embodiment is also an example of a robot combined with a portable device. For convenience of description of the embodiment, the robot used in this embodiment is substantially the same as the robot of the first embodiment, and the multi-person interaction proposed in this embodiment The communication system is also the same as the interactive control system of the first embodiment, and therefore will not be described in detail herein. Referring to FIG. 1, the embodiment of the present invention is different from the first embodiment in that the robot 110 incorporating the portable device further includes a physiological signal detecting device (not shown). The physiological signal detecting device is configured to detect a physiological signal of a near-end user, and transmit the detected physiological signal data to the remote server 120, so that the user of the remote server 120 can know the near-end user. Physiological state. The display can be by chart or number, and so on. Further, the detection result may also be displayed on the portable device 107 of the robot 110. The above physiological signals include blood pressure, blood sugar, blood oxygen or heart rate and many more.

The remote home care system can be established by the techniques disclosed in the above embodiments such that the physiological status of the elderly using the robot 110 at the proximal end can always be monitored by the remote child. The remote child can receive the physiological signal transmitted from the robot 110 through the tablet or the mobile phone to control the physiological state of the elderly at any time. Moreover, the remote server 120 can analyze and monitor the received physiological signals, and if the physiological condition is abnormal, the medical personnel can be notified immediately.

Third embodiment

This embodiment is also exemplified by a robot incorporating a portable device. For convenience of description of the present embodiment, the robot exemplified in this embodiment is substantially the same as the robot of the first embodiment. Moreover, the multi-person interactive communication system proposed in this embodiment is also the same as the interactive control system of the first embodiment, and therefore will not be described in detail herein.

Because of the current generation of younger generations, social networks (eg Facebook) are the most commonly used communication platforms. Therefore, the robot control system of the present embodiment is combined with, for example, a social network. At present, the existing social network Facebook allows users to create personal profile information on Facebook, and then can search for people who use Facebook to join the circle of friends. Facebook can also send messages, photos, and videos with friends. Share with personal updates and more.

This embodiment assumes that both the near-end user and the remote user respectively have a Facebook account, and the near-end user and the remote user have been set as friends and interact through the social network. Examples of interaction methods are as follows:

(1) When a remote user (such as a family member or a relative friend) can leave a message to the near end user through the Facebook message, the portable device 107 of the robot 110 will display This message is addressed to a remote user (such as an elderly person) or viewed by a remote user.

(2) When a remote user (such as a family member or a relative friend) uploads a photo or video to be shared on the Facebook, the Facebook account of the remote user and the Facebook account of the near-end user are mutually buddy. The portable device 107 will automatically download the photos and videos of the friends and play them. The playing time and sequence are played by the near-end user or built-in preset mode.

(3) In addition, the embodiment can also be combined with the second embodiment described above, and the robot 110 can detect the physiological signal of the near-end user through a physiological signal detecting device. When the robot 110 measures the physiological signal of the near-end user and transmits the physiological data to the portable device 107 through the wireless transmission interface, the portable device 107 distributes the physiological signal measurement data to the Facebook account through the wireless network. Since the near-end user and the remote user's Facebook account are friends, the remote user will see the physiological signal measurement data through the Facebook.

Fourth embodiment

This embodiment is also exemplified by a robot incorporating a portable device. For convenience of description of the present embodiment, the robot used in this embodiment is substantially the same as the robot of the first embodiment. Moreover, the multi-person interactive communication system proposed in this embodiment is also the same as the interactive control system of the first embodiment, and therefore will not be described in detail herein. Referring to FIG. 1, the present embodiment is different from the first embodiment in that the portable device 107 includes a video capture device (not shown), such as a camera capturing images and a microphone receiving sound. The portable device 107 transmits the image and sound captured by the camera and the microphone to the remote server 120 through the wireless network. In addition, in order to increase user interaction, the remote server 120 can also To include a sound extraction device, such as a microphone. The remote server 120 transmits the sound received by the microphone to the portable device 107.

In other words, the embodiment provides a two-way audio-visual interactive communication function, so that the remote user of the remote server 120 and the near-end user of the robot 110 can communicate in a spoken language. For the near-end user, the received sound will be resized according to the distance of the robot 110, just like the face-to-face interactive communication situation between people and people. When the near-end user responds, the near-end sound image will be captured by the built-in microphone and the front camera in the portable device 107 and transmitted to the remote user.

The remote user of the remote server 120 of the present embodiment can also control the movement position of the device movement 102 of the robot 110 and the rotation angle of the connector 103, thereby controlling the angle and position of the camera 101 in the portable device 107. In addition, in order to facilitate the remote user to operate the robot 110, the remote server 120 of this embodiment is, for example, mounted with an operating software, and the operating software provides a user interface, for example, as shown in FIG. Referring to FIG. 3, the remote user can directly control the previous camera up and down and left and right in the portable device 107 through the virtual button in the user interface, and directly browse the image captured by the front camera. In addition, a virtual button on the lower right side of the user interface can also control the movement position of the device movement 102 of the robot 110. The virtual interface on the upper right side of the user interface can determine the facial expression of the robot 110 and the whole body emotion. The user interface of FIG. 3 allows the remote user to intuitively and friendlyly operate the lens position of the portable device 107, the movement of the mobile device 102, the expression display, and the general emotional representation.

The above user interface provides at least 6 sets of facial expressions (including: happy, sad, angry, disgusting, surprised and scared) and a full body mood display. The movement and movement of the robot 110 are extended by facial expressions such as waving, hugging, raising hands, and covering faces. By combining facial expressions and movements, as well as specific movements, the robot 110 presents a variety of different body emotions. Therefore, after the remote user re-logs in the user interface to perform facial expression and whole body emotion control, not only the action of the robot 110 but also the non-verbal interaction communication is transmitted.

The above-mentioned robot combined with the portable device uses a wireless network as a communication medium, and can be equipped with a camera, a microphone, and a speaker, and the portable device can display an expression and control an interactive communication element such as an interactive robot body motion. It can be placed in the home of the elderly, and can be operated by remote friends or caregivers. In addition to making it free to move around to understand the environment in the home or the elderly, it can also move to the elderly to meet the warmth; In the situation, the remote user can also operate the robot combined with the portable device to make different limb movements and facial expressions, and project his emotions onto the robot combined with the portable device, as if the "attachment" is combined in the above. The robot carrying the device is generally on the body, and the elderly person feels that the relatives or caregivers are always intimately cared for by talking and interacting with the robot in combination with the portable device.

Fifth embodiment

In the following embodiments, the user of the robot incorporating the portable device is divided into two types: a "near end" and a "distal end", which are respectively "near end users" in the same space as the robots in combination with the portable device, and in another A space controls the "remote user" of the robot through the remote server. Simply put, the near-end user is a user who interacts directly with the robot in conjunction with the portable device (for example, an elderly person), and the "attachment" is combined with the portable device. The user on the robot (for example, a relative or a caregiver) is a remote user.

This embodiment is also exemplified by a robot incorporating a portable device. For convenience of description of the present embodiment, the robot used in this embodiment is substantially the same as the robot of the first embodiment. Moreover, the multi-person interactive communication system proposed in this embodiment is also the same as the interactive control system of the first embodiment, and therefore will not be described in detail herein. 4 is a system block diagram of a multi-person interactive communication system according to a fifth embodiment of the present invention. As shown in FIG. 4, the multi-person interactive communication system includes a robot 401 combined with a portable device as in the first embodiment, and a remote server 402 and an action device at the remote user. The device 403 is taken. The action capture device 403 is coupled to the remote server 402 for capturing the action of the remote user.

When the remote user makes an action, the action capture device 403 transmits the captured action data to the remote server 402, and the remote server transmits the action data to the portable device in the robot 401 through the wireless network. The device 107, the portable device 107 controls the robot 401 to perform substantially the same action as the remote user based on the motion data.

In other words, the remote user (friends, caregivers) connect the wireless network through the remote server 402 to operate the robot 401 in the near-end environment in combination with the portable device, and project the robot on the portable device. On the 401 body, the near-end user (older) acts as both an observer and an interlocutor, observes the behavior of the robot 401 in combination with the portable device, recognizes that it is a "replacement" of the remote user, and interacts with it. ,dialogue. Remote users can transmit signals such as audio and video, so that they can create the illusion of the near-end environment. As a result, both parties can feel as if they are in the same The environment interacts and talks with each other.

The implementation of the action capture device 403 may be, for example, using a camera and using edge detection technology to capture the action of the remote user or configuring a gyroscope sensor on the remote user's body to detect The action of the remote user. Many techniques for action capture have been developed on the market today, but the invention is not limited thereto.

The above-described embodiments of a plurality of robots incorporating a portable device have been proposed, and those skilled in the art will recognize that the present invention can be implemented separately or in combination with any of the above embodiments. Therefore, the present invention is not limited to the single embodiment described above, and the designer may combine the above multiple embodiments to suit different applications according to different requirements.

In combination with the above various embodiments, the present invention proposes an example in combination with the above embodiments, so that those skilled in the art can implement the spirit of the present invention through the following architectural diagram of FIG. FIG. 5 is a diagram showing the overall system operation architecture of the multi-person interpersonal communication system according to an embodiment of the present invention. As shown in Figure 5, this multi-person interactive communication system consists of 7 technical modules to achieve the set usage scenarios and design concepts. This multi-person interactive communication system includes functions such as video communication, emotional display, omnidirectional movement, obstacle avoidance and follow-up. It also has a camera, microphone and speaker, which allows relatives and caregivers to see the images of the elderly and speak through the speakers. The response of the elderly will be transmitted back to the relatives and friends and caregivers by the microphone to achieve the function of audio-visual communication. In addition, in order to make the dialogue more vivid, the interactive robot of the interactive control system can send relatives and friends through different expressions and body movements. The caregiver's emotions are communicated to the elderly, and the interactive robot itself can be moved. It can be operated by relatives or caregivers, walking in the elderly home and viewing the environment and the elderly's personal situation, and matching obstacle avoidance and follow-up functions to simplify remote operation. and Increase near-end interaction to provide additional entertainment.

The remote user (friends or caregivers) use the "remote user interface" to log in through the Internet to operate the interactive robot at the near end (where the elderly are located), and the near end receives the signal from the "communication module". To the "emotional module" or "mobile module" of the portable device to control the movement of the interactive robot, and to present the near-end condition to the remote user through the "video module (display of the portable device)" The module provides power to the interactive robot, and the overall shape and skeleton of the interactive robot form a "near-end user interface".

The detailed functions and operation of each module of the above interactive robot will be described below:

(1) Communication module

In this example, the communication module includes the PIC single-chip embedded network server developed by the applicant and the commercially available wireless network card to achieve the wireless network function. When the remote user uses the remote user interface to send out After the command, the command is transmitted to the wireless network router installed in the near-end environment via the Internet and wirelessly transmitted to the interactive robot. The communication module is responsible for receiving and processing the commands transmitted by the network, and then transmitting the commands to the network. Other modules allow the interactive robot to perform actions in accordance with remote commands.

(2) Emotional module

The emotion module is responsible for the expression of the above-mentioned interactive robot emotions, and is implemented by using the display internal program of the portable device to control the display panel to display the facial expression of the virtual character, which can express happiness, anger, sadness, surprise, disgust, fear And several common facial expressions, with the corresponding expressions, the interactive robot can control the servo motor to swing the hands and command the movement module to let the body move to show different emotional states.

(3) Mobile module

The mobile module is responsible for the movement of the interactive robot described above, in this case, an omnidirectional wheel platform, a self-made PIC single chip controller and an ultrasonic distance sensor. After receiving the signal and decoding, the communication module transmits the command to the mobile module to move the interactive robot. The selectable walking modes include forward and backward, left and right translation, and counterclockwise rotation. The mobile module also has a dodge obstacle and follow. The human function, after receiving the ultrasonic distance sensor information and after calculation, can control the above-mentioned interactive robot to automatically avoid obstacles or follow.

(4) Audio and video module

In this example, the audio and video module includes a network camera (IP Cam) and a speaker, which transmits the near-end image and sound back to the remote user interface, and also transmits the sound of the remote user back to the near end. The camera lens can pass through the network. The road controls its rotation and elevation, allowing the remote user to grasp the near-end condition.

(5) Power module

The power module is responsible for the power supply and charging management of the above interactive robot, and is composed of a rechargeable battery and a power circuit board. When the above-mentioned interactive robot is insufficient in power, it will flash the light to prompt the user to directly use the transformer to connect the socket during charging. When the charging is completed, the charging will be automatically cut off to protect the battery.

(6) Near-end user interface

The near-end user interface is the shape and skeleton of the interactive robot itself. The interactive robot must attract users to interact with it. Therefore, the appearance is small and cute, using soft materials such as fluffy toys, and allowing users to help. The above interactive robots change clothes, adding personalization, fun and interactivity.

(7) Remote user interface

The remote user interface is built on the computer software of the server, so that the commands issued by the remote user (friends or caregivers) are transmitted to the interactive robot through the Internet, and the two-way user (older) is in two directions. Communication and interaction. The remote user interface applicant uses the Visual Basic program to develop, in addition to driving the control screen of each function, it will also display the near-end picture captured by the lens, and the audio output can hear the sound returned from the near end. The operation of the mouse clicks, the interface design advocates the principle of simple operation, intuition and pleasant appearance.

The above-mentioned multi-person interactive communication system is self-positioning of home appliances, that is, it is expected to be easy to use, stable, and suitable for use in a home environment. Therefore, the design emphasizes that it is suitable for home use without affecting the overall function. The system must also be more simplified, stable and easy to use; for the home environment, the communication structure of the multi-person interactive communication system will be based on the broadband network environment and wireless network equipment commonly used in homes, and the charging method is also for home users. The method of directly inserting the socket is designed; in addition, since the home environment space is often crowded and complicated, and the operation burden of the user is reduced, the robot of the multi-person interactive communication system of the embodiment uses the omnidirectional wheel platform as the mobile device. 2, not only can freely and smoothly make a variety of walking modes, but also closer to the human walking mode, with an intuitive and easy to understand operating interface, the remote operator will be able to easily move the combination of this embodiment to carry The robot of the device.

Sixth embodiment

In the above embodiment, the remote server cooperates with the software and the network to enable the remote user and the near-end user to interact and interact with the expression. In the following, a different interactive embodiment will be presented to illustrate the spirit of the invention.

6 is a functional block diagram of a multi-person interactive communication system according to a sixth embodiment of the present invention. Referring to FIG. 6, the multi-person interactive communication system includes a first robot 601 combined with the portable device and a first wireless base station 602 at the near-end user, and a second combined portable device at the remote user. The robot 603 and a second wireless base station 604. Among them, the first robot 601 combining the portable device and the second robot 603 combining the portable device are substantially the same as the robot of the first embodiment combined with the portable device. In addition, in this example, the robot 603 of the second combined portable device is additionally provided with a motion detector (not shown).

When the first robot 601 combined with the portable device is activated, the network is connected through the first wireless base station 602. When the second robot 603 incorporating the portable device is activated, the network is connected through the second wireless base station 604. When the two robots 601 and 603 combined with the portable device are activated, they can be connected to each other through the network. After being connected to each other, the remote user can directly operate the second robot 603 combined with the portable device, for example, holding the robot arm 603 of the second combined portable device, such as the same handshake action.

In this embodiment, it is assumed that the motion detector (not shown) is disposed under the robot arm of the second robot 603 incorporating the portable device, and is, for example, a pressure sensing element. At this time, the second sensing device of the robot 603 combined with the portable device detects the pressure on the arm, and outputs a pressure sensing signal, so that the robot 603 transmits the handshake command, and transmits the first combination through the network. The robot 601 of the portable device. The first robot 601 combined with the portable device described above will also raise the robot arm to pose a handshake to the near-end user. In other words, when the remote user shakes hands with the robot 603 of the second combined portable device, the first combination can be carried The robot 601 of the device also raises the arm and shakes hands with the near-end user to achieve actual interaction or contact interaction.

In summary, the spirit of the present invention is primarily to design an interactive control system for a robot that incorporates a portable device for remote care and to monitor a physiological information of the user of the robot. Moreover, the multi-person interactive communication system proposed by the present invention enables the remote user to make the robot of the near-end user combined with the tablet computer perform substantially the same action as the remote user through a control manner. Further realizing the realism of robot simulation. In addition, with the features of the present invention, the remote user can also interact or interact with the near-end user through the wireless network.

The specific embodiments of the present invention are intended to be illustrative only and not to limit the invention to the above embodiments, without departing from the spirit of the invention and the following claims. The scope of the invention and the various changes made are within the scope of the invention. Therefore, the scope of the invention is defined by the scope of the appended claims.

110‧‧‧Robots that combine portable devices

120‧‧‧Remote Server

101‧‧‧ Ontology

102, 201‧‧‧ Carrying equipment

103‧‧‧Connector

105‧‧‧Wireless transmission equipment

106‧‧‧ Trigger components

107‧‧‧Portable device

401‧‧‧Robots that combine portable devices

402‧‧‧Remote Server

403‧‧‧Action capture device

601‧‧‧The first robot combined with a portable device

602‧‧‧First wireless base station

603‧‧‧Second robot combined with portable device

604‧‧‧Second wireless base station

1 is a block diagram showing a robot interaction system according to a first embodiment of the present invention.

2a is a 3D perspective view of a robot incorporating a portable device according to a first embodiment of the present invention.

Figure 2b is a side elevational view of the robot incorporating the portable device in accordance with the first embodiment of the present invention.

2c is a robot combining a portable device according to a first embodiment of the present invention; Frontal view.

3 is a schematic diagram of a user interface of a remote server according to a fourth embodiment of the present invention.

4 is a system block diagram of a multi-person interactive communication system according to a fifth embodiment of the present invention.

FIG. 5 is a diagram showing the overall system operation architecture of the multi-person interpersonal communication system according to an embodiment of the present invention.

6 is a functional block diagram of a multi-person interactive communication system according to a sixth embodiment of the present invention.

110‧‧‧Robots that combine portable devices

120‧‧‧Remote Server

101‧‧‧ Ontology

102‧‧‧ Carrying equipment

103‧‧‧Connector

105‧‧‧Wireless transmission equipment

106‧‧‧ Trigger components

107‧‧‧Portable device

Claims (11)

A multi-person interactive communication system, comprising: a remote server; a robot combined with a portable device, comprising: a body configured with a wireless transmission device, wherein the wireless transmission device uses a wireless transmission protocol for communication; a portable device that communicates with the portable device through the wireless transmission protocol when the portable device is placed on the body, wherein the portable device transmits the wireless device to the remote server Connecting, the remote server controls the robot combined with the portable device through the wireless network, wherein the remote server has an operating software built therein for controlling the action of the robot combined with the portable device through the wireless network And a moving position, wherein the remote server includes a face detecting device for detecting a facial expression of a remote user, and the remote server detects the facial expression through the The wireless network transmits to the portable device, and the portable device displays the remote device on the screen of the portable device according to the facial expression With substantially the same as those of the facial expressions. The multi-person interpersonal communication system according to claim 1, wherein the robot that is combined with the portable device further comprises: a plurality of robot arms connected to the body; a carrying device configured and connected to the body, Loading or moving the body; a connector disposed above the body, including a trigger component, when When the portable device is placed on the connector, the triggering component is triggered, and when the triggering component is triggered, the wireless transmitting device communicates with the portable device through the wireless transmission protocol. The multi-person interpersonal communication system according to claim 1, wherein the robot that is combined with the portable device further comprises: a physiological signal detecting device for detecting a physiological signal, wherein the physiological signal detecting device is adjacent to a proximal end The user performs a physiological test and transmits the detected physiological data to the remote server. The multi-person interpersonal communication system of claim 1, wherein the remote server further comprises: an audio and video capture device for capturing a sound and an image, and the remote server transmits The wireless network transmits the captured sound and the image to the combined portable device; and an action capture device for capturing the action of a remote user when the remote user makes a In operation, the action capture device transmits the data of the action to the remote server, and the remote server transmits the data of the action to the portable device through the wireless network, and the portable device according to the action The data controls the robot in conjunction with the portable device to perform substantially the same actions as the remote user. The multi-person interpersonal communication system according to claim 2, wherein the portable device comprises an audio-visual capturing device for capturing an image and a sound, and the sound captured by the audio-visual capturing device And transmitting the image to the remote server through the wireless network, The remote server controls the rotation angle of the connector through the wireless network and controls the moving position of the robot combined with the portable device to determine the shooting angle and position of the video capturing device in the portable device. The multi-person interactive communication system of claim 1, wherein when a built-in control software inside the portable device is activated, a remote user can log in to the portable device by remotely Controlling a controlled device, when the built-in control software inside the portable device is activated, a screen of the portable device displays a facial expression, wherein the remote server controls the screen through the wireless network facial expression. A multi-personal interactive communication system, comprising: a first robot combined with a portable device, comprising: a first body, configured with a first wireless transmission device, wherein the first wireless transmission device uses a first wireless transmission protocol to Communicating; a first portable device, when the first portable device is placed on the first body, the first wireless transmission device communicates with the first portable device through the first wireless transmission protocol; The second combined with the robot of the portable device, comprising: a second body, configured with a second wireless transmission device, wherein the second wireless transmission device uses a second wireless transmission protocol for communication; a motion detector; a second portable device, the second wireless transmission device transmits the second wireless transmission device when the second portable device is placed on the second body Communicating with the second portable device; wherein the second combined portable device robot connects the first combined portable device to the robot through a wireless network, wherein when a remote user touches the motion detection The robot coupled to the portable device transmits the motion data of the remote user to the robot of the first combined portable device through the wireless network, and the robot coupled to the first portable device receives the The action data of the remote user, the first combined with the robot of the portable device performs a corresponding action according to the action data of the remote user. The multi-person interpersonal communication system according to the seventh aspect of the invention, wherein the first combined carrier device further comprises: a first carrying device configured and connected to the first body for carrying or Moving the first body; and a first connector disposed above the first body, including a first triggering component, wherein the first triggering device is configured when the first portable device is placed on the first connector The component is triggered, wherein when the first triggering component is triggered, the first wireless transmission device communicates with the first portable device through the first wireless transmission protocol; wherein the second combined portable device robot The second carrier device is configured to be connected to the second body for loading or moving the second body. The second connector is disposed above the second body and includes a second trigger component. The second triggering component is triggered when the second portable device is placed on the second connector, wherein when the second triggering component is triggered, the second wireless transmitting device is transparent Passing the second wireless transmission protocol with The second portable device communicates. The multi-person interpersonal communication system according to claim 7, wherein the motion detector is a pressure sensing component. The multi-person interpersonal communication system according to claim 7, wherein the first portable control device is installed in the first portable device, and the first built-in control inside the first portable device is activated. In the case of the software, a screen of the first portable device displays a facial expression. The multi-person interactive communication system according to claim 7, wherein the second portable device is installed with a second built-in control software, and the first built-in control inside the second portable device is activated. In the case of the software, a screen of the second portable device displays a facial expression.