JP2018050161A - Communication system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a communication system contributing to protection of privacy by supporting communication based on the information between users, and exchanging information mutually without disclosing the information directly.SOLUTION: A communication system for supporting information exchange work of multiple users includes a terminal having voice call acquisition means and image display acquisition means, and including communication means capable of acquiring usage status information, and allowing mutual information exchange of respective terminals, a database storing user information and connected with the terminal, and information acquisition update means for acquiring information of a user by accessing the database, and additionally storing the user information, acquired from the terminal, in the database thus updating to the up-to-date information. The terminal includes information exchange means for exchanging information with the user by collating user status information and user information, and also exchanging information based on the information from other user according to the user status information from other terminal.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a communication system for assisting communication between a plurality of users located at positions separated from each other.

In recent years, the problem of how to facilitate communication between the elderly and their families in an aging society, or parent and child in a dual working nuclear family has been pointed out. In order to solve this problem, a system using IT is used. For example, Patent Document 1 is arranged at the first base so that the degree of presenting its presence to the other party can be adjusted. A communication assistance device for assisting communication via a communication network between the video conference terminal and the video conference terminal arranged at the second site, and the first site has the estimated status of the second site A wireless communication unit that receives the second site status information representing the position, a sensory amount range calculation unit that calculates the range of the sensory amount perceivable by the first participant at the first site, the second site status information, the first Based on the range of the sense amount of the participant, an intention amount calculation unit for calculating the intention amount of the second participant at the second base, and output so that the first participant can perceive a stimulus according to the intention amount Stimulation output unit Communication assisting apparatus has been proposed which comprises a.
In addition, Patent Document 2 discloses a system for supporting communication between a close relative and a single elderly person using a robot. When there is no response from the close relative for an elderly person's utterance for a predetermined time, a computer voice editing is performed. The means refers to the conversation knowledge database, obtains the speech data of the close relative corresponding to the keyword extracted from the speech of the elderly person, and uses the speech data to transmit the speech of the close relative. A communication support system has been proposed in which the voice is spoken from the robot and even if a close relative starts to deal directly with the elderly, he / she can speak on behalf of the robot.

JP 2015-220534 A Japanese Patent Laying-Open No. 2015-184597

  However, in the conventionally proposed communication support system, since the system functions only when there is an active intention to communicate with at least one of the users, even if there is no active use intention There was a problem that information was not transmitted when it was better to bear communication. In addition, since various information such as the current state of both users is disclosed to the other party as it is, there is a problem that privacy protection is incomplete.

  Therefore, the object of the present invention is to provide communication support based on information between users even when they do not intend to communicate directly, and to exchange information without disclosing information directly. Is to provide a communication system that can protect privacy.

The present invention provides the following inventions.
1. A communication system that supports information exchange work among multiple users,
A plurality of terminals used by each user, having voice transmission acquisition means and image display acquisition means for exchanging information with the user, and acquiring usage state information based on the usage state of the user A terminal equipped with a communication means capable of exchanging information with each other, and
A predetermined user information about the user is stored and linked to the terminal,
Information acquisition and updating means for acquiring user information by accessing the database and additionally storing user information acquired from the terminal in the database and updating it to the latest information;
Comprising
The terminal collates the user status information and the user information, exchanges information with the user, and information based on information from other users according to other user status information from other terminals. A communication system equipped with information exchange means for exchanging information.
2. The communication system according to 1, wherein the terminal includes image display means, moving means for appropriately changing the location of the terminal itself, and deformation means for changing the shape of the terminal into a desired form.

  The communication system of the present invention can provide communication support based on mutual information even when the user does not intend to communicate directly, and can exchange information without disclosing the information directly. Yes, it helps protect privacy.

FIG. 1 is a schematic diagram schematically showing a communication system as one embodiment of the present invention. FIG. 2 is an enlarged view of the terminal shown in FIG. FIG. 3 is a system configuration diagram showing an example of a server configuration for the entire system including a robot system and sensor nodes. FIG. 4 is a flow sheet showing a flow relating to processing of an image acquired by the camera and a flow in the case of performing voice dialogue. FIG. 5 is a basic structure diagram when a conversation system is configured. FIG. 6 is a flowchart showing the dialogue mode of the dialogue system of the terminal. FIG. 7 is a chart showing types of time-dependent utterances. FIG. 8 is a diagram illustrating a flow when communication is performed by a multi-robot system (terminal). FIG. 9 is a diagram showing variations of the touch interface. FIG. 10 is a diagram showing variations in emotional expression based on an emotion model in the interface. FIG. 11 is a diagram showing information types and structures. FIG. 12 is a diagram showing information related to human behavior measurement in a pyramid structure.

1, 10, 20, 30, 40

Embodiments of the present invention will be described below with reference to the drawings.
As shown in FIG. 1, the communication system 1 of this embodiment includes a plurality of terminals 10 including a smart device 12 (see FIG. 2) and a robot system 14 (see FIG. 2) connected to the smart device, and a server 20. It consists of.
As shown in FIG. 1, a plurality of terminals 10 are used by each user, and each terminal 10 is owned and used by each user. In addition, the terminal has a voice transmission acquisition unit and an image display acquisition unit for exchanging information with the user, and can acquire usage state information based on the usage state of the user. An exchangeable communication means is provided. Further, the user status information and the user information are collated and exchanged with the user, and information exchange based on information from other users is performed in accordance with other user status information from other terminals. The information exchange means is also provided.
In addition, the server 20 stores predetermined user information related to users, a database connected to the terminal, a user accessing the database to acquire user information, and user information acquired from the terminal to the database. And an information acquisition / update means for updating the information to the latest information.
The smart device has a communication function, an image acquisition function, an image display function, a voice acquisition function, and a voice transmission function. The central processing unit (CPU) temporarily stores data and programs for processing and is appropriately executed by the CPU. Any communication device having a memory that can be utilized and a recording medium that stores and stores data and programs can be used without particular limitation.
This will be described in more detail below.

<Terminal>
As shown in FIG. 2, the terminal 10 has a structure that looks like a person, and has a robot system 14 that has a body part, an arm part, and a head part. The head part has an image acquisition function, An image display function, a voice acquisition function, a voice transmission function, a central processing unit (CPU), a memory that temporarily stores data and programs for processing, and a memory and data and programs that can be used appropriately by the CPU A smart device 12, which is a communication device (not shown) having a recording medium for storing and storing the device, is mounted, and a face portion is formed by the smart device 12. The smart device also includes a monitor for image display, a camera for image acquisition, a microphone for audio acquisition, and a speaker for audio output.
(Smart device)
The smart device 12 is a member constituting the brain of a terminal formed in a human shape, and the voice transmission acquisition unit, the image display acquisition unit, and the communication unit are all hidden in the recording medium of the smart device. Function by different apps. Smart devices are originally equipped with a variety of sensors such as microphones, cameras, and accelerometers. These can be used for robot voice recognition, image processing, posture control, etc. Yes. In addition, various forms of communication can be performed using a communication system such as Wi-Fi or wireless WAN. Furthermore, by installing an application for controlling the robot on the smartphone, maintenance of the software of the robot system is facilitated.
Various devices such as a gyro, an accelerometer, a touch interface, a camera, and a microphone are mounted on the smart device. Since a lot of information can be obtained using the internal sensor, the body of the robot need only be a servo motor or body for controlling the gesture, which leads to cost reduction. Control of the movable part of the degree of freedom is performed from the smartphone by Bluetooth (registered trademark) communication.
(Voice transmission acquisition means)
The voice transmission acquisition unit is a unit that acquires an external voice and emits a voice generated by the CPU through a microphone and a speaker provided in the smart device. Specifically, the acquired external sound is processed by the CPU in accordance with an application recorded in advance on a recording medium, the semantic content is grasped by collating with the database, and the grasped content is passed to the next processing. Then, some operation is performed by other means according to the grasped contents. There are several operations performed by this terminal, one of which is that the terminal emits voice or sound from the speaker, and this is achieved by this voice transmission acquisition means.
(Image display acquisition means)
The image display acquisition unit is a unit that acquires an external image and displays an image generated by the CPU through a camera and a monitor provided in the smart device. Specifically, the acquired image is processed in accordance with an application recorded in advance on a recording medium by the CPU, and the semantic content is grasped by collating with the database, and the grasped content is passed to the next processing. Then, some operation is performed by other means according to the grasped contents. There are several operations performed by this terminal, one of which is that the terminal displays a predetermined image on the monitor, which is achieved by this image display acquisition means.

(Communication means)
The communication means is means for performing communication by radio waves using communication equipment provided in the smart device. As communication equipment, WIFI (registered trademark) equipment, ZigBee (registered trademark), or the like can be used.
(Information exchange means)
The information exchanging means accesses the server via the communication means to acquire user information stored in the database on the server, and at the time of use of the user acquired by the voice transmission acquisition means and the image display acquisition means Acquired as user status information that is information. Then, the acquired user information and user status information are collated, information to be transmitted to the user is extracted from the database, and information exchange is performed with the user.
Also, it acquires other user status information from other terminals via communication means, and collates this information with the database to provide information to be presented to the user based on the information of other users To exchange information.

(Robot system)
The robot system 14 includes a body portion 16 and an arm portion 18, and also includes a head component (not shown) for installing a smart device. Further, a moving means such as a wheel is provided on the lower surface of the body part (not shown), and it is possible to move to an arbitrary place. Such a robot system can be created by adopting a known device configuration, and an arm portion, a moving means, and the like can be configured using various actuator devices.
Also. Each member is connected to the smart device via a wiring or the like, and is configured so that the arm and the torso can be moved in accordance with instructions from the CPU.
The robot system 14 includes desktop robot systems such as iPhonoid and iPadrone (registered trademark) (stationary type for information support), senior cars (boarding type mobile robots), concierge robots (guide type mobile robots), pet robots (multi-legged) Various types of robots such as a type mobile robot) can be used.
The robot system 14 has functions such as environmental state measurement, human state measurement (C4), robot behavior mode / control command, non-verbal communication by gesture, remote operation of the robot, behavior model, and Bluetooth communication to the robot hardware. Can be made.
In addition, the terminal comprising the smart device 12 and the robot system 14 includes Sun SPOT, sensor tag, Kinect (registered trademark) sensor (3D range sensor, infrared), laser range finder (2D range sensor), Bluetooth Various sensors such as (registered trademark) can be equipped, and these sensors constitute the above-mentioned voice transmission acquisition means, image display acquisition means, and information exchange means.

<Server>
The server 20 stores predetermined user information related to the user, and stores the database connected to the terminal, the user information by accessing the database, and the user information acquired from the terminal in the database. And information acquisition / update means for updating to the latest information. The device configuration is not a conventionally known server, but a central processing unit (CPU), a memory that temporarily stores data and programs for processing, and a memory, data and programs that can be used appropriately by the CPU. It is constituted by a computer (not shown) having a recording medium for storing and storing, and further has a communication function.

<Program structure>
The program configuration that constitutes each of the above-mentioned means is as follows: measurement (Measument; M), communication means (Communication; C), decision making method and internal information processing (D), communication and information It has an access (Network and Information Access; N), a server (Informationally Structured Space; I), a robot system (Robot Partners; R), and a sensor node (Sensor Nodes; S). In addition, each layer includes a physical layer, a middleware layer (Driver Layer), an algorithm layer (Algorithm Layer), and an application layer (Application Layer).

<Usage and action>
By using a smart device and a server (server server), functions such as database access, life log collection, life log analysis, persona analysis, preference information extraction / personal information analysis, human relationship estimation, and information recommendation can be implemented.
Also, the indoor information can be collected by the voice transmission acquisition means and the image display acquisition means even if it is offline.
For example, in computational system care for watching over elderly people, the relationship between functions is clarified from a system perspective, and the methodology is clarified from a computational perspective. The purpose is to perform. Consider a hierarchical structure from the left bottom-up and top-down.
From mining to feature extraction, data mining and learning are the central methodologies. In persona analysis and information recommendation, inference and search are the central methodologies. In daily monitoring, lifestyle modeling is important, and if it is possible to refer to the modeled lifestyle, it is easy to infer abnormality detection.

Next, usage modes of the system of the present invention will be described.
First, power on the smart device. When the power is turned on, (1-1) If it is not initialized, “Initialize” is performed. (1-2) If initialization has been completed, read the setting data file in the smart device. (1-3) Access the server and robot system and check if they are available. (1-4) At that time, if the necessary device is not turned on, it prompts the user to turn on the device by voice utterance and screen display. (1-5) If a necessary device is not turned on even after a while, the main routine is left unconnected. (1-6) If the server is available, download various setting data related to the smart device.
When the database server of the server is turned on, (2-1) If initialization is not performed, initialization is performed. (2-2) When initialization has been completed, transmission of the server IP address is started by UDP communication, and TCP / IP communication or communication by SQL is started. (2-3) If the smart device or robot system can receive the server IP address, it can be confirmed that it can be used because it is accessed by TCP / IP communication or the like. Always perform connection authentication when connecting. (2-4) When the necessary device is not powered on, the connection standby state is maintained.
When powering on the robot system, (3-1) If it is not initialized, initialize it. (3-2) If it has been initialized, access the smart device or server and check if it is available. (3-3) At this time, if the necessary device is not powered on, the connection standby state is maintained. (3-4) If the server is available, read the settings from the server and start operation according to the control command. (3-5) When the server is unavailable, the server starts operating according to the control command by the smart device and the Bluetooth communication while being connected to the server in the standby state. Here, if it becomes possible to connect to the server, the process proceeds to (3-4).
When the terminal is powered on, the various sensors (sensor nodes) mounted on the terminal are initialized (4-1) if they are not initialized. (4-2) If initialized, access the server and check if it is available. (4-3) At that time, when the power of the server database server is not turned on, the state shifts to the data measurement mode while maintaining the connection standby state. As for the storage method of measurement data, as long as the buffer allows, the first-in and first-out preferentially hold the latest data. (4-4) Server database When the server is powered on, data measurement is performed according to the sampling interval and data transfer method (data type and data length) based on the sensor node settings stored in the server. To start transfer sequentially.

<Action>
The operation of the system of the present invention will be described with reference to FIG.
(1) Smart device (1-1) Call and register the user's name, user address, user phone number, user e-mail, etc. from the address book. (1-2) Next, have the emergency contact selected from the address book, and register the emergency contact name, emergency phone number, and emergency e-mail. (1-3) Next, get permission for access to location information, personal information such as birthday, web bookmarks, notepad, e-mail, calendar, music, and other contents.
(2) Server (2-1) First, register smart devices to be linked. (2-2) If the server database is in the smart device, the information registered in the smart device is quoted as it is. (2-3) If it is a database server of an external PC, start the server by TCP / IP communication or SQL. At that time, if there is an access from the smart device, the information registered in the smart device is quoted after obtaining approval from the user.
(3) Robot system (3-1) Register the robot system. The robot first receives and connects to the server IP of the server for UDP communication.
(4) Sensor node (4-1) The sensor node is registered. The robot first receives and connects to the server IP of the server for UDP communication. Perform location tagging (initial Localization) and transfer to server database server.
When quoting personal information to a server, etc., get approval from the user.

In the main routine, starting from the idling state, the human detection is performed, and then the communication mode is entered. The following operations are performed in the idling state.
・ Difference extraction from camera images (from moving object detection to human detection, communication mode)
・ Interrupt based on touch interface (to communication mode)
・ Voice interrupt (to voice recognition)
・ Interruption by other sensors (event-driven processing related to elderly tasks)
For example, human motion detection is performed.
When an event does not occur for a certain time, the mode is shifted to the sleep mode, the above sampling interval is changed to be longer, and the robot hardware is shifted to the sleep mode. With the shift to the sleep mode, the “facial expression” is changed to the sleeping expression.
FIG. 4 shows the flow of processing relating to camera image processing and voice interaction within the smart device.

Processing for turning off the power will be described below.
(1) Smart device (1-1) When the smart device is powered off (when the application ends), connection off information is transferred to the server, and various information including the end time is transferred. (1-2) When not connected to the server, various information including the end time is stored in the smart device setting data file.
(2) Server (2-1) Server Database When the server is turned off (when the application is terminated), connection off information is transferred to the smart device and various information including the end time is transferred. (2-2) When not connected to the smart device, various information including the end time is stored in the setting data file in the server database.

In order to perform various services using the system of the present invention, it is necessary to implement a communication function suitable for the service in the robot system. Communication itself can be broadly classified into verbal communication, non-verbal communication, direct control, remote control, etc., and communication modes can be classified into one-to-one, one-to-many, many-to-one, and many-to-many. In order to communicate naturally, it is necessary to recognize human gestures and actions.
Here, the measurement (Measument; M), communication method (Communication; C), decision-making method and internal information processing (D), communication and information access (N) , Server (Informationally Structured Space; I) Robot system (Robot Partner; R), Sensor node (Sensor Nodes; S)
(M1) Estimating the state of the smart device Using the acceleration sensor and GPS measurement data, the smart device is (1) placed on a desk, (2) placed in a pocket or bag, (3) Attached to the robot system, (4) Walking, (5) Riding a bicycle, (6) Moving by bus or car, (7) Riding on a train, (8) Classify as Other (undefined).
(M2) Human state estimation In order to perform human detection, we apply evolutionary robot vision that can search sequentially over time-series image data. Evolutionary Robot Vision is a methodology that uses evolutionary computation, and it is a new method that can be used by performing genetic operations such as crossover and mutation on a solution set (called an individual group) consisting of multiple solution candidates. Generate solution candidates. Next, a next generation solution set is constructed by selection. The solution candidate uses a polygon template to give the center coordinates, the distance from the center to each point, and the angle for each corner as variables, and the skin color corresponding to human skin and the black (gray) color corresponding to the hair region Search is performed using the number of pixels. By repeating these, the human region is specified. As pre-processing for human detection, a search is performed centering on a region with a large change using differential extraction.
Next, a behavior estimation method using a spiking neural network will be described. Treat human basic movements as distinctive action segments and associate them with basic movements. Basically, in addition to extraction of human hand movements and movement of the entire body, there are detections such as human approach and distance, and other areas such as occupied areas on the camera image (upper, middle, lower), etc. Is estimated as a human action. In addition, human behavior is estimated from these states.
Since it is difficult to perform human identification on a smart device, it should be implemented as an algorithm that is as simple as possible while satisfying the minimum specifications.
The LBP-Histogram method is adopted as the feature value used for face recognition. LBP (Local Binary Pattern) is calculated from face information detected from the captured image, and a histogram is created. PCA (principal component analysis) is applied to the obtained histogram, and the obtained principal component is used as a feature amount. In this method, an 80-bit identifier is created as a biometric feature. Specifically, first, prepare 80 pairs of faces (A group, B group) as templates at random, 1 if the face to be registered simulates the face of group A, 1 Create binary data for 80 bits with 0 as the personal identification code.
Speech recognition and speech synthesis use open source or commercially available libraries. For example, NTT DoCoMo Developer Support (product name) is a library that can be used free of charge for commercial use.

Dialog systems are roughly classified into (1) task-oriented dialog systems and (2) non-task-oriented dialog systems. (1) The task-oriented dialogue system aims to realize conversations according to the purpose of tasks such as information support and guidance. On the other hand, (2) the non-task-oriented dialogue system is a conversation such as a chat intended for a conversation partner of an elderly person, which reduces stress in daily life, brings healing and enjoyment. In addition, non-task-oriented dialogues are classified into (A) good speaking phase and (B) good listening phase. (A) In the talking skill phase, the robot actively speaks and provides information support. (B) In the advanced listening phase, the elderly people actively talk about the contents of old tales and hobbies, accompanied by nodding.
FIG. 5 shows the basic structure of the conversation system. The next utterance content is selected by using the flow of the utterance of the robot itself and the recognition result of the utterance from the elderly.

Here, the conversation mode is a non-task-oriented conversation system as shown in FIG. 5, (1) daily conversation mode, (2) content conversation mode, task-oriented conversation system, (3) information support conversation mode, (4 ) Classify into 4 types of scenario conversation modes, and examine detailed methodologies. Daily conversation is conversation based on a lifestyle extracted from daily life logs. A content conversation is an utterance using information in a smart device such as a calendar or email. Since it also serves as a scheduled reminder, it partially overlaps with information support conversations. In the information support conversation mode, in addition to utterances based on news and weather forecasts, schedule management and information collection on topics of interest to the elderly are performed. In the scenario conversation mode, a lot of information is provided to the elderly in an interactive manner, as in the conversation skill phase. In the scenario conversation mode, a conversation package for a certain purpose is prepared, and there are “health promotion support conversation package”, “watch watching conversation package”, “outing support conversation package” (FIG. 6) and the like.
(1) Daily conversation mode: Daily conversation mode includes sympathy utterance, etc. in addition to greetings, mustaches, monologues, and reflexive utterances (interjections). In particular, sympathy utterances are important for the elderly, such as watching over the elderly as a good listening phase.
What is empathy? Feeling exactly what others think. I agree.
2. [Sympathy] Feel the feelings of others as if they were yours.
3. [Empathy] Emotion transfer (2) Content conversation mode: In the content conversation mode, in addition to personal information, information in smart devices such as calendars, e-mails, and notepads is used to speak.
(3) Information support conversation mode: For conversations aimed at information support,
(3-1) Daily information support: Weather, news, local community event information,
(3-2) Attention support: Calling attention such as forgetting to close,
(3-3) Information collection support: Hobby and entertainment information collection and search information support.
(4) Scenario conversation mode: There are health promotion support, dementia prevention conversation such as brain training, bean knowledge about hobbies and preferences, storytelling scenarios, quizzes and the like.

The utterance method includes random utterance, event-driven utterance, and time-dependent utterance. Random utterance is a means of uttering randomly so that long-term silence does not continue. Mainly selected in conjunction with daily conversation mode and content conversation mode. In addition, event-driven utterance is a conversation performed when an event related to a sensor or the like occurs, such as a touch interface or threshold processing of an internal sensor.
As shown in FIG. 7, time-dependent utterances are roughly divided into an alarm type that utters at the time, a left and right target type that utters before and after the time (FIG. 7 (a)), and a left side type that utters before the time ( FIG. 7 (b)), there are four types of utterance right side type (FIG. 7 (c)) after the time. Based on this distribution, a time-dependent utterance probability is obtained for each utterance content, and a utterance having a high probability is uttered. Time-dependent speech probability P, when the time was the last time speech and r _t, using the sigmoid function,

It becomes. In Equation (3), a is a coefficient for time-dependent utterance, and is calculated from the current time, time for time-dependent utterance, and the width of the time-dependent utterance distribution graph.

It is expressed.

The terminal is a sensor node having a plurality of sensors, and is also an action unit for communicating with a human. The operations and utterances of individual robots can be controlled in a centralized manner through the server (FIG. 8). In other words, communication between robot systems is not thought and uttered by individual robot systems, but centralized scenario conversation is realized like a single play.

  The system of the present invention implements a touch interface imitating a face (FIG. 9). Basically, each part of the face can implement some function. In addition, usually, an emotional expression is produced based on the emotion model (FIG. 10).

Communication may not be connected due to deficiencies such as voice recognition. At that time, it is necessary to perform error recovery. Here, broadly speaking, (1) a communication field selection function, (2) topic change function, (3) interjection utterance function, (4) gaze distribution function, and (5) stop function are considered.
(1) Communication field selection function Unlike a camera or the like, communication by a robot system is a point that can create a place required for communication. For example, in the case of image processing, the robot system can select a background image that is easy to recognize humans by saying “It is difficult to see the face. Come over here”. Also, when multiple people are speaking, you can concentrate on one person's utterances by saying "Keep quiet" or "Speak one by one". It is a function to communicate like a human.
(2) Topic change function If the speech recognition result is not good, or if the speech recognition result is significantly different from the previous context, changing the topic can take the initiative and advance communication.
(3) Interjection utterance function When you want to change the topic, insert an interjection such as “Ano” or “Utto” to make a filler. In addition, after speech is captured, there is a blank time during speech recognition and a waiting time is entered. At that time, an interjection is inserted to connect “between”.
(4) Gaze distribution function When communicating, humans do not keep staring at the other person's face for a long time, but appropriately divert their gaze. Such an action in non-verbal communication is called gaze distribution. Communication like a human being can be realized by appropriately distributing gaze distribution.
(5) Operation stop function for communication Since a human hand approaches the robot when trying to touch the screen, a function to stop the pan / tilt mechanism and the gesture is necessary to prevent a contact accident.

Communication between robots, sensors, and server servers is realized by using two types of communication, broadcast communication by UDP / IP communication and individual data transfer by TCP / IP communication.
In addition to the enormous amount of data measured from sensors attached to the environment and the measurement data of the robot, usable information in the environment, such as the state of interaction with humans, can be collected in the database server. Here, in order to easily perform information extraction, information analysis, information conversion, information accumulation, information transfer, etc. from such a vast amount of data, it is necessary to structure the information, and this information is stored in the server. Has been.
The server is designed based on (1) information sharing, (2) human affinity, (3) reversibility of information conversion, and (4) system versatility.
Information can be broadly divided into (1) human information or personal information, (2) environmental information, and (3) information on the Internet (Figure 10). 11). FIG. 12 shows the types of information related to human behavior measurement and its hierarchical structure.

<Usage example, effect>
As shown in FIG. 1, the system of the present invention installs a terminal on the basis of two or more users separated from each other, measures the state of each user, makes a determination, and mediates communication between users. Therefore, communication between users can be performed with a small amount of information.
For example, in the situation where the mother is at work and the child is at home, when the information that the mother returns from 17:00 at work comes in, "I'm glad I'm coming home soon," and the terminal emits a message to the child's parent. Can teach the time to come back. In addition, when there is information that comes back around 20:00, work is done to fill in the communication gap in the form of "I returned to my mom and worked hard."
The system of the present invention is useful as a communication tool for E-learning, between parents and children, and business associates.

Claims (2)

A communication system that supports information exchange work among multiple users,
A plurality of terminals used by each user, having voice transmission acquisition means and image display acquisition means for exchanging information with the user, and acquiring usage state information based on the usage state of the user A terminal equipped with a communication means capable of exchanging information with each other, and
A predetermined user information about the user is stored and linked to the terminal,
Information acquisition and updating means for acquiring user information by accessing the database and additionally storing user information acquired from the terminal in the database and updating it to the latest information;
Comprising
The terminal collates the user status information and the user information, exchanges information with the user, and information based on information from other users according to other user status information from other terminals. A communication system equipped with information exchange means for exchanging information.
The communication system according to claim 1, wherein the terminal includes image display means, moving means for appropriately changing the location of the terminal itself, and deformation means for changing the shape of the terminal into a desired form.