JP2021197665A - Communication system and communication method - Google Patents

Abstract

To accurately grasp the situation of an object located in a remote area.SOLUTION: A communication system according to the present application includes a first receiving unit that receives the information transmitted from a first base via a first network for performing unidirectional communication of the information from the first base to a second base, a first providing unit that provides the information received by the first receiving unit to a user of the second base, a receiving unit that receives the information transmitted from a user of the first base to the user of the second base, a transmitting unit that transmits to the second base the information to transmit from the user of the first base to the user of the second base via a second network that performs bidirectional communication of the information between the first base and the second base, a second receiving unit that receives the information transmitted from the first base via the second network, and a second providing unit that provides the information received by the second receiving unit to the user of the second base.SELECTED DRAWING: Figure 1

Description

The present invention relates to communication systems and communication methods.

Conventionally, in a conference system capable of bidirectional communication, a technique via a plurality of networks is known. For example, a technique has been proposed in which the link information of an online service opened on a control application running on the control terminal of the own station is transmitted to the control terminal of the partner station via a video conference device.

Japanese Unexamined Patent Publication No. 2014-07536

However, in the above-mentioned prior art, only the link information of the online service is transmitted, and it may not be possible to accurately acquire the information about the user who uses the prior art.

The present application has been made in view of the above, and an object thereof is to accurately grasp the situation of an object located in a remote place.

The communication system according to the present application includes a first receiving unit that receives information transmitted from the first base via a first network that performs unidirectional communication of information from the first base to the second base, and the above-mentioned. A reception unit that receives information transmitted from the user of the first base to the user of the second base and the first providing unit that provides the information received by the first receiving unit to the user of the second base. Transmission from the user of the first base to the user of the second base via the second network for bidirectional communication of information between the unit and the first base and the second base. A transmitting unit that transmits information to the second base, a second receiving unit that receives information transmitted from the first base via the second network, and information received by the second receiving unit. Is provided with a second providing unit that provides the user of the second base.

According to one aspect of the embodiment, it is possible to accurately grasp the situation of an object located at a remote place.

FIG. 1 is a diagram showing an example of information processing executed by the communication system according to the embodiment. FIG. 2 is a diagram showing an example of analysis processing executed by the communication system according to the embodiment. FIG. 3 is a diagram showing an example of the configuration of the communication system according to the embodiment. FIG. 4 is a diagram showing an example of an image information storage unit according to an embodiment. FIG. 5 is a flowchart showing an example of the flow of information processing executed by the information processing apparatus according to the embodiment. FIG. 6 is a flowchart showing an example of the flow of information processing executed by the terminal device according to the embodiment. FIG. 7 is a diagram showing an example of a hardware configuration.

The description of this specification and the accompanying drawings will clarify at least the following matters.

It is received by the first receiving unit and the first receiving unit that receive the information transmitted from the first base via the first network that performs unidirectional communication of information from the first base to the second base. The first providing unit that provides the information to the user of the second base, the reception unit that receives the information transmitted from the user of the first base to the user of the second base, and the first base. Information transmitted from the user of the first base to the user of the second base is transmitted from the user of the first base to the user of the second base via the second network for two-way communication of information between the second base and the second base. Use of the transmission unit to transmit to, the second receiving unit for receiving the information transmitted from the first base via the second network, and the information received by the second receiving unit to the second base. A communication system including a second providing unit provided to a person.

According to such a communication system, the information transmitted from the first base is received and the received information is received via the first network that performs unidirectional communication of information from the first base to the second base. Provide to users of the second base. For example, the communication system receives an image taken by a foreign user from a foreign country to Japan via the first network, and provides the received image to the Japanese user.

Then, the communication system receives information transmitted from the user of the first base to the user of the second base, and establishes a second network for bidirectional communication of information between the first base and the second base. The information transmitted from the user of the first base to the user of the second base is transmitted to the second base through the system. Further, the communication system receives the information transmitted from the first base via the second network, and provides the received information to the user of the second base. For example, the communication system transmits a message including communication matters from a foreign user to a Japanese user via a second network to Japan. Then, the communication system receives the message transmitted from a foreign country via the second network, and provides the received message to the Japanese user.

In this way, the communication system can accurately grasp the situation of the user located at a remote place by transmitting the image via the first network. Then, the communication system realizes bidirectional communication with a user located at a remote place by transmitting a message via the second network. As a result, the communication system can accurately communicate with a user located in a remote place.

Generally, when designing a product in a foreign country, the product is visited directly to the local user to evaluate the performance and evaluation of the product and to confirm the product after use. In this way, we design products that match the local culture, customs, and ways of thinking. However, when conducting a product survey for foreign users, it is necessary for the surveyor to move to a foreign country and interview the foreign user. In this case, it may be difficult to conduct a product survey to foreign users at low cost due to the cost of transportation.

Further, in a general communication system for transmitting images and sounds, users located at the first base and the second base exchange bidirectionally with each other. In such a communication system, it may be difficult to obtain a high-quality image that can read a user's facial expression or the like. For example, when interviewing a foreign user about the use of a product using such a communication system, it is difficult to obtain sufficient information about the usability of the product. For example, when a foreign user gives a positive evaluation to a product, he / she may refrain from giving a positive evaluation because it is an interview regarding the use of the product. In such a case, it may be possible to support the evaluation by reading the facial expression of a foreign user, but since it is difficult to read the facial expression of the user in a general communication system, the product It was sometimes difficult to obtain sufficient information about usability.

In addition, when confirming the quality of a product prototyped in a foreign country, it was difficult to obtain sufficient information on the softness and feel of the product. For example, in such a case, it may be possible to support the evaluation by reading the facial expression of a foreign user, but it is difficult to read the facial expression of the user in a general communication system. It was sometimes difficult to obtain sufficient information about the usability of the product.

In response to these issues, the communication system provides Japanese users with images taken by foreign users received via the first network that performs unidirectional communication, thereby reducing delays on the network. Reduce. This allows the communication system to provide high quality images. In addition, the communication system reduces delays on the network by providing Japanese users with images taken of products prototyped in foreign countries received via the first network. This allows the communication system to provide high quality images of the product.

In addition, since the communication system provides Japanese users with messages received via the second network that performs two-way communication, messages are exchanged between users at the same time as the provision of images and in real time. It is possible to do. In this way, the communication system solves the above-mentioned problems. Therefore, the communication system can accurately grasp the situation of the object including the user and the product.

Further, the communication system provides the received information to the users of the first base and another third base different from the second base.

According to such a communication system, the received information is provided to the users of the first base and the third base different from the second base, so that the situation of the object located in the remote place can be accurately grasped. be able to.

Further, the communication system analyzes the received information and provides the analyzed analysis result to the user of the second base.

According to such a communication system, the received information is analyzed and the analyzed analysis result is provided to the user of the second base, so that the situation of the object located in the remote place can be accurately grasped. ..

Further, the communication system analyzes an image of a user who satisfies a predetermined condition as the received information, and provides the analyzed analysis result to the user of the second base.

According to such a communication system, in order to analyze an image of a user who satisfies a predetermined condition as received information and provide the analyzed analysis result to a user of a second base, a remote location is used. It is possible to accurately grasp the situation of the object located in.

Further, the communication system analyzes the facial expressions of the users who satisfy the predetermined conditions, extracts the psychological characteristic information indicating the psychological characteristics of the users who satisfy the predetermined conditions, and uses the analyzed psychological characteristic information as the second. Provide to users of the base.

According to such a communication system, by analyzing the facial expressions of users who satisfy predetermined conditions, psychological characteristic information indicating the psychological characteristics of users who satisfy predetermined conditions is extracted and analyzed psychological characteristic information. Is provided to the user of the second base, so that the situation of the object located in the remote place can be accurately grasped.

Further, the communication system analyzes the sensor information detected by the sensor as the received information, and provides the analyzed analysis result to the user of the second base.

According to such a communication system, the sensor information detected by the sensor is analyzed as the received information, and the analyzed analysis result is provided to the user of the second base, so that the object located in a remote place can be analyzed. You can get an accurate grasp of the situation.

Further, the communication system extracts the environmental feature information indicating the information about the photographed environment by analyzing the sensor information, and provides the analyzed environmental feature information to the user of the second base.

According to such a communication system, by analyzing the sensor information, the environmental feature information indicating the information about the photographed environment is extracted, and the analyzed environmental feature information is provided to the user of the second base. It is possible to accurately grasp the situation of an object located in a remote place.

Further, the communication system analyzes the sensor information detected from the user who satisfies the predetermined condition, and extracts and analyzes the psychological characteristic information indicating the psychological characteristic of the user who satisfies the predetermined condition. Psychological feature information is provided to the user of the second base.

According to such a communication system, by analyzing the sensor information detected from the user who satisfies the predetermined condition, the psychological feature information indicating the psychological characteristic of the user who satisfies the predetermined condition is extracted and analyzed. Since the psychological feature information is provided to the user of the second base, the situation of the target person located in a remote place can be accurately grasped.

Further, the communication system receives an image transmitted from the first base from the first base to the second base via the first network, and uses the received image at the second base. To provide to the person.

According to such a communication system, an image transmitted from the first base is received from the first base to the second base via the first network, and the received image is used by the user of the second base. Therefore, it is possible to accurately grasp the situation of the target person located in a remote place.

Further, the communication system receives a message transmitted from the user of the first base to the user of the second base, and the user of the first base to the second base via the second network. The message to be transmitted to the user is transmitted to the second base, the message transmitted from the first base is received via the second network, and the received message is sent to the second base. Provide to users.

According to such a communication system, a message transmitted from the user of the first base to the user of the second base is received, and the user of the first base uses the second base via the second network. To send a message to be sent to a person to a second base, receive a message sent from the first base via the second network, and provide the received message to a user of the second base. , It is possible to communicate accurately with other users located in remote areas.

Further, the communication system stores the image transmitted from the first base in a predetermined storage unit in a predetermined mode.

According to such a communication system, since the image transmitted from the first base is stored, the image can be re-verified or reused as appropriate.

Further, the communication system stores the image in the predetermined storage unit in a time-lapse format.

According to such a communication system, the image transmitted from the first base is stored in a predetermined storage unit in a time-lapse format, so that the image can be stored in an appropriate data format. As a result, the communication system can store an image that maintains an appropriate resolution even if the image is acquired by shooting for a long time.

Hereinafter, an example of an embodiment for implementing a communication system and a communication method (hereinafter, referred to as “embodiment”) will be described in detail with reference to the drawings. The communication system and the communication method are not limited by this embodiment. Further, in the following embodiments, the same parts are designated by the same reference numerals, and duplicate description will be omitted.

[Embodiment]
[1. An example of information processing indicated by a communication system]
An example of information processing executed by the communication system 1 according to the embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an example of information processing executed by the communication system 1 according to the embodiment. The example of FIG. 1 shows an example in which the first base LO1 is a foreign country and the second base LO2 is Japan.

Here, in the example of FIG. 1, in a foreign country, the state of an interview for investigating the performance and evaluation of the nonwoven fabric product, and the use for confirming the nonwoven fabric product after use. An example of transmitting the state of the nonwoven fabric product later via the first network N1 for unidirectional communication will be described. At this time, it is assumed that the foreign person in charge and the Japanese person in charge exchange messages with each other via the second network N2 that performs two-way communication.

For example, relay devices 11 and 12 located in a foreign country communicate with information processing devices 201 and 202 located in Japan via a first network N1 that performs unidirectional communication, and images are transmitted to the information processing devices 201 and 202. Send each. Further, the terminal devices 101 and 102 used by foreign users communicate with the terminal devices 103 and 104 used by Japanese users via the second network N2 that performs two-way communication, and send a message. Interact with each other.

In the following, when the first network N1 and the second network are not particularly distinguished, they may be referred to as network N. Further, when the relay devices 11 and 12 are not particularly distinguished, they may be referred to as the relay device 10.

Further, when the information processing devices 201 and 202 are not particularly distinguished, they may be referred to as the information processing device 200. Further, when the terminal devices 101, 102, 103 and 104 are not particularly distinguished, they may be referred to as the terminal device 100.

First, as shown in Fig. 1, as an example of a user who meets certain conditions in a foreign country, he / she is in charge of a user who has used the product (hereinafter, may be referred to as a target person). The person shall interview. In this case, the person in charge uses the camera CA11 to take a picture of the interview. Then, the person in charge records the voice of the interview using the microphone MA11. For example, the person in charge interviews the target person about "Is the product easy to use?", "How was the product feeling?", "Is there any discomfort when using the product?"

Subsequently, the microphone MA11 and the camera CA11 transmit audio information and an image to the relay device 11 (step S1). Then, the information processing device 201 receives the voice information and the image from the relay device 11 via the first network N1 (step S2). Further, the information processing apparatus 201 provides the images to the displays DI21 and DI22 (step S3). In this case, the information processing apparatus 201 provides audio information to the displays DI21 and DI22 together with the image. As a result, the information processing apparatus 201 provides the image and sound of the interview to the person in charge in Japan.

For example, in the information processing device 201, the foreign person in charge and the target person asked the Japanese person in charge, "Is the product easy to use?", "How was the product feel?", "Use the product." We will provide images and sounds showing how the interview is being conducted, such as "Is there any discomfort?"

In addition, it is assumed that there is a person in charge (hereinafter, may be referred to as an observer) who is observing the state of the interview through the magic mirror. In this case, the camera CA12 is used to photograph the observer. Then, the person in charge records the voice of the observer using the microphone MA12. For example, the observer instructs the person in charge to ask a more in-depth question about the question "How was the product feel?".

Subsequently, the microphone MA12 and the camera CA12 transmit audio information and an image to the relay device 12 (step S4). Then, the information processing device 202 receives the voice information and the image from the relay device 12 via the first network N1 (step S5). Further, the information processing apparatus 202 provides the images to the displays DI23 and DI24 (step S6). In this case, the information processing apparatus 202 provides audio information to the displays DI23 and DI24 together with the image. As a result, the information processing apparatus 202 provides the person in charge in Japan with an image and a sound showing the state of the observer. For example, the information processing device 202 instructs a Japanese person in charge to ask the person in charge a more in-depth question about the question "How was the product feel?" The image and sound to be shown are provided.

Next, an example of photographing a used non-woven fabric product that has been used in advance by a foreign user will be given. For example, the person in charge uses the camera CA11 to take a picture of a used non-woven fabric product. For example, the person in charge observes the usability, softness, defects of the product, etc. of the used nonwoven fabric product by using the camera CA11.

Subsequently, the camera CA 11 transmits an image to the relay device 11 in the same manner as in step S1. Then, the information processing device 201 receives the image from the relay device 11 via the first network N1 as in step S2. Further, the information processing apparatus 201 provides an image to the displays DI21 and DI22 in the same manner as in step S3. As a result, the information processing apparatus 201 provides the person in charge in Japan with an image showing the state of the used nonwoven fabric product. For example, the information processing apparatus 201 provides a person in charge in Japan with information on observing the usability, softness, defects of the product, and the like of the used nonwoven fabric product.

Next, as an example of a user who satisfies a predetermined condition, an example of a user who is a monitor gathered to use a non-woven fabric product (hereinafter, may be referred to as an observation target person) will be given. For example, it is assumed that a plurality of foreign observers are divided into private rooms and monitored for using non-woven fabric products. In this case, a monitoring camera CA11 is installed at a predetermined location in each private room. For example, the monitoring camera CA11 monitors the process until the observation target actually uses the non-woven fabric product, defects when the observation target wears the non-woven fabric product, and the like.

Subsequently, the camera CA 11 transmits the monitored image to the relay device 11 in the same manner as in step S1. Then, the information processing device 201 receives the monitored image from the relay device 11 via the first network N1 as in step S2. Further, the information processing apparatus 201 provides the monitored images to the displays DI21 and DI22 in the same manner as in step S3. As a result, the information processing apparatus 201 provides the person in charge in Japan with an image showing the state of monitoring. For example, the information processing apparatus 201 provides information to a person in charge in Japan about the process until the observation target actually uses the non-woven fabric product and the observation of defects when the observation target wears the non-woven fabric product. offer.

Here, step S7 is appropriately executed at the same time as the above embodiment. Specifically, the terminal device 101 used by a foreign person in charge transmits a message to the terminal device 103 used by a Japanese person in charge via the second network N2 (step S7).

For example, a foreign person in charge shall interview a foreign target person. In this case, the terminal device 101 used by a foreign person in charge transmits a message to the terminal device 103 used by a Japanese person in charge. For example, the content of the message is "Is there anything else you would like to check?"

Then, the terminal device 103 transmits a message that is a reply to the message received from the terminal device 101. For example, as the content of the message, "I want the observer to ask a more in-depth question about a specific question" or "I want the target person to ask about the function that should be implemented in the non-woven fabric product". Or, "I want the subject to take a little longer to answer the question so that the answer to the question can be explained in more concrete and detailed manner."

Then, the terminal device 101 transmits a message that is a reply to the message received from the terminal device 103. For example, the content of the message is "I understand". In this way, the terminal devices 101 and 103 enable a foreign person in charge and a Japanese person in charge to exchange messages in real time.

In addition, used non-woven fabric products that have been used in advance by foreign users shall be photographed. In this case, the terminal device 103 transmits a message to the terminal device 101. For example, as the content of the message, "I want you to enlarge and display the part of the used non-woven fabric product that is considered to have come into contact with the target person frequently" or "The roughness of the surface of the used non-woven fabric product". I want to see it. "

Then, the terminal device 101 transmits a message that is a reply to the message received from the terminal device 103. For example, the content of the message is "I understand". As described above, since the communication system 1 can communicate with the foreign person in charge by the terminal device 100 after the Japanese person in charge confirms the image and the sound provided by the information processing device 200, it is remote. Even in the ground, more detailed research on non-woven fabric products is possible.

Further, a foreign person may make a video call with Japan and the person in charge using the terminal device 102 and the camera CA13. For example, it is assumed that a foreign person in charge uses the terminal device 102 and the camera CA13, and a Japanese person in charge uses the terminal device 104 and the camera CA21. In this case, the foreign person in charge may make a video call with the person in charge in Japan to exchange information such as exchanging opinions.

Next, an example will be given in which a plurality of foreign observers are divided into private rooms and monitored for using non-woven fabric products. For example, a monitoring camera CA11 is installed at a predetermined location in each private room, and a foreign person in charge uses the camera CA13 to adjust the angle of view of the monitoring camera CA11. In this case, the camera CA 13 transmits an image obtained by monitoring the angle of view of the monitoring camera CA 11 installed at each location to the terminal device 102 (step S8). Subsequently, the terminal device 104 receives such an image (step S9). In this case, the person in charge in Japan checks the angle of view of the monitoring camera CA11 based on the image, and uses the terminal device 103 to ask the terminal device 101 to "change the angle of view to the left by 10 °." Message is sent. Then, the foreign person in charge adjusts the angle of view of the monitoring camera CA11 with reference to the message received by the terminal device 101. In this way, the terminal devices 101 and 103 enable real-time communication between a foreign person in charge and a Japanese person in charge.

In the example of FIG. 1, for convenience, steps S1 to S9 have been described in order, but steps S1 and S4, steps S2, S5 and S7, and steps S3 and S6 may be executed at the same time.

In this way, the communication system 1 captures an image of a foreign subject received via the first network N1 that performs unidirectional communication and an image of a non-woven fabric product used in a foreign country in Japan. By providing it to the person in charge, delays on the network etc. are reduced. Thereby, the communication system 1 can provide a high-quality image.

Further, since the communication system 1 provides the message received via the second network N2 that performs two-way communication to the person in charge in Japan, the message is simultaneously provided at the same time as the image is provided, and the message is sent between the persons in charge in real time. It is possible to exchange information. As a result, the communication system 1 can accurately grasp the situation of the target person and the non-woven fabric product to the person in charge located at a remote place.

[2. An example of analysis processing]
Next, the analysis process executed by the communication system 1 according to the embodiment will be described with reference to FIG. FIG. 2 is a diagram showing an example of analysis processing executed by the communication system 1 according to the embodiment. Here, in the example of FIG. 2, it is assumed that an image showing a state in which a foreign person in charge interviews the target person is received.

First, as shown in FIG. 2, the information processing apparatus 200 receives an image (step S21). For example, the information processing apparatus 200 receives an image showing how a foreign person in charge interviews the target person.

Subsequently, the information processing apparatus 200 analyzes the facial expression of the subject included in the image to extract psychological feature information indicating the psychological feature (step S22). For example, it is assumed that the facial expression of the subject is a gentle facial expression. In this case, the information processing apparatus 200 analyzes the facial expression of the subject by using a conventional technique such as image analysis, and determines that the facial expression of the subject is a gentle facial expression. Then, the information processing device 200 extracts the psychological feature information of the subject as calm. As a result, the information processing apparatus 200 determines that the response of the subject at the time of the interview does not include a lie.

In addition, it is assumed that the facial expression of the subject is a strong facial expression. In this case, the information processing apparatus 200 analyzes the facial expression of the subject by using a conventional technique such as image analysis, and determines that the facial expression of the subject is a tense facial expression. Then, the information processing device 200 extracts the psychological feature information of the subject as tension. As a result, the information processing apparatus 200 determines that the answer of the subject at the time of the interview contains a lie.

In this way, the communication system 1 can associate the response of the subject at the time of the interview with the analysis result of analyzing the facial expression of the subject, so that more accurate information on the nonwoven fabric product can be extracted from the subject. ..

Then, the information processing apparatus 200 provides the analysis result to the terminal apparatus 100 (step S23). For example, the information processing apparatus 200 says that when the psychological characteristic information of the subject is calm, the information that the psychological characteristic information of the subject is calm and that the answer of the subject at the time of the interview does not include a lie. Provide information to foreign personnel, observers, Japanese personnel, etc.

Further, the information processing apparatus 200 says that when the psychological characteristic information of the subject is tense, the information that the psychological characteristic information of the subject is tense and that the answer of the subject at the time of the interview contains a lie. Provide information. Thereby, the communication system 1 can determine whether or not the answer of the subject is reliable information.

[3. Communication system configuration]
Next, the configuration of the communication system 1 according to the embodiment will be described with reference to FIG. FIG. 3 is a diagram showing a configuration example of the communication system 1 according to the embodiment. As shown in FIG. 3, the communication system 1 includes a relay device 10, a terminal device 100, and an information processing device 200. The relay device 0, the terminal device 100, and the information processing device 200 are connected to each other via a network N so as to be communicable by wire or wirelessly. The communication system 1 shown in FIG. 3 may include a plurality of relay devices 10, a plurality of terminal devices 100, and a plurality of information processing devices 200.

The relay device 10 according to the embodiment is a transmitter capable of transmitting various information under various conditions. For example, the relay device 10 uses the first network N1 to transmit images and audio information from a foreign country to Japan.

The terminal device 100 according to the embodiment is an information processing device used by a user who accesses contents such as web contents displayed on a browser and contents for an application. For example, the terminal device 100 is a desktop PC (Personal Computer), a notebook PC, a tablet terminal, a mobile phone, a PDA (Personal Digital Assistant), or the like.

For example, the terminal device 100 is pre-installed with an application capable of transmitting and receiving messages, an application capable of making a video call, and the like. As a result, the terminal device 100 exchanges messages between the terminal devices 100 in which an application capable of transmitting and receiving messages is pre-installed. Further, the terminal device 100 makes a video call between the terminal devices 100 in which an application capable of making a video call is pre-installed.

The information processing device 200 according to the embodiment is an information processing device capable of communicating with various devices via a predetermined network N such as the Internet, and is realized by, for example, a server device or a cloud system. For example, the information processing device 200 is communicably connected to various other devices via the network N.

[4. Terminal device configuration]
Further, the configuration of the terminal device 100 according to the embodiment will be described with reference to FIG. FIG. 3 is a diagram showing a configuration example of the terminal device 100 according to the embodiment. As shown in FIG. 3, the terminal device 100 includes a communication unit 110, an input unit 120, a storage unit 130, an output unit 140, and a control unit 150.

(About communication unit 110)
The communication unit 110 is realized by, for example, a NIC (Network Interface Card) or the like. Then, the communication unit 110 is connected to the network N by wire or wirelessly, and the user transmits / receives information between different terminal devices 100.

(About input unit 120)
The input unit 120 receives various operations from the user. For example, the input unit 120 may accept various operations from the user via the display surface by the touch panel function. Further, the input unit 120 may accept various operations from the buttons provided on the terminal device 100 and the keyboard and mouse connected to the terminal device 100.

(About the storage unit 130)
The storage unit 130 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk.

(About output unit 140)
The output unit 140 is a display screen of a tablet terminal or the like realized by, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display, and displays various information.

(About control unit 150)
The control unit 150 is a controller, and for example, various programs stored in a storage device inside the terminal device 100 by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like have a RAM as a work area. It is realized by being executed. Further, the control unit 150 is a controller, and is realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

As shown in FIG. 3, the control unit 150 includes a reception unit 151, a transmission unit 152, a reception unit 153, and a provision unit 154, and realizes or executes an information processing function or operation described below. .. The internal configuration of the control unit 150 is not limited to the configuration shown in FIG. 3, and may be any other configuration as long as it is configured to perform information processing described later. Further, the connection relationship of each processing unit included in the control unit 150 is not limited to the connection relationship shown in FIG. 3, and may be another connection relationship.

(About reception desk 151)
The reception unit 151 receives various information. Specifically, the reception unit 151 receives information to be transmitted from the user of the first base to the user of the second base. For example, the reception department 151 accepts a message from a foreign person in charge, such as "Is there anything else you would like to check?"

(About transmitter 152)
The transmission unit 152 transmits various information. Specifically, the transmission unit 152 is from the user of the first base to the user of the second base via the second network that performs two-way communication of information between the first base and the second base. The information to be transmitted is transmitted to the second base. For example, the transmission unit 152 transmits a message content such as "Is there anything else you would like to confirm?" From a foreign person in charge to a Japanese person in charge.

(About receiver 153)
The receiving unit 153 (an example of the second receiving unit) receives various information. Specifically, the receiving unit 153 receives the information transmitted from the first base via the second network. For example, the receiving unit 153 receives a message from a foreign person in charge to a Japanese person in charge, such as "Is there anything else you want to check?"

(About the provider 154)
The providing unit 154 (an example of the second providing unit) provides various information. Specifically, the providing unit 154 provides the information received by the receiving unit 153 to the user of the second base. For example, the providing unit 154 provides a message that is a reply to the message received by the receiving unit 153. For example, as the content of the message, "I want the observer to ask a more in-depth question about a specific question" or "I want the target person to ask about the function that should be implemented in the non-woven fabric product". Or, "I want the subject to take a little longer to answer the question so that the answer to the question can be explained in more concrete and detailed manner."

[5. Information processing device configuration]
Further, the configuration of the information processing apparatus 200 according to the embodiment will be described with reference to FIG. FIG. 3 is a diagram showing a configuration example of the information processing apparatus 200 according to the embodiment. As shown in FIG. 3, the information processing apparatus 200 includes a communication unit 210, a storage unit 220, and a control unit 230.

(About communication unit 210)
The communication unit 210 is realized by, for example, a NIC or the like. Then, the communication unit 210 is connected to the network N by wire or wirelessly, and transmits / receives information to / from the relay device 10.

(About the storage unit 220)
The storage unit 220 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 220 has an image information storage unit 221.

(About image information storage unit 221)
The image information storage unit 221 according to the embodiment stores information related to the image. Here, FIG. 4 shows an example of the image information storage unit 221 according to the embodiment. In the example shown in FIG. 4, the image information storage unit 221 has items such as "image ID (Identifier)" and "image information". For example, "image information" has items such as "image" and "date and time".

The "image ID" is an identifier that identifies an image. The "image" is information about an image associated with an "image ID". The "date and time" is information regarding the date and time when the image associated with the "image ID" was taken.

For example, in FIG. 4, the image of "V1" identified by the image ID is "IM1" and the date and time is "T1". In the example shown in FIG. 4, the image and the date and time are represented by an abstract code such as "V1", but the image may be in a specific file format or the like. Also, the date and time are the specific file format. It may be a specific numerical value or the like.

(About control unit 230)
The control unit 230 is a controller, and is realized by, for example, using a CPU, an MPU, or the like to execute various programs stored in the storage device inside the information processing device 200 using the RAM as a work area. Further, the control unit 230 is a controller, and is realized by, for example, an integrated circuit such as an ASIC or FPGA.

As shown in FIG. 3, the control unit 230 has a receiving unit 231, an analysis unit 232, and a providing unit 233, and realizes or executes the functions and operations of information processing described below. The internal configuration of the control unit 230 is not limited to the configuration shown in FIG. 3, and may be any other configuration as long as it is configured to perform information processing described later. Further, the connection relationship of each processing unit included in the control unit 230 is not limited to the connection relationship shown in FIG. 3, and may be another connection relationship.

(About receiver 231)
The receiving unit 231 (an example of the first receiving unit) receives various information. Specifically, the receiving unit 231 receives the information transmitted from the first base via the first network that performs unidirectional communication of information from the first base to the second base. Then, the receiving unit 231 stores the received image in the image information storage unit 221.

For example, in the example of FIG. 1, the person in charge interviews the target person in a foreign country. In this case, the person in charge uses the camera CA11 to take a picture of the interview. Then, the person in charge records the voice of the interview using the microphone MA11. For example, the person in charge interviews the target person about "Is the product easy to use?", "How was the product feeling?", "Is there any discomfort when using the product?" At this time, the receiving unit 231 asked the Japanese person in charge via the first network N1 that the foreign person in charge and the target person asked, "Is the product easy to use?" And "How was the product touch?" The relay device 11 receives an image showing an interview, such as "Did you feel uncomfortable using the product?", And audio.

(About analysis unit 232)
The analysis unit 232 analyzes the information received by the reception unit 231. For example, the analysis unit 232 extracts the psychological feature information indicating the psychological feature by analyzing the facial expression of the subject included in the image received by the receiving unit 231.

For example, it is assumed that the facial expression of the subject is a gentle facial expression. In this case, the analysis unit 232 analyzes the facial expression of the subject by using a conventional technique such as image analysis, and determines that the facial expression of the subject is a gentle facial expression. Then, the analysis unit 232 extracts the psychological characteristic information of the subject as calm. As a result, the analysis unit 232 determines that the response of the subject at the time of the interview does not include a lie.

In addition, it is assumed that the facial expression of the subject is a strong facial expression. In this case, the analysis unit 232 analyzes the facial expression of the subject by using a conventional technique such as image analysis, and determines that the facial expression of the subject is a tense facial expression. Then, the analysis unit 232 extracts the psychological characteristic information of the subject as tension. As a result, the analysis unit 232 determines that the answer of the subject at the time of the interview contains a lie.

The analysis unit 232 analyzes the facial expression of the subject by learning the relationship between the analysis result of analyzing the facial expression of the subject, the answer at the time of the interview of the subject, and the positive intention of the subject. When the analysis result and the answer at the time of the interview of the subject are input, a learning model that outputs a score indicating the positive intention of the subject may be generated. As a result, the analysis unit 232 inputs the analysis result of analyzing the facial expression of the subject into the learning model and the answer at the time of the interview of the subject, and outputs a score showing a positive intention to the answer of the subject. You may. In this way, the analysis unit 232 determines with high accuracy whether or not the subject's answer contains a lie by generating a learning model that outputs a score indicating a positive intention to the subject's answer. can do.

(About the provider 233)
The providing unit 233 (an example of the first providing unit) provides various information. Specifically, the providing unit 233 provides the information received by the receiving unit 231 to the user of the second base. Further, the providing unit 233 provides the analysis result analyzed by the analysis unit 232 to the user of the second base.

For example, the provision department 233 told the Japanese person in charge that the foreign person in charge and the target person asked, "Is the product easy to use?", "How was the product feel?", "Used the product." We will provide images and sounds showing how the interview is being conducted, such as "Is there any discomfort?"

For example, the providing unit 233 responds to the subject at the time of the interview together with information that the analysis result analyzed by the analysis unit 232 shows that the psychological characteristic information of the subject is calm when the psychological characteristic information of the subject is calm. In addition, we will provide information that does not contain lies to foreign personnel, observers, Japanese personnel, etc.

[6. Processing procedure (1)]
Next, the procedure of information processing executed by the information processing apparatus 200 according to the embodiment will be described with reference to FIG. FIG. 5 is a flowchart showing an example of the flow of information processing executed by the information processing apparatus 200 according to the embodiment.

As shown in FIG. 5, the receiving unit 231 determines whether or not the timing is predetermined (step S101). Here, the predetermined timing may be any timing, for example, the timing at which the interview of the subject is started, the timing at which the used nonwoven fabric product is confirmed, and the like.

Specifically, when it is determined that the timing is not predetermined (step S101; No), the receiving unit 231 waits until it is determined that the timing is not predetermined. On the other hand, when the receiving unit 231 determines that the timing is predetermined (step S101; Yes), the receiving unit 231 receives the image transmitted from the first base via the first network (step S102).

Then, the analysis unit 232 analyzes the image (step S103). Then, the providing unit 233 provides the image and the analysis result to the user of the second base (step S104).

[7. Processing procedure (2)]
Next, the procedure of information processing executed by the terminal device 100 according to the embodiment will be described with reference to FIG. FIG. 6 is a flowchart showing an example of the flow of information processing executed by the terminal device 100 according to the embodiment.

As shown in FIG. 6, the reception unit 151 receives a message to be transmitted from the user of the first base to the user of the second base (step S201). Specifically, when the reception unit 151 does not receive the message transmitted from the user of the first base to the user of the second base, the user of the first base to the user of the second base Wait for the message to be sent.

On the other hand, when the reception unit 151 receives the message to be transmitted from the user of the first base to the user of the second base (step S201; Yes), the transmission unit 152 first receives the message via the second network. A message to be transmitted from the user of the base to the user of the second base is transmitted to the second base (step S202).

Then, the receiving unit 153 receives the message transmitted from the first base via the second network (step S203). Then, the providing unit 154 provides the received message to the user of the second base (step S204).

[8. Modification example]
The terminal device 100 and the information processing device 200 described above may be implemented in various different forms other than the above-described embodiment. Therefore, in the following, another embodiment of the terminal device 100 and the information processing device 200 will be described.

[8-1. Hub〕
In the above embodiment, the example in which the first base is in a foreign country and the second base is in Japan has been described, but the present invention is not limited to this. For example, the base may correspond to a prefecture in Japan. In this case, the first base is Tokyo and the second base is Fukuoka. Further, the base may be composed of a plurality of bases. For example, the first base may be a foreign country, the first second base may be Tokyo, and the second second base may be Ehime.

Further, the information processing apparatus 200 may provide the received information to the users of the first base and the third base different from the second base. For example, assume that the first base is Thailand, the second base is Japan, and the third base is China. In this case, the information processing apparatus 200 may provide the information transmitted from Thailand to Japan to the user in China.

Further, it is assumed that the first base is Vietnam, the second base is Tokyo, and the third base is Ehime. In this case, the information processing apparatus 200 may provide the information transmitted from Vietnam to Tokyo to the user in Ehime.

[8-2. Second network]
In the above embodiment, an example in which the second network N2 is used for communication between the terminal devices 100 has been described, but the present invention is not limited to this as long as there is no delay on the network. For example, the terminal device 101 used by a foreign person may communicate with the terminal device 103 used by a Japanese person via the first network N1. Further, the terminal device 103 may communicate with the terminal device 101 via the first network N1. In this way, a plurality of first networks N1 may be used in combination for communication between the terminal devices 100.

[8-3. Image storage mode]
In the above embodiment, an example in which the information processing apparatus 200 stores an image in the image information storage unit 221 has been described, but the storage mode in this case may be any mode. For example, the information processing apparatus 200 may store an image in the image information storage unit 221 in a time-lapse format.

[8-4. Analysis processing (1) Other methods of extracting psychological information]
In the above embodiment, the information processing apparatus 200 has described by giving an example of an analysis process for extracting psychological feature information by analyzing the facial expression of the subject included in the image, but the present invention is not limited to this. For example, it is assumed that a sensor that acquires the heartbeat information of the subject by using infrared rays or the like is used. In this case, the information processing apparatus 200 may extract the psychological feature information of the subject at the time of the interview by analyzing the sensor information.

For example, it is assumed that the heart rate of the subject is less than a predetermined threshold. In this case, the information processing apparatus 200 analyzes the sensor information and determines that the heart rate of the subject is less than a predetermined threshold value. Then, the information processing device 200 extracts the psychological feature information of the subject as calm. As a result, the information processing apparatus 200 may determine that the response of the subject at the time of the interview does not include a lie.

Further, it is assumed that the heart rate of the subject is equal to or higher than a predetermined threshold value. In this case, the information processing apparatus 200 analyzes the sensor information and determines that the heart rate of the subject is equal to or higher than a predetermined threshold value. Then, the information processing device 200 extracts the psychological feature information of the subject as tension. As a result, the information processing apparatus 200 may determine that the response of the subject at the time of the interview contains a lie.

As a result, the information processing apparatus 200 according to the embodiment extracts the psychological feature information of the subject at the time of the interview by analyzing the sensor information, so that it is highly accurate whether or not the answer of the subject contains a lie. Can be determined.

[8-5. Analysis processing (2) Extraction of environmental information]
In the above embodiment, the information processing apparatus 200 has described by giving an example of an analysis process for extracting psychological feature information by analyzing the facial expression of the subject included in the image, but the present invention is not limited to this. For example, a sensor that detects temperature, humidity, etc. shall be used. In this case, the information processing apparatus 200 may extract environmental feature information indicating information about the environment at the time of the interview by analyzing the sensor information.

The analysis process for extracting the environmental feature information may be combined with the analysis process for analyzing other sensor information. For example, a sensor that detects temperature, humidity, etc., and a sensor that acquires heartbeat information of a subject by using infrared rays, etc. are combined. In this case, the information processing apparatus 200 analyzes each sensor information and corrects the heart rate based on the environmental feature information, and when the heart rate of the subject is less than a predetermined threshold value, the psychological feature information of the subject. Is gently extracted. As a result, the information processing apparatus 200 may determine that the response of the subject at the time of the interview does not include a lie.

Further, the information processing apparatus 200 extracts the psychological feature information of the subject as tension when the heart rate is corrected based on the environmental feature information and the heart rate of the subject is equal to or higher than a predetermined threshold value. As a result, the information processing apparatus 200 may determine that the answer of the subject at the time of the interview contains a lie.

[8-6. Analysis processing (3) Voice information]
In the above embodiment, the information processing apparatus 200 has described by giving an example of an analysis process for extracting psychological feature information by analyzing the facial expression of the subject included in the image, but the present invention is not limited to this. For example, the information processing apparatus 200 may extract the psychological feature information of the subject by analyzing the voice of the subject at the time of the interview.

For example, assume that the subject is calm. In this case, the information processing apparatus 200 analyzes the voice of the target person by using a conventional technique such as voice analysis, and determines that the voice of the target person is a voice emitted when the voice of the target person is in a calm state. Then, the information processing device 200 extracts the psychological feature information of the subject as calm. As a result, the information processing apparatus 200 may determine that the response of the subject at the time of the interview does not include a lie.

In addition, it is assumed that the subject is impatient. In this case, the information processing apparatus 200 analyzes the voice of the target person by using a conventional technique such as voice analysis, and determines that the voice of the target person is a voice emitted when the voice of the target person is in a hurry. Then, the information processing apparatus 200 extracts the psychological feature information of the subject as tension. As a result, the information processing apparatus 200 may determine that the answer of the subject at the time of the interview contains a lie. The voice analysis process may be combined with an analysis process for analyzing the facial expression of the subject included in the image.

As a result, the information processing apparatus 200 according to the embodiment extracts the psychological feature information by analyzing the voice of the subject at the time of the interview, so that it is highly accurate whether or not the answer of the subject contains a lie. It can be determined.

[8-7. others〕
Of the above-mentioned processes, all or part of the processes described as being automatically performed may be performed manually. In addition, all or part of the processing described as being performed manually may be performed automatically by a known method. In addition, information including processing procedures, specific names, various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown in the figure.

Further, each component of each of the illustrated devices is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure. Further, each component may be functionally or physically distributed / integrated in any unit according to various loads, usage conditions, etc., in whole or in part thereof.

In addition, the above-mentioned processes may be appropriately combined and executed within a consistent range.

Further, the above-mentioned "section, module, unit" can be read as "means" or "circuit". For example, the receiving unit can be read as a receiving means or a receiving circuit.

[9. Hardware configuration]
Further, the terminal device 100 and the information processing device 200 according to the above-described embodiment are realized by, for example, a computer 1000 having a configuration as shown in FIG. 7. FIG. 7 is a diagram showing an example of a hardware configuration. The computer 1000 is connected to the output device 1010 and the input device 1020, and the arithmetic unit 1030, the cache 1040, the memory 1050, the output IF (Interface) 1060, the input IF 1070, and the network IF 1080 are connected by the bus 1090.

The arithmetic unit 1030 operates based on a program stored in the cache 1040 or the memory 1050, a program read from the input device 1020, or the like, and executes various processes. The cache 1040 is a cache that temporarily stores data used by the arithmetic unit 1030 for various operations such as RAM. Further, the memory 1050 is a storage device in which data used by the arithmetic unit 1030 for various calculations and various databases are registered, and is realized by a ROM (Read Only Memory), an HDD (Hard Disk Drive), a flash memory, or the like. Memory.

The output IF 1060 is an interface for transmitting information to be output to an output device 1010 that outputs various information such as a monitor and a printer. For example, USB (Universal Serial Bus), DVI (Digital Visual Interface), and the like. It may be realized by a connector of a standard such as HDMI (registered trademark) (High Definition Multimedia Interface). On the other hand, the input IF 1070 is an interface for receiving information from various input devices 1020 such as a mouse, a keyboard, a scanner, and the like, and is realized by, for example, USB.

For example, the input device 1020 includes an optical recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), and a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), and a tape medium. It may be realized by a device that reads information from a magnetic recording medium, a semiconductor memory, or the like. Further, the input device 1020 may be realized by an external storage medium such as a USB memory.

The network IF 1080 has a function of receiving data from another device via the network N and sending the data to the arithmetic unit 1030, and transmitting the data generated by the arithmetic unit 1030 to the other device via the network N.

Here, the arithmetic unit 1030 controls the output device 1010 and the input device 1020 via the output IF 1060 and the input IF 1070. For example, the arithmetic unit 1030 loads a program from the input device 1020 or the memory 1050 onto the cache 1040, and executes the loaded program. For example, when the computer 1000 functions as the information processing device 200, the arithmetic unit 1030 of the computer 1000 realizes the function of the control unit 230 by executing the program loaded on the cache 1040.

The embodiments of the present application have been described in detail with reference to the drawings. However, these are examples, and the embodiments of the present application shall be carried out in other embodiments which have been modified or improved in various ways based on the knowledge of those skilled in the art, including the embodiments described in the disclosure column of the invention. Is possible.

1 Communication system N network N1 1st network N2 2nd network 10, 11, 12 Relay device 100, 101, 102, 103, 104 Terminal device 110 Communication unit 120 Input unit 130 Storage unit 140 Output unit 150 Control unit 151 Reception unit 152 Transmitter 153 Receiver 154 Providing unit 200, 201, 202 Information processing device 210 Communication unit 220 Storage unit 221 Image information storage unit 230 Control unit 231 Receiving unit 232 Analysis unit 233 Providing unit

Claims (13)

A first receiving unit that receives information transmitted from the first base via a first network that performs unidirectional communication of information from the first base to the second base.
The first providing unit that provides the information received by the first receiving unit to the user of the second base, and the first providing unit.
A reception unit that receives information transmitted from the user of the first base to the user of the second base, and
Information transmitted from the user of the first base to the user of the second base via the second network for two-way communication of information between the first base and the second base. The transmission unit that transmits to the second base and
A second receiving unit that receives information transmitted from the first site via the second network, and a second receiving unit.
A communication system including a second providing unit that provides information received by the second receiving unit to a user of the second base. The first providing unit is
The information received by the first receiving unit is provided to the users of the first base and another third base different from the second base.
The communication system according to claim 1. Further, an analysis unit for analyzing the information received by the first reception unit is provided.
The first providing unit is
The communication system according to claim 1 or 2, wherein the analysis result analyzed by the analysis unit is provided to the user of the second base. The analysis unit
As the information received by the first receiving unit, an image showing a user who satisfies a predetermined condition is analyzed.
The first providing unit is
The communication system according to claim 3, wherein the analysis result analyzed by the analysis unit is provided to the user of the second base. The analysis unit
By analyzing the facial expressions of users who satisfy the predetermined conditions, psychological characteristic information indicating the psychological characteristics of the users who satisfy the predetermined conditions is extracted.
The first providing unit is
The communication system according to claim 4, wherein the psychological feature information analyzed by the analysis unit is provided to the user of the second base. The analysis unit
The sensor information detected by the sensor is analyzed as the information received by the first receiving unit, and the sensor information is analyzed.
The first providing unit is
The communication system according to claim 3, wherein the analysis result analyzed by the analysis unit is provided to the user of the second base. The analysis unit
By analyzing the sensor information, environmental feature information indicating information about the captured environment is extracted.
The first providing unit is
The communication system according to claim 6, wherein the environmental feature information analyzed by the analysis unit is provided to the user of the second base. The analysis unit
By analyzing the sensor information detected from the user who satisfies the predetermined condition, the psychological characteristic information indicating the psychological characteristic of the user who satisfies the predetermined condition is extracted.
The first providing unit is
The communication system according to claim 6 or 7, wherein the psychological feature information analyzed by the analysis unit is provided to the user of the second base. The first receiving unit is
The image transmitted from the first base is received from the first base to the second base via the first network.
The first providing unit is
The communication system according to any one of claims 1 to 8, wherein the image received by the first receiving unit is provided to the user of the second base. The reception department
Accepting a message to be sent from the user of the first base to the user of the second base,
The transmitter is
A message transmitted from the user of the first base to the user of the second base is transmitted to the second base via the second network.
The second receiver is
Upon receiving the message transmitted from the first base via the second network,
The second providing unit is
The communication system according to any one of claims 1 to 9, wherein the message received by the second receiving unit is provided to the user of the second base. The first receiving unit is
The communication system according to any one of claims 1 to 10, wherein an image transmitted from the first base is stored in a predetermined storage unit in a predetermined mode. The first receiving unit is
The communication system according to claim 11, wherein the image is stored in the predetermined storage unit in a time-lapse format. It is a communication method executed by a communication system.
The first receiving process of receiving the information transmitted from the first base via the first network for unidirectional communication of information from the first base to the second base.
The first providing process of providing the information received by the first receiving process to the user of the second base, and the first providing process.
The reception process for receiving information to be transmitted from the user of the first base to the user of the second base, and
Information transmitted from the user of the first base to the user of the second base via the second network for bidirectional communication of information between the first base and the second base. The transmission process of transmitting to the second base and
A second receiving step of receiving information transmitted from the first base via the second network, and
A communication method comprising a second providing step of providing information received by the second receiving step to a user of the second base.

Images