JP6369907B2 - Social touch control device - Google Patents

Description

  The present invention relates to a social touch control device capable of improving the effect of social touch.

  When communicating, people may make physical contact with each other. The physical contact accompanying this communication is also called social touch. It is known that by performing social touch, anxiety may be reduced or stress may be alleviated during communication. In addition, it is known that social touch may be useful for communicating one's feelings to the other party in communication.

  However, it is known that the effect of social touch may be reduced or the effect of social touch may not occur when the persons who perform communication are of the same sex. Furthermore, it is known that when the persons who perform communication are of the same sex, social touch may be counterproductive, such as increasing stress in communication (see Non-Patent Document 1, for example).

Antal Haans and 2 others, “Investigating Response Similarities between Real and Mediated Social Touch”, [online], CHI 2007, [Search April 21, 2015], Internet <URL: http://www.antalhaans.nl /files/HaansetalCHI07wip.pdf>

  Factors that determine the effectiveness of social touch include the gender of the appearance, voice gender, and hand movements of the communicating party. Social touch can also act when performing communication via a communication device based on these factors.

  Therefore, the objective of this invention made | formed in view of this point is providing the social touch control apparatus which can improve the effect of the social touch in the communication via a communication apparatus.

  In order to solve the above-described problems, a social touch control device according to the present invention includes a first user and a second user that communicate with each other using a social touch device and a terminal device that are connected to be able to communicate with each other. A gender determination unit that determines gender, a gender comparison unit that compares the gender of the first user determined by the gender determination unit and the gender of the second user, and as a result of the comparison, the first If the gender of the second user and the gender of the second user are the same, the information related to the communication of the second user acquired from the terminal device is different from the gender of the second user. An output information generation unit that converts the data into a property, generates output data, and transmits the output data to the social touch device; and the source information based on the input of the second user It generates the arm control data for controlling the arm provided in the Rutatchi device comprises an arm control data generator for transmitting the arm control data to the social touch device.

  According to the social touch control device according to the present invention configured as described above, it is possible to improve the effect of social touch in communication via a communication device.

It is a functional block diagram which shows schematic structure of the telepresence system which concerns on one Embodiment of this invention. It is a figure which shows the use condition of the social touch apparatus of FIG. It is a figure which shows an example of operation | movement of the arm part of FIG. It is a flowchart which shows an example of the production | generation process of the output data by the control part of the social touch control apparatus of FIG. It is a flowchart which shows an example of the production | generation process of the arm control data by the arm control data production | generation part of FIG. It is a figure which shows the modification of the social touch apparatus of FIG.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a functional block diagram showing a schematic configuration of a telepresence system according to an embodiment of the present invention. Telepresence system 100 includes social touch device 200, social touch control device 300, and terminal device 400. The social touch device 200 and the terminal device 400, which are communication devices, are wired or wirelessly connected to the social touch control device 300 so that they can communicate with each other. That is, the social touch device 200 and the terminal device 400 are connected so as to be able to communicate with each other via the social touch control device 300. In the present embodiment, a case where a user (first user) using the social touch device 200 and an operator (second user) using the terminal device 400 perform communication will be described below as an example.

  In the communication between the user and the operator, the social touch device 200 receives input of information from the user and outputs information input to the terminal device 400 by the operator. The social touch device 200 can be configured as a telepresence robot, for example. The social touch device 200 includes an image acquisition unit 210, a voice acquisition unit 220, a display unit 230, a voice output unit 240, an arm unit 250, and a control unit 260. FIG. 2 is a diagram illustrating a usage state of the social touch device 200, and is a diagram illustrating a front side of the social touch device 200. Details of the social touch device 200 will be described with reference to FIGS. 1 and 2.

  The image acquisition unit 210 acquires an image of a user who is using the social touch device 200. The image acquisition unit 210 is configured by a digital video camera, for example. The image acquired by the image acquisition unit 210 is used, for example, when the gender determination unit 311 of the social touch control device 300 determines the gender of the user as will be described later. Further, the image acquired by the image acquisition unit 210 is displayed on a display or the like of the terminal device 400 used by the operator during communication between the user and the operator.

  The voice acquisition unit 220 acquires voice such as words uttered by the user using the social touch device 200. The voice acquisition unit 220 is configured by a microphone, for example. The voice acquired by the voice acquisition unit 220 may be used when, for example, the gender determination unit 311 of the social touch control device 300 determines the gender of the user. The voice acquired by the voice acquisition unit 220 is output from the speaker of the terminal device 400 used by the operator during communication between the user and the operator.

  The display unit 230 displays predetermined information for a user using the social touch device 200. The display unit 230 is configured using, for example, a liquid crystal panel (LCD) or an organic EL panel (OELD). During communication between the user and the operator, for example, an image of the operator captured by a camera provided in the terminal device 400 is displayed on the display unit 230. In addition, on the display unit 230, for example, an avatar image imitating a human being is displayed. The image displayed on the display unit 230 is based on data acquired by the social touch device 200 from the social touch control device 300. Details of data generation in the social touch control device 300 will be described later.

  The voice output unit 240 outputs voice to a user who is using the social touch device 200. The audio output unit 240 is configured by a speaker, for example. In communication between the user and the operator, the voice output unit 240 outputs, for example, a voice such as a word uttered by the operator. In addition, the voice output unit 240 outputs a voice such as an operator's word processed by voice conversion to be described later. The voice output by the voice output unit 240 is based on data acquired by the social touch device 200 from the social touch control device 300. Details of data generation in the social touch device 200 will be described later.

  The arm unit 250 performs a social touch on a user using the social touch device 200. For example, as shown in FIG. 2, the arm unit 250 is orthogonal to the first arm member 251 from the first arm member 251 that protrudes from one side surface of the base 270 of the social touch device 200 and from the tip of the first arm member 251. The second arm member 252 extending along the pedestal 270, and the spherical third arm member 253 attached to the tip of the second arm member 252. The arm part 250 is provided so as to be movable with respect to the base 270. For example, as shown in FIG. 2, the user uses the social touch device 200 in a state in which a part of the body such as a hand is brought close to the movable range of the arm unit 250.

  The arm unit 250 is controlled by the control unit 260 based on data acquired by the social touch device 200 from the social touch control device 300. For example, as illustrated in FIG. 3, in the arm unit 250, the control unit 260 controls the two servo motors 280 so that the second arm member 252 rotates in the vertical direction and the horizontal direction. When the arm part 250 operates in this way, the contact state between the third arm member 253 and the user changes, and social touch is performed.

  Referring to FIG. 1 again, the control unit 260 is a processor that controls and manages the entire social touch device 200 including each functional block of the social touch device 200. The control unit 260 includes a processor such as a CPU (Central Processing Unit) that executes a program that defines a control procedure, and the program is stored in, for example, a storage unit provided in the social touch device 200 or an external storage medium. Is done.

  Next, the social touch control device 300 will be described. The social touch control device 300 controls communication between the social touch device 200 and the terminal device 400. The social touch control device 300 is configured by a computer, for example. The social touch control device 300 includes a control unit 310 and a storage unit 320.

  The control unit 310 is a processor that controls and manages the entire social touch control device 300 including each functional block of the social touch control device 300. The control unit 310 includes a processor such as a CPU that executes a program that defines a control procedure, and the program is stored in, for example, the storage unit 320 or an external storage medium. For example, in communication between the user and the operator, the control unit 310 transmits, to the terminal device 400, an image related to the user acquired by the image acquisition unit 210 of the social touch device 200 and a voice such as the user's utterance acquired by the voice acquisition unit 220. To do. In the present embodiment, the control unit 310 includes a gender determination unit 311, a gender comparison unit 312, an output information generation unit 313, and an arm control data generation unit 314.

  The gender determination unit 311 determines whether the gender of the user who uses the social touch device 200 is male or female. In the present embodiment, the gender determination unit 311 automatically determines gender by performing image analysis based on the user image acquired by the image acquisition unit 210 of the social touch device 200. The gender determination unit 311 can determine gender from an image, for example, by a method disclosed in Japanese Patent No. 5272213.

  Note that the gender determination unit 311 may determine the gender of the user by another method different from the method described above. The gender determination unit 311 can automatically determine the gender of the user based on information about the user acquired by the social touch device 200. Specifically, for example, the gender determination unit 311 performs voice analysis based on the user's voice acquired by the social touch device 200 from the voice acquisition unit 220, and determines gender based on the nature of the voice (for example, frequency). May be automatically determined. The gender determination unit 311 may perform gender determination by combining a plurality of analysis methods such as the image analysis and the voice analysis. By combining a plurality of analysis methods, it becomes easier to determine the gender of the user more reliably.

  For example, when the social touch device 200 includes an input interface, the user may input his / her gender to the input interface, and the gender determination unit 311 may determine the gender of the user based on the user's input.

  The gender comparison unit 312 compares the gender of the user who uses the social touch device 200 and the operator who communicates with the user using the terminal device 400, and determines whether the two genders are different or the same. . The gender comparison unit 312 can recognize the gender of the user based on the determination of the gender determination unit 311. The gender comparison unit 312 can recognize the gender of the operator, for example, by inputting gender to the terminal device 400 by the operator. Note that the gender of the operator may be automatically determined in the same manner as the gender determination unit 311 determines the gender of the user.

  The output information generation unit 313 generates data related to an image to be displayed on the display unit 230 of the social touch device 200 (output image data) and data related to a sound to be output to the audio output unit 240 (output audio data). Specifically, the output information generation unit 313 refers to the determination result by the gender comparison unit 312 based on information related to communication acquired from the terminal device 400, and outputs image data and output audio data to the social touch device 200. Is generated. Here, the information related to communication is information that the operator transmits to the user in communication with the user. Information related to communication includes information (for example, speech) that the operator intends to convey to the user and information (for example, appearance) that the operator does not intend to convey to the user. A specific example of generation of output image data and output audio data by the output information generation unit 313 will be described. Hereinafter, output image data and output audio data are collectively referred to as “output data”.

  When the gender comparison unit 312 determines that the gender between the user and the operator is different, the output information generation unit 313 generates, for example, information related to communication acquired from the terminal device 400 as output data. That is, the social touch device 200 that has acquired the output data in this case from the social touch control device 300 displays the image of the operator acquired by the terminal device 400 on the display unit 230, and the terminal device 400 displays the sound output unit 240 on the voice output unit 240. The acquired operator's voice is output. Moreover, the output information generation part 313 may generate | occur | produce the image (avatar etc.) of the same sex as an operator as output image data.

  On the other hand, when the gender comparison unit 312 determines that the gender between the user and the operator is different, the output information generation unit 313 converts the communication information acquired from the terminal device 400 into a gender characteristic different from the gender of the operator. Then, output data is generated. For example, it is assumed that the gender comparison unit 312 determines that both the user and the operator are men. In this case, the output information generation unit 313 generates an image of a woman opposite to the gender of the operator as output image data. The female image is stored in advance in the storage unit 320, for example. Further, the output information generation unit 313 performs voice conversion on the voice uttered by the operator, thereby increasing the frequency, for example, and converting it to an average voice range frequency uttered by a woman. Then, the output information generation unit 313 generates the converted sound as output sound data. The social touch device 200 that has acquired the output image data and the output audio data generated in this manner from the social touch control device 300 displays a female image on the display unit 230, and the female voice range in the audio output unit 240. Is output. In this way, an impression can be given to the user as if the operator is a woman.

  When the gender comparison unit 312 determines that both the user and the operator are female, the output information generation unit 313 generates a male image as output image data, and converts the voice converted into a male vocal range frequency. Generate as output audio data.

  The arm control data generation unit 314 generates data (arm control data) for controlling the operation of the arm unit 250 of the social touch device 200. The arm control data generation unit 314 generates arm control data when the operator performs a specific input operation such as pressing a specific button on the terminal device 400, for example. When the social touch device 200 acquires arm control data from the social touch control device 300, the control unit 260 controls the operation of the arm unit 250 based on the acquired arm control data.

  Also, the arm control data generation unit 314 generates arm control data when it is determined that a specific word is present in the utterance of the operator based on the voice information acquired by the terminal device 400 from the operator, for example. Specifically, the arm control data generation unit 314 analyzes the operator's voice acquired from the terminal device 400. When the arm control data generation unit 314 determines that there is a specific word stored in the storage unit 320 in advance, for example, “OK” or “Please rest assured” during the operator's utterance, Generate attached arm control data. Then, when the social touch device 200 acquires arm control data from the social touch control device 300, the control unit 260 controls the operation of the arm unit 250 based on the acquired arm control data. Thus, the social touch linked to the words can be realized by operating the arm unit 250 in association with a specific word and performing a social touch.

  The storage unit 320 includes a ROM (Read Only Memory) and a RAM (Random Access Memory), and stores various information such as data necessary when the control unit 310 operates. The storage unit 320 stores, for example, information about an image such as an avatar and an average voice range of a man or woman.

  In addition, the storage unit 320 includes a specific word database 321. The specific word database 321 stores words that are targets for the arm control data generation unit 314 to generate arm control data.

  In communication between the user and the operator, the terminal device 400 accepts various inputs from the operator, and outputs an image relating to the user acquired from the social touch control device 300 and a voice such as the user's speech. The terminal device 400 includes, for example, a personal computer, and includes a display display, a speaker, a camera, a microphone, a control unit that controls these, and the like.

  Next, an example of output data generation processing by the control unit 310 of the social touch control device 300 will be described with reference to the flowchart of FIG. Here, as an example, the user's gender is determined using the above-described image analysis and voice analysis, and the operator's gender is determined based on the gender input to the terminal device 400 by the operator. explain.

  First, the gender determination unit 311 acquires, from the social touch device 200, the user image acquired by the image acquisition unit 210 and the user voice acquired by the audio acquisition unit 220 (step S101).

  Then, the gender determination unit 311 performs image analysis of the user's image and voice analysis of the user's voice, and determines the user's gender based on the results of the image analysis and voice analysis (step S102).

  Next, the gender determination unit 311 acquires information on gender input by the operator from the terminal device 400 (step S103).

  Then, the gender determination unit 311 determines the gender of the operator based on the acquired input by the operator (step S104). That is, the gender determination unit 311 determines that the operator is male when the operator is input as a male, and determines that the operator is female when the operator is input as a female.

  Next, the gender comparison unit 312 determines whether the gender of the user determined in step S102 is different from the gender of the operator determined in step S104 (step S105).

  When the gender comparison unit 312 determines that the gender of the user is different from the gender of the operator (Yes in step S105), the output information generation unit 313 acquires information related to communication from the terminal device 400, and performs this communication. Such information itself is generated as output data (step S106).

  On the other hand, when the gender comparison unit 312 determines that the gender of the user and the gender of the operator are the same (No in step S105), the output information generation unit 313 acquires information related to communication from the terminal device 400 and acquires the information. The communication-related information is converted into a gender characteristic different from the gender of the operator to generate output data (step S107).

  The control unit 310 transmits the output data generated by the output information generation unit 313 to the social touch device 200. The social touch device 200 that has acquired the output data causes the display unit 230 to display an image based on the output data, and outputs sound from the sound output unit 240.

  Next, an example of arm control data generation processing by the arm control data generation unit 314 of the social touch control device 300 will be described with reference to the flowchart of FIG. Here, as an example, it is described that the arm control data generation unit 314 generates the arm control data when a specific input operation is performed by the operator or when a predetermined word is included in the utterance of the operator. To do.

  First, the arm control data generation unit 314 determines whether or not the operator has performed a specific input operation on the terminal device 400 (step S201). When the operator performs a specific input operation on the terminal device 400, a signal indicating that the input operation has been performed is transmitted from the terminal device 400 and received by the social touch control device 300, so that arm control is performed. The data generation unit 314 can confirm that the input operation has been performed.

  When it is determined that the operator has performed a specific input operation (Yes in step S201), the arm control data generation unit 314 generates arm control data based on the input operation (step S202).

  On the other hand, when the arm control data generation unit 314 determines that the operator has not performed a specific input operation (No in step S201), the arm control data generation unit 314 acquires information related to the utterance of the operator transmitted from the terminal device 400 (step S203). .

  Then, the arm control data generation unit 314 performs voice analysis on the acquired operator utterance (step S204).

  The arm control data generation unit 314 refers to the specific word database 321 in the storage unit 320, and whether or not a specific word stored in the specific word database 321 is included in the utterance of the operator as a result of the voice analysis. Is determined (step S205).

  When the arm control data generation unit 314 determines that a specific word is included in the utterance of the operator (Yes in step S205), the arm control data generation unit 314 generates arm control data associated with the specific word (step S202). ).

  On the other hand, when the arm control data generation unit 314 determines that a specific word is not included in the utterance of the operator (No in step S205), the flow ends.

  When generating the arm control data, the arm control data generation unit 314 transmits the generated arm control data to the social touch device 200. The social touch device 200 that has acquired the arm control data operates the arm based on the arm control data to perform a social touch on the user.

  The telepresence system 100 described above can be used in, for example, distance learning or telemedicine. For example, when the telepresence system 100 is used for a remote lesson, the user is a student who takes a lesson, and the operator is a teacher who gives a lesson. For example, when the telepresence system 100 is used for telemedicine, the user is a patient, and the operator is a doctor or a counselor who performs medical care.

  According to the telepresence system 100, when the gender of the user and the gender of the operator are different, the social touch effect by the arm unit 250 can be produced. In addition, even if the gender of the user is the same as the gender of the operator, the user performs a social touch by pseudo-displaying an operator of a gender different from the user, so that the effect of social touch occurs. It becomes easy. In this way, it is possible to improve the effect of social touch in communication via a communication device.

  Although the above embodiments have been described as representative examples, it will be apparent to those skilled in the art that many changes and substitutions can be made within the spirit and scope of the invention. Therefore, the present invention should not be construed as being limited by the above-described embodiments, and various modifications and changes can be made without departing from the scope of the claims.

  For example, the functions included in each component, each step, etc. can be rearranged so that there is no logical contradiction, and multiple components, steps, etc. can be combined or divided into one It is.

  Specifically, for example, in the above-described embodiment, the social touch device 200 and the social touch control device 300 have been described as separate devices, but the social touch device 200 is the social touch control device 300. The social touch control device 300 may be integrated with the function so as to include a function. Further, the terminal device 400 may include the function of the social touch control device 300.

  Moreover, the base 270 of the social touch device 200 may include a tire or the like and be configured to be movable.

  Moreover, in the said embodiment, although the social touch apparatus 200 was provided with the display part 230 and the image of an operator or the image of an avatar was displayed on the display part 230 was demonstrated, it is related with the appearance of the operator shown with respect to a user. The information is not limited to that displayed by the display unit 230. For example, as shown in FIGS. 6A and 6B, the pedestal 270 of the social touch device 200 has a physical bust that simulates a man or a woman instead of the display unit 230, Information regarding appearance may be presented to the user. By using the social touch device 200 having a bust of a gender different from his / her gender according to his / her gender, the user can easily obtain the effect of social touch regardless of the actual gender of the operator.

  Moreover, the social touch device 200 may include a physical bust that simulates a man and a woman, and may change the bust to be presented according to the user.

  In the above embodiment, when the user and the operator are the same sex, the social touch control device 300 converts the information related to the communication acquired from the terminal device 400 into a gender property different from the gender of the operator, and outputs the information. Although it explained that data was generated, the generation method of output data which social touch control device 300 performs is not restricted to this. The social touch control device 300 may generate output data by converting information related to communication acquired from the terminal device 400 into a property that is difficult for both men and women to recognize. Specifically, for example, the social touch control device 300 generates output image data so as to display an image in which an animal is anthropomorphic on the display unit 230, and the voice range between the male and female from the audio output unit 240. The output voice data may be generated so as to output the voice. This makes it easier to avoid the adverse effects of social touch that can occur at least between the same sex.

DESCRIPTION OF SYMBOLS 100 Telepresence system 200 Social touch apparatus 210 Image acquisition part 220 Audio | voice acquisition part 230 Display part 240 Audio | voice output part 250 Arm part 251 1st arm member 252 2nd arm member 253 3rd arm member 260 Control part 270 Base 280 Servo motor 300 Social touch control device 310 Control unit 311 Gender determination unit 312 Gender comparison unit 313 Output information generation unit 314 Arm control data generation unit 320 Storage unit 321 Specific word database 400 Terminal device

Claims (2)

A gender determination unit that determines the gender of the first user and the second user that communicate with each other using a social touch device and a terminal device that are communicably connected to each other;
A gender comparing unit that compares the gender of the first user determined by the gender determining unit with the gender of the second user;
As a result of the comparison, when the gender of the first user and the gender of the second user are the same, information relating to the communication of the second user acquired from the terminal device is An output information generation unit that converts the gender property different from the gender of the user, generates output data, and transmits the output data to the social touch device;
An arm control data generating unit that generates arm control data for controlling an arm included in the social touch device based on an input of the second user, and transmits the arm control data to the social touch device; A social touch control device.   The gender determination unit automatically determines the gender of the first user based on information about the first user acquired by the social touch device, and determines the gender of the second user as the second user. The social touch control device according to claim 1, wherein the determination is based on an input by the user to the terminal device.

Images