JPWO2017051577A1 - Emotion induction system and emotion induction method - Google Patents

Abstract

This paper proposes an emotion induction system and an emotion induction method that make it possible to extract natural emotions from users. An emotion to be extracted from the user is selected, and the output to the user is controlled according to the selected emotion.

Description

  The present disclosure relates to an emotion induction system and an emotion induction method.

  In recent years, technologies related to devices that work on the emotions of users have been proposed.

  For example, Patent Document 1 discloses a technique for displaying a guided object on a captured image according to the degree of similarity between a photographed person's facial expression and a desired facial expression in order to guide the photographed person's facial expression to a desired facial expression. It is disclosed.

JP 2008-27086 A

  However, the technique disclosed in Patent Document 1 induces the photographer's facial expression using a guiding object, and the photographed person needs to make a facial expression by himself according to the guidance. For this reason, the photographer's facial expression is inevitably ingenious. Therefore, with the technique disclosed in Patent Document 1, it is difficult to extract natural facial expressions and emotions from the subject.

  Therefore, the present disclosure proposes a new and improved emotion induction system and emotion induction method that can extract natural emotion from the user.

  According to the present disclosure, an emotion guidance system is provided that includes an emotion selection unit that selects an emotion to be drawn from a user, and an output control unit that controls output to the user according to the selected emotion.

  Moreover, according to this indication, the emotion induction method including selecting the emotion drawn out from a user and controlling the output to the said user according to the selected emotion by the arithmetic processing unit.

  According to the present disclosure, it is possible to appropriately control the output according to the emotion drawn from the user.

  As described above, according to the present disclosure, it is possible to extract natural emotion from the user.

  Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.

It is explanatory drawing explaining the specific example of the emotion guidance system which concerns on 1st Embodiment of this indication. It is a block diagram explaining the functional structure of the emotion guidance apparatus which concerns on the same embodiment. It is explanatory drawing which showed an example of the emotion table memorize | stored in an emotion table memory | storage part. It is explanatory drawing which shows an example of the output pattern table memorize | stored in an output pattern memory | storage part. It is explanatory drawing which shows an example of the output pattern table memorize | stored in an output pattern memory | storage part. It is a flowchart figure explaining the outline | summary of operation | movement of the emotion guidance apparatus which concerns on the same embodiment. It is a flowchart figure explaining the operation | movement regarding the emotion selection of the emotion guidance apparatus which concerns on the same embodiment. It is a flowchart figure explaining the operation | movement regarding the output selection of the emotion guidance apparatus which concerns on the same embodiment. It is a flowchart figure explaining the operation | movement regarding the output control of the emotion guidance apparatus which concerns on the same embodiment. It is a flowchart explaining the operation | movement regarding the imaging of the emotion guidance apparatus which concerns on the same embodiment. It is a flowchart explaining the operation | movement regarding provision of the image of the emotion guidance apparatus which concerns on the same embodiment. It is explanatory drawing explaining the outline | summary of the emotion guidance system which concerns on 2nd Embodiment of this indication. It is explanatory drawing explaining the outline | summary of the emotion guidance apparatus which the emotion guidance system which concerns on the embodiment contains. It is a block diagram explaining the functional structure of the emotion guidance apparatus and information processing terminal which are contained in the emotion guidance system which concerns on the embodiment. It is a block diagram explaining the functional structure of the information processing server contained in the emotion guidance system which concerns on the embodiment. It is an example of the image which notifies the approach information of the emotion guidance apparatus during dispatch. It is an example of the image which shows the position of the emotion guidance apparatus in the predetermined range around a user. It is a sequence diagram explaining operation | movement of the emotion guidance system which concerns on the same embodiment. It is a sequence diagram explaining operation | movement of the emotion guidance system which concerns on the same embodiment. It is a sequence diagram explaining operation | movement when the user of the emotion guidance system which concerns on the embodiment transmits the participation application with respect to a vehicle allocation request | requirement. It is a sequence diagram explaining operation | movement when the user of the emotion guidance system which concerns on the embodiment transmits the participation application with respect to a vehicle allocation request | requirement. It is a sequence diagram explaining operation | movement when the user of the emotion guidance system which concerns on the embodiment transmits the dispatch request which recruits participants. It is the block diagram which showed the hardware structural example of the information processing server 6 which concerns on the embodiment.

  Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

The description will be made in the following order.
1. 1. First embodiment 1.1. Outline of emotion induction system 1.2. Configuration of emotion induction device 1.3. 1. Operation of emotion induction device Second Embodiment 2.1. Outline of emotion induction system 2.2. Configuration of emotion induction system 2.3. Operation of emotion induction system 2.4. 2. Hardware configuration Summary

<1. First Embodiment>
[1.1. Outline of emotion induction system]
First, an overview of the emotion guidance system according to the first embodiment of the present disclosure will be described with reference to FIG. FIG. 1 is an explanatory diagram illustrating a specific example of the emotion guidance system according to the present embodiment.

  The emotion induction system according to the present embodiment controls the output of the emotion induction device 1 that performs an output for extracting an emotion from the user 3. The emotion induction device 1 is a device that extracts natural emotion from the user 3 by controlling the output to the user 3 in accordance with the emotion extracted from the user 3.

  The output controlled by the emotion induction device 1 works on at least one of the five senses of the user 3 and extracts emotion as a general human reaction. The output controlled by the emotion induction device 1 may be any output. For example, a movie that works on vision, a voice that works on hearing, a scent that works on sense of smell, and an object that works on sense of touch can be used. .

  Specifically, the emotion induction device 1 may include a display device 31 and control an image displayed on the display device 31 in accordance with emotions drawn from the user 3. The emotion guidance device 1 can draw emotions from the user 3 visually by making the user 3 visually recognize the image displayed on the display device 31. For example, when the emotion of “fun” is drawn from the user 3, the emotion induction device 1 may cause the display device 31 to display content such as a short control and a one-shot gag.

  Specifically, the emotion induction device 1 may include a box body 51 whose inside is not visually recognized by the user 3, and may control an object placed inside the box body 51 in accordance with an emotion drawn from the user 3. The emotion induction device 1 can draw emotions from the user 3 by tactile sensation by causing the user 3 to insert a hand into the box 51 and causing the user 3 to touch an object inside the box 51. For example, when the emotion “surprise” is drawn from the user 3, the emotion induction device 1 may arrange an elastic object 53 having a frog shape inside the box 51. For example, when the emotion of “comfortable” is drawn from the user 3, the emotion induction device 1 may arrange a stuffed animal object having a cat shape inside the box 51.

  In addition, the emotion induction device 1 may include the imaging device 11, and the imaging device 11 may image the facial expression of the user 3 from which the emotion is drawn. For example, as shown in FIG. 1, the emotion induction device 1 may be a print seal machine that includes various strobes 21 and 23, an imaging device 11, and a display device 31 in a housing 41.

  According to this configuration, the emotion guiding device 1 can capture an image of the facial expression of the user 3 from which a natural emotion has been extracted by the output device. The emotion induction device 1 may display the captured image on the display device 31 so that the user 3 can perform editing such as writing on the captured image.

  According to such an emotion induction device 1, it is possible to extract natural emotion from the user 3. In addition, the emotion induction device 1 can capture an active facial expression of the user 3 from which a natural emotion is drawn. Therefore, the emotion induction device 1 can also capture a new facial expression or a strange facial expression of the user 3 that does not normally appear on the table.

[1.2. Configuration of emotion induction device]
Next, with reference to FIGS. 2-4B, the structure of the emotion guidance system which concerns on this embodiment is demonstrated. FIG. 2 is a block diagram illustrating a functional configuration of an emotion guidance system including the emotion guidance device 1 according to the present embodiment.

  As shown in FIG. 2, the emotion induction device 1 includes an input unit 101, an emotion selection unit 103, an output selection unit 105, an output control unit 109, an emotion table storage unit 107, an output pattern storage unit 111, An output unit 113, an imaging unit 115, a score calculation unit 117, an image editing unit 119, an editing material storage unit 121, a printing unit 123, and a communication unit 125 are provided.

  The input unit 101 includes an input device that receives information input from the user 3 or a measurement device that acquires information related to the state of the user 3, and generates an input signal based on the input or measured information. Examples of the input device included in the input unit 101 include a touch panel, a keyboard, a mouse, a button, a microphone, a switch, and a lever. Further, examples of the measurement device provided in the input unit 101 include an imaging device that acquires the state of the user 3 by an image, a microphone that acquires the state of the user 3 by voice, and the like.

  The emotion selection unit 103 selects an emotion to be drawn from the user 3. Specifically, the emotion selection unit 103 first causes the user 3 to select a selection mode for determining an emotion to be extracted, and selects an emotion to be extracted from the user 3 in accordance with the selected selection mode. The selection mode used by the emotion selection unit 103 includes various selection modes. For example, the emotion selection unit 103 may select an emotion to be extracted from the user 3 according to the selection mode described below.

  For example, the emotion selection unit 103 may select an emotion to be drawn from the user 3 based on either the user 3 image captured by the imaging device or the like and the user 3 voice collected by a microphone or the like. Specifically, the emotion selection unit 103 estimates the state of the user 3 based on at least one of the image or sound of the user 3 and extracts a recommended emotion from the estimated state of the user 3 from the user 3. You may choose. In addition, the emotion selection unit 103 may select an emotion close to the state of the user 3 as an emotion to be extracted from the user 3, or may select an emotion having a large difference from the state of the user 3 as an emotion to be extracted from the user 3.

  Moreover, the emotion selection part 103 may ask the user 3 a question with an image or a sound, and may select the emotion drawn out from the user 3 based on the answer from the user 3 to the question. Specifically, the emotion selection unit 103 asks the user 3 the current mood, physical condition, recent events, and the like, and estimates the state of the user 3 based on the answer from the user 3 to the question. To do. The emotion selection unit 103 may select a recommended emotion from the estimated state of the user 3 as an emotion to be extracted from the user 3. In addition, the emotion selection unit 103 may select an emotion close to the state of the user 3 as an emotion to be extracted from the user 3, or may select an emotion having a large difference from the state of the user 3 as an emotion to be extracted from the user 3.

  The emotion selection unit 103 may display a plurality of candidate emotions corresponding to the emotion to be extracted on a display device or the like, and may select an emotion corresponding to the candidate emotion selected by the user 3 as an emotion to be extracted from the user 3. Specifically, the emotion selection unit 103 includes “cuckoo (that is, emotions that are bright and happy)”, “pounding (that is, emotions that are upset)”, “kyun-kun (that is, emotions that you love)”, “gae, and muly ( That is, the emotions that are displayed on the display device and other candidate emotions such as “dislike emotions”, “today cry (ie, sad emotions)”, and “uh, serious !?” (that is, very surprised emotions). May be selected by the user 3.

  Here, candidate emotions are not words that directly express emotions such as “surprise”, “sad”, and “fun”, but are expressed in an indirect atmosphere using mimetic words, onomatopoeia, and colloquial expressions. It may be a phrase that represents. In such a case, the emotion induction device 1 can provide a novel impression to the user 3 by extracting the emotion that the user 3 did not expect from the user 3.

  Further, the emotion selection unit 103 may select an emotion randomly selected from a plurality of predetermined emotions as an emotion to be extracted from the user 3.

  The output selection unit 105 selects an output pattern for the user 3 based on emotions drawn from the user 3. Specifically, the output selection unit 105 searches the emotion table storage unit 107 for an output pattern corresponding to the emotion selected by the emotion selection unit 103, and selects the searched output pattern as an output pattern to the user 3. .

  When there are a plurality of output patterns corresponding to the selected emotion, the output selection unit 105 selects one of the output patterns corresponding to the selected emotion at a predetermined probability or randomly, and the user 3 An output pattern may be used.

  The emotion table storage unit 107 stores emotions drawn from the user 3 and output patterns to the user 3 in association with each other. Specifically, the emotion table storage unit 107 stores an emotion table in which emotions drawn from the user 3 are associated with at least one or more output pattern identification numbers.

  For example, the emotion table storage unit 107 may store an emotion table as shown in FIG. FIG. 3 is an explanatory diagram showing an example of an emotion table stored in the emotion table storage unit 107.

  In the emotion table shown in FIG. 3, as emotions, “cuckoo (that is, bright and happy emotions)”, “pounding (that is, emotions that are upset)”, “kyunkyung (that is, emotions that you love and love)”, “gae, muri ( That is, “Emotions to be disliked”, “Today cry (ie, sad emotions)”, and “Eh, seriously !? (ie, very surprised emotions)” are set. In addition, “0011” and “0012” are set as output pattern identification numbers (output pattern IDs in FIG. 3) corresponding to the emotion “cuckoo”, and the output pattern identification corresponding to the emotion “pounding” is identified. “0021”, “0022”, and “0023” are set as numbers. In addition, “0031” is set as the identification number of the output pattern corresponding to the emotion “Kyun Kyun”, and “0041” is set as the identification number of the output pattern corresponding to the emotion “Gae, Muree”. Further, “0051” and “0052” are set as the output pattern identification numbers corresponding to the emotion “Let me cry today”, and the output pattern identification numbers corresponding to the emotion “Eh! “0061”, “0062”, and “0063” are set.

  The output control unit 109 controls output to the user 3. Specifically, the output control unit 109 reads an output control condition corresponding to the output pattern selected by the output selection unit 105 from the output pattern storage unit 111, and outputs the output by the output unit 113 according to the read control condition. Control. Note that the output control conditions include, for example, the elapsed time since the start of emotion induction and the action of the user 3.

  The output pattern storage unit 111 stores an output pattern for the user 3 and an output control condition in association with each other. Specifically, the output pattern storage unit 111 stores, for each output pattern to the user 3, an output pattern table in which an output from the output unit 113 is associated with a control condition for the output.

  For example, the output pattern storage unit 111 may store an output pattern table as shown in FIGS. 4A and 4B. 4A and 4B are explanatory diagrams illustrating an example of an output pattern table stored in the output pattern storage unit 111. FIG.

  In the output pattern table shown in FIG. 4A, the output conditions of the first to third output devices included in the output unit 113 and the control conditions for the output of each output device are set. The first output device is a display device, and the second output device is a tactile sensation presentation device that controls an object placed inside a box that is not visually recognized by the user 3. The output device is a housing in which the user 3 who uses the emotion induction device 1 enters.

  As shown in FIG. 4A, first, when the time from the start of emotion induction is “00'00” ”, the second output device arranges the frog-shaped high tactile sensation object in the box. Is set to be controlled. When the user 3 touches an object placed in the box, the first output device is controlled to display a frog image, and the third output device places the Konjac object on the ceiling of the room. It is set to be controlled so as to be dropped. Further, when the time from the start of emotion induction is “00′10 ″”, it is set that the third output device is controlled to shake the floor of the room.

  In addition, in the output pattern table shown in FIG. 4B, other examples of outputs by the first to third output devices included in the output unit 113 and control conditions for the outputs are set. As in FIG. 4A, the first output device is a display device, and the second output device is a tactile sensation that controls an object placed inside a box whose inside is not visually recognized by the user 3. The third output device is a room in which the user 3 who uses the emotion induction device 1 enters.

  As shown in FIG. 4B, first, when the time from the start of emotion induction is “00'00” ”, the first output device is controlled to start playback of video content. Is set. In addition, when the time from the start of emotion induction is “00'10” ”, it is set that the first output device is controlled to stop the reproduction of the video content being reproduced. Yes.

  The output unit 113 includes an output device that outputs to the user 3, and performs output that extracts emotion from the user 3. Any output device provided in the output unit 113 can be used as long as it works on at least one of the five senses of the user 3. For example, the output device includes a display device such as a liquid crystal display device and an organic electroluminescence display device, a holographic reproduction device, an audio output device such as a speaker and headphones, a spray device that sprays perfume, etc., and a box whose interior is not visually recognized by the user 3 Examples include a tactile sensation presentation device in which objects having various tactile sensations are arranged, and a housing having a mechanism that surprises the user 3.

  Accordingly, the output unit 113 can display, for example, image content such as an interesting moving image, a pleasant moving image, a sad moving image, an image to be healed, an unpleasant image, or a funny face on the display device. In addition, the output unit 113 can reproduce, as an output, audio contents such as fun music, sad music, or a scary story, for example, using an audio output device. In addition, the output unit 113 can spray perfume having a relaxing scent or an unpleasant scent as an output, for example, with a spraying device. Further, the output unit 113 operates, for example, a device such as dropping a Konjac-like object from the ceiling of the housing, shaking the floor of the housing, or popping a doll out of the wall of the housing. be able to.

  In addition, the output unit 113 outputs, for example, the arrangement of objects having various tactile sensations in the box whose interior is not visually recognized by the user 3 in order to cause the user 3 to touch the object in the box in the tactile sensation presentation apparatus. As can be done. In the tactile sensation presentation device, objects having various tactile sensations are not only arranged in the box body, but also may protrude from the ceiling or wall of the housing or slip down from the ceiling or wall of the housing. Good.

  The imaging unit 115 images the facial expression of the user 3 from which the emotion is drawn. For example, the imaging unit 115 includes an imaging element such as a complementary metal oxide semiconductor (CMOS) image sensor or a charge coupled device (CCD) image sensor, and an imaging lens. The imaging unit 115 receives light from a subject (that is, the user 3) that enters through the imaging lens, performs photoelectric conversion by the imaging device, and converts it into an image signal, thereby acquiring an image of the subject.

  When the imaging unit 115 captures the facial expression of the user 3 at a predetermined timing using a strobe or the like, the imaging unit 115 detects the user 3 when a similarity score calculated by a score calculation unit 117 described later is equal to or greater than a threshold value. The facial expression may be imaged. Further, when the imaging unit 115 continuously captures the facial expression of the user 3, the imaging unit 115 may store the image of the user 3 when the similarity score calculated by the score calculation unit 117 described later is equal to or greater than a threshold value. Good.

  The score calculation unit 117 calculates a similarity score representing the degree of similarity between the user's emotion and the emotion to be extracted from the user 3 based on at least one of the user's image and sound. Specifically, the score calculation unit 117 estimates the facial expression of the user 3 based on the user 3 image, and estimates the utterance content of the user 3 based on the voice of the user 3. Next, the score calculation unit 117 calculates a similarity score that represents the degree of similarity between the emotion of the user 3 expressed by the facial expression and utterance content of the user 3 and the emotion to be extracted from the user 3.

  The estimation of facial expressions and the estimation of utterance contents by the score calculation unit 117 can be executed by applying a pattern recognition technique such as image recognition and voice recognition based on a machine learning algorithm, for example. In addition, the similarity score by the score calculation unit 117 is, for example, by setting feature information indicating features for each emotion, and quantifying how much the facial expression and utterance content of the user 3 matches the feature information. Can be calculated.

  The image editing unit 119 edits the captured image of the user 3 based on the input from the user 3. Specifically, the image editing unit 119 receives an input of editing content from the user 3 by displaying an image of the user 3 captured by the imaging unit 115 on a display device or the like, and the editing content input by the user 3 Based on the above, the captured image of the user 3 is edited. Further, the image editing unit 119 may provide the editing material for editing the user 3 image to the user 3. These editing materials are stored in the editing material storage unit 121, for example.

  Editing contents that can be performed by the user 3 on the captured image include, for example, writing characters and the like, adding backgrounds and image frames, adding illustrations, and grayscale, sepia, blurring, and mosaic. An effect process using a filter such as the above can be exemplified. Further, examples of the editing material provided by the image editing unit 119 include a background, an image frame, an illustration, and various filters.

  Here, the editing material provided by the image editing unit 119 may correspond to emotions drawn from the user 3. For example, when the emotion drawn out from the user 3 is “surprise”, illustrations such as exclamation marks, explosions, and shocks closely related to the emotion “surprise” may be provided as the editing material. Further, when the emotion drawn from the user 3 is “sad”, illustrations such as hail, rain, and shadow that are closely related to the emotion of “sadness” may be provided as editing material. When the emotion drawn from the user 3 is “fun”, illustrations such as musical notes, flowers, rainbows and stars that are closely related to the emotion of “fun” may be provided as editing material.

  The editing material storage unit 121 stores editing materials such as a background, an image frame, an illustration, and various filters provided by the image editing unit 119 when the user 3 edits the captured image. The editing material storage unit 121 may store each of the editing materials in association with emotions drawn from the user 3.

  Note that the emotion table storage unit 107, the output pattern storage unit 111, and the editing material storage unit 121 described above are for data storage such as a HDD (Hard Disk Drive) device, a flash memory, and an SSD (Solid State Drive) device. It can be configured by a storage device.

  The printing unit 123 prints an image obtained by capturing the facial expression of the user 3 from which the emotion is drawn on a sticker sheet or the like. Specifically, the printing unit 123 prints the image of the user 3 edited by the image editing unit 119 on a sticker sheet with a predetermined layout. In addition, the image of the user 3 printed on the sticker paper may be one or plural. Further, when there are a plurality of images of the user 3 printed on the sticker paper, the respective images may be the same image or different images. According to this, the user 3 can print the image which imaged the facial expression from which the emotion was drawn out on the spot, and can obtain it as a sticker.

  The communication unit 125 transmits an image obtained by capturing the facial expression of the user 3 from which the emotion has been extracted to a predetermined server via the network 5. In addition, the address of a predetermined server to which the image of the user 3 is transmitted is notified to the user 3 as link information. According to this, since the user 3 can obtain an image obtained by capturing a facial expression from which emotion is extracted as image data, the user 3 can more easily view and duplicate the facial expression from which emotion is extracted. The communication unit 125 is specifically a communication interface configured with a communication device or the like for connecting to the network 5 such as a public line network. The communication unit 125 may be configured by, for example, a cable communication device that performs wired cable communication, or may be configured by a wired or wireless LAN (Local Area Network) compatible communication device.

  The configuration of the emotion guidance device 1 included in the emotion guidance system according to the present embodiment has been specifically described above. According to the emotion guidance system according to the present embodiment, a natural expression can be extracted from the user 3. Moreover, according to the emotion guidance system which concerns on this embodiment, it is also possible to image with the imaging device the facial expression of the user 3 from whom the natural emotion was drawn.

  Information processing performed by the emotion guidance device 1 is realized by cooperation between software and hardware. The emotion induction device 1 includes, as hardware, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory) that are connected to each other via a bridge and an internal bus.

  The CPU functions as an arithmetic processing device and a control device, and controls the overall operation of the emotion induction device 1 according to various programs stored in a ROM or the like. The ROM stores programs and calculation parameters used by the CPU, and the RAM temporarily stores programs used in the execution of the CPU, parameters that change as appropriate during the execution, and the like. By cooperating these hardware and software, the emotion induction device 1 has functions of the emotion selection unit 103, the output selection unit 105, the output control unit 109, the score calculation unit 117, the image editing unit 119, and the like. Can be realized.

  A part or all of the information processing executed by these emotion guiding devices 1 may be executed by an information processing server connected to the emotion guiding device 1 via the network 5. Specifically, some or all of the functions of the emotion selection unit 103, the output selection unit 105, the output control unit 109, the score calculation unit 117, the image editing unit 119, etc. are sent via the emotion induction device 1 and the network 5. It may be executed by a connected information processing server.

  In addition, a computer program for causing hardware such as CPU, ROM, and RAM incorporated in the emotion induction device 1 to perform the same functions as the components of the emotion induction device 1 described above can be created. A storage medium storing the computer program is also provided.

[1.3. Operation of emotion induction device]
Then, with reference to FIGS. 5-10, operation | movement of the emotion guidance apparatus 1 which the emotion guidance system which concerns on this embodiment contains is demonstrated. Note that the operation of the emotion induction device 1 described below is merely an example, and the operation of the emotion induction device 1 according to the present embodiment is not limited to the following.

  FIG. 5 is a flowchart for explaining an outline of the operation of the emotion guidance device 1 according to this embodiment.

  As shown in FIG. 5, the operation of the emotion induction device 1 is roughly divided into five processing operations. First, the emotion selection unit 103 selects an emotion to be drawn from the user 3 (S100). Next, the output selection unit 105 selects an output pattern for the selected emotion (S110). Subsequently, the output control unit 109 controls output to the user 3 according to the selected output pattern (S120). Next, the imaging unit 115 captures the facial expression of the user 3 from which the emotion has been extracted in response to the output (S130). Further, the captured image is edited by the image editing unit 119 and then provided to the user 3 via at least one of the printing unit 123 and the communication unit 125 (S140).

  Below, with reference to FIGS. 6-10, operation | movement of the emotion guidance apparatus 1 which demonstrated the outline | summary above is demonstrated in detail.

  First, with reference to FIG. 6, the operation | movement regarding the emotion selection of the emotion guidance apparatus 1 is demonstrated. FIG. 6 is a flowchart illustrating an operation related to emotion selection of the emotion guidance device 1 according to the present embodiment.

  As shown in FIG. 6, first, a selection mode for determining an emotion to be drawn from the user 3 is selected by an input from the user 3 (S101). When the question mode is selected, the emotion selection unit 103 displays a question to the user 3 on a display device or the like (S102), and accepts an answer to the question from the user 3 (S103). The emotion selection unit 103 repeats the question (S102) and answer (S103) loop until the emotion to be extracted is determined, and then determines the emotion to be extracted (S108). When the automatic mode is selected, the emotion selection unit 103 acquires the image and sound of the user 3 (S104), and selects the emotion to be drawn from the user 3 based on the acquired image and sound of the user 3 (S104). S105). Thereby, the emotion to be drawn is determined (S108). Further, when the input mode is selected, the emotion selection unit 103 displays candidate emotions on a display device or the like (S106), and accepts selection of candidate emotions from the user 3 (S107). Thereby, the emotion drawn out from the candidate emotions by the input of the user 3 is determined (S108).

  Next, with reference to FIG. 7, the operation | movement regarding the output selection of the emotion guidance apparatus 1 is demonstrated. FIG. 7 is a flowchart illustrating an operation related to output selection of the emotion guidance device 1 according to the present embodiment.

  As shown in FIG. 7, first, the output selection unit 105 searches the emotion table storage unit 107 for an output pattern that matches the emotion to be extracted (S111). Next, the output selection unit 105 determines whether there are a plurality of output patterns that match the emotion to be extracted (S112). When there are a plurality of output patterns that match the emotion to be extracted (S112 / Yes), the output selection unit 105 randomly selects an output pattern from the plurality of corresponding output patterns (S113), and controls the output to the user 3 An output pattern is determined (S115). On the other hand, when there is one output pattern that matches the emotion to be extracted (S112 / No), the output selection unit 105 selects the corresponding output pattern (S114), and determines the output pattern for controlling the output to the user 3 (S115).

  Then, with reference to FIG. 8, the operation | movement regarding the output control of the emotion guidance apparatus 1 is demonstrated. FIG. 8 is a flowchart for explaining operations related to output control of the emotion guidance device 1 according to the present embodiment.

  As shown in FIG. 8, first, the output control unit 109 reads the output control conditions of each output device from the output pattern (S121). Next, the output control unit 109 determines whether or not the output control condition is satisfied in each output device (S122). If the output control condition is satisfied (S122 / Yes), the corresponding output is determined. The device is controlled to cause the user 3 to execute an output that satisfies the control conditions (S123). When the output control condition is not satisfied (S122 / No), the output control unit 109 stands by and determines again whether the output control condition is satisfied (S122). Note that the output control unit 109 ends the operation when all outputs are executed or when a predetermined time has elapsed.

  Next, with reference to FIG. 9, an operation related to imaging of the emotion induction device 1 will be described. FIG. 9 is a flowchart illustrating an operation related to imaging of the emotion induction device 1 according to the present embodiment. Note that the operation relating to imaging illustrated in FIG. 9 is an operation when the imaging unit 115 continuously captures the user 3.

  As shown in FIG. 9, first, the imaging unit 115 captures an image of the user 3 (S131). Here, the score calculation unit 117 acquires the image and sound of the user 3 at the time of imaging via the input unit 101 or the like (S132). Next, the score calculation unit 117 estimates the facial expression of the user 3 from the image of the user 3 (S133), and estimates the utterance content of the user 3 from the voice of the user 3 (S134). Subsequently, the score calculation unit 117 calculates a similarity score between the emotion drawn from the user 3 and the estimated facial expression and utterance content of the user 3 (S135). Further, the imaging unit 115 determines whether or not there are a predetermined number or more of images whose similarity score is equal to or greater than a threshold (S136). When there are a predetermined number or more of images whose similarity score is equal to or greater than the threshold (S136 / Yes), the imaging unit 115 selects a predetermined number of images whose similarity score is equal to or greater than the threshold (S137), and stores the image of the selected user 3 (S139). When the number of images having a similarity score equal to or greater than the threshold is less than the predetermined number (S136 / No), the imaging unit 115 selects a predetermined number of images in descending order of the similarity score (S138), and stores the selected user 3 image. (S139).

  Furthermore, with reference to FIG. 10, the operation | movement regarding provision of the image of the emotion guidance apparatus 1 is demonstrated. FIG. 10 is a flowchart illustrating an operation related to image provision of the emotion guidance device 1 according to the present embodiment.

  As shown in FIG. 10, the emotion induction device 1 first displays a predetermined number of stored images of the user 3 on a display device or the like (S141). Next, emotion induction device 1 accepts selection of an image to be edited from user 3 (S142). Subsequently, the image editing unit 119 displays an editing material corresponding to the extracted emotion on a display device or the like (S143), and accepts editing of the selected image by the user 3 (S144). Further, the image editing unit 119 stores the edited image (S145).

  Here, the emotion induction device 1 confirms with the user 3 whether or not to provide the edited image as data (S146). When the edited image is provided as data (S146 / Yes), the edited image is transmitted to a predetermined server via the communication unit 125, and the link information to the image is notified to the user 3 (S147). On the other hand, when the edited image is not provided as data (S146 / No), the process of transmitting the edited image to a predetermined server (S147) is skipped. Next, the emotion induction device 1 confirms with the user 3 whether or not to print the edited image (S148). When printing the edited image (S148 / Yes), the image edited by the printing unit 123 is printed on a sticker sheet or the like (S149). On the other hand, when the edited image is not printed (S148 / No), the process of printing the edited image (S148) is skipped.

  If the edited image is not provided as data (S146 / No) and the edited image is not printed (S148 / No), the emotion induction device 1 confirms the method of providing the edited image again. Processing (S146, S148) may be executed.

  The emotion guidance device 1 included in the emotion guidance system according to the present embodiment has been described in detail above. According to the emotion guidance system according to the present embodiment, it is possible to extract natural emotion from the user 3. In addition, the emotion guidance system can capture an active facial expression of the user 3 from which natural emotions are drawn.

  In the above embodiment, the emotion induction system images the facial expression of the user 3 from which natural emotions are drawn, but the present technology is not limited to such an example. For example, the emotion induction system may record the voice of the user 3 from whom a natural emotion is drawn.

<2. Second Embodiment>
[2.1. Outline of emotion induction system]
Next, with reference to FIG. 11 and FIG. 12, an overview of the emotion guidance system according to the second embodiment of the present disclosure will be described. FIG. 11 is an explanatory diagram for explaining the outline of the emotion guidance system according to this embodiment, and FIG. 12 is an explanatory diagram for explaining the outline of the emotion guidance device included in the emotion guidance system according to this embodiment.

  As shown in FIG. 11, the emotion guidance system is an information processing system that dispatches the emotion guidance device 2 provided in a moving body to a location designated by the user 3. Specifically, the emotion guidance system includes an emotion guidance device 2, an information processing server 6 that manages a vehicle allocation request for the emotion guidance device 2 from the user 3, and an information processing terminal 7 that each user 3 possesses. It has a configuration connected by a network 5 such as a network.

  The information processing terminal 7 transmits a dispatch request for requesting the dispatch of the emotion guidance device 2 to the information processing server 6. The dispatch request includes, for example, a place (also referred to as a dispatch place) and a date and time (also referred to as a dispatch date / time) where the user 3 desires to dispatch the emotion guidance device 2. Further, the dispatch request may include information related to emotions that the user 3 wants to be pulled out. Note that the information processing terminal 7 may be, for example, a smartphone, a mobile phone, a personal computer, or the like.

  The information processing server 6 manages the vehicle allocation request transmitted from the information processing terminal 7. In addition, the information processing server 6 transmits the allocation request to the emotion guidance device 2 that can be allocated for the allocation location and allocation date / time of the allocation request. Further, the information processing server 6 acquires the position information of the emotion guidance device 2 from the emotion guidance device 2 and notifies the information processing terminal 7 that the emotion guidance device 2 is approaching when the dispatch date and time approaches. May be.

  The emotion induction device 2 is provided in a moving body such as an automobile, a scooter, and a motorcycle, and is provided so as to be movable to an arbitrary place by the moving body. The emotion guidance device 2 that has received the dispatch request from the information processing server 6 is dispatched to the dispatch location by the driver's driving in time for the dispatch date and time of the dispatch request.

  Such an emotion induction device 2 will be described more specifically with reference to FIG. As shown in FIG. 12, the emotion induction device 2 includes, for example, an imaging unit 115 and an output unit 113 on the back side of the moving body 4, and outputs an output that extracts emotion from the user 3 inside the light shielding curtain 127. You may go. In addition, the emotion induction device 2 can also capture the facial expression of the user 3 from which the emotion is drawn inside the light-shielding curtain 127. That is, the emotion induction device 2 may be a print sticker that is provided in the moving body 4 and that outputs an output that extracts emotion from the user 3.

  According to the emotion induction system according to the present embodiment, the user 3 can receive an output for extracting an emotion by the emotion induction device 2 at a desired place and date / time anytime and anywhere. In addition, the user 3 can also capture the facial expression from which the emotion is drawn on the spot using the emotion induction device 2.

  Note that the user who transmits the dispatch request to the information processing server 6 and the user whose emotion is drawn out by the emotion guidance device 2 may be the same or different. If the user who sent the dispatch request is different from the user whose emotions are drawn, the user who sent the dispatch request may cause the emotions to be drawn more strongly by concealing the emotions to be pulled out to the user from whom the emotions are drawn. it can.

[2.2. Configuration of emotion induction system]
Then, with reference to FIG. 13A and FIG. 13B, the structure of the emotion guidance system which concerns on this embodiment is demonstrated. FIG. 13A is a block diagram illustrating functional configurations of the emotion guidance device 2 and the information processing terminal 7 included in the emotion guidance system according to the present embodiment. FIG. 13B is a block diagram illustrating a functional configuration of the information processing server 6 included in the emotion guidance system according to the present embodiment.

  As illustrated in FIG. 13A, the emotion induction device 2 includes a position detection unit 201, an output unit 113, an imaging unit 115, an input unit 101, a control unit 120, and a communication unit 125. The information processing terminal 7 includes a position detection unit 701, an input unit 703, a display unit 705, a control unit 707, and a communication unit 709.

(Emotion induction device)
Since the input unit 101, the output unit 113, the imaging unit 115, the printing unit 123, and the communication unit 125 are substantially the same as the configurations described in the first embodiment of the present disclosure, the description here will be given. Omitted.

  The position detection unit 201 acquires position information of the emotion guidance device 2. For example, the position detection unit 201 may be a GNSS (Global Navigation Satellite System) sensor that calculates the position of the emotion induction device 2 from signals with time information transmitted from a plurality of artificial satellites. Further, the position detection unit 201 may be an A-GNSS (Assisted Global Navigation Satellite System) that further receives information assisting positioning by GNSS from a network or the like. Furthermore, the position detection unit 201 calculates the position information of the emotion induction device 2 by triangulation using the distance from the base station in the mobile communication network or the distance from the Wi-Fi (registered trademark) access point. You may do.

  The control unit 210 controls the overall operation of the emotion induction device 2. Specifically, the control unit 210 has the functions of the emotion selection unit 103, the output selection unit 105, the output control unit 109, the score calculation unit 117, the image editing unit 119, and the like described in the first embodiment of the present disclosure. Run.

(Information processing terminal)
The position detection unit 701 acquires position information of the information processing terminal 7. For example, the position detection unit 701 may be a GNSS sensor that calculates the position of the information processing terminal 7 from signals with time information transmitted from a plurality of artificial satellites. The position detection unit 701 may be an A-GNSS that further receives information for assisting positioning by GNSS from a network or the like. Further, the position detection unit 701 calculates the position information of the information processing terminal 7 by triangulation using the distance from the base station in the mobile communication network or the distance from the Wi-Fi access point. May be.

  The input unit 703 includes an input device for inputting information such as a touch panel, a keyboard, a button, a microphone, a switch, and a lever. The input unit 703 also includes an input control circuit for generating an input signal based on the input information and outputting it to the control unit 707.

  The display unit 705 includes, for example, a display device such as a CRT (Cathode Ray Tube) display device, a liquid crystal display device, or an organic EL (Organic ElectroLuminescence) display device. The display unit 705 displays an input screen for inputting a dispatch request to the information processing server 6, a notification screen from the information processing server 6, and the like.

  The control unit 707 includes a CPU, a ROM, a RAM, and the like, and controls the overall operation of the information processing terminal 7. For example, the control unit 707 controls the overall operation of the information processing terminal 7 by performing arithmetic processing by the CPU according to various programs stored in the ROM or the like. Note that parameters and the like that change as appropriate during execution of the arithmetic processing are temporarily stored in the RAM.

  The communication unit 709 is a communication interface configured by a communication device or the like for connecting to the network 5 such as a public line network. The communication unit 709 may be a cable communication device that performs wired cable communication, or may be a wired or wireless LAN compatible communication device.

(Information processing server)
As shown in FIG. 13B, the information processing server 6 includes a communication unit 610, a control unit 600, a user information storage unit 620, a vehicle allocation management information storage unit 630, a vehicle allocation request storage unit 640, and a map information storage. Part 650. The control unit 600 includes a user registration unit 601, an authentication unit 602, a vehicle allocation search unit 603, a vehicle allocation request management unit 604, and a vehicle allocation status notification unit 605.

  The communication unit 610 is a communication interface configured by a communication device for connecting to the network 5 such as a public line network. Further, the communication unit 610 may be a cable communication device that performs wired cable communication, or may be a wired or wireless LAN compatible communication device.

  The user registration unit 601 registers various information of the user 3 in the user information storage unit 620. Specifically, the user registration unit 601 receives information related to the profile of the user 3 from the information processing terminal 7 and registers it in the user information storage unit 620. The information related to the profile of the user 3 includes, for example, an image, a name, an age, an occupation, a user name, a password, and a single comment of the user 3. Among the information related to the profile of the user 3, the user 3's image, name, age, occupation, and a single comment, when making a request for participation in a vehicle allocation request to be described later and a vehicle allocation request for recruiting participants, 3 may be used as profile information.

  The user information storage unit 620 stores various information of the user 3. For example, the user information storage unit 620 stores the image, name, age, occupation, user name, password, and single comment of the user 3 in association with each other. The user information storage unit 620 may further store history information such as the number of times that the user 3 has transmitted a vehicle allocation request and the location and date / time of the user 3 vehicle allocation request.

  The authentication unit 602 authenticates that the user 3 is the registered user 3 based on the login information received from the information processing terminal 7. Specifically, the authentication unit 602 receives login information including the user name and password from the information processing terminal 7 and determines whether or not the user name and password stored in the user information storage unit 620 match. When the user name and the password match, the authentication unit 602 authenticates that the user 3 who transmitted the login information is the registered user 3. When the user name and the password do not match, the authentication unit 602 notifies the user 3 who transmitted the login information that the authentication has failed.

  When the vehicle allocation search unit 603 receives a vehicle allocation request for the emotion guidance device 2 from the information processing terminal 7, the vehicle allocation search unit 603 searches for the emotion guidance device 2 that can be allocated in response to the vehicle allocation request. Specifically, the vehicle allocation search unit 603 searches for the emotion guidance device 2 that can be allocated for the location and date / time of the vehicle allocation request based on the information stored in the vehicle allocation management information storage unit 630.

  For example, when it is requested to dispatch the emotion induction device 2 immediately in the vehicle allocation request, the vehicle allocation search unit 603 can arrive at the vehicle allocation location within a predetermined time (for example, within 15 minutes), and other The emotion induction device 2 that does not respond to the user is searched.

  In addition, for example, in the vehicle allocation request, when the location and date / time are specified and the emotion induction device 2 is requested to be allocated, the vehicle allocation search unit 603 uses the vehicle allocation location as the area in charge and before and after the vehicle allocation date / time. A search is made for an emotion induction device 2 that has not received a vehicle allocation request (for example, for 15 minutes before and after the vehicle allocation date and time).

  The allocation request from the user 3 includes at least the location and date / time at which the emotion induction device 2 is allocated. In addition, the dispatch request may include the number of users 3, designation of the type of emotion guidance device 2, and emotions to be drawn. The emotions that we want to draw out are “Kakkya (ie, emotions that are bright and happy)”, “Pounding (ie, emotions that are upset)”, “Kunkyung (ie, emotions that you love and love)”, “Gae, Muri (ie, I hate them) Emotions), “Today cry (ie, sad emotions)”, and “Eh, seriously !? (ie, very surprised emotions)”.

  In addition, when the emotion induction device 2 includes an imaging unit that captures the facial expression of the user 3, the user 3 sets the imaging settings such as the background and image frame at the time of imaging and editing materials such as effects before and after the request for dispatch. May be transmitted to the information processing server 6. The imaging setting is transmitted to the emotion induction device 2 via the information processing server 6 and is set in the emotion induction device 2 in advance so that the imaging can be performed immediately. Further, the imaging setting may be set by the information processing server 6 based on the emotion that the user 3 wants to draw.

  The vehicle allocation management information storage unit 630 stores information on the emotion induction device 2 necessary for the vehicle allocation search unit 603 to search for the emotion induction device 2 that can be allocated in response to a vehicle allocation request. Specifically, the vehicle allocation management information storage unit 630 stores each state of the emotion guidance device 2. For example, the vehicle allocation management information storage unit 630 is in a state where the emotion guidance device 2 is not serving the user 3 (also referred to as an empty vehicle) or a state where the user 3 is serving the customer (also referred to as customer service), Alternatively, it is stored whether the vehicle is heading to the place of dispatch in response to the dispatch request (also referred to as during dispatch). The vehicle allocation management information storage unit 630 stores the location and date / time of the vehicle allocation request transmitted to each of the emotion guidance devices 2. Furthermore, the vehicle allocation management information storage unit 630 may store the current position of each emotion guidance device 2, the assigned area, and the like.

  The dispatch request management unit 604 stores the dispatch request in the dispatch request storage unit 640 and the emotion guide stored in the dispatch management information storage unit 630 when the emotion guidance device 2 to be dispatched in response to the dispatch request is determined. The information of the device 2 is updated.

  Further, when the sentiment guidance device 2 to be dispatched in response to the dispatch request is determined, the dispatch request management unit 604 transmits information on the sentiment guidance device 2 to be dispatched to the user 3 who has transmitted the dispatch request. The sent information of the emotion induction device 2 includes, for example, the identification number of the emotion induction device 2, the type of the emotion induction device 2, the driver name, and the current position of the emotion induction device 2. Furthermore, the vehicle allocation request management unit 604 notifies the searched emotion guidance device 2 that there is a vehicle allocation request, and transmits a vehicle allocation request including the vehicle allocation location and the vehicle allocation date and time.

  The dispatch request storage unit 640 stores the dispatch request determined by the sentiment guidance device 2 to be dispatched. Specifically, the vehicle allocation request storage unit 640 stores the vehicle allocation request, the sentiment guidance device 2 to be allocated, and the user 3 who has transmitted the vehicle allocation request in association with each other. In addition, when the dispatch of the emotion guidance device 2 is completed, the dispatch request for which the dispatch has been completed may be deleted from the dispatch request storage unit 640.

  The dispatch status notifying unit 605 sends the dispatch request to the user 3 who has transmitted the dispatch request from a predetermined time before the dispatch date and time of the dispatch request (for example, 10 minutes before) until the emotion induction device 2 arrives at the dispatch location. The approach information of the emotion guidance device 2 during dispatch is notified. Specifically, the vehicle allocation status notifying unit 605 acquires position information from the emotion induction device 2 during vehicle allocation when a predetermined time before the vehicle allocation date and time, and from the acquired position information to the arrival of the emotion induction device 2 Time, estimated arrival time, etc. are calculated. In addition, the dispatch status notifying unit 605 provides the location information of the emotion guiding device 2 during dispatch, the calculated time to arrival of the emotion guiding device 2, and the arrival schedule as approach information to the user 3 who has transmitted the dispatch request. Notify time etc. In addition, the dispatch status notification unit 605 may end the notification of the approach information when the difference between the position of the emotion guidance device 2 and the dispatch location is sufficiently small and is equal to or less than the threshold value.

  For example, the dispatch status notifying unit 605 may notify the approach information with an image as shown in FIG. 14 to the user 3 who has transmitted the dispatch request. FIG. 14 is an example of an image for notifying the approach information of the emotion guidance device 2 during dispatch.

  As shown in FIG. 14, for example, an image 800 for notifying the approach information of the emotion guidance device 2 during dispatch is an image 803 showing the position of the dispatch location and an image 805 showing the location of the emotion guidance device 2 during dispatch. Is displayed. In addition, in the image 800 for notifying the approach information, an image 801 for notifying the estimated arrival time “21:32” calculated from the position of the dispatch location and the position of the emotion guidance device 2 during dispatch may be displayed. .

  The map information storage unit 650 stores map information. The dispatch status notifying unit 605 can more accurately calculate the time until arrival of the emotion induction device 2 and the estimated arrival time by using the map information stored in the map information storage unit 650. The map information storage unit 650 may further store traffic jam information, traffic jam prediction information, and the like.

  According to the emotion guidance system according to the present embodiment having the above configuration, the user 3 can receive an output for extracting emotions from the emotion guidance device 2 at a desired place and date. In addition, the user 3 can also capture the facial expression from which the emotion is drawn on the spot using the emotion induction device 2.

  Furthermore, the emotion guidance system according to the present embodiment provides a mechanism that allows the user 3 to receive an output that extracts emotions together with other users, and to capture the facial expression from which the emotions are extracted together with the other users. Also good.

  For example, the user 3 may confirm a vehicle allocation request in which the vehicle allocation location is within a predetermined range around the user 3, and may transmit a participation application for the vehicle allocation request to the information processing server 6. In such a case, the vehicle allocation request management unit 604 transmits a participation application from the user 3 together with the profile information of the user 3 to the user who transmitted the vehicle allocation request. When the user who transmitted the vehicle allocation request approves the participation application from the user 3, the vehicle allocation request management unit 604 notifies the user 3 that the participation application has been approved.

  Thereby, the user 3 can receive the output which extracts the emotion by the emotion guidance apparatus 2 with the user who transmitted the vehicle allocation request | requirement by heading to the vehicle allocation location of a vehicle allocation request | requirement.

  For example, the user 3 can confirm the position of the emotion guidance device 2 and the location of the vehicle in the predetermined range around the user 3 by using an image as shown in FIG. FIG. 15 is an example of an image showing the position of the emotion guidance device 2 within a predetermined range around the user 3.

  As shown in FIG. 15, for example, an image 811 indicating the current position of the user is displayed on the image 810 indicating the position of the emotion guiding device 2 existing within a predetermined range around the user 3. Images 813, 817, and 819 indicating the positions are displayed. In addition, the images 813, 817, and 819 indicating the position of the emotion induction device 2 are each displayed with an image representing the state of the emotion induction device 2, and the emotion induction device 2 capable of transmitting a participation application is grasped. Can be done. It should be noted that an image 815 showing the place of dispatch is also displayed on the emotion guidance device 2 during dispatch. Thereby, the user 3 who is going to transmit a participation application can grasp | ascertain the vehicle allocation place which goes to participate in a vehicle allocation request | requirement. Such an image 810 may be generated by the vehicle allocation request management unit 604, for example.

  In addition, when the user 3 who transmitted the participation application is not in time for the dispatch date and time, the user who transmitted the dispatch request and the user 3 who transmitted the participation application may capture images separately, and the respective captured images may be combined. .

  Further, for example, the user 3 may transmit a vehicle allocation request for recruiting participants to the information processing server 6. In such a case, the vehicle allocation request management unit 604 can control the vehicle allocation request for recruiting participants to be viewable by other users, and can solicit participants for the vehicle allocation request. When another user responds to the request for the vehicle allocation request, the vehicle allocation search unit 603 searches for the emotion induction device 2 that can be allocated at the location and the date and time of the vehicle allocation request, and the vehicle allocation request management unit 604 A dispatch request is transmitted to the device 2. Further, the dispatch request management unit 604 transmits information on the sentiment guidance device 2 to be dispatched to the user 3 who has transmitted the dispatch request for recruiting participants and the user who has accepted the recruitment. In addition, the number of users who can apply for participation request for a dispatch request is not limited to one person, and may be a plurality of users.

  In addition, the vehicle allocation request management unit 604 may control the allocation request for recruiting participants so that it can be viewed only by a specific user, instead of being controlled so that it can be viewed by all users. For example, the vehicle allocation request management unit 604 may control the vehicle allocation request for recruiting participants only to users who are within a predetermined distance from the vehicle allocation location in the vehicle allocation request for recruiting participants.

  In addition, the vehicle allocation request management unit 604 can view the vehicle allocation request for recruiting the participants only to the users whose emotions the user 3 wants to withdraw and the emotions to be withdrawn match in the vehicle allocation request for recruiting the participants. You may control so that it may become. Furthermore, the vehicle allocation request management unit 604 may automatically match a vehicle allocation request for recruiting a participant with a user who intends to apply for participation in the vehicle allocation request based on the emotion to be extracted. In addition, what is necessary is just to make a user input the emotion which a user who responds to a recruitment wants to draw, for example, when browsing a dispatch request for recruiting participants.

[2.3. Behavior of emotion induction system]
Then, with reference to FIG. 16A-FIG. 18, operation | movement of the emotion guidance system which concerns on this embodiment is demonstrated.

  First, the basic operation of the emotion guidance system according to the present embodiment will be described with reference to FIGS. 16A and 16B. 16A and 16B are sequence diagrams illustrating the operation of the emotion guidance system according to the present embodiment.

  As shown in FIG. 16A, first, user registration information is transmitted from the information processing terminal 7 (ie, user 3) to the information processing server 6 (S201). The information processing server 6 registers the transmitted user registration information in the user information storage unit 620 (S202), and notifies the information processing terminal 7 of the completion of user registration (S203).

  Subsequently, login information is transmitted from the information processing terminal 7 to the information processing server 6 (S204). The information processing server 6 performs user authentication based on the login information (S205), and when the user authentication is completed, notifies the information processing terminal 7 of the authentication completion (S206). Next, the information processing terminal 7 transmits a dispatch request for the emotion guidance device 2 to the information processing server 6 (S207).

  The information processing server 6 searches the emotion guidance device 2 that can be dispatched at the place and date / time of the dispatch request, and selects the emotion guidance device 2 to dispatch (S208). Subsequently, the information processing server 6 stores the transmitted allocation request and the sentiment guidance device 2 to be allocated in association with each other (S210). In addition, the information processing server 6 transmits a dispatch request to the emotion guidance device 2 (S211), and notifies the information processing terminal 7 of information on the emotion guidance device 2 to be dispatched (S212). The information processing terminal 7 may transmit the background of the captured image and the imaging settings such as the editing material to the information processing server 6 at any timing after user registration (S209). For example, the imaging setting may be transmitted to the emotion induction device 2 at the same time as the vehicle allocation request.

  Next, as shown in FIG. 16B, the information processing server 6 determines whether or not a predetermined time before the scheduled dispatch time (S221). 6 requests the sentiment guidance device 2 to be dispatched to transmit the position information of the current position (S222). The emotion guidance device 2 transmits the position information of the current position to the information processing server 6 (S224). Note that the emotion induction device 2 may reflect the imaging settings such as the background of the captured image received at the timing and the editing material (S223).

  Subsequently, the information processing server 6 calculates the time when the emotion guiding device 2 arrives at the dispatch location (S225), and notifies the information processing terminal 7 of the position information of the emotion guiding device 2 to be dispatched and the estimated arrival time. (S226). The information processing terminal 7 displays the notified position information of the emotion guiding device 2 and the estimated arrival time (S227). In addition, the process of S222-S227 (however, except the process of S223) may be repeatedly performed at predetermined intervals (for example, every 1 to 3 minutes) until the emotion induction device 2 reaches the dispatch location. .

  Next, with reference to FIG. 17A and FIG. 17B, operation | movement of the emotion guidance system which concerns on this embodiment when the user 3 transmits the participation application with respect to a vehicle allocation request | requirement is demonstrated. FIG. 17A and FIG. 17B are sequence diagrams for explaining the operation when the user 3 of the emotion guidance system according to the present embodiment transmits a participation application for a dispatch request. In FIGS. 17A and 17B, it is assumed that user registration and user authentication for each user have been completed.

  As illustrated in FIG. 17A, first, the information processing terminal 7B (that is, a user who transmits a participation application) requests the information processing server 6 for position information of the emotion guidance device 2 around the information processing terminal 7B (S231). . The information processing server 6 searches the positional information of the emotion guiding device 2 (S232), and transmits the positional information of the emotion guiding device 2 to the information processing terminal 7B (S233). Thereby, the position of the emotion induction device 2 and the vehicle allocation request for the emotion induction device 2 are displayed on the information processing terminal 7B, and the user can confirm the vehicle allocation request transmitted to the surrounding emotion induction device 2 ( S234).

  Here, when the participation application for the vehicle allocation request is transmitted from the information processing terminal 7B to the information processing server 6 (S235), the information processing server 6 processes the participation application for the vehicle allocation request and the profile information of the applied user. It transmits to the terminal 7A (that is, the user 3 who transmitted the vehicle allocation request) (S236). When the approval for the participation application is transmitted from the information processing terminal 7A to the information processing server 6 (S237), the information processing server 6 stores the approval of the participation application for the vehicle allocation request (S238) and applies to the information processing terminal 7B. Is notified (S239).

  Next, as shown in FIG. 17B, the information processing server 6 determines whether or not a predetermined time before the scheduled dispatch time (S221). 6 requests the sentiment guidance device 2 to be dispatched to transmit the position information of the current position (S222). The emotion guidance device 2 transmits the position information of the current position to the information processing server 6 (S224). The emotion induction device 2 may reflect the background of the captured image received at the timing and the imaging settings such as the editing material (S223).

  Subsequently, the information processing server 6 calculates the time at which the emotion guiding device 2 arrives at the dispatch location (S225), and sends the position information of the sent emotion guiding device 2 to be dispatched and the estimated arrival time to the information processing terminals 7A and 7B. Notification is made (S226A, S226B). The information processing terminals 7A and 7B display the notified position information of the emotion guiding device 2 and the estimated arrival time (S227A, S227B). Note that the processing of S222 to S227A and S227B (excluding the processing of S223) is repeatedly executed at a predetermined interval (for example, every 1 to 3 minutes) until the emotion induction device 2 reaches the dispatch location. Also good.

  In FIG. 17B, for convenience of illustration, the processing of S226A and S226B is shown to be executed at different timings, but the processing of S226A and S226B may be executed at the same timing.

  Here, with reference to FIG. 18, operation | movement of the emotion guidance system which concerns on this embodiment when the user 3 transmits the dispatch request which recruits participants is demonstrated. FIG. 18 is a sequence diagram illustrating an operation when the user 3 of the emotion guidance system according to the present embodiment transmits a vehicle allocation request for recruiting participants.

  In FIG. 18, it is assumed that user registration and user authentication for each user have been completed. Further, the processing after a predetermined time before the scheduled dispatch time after the processing shown in FIG. 18 is the same as the processing described with reference to FIG. 17B, and thus description thereof is omitted here.

  As shown in FIG. 18, first, the information processing terminal 7A (that is, the user 3 who transmits a dispatch request for recruiting participants) transmits a dispatch request for recruiting participants to the information processing server 6 (S241). Next, the information processing server 6 stores the transmitted vehicle allocation request (S242). Here, when the information processing terminal 7B requests browsing of a dispatch request for recruiting participants (S243), the information processing server 6 displays information on the dispatch request for recruiting participants in the information processing terminal 7B. (S244). Thereby, the information on the dispatch request for recruiting participants is displayed on the information processing terminal 7B, and the user can confirm the dispatch request for recruiting participants (S245).

  Here, when the application for participation request of the dispatch request is transmitted from the information processing terminal 7B (S246), the information processing server 6 transmits the transmitted application for participation invitation to the information processing terminal 7A (S247). . Further, the information processing server 6 searches for the emotion guidance device 2 that can be dispatched at the location and date / time of the dispatch request, and selects the emotion guidance device 2 to be dispatched (S248). Subsequently, the information processing server 6 stores the vehicle allocation request and the emotion guidance device 2 to be allocated in association with each other (S249). The information processing server 6 transmits a vehicle allocation request to the emotion guidance device 2 (S250), and notifies the information processing terminals 7A and 7B of information on the emotion guidance device 2 to be allocated (S251A, S251B).

  Note that the information processing terminal 7A may transmit the imaging settings such as the background of the captured image and the editing material to the information processing server 6 at any timing. The imaging setting is transmitted to the emotion induction device 2 at the same time as a vehicle allocation request, for example.

  In FIG. 18, for the sake of convenience, the processes of S250, S251A, and S251B are shown to be executed at different timings, but the processes of S250, S251A, and S251B may be executed at the same timing.

  The operation of the emotion guidance system according to this embodiment has been described in detail above. According to the emotion guidance system according to the present embodiment, the user 3 can receive an output for extracting emotions from the emotion guidance device 2 at a desired place and date. Moreover, according to the emotion guidance system which concerns on this embodiment, the user 3 can also receive the output which extracts an emotion with another user, and can image the facial expression from which the emotion was pulled out with the other user.

[2.4. Hardware configuration]
Hereinafter, an example of a hardware configuration of the information processing server 6 according to the present embodiment will be described with reference to FIG. FIG. 19 is a block diagram illustrating a hardware configuration example of the information processing server 6 according to the present embodiment. Information processing by the information processing server 6 according to the present embodiment is realized by cooperation of software and hardware.

  As illustrated in FIG. 19, the information processing server 6 includes a CPU 661, a ROM 663, a RAM 665, a bridge 671, internal buses 667 and 669, an interface 673, an input device 675, an output device 677, and a storage device 679. A drive 681, a connection port 683, and a communication device 685.

  The CPU 661 functions as an arithmetic processing unit and a control unit, and controls the overall operation of the information processing server 6 according to various programs stored in the ROM 663 and the like. The ROM 663 stores programs and calculation parameters used by the CPU 661, and the RAM 665 temporarily stores programs used in the execution of the CPU 661, parameters that change as appropriate in the execution, and the like. For example, the CPU 661 may execute functions of the control unit 600 and the like.

  The CPU 661, ROM 663, and RAM 665 are connected to each other by a bridge 671, internal buses 667 and 669, and the like. The CPU 661, ROM 663, and RAM 665 are also connected to an input device 675, an output device 677, a storage device 679, a drive 681, a connection port 683, and a communication device 685 via an interface 673.

  The input device 675 includes an input device for inputting various information such as a touch panel, a keyboard, a mouse, a button, a microphone, a switch, and a lever. The input device 675 also includes an input control circuit for generating an input signal based on the input information and outputting it to the CPU 661.

  The output device 677 includes, for example, a display device such as a CRT (Cathode Ray Tube) display device, a liquid crystal display device, an organic EL (Organic ElectroLuminescence) display device, and an audio output device such as a speaker and headphones.

  The storage device 679 is a data storage device configured as an example of a storage unit of the information processing server 6. The storage device 679 may include a storage medium, a storage device that stores data in the storage medium, a reading device that reads data from the storage medium, and a deletion device that deletes stored data. The storage device 679 may execute functions such as a user information storage unit 620, a vehicle allocation management information storage unit 630, a vehicle allocation request storage unit 640, and a map information storage unit 650, for example.

  The drive 681 is a storage medium reader / writer, and is built in or externally attached to the information processing server 6. For example, the drive 681 reads information stored in a mounted removable storage medium such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 663. The drive 681 can also write information to a removable storage medium.

  The connection port 683 is a connection interface including connection ports for connecting external connection devices such as a USB port, an Ethernet (registered trademark) port, an IEEE 80671 standard port, and an optical audio terminal, for example.

  The communication device 685 is a communication interface configured by a communication device for connecting to the network 5 such as a public line network, for example. The communication device 685 may be a cable communication device that performs wired cable communication, or may be a wired or wireless LAN compatible communication device. For example, the communication device 685 may execute the function of the communication unit 610.

  Further, it is possible to create a computer program for causing hardware such as a CPU, a ROM, and a RAM built in the information processing server 6 to exhibit functions equivalent to those of the information processing server 6 described above. A storage medium storing the computer program is also provided.

<3. Summary>
As described above, according to the emotion induction system according to the first embodiment of the present disclosure, it is possible to draw a natural expression from the user 3. Moreover, according to the emotion guidance system which concerns on 1st Embodiment of this indication, it is also possible to image with the imaging device the facial expression of the user 3 from whom the natural emotion was drawn.

  Moreover, according to the emotion guidance system which concerns on 2nd Embodiment of this indication, the user 3 can receive the output which extracts the emotion by the emotion guidance apparatus 2 in the desired place and date. In addition, according to the emotion guidance system according to the second embodiment of the present disclosure, the user 3 receives an output that extracts emotion together with other users, and images the facial expression from which the emotion is extracted together with the other users. Is also possible.

  The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

  Further, the effects described in the present specification are merely illustrative or exemplary and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

The following configurations also belong to the technical scope of the present disclosure.
(1)
An emotion selector that selects emotions to be drawn from the user;
An output control unit for controlling output to the user according to the selected emotion;
Emotion induction system with
(2)
The emotion induction system according to (1), wherein the emotion selection unit selects an emotion to be extracted from the user based on at least one of the user's image or sound.
(3)
The emotion induction system according to (1), wherein the emotion selection unit selects an emotion to be extracted from the user based on a question to the user and an answer to the question.
(4)
The emotion output system according to any one of (1) to (3), wherein the output works to at least one of the five senses of the user to extract a selected emotion from the user.
(5)
The output control unit controls an object provided in a box whose inside is not visually recognized by the user from among objects having at least one of tactile sensation and shape different from each other according to the selected emotion. The emotion induction system according to any one of (1) to (4).
(6)
The emotion induction system according to any one of (1) to (5), further including an imaging unit that images the user from which the selected emotion is drawn.
(7)
A score calculating unit that calculates a similarity score representing a degree of similarity between the selected emotion and the user's emotion based on at least one of the user's image and sound;
The emotion induction system according to (6), wherein the imaging unit acquires an image of the user when the similarity score is a threshold value or more.
(8)
An image editing unit that edits the captured image of the user based on an input from the user;
The emotion induction system according to (6) or (7), wherein the captured image of the user is edited with an editing material corresponding to the selected emotion.
(9)
The emotion induction system according to any one of (1) to (8), further including an emotion induction device that is provided in a moving body and outputs an output corresponding to the selected emotion to the user. (10)
An information processing server further comprising: a vehicle allocation request management unit that registers a vehicle allocation request of the emotion guidance device and transmits the vehicle allocation request to the emotion guidance device that can be allocated at a vehicle allocation location and a vehicle allocation date and time included in the vehicle allocation request. The emotion induction system according to (9) above.
(11)
The emotion guidance system according to (10), wherein the dispatch request further includes information on emotions to be drawn from the user.
(12)
The emotion induction device further includes an imaging unit that images the user from which the selected emotion is drawn,
The said dispatch request | requirement is an emotion guidance system as described in said (10) or (11) which further contains the information regarding imaging setting.
(13)
The information processing server acquires position information of the emotion guidance device from the emotion guidance device that has transmitted the vehicle allocation request, and notifies the user who has registered the vehicle allocation request of approach information of the emotion guidance device The emotion induction system according to any one of (10) to (12), further including a situation notification unit.
(14)
The said dispatch request management part receives the participation application with respect to the said dispatch request from another user, and transmits the said participation application to the user who registered the said dispatch request, In any one of said (10)-(13) The described emotion induction system.
(15)
The dispatch request management unit registers a dispatch request for recruiting participants, and when there is a participant in response to the recruitment of the dispatch request, the emotion induction that can be dispatched at the dispatch location and the dispatch date / time included in the dispatch request The emotion guidance system according to any one of (10) to (14), wherein the dispatch request is transmitted to a device.
(16)
The emotion guidance system according to (15), wherein the dispatch request management unit controls the dispatch request that can be browsed by the participant so that the emotion drawn from the user matches the emotion drawn from the participant. .
(17)
Selecting emotions to draw from users,
Controlling the output to the user according to the selected emotion by the arithmetic processing unit;
Emotion induction method including.

DESCRIPTION OF SYMBOLS 1, 2 Emotion guidance device 3 User 4 Mobile body 6 Information processing server 7 Information processing terminal 103 Emotion selection part 105 Output selection part 107 Emotion table memory | storage part 109 Output control part 111 Output pattern memory | storage part 113 Output part 115 Imaging part 117 Score calculation 119 Image editing unit 121 Editing material storage unit 123 Printing unit 125 Communication unit

Claims (17)

An emotion selector that selects emotions to be drawn from the user;
An output control unit for controlling output to the user according to the selected emotion;
Emotion induction system with   The emotion induction system according to claim 1, wherein the emotion selection unit selects an emotion to be extracted from the user based on at least one of the user's image or sound.   The emotion induction system according to claim 1, wherein the emotion selection unit selects an emotion to be extracted from the user based on a question to the user and an answer to the question.   The emotion output system according to claim 1, wherein the output works to at least one or more of the five senses of the user to extract a selected emotion from the user.   The output control unit controls an object provided in a box whose inside is not visually recognized by the user from among objects having at least one of tactile sensation and shape different from each other according to the selected emotion. The emotion induction system according to claim 1.   The emotion guidance system according to claim 1, further comprising an imaging unit that images the user from which the selected emotion is drawn. A score calculating unit that calculates a similarity score representing a degree of similarity between the selected emotion and the user's emotion based on at least one of the user's image and sound;
The emotion induction system according to claim 6, wherein the imaging unit acquires an image of the user when the similarity score is equal to or greater than a threshold value. An image editing unit that edits the captured image of the user based on an input from the user;
The emotion induction system according to claim 6, wherein the captured image of the user is edited with an editing material corresponding to the selected emotion.   The emotion induction system according to claim 1, further comprising an emotion induction device that is provided in a moving body and outputs an output corresponding to the selected emotion to the user.   An information processing server further comprising: a vehicle allocation request management unit that registers a vehicle allocation request of the emotion guidance device and transmits the vehicle allocation request to the emotion guidance device that can be allocated at a vehicle allocation location and a vehicle allocation date and time included in the vehicle allocation request. The emotion induction system according to claim 9, comprising:   The emotion guidance system according to claim 10, wherein the dispatch request further includes information on emotions to be drawn from the user. The emotion induction device further includes an imaging unit that images the user from which the selected emotion is drawn,
The emotion guidance system according to claim 10, wherein the dispatch request further includes information related to imaging settings.   The information processing server acquires position information of the emotion guidance device from the emotion guidance device that has transmitted the vehicle allocation request, and notifies the user who has registered the vehicle allocation request of approach information of the emotion guidance device The emotion induction system according to claim 10, further comprising a situation notification unit.   The emotion guidance system according to claim 10, wherein the dispatch request management unit accepts a participation request for the dispatch request from another user and transmits the participation request to a user who has registered the dispatch request.   The dispatch request management unit registers a dispatch request for recruiting participants, and when there is a participant in response to the recruitment of the dispatch request, the emotion induction that can be dispatched at the dispatch location and the dispatch date / time included in the dispatch request The emotion induction system according to claim 10, wherein the dispatch request is transmitted to a device.   The emotion dispatch system according to claim 15, wherein the dispatch request management unit controls the dispatch request that can be browsed by the participant so that an emotion drawn from the user matches an emotion drawn from the participant. Selecting emotions to draw from users,
Controlling the output to the user according to the selected emotion by the arithmetic processing unit;
Emotion induction method including.

Images