JP2021002344A - Information processor - Google Patents

Abstract

To allow sharing of useful information by constructing an environment which enables a close connection between a provider of a commodity and a user as a receiver of the commodity.SOLUTION: A communication robot 1 is an information processor connected to a network N. A voice input controller 101 of the communication robot 1 inputs a request to acquire net information from a user U by voice. An information acquisition unit 102 acquires net information via a network on the basis of the request for acquisition from the user by voice. A voice output control unit 104 outputs, to the user, the information that the net information has been acquired by voice. A notification control unit 105 controls notification of the net information to the user U. The object of the present invention can be thus achieved.SELECTED DRAWING: Figure 4

Description

The present invention relates to an information processing device.

Conventionally, a sales service that allows a user to browse and order a favorite product or service (hereinafter referred to as "product, etc.") via the Internet or the like using a catalog provided by a product provider, that is, called a catalog mail order. The service is thriving.
Then, for example, in order for the user to use such catalog mail order, a technique has been proposed for selling the product or the like with a cash voucher so that the user can efficiently use the catalog mail order (for example). , Patent Document 1).

Japanese Unexamined Patent Publication No. 2010-067092

However, the prior art including the technique described in Patent Document 1 described above merely enables efficient use of catalog mail order, and information that can be acquired by the user (matters that can be considered) is simply described in the catalog. It was limited to information on general products that have been sold.
In this regard, in recent years, when deciding whether or not to purchase a product, the user side is provided with not only simple information and price related to the product, but also the place of production, producer, seller, and service of the product. There is a desire to take into account the subject and various other information.
In addition, there is a request from producers, sellers, and other providers of products to convey detailed information about the products to users.

The present invention has been made in view of such a situation, and useful information can be shared by constructing an environment in which the provider side of the product or the like and the user side receiving the provision can closely cooperate with each other. The purpose is to do so.

In order to achieve the above object, the information processing device of one aspect of the present invention is
An information processing device connected to a network
A voice input control means that executes control for inputting a user's information acquisition request by voice,
An acquisition means for acquiring net information via the network based on the acquisition request by voice.
A voice output control means that executes control to output the acquisition of the net information to the user by voice, and
A notification control means for controlling the notification of the acquired net information to the user, and
To be equipped.

According to the present invention, an environment in which a provider side of a product or the like and a user side receiving the provision can closely cooperate is constructed, and useful information can be shared.

It is a figure which shows the outline of this service to which the communication robot which concerns on 1st Embodiment of the information processing apparatus of this invention is applied. It is a block diagram which shows an example of the structure of the information processing system to which the communication robot of FIG. 1 is applied. It is a block diagram which shows an example of the hardware composition of the communication robot of FIG. FIG. 3 is a functional block diagram showing an example of a functional configuration that realizes a product or the like purchase support process among the processes whose execution is controlled by the communication robot of FIG. It is a figure which shows the outline of this service to which the communication robot which concerns on 2nd Embodiment of the information processing apparatus of this invention is applied. It is a block diagram which shows an example of the structure of the information processing system to which the communication robot of FIG. 5 is applied. It is a functional block diagram which shows an example of the functional configuration which realizes the Mimamori control process among the processes whose execution is controlled by the communication robot of FIG. It is a flow chart which shows the flow of a service when a user purchases a product or the like using the communication robot of FIG. It is an image diagram which shows an example of the business model using the communication robot of FIG.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
First, with reference to FIG. 1, a service to which the information processing system (see FIG. 2 described later) to which the communication robot 1 according to the first embodiment of the information processing apparatus of the present invention is applied is applied (hereinafter, "the present invention"). The outline of "service") will be explained.

FIG. 1 is a diagram showing an outline of the service to which the communication robot according to the first embodiment of the present invention is applied.

This service is a service provided to the user U by the service provider G who provides the communication robot 1 according to the first embodiment of the information processing apparatus of the present invention. The user U to be provided with this service is not particularly limited, but is provided as a particularly convenient service for, for example, elderly people living alone or those who are unfamiliar with EC (Electronic Commerce) sites.

As shown in FIG. 1, the user U who is the target of providing this service reads the paper-based catalog C issued by the catalog mail-order company E which is co-sponsoring this service as a partner company. Then, the user U can consider whether or not to purchase the product or the like listed in the catalog C (in the example of FIG. 1, the healthy juice J listed on page 15 of the catalog C). At this time, the user U can acquire detailed information that is not described in the catalog C for the product or the like for which whether or not to purchase is being examined by communicating with the communication robot 1 by voice.

Specifically, a QR code (registered trademark) indicating a URL (Uniform Resource Locator) or the like for acquiring detailed information of a product or the like is printed on the catalog C. Therefore, as shown in FIG. 1, the user U speaks to the communication robot 1 by voice, "I want to know more about the healthy juice on page 15" (step SS1). Then, the communication robot 1 replies, "Please hold the code over" (step SS2). Therefore, the user U holds the QR code (registered trademark) listed in the catalog C over the communication robot 1 (step SS3). As a result, the communication robot 1 recognizes the URL or the like for acquiring the detailed information of the product or the like, accesses the URL or the like, and acquires the detailed information of the product or the like. The detailed information of this product or the like is stored in advance by the catalog mail order company E in a cloud storage or the like on the Internet (hereinafter referred to as "this cloud"). Next, when the communication robot 1 acquires detailed information such as products from this cloud (step SS4), it outputs a voice saying "I will show you the details of healthy juice on page 15!" (Step SS5). Then, the communication robot 1 transmits the acquired detailed information of the product or the like to the television receiver T (hereinafter referred to as "television T") (step SS6). Then, the television T displays detailed information such as a product transmitted from the communication robot 1 (step SS7). As a result, the user U can easily obtain detailed information on the product by viewing the information (image information and text information) displayed on the television T.

Further, the communication robot 1 can read out detailed information such as the above-mentioned products by voice as various information (hereinafter, referred to as "net information") that can be acquired and output from the Internet or the cloud. It is also possible to support a video call between a user U and an operator of a service center such as a catalog mail order company E. Specifically, the communication robot 1 supports a video call between the operator and the user U by a video call function using a touch panel M capable of outputting a moving image and a speaker (not shown). Further, it is possible to accept a request (some instruction or command) issued by the user U by voice. That is, the communication robot 1 can execute various kinds of processing while communicating with the user U by voice.

In this way, since the communication robot 1 can communicate by voice, it is possible to easily extract digital information by requesting an analog form by voice without operating a personal computer.
Further, for the user U, the communication robot 1 can feel as if he / she talks to him / her, so that he / she can be positioned as a partner to be attached to.

The communication robot 1 not only outputs the acquired net information (for example, detailed information of the above-mentioned products and the like) as it is, but also processes the information and adds the information based on the acquired net information to the user U. You can also make recommendations.

Further, the user U prints on the catalog C, for example, in addition to the method of holding the QR code (registered trademark) over the communication robot 1 as described above as a request for acquiring the net information (for example, detailed information of the above-mentioned products and the like). There is also a method of holding the page of the product product over the communication robot 1 and inputting "I want this information" by voice.
In this case, the communication robot 1 recognizes the voice input "I want this information" and recognizes the product (health juice J) printed on the page of the catalog C held over via the hardware camera R. , You can also get detailed information about the product.

As described above, the communication robot 1 is a communication tool capable of acquiring net information from the Internet or the cloud as an information source. Further, the communication robot 1 employs voice as a base for one-to-one communication with the user U. Therefore, the user U has an effect that it is not necessary to perform troublesome operations such as touch operation on the screen and keyboard input. In particular, when the user U is an elderly person or a person who is unfamiliar with the EC site, this effect becomes remarkable. Since the communication robot 1 includes the touch panel M, it can also accept touch operations and keyboard inputs as an auxiliary.

Further, the communication robot 1 can acquire information prepared in advance by the catalog mail order company E as the net information as in the above example, but is not particularly limited to this. For example, the communication robot 1 can output information such as products not prepared by the catalog mail order company E by voice as net information. For example, a product of another company similar to a product prepared by the catalog mail order company E can be recommended to the user U.

Further, the communication robot 1 can input a QR code (registered trademark) or voice as a request for acquiring net information as in the above example, but other than that, for example, voice that is not a direct request. It is also possible to obtain online information from such information. For example, it is assumed that the communication robot 1 has a function of talking with the user U (hereinafter, referred to as an "interactive function"). In this case, the communication robot 1 can acquire the product and the like and the net information about the product and the like based on the content of the dialogue with the user. Specifically, for example, it is assumed that the content of the dialogue between the communication robot 1 and the user U is related to a certain menu (menu). In this case, the communication robot 1 can provide the user U with the foodstuff to be prepared and the net information about the foodstuff in the form of voice.

In addition, the user U can perform the purchase procedure of the specified product or the like via the communication robot 1. For example, the communication robot 1 specifies a product or the like that the user U wants to purchase by using the QR code (registered trademark) as described above. The communication robot 1 serves as an interface to the user U in the purchase procedure of the specified product or the like, and can also assist the purchase procedure. Specifically, for example, the communication robot 1 can assist the user U in selecting a color variation of a product or the like that he / she wants to purchase.
Further, the communication robot 1 can prompt reconfirmation when the user U purchases the wrong product or the like. Specifically, for example, the communication robot 1 is when the user U is trying to purchase a product or the like that is different from the product or the like that the user U normally purchases, or the size that the user U normally purchases continuously. It is possible to prompt the user U to reconfirm when he / she is going to purchase a product or the like having a size different from the above. That is, the communication robot 1 can assist the purchase procedure of the user U based on the past purchase record of the user U. As a result, the convenience of the user U is improved.

Further, as described above, the user U can make a video call with the operator of the service center via the communication robot 1. For example, it is assumed that when the user U is in the process of purchasing a product, the user U requests a response by a natural person instead of the communication robot 1. In this case, the communication robot 1 can make the user U make a video call with the operator based on the request of the user U. Further, the communication robot 1 can provide the user U with guidance by the operator (specific operation example, etc.) in the form of voice or video (for example, video output from the television T).

Further, the purchase of the product or the like via the communication robot 1 may be performed under the condition that the user U has an incentive as compared with the purchase or the like at the actual store. As described above, the communication robot 1 can provide the net information to the user U. However, the user U may obtain the net information about the product or the like from the communication robot 1, confirm the content, and then visit the actual store to receive the product or the like. In addition, the user U may not purchase immediately after acquiring the net information in order to further consider it. For this reason, an incentive may be provided for the purchase of a product or the like via the communication robot 1.

Further, the communication robot 1 can urge the user U to browse the catalog C. For example, as described above, the communication robot 1 has a dialogue function with the user U. In this case, the communication robot 1 can recommend the user U to browse the catalog C from the flow of daily conversation with the user U. Specifically, for example, when the communication robot 1 and the user U have a conversation about the summer heat, the communication robot 1 has a content such as "Summer special feature is included in the catalog." Audio can be output.
In addition, the communication robot 1 can increase the frequency of recommending a specific product. As described above, the communication robot 1 can recommend a product based on the content of the conversation with the user U, but for example, it is possible to increase the frequency of recommending a specific product. Specifically, for example, when an advertising expense or the like is paid to the service provider G by a company that provides the product or the like, the product or the like of the company can be preferentially recommended. .. As a result, the service provider G can earn advertising revenue.

Next, with reference to FIG. 2, an example of the configuration of the information processing system that enables the service shown in FIG. 1 will be described.
FIG. 2 is a block diagram showing an example of the configuration of an information processing system to which the communication robot of FIG. 1 is applied.

The information processing system shown in FIG. 2 includes a communication robot 1, a management server 2, and a partner terminal 3.
The communication robot 1, the management server 2, and the partner terminal 3 are connected to each other via a predetermined network N such as the Internet.
In FIG. 2, only one partner terminal 3 is drawn, but this is for easy understanding of the explanation. That is, since there may actually be a plurality of catalog mail-order companies E, there may be a plurality of partner terminals 3 (not shown).

The communication robot 1 is an information processing device having an information collecting function, an interactive function, and the like for acquiring and outputting net information. The communication robot 1 is provided with a touch panel M, a speaker (not shown), and the like, and can output voice information, character information, and image information.

The management server 2 is an information processing device managed by the service provider G. The management server 2 executes various processes for realizing this service while appropriately communicating with the communication robot 1 and the partner terminal 3 respectively. Specifically, for example, the management server 2 links and manages various data in the information processing system of FIG.

The partner terminal 3 is an information processing device operated by a person in charge of the catalog mail order company E. The partner terminal 3 is used for business such as recording and providing various information related to products and the like provided by the catalog mail order company E.

FIG. 3 is a block diagram showing an example of the hardware configuration of the communication robot in the information processing system of FIG.

The communication robot 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an input unit 16, and an output unit 17. A storage unit 18, a communication unit 19, and a drive 20 are provided.

The CPU 11 executes various processes according to the program recorded in the ROM 12 or the program loaded from the storage unit 18 into the RAM 13.
Data and the like necessary for the CPU 11 to execute various processes are also appropriately stored in the RAM 13.

The CPU 11, ROM 12 and RAM 13 are connected to each other via the bus 14. An input / output interface 15 is also connected to the bus 14. An input unit 16, an output unit 17, a storage unit 18, a communication unit 19, and a drive 20 are connected to the input / output interface 15.

The input unit 16 is composed of various hardware buttons and the like, and inputs various information according to an operation instructed by the operator.
The output unit 17 is composed of a display such as a liquid crystal display, a speaker, or the like, and outputs various information as images or sounds.
The input unit 16 and the output unit 17 constitute a touch panel M.

The storage unit 18 is composed of a DRAM (Dynamic Random Access Memory) or the like, and stores various data.
The communication unit 19 communicates with other devices (for example, the management server 2 and the partner terminal 3 in FIG. 2) via the network N including the Internet.

A removable medium 30 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately mounted on the drive 20. The program read from the removable media 30 by the drive 20 is installed in the storage unit 18 as needed.
In addition, the removable media 30 can also store various data stored in the storage unit 18 in the same manner as the storage unit 18.

Although not shown, the management server 2 and the partner terminal 3 in FIG. 1 can also have basically the same configuration as the hardware configuration shown in FIG. Therefore, the description of the hardware configuration of the management server 2 and the partner terminal 3 will be omitted.

By collaborating with the various hardware of the communication robot 1 shown in FIG. 3 and various software, it becomes possible to execute various processes including the purchase support process for products and the like in the communication robot 1. As a result, the service provider G can provide the above-mentioned service to the user U. "Product purchase support process" refers to the process executed to provide the above-mentioned service.
Hereinafter, among the information processing systems according to the present embodiment, the functional configuration for executing the product purchase support process executed by the communication robot 1 will be described with reference to FIG.

FIG. 4 is a block diagram showing an example of a functional configuration for executing a product purchase support process among the functional configurations of the information processing system including the communication robot of FIG.

As shown in FIG. 4, in the CPU 11 of the communication robot 1, when the execution of the product purchase support process is controlled, the voice input control unit 101, the information acquisition unit 102, the information management unit 103, and the voice output control The unit 104, the notification control unit 105, and the dialogue support unit 106 function.
Further, a user DB 181 and a message DB 182 are provided in one area of the storage unit 18 of the communication robot 1. In the user DB181, all information related to the user U (hereinafter referred to as "user information") is managed in association with an ID or the like that can uniquely identify the user U. The user information also includes the purchase history of the user U's products and the like. The message DB 182 stores information that serves as a template for a message to the user U (hereinafter, referred to as “template information”) for which output control is executed by the voice output control unit 104.

The voice input control unit 101 executes control for inputting a request for acquisition of net information by the user U by voice.

The information acquisition unit 102 acquires the net information via the network N based on the voice-based net information acquisition request.
In addition, the information acquisition unit 102 acquires voice information. Specifically, for example, the information acquisition unit 102 acquires the voice data as voice information when the user U speaks.

The information management unit 103 manages various types of information stored in the storage unit 18 of the communication robot 1. Specifically, the information management unit 103 manages the user information stored in the user DB 181 and the template information stored in the message DB 182.

The voice output control unit 104 executes control to output to the user U by voice that the net information has been acquired by the information acquisition unit 102.
Further, the voice output control unit 104 executes control to output the contents of the net information acquired by the information acquisition unit 102 to the user U by voice.

The notification control unit 105 executes control to notify the user U of the net information acquired by the information acquisition unit 102.

The dialogue support unit 106 supports the dialogue between the user U and another person based on the voice information acquired by the information acquisition unit 102.
Specifically, the dialogue support unit 106 recognizes the natural language that the user U uses on a daily basis among the voice information acquired by the information acquisition unit 102. Here, the method of recognizing the natural language by the dialogue support unit 106 is not particularly limited. For example, it is recognized by NLP (Natural Language Processing) using techniques such as morphological analysis and parsing. Then, the dialogue support unit 106 selects and extracts the template information of the message corresponding to the meaning and content of the recognized voice information from the message DB 182.
In addition, the dialogue support unit 106 can also generate message template information corresponding to the meaning and content of the recognized voice information. The model information generated by the dialogue support unit 106 is output controlled by the voice output control unit 104, and is stored and managed in the message DB 182.

[Second Embodiment]
Next, with reference to FIG. 5, a service to which the information processing system (see FIG. 6 described later) to which the communication robot 1 according to the second embodiment of the information processing apparatus of the present invention is applied is applied (hereinafter, "" The outline of "this service") will be explained.

FIG. 5 is a diagram showing an outline of the service to which the communication robot according to the second embodiment of the present invention is applied.

This service is a service provided to the user U by the service provider G who provides the communication robot 1 according to the second embodiment of the information processing apparatus of the present invention.
The user U to be provided with this service is not particularly limited, but as in the first embodiment, it is provided as a particularly convenient service for elderly people living alone who have weak legs and cannot easily go out. To. That is, in general, elderly people cannot master the use of personal computers and smartphones, which are prerequisites for using EC sites. For this reason, this service, which allows users to easily purchase products and the like while staying at home without using a personal computer or smartphone, is a highly convenient service for elderly people living alone.

In addition, from the standpoint of family F, such as a child who has an elderly person living alone as a parent, the daily health condition of the parents living apart is always anxious. For this reason, there have been conventional technologies for realizing so-called "Mimamori" by families and systems living in remote areas. For example, it is possible to "watch" with a fixed camera, but many elderly people who are the targets of imaging with a fixed camera are stressed that their daily lives are monitored by the fixed camera. In addition, if family F living in a remote place tries to realize a level of "Mimamori" that can be reassured, a corresponding cost will be incurred.

On the other hand, the communication robot 1 according to the second embodiment of the information processing apparatus of the present invention organically displays the functions (dialogue function, video call function, and information collecting function) of the first embodiment from the viewpoint of "Mimamori". It is equipped with a "Mimamori function" that is linked to each other. According to the "Mimamori function", the communication robot 1 functions as a supporter of the daily "Mimamori" of the user U, so that the family F living in a remote place can perform "Mimamori" in real time.

By using this service, the user U is stimulated by the communication robot 1 which is the partner of daily communication. As a result, it can be expected that the user U will feel like trying new hobbies and new things, and will feel reassured that he / she is being watched over.
User U can also enjoy a video call with family F and friends (other users). Specifically, a video call is made by displaying a person to be called on the touch panel M of the communication robot 1. Since the video call is made using a dedicated line, it is possible to prevent, for example, a so-called "Oreore fraud" by a person pretending to be a family member F.
Further, the user U can use, for example, the following services in addition to the above-mentioned shopping (purchase of products and the like) by performing a simple touch operation on the touch panel M of the communication robot 1. That is, it is possible to use services such as watching, daily calling, and information sharing with family F (for example, sharing of information about what user U wants). In addition, services such as calendars, dictionaries, weather forecasts, telephone directories, news, music playback, cameras, and various notifications (for example, seasonal notifications) can be used.

By using this service, Family F can obtain the satisfaction of being filial to parents living alone.
In addition, Family F is a dedicated application software (hereinafter referred to as "Family-only application") installed on the smartphone for Family F to use this service, and makes a video call with the parent (user U). Can be done.
In addition, the family F can check how much the parent (user U) and the communication robot 1 are interacting with each other (frequency of use) with the family-only application. Specifically, the date and time of login, calling, conversation start, conversation end, etc. can be confirmed as a history.
Further, since the family F can see the moving image captured by the hardware camera R aligned with the line of sight of the communication robot 1, for example, the state of the room and the state of the parent (user U) can be confirmed. ..
As a result, the family F can lead a daily life with peace of mind without being overly worried about the parent (user U).

In addition, user U and family F can obtain incentive points by using this service. The effect of this service is realized only when the user U actively interacts with the communication robot 1. Therefore, the service point is given to the user U who has interacted with the communication robot 1, so that the usage rate of this service is improved. As a result, the user U and the family F will actively use this service, and it can be expected that the above-mentioned effect will be realized.

Further, according to this service, the user U can acquire all kinds of information about "things" and "things" while staying at home by interacting with the communication robot 1.
Specifically, for example, as shown in FIG. 5, the user U, the local producer A, the partner company P, another user U, the family F, the Mimamori Center H, the partner doctor D, etc., via the communication robot 1. Can be connected with. Of these, "regional producer A" refers to a person who produces "things" in the region of user U. "Partner company P" means a company, etc. that supports this service. The products and the like provided by the partner company P can be purchased through the communication robot 1. "Mimamori Center H" refers to an organization operated by service provider G that provides monitoring and guidance for user U. "Partner doctor D" refers to medical institutions, doctors, etc. who support this service. The medical treatment provided by the partner doctor D can also be performed remotely via the communication robot 1.
As a result, the user U can purchase, for example, agricultural products produced by the local producer A through the partner company P, or communicate with other user U and family F by video call or the like. .. Furthermore, since the support of the Mimamori Center H and the partner doctor D can be received, the user U can lead a daily life with peace of mind. In addition, the family F can reduce the worry about the parent (user U) living alone.

Summarizing the above, this service realizes the following contents.
That is, this service functions as a platform for bringing the elderly (user U) into contact with family, society, various services, and various information.
In addition, the usage record of the communication robot 1 by the elderly (user U) is managed. This makes it possible for the elderly (user U) to grasp the frequency of use of the communication robot 1. Since the usage record is managed, it is possible to analyze the user U's intention. As a result, various recommendations to the user U and notification (alert) to the user U himself or his family F or the like when a danger occurs can be made.
In addition, this service can be linked to various devices. For example, it is possible to link with a wearable device, a thermometer, a sphygmomanometer, or an indoor temperature / humidity sensor (not shown), or to connect a Miracast to a TV T.
Further, since the communication robot 1 is connected to the Internet, it can acquire information from the cloud or the outside and output or input it as appropriate. Furthermore, it is possible to send the content of the video call to the linked smartphone and to be notified when certain conditions are met.
In addition, various information can be displayed or notified by using an external API (Application Programming Interface) such as weather and news.
In addition to the touch panel M and the hardware camera R, the communication robot 1 can be equipped with an NFC (Near Field Communication) (registered trademark) sensor, a short-range sensor, a microphone, and the like.
Further, in the communication robot 1, the upper portion of the housing can be rotated up, down, left and right by a predetermined angle (for example, an upper limit of 15 degrees and left and right of 175 degrees).
Further, the communication robot 1 enables communication by, for example, Wi-Fi, a SIM card, or Bluetooth (registered trademark).
Further, the communication robot 1 can collate with the information stored in a predetermined database when it sees an object (that is, when it is imaged by the hardware camera R) by the action recognition technology and the object recognition technology.
Further, the communication robot 1 promotes the conversation of the elderly (user U). As a result, the communication robot 1 functions as a life partner that serves as a basis for the mind of the elderly (user U).

Here, a conversation exchanged between the user U and the communication robot 1 by the dialogue function of the communication robot 1 will be described with specific examples.
When the user U (a woman in her 70s) rents the communication robot 1 from the service provider G, the following conversation is exchanged between the user U and the communication robot 1.
That is, when the communication robot 1 speaks "Grandma, thank you from now on.", User U answers "Thank you. OOOO (name of the communication robot 1 that can be set arbitrarily)." Then, when the communication robot 1 says, "I want to remember my grandma's face and voice, look at this!", User U looks at the communication robot 1. Here, the communication robot 1 stores and registers the voice (voiceprint) and face of the user U as biometric information for authentication to be used later. Also, register a PIN in case the biometric authentication does not pass.

After that, while User U lives a daily life with Communication Robot 1, Communication Robot 1 talks to "Grandma, it's getting hot recently. Is there water?" Then, images of the three types of drinking water products are displayed on the touch panel M. Then, when User U touched the touch panel M and said, "Let's do this," ▽▽ Delicious water of Mt. ", Communication Robot 1 said," Yeah, I understand! "▽▽ Delicious water of Mt. I will buy it. Talk to Grandma, OOOO-chan (the name of Communication Robot 1). " Then, user U talks to "OOOO-chan". As a result, authentication is started. That is, the communication robot 1 authenticates the user U each time when purchasing a product or the like in order to prevent unauthorized use.

If the authentication is successful, the purchase procedure of the product or the like is started, but if the user U wears a mask, the authentication may not be successful. Then, the communication robot 1 says, "If you are wearing a mask, remove it. Or enter your PIN." Then, the user U replies, "Don't do it, you kept masking", removes the mask, and authenticates again. Then, when the face and the voiceprint are authenticated and the short-distance sensor detects that the user U is in front of the eyes, the purchase procedure is started. When the purchase procedure is completed, Communication Robot 1 says, "Grandma, I bought it! The product will arrive between 2:00 pm and 4:00 pm tomorrow." Then, user U answers "Thank you OOOO-chan". In this way, the user U can easily purchase a product or the like through a conversation exchanged with the communication robot 1.

The day after the user U purchases the product, the communication robot 1 detects the user U's face and movement within the distance captured by the camera, and says, "It's about 2:00 pm. By 4:00 pm The product will arrive. " Then, user U replies, "It was." In this way, the communication robot 1 can naturally remind the product or the like in a casual conversation.
After that, when a courier visits User U's home and says "I have delivered water" at the entrance, User U answers "Yes, always thank you."

Later, User U talks to Communication Robot 1 "Oh yeah, I want to eat ramen." Then, Communication Robot 1 asks, "Ramen is delicious, by the way, have you eaten vegetables lately?" There is a reason why the communication robot 1 asked in this way. That is, the communication robot 1 refers to the purchase history of the user U and determines that the purchase of products belonging to the vegetable or fruit category is small. In response, User U replies, "I haven't eaten much (vegetables) these days. I often get fruits from my neighbors." Then, Communication Robot 1 recommends, "That's right. It seems that my aunt's favorite tomato hasn't been eaten recently, so why not try it?" Furthermore, Communication Robot 1 casually provides information, saying, "Tomatoes contain iron and potassium and are good for summer heat fatigue! Now, Kumamoto tomatoes are recommended and introduced!" Then, user U asks, "Yes? Can you show me a little?" Then, the communication robot 1 answers "Yeah! I will display the recommended tomatoes" and displays the recommended product (tomatoes from Kumamoto) on the touch panel M. On the other hand, the user U expresses his intention to purchase, saying, "It looks delicious, I'll do this." Then, Communication Robot 1 tells us that we can introduce products other than tomatoes, saying, "Yeah, I understand. Do you want to see popular products in your grandma's friend's age?" Then, user U replies, "Well, I like clothes." On the other hand, Communication Robot 1 introduces products such as "I will introduce three popular items in the fashion category. The first place is a silk blouse", and the touch panel M is a popular item for women in their 70s. Is displayed. Then, user U asks, "What is that? Tell me." Then, Communication Robot 1 replies, "Short-sleeved silk blouse with good water absorption. It's a summer blouse that is just right for the coming season." In response, User U says, "It's a bright color. This is popular." Then, the communication robot 1 replies, "It's okay to have grandma's favorite blue color."

At a later date, User U talks to Communication Robot 1 that "customers are coming, so I have to buy tea." Then, the communication robot 1 displays a plurality of types of candidate teas on the touch panel M. Then, user U asked, "What is the difference between this" gyokuro "and" sweet tea "? While muttering, touch the button (not shown) on the touch panel M that says "See the product in detail". Then, a guide video of the target product or the like is displayed on the TV T connected by Miracast and automatically played back. Here, the communication robot 1 begins to explain, such as "What is the difference between" Gyokuro "and" Sweet tea "..." as the moving image is reproduced. Specifically, the communication robot 1 reads aloud the text for product guidance stored and managed in advance in the cloud in accordance with the reproduction of the moving image. The person who reads out the text for product guidance is not limited to the communication robot 1. For example, it may be a narration by a tea producer. User U, who watched the moving image and heard the explanation of Communication Robot 1, said, "Hmm. I see. ▲▲▲ (the name of a famous Japanese sweet) is sweet, but I wonder which tea is better." Ask. Here, although not shown, if the icon written as "Video call ON" is displayed in the mail-order content of the shop (partner company P) displayed on the TV T, it is displayed while it is displayed. You can make a video call with producer A.
When the user U wishes to make a video call with the producer, an incoming call arrives at the partner terminal 3 of the producer A. When Producer A replies, "Hello, this is XX Farm," User U asks, "Hello, I'm thinking of serving sweets to customers. Which tea is better?" Then, Producer A replies, "That's the case ..." and teaches how to make delicious tea. And the call ends. When the video call ends, the communication robot 1 asks, "How was the producer's voice?" Then, User U replies, "I was kindly taught. The stars are five." Then, five star marks are displayed on the touch panel M. As a result, the shop evaluation of XX farm goes up.

Furthermore, at a later date, User U wanted to purchase a new one because the seasonings at home were running low. Then, while looking at the label affixed to the seasoning, he asked Communication Robot 1 "I don't know what to read at all." And called "○ △ × (user U's daughter's name)." I give an instruction. Then, the communication robot 1 makes a video call to the daughter of the user U. When the daughter of user U accepts the video call, the video call is started. User U asks her daughter, "Hello, what's the name? I don't know in English." Then, my daughter suggests, "Well, I don't know. Why don't you ask OO-chan (the name of communication robot 1)?" In response, User U replies, "Yes, I'll ask." After that, the user U shows the seasoning label to the communication robot 1 while asking "OOOO-chan, look at this. Do you know what?" At this time, the captured image of the seasoning label is displayed on the touch panel M. Then, the communication robot 1 searches for the corresponding product by referring to the net information. The communication robot 1 answers the search result by voice. For example, the communication robot 1 touches the three types of products (seasonings) extracted as search results while saying, "There were three similar products in the store. Is there the same one among them?" Display on M. Here, it is assumed that one of the three displayed products (seasonings) is the same product. Then, user U says thank you, "This is this. Thank you." Then, the user U puts the target product (seasoning) in the cart and orders it. The flow from ordering to delivery is as described above.

Next, with reference to FIG. 6, an example of the configuration of the information processing system that enables the service shown in FIG. 5 will be described.
FIG. 6 is a block diagram showing an example of the configuration of an information processing system to which the communication robot of FIG. 5 is applied.

The information processing system shown in FIG. 6 includes a communication robot 1, a management server 2, a partner terminal 3, and a family terminal 4.
The communication robot 1, the management server 2, the partner terminal 3, and the family terminal 4 are connected to each other via a predetermined network N such as the Internet.
In FIG. 6, only one partner terminal 3 and one family terminal 4 are drawn, but this is for easy understanding of the explanation. That is, since a plurality of partner companies P and the like and family F may actually exist, a plurality of partner terminals 3 and family terminals 4 (not shown) may exist, respectively.

The outline of the communication robot 1, the management server 2, and the partner terminal 3 is the same as that of the first embodiment. Therefore, the description of the outline of the communication robot 1, the management server 2, and the partner terminal 3 will be omitted. However, in the first embodiment, the partner terminal 3 is operated by the person in charge of the catalog mail order company E as a partner company, but in the second embodiment, the local producer A and the partner doctor D are further operated. Also operates the partner terminal 3 to use this service.

The family terminal 4 is an information processing device operated by the family F. The family terminal 4 is composed of, for example, a smartphone, a tablet, a personal computer, or the like.

Although not shown here, the hardware configurations of the communication robot 1, the management server 2, the partner terminal 3, and the family terminal 4 of FIG. 5 can basically have the same configuration as that of FIG. Therefore, the description of the hardware configuration of the communication robot 1, the management server 2, the partner terminal 3, and the family terminal 4 in FIG. 5 will be omitted.

By collaborating with various hardware and various software of the communication robot 1 as described above, it becomes possible to execute various processes including the monitoring control process in the communication robot 1. As a result, the service provider G can provide the above-mentioned service to the user U. "Mimamori control process" means the process executed to provide the above-mentioned service.
Hereinafter, among the information processing systems according to the present embodiment, a functional configuration for executing the monitoring control process executed by the communication robot 1 will be described with reference to FIG. 7.

FIG. 7 is a block diagram showing an example of the functional configuration for executing the monitoring control process among the functional configurations of the information processing system including the communication robot of FIG.

As shown in FIG. 4, in the CPU 11 of the communication robot 1, when the execution of the monitoring control process is controlled, the monitoring control unit 107 functions in addition to the functional configuration of FIG. 4 described above.
The functions of the voice input control unit 101, the information acquisition unit 102, the information management unit 103, the voice output control unit 104, the notification control unit 105, and the dialogue support unit 106 are basically the same as those of the first embodiment. Therefore, the description of these functional blocks will be omitted.

The Mimamori control unit 107 supports the family F of the user U to perform the "Mimamori" of the user U in real time by coordinating various functions (dialogue function, video call function, information collecting function) of the communication robot 1. ..

Next, with reference to FIG. 8, a service flow when the user U purchases a product or the like using the communication robot 1 will be described.
FIG. 8 is a flow chart showing a service flow when a user purchases a product or the like using the communication robot of FIG.

The user U can purchase products and the like from the partner company P (supermarket in the example of FIG. 8) only by talking with the communication robot 1. Specifically, first, the person in charge of the partner company P operates the partner terminal 3 to register the products and the like that can be provided in this service (step SS11). The products and the like registered in this service are products that can be purchased by the user U via the communication robot 1.

The user U can select and order a desired product or the like from a plurality of types of products or the like displayed on the touch panel M of the communication robot 1. Specifically, for example, as shown in FIG. 8, products such as "delicious lemon bread", "cooking soy sauce", and "apple village news" are displayed on the touch panel M. Here, when the user U performs an operation of selecting "cooking soy sauce" with a finger or voice, detailed information of "cooking soy sauce" is displayed on the touch panel M. At the same time, the communication robot 1 gives an explanation about "cooking soy sauce". Specifically, a voice explanation such as "It's soy sauce delivered by a long-established XX food! It's perfect for simmered dishes!" Is given. When the user U determines the product or the like to be purchased, the user U performs an operation for ordering the product or the like (step SS12). The operation performed by the user U to order the product or the like may be a voice (for example, a voice saying "Please give me a favor!") Or may be input to the touch panel M. That is, the user U can easily purchase the desired product or the like simply by talking to the communication robot 1 or pressing the touch panel M without inputting the keyboard.

When the operation of ordering the product or the like is performed by the user U, the product or the like is shipped after the person in charge of the partner company P confirms the order contents by telephone (step SS13). In this way, the telephone confirmation is performed before the order is confirmed, so that the user U can prevent an erroneous order.

The user U can receive the products and the like shipped from the partner company P by cash on delivery (cash on delivery) (step SS14). In the example of FIG. 8, cash on delivery is adopted, but the present invention is not limited to this, and any payment method such as credit card payment can be used.

Next, a business model using the communication robot 1 will be described with reference to FIG.
FIG. 9 is an image diagram showing an example of a business model using the communication robot of FIG.

The service provider G can build the following business model, for example.
That is, this service includes a communication robot 1, this cloud, and CRM (Customer Relationship Management) provided by the service provider G.

The partner company P that supports this service pays the service provider G an advertising fee, a service usage fee, and a sales commission for products, etc. As a result, the partner company P can register products and the like in this service and sell them to the user U. In addition, the partner company P can acquire information on sales analysis and sales forecast from CRM.

The user U who uses this service rents the communication robot 1 from the service provider G and pays the service usage fee. As a result, the user U can acquire various useful information (for example, net information) by providing various information to the communication robot 1 and providing information such as an address to the cloud. Further, as described above, the user U can purchase a product or the like from the partner company P only by having a conversation or the like with the communication robot 1.

In this way, the service provider G can obtain the advertising fee, the service usage fee, and the product sales commission from the partner company P through the provision of this service. Further, the service provider G can obtain a service usage fee from the user U through the provision of this service.
Service provider G uses a part of the revenue such as advertising fee, service usage fee, and product sales commission obtained through the provision of this service for the operation cost or development cost of communication robot 1, this cloud, and CRM. By allocating to, it is possible to operate this service while securing profits.

In addition, in this service, for example, the following efforts are made to maintain customer satisfaction and retention rate. That is, the data and contents used in the interactive function are regularly updated and upgraded. In addition, a stable platform will be provided, the frequency of use of user U will be analyzed, and notifications from local governments and partner companies P will be disseminated. Furthermore, in order to foster fans of Communication Robot 1 and increase brand value, original goods will be sold and events will be held.
As a result, the service content can be enhanced by incorporating the company that owns the shopping product and the content as the partner company P.
In addition, since it is possible to personalize each individual user U, the connection between the user U and the society (for example, local producer A, partner company P, other user U, partner doctor D, etc.), user U and family It is possible to maintain each connection with F.
As a result, the customer satisfaction and the retention rate in the user U can be maintained.

Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, and the like within the range in which the object of the present invention can be achieved are included in the present invention. Is.

For example, in the above-described embodiment, the case where the user U is an elderly person living alone is described, but the present invention is not limited to this. For example, a child who is forced to spend time at home due to a long-term closure due to social demand can be a user U. As a result, parents who have no choice but to go out for work can "watch" their children with the communication robot 1. In addition, a patient who is hospitalized in a medical institution or the like without being able to meet his / her family due to being infected with an unknown virus or the like can be designated as a user U. As a result, the patient's family can "watch" the patient with the communication robot 1.

Further, for example, in the above-described embodiment, the family F uses the service by the family-only application, but the present invention is not limited to this. Family F can also access this service by accessing the website dedicated to family F for using this service, which is displayed by the browser function of the family terminal 4.

Further, for example, in FIG. 5, local producer A, partner company P, other user U, family F, Mimamori Center H, and partner doctor D are listed as persons involved in this service in various aspects. However, this is just an example. For example, the local government of the user U or its institution may be included. As a result, the user U can use, for example, at least a part of the administrative services via the communication robot 1.

Further, the system configuration shown in FIGS. 2 and 6, the hardware configuration shown in FIG. 3, and the functional configuration shown in FIG. 4 are merely examples for achieving the object of the present invention, and are not particularly limited.

In other words, the functional configuration shown in FIG. 4 is merely an example and is not particularly limited.
That is, it suffices if the information processing system shown in FIGS. 2 and 6 has a function capable of executing the above-mentioned series of processes as a whole, and what kind of functional block is used to realize this function is particularly important. It is not limited to the examples of FIGS. 4 and 7. Further, the location of the functional block is not particularly limited to FIGS. 4 and 7, and may be arbitrary. For example, the functional block of the communication robot 1 may be transferred to the management server 2, the partner terminal 3, the family terminal 4, or another information processing device (not shown). That is, it is also possible to enable the management server 2 or the like to perform the product purchase support process by the communication robot 1 and the monitoring control process.
Further, one functional block may be configured by a single piece of hardware, a single piece of software, or a combination thereof.

Further, for example, when a series of processes are executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer embedded in dedicated hardware.
Further, the computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose smartphone or a personal computer in addition to a server.

Further, for example, a recording medium containing such a program is not only composed of a removable medium (not shown) distributed separately from the device main body in order to provide the program to the user, but is also preliminarily incorporated in the device main body. It is composed of a recording medium or the like provided to the user in the state.

The recording medium containing such a program is not only composed of the removable media 30 shown in FIG. 3 which is distributed separately from the device main body in order to provide the program to the user, but also in a state of being preliminarily incorporated in the device main body. It is composed of a recording medium or the like provided to the user. The removable media 30 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. The optical disk is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versaille Disk), or the like. The magneto-optical disk is composed of MD (Mini-Disk) or the like. Further, the recording medium provided to the user in a state of being incorporated in the apparatus main body in advance includes, for example, the ROM 12 of FIG. 3 in which the program is recorded, the hard disk included in the storage unit 18 of FIG.

In the present specification, the steps for describing a program recorded on a recording medium are not necessarily processed in chronological order, but also in parallel or individually, even if they are not necessarily processed in chronological order. It also includes the processing to be executed.
Further, in the present specification, the term of the system shall mean an overall device composed of a plurality of devices, a plurality of means, and the like.

Summarizing the above, it is sufficient that the information processing apparatus to which the present invention is applied has the following configuration, and various various embodiments can be taken.
That is, the information processing device to which the present invention is applied (for example, the communication robot of FIG. 1) is
An information processing device connected to a network (for example, network N in FIG. 2).
A voice request for acquisition of information (for example, detailed information of health juice J shown in FIG. 1) by a user (for example, user U in FIG. 1) is voiced (for example, "I want to know more about health juice on page 15" in FIG. ) (Voice input control unit 101 in FIG. 4) and
An acquisition means (information acquisition unit 102 in FIG. 4) for acquiring net information (for example, the net information in FIG. 1) via the network based on the acquisition request by voice.
A voice output means (voice output control unit 104 in FIG. 4) that outputs to the user by voice that the net information has been acquired, and
A notification control means (notification control unit 105 in FIG. 4) that controls notification of the net information to the user, and
To be equipped.

As a result, when the information acquisition request by the user is input by voice, the net information is acquired based on the acquisition request. Then, the acquired net information is output to the user by voice. As a result, when deciding whether or not to purchase a product, the user not only has simple information and price related to the product, but also the place of production, the producer, the seller, the service provider, and others. Various information can be taken into account.

In addition, the acquisition means
As the net information, information necessary for ensuring the safety of the user's life (for example, for the above-mentioned "Mimamori") is acquired, and the information is obtained.
The audio output control means
It is possible to execute a control to output the information acquired as the net information by the acquisition means by voice.

As a result, the information necessary for ensuring the safety of the user's life is acquired and output by voice. As a result, it is possible to realize "Mimamori" for the user.

1 ... Communication robot, 2 ... Management server, 3 ... Partner terminal, 4 ... Family terminal, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Bus, 15 ... Input / output interface, 16 ... Input section, 17 ... Output section, 18 ... Storage section, 19 ... Communication section, 20 ... Drive, 30 ... Removable media , 101 ... voice input control unit, 102 ... information acquisition unit, 103 ... information management unit, 104 ... voice output control unit, 105 ... notification control unit, 181 ... user DB, 182 ... Message DB, G ... Service provider, U ... User, A ... Local producer, P ... Partner company, F ... Family, M ... Mimamori Center, D ... Partner doctor, N ... Network

Claims (2)

An information processing device connected to a network
A voice input control means that executes control for inputting a user's information acquisition request by voice,
An acquisition means for acquiring net information via the network based on the acquisition request by voice.
A voice output control means that executes control to output the acquisition of the net information to the user by voice, and
A notification control means for controlling the notification of the acquired net information to the user, and
Information processing device equipped with. The acquisition means
As the net information, the information necessary for ensuring the safety of the user's life is acquired, and the information is obtained.
The audio output control means
A control for outputting the information by voice, which is acquired as the net information by the acquisition means, is executed.
The information processing device according to claim 1.

Images