TWI659383B - Smart agent method and smart agent robot system - Google Patents

Abstract

The intelligent agent method includes capturing images of at least one customer to generate image data; identifying at least one characteristic of the at least one customer based on the image data; an agent robot communicating with the at least one customer; and based on the message and the at least one characteristic To generate an analysis report.

Description

Intelligent agent method and intelligent agent robot system

The invention describes a smart agent method and a smart agent robot system, especially a personalised smart agent method.

With the rapid development of technology and the Internet, the social model between people has also improved. In recent years, due to the popularity of smart phones and wireless communications, social networks have become an important channel for connecting and making friends. For example, social networking platforms such as Facebook, Twitter, WeChat, Line, etc. that are commonly used in daily life. These social network platforms can be installed in a smart phone or a computer by means of an Application Program, and they all have the function of Instant Messaging transmission. Therefore, when users are online, they can send instant messages to other users through social networking platforms.

In the traditional instant messaging mode of social networks, platform developers of social networks often use automatic answer assistants to respond to simple questions from users or help users get the services or information they need. For example, in an Apple Social Network account (Apple Account), users can obtain basic server-side services and information through the automatic answer assistant SIRI on a smart phone (such as an Apple phone, iPhone). However, since today's auto-response assistants cannot be customized or personalized, they can only respond to some officially set issues. Today's auto-response assistants cannot provide a more accurate response based on the status or profile of the questioner. In addition, since today's auto-response assistants cannot be personalized, it is not possible to use the function of artificial intelligence to temporarily respond to the responder's question.

An embodiment of the present invention provides a smart agent method, which includes capturing an image of at least one customer to generate image data, identifying at least one characteristic of at least one customer based on the image data, and an agent robot communicating information with at least one customer , And generate an analysis report based on the message and at least one characteristic.

Another embodiment of the present invention provides an intelligent agent robot system, which includes a server, an agent robot, a client device, and a database. The server is used to serve web pages. The agent robot is embedded in the webpage and is used to communicate with at least one customer through the instant messaging interface. The client device is connected to the server for browsing the web. The database is linked to a server to record the data of at least one customer. The client device captures the image of at least one customer to generate image data, and the image data is transmitted to the server. The server identifies at least one characteristic of the at least one customer based on the image data, and the agent robot communicates with the at least one customer. The server generates an analysis report based on the message and at least one characteristic.

FIG. 1 is a block diagram of an embodiment of a smart agent robot system 100 according to the present invention. The intelligent agent robot system 100 includes a server 10, a client device 11, a host 12, and a database 13. The server 10 may be a computing device such as a computer, a cloud server, or a workstation. The server 10 can also be regarded as the hardware for setting up a website for a service platform. Therefore, the server 10 has a function of providing a web page of a service platform. The user can browse the webpage content provided by the server 10 by simply typing a specific URL. In addition, the server 10 also has a network function, and can be connected externally to obtain specific computing functions and data backup functions. The client device 11 is connected to the server 10 and may be a device having a communication function such as a personal computer, a tablet computer, or a smart phone. A user (hereinafter referred to as a client) of the client device 11 can browse the webpage content provided by the server 10 on the display surface of the client device 11. The host 12 is connected to the server 10. The host 12 may be any device capable of communication, such as a personal computer, a smart phone, or a tablet computer. The user of the host 12 may be a member of a service platform such as a salesperson of a manufacturer or a salesperson. For a more general description, the person who operates the host 12 is hereinafter referred to as "user". The database 13 is connected to the server 10 for storing data and communication records of at least one client. However, the connection method of the database 13 is not limited by the first figure. For example, the database 13 may also be a database inside the server 10 or a cloud database outside it. The agent robot BOT can be a personalized chat robot for the users (business personnel or marketing personnel) of the host 12. The agent robot BOT is embedded in a web page provided by the server 10 and can communicate with at least one client of the client device 11 through an instant messaging interface. As mentioned above, the intelligent agent robot system 100 may perform communication and interaction behaviors with customers, such as a service inquiry function, an intelligent response function, and an analysis report generation function. In the intelligent agent robot system 100, the client device 11 can capture images of at least one client to generate image data. The image data can be photo data, video data, or video data. After the image data is transmitted to the server 10, the server 10 can identify at least one characteristic of at least one customer based on the image data. In addition, the agent robot BOT can communicate with at least one client, and the server 10 can generate an analysis report based on the communicated message and at least one characteristic. Moreover, the database 13 includes a personal customer relationship management database (Customer Relationship Management, CRM), messages communicated by the agent robot BOT with at least one customer, photos of individuals or family members processed by the server 10 using the face recognition function, And analysis reports can be stored in personal customer relationship management database. Therefore, the user can utilize the customer relationship management database through the management platform provided by the server 10 to maintain, analyze, or manage the data or relationships of at least one customer.

In the intelligent agent robot system 100, the server 10 can support various functions of the agent robot BOT during communication. For example, the server 10 may support an artificial intelligence semantic analysis engine, and may perform semantic disassembly on the message input by the customer to analyze a plurality of keyword meanings. The server 10 can support an image recognition function, which can identify the age characteristics, gender characteristics, facial characteristics, and / or real-time emotional characteristics of at least one client. Furthermore, the server 10 can support a wealth identification function, and can identify the wealth status of at least one customer based on the characteristics of the at least one customer. For example, the database 13 can store various face information and speech patterns of the rich, and the server 10 can determine the approximate wealth status of at least one customer based on the records and face characteristics of the chat between the agent robot BOT and at least one customer . In addition, the server 10 may support an optical character recognition (Optical Character Recognition) function. In other words, when the server 10 receives the image data of at least one customer, it can identify the business card information, driver's license data, identity card data, and / or travel data of at least one customer. The server 10 can recognize the image with text, generate electronic text data, and store the data in the database 13. The functions of the server 10 of the intelligent agent robot system 100 of the present invention using artificial intelligence algorithms can be listed in Table A, as shown below: Visual class Language ability language skills Knowledge Search Computer vision Custom speech recognition Spell check Analysis of academic papers Web search Emotion recognition Speaker recognition Semantic analysis English word association analysis Image search Face recognition Speech recognition engine Understand semantics Interactive search Video search Video identification instant translation Text analysis Recommended features News search Web page English text analysis Auto-recommended search function Table A

FIG. 2 is a schematic diagram of a webpage including the instant messaging interface IMUI of the agent robot BOT in the intelligent agent robot system 100. As mentioned above, the server 10 has a webpage function of providing a service platform. The client only needs to enter a specific URL to browse the webpage content provided by the server 10 through the client device 11. In FIG. 2, the interface UI of the server 10 presents web page content. The content of this webpage may be a personal webpage of a user (a salesperson or a salesperson) of the host 12. For example, the web page content presented by the interface UI of the server 10 includes a region T1 and a region T2. The area T1 can display the background pattern of the user's business card and a photo sticker. The area T2 can display the user's personal information, such as the user's gender, mobile phone, email address, birthday, phone, social network account and nickname, and so on. The space under area T2 can display user introductions, personal qualifications, and related articles. When customers want to ask questions and want to communicate with users, they can use IMUI to communicate with users. In the instant messaging interface IMUI, a customer corresponds to a customer image A, and a user corresponds to a user image B. When the customer asks a question, the input text of the customer's question will be displayed next to the customer image A. In addition, users can use IMUI to input response text. When the user enters the response text, the user response B is displayed next to the user image B. However, as mentioned above, the agent robot BOT of the intelligent agent robot system 100 of the present invention may be a personalized chat robot for a user (a salesperson or a salesperson). Under the condition of the artificial intelligence function of the server 10, the agent robot can communicate with the customer instead of the user. For example, when the user is not online, the agent robot can perform the function of communicating with the customer. In other words, even if the user is not online, the agent robot BOT will automatically generate a response text next to the user image B, and the customer's question using the IMUI of the instant messaging interface will definitely get a response. Therefore, the agent robot BOT of the intelligent agent robot system 100 has the function of directly interviewing and communicating with customers. In addition to reducing the labor consumption, it can also increase the effectiveness of interaction with customers. In addition, the instant messaging interface IMUI can be any application interface with real-time chat, such as the platform development interface of the server 10, the Facebook Messenger interface, or the chat interface connected to Line, and so on. Any reasonable change in hardware or software is within the scope of the present invention.

The agent and analysis functions of the intelligent agent robot system 100 will be described below with an embodiment. As mentioned earlier, the agent robot BOT can be a personalised, dedicated agent secretary for a business person. It is assumed that this salesperson is a salesperson in the insurance industry. First, the server 10 can obtain image data of at least one client, such as a family portrait photo, through the client device 11. The server 10 uses the image recognition function to identify the characteristics of each family member in the photo of the family portrait. For example, the age characteristics, gender characteristics, and facial characteristics of each family member. If the photo of the family portrait contains a text image, the server 10 may also recognize the text image using the aforementioned optical character recognition function. In other words, the server 10 can automatically collect identity information and kinship of each family member. For example, if the optical character recognition function recognizes the text image of the ID card, the server 10 can obtain the names and relationships of family members according to the text recognition result of the ID card. In addition, the text and messages communicated between the agent robot BOT and customers (family members) will be semantically disassembled by artificial intelligence. The server 10 can generate a family-style recommended insurance policy from the identity information, kinship, and semantics of each family member. In addition, when the customer information of the database 13 is sufficient, the server 10 can also automatically classify the hobbies and lifestyle habits of the customer group, so that the policy or analysis report finally generated can be more accurate. In the intelligent agent robot system 100, for business personnel, although family members (customers) are not online when asking questions or chatting through the IMUI interface, however, because family members (customers) can use the IMUI interface IMUI Interview and communicate with the agent robot BOT (virtual agent of business personnel, or virtual personal secretary), so it can still handle insurance inquiries and related analysis needs of family members (customers), so it can greatly save manpower of business personnel Consume. In addition, business personnel can also use the host computer 12 (for example, their own smartphone or computer) to log in to the service platform member of the server 10, that is, they can browse the customer's data and receive the log messages transmitted by the agent robot BOT.

In the intelligent agent robot system 100, each user has its own agent robot BOT. In addition to naming the agent robot BOT, it can also be edited to make the agent robot BOT automatically execute according to the schedule Various actions. For example, the user can set a certain time or holiday to send a specific greeting card, and the agent robot BOT will send the greeting card information to the client device 11 according to a preset schedule. In addition, the operation mode of the agent robot BOT of the present invention is not limited by the foregoing implementation benefits. For example, when the customer cannot contact the user, the customer can directly click on the business card advertisement to start the IMUI communication with the agent robot BOT. Therefore, this fully automated and intelligent agent approach can increase the efficiency of developing customers and reduce labor consumption.

FIG. 3 is a flowchart of a smart agent robot system 100 executing a smart agent method. The smart agent method includes steps S301 to S304. Any reasonable step change belongs to the scope disclosed by the present invention. Steps S301 to S304 are described below. Step S301: Capture images of at least one customer to generate image data; Step S302: Identifying at least one characteristic of at least one customer based on the image data; Step S303: The agent robot BOT communicates with at least one customer; Step S304: Generate an analysis report based on the message and at least one characteristic.

Steps S301 to S304 have been described in the foregoing embodiments, so they will not be described again here. The intelligent agent robot system 100 can implement an automated intelligent agent function according to steps S301 to S304. In addition to enabling immediate responses to questions from customers and potential customers, it can also reduce the human burden on users (members on the service platform, business staff, etc.).

In summary, the present invention describes a smart agent robot system and a smart agent method. The server of the intelligent agent robot system has the function of artificial intelligence, which can support the agent robot on its platform webpage to perform various communication capabilities, semantic analysis and image recognition capabilities. The agent robot can be an automatic chat robot in the form of a database, and uses the instant messaging interface in the webpage to communicate with customers. Agent robots can also be considered personal robots. Users of each service platform member can have their own named robots. Therefore, the agent robot can be regarded as the user's exclusive service secretary. In addition to chatting with customers, it also integrates functions such as sending greeting cards and inquiries and responses to customers. Therefore, the intelligent agent of the present invention can increase the efficiency of developing customers and reduce labor consumption. The above description is only a preferred embodiment of the present invention, and all equivalent changes and modifications made in accordance with the scope of patent application of the present invention shall fall within the scope of the present invention.

 100  Intelligent Agent Robot System  10  Server  11  Client device  12  Host  13  database  BOT  Agent robot  UI  Interface  T1 and T2  Area  IMUI  Instant messaging interface  A  Customer image  B  Proxy robot image  S301 to S304  Steps

FIG. 1 is a block diagram of an embodiment of a smart agent robot system according to the present invention. FIG. 2 is a schematic diagram of a web page including an instant messaging interface of the agent robot in the intelligent agent robot system of FIG. 1. FIG. 3 is a flowchart of the intelligent agent robot system in FIG. 1 executing the intelligent agent method.

Claims (11)

An intelligent agency method includes: capturing an image of at least one customer to generate image data; identifying at least one characteristic of the at least one customer based on the image data; and based on the at least one characteristic of the at least one customer, Generate a relative relationship corresponding to the at least one customer; an agent robot communicates a message with the at least one customer; and generate the at least one customer ’s based on the semantic content of the message and the at least one characteristic of the at least one customer A wealth state; and generating a family-type recommended insurance policy based on the kinship of the at least one client, the semantic content of the message, and the wealth state; wherein the agent robot is a humanized agent robot exclusively for a business person, It is used to temporarily communicate with the at least one customer on behalf of the salesperson when the salesperson is offline. The method of claim 1, wherein the at least one characteristic comprises an age characteristic, a gender characteristic, a facial characteristic, and / or an instant emotional characteristic. The method according to claim 1, wherein the agent robot communicates the message with the at least one client, the agent robot communicates the message with the at least one client by using an Instant Messaging interface. The method according to claim 1, further comprising: using an optical character recognition (Optical Character Recognition) technology to identify the business card information, driver's license information, identity card information and / or travel information of the at least one customer. The method according to claim 4, further comprising: storing the data of the at least one customer identified by the optical character in a database. The method according to claim 1, further comprising: using an artificial intelligence semantic analysis engine to semantically disassemble the message to analyze a plurality of keyword meanings. An intelligent agent robot system includes: a server for providing a webpage; and an agent robot embedded in the webpage for temporarily acting on behalf of a businessperson through an instant messaging interface when the businessperson is offline. Communication with at least one client; a client device connected to the server for browsing the webpage; and a database connected to the server for recording data of the at least one client; wherein the client device Capture an image of the at least one customer to generate image data, the image data is transmitted to the server, and the server identifies at least one characteristic of the at least one customer based on the image data, and according to the at least one customer's The at least one characteristic generates a kinship corresponding to the at least one customer. The agent robot is a humanized agent robot exclusively for the salesperson, and is used to communicate a message with the at least one customer, according to the semantic content of the message And the at least one characteristic of the at least one customer, generating a wealth status of the at least one customer, and according to the The kinship of a customer, the semantic content of the message and the wealth of the state, generate a family of recommended policies. The system according to claim 7, wherein the server uses an Optical Character Recognition technology to identify the business card information, driver's license information, identity card information, and / or travel information of the at least one customer, and Deposited into the database. The system according to claim 7, further comprising: a host connected to the server for providing a user to browse the information of the at least one client and receive a log message transmitted by the agent robot. The system according to claim 7, wherein the database includes a customer relationship management database owned exclusively by a person, the message communicated by the agent robot with the at least one customer, and the server processes the information using a face recognition function. A photo of a person or family member and the analysis report are stored in the customer relationship management database exclusively for the individual. The system of claim 10, wherein a user uses the customer relationship management database to maintain, analyze, or manage the data or relationships of the at least one customer through a management platform provided by the server.