CN111429263B

CN111429263B - Robot information interaction method, device, server and system

Info

Publication number: CN111429263B
Application number: CN202010199475.3A
Authority: CN
Inventors: 代品宣; 黄华; 周院平; 孙信中; 矫人全
Original assignee: Nanjing Aoto Electronics Co ltd
Current assignee: Nanjing Aoto Electronics Co ltd
Priority date: 2019-12-11
Filing date: 2020-03-20
Publication date: 2024-04-26
Anticipated expiration: 2040-03-20
Also published as: CN111429263A

Abstract

The invention relates to a robot information interaction method, a robot information interaction system, a robot information interaction device and a robot information interaction server. The robot performs information interaction with the network terminal equipment through the remote server and the intermediate server. The intermediate server participates in establishing a communication link, performs time coding on the screened suitable content, and instructs the website terminal equipment to switch the display content. The remote server participates in establishing a communication link, retrieving client information, classifying clients, and screening out suitable content and matched corpus. The third party staff can supervise and control the robot through the remote server. The robot explains the content displayed on the screen of the network point terminal equipment by playing the matched corpus. The method and the device improve the working efficiency and the working accuracy of the robot, enable the robot to provide the service with richer content and more accurate content for clients, and improve the working efficiency and the working effect of the website terminal equipment.

Description

Robot information interaction method, device, server and system

Technical Field

The present invention relates to the field of robots, and in particular, to a method, an apparatus, a server, and a system for information interaction of a robot.

Background

The intelligent banking outlets are based on the conventional banking business, and help the banking to optimize and innovate business processes through the mobile network and the intelligent equipment, so that communication and connection with clients are enhanced, the business efficiency of the banking is improved, and cost and risk are reduced.

The intelligent banking outlets are provided with intelligent banking equipment such as interactive advertisement screens, noble metal 3D display cabinets, map house watching screens, backdrop, entrance guards and the like. The bank robot is a key device of an intelligent banking website, and the robot can autonomously obtain external environment signals according to map information stored in the robot or according to a sensor to plan a moving path and move to a target point along the moving path without manual intervention. In the robot tour process, the robot is interconnected and interacted with intelligent banking equipment, a novel intelligent banking website marketing system is built, visual sense and technological experience of banking clients are improved, intelligent modes are opened by banking websites, and website performance is improved.

The prior art discloses a robot interaction method and a system, wherein the robot interaction method comprises the following steps: the service request triggered by the user comprises the identification of the interactive service selected by the user; according to the corresponding relation of the information acquisition mode of the identification service; activating an information acquisition mode corresponding to the identification of the interactive service selected by the user; acquiring interactive information of a user through an activated information acquisition mode; the robot processes the interacted information to complete the service request. The application requirements of user interaction are realized through the robot, and the use mode of the robot is expanded. The robot is used as an information interaction main body, and the receiving module, the activating module, the acquiring module and the processing module are all arranged in the robot, are not provided with slave equipment, and are combined with a scene applied to an intelligent bank.

The prior art also discloses a headquarter collaborative operation management center, a user online system, a city financial system, a living API integrated system and a banking website online management system, which can realize the online marketing mobile marketing and management of the banking website, supplement the traditional operation channel of the bank, realize a novel client obtaining mode, lead the bank to get rid of the existing development bottleneck and bring the preparation of software and hardware for the new financial era. The system is wider, and the technical problems of large interactive data volume, more data interaction servers and network point terminal equipment and limited load caused by various working types, deep content layers and complex logic relations between robots and network point terminal equipment are not solved. The prior art fails to realize intelligent interaction between the robot and intelligent bank hall equipment, and does not realize accurate marketing to bank clients in daily banking sites, so that the intelligent bank hall intelligent robot is not suitable for daily work scenes of intelligent banking sites.

Disclosure of Invention

Aiming at the technical problems, the invention aims to overcome the defects and shortcomings in the prior art and provide an information interaction method, device, server and system of a robot. The robot performs information interaction with the network terminal equipment through the remote server and the intermediate server. The intermediate server participates in establishing a communication link, performs time coding on the screened suitable content, and instructs the website terminal equipment to switch the display content. The remote server participates in establishing a communication link, retrieving client information, client classification, client characteristics and screened suitable content, and screening matched corpus suitable for the content. And a third party worker can monitor and control the robot through the remote server, including explaining the content displayed on the screen of the website terminal equipment by playing the configured corpus. Through reasonable division of labor, the working efficiency and the working accuracy of the robot are improved, and the working efficiency and the working effect of the network point terminal equipment are improved.

In order to achieve the above purpose, the present invention adopts the following technical scheme:

In a first aspect, an embodiment of the present application provides an information interaction method for a robot, including:

Step 1, a robot acquires face information of a visiting client by using a camera and sends the face information to a remote server, receives client information called by the remote server, classifies clients, prompts the clients to select client features and screened suitable content, and simultaneously sends the client features and the screened suitable content to an intermediate server;

Step 2, the robot receives a selection result sent by a client and sends the selection result to the remote server, and simultaneously the robot sends an instruction for establishing a communication link with the network point terminal equipment to the intermediate server, and the remote server establishes a communication link with the network point terminal equipment through the intermediate server;

step 3, the robot receives the instruction of the website terminal equipment, judges whether the instruction content is to guide the client to the appointed position, if so, the robot guides the client to the appointed position, then the robot enters the next step, and if not, the robot directly enters the next step;

Step 4, the robot calls an interface opened by the network point terminal equipment according to a communication protocol, and the screened suitable content in the network point terminal equipment after time coding by the intermediate server is obtained;

and 5, receiving and playing matched corpus of the screened suitable content from the remote server by the robot, and instructing the website terminal equipment to synchronously play or delay play according to the setting by the intermediate server according to the time code.

Preferably, the method for guiding the client to the designated position by the robot in the step 3 includes:

the robot brings the client to tour to a specified position;

the robot judges whether the target position point is safe and reachable;

If yes, the step 4 robot calls an interface opened by the network point terminal equipment according to a communication protocol, and the screened suitable content in the network point terminal equipment after time coding by the intermediate server is obtained;

if not, the robot selects a second position point and judges whether the second position point is safe and reachable;

If not, the robot stops in situ, the step of calling the interface opened by the network point terminal equipment by the robot according to the communication protocol is carried out, and the screened suitable content in the network point terminal equipment after the time coding is carried out by the intermediate server is obtained.

Preferably, the screened suitable content comprises advertising programs; the website terminal equipment is intelligent banking website terminal equipment.

In a second aspect, an embodiment of the present application provides an information interaction method of a remote server, where the method includes:

Step 1, a remote server displays the dialogue between a client and a robot; the customer may be a banking customer;

Step 2, the remote server displays the face information of the client acquired by the robot, and invokes the client information, the client classification, the client characteristics and the screened suitable content;

Step 3, the remote server transmits the client information, the client classification, the client characteristics and the screened suitable content to the robot;

step 4, the remote server sends the matched corpus of the screened suitable content to the robot;

step 5, after the robot finishes playing the matched corpus, the remote server instructs the robot to inquire whether a client has a wish to select another screened suitable content again, and if so, the next step is carried out; if not, ending the service;

and 6, the remote server provides service contents possibly needed by the client for the robot to select and receives the selection result sent by the robot.

In a third aspect, an embodiment of the present application provides an information interaction method of an intermediate server, where the method includes:

step 1, an intermediate server receives an instruction for establishing a communication link with a network point terminal device sent by a robot, sends an instruction for opening a call interface to the network point terminal device, and establishes and operates the communication links of the robot, the intermediate server and the network point terminal device;

Step 2, the intermediate server receives client information transmitted by the robot, client classification, client characteristics and screened suitable content;

Step 3, the intermediate server performs time coding on the screened suitable content and sends the screened suitable content subjected to the time coding to the network point terminal equipment;

and 4, the intermediate server sends an instruction to the network point terminal equipment to switch the display content of the network point terminal equipment.

Preferably, the method for running the communication links of the robot, the intermediate server and the network point terminal equipment comprises the following steps:

Step 1, when an intermediate server is started, TCP CLIENT is used for connecting terminal services; before, enabling TCP SERVER service by the network terminal equipment;

Step 2, when the intermediate server is started, starting Web Socket Server services, and when the robot is started, connecting the intermediate server by using Web Socket Client;

Step3, the intermediate server circularly monitors the issued screen cutting instruction request and distributes the screen cutting instruction request to different intelligent bank terminal devices according to the device type;

Step 4, the intermediate server receives the instruction execution result returned by the network point terminal equipment, the intermediate server returns the instruction execution result to the robot according to the communication link, and the robot uploads the instruction execution result to the remote server;

step 5, the intermediate server receives the instruction of calling the robot from the network terminal equipment, and notifies the robot to move to the target position point according to the communication link, and after the robot moves to the target position point, the intermediate server broadcasts the content under the control of the remote server; the website terminal equipment comprises an interactive screen.

In a fourth aspect, an embodiment of the present application provides an information interaction method of a mesh point terminal device, where the method includes:

Step 1, receiving an instruction which is transmitted by an intermediate server and is transmitted by a remote server to establish a communication link with a network point terminal device;

step 2, receiving the filtered suitable content after time coding sent by the intermediate server;

step 3, the instruction robot judges whether the instruction content is guiding the client to the appointed position;

Step 4, receiving an interface opened by the robot according to the communication protocol and calling the network terminal equipment, and sending the screened suitable content after the time coding to the robot through a remote server;

and step 5, receiving an intermediate server instruction, and switching the display content of the network point terminal equipment.

Preferably, the information interaction method of the website terminal equipment is characterized in that the website terminal equipment comprises screen interaction equipment and multidimensional display equipment, wherein the screen interaction equipment and the multidimensional display equipment are advertisement display equipment, and the safe interaction equipment is intelligent electrical equipment in an intelligent banking scene; the website terminal equipment is intelligent banking website terminal equipment; the network point terminal equipment uses player software which is developed by mixing Web Browser controls of an HTML front end and a Win Form; the player is used for loading the HTML webpage and realizing advertisement display of the bank financial product.

In a fifth aspect, an embodiment of the present application provides an information interaction device for a robot, including:

the acquisition module is used for acquiring the face information of the visited client and sending the face information to the remote server;

The receiving and transmitting module is used for transmitting the acquired face information of the visited clients to the remote server, receiving client information which is called by the remote server, classifying clients, and selecting the client characteristics and the screened suitable content; receiving a selection result sent by a client; transmitting the selection result to a remote server; calling the opened calling interface in the network terminal equipment to acquire the time code of the playing content of the network terminal equipment; receiving matched corpus of the screened suitable content from a remote server;

The judging module is used for judging whether the screened suitable content needs to guide the client to the appointed position;

the processor is used for running the Android system; synchronously playing the selected suitable content in the network terminal equipment according to the time code or carrying out delayed playing according to the setting; the driving interaction screen is used for man-machine interaction;

The time management module is used for synchronously playing the screened suitable content in the network terminal equipment according to the time code or carrying out delayed playing according to the setting; the driving interaction screen is used for man-machine interaction;

The storage module is used for storing the matched corpus of the screened suitable content;

the motion module is used for driving the rotating speed and the coordination direction of universal wheels positioned on the motion chassis;

the voice recognition module is used for recognizing voices in the man-machine conversation;

the face recognition module is used for recognizing the face attribute of the client;

The sound input and output module is used for controlling the loudspeaker to broadcast corpus and/or emit sound by the robot; sound input is made through a microphone.

In a sixth aspect, an embodiment of the present application provides an information interaction apparatus of a remote server, where the apparatus includes:

The display module is used for displaying the dialogue between the client and the robot; displaying the face information of the client acquired by the robot;

The calculation analysis module is used for classifying the fetched client information and screening out suitable contents according to the client characteristics;

the processor is used for retrieving the client information; after the robot finishes playing the matched corpus, indicating the robot to inquire whether a client has a wish of selecting the other screened suitable content again;

The receiving and transmitting module is used for transmitting the screened suitable content to the robot; the matched corpus is also used for sending the screened suitable content; the selection result sent by the robot is also received;

And the selection module is used for providing service contents possibly needed by the client for the client to select.

In a seventh aspect, an embodiment of the present application provides an information interaction apparatus of an intermediate server, where the apparatus includes:

The processor is used for forming an instruction of opening a calling interface sent to the network point terminal equipment; forming an instruction for switching the display content of the network point terminal equipment sent to the network point terminal equipment;

The receiving and transmitting module is used for receiving an instruction of establishing a communication link with the network terminal equipment, which is sent by the remote server; sending an instruction for opening and calling an interface to the network point terminal equipment; receiving the screened suitable content transmitted from a remote server; the screened suitable content after the time coding is sent to the network terminal equipment; sending an instruction to the network point terminal equipment to switch the display content of the network point terminal equipment;

The storage module is used for selecting the suitable content transmitted from the remote server; the matched corpus is also used for storing the screened suitable content;

the computing module is used for carrying out time coding on the screened suitable content;

and the communication module is used for establishing and operating communication links of the robot, the intermediate server and the network point terminal equipment.

In an eighth aspect, an embodiment of the present application provides an information interaction apparatus of a mesh point terminal device, where the apparatus includes:

the receiving and transmitting module is used for receiving an instruction of an open call interface sent by the intermediate server; sending a time code of the play content to the robot; receiving an instruction of an intermediate server to establish a communication link of the robot, the intermediate server and the network point terminal equipment; receiving an instruction for switching the display content of the website terminal equipment sent by the intermediate server;

The processor is used for receiving the call interface which is already opened by the robot call and receiving and executing the instruction sent by the intermediate server to switch the display content of the website terminal equipment; executing an instruction for establishing a communication link between the robot, the intermediate server and the network point terminal equipment;

The playing module is used for the mixed development of the player software for the Web Browser control of the HTML front end and the Win Form; the player is used for loading an HTML webpage and realizing advertisement display of bank financial products;

the storage module is used for storing the screened suitable content;

And the display control module is used for displaying the play content, including displaying or displaying on the screen interaction equipment and/or the advertisement display equipment.

In a ninth aspect, an embodiment of the present application provides a robot including: the information interaction device of the robot; or the information interaction method of the robot is realized.

In a tenth aspect, an embodiment of the present application provides an intermediate server, including: the information interaction device of the intermediate server; or the information interaction method of the intermediate server is realized.

In an eleventh aspect, an embodiment of the present application provides a remote server, the server including: the information interaction device of the remote server; or the information interaction method of the remote server is realized.

In a twelfth aspect, an embodiment of the present application provides a mesh point terminal device, including: the information interaction device of the network point terminal equipment; or the information interaction method of the network point terminal equipment is realized.

In a thirteenth aspect, an embodiment of the present application provides a remote server, where the remote server includes a processor and a machine-readable storage medium storing machine executable instructions capable of being executed by the processor, where the processor executable instructions, when invoked and executed by the processor, cause the processor to implement an information interaction method of a remote server according to an embodiment of the present application.

In a fourteenth aspect, an embodiment of the present application provides an intermediate server comprising a processor and a machine-readable storage medium storing machine-executable instructions executable by the processor, which when invoked and executed by the processor, cause the processor to: the information interaction method of the intermediate server is achieved.

In a fifteenth aspect, an embodiment of the present application provides an information interaction system of a robot, including: the information interaction device of the robot, the information interaction device of the remote server, the information interaction device of the intermediate server and the information interaction device of the network point terminal equipment.

In view of the foregoing, the present invention relates to a method, a system, a device and a server for information interaction of a robot. The robot performs information interaction with the network terminal equipment through the remote server and the intermediate server. The intermediate server participates in establishing a communication link, performs time coding on the screened suitable content, and instructs the website terminal equipment to switch the display content. The remote server participates in establishing a communication link, retrieving client information, classifying clients, and screening out suitable content and matched corpus. The third party staff can supervise and control the robot through the remote server. The robot explains the content displayed on the screen of the network point terminal equipment by playing the matched corpus. The method and the device improve the working efficiency and the working accuracy of the robot, enable the robot to provide the service with richer content and more accurate content for clients, and improve the working efficiency and the working effect of the website terminal equipment.

In the scheme provided by the embodiment of the application, compared with the prior art, the application has the following beneficial effects: the information interaction method and the information interaction device for the robot provided by the application realize that the robot participates in enterprise network point service work efficiently and rapidly. The information interaction method and the device of the robot are applied to intelligent banking sites, so that the robot is used for marketing various banking products, the service efficiency of the banking sites is greatly improved, the customer satisfaction degree of the banking sites is increased, the technical problems of multiple kinds of banking site products, deep content level, large calculation amount, difficult information communication between customer demands and banking service personnel and low communication efficiency can be solved, and the customer can obtain service support from a remote server or an intermediate server respectively according to different requirements of the problem or service function through the banking site terminal equipment, thereby solving the technical problem that the robot is limited by memory and data operation, and further greatly improving the service accuracy and service efficiency of the robot.

The information interaction method and the information interaction device of the remote server solve the technical problems that the network point terminal equipment has various varieties, different functions and complex contents, and people cannot fully grasp all contents in a short time to respond to client consultation or transact business. According to the information interaction method and device for the remote server, disclosed by the invention, the robot is assisted to complete the service with large calculation amount and high operation environment requirement, and the information interaction is performed with the intermediate server, so that the operation speed and accuracy of the robot are improved, and a third party can manage and control the robot. The information interaction method and the information interaction device of the remote server are beneficial to unified management control of the network point terminal equipment and introduction of the third party platform for monitoring, evaluating and controlling service contents, safe operation and working quality of the robot and the network point terminal equipment, so that the working efficiency of the robot and the network point terminal equipment is improved, and the satisfaction degree of clients is improved.

The information interaction method and the information interaction device of the intermediate server can solve the technical problems that the network point terminal equipment cannot fully exert the value of the existing data under the existing network point terminal equipment system, the robots and the banking network point terminal equipment, the third party service system are redundant in data, slow to operate and few in abutting customer demand windows. The technical problems that the data interaction amount among the network terminal equipment, the remote server and the robot is large and the data interaction is restricted by the load are solved through scientific division of labor.

The network point terminal equipment is connected with the robot and the remote server through the intermediate server, so that separation of equipment objects, communication modes and communication protocols is realized. The network terminal equipment sends the filtered suitable content after the time coding to the robot through a remote server; according to the time code, the robot instructs the network point terminal equipment to synchronously play or to delay playing according to the setting through the intermediate server; the net point terminal equipment can also accept the customer requirement, actively call the robot, and enable the robot to tour to a specified position point for commodity explanation. The robot can call the interface of the network point terminal equipment and switch the display content of the screen of the network point terminal equipment. The information interaction method and the information interaction device of the network point terminal equipment improve the working efficiency of the robot, enable the robot to interact with the network point terminal equipment rapidly and accurately, enable the robot and the network point terminal equipment to provide services for clients together, and improve the working efficiency and the service effect.

The robot information interaction system provided by the invention comprises a robot, a remote server, an intermediate server and network terminal equipment, and solves the technical problems of various service contents, information lag and time and labor waste in searching during manual service; the problem that a single robot is limited by memory and load and can not quickly and efficiently provide various consultation or business services with rich contents and large data interaction amount for clients is solved; the robot is participated in network work, a large amount of manual labor is replaced, the labor cost is saved, and a third party can use a remote server to monitor and control the robot.

In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Drawings

FIG. 1 is a flow chart of a method for information interaction of a robot according to an embodiment of the invention;

FIG. 2 is a flow chart of a method of information interaction of a robot according to yet another embodiment of the present invention;

FIG. 3 is a flowchart of a method for information interaction of a remote server according to an embodiment of the present invention;

FIG. 4 is a flowchart of an information interaction method of an intermediate server according to an embodiment of the present invention;

FIG. 5 is a flow chart of a method of information interaction for a mesh point terminal device according to an embodiment of the present invention;

FIG. 6 is a flow chart of a method of information interaction for a robot according to yet another embodiment of the present invention;

Fig. 7 is a schematic structural diagram of an information interaction device of a robot according to an embodiment of the present invention;

FIG. 8 is a schematic diagram illustrating an information interaction device of a remote server according to an embodiment of the present invention;

FIG. 9 is a schematic diagram illustrating an information interaction device of an intermediate server according to an embodiment of the present invention;

Fig. 10 is a schematic structural diagram of an information interaction device of a mesh point terminal device according to an embodiment of the present invention.

Detailed Description

In order that the above-recited objects, features and advantages of the present application will be more clearly understood, a more particular description of the application will be rendered by reference to the appended drawings and appended detailed description. The embodiments of the present application and the features in the embodiments may be combined with each other without collision. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.

Referring to fig. 1, fig. 1 is a flowchart of a method for information interaction of a robot according to an embodiment of the invention, the method includes:

Step S100, the robot acquires the face information of the visiting client by using a camera and sends the face information to a remote server, receives the client information called by the remote server, classifies the client, prompts the client to select the client by using the client characteristics and the screened suitable content, and simultaneously sends the client to an intermediate server;

specifically, the robot docking intermediate server can set the equipment type and the equipment number in the JSON character string according to the communication protocol, and the intermediate server searches the connected network point terminal equipment according to the equipment type and the equipment number.

Step S102, a robot receives a selection result sent by a client and sends the selection result to the remote server, and simultaneously, the robot sends an instruction for establishing a communication link with a network point terminal device to the intermediate server, and the remote server establishes a communication link with the network point terminal device through the intermediate server;

Step S104, the robot receives the instruction of the website terminal equipment, judges whether the instruction content is to guide the client to the appointed position, if so, carries out the step S104', the robot guides the client to the appointed position, then enters the next step, if not, directly enters the next step;

specifically, the website terminal device can be an interactive advertisement screen, and can call the robot to explain advertisement content besides the function of advertisement display;

Step S106, the robot calls an interface opened by the network point terminal equipment according to a communication protocol, and the screened suitable content in the network point terminal equipment after time coding by the intermediate server is obtained;

specifically, the robot sends out an interface instruction for calling the opening of the network point terminal equipment according to the communication protocol, so as to realize the switching of the display content of the network point terminal equipment; the screened suitable content comprises advertising programs; the website terminal equipment is intelligent banking website terminal equipment;

And the robot acquires advertisement content played by the website terminal equipment and the time progress of playing the advertisement content according to the communication protocol. So that the robot searches the remote server to acquire the matched explanation corpus of the advertisement content of the website terminal equipment. And the robot explains the advertisement of the net point terminal equipment according to the time schedule.

And S108, the robot receives and plays matched corpus of the screened suitable content from the remote server, and instructs the website terminal equipment to play synchronously or delay play according to the setting through the intermediate server according to the time code.

The content played by the website terminal equipment is advertisement content selected by the user on the robot.

The information interaction method and the information interaction device of the robot can be applied to the construction of a bank website marketing system, and the robot can replace a hall manager to conduct the recommendation and consultation answering work of the bank financial products in an intelligent bank scene. The robot can explain various service contents of the bank to the client by switching the contents displayed in the advertisement screen and complete information interaction with the client, so that the workload of a bank worker is reduced, and the working efficiency of the bank is improved.

Referring to fig. 2, fig. 2 is a flowchart of a method for information interaction of a robot according to another embodiment of the present invention, the method includes:

the robot guiding the client to the designated location in step S104' of fig. 1 includes the following steps:

Step S1040, the robot leads the client to tour to a specified position;

specifically, the designated position is a target position point, and can be set to be located opposite to the advertisement screen.

Step S1042, the robot judges whether the target position point is safe and reachable;

If yes, the step S1050 is carried out, the robot calls an interface opened by the network point terminal equipment according to the communication protocol, and the screened suitable content in the network point terminal equipment after the time coding by the intermediate server is obtained;

If not, go to step S1044 to select a second location point by the robot;

Specifically, the robot determines whether the target position point can be reached by its own ultrasonic sensor and infrared sensor. If not, stay beside the target location point. The target position point may be set aside to a second position point, which is a limit position to which the robot can move to approach the target position point.

Step S1046, judging whether the second location point is safe and reachable;

If not, stopping the robot in place in the step S1048, and then calling an interface opened by the network point terminal equipment by the robot in the step S1050 according to a communication protocol to acquire the screened suitable content in the network point terminal equipment after time coding by the intermediate server;

Step S1050, the robot calls an interface opened by the network point terminal equipment according to a communication protocol, and the screened suitable content in the network point terminal equipment after time coding by the intermediate server is obtained; the step S1050 is the step S106 shown in fig. 1.

Specifically, the specified position may be a position at which the commodity is viewed; for example, when the specified location is occupied, the robot selects a second location; when the second position is not available, the robot executes to stop in situ, and calls an interface opened by the network point terminal equipment according to a communication protocol by the robot in step S106 of FIG. 1, so as to obtain the screened suitable content in the network point terminal equipment after time coding by the intermediate server; the system setting module can be used for setting the number of the judging positions, such as whether the third position point is safe and reachable, of the robot when the judging result of judging whether the second position point is safe and reachable is NO; if not, the robot selects a third position point and judges whether the third position point is safe and reachable; the number of the continued selection judgment positions is, for example, set to sequentially judge to an nth position point;

If yes, the robot in step S106 of FIG. 1 calls an interface opened by the network terminal equipment according to the communication protocol, and the screened suitable content in the network terminal equipment after time coding by the intermediate server is obtained;

If not, the robot is stopped in place, and the robot calls the interface opened by the website terminal device according to the communication protocol in step S106 of fig. 1, so as to obtain the screened suitable content in the website terminal device after the time coding by the intermediate server.

Referring to fig. 3, fig. 3 is a flowchart of a method for information interaction of a remote server according to an embodiment of the invention, the method includes:

Step S300, a remote server displays the dialogue between a client and a robot; the customer may be a banking customer;

The utterances of the client's query robot are uploaded to a remote server for display. The robot answers are automatically produced and issued by the remote server. The process of issuing can be divided into an automatic mode and a manual mode. And in a manual mode, a customer service person clicks a key to issue the control corpus of the robot.

Step S302, a remote server displays the face information of the client acquired by the robot, and invokes the client information, the client classification, the client characteristics and the screened suitable content;

Specifically, the steps of retrieving the client information, classifying the clients, screening the suitable content include retrieving and outputting a program list by a remote server according to the gender and age of the clients by adopting a fuzzy search method, and screening the program content suitable for the clients. The remote server can comprise a control webpage of the robot, an Android mobile phone client and an IOS mobile phone client. The remote server can be used for controlling robot movement, corpus configuration, corpus issuing, and third party weather docking, news and music servers. Customer service personnel can realize the whole-course monitoring of all actions of the robot through the remote server. Generally, a robot system is divided into a cloud and a terminal. The cloud may be the remote server.

In order to realize the active welcome reception of the robot and the active marketing recommendation of the robot, the robot needs to recognize the face of the client and add the face to the database of the remote server, and the sex, the age, the occupation and the like are added when the robot comes for the first time. The clients are classified according to VIP and general. The favorite advertisement content of the customer is added in the database for marketing recommendation.

Step S304, the remote server transmits the client information, the client classification, the client characteristics and the screened suitable content to the robot;

the remote server's screening structure is advertising content for that customer, which is sent to the robot.

Step S306, the remote server sends the matched corpus of the screened suitable content to the robot;

The matched corpus is configuration corpus of advertisement content obtained from a remote server after the robot walks to the position of the interactive screen and inquires the playing progress of the interactive screen.

Step S308, after the robot finishes playing the matched corpus, the remote server instructs the robot to inquire whether a client has a wish to select another screened suitable content again, and if so, the next step is carried out; if not, go to step S312 to end the service;

In step S310, the remote server provides the service content that may be needed by the client to the robot, so as to allow the client to select and receive the selection result sent by the robot.

Specifically, the remote server participates in man-machine conversation, and the remote server operates and includes displaying the face information of the client collected by the robot, calling the client information, classifying the client, selecting the client characteristics and the selected suitable content, and selecting the matched corpus of the suitable content. The background visual content comprises, by a remote server: robot control web page, android mobile phone client and IOS mobile phone client. The website equipment terminal comprises a display screen, wherein the display screen comprises an interactive display screen, and a client can actively call the robot through the interactive display screen to enable the robot to tour to a specified position point for explanation.

The remote server can be applied to network point terminal equipment, including self-service equipment, unmanned network points, unmanned shops, intelligent home network points and intelligent office network point terminal equipment. In intelligent banking field, site terminal equipment includes, and financing marketing screen, noble metal 3D show cupboard, map see the room screen, show the backdrop of banking financing product, perhaps the equipment of baking off financing product atmosphere. The remote server comprises a method for realizing information interaction between a robot and a remote server, an intermediate server and a website terminal device through a cloud; the remote server also comprises various mobile client devices, such as mobile phones, capable of accessing the network, for realizing the information interaction method with the robot, the intermediate server and the online store terminal device.

Referring to fig. 4, fig. 4 is a flowchart of an information interaction method of an intermediate server according to an embodiment of the invention, the method includes:

step S400, the intermediate server receives an instruction for establishing a communication link with the network point terminal equipment sent by the robot, sends an instruction for opening and calling an interface to the network point terminal equipment, and establishes and operates the communication links of the robot, the intermediate server and the network point terminal equipment;

Step S402, an intermediate server receives client information transmitted from a robot, client classification, client characteristics and screened suitable content;

step S404, the intermediate server performs time coding on the screened suitable content and sends the screened suitable content subjected to the time coding to the network terminal equipment;

The time code is the playing progress of the advertisement content currently being played on the interactive screen. Such as the progress of the video playing, or the order of the picture advertisements.

Step S406, the intermediate server sends an instruction to the network point terminal equipment to switch the display content of the network point terminal equipment.

Specifically, the robot switches the display content of the interactive screen through the communication link of the intermediate server. The advertisement content can be mainly advertisement content, or can be door control or the like.

In another embodiment of the information interaction method of the intermediate server, the step S400 further includes:

Step S390, when the intermediate server is started, a robot login service interface is started;

Step S392, when the intermediate server is started, connecting network point terminal equipment, such as service interfaces of screen interaction equipment, safety interaction equipment and multidimensional display equipment;

Step 394, the intermediate server receives a service interface reserved by the robot by using the intermediate server, and logs in the intermediate server;

Step S396, the intermediate server runs the communication links of the robot, the intermediate server and the network point terminal equipment.

The establishment of the communication link is established upon power-on. And the intermediate server runs WinForm software, and the configuration file comprises a communication mode and a communication protocol of the connected equipment.

In another embodiment of the information interaction method of the intermediate server, the method for operating the communication link of the robot, the intermediate server and the website terminal device includes:

Step S4000, when the intermediate server is started, TCP CLIENT is used for connecting terminal services; before, enabling TCP SERVER service by the network terminal equipment;

step S4002, when the intermediate server is started, starting Web Socket Server the service, and when the robot is started, connecting the intermediate server by using Web Socket Client;

step S4004, the intermediate server circularly monitors the issued screen cutting instruction request and distributes the screen cutting instruction request to different intelligent bank terminal devices according to the device type;

step S4006, the intermediate server receives the instruction execution result returned by the network point terminal equipment, the intermediate server returns the instruction execution result to the robot according to the communication link, and the robot uploads the instruction execution result to the remote server;

Specifically, the website terminal equipment returns an instruction execution result to the intermediate server, and the intermediate server returns the instruction execution result to the robot according to the communication link;

Step S4008, the intermediate server receives an instruction of calling the robot from the website terminal equipment, and notifies the robot to move to a target position point according to the communication link, and after the robot moves to the target position point, the intermediate server broadcasts the content under the control of the remote server;

Specifically, the website terminal equipment sends an instruction of calling the robot to an intermediate server, and the intermediate server informs the robot to move to a target position point according to a communication link, and after the robot moves to the target position point, the content is broadcasted under the control of a remote server; for example, information of a banking product is broadcasted for selling or recommending financial products to customers; the website terminal equipment comprises an interactive screen.

The intermediate server reserves a plurality of common communication modes such as RS232, 485, modbus, TCP, HTTP, UDP, web Socket and the like on software, and expands reserved space of the network point terminal equipment; the website terminal equipment can also instruct the robot to finish the actions of switching on and off a lamp, switching on and off an entrance guard, queuing and taking numbers and the like through a remote server. In the participation of the intermediate server, the robot can send a request to switch the display content of the interactive screen; the robot can broadcast corpus aiming at the content of the interactive screen. The intermediate server can greatly increase the variety and the number of the network terminal devices, thereby improving the working efficiency of the robot and the office efficiency of the network terminal devices. Through the contact function of the intermediate server, the technical problem of contradiction between limited server space and calculated amount of the robot is solved, so that the working efficiency of the robot is improved, and the office efficiency of the network point terminal equipment is improved.

The information interaction method and the information interaction device of the intermediate server can be applied to intelligent banking terminal equipment, and the robot is used for recommending banking financial products in a high-efficiency manner instead of manpower. Personalized marketing can be performed for bank clients, so that the bank work efficiency is improved.

Robots in banking sites operate in an extranet environment. The intelligent banking terminal equipment works in the intranet environment of the bank. Because if the robot is directly docked with the terminal device of the intelligent banking site, the robot does not meet the relevant regulations of the banking site. Meanwhile, the banking terminal devices are numerous and various in interface form, so that an intermediate server is necessary to be introduced in the process of docking with the robot, the intermediate server docks the intelligent banking terminal devices, and a calling interface is opened according to a communication protocol for the robot to access. According to the information interaction method and device of the intermediate server, provided by the invention, the service level and service efficiency of a bank are improved on the premise of ensuring the safety of the intranet of the bank.

Referring to fig. 5, fig. 5 is a flowchart of a method for information interaction between a network terminal device according to an embodiment of the present invention, where the method includes:

Step S500, receiving an instruction which is transmitted by the intermediate server and is transmitted by the remote server to establish a communication link with the network point terminal equipment;

step S502, the filtered suitable content after time coding sent by an intermediate server is received;

step S504, the instruction robot judges whether the instruction content is guiding the client to the appointed position;

Step S506, the interface opened by the robot according to the communication protocol is called by the receiving robot, and the filtered suitable content after the time coding is sent to the robot through a remote server;

step S508, receiving the instruction of the intermediate server, and switching the display content of the network point terminal equipment.

Specifically, the website terminal equipment comprises screen interaction equipment and multidimensional display equipment, wherein the screen interaction equipment and the multidimensional display equipment are advertisement display equipment, and the safe interaction equipment is intelligent electrical equipment in an intelligent banking scene; the website terminal equipment is intelligent banking website terminal equipment; the network point terminal equipment uses player software which is developed by mixing Web Browser controls of an HTML front end and a Win Form; the player is used for loading the HTML webpage and realizing advertisement display of the bank financial product.

Specifically, the information interaction method and the information interaction device of the website terminal equipment can be applied to the field of intelligent banking. The intelligent banking terminal equipment comprises a queuing machine, an ATM, a navigation table and an advertisement screen. The terminal equipment of the website can be used for enabling robots to switch the display screen of the terminal equipment of the website, such as financial marketing screen to switch stock information, fund information, noble metal 3D display cabinet to switch gold bricks, gold coins and other information, baking financial product atmosphere, backdrop to switch scene atmosphere or applying a map to look at a house to switch map of a city, so that personalized marketing can be carried out for bank clients, and the bank working efficiency is improved.

Fig. 6 is a flowchart of a method for information interaction of a robot according to still another embodiment of the present invention, the method including:

s802, the robot acquires face information of a visiting client by using a camera;

S804, the robot sends face information of the visiting client;

s806, the remote server displays the dialogue between the client and the robot;

S808, the robot sends an instruction for establishing a communication link with the network point terminal equipment to the intermediate server;

s810, the remote server displays the face information of the client acquired by the robot, and invokes the client information, classifies the client, and selects the client characteristics and the screened suitable content;

S812, the remote server sends the client information, the client classification, the client characteristics and the screened suitable content to the robot;

S814, the remote server establishes a communication link with the network point terminal equipment through the intermediate server;

s816, the intermediate server responds to the remote server instruction and establishes a communication link with the network point terminal equipment;

S818, the robot sends the client information called by the remote server, the client classification, the client characteristics and the screened suitable content to the intermediate server;

s820, the intermediate server performs time coding on the screened suitable content;

s822, sending the filtered suitable content after time coding;

s824, the robot receives the instruction of the website terminal equipment and judges whether the instruction content is guiding the client to the appointed position;

S826, if yes, guiding the client to the appointed position, and then carrying out the next step, if no, directly carrying out the next step;

S828, the robot calls an interface opened by the network point terminal equipment according to a communication protocol, and the screened suitable content of the network point terminal equipment after the time coding is obtained;

s830, the network terminal equipment sends the filtered suitable content after the time coding to the robot through a remote server;

s832, screening matched corpus suitable for content by a remote server;

s834, the robot receives and plays the matched corpus;

s836, according to the time code, the robot instructs the network terminal equipment to play synchronously or to play in a delayed mode according to the setting through the intermediate server;

s838, the intermediate server instructs the screen terminal equipment to switch the display content of the screen terminal equipment;

S840, the network terminal equipment switches the display content;

S842, the remote server instructs the robot to inquire whether the client has a wish to select another screened suitable content again;

S844, if yes, carrying out the next step, and if no, ending the service;

s846, the server provides service contents possibly needed by the client to the robot for the client to select;

s848, the robot sends the selection result of the client.

Specifically, before the step S802, the method further includes: the method comprises the steps that a robot, a remote server, an intermediate server and network point terminal equipment establish a communication link; secondly, the robot recognizes that a client arrives, actively performs welcome reception, or actively calls the robot by the client, wherein the client actively calls the robot comprises clicking the robot on a screen controller; the intermediate server searches an online robot according to the communication chain and forwards a call instruction to the robot; the robot forwards the call instruction to a remote server; after receiving the call instruction forwarded by the robot, the remote server displays call content on a display screen, determines the responding robot and issues a robot tour instruction; and the robot receives the tour instruction to tour to the appointed position point.

Specifically, the step S804, the sending, by the robot, of the face information of the visiting client, further includes:

The method comprises the steps that a robot sends face parameters of a client to a remote server;

secondly, the remote server identifies parameters such as the name, age and the like of the client; the remote server broadcasts 'honored client XXX yougood' to clients;

thirdly, the robot and the client perform normal man-machine conversation, and the man-machine conversation content is uploaded to a remote server;

The fourth step, the remote server screens out the interested program content of the client according to the client's sentences in the dialogue sentences, the client's commands, the client's selections and the client's facial features, such as gender and age; the remote server issues a program list to the robot for display, and the program is selected by the client;

fifthly, the robot transmits the program selected by the client to the network terminal equipment for display through the communication link;

Step six, the robot inquires whether the client needs to take the client to the position of the website terminal equipment and inquires whether the content of the website terminal equipment is explained;

Seventh, the client selects that the robot brings the client to the site terminal equipment. And performing an eighth step. If not, the client enters an eleventh step;

eighth step, the robot searches the content playing progress of the current website terminal equipment through a communication link;

ninth, the robot searches matched corpus of current playing progress from a remote server through a communication link;

tenth, according to the current playing progress, the robot explains the matched corpus;

and eleventh, the robot continues to perform man-machine conversation with the client, and the third step is repeated.

The fourth step further includes: the remote server judges whether the voice command of the user is an entrance guard switch (lamp) according to the voice dialogue of the client, and judges whether the user has permission to enter the entrance guard or the lamp through the face characteristics;

the remote server issues an instruction for opening and closing the entrance guard to the robot, and a client selects whether to open the entrance guard;

If the client selects the gate inhibition, the robot sends a control instruction to the gate terminal equipment through a communication link, and the gate terminal equipment executes the gate inhibition opening and closing action;

the robot inquires about the action of opening and closing the entrance guard, and the voice broadcast tells the client of the opening and closing result of the entrance guard (lamp). Guiding the customer to move to the door access (light) area.

The information interaction method and the system of the robot are suitable for daily work scenes of intelligent banking sites, and intelligent interaction between the robot and intelligent banking site terminal equipment is realized. The invention can be used for accurately marketing bank clients in daily work of banking outlets; the method can be used for constructing a banking website marketing system, and in an intelligent banking scene, a robot can replace a hall manager to recommend and market the bank financial products. The robot information interaction method and the system are applied to the intelligent bank product marketing field, can improve the service efficiency of banking sites, increase the customer satisfaction of the banking sites, improve the working efficiency of robots and banking site terminal equipment and the accuracy of service content, and improve the working efficiency and the working accuracy of the banking sites.

The robot and remote server are closely dependent. The robot can realize functions of welcome reception, motion control, singing, dancing, tour explanation and the like by relying on a remote server. The intermediate server and the network terminal equipment are added for realizing the screen cutting interaction of the robot and constructing the whole solution of the intelligent bank. And the network terminal equipment starts, not only realizes the function of advertisement display and lamp switching, but also starts a monitoring service to monitor the connection request of the intermediate server. And the intermediate server is started, namely, the intermediate server is connected with the network terminal equipment according to the configuration file, and the monitoring service of the robot is started. And the robot is connected with the intermediate server according to the configuration file as soon as the robot is started. If the intermediate server cannot be connected, the robot periodically and circularly connects the intermediate server. The communication links of the remote server, the robot, the intermediate server and the network point terminal equipment are actively established when the power is started. The latter types of communication requests are based on established communication links. The display screen is switched to display the content, so that the method can be used for switching advertisement content and carrying out marketing explanation in cooperation with a robot; the robot can carry out daily management work of banking sites such as entrance guard, lamps and lanterns, and site terminal equipment can acquire the switch state of current lamps and lanterns, entrance guard, and the robot is further communicated with the guide to the customer. The intelligent network point terminal equipment moves the calling robot to a designated position through a communication link. After the robot walks to the appointed position, inquiring the content playing progress of the website terminal equipment, and acquiring matched corpus of the website terminal equipment from a remote server. The client can call the robot by the network terminal equipment through one key; the network terminal equipment realizes that the calling robot moves to a designated position through a communication link, and finally, the information interaction among the robot, the remote server, the intermediate server and the network terminal equipment in the intelligent banking network working environment is realized, thereby better serving the banking clients, improving the working efficiency of the banking and reducing the working load of the banking staff.

Referring to fig. 7, fig. 7 is a schematic structural diagram of an information interaction device 10 of a robot according to an embodiment of the invention, the device includes:

the acquisition module 12 is used for acquiring the face information of the visited client and sending the face information to the remote server;

The transceiver module 14 is configured to send the acquired face information of the visited client to a remote server, and receive client information, client classification, client characteristics and screened suitable content that are retrieved by the remote server; receiving a selection result sent by a client; transmitting the selection result to a remote server; calling the opened calling interface in the network terminal equipment to acquire the time code of the playing content of the network terminal equipment; receiving matched corpus of the screened suitable content from a remote server;

a judging module 16, configured to judge whether the screened suitable content needs to guide the client to a specified location;

The time management module 18 is configured to perform synchronous playing with the screened suitable content in the website terminal device according to the time code or perform delayed playing according to a setting; the driving interaction screen is used for man-machine interaction;

The storage module 20 is used for storing the matched corpus of the screened suitable content;

the motion module 22 is used for driving the rotating speed and the coordination direction of universal wheels positioned on the motion chassis;

a voice recognition module 24 for recognizing voices in the man-machine conversation;

A face recognition module 26 for recognizing the face attribute of the client;

A sound input and output module 28 for controlling the speaker for the robot to broadcast corpus and/or to emit sound; sound input is made through a microphone.

Fig. 8 is a schematic structural diagram of an information interaction device 29 of a remote server according to an embodiment of the present invention; the device comprises:

a display module 30 for displaying a dialogue between a client and a robot; displaying the face information of the client acquired by the robot;

The calculation and analysis module 32 is used for classifying the fetched client information and screening out suitable content according to the client characteristics;

A processor 34 for retrieving customer information; after the robot finishes playing the matched corpus, indicating the robot to inquire whether a client has a wish of selecting the other screened suitable content again;

A transceiver module 36, configured to send the screened suitable content to a robot; the matched corpus is also used for sending the screened suitable content; the selection result sent by the robot is also received;

the selection module 38 is configured to provide service contents that may be required by the customer for the customer to select.

Fig. 9 is a schematic structural diagram of an information interaction device 39 of an intermediate server according to an embodiment of the present invention; the device comprises:

a processor 40 for forming an instruction of an open call interface issued to the mesh point terminal device; forming an instruction for switching the display content of the network point terminal equipment sent to the network point terminal equipment;

A transceiver module 42 for receiving an instruction from a remote server to establish a communication link with a website terminal device; sending an instruction for opening and calling an interface to the network point terminal equipment; receiving the screened suitable content transmitted from a remote server; the screened suitable content after the time coding is sent to the network terminal equipment; and sending an instruction to the network point terminal equipment to switch the display content of the network point terminal equipment.

A storage module 44 for the screened suitable content from the remote server; the matched corpus is also used for storing the screened suitable content;

A calculation module 46 for time-encoding said screened suitable content,

And the communication module 48 is used for establishing and running communication links of the robot, the intermediate server and the network point terminal equipment.

Fig. 10 is a schematic structural diagram of an information interaction device 49 of a website terminal device according to an embodiment of the present invention; the device comprises:

The transceiver module 50 is configured to receive an instruction that the intermediate server issues an open call interface; sending a time code of the play content to the robot; receiving an instruction of an intermediate server to establish a communication link of the robot, the intermediate server and the network point terminal equipment; and receiving an instruction of switching the display content of the network point terminal equipment sent by the intermediate server.

The processor 52 is configured to receive the call interface that has been opened by the robot call, and receive and execute an instruction sent by the intermediate server to switch the display content of the website terminal device; executing the instruction of establishing the communication links of the robot, the intermediate server and the network point terminal equipment.

The playing module 54 is used for the mixed development of the player software for the Web Browser control of the HTML front end and the Win Form; the player is used for loading the HTML webpage and realizing advertisement display of the bank financial product.

A storage module 56, configured to store the screened suitable content;

The display control module 58 is configured to display the play content, including on a screen interactive device and/or an advertisement presentation device.

An embodiment of the present application provides a robot including: the information interaction device of the robot; or the information interaction method of the robot is realized.

The embodiment of the application provides an intermediate server, which comprises: the information interaction device of the intermediate server; or the information interaction method of the intermediate server is realized.

The embodiment of the application provides a remote server, which comprises: the information interaction device of the remote server; or the information interaction method of the remote server is realized.

The embodiment of the application provides a network point terminal device, which comprises: the information interaction device of the network point terminal equipment; or the information interaction method of the network point terminal equipment is realized.

The embodiment of the application provides an information interaction system of a robot, which comprises the following components: the information interaction device of the robot, the information interaction device of the remote server, the information interaction device of the intermediate server and the information interaction device of the network point terminal equipment.

In one embodiment of the present application, a remote server is provided, including a processor and a machine-readable storage medium storing machine-executable instructions capable of being executed by the processor, which when invoked and executed by the processor, cause the processor to implement an information interaction method of a remote server according to an embodiment of the present application.

In one embodiment of the application, an intermediate server is provided that includes a processor and a machine-readable storage medium storing machine-executable instructions executable by the processor that, when invoked and executed by the processor, cause the processor to: the information interaction method of the intermediate server is achieved.

The components/modules/units of the system/computer apparatus integration, if implemented as software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, the present invention may also be implemented by implementing all or part of the flow of the method of the above embodiment, or by instructing the relevant hardware by a computer program, where the computer program may be stored in a computer readable storage medium, and where the computer program, when executed by a processor, may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable storage medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. It should be noted that the computer readable medium contains content that can be appropriately scaled according to the requirements of jurisdictions in which such content is subject to legislation and patent practice, such as in certain jurisdictions in which such content is subject to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.

In the several embodiments provided herein, it should be understood that the disclosed systems and methods may be implemented in other ways. For example, the system embodiments described above are merely illustrative, e.g., the division of the components is merely a logical functional division, and additional divisions may be implemented in practice.

In addition, each functional module/component in the embodiments of the present invention may be integrated in the same processing module/component, or each module/component may exist alone physically, or two or more modules/components may be integrated in the same module/component. The integrated modules/components described above may be implemented in hardware or in hardware plus software functional modules/components.

It will be evident to those skilled in the art that the embodiments of the invention are not limited to the details of the foregoing illustrative embodiments, and that the embodiments of the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive, the scope of embodiments being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is evident that the word "comprising" does not exclude other elements or steps, and that the singular does not exclude a plurality. A plurality of units, modules or means recited in a system, means or terminal claim may also be implemented by means of software or hardware by means of one and the same unit, module or means. The terms first, second, etc. are used to denote a name, but not any particular order.

The above examples illustrate only a few embodiments of the invention, which are described in detail and are not to be construed as limiting the scope of the invention. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the invention, which are all within the scope of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.

Claims

1. An information interaction method of a robot, the method comprising:

Step A1, a robot collects face information of a visiting client by using a camera and sends the face information to a remote server, receives client information called by the remote server, classifies clients, prompts the client to select client characteristics and screened suitable content, and simultaneously sends the client information to an intermediate server;

A2, the robot receives a selection result sent by a client and sends the selection result to the remote server, and simultaneously, the robot sends an instruction for establishing a communication link with the network point terminal equipment to the intermediate server, and the remote server establishes a communication link with the network point terminal equipment through the intermediate server;

A3, the robot receives the instruction of the website terminal equipment, judges whether the instruction content is to guide the client to the appointed position, if so, the robot guides the client to the appointed position, then the robot enters the next step, and if not, the robot directly enters the next step;

Step A4, the robot calls an interface opened by the network point terminal equipment according to a communication protocol, and the screened suitable content in the network point terminal equipment after time coding by the intermediate server is obtained;

Step A5, the robot receives and plays matched corpus of the screened suitable content from the remote server, and instructs the website terminal equipment to play synchronously or delay play according to the setting through the intermediate server according to the time code;

The method for guiding the client to the appointed position by the robot in the step A3 comprises the following steps:

the robot brings the client to tour to a specified position;

the robot judges whether the target position point is safe and reachable;

if yes, the step A4 robot calls an interface opened by the network point terminal equipment according to a communication protocol, and the screened suitable content in the network point terminal equipment after time coding by the intermediate server is obtained;

if not, the robot stops in situ, the step A4 of calling an interface opened by the network point terminal equipment according to a communication protocol by the robot, and the screened suitable content in the network point terminal equipment after time coding by the intermediate server is obtained;

the screened suitable content comprises advertising programs; the website terminal equipment is intelligent banking website terminal equipment;

The information interaction method of the remote server comprises the following steps:

step B1, a remote server displays the dialogue between a client and a robot; the customer is a banking customer;

Step B2, the remote server displays the face information of the client acquired by the robot, and invokes the client information, the client classification, the client characteristics and the screened suitable content;

Step B3, the remote server transmits the client information, the client classification, the client characteristics and the screened suitable content to the robot;

step B4, the remote server sends the matched corpus of the screened suitable content to the robot;

step B5, after the robot finishes playing the matched corpus, the remote server instructs the robot to inquire whether a client has a wish to select another screened suitable content again, and if so, the next step is carried out; if not, ending the service;

step B6, the remote server provides service contents possibly needed by a client for the robot to select and receives a selection result sent by the robot;

The information interaction method of the intermediate server comprises the following steps:

Step C1, an intermediate server receives an instruction for establishing a communication link with the network point terminal equipment, which is sent by the robot, sends an instruction for opening and calling an interface to the network point terminal equipment, and establishes and operates the communication links of the robot, the intermediate server and the network point terminal equipment;

Step C2, the intermediate server receives client information transmitted from the robot, client classification, client characteristics and screened suitable content;

step C3, the intermediate server performs time coding on the screened suitable content and sends the screened suitable content subjected to the time coding to the network point terminal equipment;

Step C4, the intermediate server sends an instruction to the network point terminal equipment to switch the display content of the network point terminal equipment;

The method for operating the communication links of the robot, the intermediate server and the network point terminal equipment comprises the following steps:

Step D1, when the intermediate server is started, TCP CLIENT is used for connecting terminal services;

Step D2, when the intermediate server is started, starting Web Socket Server the service, and when the robot is started, connecting the intermediate server by using Web Socket Client;

step D3, the intermediate server circularly monitors the issued screen cutting instruction request and distributes the screen cutting instruction request to different intelligent bank terminal devices according to the device type;

step D4, the intermediate server receives the instruction execution result returned by the network point terminal equipment, the intermediate server returns the instruction execution result to the robot according to the communication link, and the robot uploads the instruction execution result to the remote server;

step D5, the intermediate server receives the instruction of calling the robot from the network point terminal equipment, and notifies the robot to move to the target position point according to the communication link, and after the robot moves to the target position point, the intermediate server broadcasts the content under the control of the remote server; the network point terminal equipment comprises an interactive screen;

The network point terminal information interaction method comprises the following steps:

E1, receiving an instruction which is transmitted by an intermediate server and is transmitted by a remote server to establish a communication link with a network point terminal device;

e2, receiving the filtered suitable content after time coding sent by the intermediate server;

E3, the instruction robot judges whether the instruction content is guiding the client to the appointed position;

e4, receiving an interface opened by the robot according to the communication protocol and calling the network terminal equipment, and sending the screened suitable content after the time coding to the robot through a remote server;

e5, receiving an intermediate server instruction, and switching display contents of the network point terminal equipment;

the network point terminal equipment comprises screen interaction equipment and multidimensional display equipment, wherein the screen interaction equipment and the multidimensional display equipment are advertisement display equipment, and the safe interaction equipment is intelligent electrical equipment in an intelligent bank scene; the website terminal equipment is intelligent banking website terminal equipment; the network point terminal equipment uses player software which is developed by mixing Web Browser controls of an HTML front end and a Win Form; the player is used for loading an HTML webpage and realizing advertisement display of bank financial products;

The robot information interaction device comprises:

The sound input and output module is used for controlling the loudspeaker to broadcast corpus and/or emit sound by the robot; sound input is performed through a microphone;

the information interaction device of the remote server comprises:

the selection module is used for providing service contents possibly needed by a customer for the customer to select;

the information interaction device of the intermediate server comprises:

the communication module is used for establishing and operating communication links of the robot, the intermediate server and the network point terminal equipment;

the information interaction device of the network point terminal equipment comprises:

the storage module is used for storing the screened suitable content;