CN110610249A - Information processing method, information display method, device and service terminal - Google Patents

Information processing method, information display method, device and service terminal Download PDF

Info

Publication number
CN110610249A
CN110610249A CN201810621641.7A CN201810621641A CN110610249A CN 110610249 A CN110610249 A CN 110610249A CN 201810621641 A CN201810621641 A CN 201810621641A CN 110610249 A CN110610249 A CN 110610249A
Authority
CN
China
Prior art keywords
user
service
order
business
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810621641.7A
Other languages
Chinese (zh)
Inventor
陈耀轩
袁丹兰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201810621641.7A priority Critical patent/CN110610249A/en
Publication of CN110610249A publication Critical patent/CN110610249A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/02Reservations, e.g. for tickets, services or events
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/12Hotels or restaurants
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/08Speech classification or search

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • Marketing (AREA)
  • Theoretical Computer Science (AREA)
  • Human Resources & Organizations (AREA)
  • Health & Medical Sciences (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Primary Health Care (AREA)
  • General Health & Medical Sciences (AREA)
  • Development Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the application provides an information processing method, an information display device and a service terminal. Detecting that a user is located in an induction range of a service terminal, and generating an induction signal; responding to the induction signal, and collecting user voice information; determining an object selection instruction according to the user voice information; wherein the object selection instruction comprises at least one object identification; based on the object selection instruction, the first business order can be automatically generated. In the embodiment of the application, the selection of the service object can be realized by adopting a voice form, and the service order is automatically generated.

Description

Information processing method, information display method, device and service terminal
Technical Field
The embodiment of the application relates to the technical field of computer application, in particular to an information processing method, an information display device and a service terminal.
Background
In many offline service places, such as catering places, where business objects are offered for sale, customers often need to select business objects according to their own needs and inform sellers, and sellers offer needed business objects according to information such as business object names provided by the customers.
In order to facilitate stock preparation, object settlement and the like, a business order is often generated according to information such as a business object name provided by a customer, and a seller can provide a business object required by the corresponding customer and perform final settlement and the like according to the business order.
Taking a catering place as an example, a business order is also a food order, and a traditional ordering mode is usually generated by manually recording a special service staff according to a name of a food provided by a customer, so that the efficiency is low.
Disclosure of Invention
The embodiment of the application provides an information processing method, an information display device and a service terminal, and aims to solve the technical problem that in the prior art, service execution efficiency is low.
In a first aspect, an embodiment of the present application provides an information processing method, including:
detecting that a user is located in an induction range of a service terminal to generate an induction signal;
responding to the induction signal, and collecting user voice information;
determining an object selection instruction according to the user voice information; wherein the object selection instruction comprises at least one object identification;
and generating a first business order based on the object selection instruction.
In a second aspect, an embodiment of the present application provides an information processing method, including:
acquiring biological information of a user and identifying the biological information of the user to obtain a user identifier;
determining an object identifier of at least one target business object corresponding to the user identifier;
collecting user voice information;
and generating a second business order by combining the object identification of the at least one target business object and the user voice information.
In a third aspect, an embodiment of the present application provides an information display method, including:
providing a service interaction interface;
displaying service prompt information for executing service operation on the service interaction interface;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
In a fourth aspect, an embodiment of the present application provides an information processing method, including:
detecting that a user is located in an induction range of the ordering terminal to generate an induction signal;
responding to the induction signal, and collecting user voice information;
determining a meal selection instruction according to the user voice information; wherein the meal selection instruction comprises at least one meal name;
and generating a first food order based on the food selection instruction.
In a fifth aspect, an embodiment of the present application provides an information processing method, including:
acquiring biological information of a user and identifying the biological information of the user to obtain a user identifier;
determining the name of at least one target food corresponding to the user identification;
collecting user voice information;
and generating a second food order by combining the name of the at least one target food and the user voice information.
In a sixth aspect, an embodiment of the present application provides an information display method, including:
providing an ordering interactive interface;
displaying service prompt information for executing service operation on the ordering interactive interface;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
In a seventh aspect, an embodiment of the present application provides an information processing apparatus, including:
the detection module is used for detecting that the user is positioned in the sensing range of the service terminal and generating a sensing signal;
the first response module is used for responding to the induction signal and acquiring user voice information;
the first identification module is used for determining an object selection instruction according to the user voice information; wherein the object selection instruction comprises at least one object identification;
and the first order generation module is used for generating a first business order based on the object selection instruction.
In an eighth aspect, an embodiment of the present application provides an information processing apparatus, including:
the acquisition module is used for acquiring user biological information and user voice information;
the third identification module is used for identifying biological information of the user to obtain a user identifier;
the object determining module is used for determining the object identifier of at least one target business object corresponding to the user identifier;
and the second order generation module is used for generating a second business order by combining the object identifier of the at least one target business object and the user voice information.
In a ninth aspect, an embodiment of the present application provides an information display apparatus, which provides a service interaction interface;
the service interaction interface is used for displaying service prompt information for executing service operation;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
In a tenth aspect, an embodiment of the present application provides a service terminal, including a processing component, a storage component, a detection component, and a pickup component;
the storage component stores one or more computer program instructions; the one or more computer program instructions for invocation and execution by the processing component;
the processing component is to:
detecting that the user is positioned in the sensing range of the service terminal through the detection assembly to generate a sensing signal;
responding to the induction signal, starting the pickup assembly to collect voice information of a user;
determining an object selection instruction according to the user voice information; wherein the object selection instruction comprises at least one object identification;
and generating a first business order based on the object selection instruction.
In an eleventh aspect, an embodiment of the present application provides a service terminal, including a processing component, a storage component, a detection component, and a pickup component;
the storage component stores one or more computer program instructions; the one or more computer program instructions for invocation and execution by the processing component;
the processing component is to:
acquiring biological information of a user through the detection assembly and identifying the biological information of the user to obtain a user identifier;
determining an object identifier of at least one target business object corresponding to the user identifier;
collecting voice information of a user through the pickup assembly;
and generating a second business order by combining the object identification of the at least one target business object and the user voice information.
In a twelfth aspect, an embodiment of the present application provides a service terminal, including a processing component, a storage component, and a display component;
the storage component stores one or more computer program instructions; the one or more computer program instructions for invocation and execution by the processing component;
the processing component is to:
providing a service interaction interface through the display component;
the service interaction interface is used for displaying service prompt information for executing service operation;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
In the embodiment of the application, a user is detected to be positioned in an induction range of a service terminal, and an induction signal is generated; responding to the induction signal, and collecting user voice information; according to the user voice information, an object selection instruction input by the user voice can be recognized; wherein the object selection instruction comprises at least one object identification; based on the object selection instruction, the first business order can be automatically generated. In the embodiment of the application, the selection of the service object can be realized by adopting a voice form, and the service order is automatically generated, so that the service execution efficiency is improved, and the user experience is improved.
These and other aspects of the present application will be more readily apparent from the following description of the embodiments.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a flow chart illustrating one embodiment of an information processing method provided herein;
FIG. 2 is a flow chart illustrating a further embodiment of an information processing method provided by the present application;
FIG. 3 is a flow chart illustrating a further embodiment of an information processing method provided by the present application;
FIG. 4 is a flow chart illustrating a further embodiment of an information processing method provided by the present application;
FIG. 5 is a flow chart illustrating a further embodiment of an information display method provided by the present application;
6 a-6 e respectively show interface display diagrams of the embodiment of the application in a practical application;
FIG. 7 is a schematic diagram illustrating an embodiment of an information processing apparatus provided herein;
FIG. 8 is a schematic diagram illustrating an information processing apparatus according to yet another embodiment of the present disclosure;
fig. 9 is a schematic structural diagram illustrating an embodiment of a service terminal provided in the present application;
fig. 10 is a schematic structural diagram illustrating a service terminal according to another embodiment of the present application;
fig. 11 is a schematic structural diagram illustrating a service terminal according to still another embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
In some of the flows described in the specification and claims of this application and in the above-described figures, a number of operations are included that occur in a particular order, but it should be clearly understood that these operations may be performed out of order or in parallel as they occur herein, the number of operations, e.g., 101, 102, etc., merely being used to distinguish between various operations, and the number itself does not represent any order of performance. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.
The technical scheme of the embodiment of the application can be suitable for off-line service places for selling business objects, such as catering places, wherein the catering places can be hotels, restaurants or convenience stores for providing beverages, sweets, fast food and the like.
In these offline service places, a user needs to select a business object for consumption, taking a dining place as an example, that is, needs to order, at present, a service person usually manually records and generates a food order according to the user requirement, and then delivers the food order to a stock person such as a kitchen to prepare food for the user. The food order comprises consumption information, and after the user finishes dining, the user settles accounts with the seller according to the food order. Service personnel usually adopt traditional paper pen record form or carry out the record with the help of electronic equipment such as meal ordering ware, and this kind of mode not only wastes manpower resources but also the efficiency of ordering is slower, leads to the user experience of having dinner not good. Although the food ordering device can be delivered to the user at present, the user orders food, and then the user still needs manual operation to complete, the efficiency is still slow
In the embodiment of the application, the selection of the service object can be realized by the service terminal in a voice mode, and the service order is automatically generated, so that the service execution efficiency is improved, and the user experience is improved.
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 is a flowchart of an embodiment of an information processing method provided in an embodiment of the present application, where the method may include the following steps:
101: and detecting that the user is positioned in the sensing range of the service terminal to generate a sensing signal.
102: and responding to the induction signal, and collecting voice information of the user.
In the embodiment of the application, the service terminal can be switched to the service processing state by detecting that the user is located in the sensing range of the service terminal, so that the voice information of the user can be acquired. The user can perform voice input without performing any operation.
The service terminal can be configured with a pickup assembly, and the pickup assembly can be started in response to the induction signal, so that the voice information of the user can be collected through the pickup assembly.
The service terminal can be configured with a detection component, and whether a user exists in the sensing range of the service terminal can be detected through the detection component. The sensing range can be determined according to the detection accuracy of the service terminal, and can also be preset in combination with the actual situation.
As an optional manner, the detection component may be an image acquisition component, such as a camera, and detect whether a user exists within a preset range of the service terminal through an image recognition technology.
Alternatively, the sensing assembly may be a body sensor, such as a thermal infrared sensor, a body proximity sensor, or the like.
103: and determining an object selection instruction according to the user voice information.
Wherein the object selection instruction comprises at least one object identification. In addition, selection requirements may also be included.
The business terminal in the embodiment of the application is used for selecting the object and generating the business order, and in a catering place in practical application, the business terminal can be a food ordering terminal.
The service terminals can be deployed in an offline service place, one or more service terminals can be deployed in one offline service place, and one service terminal can be deployed at each dining position in a dining place, so that users can conveniently order meals at the respective dining positions by the service terminals.
And responding to the induction signal, and the service terminal can acquire the voice information of the user in real time.
The user can input an object selection instruction through the voice of the service terminal, the object selection instruction comprises at least one object identifier, and the object selection instruction input by the voice of the user can be obtained by carrying out voice recognition on the currently collected voice information of the user.
In addition, the object selection instruction may further include a selection requirement, and the object identifier may specifically be an object name of the service object to be selected, which is desired to be selected by the user, such as a name of a meal. The selection requirement may include, for example, a transaction amount of the business object to be selected, and may further include a processing requirement and a use requirement of the business object to be selected, for example, when the business object is a meal, the selection requirement may include a processing requirement of the meal, such as "do not spicy", "half sugar", and the like, and may further include a dining requirement, such as "take away", "eat in a hall", and the like.
104: and generating a first business order based on the object selection instruction.
Based on at least one object identifier in the object selection instruction, a first business order may be automatically generated.
The business content included in the first business order is similar to that in the prior art, the business related information of each business object may be shown in the first business order in a list form, for example, the business related information may include an object identifier, a business quantity, a unit price, and the like, the first business order may further include object settlement information, that is, a total price of each business object corresponding to the first business order, and the like, and the object settlement information may be obtained by calculation according to the unit price and the business quantity of each business object, and may further include information such as a placing order number and a dining position.
In the embodiment, the object selection and the order processing are performed by the service terminal by self-help voice, without participation of an object provider and without complex operation execution of a user, so that the service execution efficiency is improved, and the user experience is improved.
Further, optionally, after generating the first service order, the user may still confirm the first service order in a form of voice, and therefore in some embodiments, after generating the first service order based on the object selection instruction, the method may further include:
determining a first order confirmation instruction according to the user voice information;
and processing the first business order based on the first order confirmation instruction.
That is, if the user inputs the first order confirmation instruction by voice, the first order confirmation instruction can be obtained by recognizing the currently collected user voice information by voice.
As an alternative, processing the first business order based on the first order confirmation instruction may be to print the first business order. The business terminal can be configured with a printing component, and if the first order confirmation instruction is obtained through recognition, the first business order can be printed as a paper bill. The user can deliver the paper bill to the object provider, and the object provider carries out the processes of stock, delivery and the like based on the paper bill.
As another alternative, based on the first order confirmation instruction, processing the first service order may be sending the first service order to a processing end to notify an object provider. The processing end may be a client corresponding to the seller, and the processing end may generate the delivery prompt information based on the first service order and output the delivery prompt information to notify the object provider of performing the processing such as stock and delivery.
Of course, the processing of the service order generated by the service end is not limited to the above two alternatives, and other alternatives will be further described in the following embodiments.
Fig. 2 is a flowchart of another embodiment of an information processing method provided in an embodiment of the present application, where the method may include the following steps:
201: and detecting that the user is positioned in the sensing range of the service terminal to generate a sensing signal.
202: and responding to the induction signal, and collecting voice information of the user.
The operations of step 201 to step 202 are similar to the operations of step 101 to step 102. And will not be described in detail herein.
203: and determining a recommended business object.
204: and outputting object recommendation prompt information based on the recommended service object.
The object recommendation prompting information can be used for prompting a user to input an object selection instruction comprising an object identifier of the recommended service object by voice.
205: and determining an object selection instruction according to the user voice information.
The object selection instruction may include at least one object identifier and may further include a selection requirement.
206: and generating a first business order based on the object selection instruction.
The operations in step 205 to step 206 are the same as those in step 103 to step 104, and are not described herein again.
207: and determining a first order confirmation instruction according to the user voice information.
208: and processing the first business order based on the first order confirmation instruction.
In this embodiment, service object recommendation may be performed to the user, so as to facilitate the user to select a service object, thereby further improving service execution efficiency.
As an alternative, the determining the recommended business object may include:
responding to the induction signal, if the voice information of the user is not acquired within the preset time, determining a recommended service object, and outputting object recommendation prompt information based on the recommended service object.
As another alternative, the determining the recommended business object may include:
performing emotion recognition on the user;
and determining a recommended service object according to the user emotion obtained by identification.
Optionally, if the user emotion is a first preset emotion, the service object may be determined to be recommended, the service object is recommended to the user, and object recommendation prompt information is output. For example, the first preset emotion may be a "thinking" emotion, and if the user has a thinking emotion, it may be determined that the user does not know what to do, and guidance may be provided to output the object recommendation hint information.
The object recommendation prompt message may be, for example, "hello, whether you need to recommend? that the most popular coffee in this month is vanilla latte".
The recommended service object may be a service object pushed by an object provider or a service object sold in the highest amount.
Of course, the recommended service object corresponding to the user emotion obtained through recognition can be searched according to the corresponding relation between the user emotion and the service object. The corresponding relation between different user emotions and different service objects can be preset, so that the service objects can be recommended to the user by combining the user emotion obtained by current recognition, and the user experience is improved.
Further, optionally, the determining the recommended business object may include:
acquiring biological information of a user and identifying the biological information of the user to obtain a user identifier;
and determining a recommended service object corresponding to the user identification.
The biological information may refer to a human face, and the biological information recognition is performed on the user, that is, the human face recognition is performed on the user. Of course, the user biological information may also refer to iris, fingerprint, etc. that may identify the biological characteristics of the user, and this application does not specifically limit this.
Optionally, the recommended service object may be determined according to a historical transaction record corresponding to the user identifier.
When the biological information is a human face, the human face image can be acquired through the image acquisition assembly of the service terminal, the human face is identified, and the user identification is determined, so that the historical transaction record corresponding to the user identification can be searched and obtained.
The recommended service object may be a service object with the largest historical transaction amount, a service object transacted last time, or a similar object of the service object with the largest historical transaction amount, or a similar object of the service object transacted last time, or the like.
In some embodiments, after generating the first business order based on the object selection instruction, the method may further include:
determining a first order updating instruction according to the user voice information; the first order updating instruction comprises an object identifier and an updating requirement;
and updating the first business order based on the first order updating instruction.
That is, the user can not only select the object and confirm the order by voice, but also update the order.
Wherein the order update operation may be performed before the object confirmation operation.
The order updating operation for the first business order may include deletion, modification, addition, and the like of the business object, and a change of a selection requirement of the business object.
Further, in some embodiments, after generating the first business order based on the object selection instruction, the method may further include:
determining a first order viewing instruction according to the user voice information;
and displaying the first business order based on the first order viewing instruction.
That is, if the first order searching instruction for obtaining the user voice input is identified, the first service order can be displayed.
Further, in some embodiments, after generating the first business order based on the object selection instruction, the method may further include:
determining a first order cancelling instruction according to the user voice information;
and canceling the first service order based on the first order canceling instruction.
That is, if a first order cancellation instruction to obtain a user voice input is identified, the first business order may be cancelled.
As can be seen from the above description, in the embodiment of the present application, the service operations such as object selection, updating, checking, generating, and/or canceling a service order can all be implemented in a voice interaction manner, so that the complexity of the user operation is greatly reduced, and the user can automatically perform the service operations such as object selection, order updating, order checking, and the like only by inputting the user's own requirements through voice, thereby greatly improving the service execution efficiency and improving the user experience.
In order to facilitate object selection by a user, in some embodiments, the method may further comprise:
responding to the induction signal, and displaying a service interaction interface;
and displaying the object related information of at least one business object on the business interaction interface.
The object related information may include basic information such as an object name and an object unit price, and the object related information may be presented in a text or picture format.
The user can conveniently determine the business object to be selected based on the object related information of at least one business object so as to execute the voice input operation.
In the embodiment of the application, when a user enters the sensing range of the service terminal, the service interaction interface and the pickup assembly can be naturally started, so that the user can directly browse the service object and execute voice interaction to select the service object and the like.
The user can realize interaction with the service terminal through vision and voice, and better sensory experience can be provided for the user, so that the user experience is improved.
Further, in some embodiments, after generating the first business order based on the object selection instruction, the method further comprises:
and displaying the first service order on the service interaction interface so as to facilitate the user to check the first service order.
In addition, in order to guide the user to perform voice input and understand the service function of the service terminal, service prompt information corresponding to the service operation can be output.
Thus, in certain embodiments, the method may further comprise:
outputting object selection prompt information; and the object selection prompt message is used for prompting a user to input the object selection instruction by voice.
As a result of responding to the sensing signal, a business interaction interface may be presented.
Therefore, optionally, the object selection prompt message may be displayed on the service interaction interface, and the object selection prompt message may be displayed in a form of graphics and text.
In addition, the object selection prompt message can be played in a sound mode.
The object selection prompt message may be specifically used to prompt the user to execute a voice input form of the object selection operation, for example, the object selection prompt message may be "you can say 'a cup of ice american'," you can say 'a cup of cappuccino', "you can say 'a cup of hot latte'," or the like.
In addition, service scene prompt information of the object selection operation can be output to prompt a user of a service scene of the object selection operation, and the service scene prompt information of the object selection operation can be, for example, "welcome to XXX", "you can place an order in a voice manner", and the like.
The service scene prompt information of the object selection operation can be displayed in the service interaction interface in a graphic and text mode, and can also be played in a sound mode.
The service scene prompt information of the object selection operation can be output in cooperation with the object selection prompt information, so that the human-computer interaction experience is improved.
In some embodiments, after generating the first business order based on the object selection instruction, the method may further include:
outputting first order confirmation prompt information; the first order confirmation prompting message is used for prompting a user to input the first order confirmation instruction in a voice mode.
Optionally, as a result of responding to the sensing signal, a business interaction interface may be presented.
Therefore, the first order confirmation prompt message can be displayed on the service interaction interface.
In addition, the first order confirmation prompt message can be played in a sound mode.
The first order confirmation prompting message may be used to prompt the user to perform a voice input form of order confirmation operation, for example, the first order confirmation prompting message may be "you can say 'confirm purchase'," or the like.
In addition, service scene prompt information of the order confirmation operation may be output to prompt the user of the service scene of executing the order confirmation operation, and the service scene prompt information of the order confirmation operation may be, for example, "please confirm the order".
In some embodiments, after generating the first business order based on the object selection instruction, the method may further include:
outputting a first order updating prompt message; the first order updating prompt message is used for prompting a user to input the first order updating instruction.
Optionally, as a result of responding to the sensing signal, a business interaction interface may be presented.
Therefore, the first order updating prompt information can be displayed on the service interaction interface.
In addition, the first order updating prompt message can be played in a sound mode.
The first order update instruction may be specifically used to prompt the user to perform a voice input form of an order update operation, for example, the first order update prompt message may be "you can say 'take iron and add a cup'," do not need ice america, change into hot america "," milk tea changes into half sugar ", and the like.
In some embodiments, after generating the first business order based on the object selection instruction, the method may further include:
outputting first order cancellation prompt information; the first order cancellation prompting message is used for prompting a user to input a first order cancellation instruction.
Optionally, as a result of responding to the sensing signal, a business interaction interface may be presented.
Therefore, the first order cancellation prompt message can be displayed on the service interaction interface.
Thus, the method may comprise:
and determining a first order canceling instruction according to the user voice information, and canceling the first service order.
The first order cancellation instruction may be specifically used to prompt the user to perform a voice input form of order cancellation operation, for example, the first order cancellation prompt message may be "you can say 'cancel order'," or the like.
In some embodiments, after generating the first business order based on the object selection instruction, the method may further include:
and outputting object selection prompt information for prompting the user to input an object selection instruction by voice so that the user can continue object selection and the like.
One or more of the first order confirmation prompt message, the first order update prompt message, and the first order cancellation prompt message described above may be displayed in the service interaction interface after the first service order is generated, so that the user can conveniently input a corresponding service instruction through voice according to the first order confirmation prompt message, the first order update prompt message, or the first order cancellation prompt message, so as to trigger execution of the corresponding service operation.
In some embodiments, said processing said first business order based on said first order confirmation instruction may comprise:
outputting first order settlement confirmation information based on the first order confirmation instruction;
recognizing a first settlement confirmation instruction input by a user voice;
outputting first settlement prompt information based on the first settlement confirmation instruction
Alternatively, the first order settlement confirmation information may be displayed on the service interaction interface, and the first order settlement confirmation information may be in a form of voice input for prompting the user to perform a settlement confirmation operation, for example, the first order settlement confirmation information may be "you can say 'confirm payment'.
Further, after outputting first order settlement confirmation information based on the first order confirmation instruction, the method may include:
performing emotion recognition on the user;
if the second preset emotion is recognized and obtained, the first calculation prompt message can be output. The second preset emotion may be, for example, "smile" or the like.
As an alternative, a first settlement prompting message including a first payment link may be displayed on the service interaction interface; the first payment link is used for calling a third party payment system to carry out online payment;
as another alternative, the first settlement prompting message may be used to prompt the user to provide a second payment link provided by a third party payment system.
Accordingly, based on the first settlement confirmation instruction, a scanning component may also be initiated for scanning a second payment link provided by the user to invoke the third party payment system to make an online payment.
And if the payment of the first business order is successful, printing the first business order.
In addition, in some embodiments, in order to facilitate the user to know the voice recognition result, the voice recognition result of the user voice information may be displayed on the service interaction interface.
For example, after the object selection instruction input by the user is recognized, the object selection instruction may be displayed on the service interaction interface to facilitate the user to determine whether the speech recognition result is correct.
After the first order confirmation instruction is determined according to the user voice information, the first order confirmation instruction can be displayed on the service interaction interface.
After determining the first order updating instruction according to the user voice information, displaying the first order updating instruction on a service interaction interface;
after the first order cancellation instruction is determined according to the user voice information, the first order cancellation instruction and the like can be displayed on the service interaction interface.
After determining the first settlement confirmation instruction according to the user voice information, the first settlement confirmation instruction may be displayed on the service interaction interface, and the like.
In addition, in some embodiments, to further facilitate user operation, after the generating the first business order based on the object selection instruction, the method further includes:
and displaying a first operation control for executing order confirmation operation on the service interaction interface.
The processing the first business order based on the first order confirmation instruction may include:
and processing the first business order based on the first order confirmation instruction or in response to the touch operation aiming at the first operation control.
That is, the order confirmation operation may be triggered to be executed in a voice interaction form or a control operation form, so as to process the first service order.
Optionally, the first operation control may be output in cooperation with the first order confirmation prompt message, or may be output in cooperation with the first service order.
In addition, after the first order confirmation prompt information is output, emotion recognition can be performed on the user, and the first service order can be processed by combining the obtained user emotion through recognition, a first order confirmation instruction input by the user through voice or touch operation aiming at the first operation control.
In some embodiments, after the first business order is generated based on the object selection instruction, a second operation control for executing an order cancellation operation may be further displayed on the business interaction interface;
therefore, the first business order can be cancelled based on a first order cancelling instruction or in response to a touch operation for the second operation control.
The second operation control can be displayed in cooperation with the first business order, and the like.
In addition, in some embodiments, based on the first settlement confirmation instruction, a third operation control for executing settlement confirmation operation can be displayed on the service interaction interface;
the outputting first settlement prompting information based on the first settlement confirming instruction may include:
and outputting first settlement prompt information based on the first settlement confirmation instruction or in response to a trigger operation for the third operation control.
Optionally, based on the first settlement confirmation instruction, a fourth operation control for executing the continuous purchase adding operation may be displayed on the service interaction interface;
from responding to the touch operation of the fourth operation control, object selection prompt information can be output to prompt the user to continue inputting an object selection instruction by voice and the like.
In some embodiments, in order to facilitate a user to intuitively know a response result of a service instruction, that is, whether the service instruction is successfully responded, and the like, after the first service order is generated based on the object identifier and the selection requirement, the method may further include:
and displaying the response result feedback information of the object selection instruction on a service interaction interface.
The response result feedback information of the object selection instruction may include result prompt information indicating whether the object selection instruction successfully responds, for example, the object selection instruction is "iron in cup", and the result prompt information may be "good iron in cup added". And the service prompt information of the service operation which is possibly executed next step can be output together with the response result feedback information. For example, after the object selection operation is performed and the service order is generated, the next service operation is an order confirmation operation or an order update operation, so that the first order confirmation prompt information and the second order update prompt information can be displayed in cooperation with the response result feedback information, for example, "good, a cup iron in a cup has been added, you can modify the order or 'confirm purchase'," or the like by voice.
In addition, after the service interaction interface displays the response result feedback information of the object selection instruction, object selection prompt information can be displayed on the service interaction interface so as to guide the user to continue to select the service object.
In some embodiments, after processing the first business order based on the first order confirmation instruction, the method may further include:
and displaying response result feedback information of the first order confirmation instruction on the service interaction interface.
The feedback information of the response result of the first order confirmation instruction may include result prompt information indicating whether the first order confirmation instruction is successful in response, for example, the first order confirmation instruction is "confirm purchase", and the feedback information of the response result may be "good, and the order contains 3 beverages, which is 102 yuan in total.
Optionally, the service prompt information for executing the next service operation may be displayed in cooperation with the response result feedback information. The next business operation may be determined based on the current business operation being an order confirmation operation, and the next business operation may include, for example, a settlement confirmation operation, and thus, a first settlement confirmation prompt may be displayed, which may be, for example, "you can say" confirm payment ", start payment", or the like.
In some embodiments, in order to facilitate the user to know the voice input state, the method may further include:
and displaying voice interaction state prompt information on the service interaction interface.
The voice interaction state prompt information is used for prompting whether the voice interaction state prompt information is in a voice acquisition state or not, and the voice interaction state prompt information is a state control which can be changed, such as the change of shape or color. If the current state is in the voice acquisition state, the state control can be switched to a first display state, and if the current state is not in the voice acquisition state, the state control can be switched to a second display state, and the like.
In some embodiments, after generating the first business order based on the object selection instruction, the method further comprises:
performing action recognition on the user;
and if the first preset action is identified and obtained, processing the first business order.
Optionally, after the first order confirmation prompting message is output, performing action recognition on the user.
Of course, after the first service order is generated, first action prompt information may also be output to prompt the user to execute the first preset action.
The first preset action may be, for example, a nodding action, and the first service order may be processed.
Alternatively, the first service order may be cancelled if a second preset action is identified, which may be, for example, a shaking motion or the like.
In addition, in order to further improve the accuracy, after the generating the first service order based on the object selection instruction, the method may further include:
performing action recognition on the user;
the processing the first business order based on the first object confirmation instruction may include:
and processing the first service order by combining the first preset action obtained by identification and the first order confirmation instruction.
And if the user action is taken as a first preset action and the first object confirmation instruction is identified and obtained, processing the first business order.
Optionally, after the first order confirmation prompting message is output, the action recognition is performed on the user.
Further, based on the first order cancellation instruction, cancelling the first business order may be:
and canceling the first service order by combining the second preset action obtained by identification and the first order canceling instruction.
In some embodiments, after outputting the first order settlement confirmation information based on the first order confirmation instruction, the method may further comprise:
performing action recognition on the user;
and if the third preset action is identified, outputting first calculation prompt information.
The third preset action may be, for example, a nodding action, and if the third preset action is recognized, it indicates that the user confirms to settle, so that the first settlement prompting message may be output.
Further, to improve accuracy, in some embodiments, after outputting first order settlement confirmation information based on the first order confirmation instruction, the method may further comprise:
performing action recognition on the user;
the outputting first settlement prompting information based on the first settlement confirming instruction may include:
and outputting first settlement prompt information by combining the third preset action obtained by identification and the first settlement confirmation instruction.
In some embodiments, in response to the sensing signal, the user may further perform biological information recognition on the user to obtain a user identifier;
determining an object identifier of at least one target business object corresponding to the user identifier;
and generating a second business order based on the object identification of the at least one target business object.
In addition, a selection requirement corresponding to the user identifier may also be determined, and a second business order is generated specifically based on the object identifier of the at least one target business object and the selection requirement;
after determining the object identifier of the at least one target business object corresponding to the user identifier, the method further includes:
outputting object confirmation prompt information;
the generating a second business order based on the object identifier of the at least one target business object comprises:
determining an object confirmation instruction according to the user voice information;
and generating a second business order based on the object identification of the at least one target business object in response to the object confirmation instruction.
Namely, the second service order is generated by specifically combining the object identifier of at least one target service object and the user voice information.
Optionally, the outputting the object confirmation prompt message may be displaying the object confirmation prompt message on a service interaction interface.
As can be seen from the above description, if the voice recognition is performed to obtain the object selection instruction input by the user voice, the first service order may be generated based on the service object corresponding to the object selection instruction.
If the biological information face recognition is carried out to obtain the user identification, the second business order can be automatically generated based on at least one target business object corresponding to the user identification.
Alternatively, when the object selection instruction input by the user voice is not recognized, the biological information of the user is collected and the biological information recognition is carried out on the user to obtain the user identification.
Or after the biological information is failed to be identified, whether the object selection instruction input by the voice of the user exists can be determined through the voice identification.
Of course, the service terminal may also trigger generation of the second service order only by using the biometric information identification method, which may be described in the following embodiments. The following description also refers to possible implementation manners of performing business operations such as processing, updating, searching, and canceling on the second business order, and determining the object identifier of the at least one target business object corresponding to the user identifier.
Fig. 3 is a flowchart of another embodiment of an information processing method provided in an embodiment of the present application, where the method may include the following steps:
301: and acquiring biological information of the user and identifying the biological information of the user to obtain a user identifier.
The biological information may refer to a human face, an iris, a fingerprint, or the like.
Through the biological characteristic recognition technology, the corresponding user identification can be obtained by acquiring the biological information of the user and carrying out biological information recognition, and the user identification can be a user registration account number and the like.
Each user can register a user identifier through the service terminal in advance, and the biological characteristics of the user identifier are stored corresponding to the user identifier. Therefore, the biological characteristics can be determined through biological information identification, and the corresponding user identification can be obtained through searching.
302: and determining the object identification of at least one target business object corresponding to the user identification.
In addition, a selection requirement corresponding to the user identifier may also be determined, which may be a selection requirement for each target business object.
Based on the user identification, a target business object recommended to the user can be determined.
The target business object is a business object with a higher purchase probability of the user, and can be determined in various ways.
As an optional manner, the object identifier of at least one target business object may be determined according to the historical transaction record corresponding to the user identifier.
For example, the at least one target business object may be a business object whose historical transaction amount is greater than a certain amount, a business object that has been transacted last time, or a similar object whose historical transaction amount is greater than a certain amount, or a similar object of a business object that has been transacted last time, and the like.
The selection requirement may also be a selection requirement corresponding to a target business object recorded in the historical transaction record.
As another alternative, the object identifier of at least one target service object may be determined according to the historical behavior record corresponding to the user identifier.
The historical behavior record may record a browsing record of the user, a collection record of the user, and the like, so for example, a service object whose browsing times are greater than a certain number of times or whose collection times are greater than a certain number of times may be used as the target service object.
In combination with historical transaction records or historical behavior records, the shopping habits of the user may be determined, thus enabling the object identification of at least one target business object to be determined.
In addition, as another optional manner, a target business object matched with the user feature may be determined according to the user feature corresponding to the user identifier.
The user characteristics may include information such as gender, age, occupation, etc., so that based on the user characteristics, a matching target business object may be determined.
303: and collecting the voice information of the user.
The collecting of the user voice information may be continuously performed, and may be performed before or after the collecting of the user biological information, which is not specifically limited in this embodiment of the application, and therefore the operation of step 303 is not limited to the flow sequence of this embodiment.
304: and generating a second business order by combining the object identification of the at least one target business object and the user voice information.
As an optional manner, the user voice information may include an object determination instruction input by the user voice, so that the object determination instruction may be determined according to the user voice information, and by responding to the object determination instruction, the second service order may be generated based on the object identifier of the at least one target service object.
As another optional mode, the user voice information may include an object selection instruction input by the user voice, and the object selection instruction may include an object identifier of the at least one target business object, so that the second business order may be generated based on the object identifier of the at least one target business object.
In addition, optionally, after the second service order is generated, the user may also confirm the second service order in a voice form. Thus, in certain embodiments, the method may further comprise:
determining a second order confirmation instruction according to the user voice information;
and processing the second business order based on the second order confirmation instruction.
I.e. if a second order confirmation instruction is recognized which gets the user's voice input, the second service order can be processed.
In the embodiment, the user identification can be determined by carrying out biological information recognition on the user, and then at least one target business object corresponding to the user identification can be determined, so that an automatically generated business order can be generated based on the object identification of the at least one target business object by combining the voice information of the user, the business execution efficiency is improved, and the user experience can be greatly improved.
In some embodiments, in order to further improve the service execution efficiency and improve the user experience, in some embodiments, the acquiring the user biological information and performing biological information recognition on the user to obtain the user identifier includes:
detecting that a user is located in an induction range of a service terminal to generate an induction signal;
and responding to the induction signal, acquiring the biological information of the user, and identifying the biological information of the user to obtain a user identifier.
And responding to the sensing signal, and displaying a service interaction interface. The object related information of at least one business object can be displayed in the business interaction interface so as to facilitate browsing of a user.
Of course, the service interaction interface may also be presented in response to a touch operation for the service terminal. For example, the touch operation may be that the user clicks a display screen of the service terminal or touches a specific button of the service terminal, etc.
Further, in some embodiments, emotion recognition may also be performed on the user;
therefore, the determining the object identifier of the at least one target business object corresponding to the user identifier may include:
and determining the object identifier of at least one target business object corresponding to the user identifier according to the user emotion obtained by identification.
Optionally, if the emotion of the user is a third preset emotion, determining an object identifier of at least one target business object corresponding to the user identifier. For example, the third preset emotion may be "thinking", that is, if the user is in a thinking emotion, it may be determined that the user may not know which business objects to select, at this time, at least one target business object corresponding to the user identifier may be determined directly based on the user identifier, so as to assist the user in selecting, and the like.
In some embodiments, after determining the object identifier of the at least one target business object corresponding to the user identifier, the method further includes:
outputting object confirmation prompt information;
the generating a second service order by combining the object identifier of the at least one target service object and the user voice information comprises:
determining an object confirmation instruction according to the user voice information;
and generating a second business order based on the object identification of the at least one target business object in response to the object confirmation instruction.
The service interaction interface can also be presented as a response to the sensing signal. Therefore, the object confirmation prompt message can be displayed on the service interaction interface, and of course, the object confirmation prompt message can also be played in a sound mode.
The object confirmation prompt message is used for prompting the user to input a business instruction whether to trade the target business object, and based on the object confirmation prompt message, the user can input an object confirmation instruction or an object cancellation instruction by voice, so that in response to the object confirmation instruction, a second business order can be generated based on the target business object.
The object confirmation prompt message may also include guidance information such as a user name corresponding to the user identifier, and the object confirmation prompt message may be, for example, "mr. a, hello, whether to continue today with a cup of tin tweed". The user may voice-input an object confirmation instruction such as "yes" or an object cancellation instruction such as "not to".
And if the object canceling instruction is obtained through recognition, object selection prompt information can be output to prompt a user to input the object selection instruction through voice.
In some embodiments, after outputting the object confirmation prompt information, the method may further include:
performing action recognition on the user;
the generating a second business order based on the object identification of the at least one target business object in response to the object confirmation instruction may include:
and generating a second business order based on the object identification of the at least one target business object by combining the fourth preset action obtained by identification and the object confirmation instruction.
That is, if the fourth preset action and the object confirmation instruction are obtained through recognition, the second service order may be generated based on the object identifier of the at least one target service object.
Of course, alternatively, after the fourth preset action or the object confirmation instruction is obtained if the identification is performed, the second business order may be generated based on the object identifier of the at least one target business object.
Optionally, if the fifth preset action and/or the object cancel instruction is obtained through recognition, the process may be ended, or object selection prompt information may be output to prompt the user to input the object selection instruction through voice.
The fourth preset motion may be, for example, a nodding motion, and the fifth preset motion may be, for example, a shaking motion.
For the second service order, corresponding service prompt information can be output by combining different service scenes, and response result feedback information of the service instruction can also be output; in addition, a voice interaction state and the like can also be displayed. Similar to the processing flow of the first service order, the following is briefly listed, and the specific function introduction of the similar part may be referred to the description in the above embodiment.
In some embodiments, after generating the second business order, the method may further comprise:
recognizing a second order updating instruction input by the user through voice; the second order updating instruction may include an object identifier and an updating requirement;
and updating the second business order based on the second order updating instruction.
In some embodiments, after generating the second business order, the method may further comprise:
determining a second order cancelling instruction according to the user voice information;
and canceling the second service order based on the second order canceling instruction.
In some embodiments, after generating the second business order, the method may further comprise:
outputting a second order confirmation prompt message; and the second order confirmation prompt message is used for prompting a user to input the second order confirmation instruction by voice.
In some embodiments, after generating the second business order, the method may further comprise:
outputting a second order updating prompt message; and the second order updating prompt message is used for prompting a user to input the second order updating instruction.
In some embodiments, after generating the second business order, the method may further comprise:
outputting a second order cancellation prompt message; and the second order cancellation prompt message is used for prompting a user to input the second order cancellation instruction.
In some embodiments, the outputting the second order confirmation prompting message may include:
and displaying the second order confirmation prompt information on the service interaction interface.
Of course, optionally, the second order confirmation prompting message may also be played in an audio form.
In some embodiments, the outputting the second order update prompting message may include:
and displaying the second order updating prompt information on the service interaction interface.
In some embodiments, the outputting the second order cancellation prompt message may include:
and displaying the second order cancellation prompt message on the service interaction interface.
In some embodiments, after generating the second business order based on the object identification of the at least one target business object, the method may further comprise:
and displaying the second service order on the service interaction interface.
In some embodiments, after generating the second business order, the method may further comprise:
displaying a first operation control for executing order confirmation operation on a business interaction interface;
the processing the second business order based on the second order confirmation instruction comprises:
and processing the first business order based on the second order confirmation instruction or in response to the touch operation aiming at the first operation control.
In some embodiments, after generating the second business order, the method may further comprise:
displaying a second operation control for executing order cancellation operation on the business interaction interface;
the method further comprises the following steps:
and canceling the second business order in response to the touch operation aiming at the second operation control.
In some embodiments, after processing the second business order based on the second order confirmation instruction, the method further comprises:
and displaying response result feedback information of the second order confirmation instruction on the service interaction interface.
In some embodiments, said processing said second business order based on said second order confirmation instruction may comprise:
outputting second order settlement confirmation information based on the second order confirmation instruction;
recognizing a second settlement confirmation instruction input by the user through voice;
and outputting second settlement prompting information based on the second settlement confirming instruction.
In addition, after the second order settlement confirmation information is output, emotion recognition can be performed on the user, and if a second preset emotion occurs, the second settlement prompt information can also be output.
Optionally, outputting second settlement prompting information based on the second settlement confirming instruction may include:
displaying second settlement prompting information comprising the first payment link on the service interaction interface; the first payment link is used for calling a third party payment system to carry out online payment.
Further, as another alternative, based on the second settlement confirmation instruction, the scanning component may also be activated.
The second settlement prompting message is used for prompting the user to provide a second payment link of the third-party payment system. The scanning component adjusts the third party payment system to make the online payment by scanning the second payment link.
Wherein if the second business order payment is successful, the second business order may be printed.
In addition, the processing the second service order based on the second object confirmation instruction may further be: and transmitting the first service order to a processing end based on the first object confirmation instruction.
Fig. 4 is a flowchart of another embodiment of an information processing method provided in an embodiment of the present application, where the method may include the following steps:
401: and detecting that the user is positioned in the sensing range of the service terminal to generate a sensing signal.
402: and responding to the induction signal, and acquiring voice information and biological information of the user.
403: and performing biological information identification on the user based on the user biological information.
404: and judging whether a user identification corresponding to the biological information identification result exists, if so, executing the step 405, and if not, executing the step 409.
And in response to the sensing signal, performing biological information recognition on the user, and if a user identifier is obtained, continuing to perform the operation of step 405.
If the biometric information identification fails and the corresponding user identifier does not exist, the operation of step 409 may be performed.
405: and determining the object identification of at least one target business object corresponding to the user identification.
406: and outputting object confirmation prompt information.
407: and generating a second business order based on the object identification of the at least one target business object according to the object confirmation instruction in the user voice information.
If the user confirms the prompt information based on the object and inputs the object confirmation instruction by voice, the voice recognition is carried out on the currently collected user voice information, and the object confirmation instruction can be recognized and obtained.
408: and processing the second service order according to a second order confirmation instruction in the user voice information.
And if the user inputs a second order confirmation instruction by voice, performing voice recognition on the currently acquired user voice information, namely recognizing and obtaining the second order confirmation instruction.
Optionally, after the second service order is generated, the second service order may be displayed on a service interaction interface, so that the user can conveniently browse and confirm.
Of course, a second order confirmation prompting message can also be output to prompt the user to input the second order confirmation instruction by voice.
409: and outputting object selection prompt information.
410: and determining an object selection instruction according to the user voice information.
Wherein the object selection instruction comprises at least one object identification.
411: and generating a first business order based on the object selection instruction.
412: and processing the first service order according to a first order confirmation instruction in the user voice information.
Corresponding or identical steps can be referred to the above embodiments, and are not described in detail herein.
In addition, if the user identification corresponding to the biological recognition result does not exist, registration prompt information can be output to guide the user to register to obtain the user identification, and the biological characteristics of the user are collected and bound with the user identification corresponding to the user identification.
An embodiment of the present application further provides an information display method, as shown in fig. 5, the method may include the following steps:
501: and providing a service interaction interface.
The service interaction interface may be provided when the service terminal detects that the user exists in the sensing range.
The business interaction interface can display the object related information of at least one business object so as to facilitate the user to view and the like.
502: and displaying service prompt information for executing service operation on the service interaction interface.
The service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
That is, in response to the voice input for the service prompt information, a service instruction may be obtained, and based on the service instruction, a corresponding service operation may be performed.
Optionally, the service interaction interface may display service prompt information for executing the next service operation according to the previous service operation.
The business operation may be an object selection operation, an object confirmation operation, an order update operation, an order cancellation operation, or an order settlement operation, among others.
Wherein, the business operation is the object selection operation; the service prompt information is prompt information selected for an object; the service instruction is also an object selection instruction; the object selection instruction comprises at least one object identifier and can also comprise a selection requirement and the like;
the object selection instruction is used for triggering generation of a business order, namely, the business order is generated according to the object selection instruction.
Accordingly, the method may further comprise:
and displaying the service order on the service interaction interface.
And when the business operation is an object confirmation operation, the business prompt information is object confirmation prompt information. The object confirmation prompt information is generated according to a target business object corresponding to the user identification obtained by face recognition. The service instruction is also an object confirmation instruction.
The object confirmation instruction is used for triggering generation of a business order based on the target business object.
Namely, according to the object confirmation instruction, generating a business order based on the target business object.
Accordingly, the method may further comprise:
and displaying the service order on the service interaction interface.
The execution result of the object selection operation or the object confirmation operation is to generate a business order, so the corresponding next business operation may include an order confirmation operation, an order update operation, an order cancel operation, or the like.
When the service operation can be an order confirmation operation, the service prompt information is also an order confirmation prompt information, and the service instruction is also an order confirmation instruction.
The order confirmation instruction is used for triggering the processing of the business order. That is, the service order can be processed according to the order confirmation instruction.
The service order may be a service order generated based on a service object corresponding to the object selection instruction, or a service order generated based on a target service object corresponding to the user identifier obtained by face recognition.
The generation of the service order can be referred to the above embodiments, and is not described herein.
When the service operation is an order canceling operation, the service prompt information is also order canceling prompt information, and the service instruction is also an order updating instruction; the order updating instruction is used for triggering the cancellation of the business order.
That is, the service terminal can cancel the service order according to the order cancellation instruction.
When the business operation can be order updating operation, the business prompt information also refers to order updating prompt information; the service instruction is also an order updating instruction; the order updating instruction is used for triggering the updating of the business order. That is, the service order can be updated according to the order updating instruction.
In addition, the business operation can also be order settlement operation, the business prompt information is settlement confirmation prompt information, and the business instruction is a settlement confirmation instruction. The settlement confirmation instruction instructs the user to trigger the service interaction interface to display the settlement prompt information corresponding to the service order. That is, the service terminal can display the settlement prompting information corresponding to the service order on the service interaction interface according to the settlement confirmation instruction.
In addition, in order to facilitate service interaction by using multiple interaction methods, in some embodiments, the method may further include:
displaying an operation control corresponding to the business operation on the business interaction interface;
the triggering operation aiming at the operation control is used for triggering and executing the corresponding business operation
That is, based on the service instruction or in response to the trigger operation for the operation control, the corresponding service operation may be triggered to be executed.
In addition, in order to facilitate the user to know whether the speech recognition is accurate, in some embodiments, the method may further include:
and responding to the voice input aiming at the service prompt information, and displaying a voice recognition result of the voice information of the user on the service interaction interface.
To facilitate the user to understand the response result of the service instruction, in some embodiments, the method may further include:
and displaying the response result feedback information of the service instruction on the service interaction interface.
Alternatively, after the response result feedback information is displayed for a predetermined time, service prompt information for executing the next service operation may be displayed on the service interaction interface.
The response result feedback information may also include operation prompt information for executing the next service operation.
In addition, while the service interaction interface displays service prompt information for executing service operation, the method further includes:
and displaying service scene prompt information corresponding to the service operation on the service interaction interface.
The service scene prompt message can be used for prompting the user of the service operation, so that the user can know the service operation conveniently.
By the embodiment of the application, multi-mode interaction with a user is realized, and business operations such as business object selection, order processing and the like are realized by combining interaction modes such as voice, touch operation, vision, action and the like, so that the business execution efficiency is improved. The user is guided by the output of the service prompt information, so that man-machine interaction is realized, the user can complete service operation in a more natural mode, and the user experience is improved.
In an actual application, the embodiment of the application can be applied to offline catering places, the business object can specifically refer to a food, the business order can refer to a food order and the like, and the business terminal also refers to a food ordering terminal.
In an online catering place, as an embodiment, the information processing method provided by the application may also include:
detecting that a user is located in an induction range of the ordering terminal to generate an induction signal;
responding to the induction signal, and collecting user voice information;
determining a meal selection instruction according to the user voice information; wherein the meal selection instruction comprises at least one meal name; the food ordering requirement can be further included;
and generating a first food order based on the food selection instruction.
As another embodiment, the information processing method provided by the present application may also include:
acquiring biological information of a user and identifying the biological information of the user to obtain a user identifier;
determining the name of at least one target food corresponding to the user identification;
collecting user voice information;
and generating a second food order based on the food name of the at least one target food and the user voice information.
In addition, the information display method provided by the present application may also include:
providing an ordering interactive interface;
displaying service prompt information for executing service operation on the ordering interactive interface;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
For convenience of understanding, the technical scheme of the embodiment of the application is described below by taking an offline dining place as an example and combining the accompanying drawings.
The ordering terminal can be deployed in an online catering place.
The food ordering terminal can be provided with a detection component such as a camera or a sensor, and the detection component is used for detecting whether a user exists in the sensing range of the food ordering terminal.
The ordering terminal can be configured with a display component to provide an ordering interactive interface.
If the ordering terminal detects that the user exists in the induction range, the pickup assembly can be started to collect the voice information of the user. Meanwhile, the ordering interactive interface can be awakened. And displaying the ordering interactive interface in the ordering terminal.
Referring to fig. 6a, which is a schematic display diagram of an ordering interactive interface provided by an ordering terminal, in the ordering interactive interface 600, meal related information 601 of at least one meal may be displayed, where the meal related information may include basic information such as a meal name and a meal unit price. Therefore, when the user is located in the sensing range of the ordering terminal, the ordering interactive interface can be displayed, and the user can browse the food naturally to determine the desired food.
To guide the user to make a voice input, a meal selection prompt message, such as "you can say: ' one big cup date is spring red and iron is taken ', ' and service scene prompt information, the service scene prompt information and the meal selection prompt information can be displayed in a matching way, for example, the display content 602 in fig. 6a "welcome to AAA, you can say: 'A big cup of jujube Chunhong Yida iron' 'and a big cup of hot lata iron' 'are packed into a big cup of American style'.
The user can input a food selection instruction based on the food selection prompt information, the food selection instruction can include food names, food ordering requirements and the like, and the food ordering requirements include quantity, packaging and the like.
In addition, a switching control 603 can also be displayed in the ordering interactive interface 600, and a user can be supported to select a business object in a touch manner by responding to a touch operation for the switching control 603.
The ordering terminal can generate a first food order based on the food selection instruction. For ease of user review, the first meal order 604 may also be displayed in the ordering interaction interface 600, as shown in FIG. 6 b.
In addition, in order to facilitate the user to know the voice recognition result, as shown in fig. 6b, the voice recognition result 605 of the voice information of the user can be displayed in the ordering interactive interface 600, that is, "latte in cup"
In addition, in order to facilitate the user to intuitively know the response result of the service instruction, that is, whether the service instruction is successfully responded, and the like, the feedback information of the response result of the service instruction can be displayed on the ordering interactive interface.
As shown in fig. 6b, response result feedback information of the object selection instruction, such as "good, cup latte has been added", may be displayed in the ordering interactive interface 600, and in addition, a first order confirmation prompt information and a first order update prompt information may be displayed in the ordering interactive interface. In fig. 6b, the first order confirmation prompt message, the first order update prompt message, and the response result feedback message are output in a matching manner, that is, the display content 606 is "good," a cup latte in a cup has been added, and you can modify the order or 'confirm purchase' "by voice.
In addition, an operation control for executing the next business operation may also be displayed in the ordering interactive interface, as shown in fig. 6b, a first operation control 607 for executing the order confirmation operation may be displayed in the ordering interactive interface 600, and a second operation control 608 for executing the order cancellation operation may also be displayed.
And generating a corresponding service instruction can be triggered through the first control and the second operation control.
After the response result feedback information shows the preset time, or the response result feedback information shows that the voice information of the user is not acquired within the preset time, the meal selection prompt information may be continuously output to prompt the user to continuously add the meal to be purchased, such as the display content 602 shown in fig. 6c in which the meal selection prompt information and the service scene prompt information are cooperatively displayed.
If the first order confirmation instruction input by the user is obtained through recognition, or the touch operation aiming at the first operation control is detected, the first food order can be processed.
Still taking voice input as an example, if the user inputs the first order confirmation instruction by voice, as shown in fig. 6d, the voice recognition result 609 of the first order confirmation instruction may be displayed in the ordering interactive interface 600, "confirm purchase", and the feedback information of the response result of the first order confirmation instruction may also be displayed, such as "good, this order contains 3 drinks, which is 102 yuan in total".
Further, based on the first order confirmation instruction, first order settlement confirmation information such as "you can say 'confirm payment'" may be output. The first order settlement confirmation information and the response result feedback information may be outputted in cooperation, as shown in the display 610 in fig. 6 d.
In addition, the first meal order 604 may also be displayed.
Further, a third operation control 611 for performing an order settlement operation, a fourth operation control 612 for continuing a purchase operation, and the like may also be displayed.
In response to the fourth operation control, the interface display diagram of fig. 6c may be returned.
Wherein if the first settlement confirming instruction for obtaining the user voice input is recognized;
and outputting first settlement prompt information based on the first settlement confirmation instruction.
First settlement prompting information 613 as shown in fig. 6e, which is used to prompt the user to provide a second payment link of the third party payment system.
Based on the first settlement confirmation instruction, the scanning component can also be activated to adjust the third party payment system for online payment by scanning the second payment link.
In addition, a fifth operation control 614 for canceling the settlement operation may be further displayed, and in response to a touch operation for the fifth operation control, the ordering flow may be ended, and the interface display diagram shown in fig. 6a may be returned to be displayed.
And if the payment of the first food order is successful, displaying a prompt message of successful payment on a food interactive interface. In addition, the first food order can be printed or sent to the processing terminal, so that the merchant can prepare food according to the first food order.
In addition, the ordering terminal can also identify biological information of the user to obtain a user identifier; and generating a second food order by combining at least one target food corresponding to the user identification.
It should be noted that the first food order and the second food order are only generated in different ways, and the rest of the operation flows may be the same or similar, and are not described herein again.
In addition, in order to facilitate the user to know the voice input state, voice interaction state prompt information, such as the voice interaction state prompt information 615 in fig. 6a to 6d, may also be displayed on the meal interaction interface.
Fig. 7 is a schematic structural diagram of an embodiment of an information processing apparatus according to an embodiment of the present application, where the apparatus may include:
a detection module 701, configured to detect that a user is located within an induction range of a service terminal, and generate an induction signal;
a first response module 702, configured to respond to the sensing signal and collect user voice information;
a first recognition module 703, configured to determine an object selection instruction according to the user voice information; wherein the object selection instruction comprises at least one object identification;
a first order generating module 704, configured to generate a first service order based on the object selection instruction.
In some embodiments, the apparatus may further comprise:
the second identification module is used for determining a first order confirmation instruction according to the user voice information;
and the first order processing module is used for processing the first service order based on the first order confirmation instruction.
In some embodiments, the apparatus may further comprise:
the first order updating module is used for determining a first order updating instruction according to the user voice information; and updating the first business order based on the first order updating instruction.
In some embodiments, the apparatus may further comprise:
the first order cancellation module is used for determining a first order cancellation instruction according to the user voice information; and canceling the first service order based on the first order canceling instruction.
In some embodiments, the apparatus may further comprise:
the object recommending module is used for determining a recommended service object; based on the recommended service object, outputting object recommendation prompt information; the object recommendation prompting information is used for prompting a user to input an object selection instruction comprising an object identifier of the recommended service object by voice.
As an optional mode, the object recommending module determines that the recommended service object may specifically be to acquire user biological information and perform biological information identification on the user to obtain a user identifier; and determining a recommended service object corresponding to the user identification.
Optionally, the object recommendation module may determine the recommended service object corresponding to the user identifier specifically according to a historical transaction record corresponding to the user identifier.
As another optional way, the object recommendation module determines that recommending a business object may specifically be performing emotion recognition on the user; and determining a recommended service object according to the user emotion obtained by identification.
As yet another optional manner, the object recommendation module determines that recommending a business object may specifically be performing action recognition on the user; and if the first preset action is identified and obtained, processing the first business order.
In some embodiments, the apparatus may further comprise:
the action recognition module is used for carrying out action recognition on the user;
the first order processing module is further used for processing the first business order if the first preset action is obtained through identification.
Optionally, the first order processing module may process the first service order by combining the first preset action obtained by identification and the first order confirmation instruction.
In some embodiments, the apparatus may further comprise:
the biological recognition module is used for responding to the induction signal, collecting user biological information and carrying out biological information recognition on the user to obtain a user identifier;
the first order generation module is further configured to determine an object identifier of at least one target business object corresponding to the user identifier; generating a second business order based on the object identification of the at least one target business object;
the first order processing module is also used for identifying a second order confirmation instruction input by a user through voice; and processing the second business order based on the second order confirmation instruction.
In some embodiments, the determining, by the first order generation module, the object identifier of the at least one target business object corresponding to the user identifier may include: and determining the object identifier of at least one target business object according to the historical transaction record corresponding to the user identifier.
In some embodiments, the determining, by the first order generation module, the object identifier of the at least one target business object corresponding to the user identifier may include: and determining the object identifier of at least one target business object matched with the user characteristic according to the user characteristic corresponding to the user identifier.
Furthermore, the apparatus may further include:
the object confirmation prompting module is used for outputting object confirmation prompting information;
the first order processing module generates a second service order based on the object identifier of the at least one target service object, which may specifically be an object confirmation instruction input by the user, and generates the second service order based on the object identifier of the at least one target service object.
Optionally, the object confirmation prompting module may be specifically configured to display the object confirmation prompting information on a service interaction interface.
In some embodiments, the first order processing module recognizes the object confirmation instruction input by the user, and based on the object identifier of the at least one target business object, generating the second business order may specifically be based on the object identifier of the at least one target business object, in combination with the fourth preset action obtained by the action recognition module and the object confirmation instruction.
In some embodiments, the face recognition module may specifically respond to the sensing signal, and if the object selection instruction is not recognized, perform face recognition on the user to obtain a user identifier.
In some embodiments, the apparatus may further comprise:
the interface display module is used for responding to the induction signal and displaying a service interaction interface; and displaying the object related information of at least one business object on the business interaction interface.
Optionally, the interface display module may be further configured to display the first service order on the service interaction interface after generating the first service order based on the object selection instruction.
In some embodiments, the apparatus may further comprise:
the first service prompt module is used for outputting object selection prompt information; the object selection prompt message is used for prompting a user to input the object selection instruction in a voice mode;
based on the object selection instruction, after a first business order is generated, first order confirmation prompt information is output; the first order confirmation prompting message is used for prompting a user to input the first order confirmation instruction in a voice mode.
Optionally, the first service prompt module may specifically display the object selection prompt information on a service interaction interface; and displaying the first order confirmation prompt information on the service interaction interface.
In addition, the first service prompt module is further used for outputting first order updating prompt information after generating a first service order based on the object selection instruction; the first order updating prompt message is used for prompting a user to input the first order updating instruction.
Optionally, the first service prompt module may specifically display the first order update prompt information on a service interaction interface.
In addition, the first service prompt module is further configured to output first order cancellation prompt information after generating the first service order based on the object selection instruction; the first order cancellation prompting message is used for prompting a user to input the first order cancellation instruction.
Optionally, the first service prompt module may specifically display the first order cancellation prompt information on a service interaction interface.
In some embodiments, the apparatus may further comprise:
the first control display module is used for displaying a first operation control for executing order confirmation operation on the service interaction interface;
the first order processing module may be specifically configured to process the first service order based on the first order confirmation instruction or in response to a touch operation for the first operation control.
In some embodiments, the first control display module is further configured to display a second operation control for performing an order cancellation operation on the service interaction interface;
the apparatus may further include:
and the first order canceling module is used for canceling the first business order in response to the touch operation aiming at the second operation control.
In some embodiments, the apparatus may further comprise:
the first result feedback display module is used for displaying response result feedback information of the object selection instruction on a service interaction interface;
and displaying response result feedback information of the first order confirmation instruction on the service interaction interface after the first service order is processed based on the first order confirmation instruction.
In some embodiments, the first order processing module may be specifically configured to output first order settlement confirmation information based on the first order confirmation instruction; recognizing a first settlement confirmation instruction input by a user voice; and outputting first settlement prompt information based on the first settlement confirmation instruction.
Optionally, the first order processing module, based on the first settlement confirmation instruction, may specifically output the first settlement prompting message by displaying, on a service interaction interface, the first settlement prompting message including the first payment link; the first payment link is used for calling a third party payment system to carry out online payment.
Furthermore, in some embodiments, the apparatus may further comprise:
and the order printing module is used for printing the first business order if the payment of the first business order is successful.
In some embodiments, the first order processing module may be specifically configured to transmit the first service order to a processing end based on the first object confirmation instruction.
The information processing apparatus shown in fig. 7 may execute the information processing method described in the embodiment shown in fig. 1, fig. 2, or fig. 4, and the implementation principle and technical effect thereof are not repeated.
Fig. 8 is a schematic structural diagram of another embodiment of an information processing apparatus according to an embodiment of the present application, where the apparatus may further include:
an acquisition module 801, configured to acquire user biological information and user voice information;
a third identification module 802, configured to perform biological information identification on the user to obtain a user identifier;
an object determining module 803, configured to determine an object identifier of at least one target business object corresponding to the user identifier;
a second order generating module 804, configured to generate a second service order by combining the object identifier of the at least one target service object and the user voice information.
Furthermore, in some embodiments, the apparatus may further comprise:
the fourth identification module is used for determining a second order confirmation instruction according to the user voice information;
and the second order processing module is used for processing the second service order based on the second order confirmation instruction.
In some embodiments, the object confirmation module may be specifically configured to determine, according to the historical transaction record corresponding to the user identifier, an object identifier of at least one target service object corresponding to the user identifier.
In some embodiments, the object confirmation module may be specifically configured to determine, according to a user feature corresponding to the user identifier, an object identifier of at least one target service object corresponding to the user identifier.
In some embodiments, the apparatus may further comprise:
the object confirmation prompting module is used for outputting object confirmation prompting information;
the second order generation module may be specifically configured to determine an object confirmation instruction according to the user voice information; and generating a second business order based on the object identification of the at least one target business object in response to the object confirmation instruction.
In some embodiments, the apparatus may further comprise:
the action recognition module is used for carrying out action recognition on the user;
the second order generation module may be specifically configured to generate a second service order based on the object identifier of the at least one target service object in combination with the fourth preset action obtained through identification and the object confirmation instruction.
Furthermore, the apparatus may further include:
the second business prompt module is used for outputting object selection prompt information if the biological information identification fails;
the first recognition module is used for recognizing an object selection instruction input by a user voice; wherein the object selection instruction comprises at least one object identification;
the first order generation module is used for generating a first business order based on the object selection instruction;
the second identification module is used for identifying a first order confirmation instruction input by a user through voice;
and the first order processing module is used for processing the first service order based on the first order confirmation instruction.
In some embodiments, the apparatus may further comprise:
the second order updating module is used for determining a second order updating instruction according to the user voice information; the second order updating instruction comprises an object identifier and an updating requirement; and updating the second business order based on the second order updating instruction.
In some embodiments, the apparatus may further comprise:
the second order canceling module is used for determining a second order canceling instruction according to the user voice information; and canceling the second service order based on the second order canceling instruction.
In some embodiments, the second service prompt module is further configured to output a second order confirmation prompt message; and the second order confirmation prompt message is used for prompting a user to input the second order confirmation instruction by voice.
Optionally, the second service prompt module may display the second order confirmation prompt information on the service interaction interface.
In some embodiments, the second service prompt module is further configured to output a second order update prompt message; and the second order updating prompt message is used for prompting a user to input the second order updating instruction.
Optionally, the second service prompt module may display the second order update prompt information on the service interaction interface.
In some embodiments, the second service prompting module is further configured to output a second order cancellation prompting message; and the second order cancellation prompt message is used for prompting a user to input the second order cancellation instruction.
Optionally, the second service prompt module may display the second order cancellation prompt message on the service interaction interface.
In some embodiments, the apparatus may further include an interface display module for presenting a service interaction interface in response to the sensing signal; and displaying the object related information of at least one business object on the business interaction interface.
Optionally, the interface display module may be further configured to display a second service order on the service interaction interface after generating the second service order based on the object identifier of the at least one target service object.
Furthermore, in some embodiments, the apparatus may further comprise:
the second control display module is used for displaying a first operation control for executing order confirmation operation on the service interaction interface;
the second order processing module may be specifically configured to process the first service order based on the second order confirmation instruction or in response to a touch operation for the first operation control.
In some embodiments, the second control display module is further configured to display a second operation control for performing an order cancellation operation on the service interaction interface;
the apparatus may further include:
and the second order cancelling module is used for responding to the touch operation aiming at the second operation control and cancelling the second business order.
In some embodiments, the apparatus may further comprise:
and the second result feedback display module is used for displaying response result feedback information of the second order confirmation instruction on the service interaction interface.
In some embodiments, the second order processing module may be specifically configured to:
outputting second order settlement confirmation information based on the second order confirmation instruction;
recognizing a second settlement confirmation instruction input by the user through voice;
and outputting second settlement prompting information based on the second settlement confirming instruction.
Optionally, the outputting, by the second order processing module, the second settlement prompting information based on the second settlement confirmation instruction may specifically be: displaying second settlement prompting information comprising the first payment link on the service interaction interface; the first payment link is used for calling a third party payment system to carry out online payment.
Wherein, the device can also include:
and the printing module is used for printing the second business order if the payment of the second business order is successful.
In some embodiments, the second order processing module may retire to: and transmitting the first service order to a processing end based on the first object confirmation instruction.
The specific manner in which each module and unit of the information processing apparatus in the above embodiments perform operations has been described in detail in the embodiments related to the method, and will not be described in detail here.
In addition, the embodiment of the application also provides an information display device, which provides a service interaction interface; the service interaction interface is used for displaying service prompt information for executing service operation;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
In one possible design, the information processing apparatus of the embodiment shown in fig. 7 may be implemented as a service terminal, which may include a processing component 901, a storage component 902, a detection component 903, and a sound pickup component 904, as shown in fig. 9;
the storage component 902 stores one or more computer instructions, wherein the one or more computer instructions are invoked for execution by the processing component 901.
The processing component 901 is configured to:
detecting that the user is located in the sensing range of the service terminal through the detection component 903, and generating a sensing signal;
in response to the sensing signal, activating the pickup assembly 904 to collect voice information of the user;
determining an object selection instruction according to the user voice information; wherein the object selection instruction comprises at least one object identification;
and generating a first business order based on the object selection instruction.
The processing component 901 may include one or more processors to execute computer instructions to perform all or part of the steps of the above-described method. Of course, the processing elements may also be implemented as one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components configured to perform the above-described methods.
Storage component 902 is configured to store various types of data to support operation at a business terminal. The memory components may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The detection component 903 may be an image acquisition component or sensor, such as a thermal infrared sensor, a human proximity sensor, or the like.
Pickup assembly 904 may be a sound collection device such as a microphone.
In addition, the service terminal may further include:
the display component is used for providing a business interaction interface and displaying object related information of at least one business object on the business interaction interface; service prompt information for executing service operation can be displayed;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
The display element may be an Electroluminescent (EL) element, a liquid crystal display or a microdisplay having a similar structure, or a retina-directable display or similar laser scanning type display.
In addition, the service terminal may further include:
and the scanning component is used for calling the third-party payment system to realize online payment and the like through scanning the payment link.
The scanning assembly may be, for example, a scanning gun or the like.
Of course, it is understood that the service terminal may also include other components, such as input/output interfaces, communication components, etc., which are not described in detail herein.
In one possible design, the information processing apparatus of the embodiment shown in fig. 10 may be implemented as a service terminal, which may include a processing component 1001, a storage component 1002, a detection component 1003, and a sound pickup component 1004 as shown in fig. 10;
alternatively, the service terminal shown in fig. 10 and the service terminal shown in fig. 9 may be the same service terminal to perform different functional operations.
The storage component 1002 is one or more computer instructions, wherein the one or more computer instructions are for the processing component 701 to invoke for execution.
The processing component 1001 is configured to:
acquiring biological information of a user through the detection component 1003, and identifying the biological information of the user to obtain a user identifier;
determining an object identifier of at least one target business object corresponding to the user identifier;
collecting voice information of a user through the sound pickup assembly 1004;
and generating a second business order by combining the object identification of the at least one target business object and the user voice information.
The processing component 1001 may include one or more processors to execute computer instructions to perform all or part of the steps of the method described above. Of course, the processing elements may also be implemented as one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components configured to perform the above-described methods.
Storage component 1002 is configured to store various types of data to support operation at a business terminal. The memory components may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The detection component 1003 may be an image capture component or sensor, such as a thermal infrared sensor, a human proximity sensor, or the like.
The pickup assembly 1004 may be a sound collection device such as a microphone.
In addition, the service terminal may further include:
the display component is used for providing a business interaction interface and displaying object related information of at least one business object on the business interaction interface; service prompt information for executing service operation can be displayed;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
The display element may be an Electroluminescent (EL) element, a liquid crystal display or a microdisplay having a similar structure, or a retina-directable display or similar laser scanning type display.
In addition, the service terminal may further include:
and the scanning component is used for calling the third-party payment system to realize online payment and the like through scanning the payment link.
The scanning assembly may be, for example, a scanning gun or the like.
Of course, the service terminal may of course also comprise other components, such as input/output interfaces, communication components, etc.
In addition, an embodiment of the present application further provides a service terminal, as shown in fig. 11, the service terminal may include a processing component 1101, a storage component 1102, and a display component 1103;
alternatively, the service terminal shown in fig. 11 may be the same service terminal as the service terminal shown in fig. 9 or fig. 10, so as to implement different functional operations.
The storage component 1102 stores one or more computer program instructions; the one or more computer program instructions for invocation and execution by the processing component 1101;
the processing component 1101 is configured to:
providing a business interaction interface through the display component 1103;
the service interaction interface is used for displaying service prompt information for executing service operation;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
In addition, the display component 1103 is further configured to display object related information of at least one business object.
The display element 1103 may be an Electroluminescent (EL) element, a liquid crystal display or a micro-display having a similar structure, or a laser scanning type display in which the retina can directly display or the like.
Of course, the service terminal may of course also comprise other components, such as a detection component, a sound pick-up component, a scanning component, an input/output interface, a communication component, etc.
When the service terminal includes a detection component and a sound pickup component, reference may be made to the service terminal shown in fig. 9 or fig. 10.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (53)

1. An information processing method characterized by comprising:
detecting that a user is located in an induction range of a service terminal to generate an induction signal;
responding to the induction signal, and collecting user voice information;
determining an object selection instruction according to the user voice information; wherein the object selection instruction comprises at least one object identification;
and generating a first business order based on the object selection instruction.
2. The method of claim 1, wherein after generating the first business order based on the object selection instruction, the method further comprises:
determining a first order confirmation instruction according to the user voice information;
and processing the first business order based on the order confirmation instruction.
3. The method of claim 1, wherein after generating the first business order based on the object selection instruction, the method further comprises:
determining a first order updating instruction according to the user voice information;
and updating the first business order based on the first order updating instruction.
4. The method of claim 1, wherein after generating the first business order based on the object selection instruction, the method further comprises:
determining a first order cancelling instruction according to the user voice information;
and canceling the first service order based on the first order canceling instruction.
5. The method of claim 1, wherein prior to determining an object selection instruction based on the user speech information, the method further comprises:
determining a recommended service object;
based on the recommended service object, outputting object recommendation prompt information; the object recommendation prompting information is used for prompting a user to input an object selection instruction comprising an object identifier of the recommended service object by voice.
6. The method of claim 5, wherein determining the recommended business object comprises:
acquiring user biological information and carrying out biological identification on the user to obtain a user identifier;
and determining a recommended service object corresponding to the user identification.
7. The method of claim 6, wherein the determining the recommended service object corresponding to the user identifier comprises:
and determining a recommended service object according to the historical transaction record corresponding to the user identification.
8. The method of claim 5, wherein determining the recommended business object comprises:
performing emotion recognition on the user;
and determining a recommended service object according to the user emotion obtained by identification.
9. The method of claim 1, wherein after generating the first business order based on the object selection instruction, the method further comprises:
performing action recognition on the user;
and if the first preset action is identified and obtained, processing the first business order.
10. The method of claim 2, wherein after generating the first business order based on the object selection instruction, the method further comprises:
performing action recognition on the user;
the processing the first business order based on the first object confirmation instruction comprises:
and processing the first service order by combining the first preset action obtained by identification and the first order confirmation instruction.
11. The method of claim 1, further comprising:
responding to the induction signal, acquiring biological information of a user, and identifying the biological information of the user to obtain a user identifier;
determining an object identifier of at least one target business object corresponding to the user identifier;
and generating a second business order based on the object identification of the at least one target business object.
12. The method of claim 11, wherein the determining the object identifier of the at least one target business object corresponding to the user identifier comprises:
and determining the object identifier of at least one target business object according to the historical transaction record corresponding to the user identifier.
13. The method of claim 11, wherein the determining the object identifier of the at least one target business object corresponding to the user identifier comprises:
and determining the object identifier of at least one target business object matched with the user characteristic according to the user characteristic corresponding to the user identifier.
14. The method of claim 11, wherein after determining the object identifier of the at least one target business object corresponding to the user identifier, the method further comprises:
outputting object confirmation prompt information;
the generating a second business order based on the object identifier of the at least one target business object comprises:
determining an object confirmation instruction according to the user voice information;
and generating a second business order based on the object identification of the at least one target business object in response to the object confirmation instruction.
15. The method of claim 14, wherein outputting the object confirmation prompt comprises:
and displaying the object confirmation prompt information on a service interaction interface.
16. The method of claim 14, wherein after outputting the object confirmation prompt, the method further comprises:
performing action recognition on the user;
the recognizing the object confirmation instruction input by the user, and the generating the second business order based on the object identifier of the at least one target business object comprises:
and generating a second business order based on the object identification of the at least one target business object by combining the fourth preset action obtained by identification and the object confirmation instruction.
17. The method of claim 11, wherein the collecting user biometric information and biometrically identifying the user to obtain a user identification in response to the sensing signal comprises:
responding to the induction signal, if the object selection instruction is not identified, acquiring biological information of the user and carrying out biological identification on the user to obtain a user identifier.
18. The method of claim 1, further comprising:
responding to the induction signal, and displaying a service interaction interface;
and displaying the object related information of at least one business object on the business interaction interface.
19. The method of claim 1, further comprising:
outputting object selection prompt information; and the object selection prompt message is used for prompting a user to input the object selection instruction by voice.
20. The method of claim 2, wherein after generating the first business order based on the object selection instruction, the method further comprises:
outputting first order confirmation prompt information; the first order confirmation prompting message is used for prompting a user to input the first order confirmation instruction in a voice mode.
21. The method of claim 3, wherein after generating the first business order based on the object selection instruction, the method further comprises:
outputting a first order updating prompt message; the first order updating prompt message is used for prompting a user to input the first order updating instruction.
22. The method of claim 4, wherein after generating the first business order based on the object selection instruction, the method further comprises:
outputting first order cancellation prompt information; the first order cancellation prompting message is used for prompting a user to input the first order cancellation instruction.
23. The method of claim 19, wherein outputting the object selection prompt comprises:
and displaying the object selection prompt information on a service interaction interface.
24. The method of claim 18, wherein after generating the first business order based on the object selection instruction, the method further comprises:
and displaying the first business order on the business interaction interface.
25. The method of claim 1, wherein after generating the first business order based on the object selection instruction, the method further comprises:
displaying a first operation control for executing order confirmation operation on a business interaction interface;
and responding to the touch operation aiming at the first operation control, and processing the first business order.
26. The method of claim 1, wherein after generating the first business order based on the object selection instruction, the method further comprises:
displaying a second operation control for executing order cancellation operation on the business interaction interface;
after generating the first business order based on the object selection instruction, the method further includes:
and canceling the first business order in response to the touch operation aiming at the second operation control.
27. The method of claim 2, wherein after generating the first business order based on the object identification and the selection requirement, the method further comprises:
displaying response result feedback information of the object selection instruction on a service interaction interface;
after processing the first service order based on the first order confirmation instruction, the method further includes:
and displaying response result feedback information of the first order confirmation instruction on the service interaction interface.
28. The method of claim 2, wherein processing the first business order based on the first order confirmation instruction comprises:
outputting first order settlement confirmation information based on the first order confirmation instruction;
recognizing a first settlement confirmation instruction input by a user voice;
and outputting first settlement prompt information based on the first settlement confirmation instruction.
29. The method of claim 28, wherein outputting a first settlement prompting message based on the first settlement confirmation instruction comprises:
displaying first settlement prompt information comprising a first payment link on a service interaction interface; the first payment link is used for calling a third party payment system to carry out online payment;
and if the payment of the first business order is successful, printing the first business order.
30. The method of claim 1, wherein processing the first business order based on the first object confirmation instruction comprises:
and transmitting the first service order to a processing end based on the first object confirmation instruction.
31. An information processing method characterized by comprising:
acquiring biological information of a user and identifying the biological information of the user to obtain a user identifier;
determining an object identifier of at least one target business object corresponding to the user identifier;
collecting user voice information;
and generating a second business order by combining the object identification of the at least one target business object and the user voice information.
32. The method of claim 31, wherein after generating a second business order in conjunction with the object identification of the at least one target business object and the user voice information, the method further comprises:
determining a second order confirmation instruction according to the user voice information;
and generating a second business order based on the object identification of the at least one target business object.
33. The method of claim 31, wherein the collecting the user biometric information and performing the biometric information recognition on the user to obtain the user identifier comprises:
detecting that a user is located in an induction range of a service terminal to generate an induction signal;
and responding to the induction signal, acquiring the biological information of the user, and identifying the biological information of the user to obtain a user identifier.
34. The method of claim 31, further comprising:
performing emotion recognition on the user;
the determining the object identifier of the at least one target business object corresponding to the user identifier includes:
and determining the object identifier of at least one target business object corresponding to the user identifier according to the user emotion obtained by identification.
35. The method of claim 31, wherein the determining the object identifier of the at least one target business object corresponding to the user identifier comprises:
and determining the object identifier of at least one target business object corresponding to the user identifier according to the historical transaction record corresponding to the user identifier.
36. The method of claim 31, wherein the determining the object identifier of the at least one target business object corresponding to the user identifier comprises:
and determining the object identifier of at least one target business object corresponding to the user identifier according to the user characteristics corresponding to the user identifier.
37. The method of claim 31, wherein after determining the object identifier of the at least one target business object corresponding to the user identifier, the method further comprises:
outputting object confirmation prompt information;
the generating a second service order by combining the object identifier of the at least one target service object and the user voice information comprises:
determining an object confirmation instruction according to the user voice information;
and generating a second business order based on the object identification of the at least one target business object in response to the object confirmation instruction.
38. The method of claim 37, wherein after outputting the object confirmation prompt, the method further comprises:
performing action recognition on the user;
the generating a second business order based on the object identification of the at least one target business object in response to the object confirmation instruction comprises:
and generating a second business order based on the object identification of the at least one target business object by combining the fourth preset action obtained by identification and the object confirmation instruction.
39. The method of claim 31, further comprising:
if the biological information identification fails, outputting object selection prompt information;
determining an object selection instruction according to the user voice information; wherein the object selection instruction comprises at least one object identification;
generating a first business order based on the object selection instruction;
determining a first order confirmation instruction according to the user voice information;
and processing the first business order based on the first order confirmation instruction.
40. An information display method, comprising:
providing a service interaction interface;
displaying service prompt information for executing service operation on the service interaction interface;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
41. The method of claim 40, further comprising:
displaying an operation control corresponding to the business operation on the business interaction interface;
the triggering operation aiming at the operation control is used for triggering and executing the corresponding business operation
42. The method of claim 40, further comprising:
and responding to the voice input aiming at the service prompt information, and displaying a voice recognition result of the voice information of the user on the service interaction interface.
43. The method of claim 40, wherein while the service interaction interface displays service prompt information for performing a service operation, the method further comprises:
and displaying service scene prompt information corresponding to the service operation on the service interaction interface.
44. The method of claim 40, wherein the business operations comprise an object selection operation, an object confirmation operation, an order cancellation operation, an order update operation, or an order settlement operation.
45. An information processing method characterized by comprising:
detecting that a user is located in an induction range of the ordering terminal to generate an induction signal;
responding to the induction signal, and collecting user voice information;
determining a meal selection instruction according to the user voice information; wherein the meal selection instruction comprises at least one meal name;
and generating a first food order based on the food selection instruction.
46. An information processing method characterized by comprising:
acquiring biological information of a user and identifying the biological information of the user to obtain a user identifier;
determining the name of at least one target food corresponding to the user identification;
collecting user voice information;
and generating a second food order by combining the name of the at least one target food and the user voice information.
47. An information display method, comprising:
providing an ordering interactive interface;
displaying service prompt information for executing service operation on the ordering interactive interface;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
48. An information processing apparatus characterized by comprising:
the detection module is used for detecting that the user is positioned in the sensing range of the service terminal and generating a sensing signal;
the first response module is used for responding to the induction signal and acquiring user voice information;
the first identification module is used for determining an object selection instruction according to the user voice information; wherein the object selection instruction comprises at least one object identification;
and the first order generation module is used for generating a first business order based on the object selection instruction.
49. An information processing apparatus characterized by comprising:
the acquisition module is used for acquiring user biological information and user voice information;
the third identification module is used for identifying biological information of the user to obtain a user identifier;
the object determining module is used for determining the object identifier of at least one target business object corresponding to the user identifier;
and the second order generation module is used for generating a second business order by combining the object identifier of the at least one target business object and the user voice information.
50. An information display device is characterized in that a service interaction interface is provided;
the service interaction interface is used for displaying service prompt information for executing service operation;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
51. A business terminal is characterized by comprising a processing component, a storage component, a detection component and a pickup component;
the storage component stores one or more computer program instructions; the one or more computer program instructions for invocation and execution by the processing component;
the processing component is to:
detecting that the user is positioned in the sensing range of the service terminal through the detection assembly to generate a sensing signal;
responding to the induction signal, starting the pickup assembly to collect voice information of a user;
determining an object selection instruction according to the user voice information; wherein the object selection instruction comprises at least one object identification;
and generating a first business order based on the object selection instruction.
52. A business terminal is characterized by comprising a processing component, a storage component, a detection component and a pickup component;
the storage component stores one or more computer program instructions; the one or more computer program instructions for invocation and execution by the processing component;
the processing component is to:
acquiring biological information of a user through the detection assembly and identifying the biological information of the user to obtain a user identifier;
determining an object identifier of at least one target business object corresponding to the user identifier;
collecting voice information of a user through the pickup assembly;
and generating a second business order by combining the object identification of the at least one target business object and the user voice information.
53. A business terminal is characterized by comprising a processing component, a storage component and a display component;
the storage component stores one or more computer program instructions; the one or more computer program instructions for invocation and execution by the processing component;
the processing component is to:
providing a service interaction interface through the display component;
the service interaction interface is used for displaying service prompt information for executing service operation;
the service prompt information is used for prompting a user to input a service instruction by voice; the service instruction is used for triggering and executing corresponding service operation.
CN201810621641.7A 2018-06-15 2018-06-15 Information processing method, information display method, device and service terminal Pending CN110610249A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810621641.7A CN110610249A (en) 2018-06-15 2018-06-15 Information processing method, information display method, device and service terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810621641.7A CN110610249A (en) 2018-06-15 2018-06-15 Information processing method, information display method, device and service terminal

Publications (1)

Publication Number Publication Date
CN110610249A true CN110610249A (en) 2019-12-24

Family

ID=68888377

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810621641.7A Pending CN110610249A (en) 2018-06-15 2018-06-15 Information processing method, information display method, device and service terminal

Country Status (1)

Country Link
CN (1) CN110610249A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111312241A (en) * 2020-02-10 2020-06-19 深圳创维-Rgb电子有限公司 Unmanned shopping guide method, terminal and storage medium
CN112764620A (en) * 2021-01-25 2021-05-07 北京三快在线科技有限公司 Interactive request processing method and device, electronic equipment and readable storage medium
CN113037924A (en) * 2021-01-27 2021-06-25 维沃移动通信有限公司 Voice sending method and device and electronic equipment
CN115101048A (en) * 2022-08-24 2022-09-23 深圳市人马互动科技有限公司 Science popularization information interaction method, device, system, interaction equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100228639A1 (en) * 2009-03-05 2010-09-09 Barclays Bank Delaware Systems And Methods To Initiate Payments From Electronic Devices
CN103632319A (en) * 2013-11-14 2014-03-12 成都博约创信科技有限责任公司 Order system based on voice identification technology
CN105894405A (en) * 2016-04-25 2016-08-24 百度在线网络技术(北京)有限公司 Ordering interactive system and method based on artificial intelligence
CN105931145A (en) * 2016-05-06 2016-09-07 乐视控股(北京)有限公司 Intelligent ordering method and apparatus
CN107424013A (en) * 2017-08-01 2017-12-01 深圳市益廷科技有限公司 A kind of hotel self-service meal ordering system
CN107578320A (en) * 2017-09-19 2018-01-12 拉扎斯网络科技(上海)有限公司 Booking method for meal and relevant apparatus based on interactive voice

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100228639A1 (en) * 2009-03-05 2010-09-09 Barclays Bank Delaware Systems And Methods To Initiate Payments From Electronic Devices
CN103632319A (en) * 2013-11-14 2014-03-12 成都博约创信科技有限责任公司 Order system based on voice identification technology
CN105894405A (en) * 2016-04-25 2016-08-24 百度在线网络技术(北京)有限公司 Ordering interactive system and method based on artificial intelligence
CN105931145A (en) * 2016-05-06 2016-09-07 乐视控股(北京)有限公司 Intelligent ordering method and apparatus
CN107424013A (en) * 2017-08-01 2017-12-01 深圳市益廷科技有限公司 A kind of hotel self-service meal ordering system
CN107578320A (en) * 2017-09-19 2018-01-12 拉扎斯网络科技(上海)有限公司 Booking method for meal and relevant apparatus based on interactive voice

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111312241A (en) * 2020-02-10 2020-06-19 深圳创维-Rgb电子有限公司 Unmanned shopping guide method, terminal and storage medium
CN112764620A (en) * 2021-01-25 2021-05-07 北京三快在线科技有限公司 Interactive request processing method and device, electronic equipment and readable storage medium
CN112764620B (en) * 2021-01-25 2022-06-21 北京三快在线科技有限公司 Interactive request processing method and device, electronic equipment and readable storage medium
CN113037924A (en) * 2021-01-27 2021-06-25 维沃移动通信有限公司 Voice sending method and device and electronic equipment
CN113037924B (en) * 2021-01-27 2022-11-25 维沃移动通信有限公司 Voice transmission method, device, electronic equipment and readable storage medium
CN115101048A (en) * 2022-08-24 2022-09-23 深圳市人马互动科技有限公司 Science popularization information interaction method, device, system, interaction equipment and storage medium
CN115101048B (en) * 2022-08-24 2022-11-11 深圳市人马互动科技有限公司 Science popularization information interaction method, device, system, interaction equipment and storage medium

Similar Documents

Publication Publication Date Title
US11763361B2 (en) Augmented reality systems for facilitating a purchasing process at a merchant location
US11496792B2 (en) Interactive video overlay with persistent cart
CN110610249A (en) Information processing method, information display method, device and service terminal
EP3479588B1 (en) Augmented reality device and operation thereof
US10410188B2 (en) Electronic check splitting system, method and apparatus
US9489702B2 (en) Information processing device, data processing method thereof, and program
US20130117153A1 (en) Fully interactive, wireless, retail video display tag, integrated with content distribution, data management, feedback data collection, inventory and product price search capabilities
US20150215674A1 (en) Interactive streaming video
JP4928592B2 (en) Image processing apparatus and program
JP2006209550A (en) Information providing device, information providing system, and vending machine
TW201506834A (en) Questionnaire system, questionnaire response device, questionnaire response method, and questionnaire response program
US20180089706A1 (en) Systems And Methods for Generating Surveys
WO2019128908A1 (en) Data object information processing method, apparatus, and system, and electronic device
JP2014081888A (en) Order support device, order support method and order support program
CN112216042A (en) Cash register with double display screens, information interaction method and device and medium
KR101923591B1 (en) Method for menu ordering using character
KR20210003639A (en) Customer management device and customer management method
US9792617B2 (en) Systems and methods for generating surveys
CN112036865A (en) Service providing method, device and equipment
US20150154690A1 (en) Interactive electronic menu, ordering, monitoring and payment system and method therefor
US20200258104A1 (en) Dual-Function Button for Emails and Implementations in Surveys
US20140157133A1 (en) System And Methods for Generating Surveys
US9483774B2 (en) Systems and methods for generating surveys
US11069354B2 (en) Voice-based transaction terminal ordering
US9576316B2 (en) Dynamic menus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40019517

Country of ref document: HK

RJ01 Rejection of invention patent application after publication

Application publication date: 20191224

RJ01 Rejection of invention patent application after publication