CN113450497A

CN113450497A - Information processing method and device and electronic equipment

Info

Publication number: CN113450497A
Application number: CN202010219364.4A
Authority: CN
Inventors: 杨智慧; 付强; 吴楠; 吴登峰; 韩卫生; 彭傊; 纳跃跃; 马骁
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2020-03-25
Filing date: 2020-03-25
Publication date: 2021-09-28

Abstract

The embodiment of the application discloses an information processing method and device and electronic equipment. The method is applied to the vending machine, the vending machine comprises a pedestrian detection module, a sound collection module, a voice broadcast module and a processing module, and the method comprises the following steps: when the processing module obtains the human body perception information collected by the pedestrian detection module, the voice broadcasting module is used for carrying out voice broadcasting on first prompt information; if the voice data collected by the voice collection module is obtained, extracting operation instruction information of a user from the voice data; and executing relevant operation according to the operation instruction information. By the scheme, the cost of realizing the active interaction function is reduced, and the safety of user data is ensured.

Description

Information processing method and device and electronic equipment

Technical Field

The present application relates to the field of vending machine technology, and in particular, to an information processing method, an information processing apparatus, an electronic device, an application program, a circuit board, a device, and a vending machine host.

Background

A Vending Machine (VEM) is a Machine that can automatically dispense money according to the money put in. The vending machine is a common commercial automation device, is not limited by time and place, can save manpower and facilitate transaction, and is a brand new commercial retail form, namely a micro supermarket with 24-hour business.

Conventional vending machines generally vend objects of merchandise in a passive manner. For example, a consumer user with a purchase demand walks in front of the device, can select goods according to the own demand after awakening the device, and the host of the vending machine can prompt the user to enter a payment process after obtaining the goods selection information submitted by the user, and can carry out goods discharge processing after obtaining the information of successful payment, and send the goods object selected by the user to a goods delivery port to complete the selling processing process.

In order to improve the transaction amount of the vending machine and enhance the shopping interest of the user, the vending machine actively initiates interaction, and a shopping guide selling mode for pedestrians passing through the vending machine becomes a trend. In the mode, how to detect the change condition of people around the equipment and the important premise of active cost interaction.

At present, the main method is to collect images around the device through a camera configured on a host computer for face payment, determine whether pedestrians appear around the device through image analysis, and then initiate active interaction. Such a detection method may have a problem of collecting user data without obtaining user authorization, so that the privacy of the user is at risk of being revealed, for example, the user is located based on the location of the vending machine. In addition, because of the camera that people's face payment demand configured, do not support long-time work usually, the image acquisition that lasts leads to the camera to generate heat very easily, and then influences the life of camera, and the camera long-time work still can increase equipment power consumption, increases the use cost of vending machine.

If the camera of face payment is reformed transform, replace by the camera of high performance, then can improve the use cost of vending machine greatly, compare in the commodity object of vending machine (the commodity of the equal price such as beverage, food), the feasibility of reforming so relatively poor.

Disclosure of Invention

The application provides an information processing method, an information processing device and electronic equipment, which can carry out selling processing on commodity objects in an active interaction mode, and are beneficial to reducing the cost of realizing an active interaction function and ensuring the safety of user data.

The application provides the following scheme:

an information processing method is applied to a vending machine, the vending machine comprises a pedestrian detection module, a sound collection module, a voice broadcast module and a processing module, and the method comprises the following steps:

when the processing module obtains the human body perception information collected by the pedestrian detection module, the voice broadcasting module is used for carrying out voice broadcasting on first prompt information;

if the voice data collected by the voice collection module is obtained, extracting operation instruction information of a user from the voice data;

and executing relevant operation according to the operation instruction information.

An application program, comprising:

the system comprises a first interface, a second interface, a third interface and an information processing program module;

the first interface is used for receiving the calling of a pedestrian detection module of the vending machine and acquiring the human body perception information acquired by the pedestrian detection module;

the second interface is used for calling a voice broadcasting module of the vending machine and sending the first prompt information to the voice broadcasting module for broadcasting;

the third interface is used for receiving the call of a sound acquisition module of the vending machine and acquiring the voice data acquired by the sound acquisition module;

and the information processing program module is used for extracting the operation instruction information of the user from the voice data and executing related operation according to the operation instruction information.

An information processing method comprising:

the vending machine loads an installation package corresponding to the application program;

the application is started so as to initiate active voice interaction for a user passing through the vending machine when human perception information is obtained.

An information processing method comprising:

when a first client associated with the vending machine obtains human body perception information, voice broadcasting is carried out on first prompt information through a voice broadcasting module of the vending machine, and the human body perception information is collected by a pedestrian detection module of the vending machine;

if the voice data collected by the sound collection module of the vending machine is obtained, extracting the operation instruction information of the user from the voice data;

and forwarding the operation instruction information to a second client associated with a host of the vending machine, so that the second client executes related operations according to the operation instruction information.

An information processing method comprising:

a second client associated with a host of the vending machine obtains operation instruction information of a user sent by a first client, wherein the operation instruction information is extracted from voice data collected by the first client from a voice collecting module of the vending machine, and the voice data is collected after human body perception information collected by a pedestrian detecting module of the vending machine and a voice broadcasting module of the vending machine broadcast first prompt information of pedestrians passing through the vending machine are obtained at the first client;

An application program, comprising:

an interface module and an information processing program module;

the interface module is used for receiving the call of a communication interface of a host of the vending machine, obtaining operation instruction information sent by a first client through the communication interface, wherein the operation instruction information is extracted from voice data collected by a voice collecting module of the vending machine from the first client, and the voice data is collected after human body perception information collected by a pedestrian detecting module of the vending machine is obtained at the first client and first prompt information broadcast is carried out on pedestrians passing through the vending machine by the voice broadcasting module of the vending machine;

and the information processing program module is used for executing related operations according to the operation instruction information.

An information processing method comprising:

loading an installation package corresponding to the application program by a host of the vending machine;

and starting the application program so as to execute relevant operation according to the operation instruction information when the operation instruction information of the user sent by the first client is obtained.

A circuit for actively carrying out voice interaction is applied to a vending machine and comprises:

the system comprises a processing module, a pedestrian detection module, a sound acquisition module, a voice broadcast module and an interface module;

the processing module is used for carrying out voice broadcast on first prompt information through the voice broadcast module when the human body perception information acquired by the pedestrian detection module is obtained, and extracting operation instruction information of a user from voice data acquired by the voice acquisition module;

the interface module is used for sending the operation instruction information extracted by the processing module to a host of the vending machine so that the host can execute relevant operations according to the operation instruction information.

A circuit board for proactive voice interaction comprising:

the pedestrian detection device comprises a circuit board body, a processing module, a pedestrian detection module, a sound collection module, a voice broadcast module and an interface module;

the circuit board body comprises a first surface and a second surface which are correspondingly arranged, the processing module, the voice broadcasting module and the interface module are distributed on the first surface, and the pedestrian detection module and the sound collection module are distributed on the second surface;

the processing module is respectively electrically connected with the pedestrian detection module, the sound collection module, the voice broadcast module and the interface module.

A circuit board for proactive voice interaction comprising:

a first sub circuit board and a second sub circuit board;

the first sub circuit board comprises a first sub circuit board body, and a processing module, a voice broadcasting module and an interface module which are arranged on the surface of one side of the first sub circuit board body;

the second sub circuit board comprises a second sub circuit board body, and a pedestrian detection module and a sound collection module which are arranged on the surface of one side of the second sub circuit board body;

An equipment for actively conducting voice interaction, the equipment being installed on a cabinet of a vending machine and electrically connected with a host of the vending machine, the equipment comprising:

the shell and the circuit board actively performing voice interaction;

the shell is provided with at least two open holes, and the circuit board is arranged in the shell, and the pedestrian detection module and the sound collection module which are arranged on the circuit board face the different open holes respectively.

A vending machine host, comprising:

the host computer shell, the host computer processing module, the display module and the circuit board which actively carries out voice interaction;

the host processing module and the circuit board which actively carries out voice interaction are arranged inside the host shell, and the host processing module is electrically connected with a processing module in the circuit;

the host casing has the surrounding the frame of display module, be provided with on the frame with pedestrian detection module and sound acquisition module assorted trompil in the circuit.

An information processing method is applied to equipment for actively carrying out voice interaction, the equipment comprises a pedestrian detection module, a sound collection module, a voice broadcast module and a processing module, and the method comprises the following steps:

the processing module obtains the related information of the commodity object provided by the entity shop related to the equipment;

when the human body perception information collected by the pedestrian detection module is obtained, voice broadcasting is carried out on first prompt information through the voice broadcasting module;

and if the operation instruction information of the user is extracted from the voice data acquired by the voice acquisition module and the operation instruction information comprises the identification information of the target commodity object selected by the user, generating an order request and submitting the order request to a fulfillment platform.

An information processing apparatus applied to a vending machine, comprising:

the human body perception information obtaining unit is used for obtaining human body perception information collected by a pedestrian detection module of the vending machine;

the voice broadcasting unit is used for carrying out voice broadcasting on the first prompt information through a voice broadcasting module of the vending machine;

the operation instruction information extraction unit is used for extracting operation instruction information of a user from voice data acquired by a sound acquisition module of the vending machine when the voice data are acquired;

and the operation execution unit is used for executing related operations according to the operation instruction information.

An information processing apparatus applied to a first client associated with a vending machine, comprising:

and the operation instruction information sending unit is used for forwarding the operation instruction information to a second client associated with the host of the vending machine so that the second client can execute related operations according to the operation instruction information.

An information processing apparatus applied to a host-associated second client of a vending machine, comprising:

the system comprises an operation instruction information obtaining unit, a voice broadcasting module and a control unit, wherein the operation instruction information obtaining unit is used for obtaining operation instruction information of a user sent by a first client, the operation instruction information is extracted from voice data collected by the voice collecting module of the vending machine from the first client, and the voice data is obtained after human body perception information collected by a pedestrian detecting module of the vending machine and first prompt information broadcast of pedestrians passing through the vending machine are obtained by the voice broadcasting module of the vending machine at the first client;

An information processing device applied to equipment for actively carrying out voice interaction comprises the following components:

a related information obtaining unit configured to obtain related information of a commodity object provided by an entity store associated with the device;

the human body perception information obtaining unit is used for obtaining human body perception information collected by a pedestrian detection module of the equipment;

the voice broadcasting unit is used for carrying out voice broadcasting on the first prompt information through a voice broadcasting module of the equipment;

the operation instruction information extraction unit is used for extracting operation instruction information of a user from the voice data acquired by the voice acquisition module, wherein the operation instruction information comprises identification information of a target commodity object selected by the user;

and the request submitting unit is used for generating an order request and submitting the order request to the fulfillment platform.

An electronic device, comprising:

one or more processors; and

a memory associated with the one or more processors for storing program instructions that, when read and executed by the one or more processors, perform operations comprising:

when human body perception information acquired by a pedestrian detection module of the equipment is obtained, voice broadcasting is carried out on first prompt information through a voice broadcasting module of the equipment;

if the voice data collected by the sound collection module of the equipment is obtained, extracting the operation instruction information of the user from the voice data;

An electronic device, comprising:

one or more processors; and

when human body perception information is obtained, voice broadcasting is carried out on first prompt information through a voice broadcasting module of the vending machine, and the human body perception information is collected by a pedestrian detection module of the vending machine;

An electronic device, comprising:

one or more processors; and

the method comprises the steps that operation instruction information of a user sent by a first client side is obtained, wherein the operation instruction information is extracted from voice data collected by a voice collecting module of a vending machine by the first client side, and the voice data is collected after human body perception information collected by a pedestrian detecting module of the vending machine and a voice broadcasting module of the vending machine broadcast first prompt information of pedestrians passing through the vending machine are obtained at the first client side;

An electronic device, comprising:

one or more processors; and

obtaining related information of a commodity object provided by an entity shop related to the equipment;

and if the operation instruction information of the user is extracted from the voice data acquired by the voice acquisition module of the equipment and the operation instruction information comprises the identification information of the target commodity object selected by the user, generating an order request and submitting the order request to a fulfillment platform.

According to the specific embodiments provided herein, the present application discloses the following technical effects:

this application embodiment can detect the people situation of change around the vending machine through pedestrian detection module, and someone can obtain human perception information and send to processing module when passing through the vending machine, triggers processing module and gets into the initiative mutual flow, carries out voice broadcast to first prompt message through the voice broadcast module to this carries out the shopping guide to the user. If the user hears the information that the voice broadcast module broadcasts, carry out voice interaction with the vending machine, the voice acquisition module then can be with the speech data transmission who gathers to processing module, the operation instruction information of user is extracted from it by processing module, and carry out relevant operation according to operation instruction information, and when needing to carry out interaction on next step with the user, obtain the relevant prompt information of operation, carry out voice broadcast to the relevant prompt information of operation through the voice broadcast module, realize the further guide to user's shopping action.

According to the scheme, the method does not simply depend on the image information acquired by the camera, the cost of realizing the active interaction function is reduced, and the safety of user data is improved. Specifically, for a vending machine which is not provided with a camera, image information of pedestrians passing around the vending machine cannot be collected in the active interaction process, and the privacy of a user can be prevented from being revealed; for the vending machine provided with the camera, the camera can be started as required to collect image information under the condition of obtaining user authorization, so that the working time of the camera can be reduced, and the influence on the service life of the camera caused by continuous working is avoided; but also can prevent the camera from randomly shooting the image information of all the pedestrians passing around the vending machine, thereby improving the use safety of the camera.

Of course, it is not necessary for any product to achieve all of the above-described advantages at the same time for the practice of the present application.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

FIG. 1 is a schematic view of a vending machine provided by an embodiment of the present application;

FIGS. 2-8 are flow charts of methods provided by embodiments of the present application;

FIGS. 9-12 are schematic views of apparatus provided by embodiments of the present application;

fig. 13 is a schematic diagram of an architecture of an electronic device provided in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments that can be derived from the embodiments given herein by a person of ordinary skill in the art are intended to be within the scope of the present disclosure.

The embodiment of the application can provide a circuit for actively carrying out voice interaction, and the circuit can be applied to vending machines and used for realizing pedestrian detection and voice interaction. The method specifically comprises the following steps: processing module, pedestrian detection module, sound collection module and voice broadcast module. As an example, the pedestrian detection module may be embodied as a human body sensor, the sound collection module may be embodied as a microphone, and the voice broadcast module may be embodied as a speaker.

In the practical application process, the processing module can be matched with other modules, and the shopping guide of the pedestrians passing through the vending machine is realized in a voice mode. Specifically, the processing module can obtain pre-configured first prompt information when human body perception information collected by the pedestrian detection module is obtained, and the voice broadcast module is used for carrying out voice broadcast on the first prompt information; after voice broadcasting, if voice data acquired by the voice acquisition module are acquired, operation instruction information of a user can be extracted from the voice data, and related operations are executed according to the operation instruction information, so that shopping guide service is provided for the user.

Or, in the practical application process, the function of the implementation process of the shopping guide can be split according to the use requirement. As an example, a portion of the functionality may be implemented by the circuitry actively engaged in voice interaction, e.g., by the circuitry engaged in pedestrian detection and actively initiating voice interaction; some functions may be implemented by the host computer of the vending machine, for example, by the host computer performing related operations according to the operation instruction information. Correspondingly, the circuit can also comprise an interface module which is used for realizing the electrical connection between the processing module in the circuit and the vending machine host, sending the operation instruction information extracted by the processing module to the host and triggering the host to execute the relevant operation according to the operation instruction information.

In this implementation, for the power supply of each component in the circuit, a power supply source may be provided in the circuit; or, after the interface module is electrically connected to the host, the host supplies power to the circuit, which is not specifically limited in the embodiment of the present application.

In the embodiment of the application, the sound acquisition module can be in a working state all the time and acquires the voice data input by a user at any time; or, the sound collection module may be activated by the processing module, for example, when the processing module determines that a pedestrian passes through the vending machine, the processing module may trigger the sound collection module to switch to the operating state, and start to collect the voice data.

Correspondingly, the embodiment of the application can provide the circuit board for actively carrying out voice interaction. In one mode, the active voice interaction circuit may be disposed on a circuit board. Correspondingly, the circuit board body can include a first surface and a second surface which are correspondingly arranged, and each part of the circuit can be respectively arranged on the first surface and the second surface. For example, processing module, voice broadcast module and interface module can be arranged on the first surface, pedestrian detection module and sound collection module are arranged on the second surface, and processing module is ensured to be electrically connected with pedestrian detection module, sound collection module, voice broadcast module and interface module respectively.

Or, in another mode, the above active voice interaction circuit may be arranged on at least two circuit boards. Taking two circuit boards as an example, the two circuit boards may include a first sub circuit board and a second sub circuit board. The first sub circuit board can comprise a first sub circuit board body, and a processing module, a voice broadcasting module and an interface module which are arranged on the surface of one side of the first sub circuit board body; the second sub circuit board can comprise a second sub circuit board body, and a pedestrian detection module and a sound collection module which are arranged on the surface of one side of the second sub circuit board body; in addition, the processing module can be respectively electrically connected with the pedestrian detection module, the sound collection module, the voice broadcast module and the interface module. For example, the first sub circuit board and the second sub circuit board can be electrically connected through the flexible flat cable, so that data interaction between the processing module and the pedestrian detection module and between the processing module and the sound collection module can be realized.

Based on the circuit board, the embodiment of the present application may provide a device for actively performing voice interaction (i.e., the circuit board may be installed in a device independent from a host), and the device may include a housing and any one of the above circuit boards. Wherein, be provided with two at least trompils on the casing, and the circuit board when installing inside the casing, pedestrian detection module and the sound collection module who lays on the circuit board are towards different trompils respectively, and wherein, the shape and the position of trompil and the shape and the position phase-match of pedestrian detection module and the sound collection module that correspond rather than. Therefore, the pedestrian detection module can collect human body perception information through the corresponding opening hole, and the sound collection module can collect voice data input by a user through the corresponding opening hole. The equipment for actively carrying out voice interaction can be arranged on a box body of the vending machine and is electrically connected with a host machine of the vending machine, so that data interaction can be carried out between the processing module arranged on the circuit board and the host machine processing module.

Or, based on the circuit board, the embodiment of the application can provide a vending machine host with an active voice interaction function (that is, the circuit board can be installed inside the host), and the host can be installed on a box body of the vending machine, so as to detect pedestrians around the vending machine, initiate an active interaction process when it is determined that someone passes through the vending machine, and guide shopping for a user. Specifically, the host may include a host housing, a host processing module, a display module, and any one of the above circuit boards. The host processing module and the circuit board can be arranged in the host shell, and the host processing module is electrically connected with the processing modules arranged on the circuit board; the host casing has a frame surrounding the display module, the frame is provided with a hole matched with the shape and the position of the pedestrian detection module and the sound collection module arranged on the circuit board, and the pedestrian detection module and the sound collection module are convenient to acquire information. As one example, the display module may be embodied as a display screen.

Or, in the practical application process, software and hardware upgrading can be performed on the host of the passive interactive traditional vending machine, and the host is transformed into the host with the active voice interaction function in the embodiment of the application. Specifically, can carry out hardware transformation to the host computer of traditional vending machine, install the circuit board that carries out the pronunciation interaction voluntarily that this application embodiment provided additional to when having the pedestrian through the vending machine, can carry out human perception automatically and get into the mutual flow of initiative, carry out the shopping guide to the pedestrian with the speech mode.

To the host computer of traditional vending machine, can include host computer casing, host computer processing module and display module, will initiatively carry out the circuit board of voice interaction and install in the inside back of host computer casing additional, can set up on the frame that surrounds display module with sound collection module and pedestrian detection module assorted hole to the two carries out human perception and pronunciation through the trompil that corresponds separately and picks up. As shown in fig. 1, the upper frame of the housing is provided with a camera 40, so that a hole can be formed in the lower frame of the housing.

When hardware transformation is carried out, different circuit boards can be selected according to the height information of the frame. For example, for a host computer whose frame height information is lower than a preset height value (the preset height value can be determined according to actual use requirements), the area where the circuit board can be installed is limited, so that a scheme of arranging a circuit for actively performing voice interaction on one circuit board can be adopted, and the space occupied by the circuit board is reduced as much as possible. When installing the circuit board in the host computer casing inside, need ensure on the one hand that host computer processing module is connected with the processing module electricity of laying on the circuit board, on the other hand needs ensure that the second surface is towards the trompil in the frame, and pedestrian detection module and sound collection module of being convenient for carry out information acquisition.

For a host computer with the frame height information not lower than the preset height value, the area for installing the circuit board is relatively large, so that a scheme of arranging a circuit for actively carrying out voice interaction on different circuit boards can be adopted, and similarly, when the circuit board is installed inside the host computer shell, the requirements of the two aspects are also required to be met. In addition, for the host computer with the frame height information not lower than the preset height value, hardware reconstruction can be performed by additionally arranging the single circuit board provided with the circuit for actively performing voice interaction.

Preferably, in order to reduce the pickup interference of the voice broadcast module to the sound collection module as much as possible, the distance between the voice broadcast module and the sound collection module in the spatial position can be as far as possible. Taking a single circuit board as an example, a base electrically connected with the voice broadcast module may be disposed on the first surface (in the example of the above two circuit boards, the base may be disposed on the first circuit board), the voice broadcast module is fixedly mounted at a position far away from the sound collection module, and the voice broadcast module is electrically connected with the base through an electric wire. As shown in fig. 1, the circuit board actively performing voice interaction may be installed in a region corresponding to the lower frame, and a hole 20 corresponding to the sound collection module and the pedestrian detection module is formed in the region; the voice broadcasting module can be fixed in a region corresponding to the upper frame, and corresponding holes are formed in the region, so that voice broadcasting is facilitated; or, except that can install the voice broadcast module additional on the host computer, can also be fixed in the other positions of vending machine with voice broadcast module 30, like the example of fig. 1, the voice broadcast module mounting is in the box of vending machine, and both convenience of customers listen to, can not cause the interference to the sound collection module pickup again, still can not influence vending machine normal use.

In addition, software modification can be performed on a host of a conventional vending machine, and by installing an application program provided in the embodiment of the present application (see, for example, embodiment 4 below, which will not be described in detail here), a vending processing flow of the host is upgraded, so that the vending processing flow can be matched with a circuit that actively performs voice interaction, and vending processing can be performed in an active interaction manner.

The following explains an interaction process of the embodiment of the present application with reference to a flowchart shown in fig. 2.

Example 1

S101: when the processing module of vending machine obtained the human perception information that pedestrian detection module gathered, carry out voice broadcast to first suggestion information through the voice broadcast module.

As an example, the pedestrian detection module in this embodiment of the present application may be embodied as a TOF (Time-of-Flight) laser distance sensor, and when it is detected that a person approaches a vending machine, the pedestrian detection module may send an interrupt signal to the processing module (in this embodiment of the present application, the human body perception information may include whether the person passes through the vending machine, and if the human body perception information sends the interrupt signal, it may indicate that the person passes through the vending machine).

In addition, it should be noted that the sensor usually has a certain coverage, and when the pedestrian got into the coverage of sensor, the human perception information can be gathered, so the pedestrian detection module of the embodiment of the application can include at least two human body sensors to increase the coverage of sensor, avoid appearing because of the coverage is little leads to the condition that information acquisition is omitted as far as possible. As illustrated in fig. 1, the circuit for active voice interaction may include 2 human body sensors arranged in a horizontal direction.

It can be understood that besides the TOF sensor, the pedestrian detection can be performed based on technologies such as visible light images, laser radars, infrared images, and the like, and the specific implementation process can be referred to related technologies, which are not described in detail herein.

Preferably, the processing module can initiate active interaction to the user immediately after obtaining the human perception information; alternatively, to improve the success rate of shopping guidance, voice interaction may be initiated to the user again when human perception information is obtained and it is determined that the user may have a purchase intention.

Specifically, the processing module may obtain information related to a user behavior, and control the voice broadcast module to perform voice broadcast on the first prompt information when it is determined that the user has a purchase intention according to the information related to the user behavior.

As an example, if the user stays in front of the vending machine or stays for a preset time (for example, the preset time is 2 seconds, which may be determined specifically in combination with the actual application requirement), it may be determined that the user may not simply pass through the vending machine and may have a purchase intention, and the processing module may initiate active interaction for the user to perform shopping guidance for the user, which is helpful to improve the deal rate of the commodity object.

In this example, whether the user is staying in front of the vending machine may be determined in a number of ways. For example, in one mode, the processing module may control the sound collection module to start after obtaining the human perception information, and obtain the sound information collected by the sound collection module and related to the walking of the user. If it is determined from the sound information that the walking behavior of the user changes, for example, the footstep sound suddenly disappears, it may be that the user changes from a walking state to a stopped state; for another example, the frequency of the footstep sound is slowed, the user may stop, and the like, and the variation information may determine that the user may stop in front of the vending machine, and accordingly, the user may be determined to have the purchasing intention.

Or, in another mode, if the vending machine is configured with an image acquisition module, for example, a camera, the processing module may control the image acquisition module to start after obtaining the human perception information, obtain image information of pedestrians passing through the vending machine, and determine whether the user stays in front of the vending machine through the image information.

In addition to the stopping behavior, a behavior action representing the purchasing intention can be preset, if the pedestrian executes the behavior action in front of the vending machine, the pedestrian can be determined not to simply pass through the vending machine, and active interaction can be initiated for the pedestrian. Specifically, the processing module may control the image acquisition module to start up after obtaining the human perception information, and obtain the user image information acquired by the image acquisition module; and if the action information executed by the user is extracted from the image information and the action information is consistent with the preset action information, determining that the user has the purchasing intention. For example, the preset action may be a nodding action, an OK gesture, or the like, which may be determined specifically according to the usage requirement.

S102: the processing module obtains the voice data collected by the sound collection module and extracts the operation instruction information of the user from the voice data.

In the embodiment of the application, the sound collection module can be embodied as a single microphone; or, the method can be embodied as a microphone array composed of at least two microphones, and multi-channel voice pickup is performed through the microphone array. As illustrated in fig. 1, the microphone array may include 4 microphones, and the microphones may be equally spaced in a horizontal direction. The number, arrangement mode and the like of the microphones are not limited in the embodiment of the application, and can be determined by combining with actual application requirements.

Preferably, in order to reduce the impact of ambient noise on the speech recognition accuracy, and taking into account that users with purchasing intent are typically located in a certain area directly in front of the vending machine, the processing module may perform speech recognition based on a noise reduction algorithm with pointing. That is, the area in front of the vending machine may be angle-divided based on a preset reference, for example, angle-divided based on the vending machine, voice data collected in an area corresponding to a preset angle range may be determined as target voice data, voice recognition may be performed, and voice data collected outside the area corresponding to the preset angle range may be determined as interference information, and noise suppression may be performed.

As an example, the voice data collected in the left and right regions corresponding to 60 ° may be voice-recognized with reference to the center of the vending machine, that is, the preset angle range is-60 ° to 60 °. In this example, after the processing module obtains the voice data acquired by the microphone array, the acquisition angle information corresponding to the voice data may be determined, and if the acquisition angle information matches with the preset angle range information, that is, the acquisition angle is within a range of-60 ° to 60 °, the voice data may be determined as the target voice data for voice recognition, so as to obtain the operation instruction information of the user. Therefore, the voice recognition accuracy rate under the noisy environment is guaranteed, and the voice interaction experience of the user is improved.

As an example, the processing module may perform local voice recognition, and extract the operation instruction information of the user from the target voice data; or the processing module can submit the target voice data to the cloud server, and the cloud server performs voice recognition to obtain the operation instruction information of the user and sends the operation instruction information to the processing module.

S103: and the processing module executes related operation according to the operation instruction information.

The operation instruction information in the embodiment of the present application is generally information related to the selling process, and the operation instruction information and the corresponding operation process thereof are exemplified below with reference to specific examples.

1. The operation instruction information can be instruction information for checking commodity object information

As an example, a user may request to view all of the merchandise objects sold by the vending machine. For example, after the user receives the first prompt information broadcasted by the loudspeaker, the user can input the voice to check all commodities, the microphone array can send the voice data to the processing module after acquiring the voice data, and the processing module obtains the operation instruction information of checking all commodity object information. Correspondingly, all commodity objects which can be sold by the vending machine can be determined as target commodity objects to be checked, relevant information of the target commodity objects to be checked is obtained, and information display is carried out through the display screen. Specifically, the related information may include picture information and text information of the target commodity object to be viewed, where the text information may include a name, a price, an inventory quantity, and the like of the target commodity object to be viewed.

Preferably, the processing module can also continue to perform voice interaction with the user to guide the user in shopping. For example, the speaker may be controlled to broadcast a preconfigured second prompt message, where the second prompt message may be "below is all the goods, what is needed to tell me what is good". Specifically, the processing module may obtain prompt information (in this example, second prompt information) associated with the viewing operation, and control the speaker to perform voice broadcast on the second prompt information.

Or, as another example, a user may request to view a portion of the merchandise objects sold by the vending machine for different needs. For example, a request may be made to view merchandise objects of interest to the user; alternatively, a request may be made to view merchandise objects that are in stock (i.e., merchandise objects having an inventory number greater than zero), and so forth.

Taking the automatic beverage vending machine as an example, after a user checks all commodity objects, the user wants to buy sugar-free beverages, the user can input 'check sugar-free beverages' by voice, the microphone array can send the voice data to the processing module after acquiring the voice data, and the processing module extracts target characteristic information of the commodity objects from the voice data to generate operation instruction information. In this example, the target characteristic information may be "sugar-free", and the operation instruction information "view sugar-free beverage" may be generated. Correspondingly, the characteristic information associated with each commodity object can be obtained, the target commodity object to be checked is determined according to the target characteristic information included in the operation instruction information, the relevant information of the target commodity object to be checked is further obtained, and information display is carried out through the display screen. Specifically, the related information may include picture information and text information of the target commodity object to be viewed, where the text information may include a name, a price, an inventory quantity, feature information, and the like of the target commodity object to be viewed.

Preferably, the vending machine can also continue to interact with the user by voice to guide the user in shopping. For example, the processing module may obtain prompt information (in this example, third prompt information) associated with the viewing operation, and control the speaker to perform voice broadcast on the third prompt information. Wherein the third prompt may be "no sugar beverage below, what is needed to tell me what it is.

2. The operation instruction information may be purchase operation instruction information

After checking the relevant information of the commodity object, the user can select a target commodity object to be purchased in a touch operation mode; or, the target commodity object to be purchased may be determined in a voice interaction manner, and in this manner, the processing module may generate a purchase operation instruction according to the voice data acquired by the microphone array, where the purchase operation instruction may include identification information of the target commodity object to be purchased.

Taking the automatic beverage vending machine as an example, after checking the commodity object, the user wants to buy the cola, the user can input the cola by voice, the microphone array can send the voice data to the processing module after acquiring the voice data, and the processing module obtains the operation instruction information of purchasing the cola. Correspondingly, the cola can be determined as a target commodity object to be purchased, an order confirmation interface is generated according to the related information of the cola, and the order confirmation interface is displayed through the display screen. The order confirmation interface may include, in addition to the picture information of the target commodity object to be purchased and the text information such as the name and price of the target commodity object to be purchased, an operation button for performing other operations, for example, an operation button for performing the next payment operation, that is, the user may perform the payment operation by touching the operation button.

Preferably, the vending machine can also continue to interact with the user by voice to guide the user in shopping. For example, the processing module may obtain prompt information (in this example, fourth prompt information) associated with the purchase operation, and control the speaker to perform voice broadcast on the fourth prompt information. Wherein, the fourth prompting message may be "good, you can say payment".

3. The operation instruction information can be payment operation instruction information

After the user receives the fourth prompt message broadcasted by the loudspeaker, the user can input 'payment' through voice, the microphone array can send the voice data to the processing module after acquiring the voice data, and the processing module obtains the operation instruction information of 'order payment' and enters a payment process.

In the practical application process, the vending machine may support different payment modes, and the processing module may correspondingly perform payment processing in different modes. As an example, the vending machine in the embodiment of the present application may be embodied as at least: a vending machine capable of supporting face payment, that is, the vending machine is configured with a camera (as an example in fig. 1, the camera may be disposed on the upper frame of the main body housing 10); and vending machines that do not support face payment, i.e., vending machines that are not configured with cameras, e.g., vending machines that do not support electronic payment, vending machines that support only swipe code payment, etc.

For the vending machine equipped with the camera, if the vending machine only supports face payment, the processing module can control the camera to start after obtaining instruction information related to payment, and starts to collect face image information of a user, and correspondingly, the processing module can obtain the face image information collected by the camera, perform face recognition and perform payment processing according to a face recognition result.

If the vending machine supports other electronic payment modes besides face payment, the processing module can carry out payment processing in various modes. For example, in one mode, a certain payment mode may be determined as a default payment mode with a high priority level by a default configuration mode, and after the processing module obtains instruction information related to payment, payment processing may be performed according to the default payment mode.

Or, in another mode, the processing module may perform payment processing according to a payment mode selected by the user. Specifically, after obtaining instruction information related to payment, the processing module can obtain information of selectable payment modes, and the information is displayed through a display screen; meanwhile, prompt information (in this example, fifth prompt information) associated with the payment operation may also be obtained, and the speaker is controlled to perform voice announcement on the fifth prompt information. The fifth prompt message may be "please select a payment method".

Similarly, the user can select a target payment mode through a touch operation mode; alternatively, the target payment mode can be determined by means of voice interaction. For example, a user can input 'code scanning payment' through voice, the microphone array can send the voice data to the processing module after collecting the voice data, and the processing module obtains operation instruction information of 'code scanning payment'. Correspondingly, a cash register code can be generated according to the price information of the target commodity object to be purchased, and the cash register code is displayed through the display screen, so that the user can scan the cash register code through the associated terminal equipment to perform payment processing. Preferably, the processing module can control the camera to be turned off at this time, that is, the camera is in a non-working state, so that the problem that the camera collects the user privacy data under the condition that the user authorization is not obtained (the user does not select face payment, which is equivalent to the authorization that the image collection is not performed on the camera) can be avoided, and the use safety of the vending machine can be ensured.

For a vending machine without a camera, if the vending machine supports electronic payment, the processing module can generate a cash register according to the related information of the target commodity object to be purchased after acquiring the instruction information related to payment, and scan and pay; if the vending machine does not support electronic payment, the processing module can obtain prompt information (in this example, sixth prompt information) associated with payment operation after obtaining instruction information related to payment, and controls the speaker to perform voice broadcast on the sixth prompt information. The sixth prompt message may be "please insert coins at the coin slot", and guides the user to pay in currency.

4. The operation instruction information can be instruction information for exiting the interactive process

In the embodiment of the application, the user can request to quit the interactive process according to the actual use requirement, for example, the user can request to quit after the transaction is finished; alternatively, the interactive process may be requested to exit at any time during the transaction.

Taking the example of the transaction ending and the withdrawal of the interaction process as an example, after the processing module obtains the information of the payment completion, the processing module can obtain the prompt information (in this example, the seventh prompt information) associated with the transaction operation, and control the speaker to perform voice broadcast on the seventh prompt information. The seventh prompt message may be "what is needed for payment completion and asking for questions". After the user hears the seventh prompt message played by the loudspeaker, the user can input exit voice, the microphone array collects the voice data and then sends the voice data to the processing module, the processing module obtains operation instruction information of exiting the interactive process, the active interactive process is finished, a preset homepage interface is obtained, and the homepage interface is displayed through the display screen.

As an implementation manner, after the processing module performs the related operation (which may be any operation mentioned in the embodiment of the present application, or may be a specific operation, for example, after the payment operation is performed), a timer may be started, and if the interaction information of the user is not obtained within a preset time period (which may be interaction information input by the user in a touch manner, or interaction information input by the user in a voice manner), the processing module may also end the active interaction process.

In addition, in order to provide a more personalized guidance service to the user, the embodiment of the present application may further provide the following preferred solutions, which are illustrated below.

In the first preferred scheme, commodity object recommendation can be performed on the user according to weather information of the position where the vending machine is located.

As an example, when a person passes through the vending machine, the processing module may obtain target weather information of a location where the vending machine is located, determine a target commodity object to be recommended from commodity objects associated with the target weather information according to an association relationship between the weather information and the commodity objects, and push information to a user. For example, the processing module may obtain related information of a target product to be recommended, and control the speaker to push information to the user in a voice broadcast manner; or the processing module can obtain the relevant information of the target commodity to be recommended and push the information to the user in an information display mode through the display screen. As an example, the processing module may determine all the commodity objects associated with the target weather information as the target commodity object to be recommended, or may determine some of the commodity objects as the commodity objects to be recommended, which may be determined by combining actual application requirements.

That is to say, when the processing module controls the speaker to broadcast the first preset prompt message, the relevant information of the target commodity object to be recommended can be displayed on the display screen of the host computer at the same time for the user to select. In the actual application process, the user may determine the to-be-purchased commodity object from the to-be-recommended target commodity object, for example, by a touch operation manner or by a voice interaction manner. Alternatively, the user may purchase other commodity objects besides the target commodity object to be recommended in a voice interaction manner, and the specific process may refer to the description above and is not illustrated here.

In the embodiment of the application, the processing module can obtain the target weather information of the position of the vending machine in various modes. For example, in one mode, weather information of the location of the vending machine issued by the server deployed on the cloud server can be obtained (for example, the weather information of the day can be issued at regular time every day, or the weather information after change can be issued in real time when the weather information has a large change); or, if the vending machine is provided with equipment capable of performing environment detection, such as a thermometer, a hygrometer, and the like, the processing module can obtain weather information collected by the environment detection equipment.

And in the second preferred scheme, the commodity object recommendation can be carried out on the user according to the characteristic information of the user.

In the actual application process, the processing module may control the camera to start to collect the user image information when the user has a purchase intention (for example, the time that the user stays in front of the vending machine exceeds a preset time length, or the user performs a preset action, or the user starts to perform voice interaction with the vending machine, or the like), so that the processing module may extract the target feature information of the user from the image information collected by the camera, and perform personalized recommendation on the commodity object according to the target feature information. Specifically, the processing module can obtain user type information associated with different feature information and commodity objects associated with each user type information, so that after the processing module performs image processing to obtain target feature information of a user, the processing module can obtain target user type information of the user according to the target feature information, further determine a target commodity object to be recommended from the commodity objects associated with the target user type information, and perform information push on the user. As an example, the processing module may determine all the commodity objects associated with the target user type information as target commodity objects to be recommended, or may determine some of the commodity objects as commodity objects to be recommended, which may be determined specifically by combining with actual application requirements.

For example, when the user is determined to be a fitness fan according to the characteristic information of the user, a low-calorie commodity object such as mineral water and sugar-free beverage can be determined as a target commodity object to be recommended; or when the user is determined to be the elderly according to the characteristic information of the user, commodity objects such as mineral water and milk can be determined as target commodity objects to be recommended; or, determining that the user consumes a large amount of physical power according to the characteristic information of the user, for example, characteristics such as full sweat, asthma and appealing, and determining the commodity object such as beverage as a target commodity object to be recommended; or determining that the user state is easy according to the characteristic information of the user, and determining commodity objects such as leisure food and the like as target commodity objects to be recommended; and so on. The embodiment of the application does not need to be specifically limited for the dividing mode of the user type, the implementation process of determining the user type information according to the characteristic information, the incidence relation between the user type and the commodity object, and the like, and the specific implementation process can refer to the related technology.

As can be seen from the above description, the camera is started only when needed (for example, the camera may be started when face payment is performed, or the camera may be started when image information of a user needs to be shot according to personalized recommendation), which is helpful for reducing the working time of the camera and avoiding that the service life of the camera is affected when the camera is continuously in a working state; on the other hand, the camera is started to enter the working state only under the condition that the user authorization is obtained, image information of all pedestrians passing around the vending machine cannot be shot at will, and the data security of the camera is improved.

Preferably, besides starting the camera under the condition of obtaining the user authorization, the embodiment of the application can further improve the data security of the camera through the following implementation manner. For example, in one mode, the acquisition area of the camera may be preset (e.g., the size of the acquisition area may be 0.5 m)²And the position of the acquisition area can be right in front of the camera), the processing module can issue the information of the acquisition area to the camera when controlling the camera to start, and the camera is controlled to shoot the image information in the acquisition area. Therefore, when the image information of the user operating the vending machine is shot, the image information of the passing pedestrians can be prevented from being shot by mistake, and the data security of the surrounding pedestrians can be improved.

Or, in another mode, the processing module may determine the processing area information of the image processing according to the relative position of the user with the purchase intention and the vending machine, that is, even if the acquisition area of the camera is relatively large and the image information of a part of pedestrians is acquired, the processing module may cut and delete the image outside the processing area during the image processing, and the image information of surrounding pedestrians is not left.

In addition, the camera can also exit from the working state after the acquisition of the related information is finished, and then enters the working state until the camera is started next time, and the camera cannot acquire the image information in the period. For example, when personalized recommendation is performed, the processing module may control the camera to turn off after obtaining the user image information acquired by the camera, and even if the user has other subsequent operations (for example, determining a target commodity object to be purchased from the target commodity object to be recommended), the camera may stop image information acquisition. Of course, if the subsequent user selects face payment, the processing module can control the camera to start, and then the camera enters the working state again.

It is to be understood that the first client and the second client in the embodiments of the present application may be different clients, or may be different modules in the same client, and are used for functional division only, and should not be considered as a limitation to the specific implementation.

Example 2

Corresponding to the processing module in embodiment 1, an application program may be provided in the embodiments of the present application, and is used to implement a selling process in an active interaction manner. Specifically, the application programs may include: the system comprises a first interface, a second interface, a third interface and an information processing program module.

The first interface is used for receiving the call of a pedestrian detection module of the vending machine and obtaining human body perception information collected by the pedestrian detection module; the second interface is used for calling a voice broadcasting module of the vending machine and sending the first prompt information to the voice broadcasting module for broadcasting; the third interface is used for receiving the call of a sound acquisition module of the vending machine and acquiring the voice data acquired by the sound acquisition module; and the information processing program module is used for extracting the operation instruction information of the user from the voice data and executing related operation according to the operation instruction information so as to guide shopping for the user.

So, to the vending machine that disposes pedestrian detection module, sound collection module and voice broadcast module, can carry out software upgrading to its processing module, make the vending machine can initiatively initiate voice interaction. Specifically, the vending machine loads an installation package corresponding to the application program; the application is started so as to initiate active voice interaction for a user passing through the vending machine when human perception information is obtained.

Example 3

As described above, the information processing process according to the embodiment of the present application may perform function splitting, and in the following, the first client performs pedestrian detection and actively initiates voice interaction, and the second client performs a related operation according to the operation instruction information as an example, to exemplify a process of implementing shopping guide, which may specifically refer to the flowchart shown in fig. 3.

S201: when the first client side obtains the human body perception information, the voice broadcasting module of the vending machine is used for carrying out voice broadcasting on the first prompt information.

In the embodiment of the present application, the first client may be disposed on the vending machine (for example, may be disposed on a host installed on the vending machine, or may be disposed on a device actively performing voice interaction installed on the vending machine), and is configured to implement a function of a processing module in a circuit actively performing voice interaction. Specifically, after the human body perception information collected by the pedestrian detection module of the vending machine is obtained by the first client, the first preset prompt information can be obtained, and voice broadcasting is carried out through the voice broadcasting module.

S202: the first client obtains voice data collected by a sound collection module of the vending machine, and extracts operation instruction information of a user from the voice data.

S203: and the first client forwards the operation instruction information to the second client.

S204: and the second client executes the relevant operation according to the operation instruction information.

In this embodiment of the application, the second client may be disposed on the vending machine host, and is configured to implement the function of the host processing module. Specifically, after obtaining the operation instruction information sent by the first client, the second client may execute the relevant operation according to the operation instruction information.

The detailed description in this embodiment can be referred to that in embodiment 1, and will not be illustrated here.

Example 4

Corresponding to the second client in embodiment 3, an application program may be provided in this embodiment of the application, and is used to implement the selling process in an active interaction manner. Specifically, the application programs may include: an interface module and an information processing program module.

The interface module is used for receiving calling of a communication interface of a host machine of the vending machine, obtaining operation instruction information sent by a first client through the communication interface, wherein the operation instruction information is that the first client is extracted from voice data collected by a sound collection module of the vending machine, and the voice data is obtained by the first client, human body perception information collected by a pedestrian detection module of the vending machine and voice broadcasting module of the vending machine are collected after first prompt information broadcasting is carried out on pedestrians passing through the vending machine. And the information processing program module is used for executing related operations according to the operation instruction information.

In addition, if the prompt information related to the related operation is obtained, the interface module can also call a communication interface of the vending machine host to send the prompt information related to the related operation to the first client, and then voice broadcasting is carried out on the prompt information related to the related operation through the voice broadcasting module, so that shopping guidance is carried out on the user.

In the practical application process, the application program provided by the embodiment can be used for upgrading software of the host machine of the traditional vending machine, and the host machine of the vending machine is transformed into the host machine which can actively perform vending processing in an interactive mode. Specifically, a host of the vending machine loads an installation package corresponding to the application program; and starting the application program so as to execute relevant operations according to the operation instruction information when the operation instruction information sent by the first client is obtained.

Example 5

The information processing scheme provided by the embodiment of the application can also be applied to the field of new retail sales, equipment capable of actively performing voice interaction is arranged on line, the equipment provides the operation service of placing orders on line for the user, and the user order is submitted to a fulfillment platform. Specifically, the device actively performing voice interaction may include a pedestrian detection module, a sound collection module, a voice broadcast module, and a processing module.

The following explains an interaction process of the embodiment of the present application with reference to a flowchart shown in fig. 4.

S301: the processing module obtains the related information of the commodity object provided by the entity shop associated with the equipment.

As an example, the device may be disposed in an area associated with the physical store, for example, in a community within a distribution range of the physical store, and related information of the commodity object provided by the physical store associated with the device may be obtained in advance for the user to view, so that the user may determine the target commodity object to be ordered. For example, picture information and character information of the commodity object can be obtained, and the commodity object information is displayed to a user through a display module of the equipment; alternatively, a sample of the commodity object may be obtained and the commodity object information is presented to the user through a commodity object presentation bin of the apparatus.

S302: if the human body perception information collected by the pedestrian detection module is obtained, voice broadcasting is carried out on the first prompt information through the voice broadcasting module.

When the pedestrian passes through the equipment, the pedestrian detection module can collect human body perception information and send the processing module, the processing module is triggered to actively initiate voice interaction to the user, the first prompt information is broadcasted through the voice broadcast module, and the user is prompted to select and purchase commodity objects. The specific implementation process can be described in S101, and is not illustrated here.

S303: and if the operation instruction information of the user is extracted from the voice data acquired by the voice acquisition module and the operation instruction information comprises the identification information of the target commodity object selected by the user, generating an order request and submitting the order request to a fulfillment platform.

After voice interaction is initiated to a user, if the voice acquisition module acquires voice data input by the user, the voice data can be sent to the processing module for voice recognition, and operation instruction information is extracted from the voice data. Similarly, the operation instruction information may be instruction information for viewing commodity object information, so as to request to view related information of a commodity object that can be subjected to online ordering and ordering operations by the device; or, the operation instruction information may be purchase operation instruction information, so as to determine a target commodity object to be purchased, generate an order request, and submit the order request to the fulfillment platform, and correspondingly, the fulfillment platform may provide fulfillment services for an order associated with the physical store, and deliver the commodity object selected by the user to a specified address; or, the operation instruction information may be payment operation instruction information so as to make order payment after submitting an online order; alternatively, the operation instruction information may be instruction information for exiting the interactive process, thereby requesting to exit the voice interactive process.

The implementation process of extracting the operation instruction information, the implementation process of performing the relevant operation according to the operation instruction information, and the like can be referred to the descriptions at S102 and S103, and are not illustrated here. Regarding the implementation process of the fulfillment platform for performing fulfillment services on online orders, reference may be made to related technologies, and details thereof are not described herein.

Example 6

Embodiment 6 is a method corresponding to embodiment 1, and provides an information processing method from the perspective of a vending machine, wherein the vending machine may include a pedestrian detection module, a sound collection module, a voice broadcast module, and a processing module. Referring to fig. 5, the method may specifically include:

s401: when the processing module obtains the human body perception information collected by the pedestrian detection module, the voice broadcasting module is used for carrying out voice broadcasting on first prompt information;

s402: if the voice data collected by the voice collection module is obtained, extracting operation instruction information of a user from the voice data;

s403: and executing relevant operation according to the operation instruction information.

Example 7

Embodiment 7 is a method corresponding to embodiment 3, and provides an information processing method from the perspective of a first client, and referring to fig. 6, the method may specifically include:

s501: when a first client associated with the vending machine obtains human body perception information, voice broadcasting is carried out on first prompt information through a voice broadcasting module of the vending machine, and the human body perception information is collected by a pedestrian detection module of the vending machine;

s502: if the voice data collected by the sound collection module of the vending machine is obtained, extracting the operation instruction information of the user from the voice data;

s503: and forwarding the operation instruction information to a second client associated with a host of the vending machine, so that the second client executes related operations according to the operation instruction information.

Example 8

Embodiment 8 is a method corresponding to embodiment 3, and provides an information processing method from the perspective of the second client, and referring to fig. 7, the method may specifically include:

s601: a second client associated with a host of the vending machine obtains operation instruction information of a user sent by a first client, wherein the operation instruction information is extracted from voice data collected by the first client from a voice collecting module of the vending machine, and the voice data is collected after human body perception information collected by a pedestrian detecting module of the vending machine and a voice broadcasting module of the vending machine broadcast first prompt information of pedestrians passing through the vending machine are obtained at the first client;

s602: and executing relevant operation according to the operation instruction information.

Example 9

Embodiment 9 is a device corresponding to embodiment 5, and provides an information processing method from the perspective of a device that actively performs voice interaction, where the device may include a pedestrian detection module, a sound collection module, a voice broadcast module, and a processing module. Referring to fig. 8, the method may specifically include:

s701: the processing module obtains the related information of the commodity object provided by the entity shop related to the equipment;

s702: when the human body perception information collected by the pedestrian detection module is obtained, voice broadcasting is carried out on first prompt information through the voice broadcasting module;

s703: and if the operation instruction information of the user is extracted from the voice data acquired by the voice acquisition module and the operation instruction information comprises the identification information of the target commodity object selected by the user, generating an order request and submitting the order request to a fulfillment platform.

For the parts not described in detail in embodiments 6 to 9, reference may be made to the descriptions in the embodiments, which are not repeated herein.

In correspondence with embodiment 1, an embodiment of the present application further provides an information processing apparatus, see fig. 9, which is applied to a vending machine, including:

a human body perception information obtaining unit 801, configured to obtain human body perception information acquired by a pedestrian detection module of the vending machine;

the voice broadcasting unit 802 is used for performing voice broadcasting on the first prompt information through a voice broadcasting module of the vending machine;

an operation instruction information extraction unit 803, configured to extract operation instruction information of a user from voice data acquired by a sound acquisition module of the vending machine when the voice data is acquired;

and an operation execution unit 804, configured to execute a relevant operation according to the operation instruction information.

The operation instruction information extraction unit is specifically configured to: obtaining preset angle range information determined by angle division of the front area of the vending machine based on a preset reference; and determining acquisition angle information corresponding to the voice data, and if the acquisition angle information is matched with the preset angle range information, performing voice recognition on the voice data to obtain the operation instruction information.

Wherein the apparatus further comprises:

and the prompt information acquisition unit is used for acquiring the prompt information associated with the related operation and carrying out voice broadcast on the prompt information associated with the related operation through the voice broadcast module.

Wherein the apparatus further comprises:

and the prompt information sending unit is used for obtaining the prompt information associated with the relevant operation after the operation execution unit executes the relevant operation according to the operation instruction information, and sending the prompt information to the first client so as to carry out voice broadcast on the prompt information associated with the relevant operation through the voice broadcast module.

Wherein, the vending machine still includes the display module, the device still includes:

and the display information obtaining unit is used for obtaining the display information related to the related operation and displaying the information through the display module.

Wherein the operation instruction information is instruction information for checking commodity object information,

the operation execution unit is specifically configured to: determining a target commodity object to be viewed from the commodity objects provided by the vending machine according to the operation instruction information;

the display information obtaining unit is specifically configured to: and obtaining the relevant information of the target commodity object to be checked, and displaying the information through the display module.

Wherein the operation instruction information is purchase operation instruction information,

the operation execution unit is specifically configured to: determining a target commodity object to be purchased from the commodity objects provided by the vending machine according to the operation instruction information;

the display information obtaining unit is specifically configured to: and generating an order confirmation interface according to the relevant information of the target commodity object to be purchased, and displaying the order confirmation interface through the display module.

Wherein the operation instruction information is instruction information for exiting the interactive process,

the operation execution unit is specifically configured to: finishing the active interaction processing process according to the operation instruction information;

the display information obtaining unit is specifically configured to: and acquiring a preset homepage interface, and displaying the homepage interface through the display module.

The vending machine further comprises an image acquisition module, and if the operation instruction information is payment operation instruction information, the payment mode is face payment;

the operation execution unit is specifically configured to: controlling the image acquisition module to start according to the operation instruction information; extracting the face information of the user from the face image information acquired by the image acquisition module, and performing payment processing according to the face information;

the display information obtaining unit is specifically configured to: and obtaining result information of the payment processing, and displaying the result information through the display module.

Wherein the apparatus further comprises:

the behavior information obtaining unit is used for obtaining information related to user behaviors after the human body perception information is obtained;

and the purchasing intention determining unit is used for informing the voice broadcasting unit to carry out voice broadcasting on the first prompt information when the user is determined to have the purchasing intention according to the information related to the user behavior.

The behavior information obtaining unit is specifically configured to: controlling the sound acquisition module to start, and acquiring sound information which is acquired by the sound acquisition module and is related to the walking of the user;

the purchase intention determining unit is specifically configured to: and determining that the walking behavior of the user changes according to the sound information, wherein the change information indicates that the user stays in front of the vending machine, and then determining that the user has the purchasing intention.

Wherein the vending machine further comprises an image acquisition module,

the behavior information obtaining unit is specifically configured to: controlling the image acquisition module to start, and acquiring user image information acquired by the image acquisition module;

the purchase intention determining unit is specifically configured to: and if the action information executed by the user is extracted from the image information and the action information is consistent with the preset action information, determining that the user has the purchasing intention.

Wherein, the vending machine still includes the image acquisition module, the device still includes:

the associated information obtaining unit is used for obtaining user type information associated with different characteristic information and commodity objects associated with the user type information;

the starting control unit is used for controlling the image acquisition module to start when the user is determined to have the purchasing intention;

the characteristic information acquisition unit is used for extracting target characteristic information of the user from the user image information acquired by the image acquisition module;

and the commodity object determining unit is used for determining the target user type information associated with the target characteristic information, determining a target commodity object to be recommended from the commodity objects associated with the target user type information, and pushing information to the user.

Wherein the apparatus further comprises:

the acquisition area information acquisition unit is used for acquiring acquisition area information associated with the image acquisition module;

the start control unit is specifically configured to: and sending the acquisition area information to the image acquisition module, and controlling the image acquisition module to shoot the image information in the acquisition area.

Wherein the apparatus further comprises:

a processing area information obtaining unit configured to obtain processing area information of image processing so as to perform deletion processing on image information located outside the processing area and perform information extraction from image information located inside the processing area.

Wherein the apparatus further comprises:

and the closing control unit is used for controlling the image acquisition module to be closed and stopping image information acquisition after the image information acquired by the image acquisition module is obtained.

Wherein the apparatus further comprises:

and the commodity object determining unit is used for obtaining the target weather information of the position of the vending machine after the human body perception information is obtained, determining a target commodity object to be recommended from the commodity objects related to the target weather information according to the association relationship between the weather information and the commodity object, and pushing information to the user.

Corresponding to embodiment 3, an embodiment of the present application further provides an information processing apparatus, referring to fig. 10, which is applied to a first client associated with a vending machine, and includes:

a human perception information obtaining unit 901, configured to obtain human perception information collected by a pedestrian detection module of the vending machine;

the voice broadcasting unit 902 is used for performing voice broadcasting on the first prompt information through a voice broadcasting module of the vending machine;

an operation instruction information extraction unit 903, configured to extract operation instruction information of a user from voice data acquired by a sound acquisition module of the vending machine when the voice data is acquired;

an operation instruction information sending unit 904, configured to forward the operation instruction information to a second client associated with the host of the vending machine, so that the second client performs a relevant operation according to the operation instruction information.

In correspondence with embodiment 3, an embodiment of the present application further provides an information processing apparatus, referring to fig. 11, which is applied to a host-associated second client of a vending machine, and includes:

an operation instruction information obtaining unit 1001, configured to obtain operation instruction information of a user sent by a first client, where the operation instruction information is extracted from voice data collected by a sound collection module of the vending machine by the first client, and the voice data is collected after human body perception information collected by a pedestrian detection module of the vending machine and a voice broadcast module of the vending machine broadcast first prompt information for a pedestrian passing through the vending machine are obtained at the first client;

an operation executing unit 1002, configured to execute a relevant operation according to the operation instruction information.

Corresponding to embodiment 5, an embodiment of the present application further provides an information processing apparatus, with reference to fig. 12, where the apparatus is applied to a device that actively performs voice interaction, and includes:

a related information obtaining unit 1101 configured to obtain related information of a commodity object provided by an entity store associated with the device;

a human perception information obtaining unit 1102, configured to obtain human perception information acquired by a pedestrian detection module of the device;

the voice broadcasting unit 1103 is used for performing voice broadcasting on the first prompt information through a voice broadcasting module of the device;

an operation instruction information extraction unit 1104, configured to extract operation instruction information of a user from the voice data acquired by the sound acquisition module, where the operation instruction information includes identification information of a target commodity object selected by the user;

a request submitting unit 1105, configured to generate an order request to be submitted to a fulfillment platform.

In addition, an embodiment of the present application further provides an electronic device, including:

one or more processors; and

And an electronic device comprising:

one or more processors; and

And an electronic device comprising:

one or more processors; and

And an electronic device comprising:

one or more processors; and

Where fig. 13 exemplarily illustrates an architecture of an electronic device, for example, the device 1200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, an aircraft, and so forth.

Referring to fig. 13, device 1200 may include one or more of the following components: processing component 1202, memory 1204, power component 1206, multimedia component 1208, audio component 1210, input/output (I/O) interface 1212, sensor component 1214, and communications component 1216.

The processing component 1202 generally controls overall operation of the device 1200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 1202 may include one or more processors 1220 to execute instructions to perform all or a portion of the steps of the methods provided by the disclosed subject matter. Further, the processing component 1202 can include one or more modules that facilitate interaction between the processing component 1202 and other components. For example, the processing component 1202 can include a multimedia module to facilitate interaction between the multimedia component 1208 and the processing component 1202.

The memory 1204 is configured to store various types of data to support operation at the device 1200. Examples of such data include instructions for any application or method operating on device 1200, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1204 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

A power supply component 1206 provides power to the various components of the device 1200. Power components 1206 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for device 1200.

The multimedia component 1208 includes a screen that provides an output interface between the device 1200 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1208 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 1200 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

Audio component 1210 is configured to output and/or input audio signals. For example, audio assembly 1210 includes a Microphone (MIC) configured to receive external audio signals when device 1200 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 1204 or transmitted via the communication component 1216. In some embodiments, audio assembly 1210 further includes a speaker for outputting audio signals.

The I/O interface 1212 provides an interface between the processing component 1202 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 1214 includes one or more sensors for providing various aspects of state assessment for the device 1200. For example, the sensor assembly 1214 may detect an open/closed state of the device 1200, the relative positioning of the components, such as a display and keypad of the device 1200, the sensor assembly 1214 may also detect a change in the position of the device 1200 or a component of the device 1200, the presence or absence of user contact with the device 1200, orientation or acceleration/deceleration of the device 1200, and a change in the temperature of the device 1200. The sensor assembly 1214 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 1214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1214 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communications component 1216 is configured to facilitate communications between device 1200 and other devices in a wired or wireless manner. The device 1200 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1216 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 1216 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the device 1200 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as memory 1204 comprising instructions, executable by processor 1220 of device 1200 to perform the methods provided by the present disclosure is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments of the present application.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, the system or system embodiments are substantially similar to the method embodiments and therefore are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described system and system embodiments are only illustrative, wherein the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

The information processing method, the information processing apparatus, and the electronic device provided by the present application are described in detail above, and a specific example is applied in the description to explain the principle and the implementation of the present application, and the description of the above embodiment is only used to help understand the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, the specific embodiments and the application range may be changed. In view of the above, the description should not be taken as limiting the application.

Claims

1. The information processing method is characterized by being applied to a vending machine, wherein the vending machine comprises a pedestrian detection module, a sound collection module, a voice broadcast module and a processing module, and the method comprises the following steps:

2. The method of claim 1,

the extracting of the operation instruction information of the user from the voice data includes:

obtaining preset angle range information determined by angle division of the front area of the vending machine based on a preset reference;

and determining acquisition angle information corresponding to the voice data, and if the acquisition angle information is matched with the preset angle range information, performing voice recognition on the voice data to obtain the operation instruction information.

3. The method of claim 1, further comprising:

and obtaining the prompt information associated with the related operation, and carrying out voice broadcast on the prompt information associated with the related operation through the voice broadcast module.

4. The method of claim 1, wherein the vending machine further comprises a display module, the method further comprising:

and obtaining display information associated with the related operation, and displaying the information through the display module.

5. The method according to claim 4, wherein the operation instruction information is instruction information for viewing commodity object information,

the executing relevant operation according to the operation instruction information comprises: determining a target commodity object to be viewed from the commodity objects provided by the vending machine according to the operation instruction information;

the obtaining of the display information associated with the related operation and the displaying of the information through the display module include: and obtaining the relevant information of the target commodity object to be checked, and displaying the information through the display module.

6. The method according to claim 4, wherein the operation instruction information is purchase operation instruction information,

the executing relevant operation according to the operation instruction information comprises: determining a target commodity object to be purchased from the commodity objects provided by the vending machine according to the operation instruction information;

the obtaining of the display information associated with the related operation and the displaying of the information through the display module include: and generating an order confirmation interface according to the relevant information of the target commodity object to be purchased, and displaying the order confirmation interface through the display module.

7. The method of claim 4, wherein the operation instruction information is instruction information for exiting an interactive process,

the executing relevant operation according to the operation instruction information comprises: finishing the active interaction processing process according to the operation instruction information;

the obtaining of the display information associated with the related operation and the displaying of the information through the display module include: and acquiring a preset homepage interface, and displaying the homepage interface through the display module.

8. The method according to claim 4, wherein the vending machine further comprises an image acquisition module, if the operation instruction information is payment operation instruction information, and the payment mode is face payment;

the executing relevant operation according to the operation instruction information comprises: controlling the image acquisition module to start according to the operation instruction information; extracting the face information of the user from the face image information acquired by the image acquisition module, and performing payment processing according to the face information;

the obtaining of the display information associated with the related operation and the displaying of the information through the display module include: and obtaining result information of the payment processing, and displaying the result information through the display module.

9. The method of claim 1, wherein after obtaining the human perceptual information, the method further comprises:

obtaining information related to user behavior;

through the voice broadcast module carries out the pronunciation to first suggestion information and reports, include: and when the user is determined to have the purchasing intention according to the information related to the user behavior, carrying out voice broadcast on the first prompt information.

10. The method of claim 9,

the obtaining information related to the user behavior comprises: controlling the sound acquisition module to start, and acquiring sound information which is acquired by the sound acquisition module and is related to the walking of the user;

the determining that the user has a purchase intention according to the information related to the user behavior comprises: and determining that the walking behavior of the user changes according to the sound information, wherein the change information indicates that the user stays in front of the vending machine, and then determining that the user has the purchasing intention.

11. The method of claim 9, wherein the vending machine further comprises an image capture module,

the obtaining information related to the user behavior comprises: controlling the image acquisition module to start, and acquiring user image information acquired by the image acquisition module;

the determining that the user has a purchase intention according to the information related to the user behavior comprises: and if the action information executed by the user is extracted from the image information and the action information is consistent with the preset action information, determining that the user has the purchasing intention.

12. The method of claim 1, wherein the vending machine further comprises an image capture module, the method further comprising:

obtaining user type information associated with different characteristic information and commodity objects associated with the user type information;

if the user is determined to have the purchase intention, controlling the image acquisition module to start;

extracting target characteristic information of the user from user image information acquired by the image acquisition module;

and determining target user type information associated with the target characteristic information, determining a target commodity object to be recommended from the commodity objects associated with the target user type information, and pushing information to the user.

13. The method of claim 8, 11 or 12, further comprising:

acquiring acquisition area information associated with the image acquisition module;

the controlling the image acquisition module to start includes:

and sending the acquisition area information to the image acquisition module, and controlling the image acquisition module to shoot the image information in the acquisition area.

14. The method of claim 8, 11 or 12, further comprising:

processing area information of image processing is obtained so as to perform deletion processing on image information located outside the processing area, and information extraction is performed from image information located inside the processing area.

15. The method of claim 8, 11 or 12, wherein after obtaining the image information acquired by the image acquisition module, the method further comprises:

and controlling the image acquisition module to be closed, and stopping image information acquisition.

16. The method of claim 1, wherein after obtaining the human perceptual information, the method further comprises:

and obtaining target weather information of the position of the vending machine, determining a target commodity object to be recommended from the commodity objects associated with the target weather information according to the association relationship between the weather information and the commodity objects, and pushing information to the user.

17. An application program, comprising:

18. An information processing method characterized by comprising:

loading an installation package corresponding to the application program of claim 17 by the vending machine;

19. An information processing method characterized by comprising:

20. An information processing method characterized by comprising:

21. An application program, comprising:

an interface module and an information processing program module;

22. An information processing method characterized by comprising:

loading an installation package corresponding to the application program of claim 21 by a host computer of the vending machine;

23. A circuit for actively carrying out voice interaction, which is applied to a vending machine, comprises:

24. A circuit board for proactive voice interaction, comprising:

25. A circuit board for proactive voice interaction, comprising:

a first sub circuit board and a second sub circuit board;

26. An equipment for actively carrying out voice interaction, characterized in that, the equipment is installed on the box body of a vending machine and is electrically connected with the host machine of the vending machine, the equipment comprises:

a housing and a circuit board for active voice interaction according to claim 24 or 25;

27. A vending machine host, comprising:

a host housing, a host processing module, a display module, and the circuit board of claim 24 or 25 for active voice interaction;

28. The information processing method is characterized by being applied to equipment for actively carrying out voice interaction, the equipment comprises a pedestrian detection module, a sound collection module, a voice broadcast module and a processing module, and the method comprises the following steps:

29. An information processing apparatus, applied to a vending machine, comprising:

30. An information processing apparatus, applied to a first client associated with a vending machine, comprising:

31. An information processing apparatus, applied to a host-associated second client of a vending machine, comprising:

32. An information processing apparatus applied to a device for actively performing voice interaction, comprising:

33. An electronic device, comprising:

one or more processors; and

34. An electronic device, comprising:

one or more processors; and

35. An electronic device, comprising:

one or more processors; and

36. An electronic device, comprising:

one or more processors; and