WO2020051723A1

WO2020051723A1 - Vending machine and voice interaction system and method applied to vending machine

Info

Publication number: WO2020051723A1
Application number: PCT/CN2018/000325
Authority: WO
Inventors: 朱恩辛; 黄羽岑; 黄贯维
Original assignee: 朱恩辛
Priority date: 2018-09-14
Filing date: 2018-09-14
Publication date: 2020-03-19

Abstract

Disclosed are a vending machine, a voice interaction system applied to a vending machine, and a voice interaction method applied to a vending machine. The interaction system comprises a server and at least one vending machine. The server and each vending machine can be connected to each other. The vending machine comprises intelligent audio equipment for receiving and playing audio signals. Upon activation of the vending machine, member identification information and an audio signal from a member player are obtained. Feature information in the audio signal is extracted, and it is determined whether the feature information is an operation instruction. Designated actions are executed according to the operation instruction to proceed with the game, thereby improving interaction and enjoyment of the game and increasing economic benefits.

Description

Selection selling device, voice interaction system and voice interaction method using same

Technical field

The present invention relates to the technical field of selection and sales, and in particular to a selection and sales device and a voice interaction system and a voice interaction method using the same, so as to increase the fun of the game.

Background technique

In recent years, because of changes in schoolwork, work, and life, coupled with reduced time and space for activities, people have become more and more stressed, and they need to use a variety of different game equipment for entertainment to relieve some Stress promotes mental health. The selection vending machine is a kind of physical entertainment equipment used on the street or in the storefront. It mainly has a closed storage space in the cabinet, and a variety of properties or styles of goods are placed in the storage space [such as plush Dolls, electronic products, etc.], and a grasping device is provided above the placement space. The control device on the chassis is used to control the movement of the grasping device for the selected and grasped goods, and the goods are moved to the placement space. The falling object in the corner, if the product can be smoothly dropped into the falling object, the player can take out the captured product through the access opening outside the chassis, making it both interesting and entertaining.

However, this type of selection vending machine is currently limited to grabbing goods or prizes, and has no other functions. Therefore, its use and variability are limited by the players, and it is a stand-alone operation that lacks interaction with players. , In the long run, it will lose its appeal to players, and there is really great room for improvement. In other words, how to solve the aforementioned problems and create more interesting gameplay and effects is a technical problem to be solved by the present invention.

In view of this, the inventor of the present case has developed a product selection and sales device and a voice interaction system and a voice interaction method using the same to overcome the shortcomings and inconveniences caused by the lack of interactivity and entertainment of the existing ones.

Summary of the Invention

Therefore, the main object of the present invention is to provide a selection selling device, which can have the function of voice command control, and can capture and play effects in real time, thereby increasing its entertainment effect and further increasing its attractiveness. .

In addition, a second main object of the present invention is to provide a voice interaction system using a selection selling device, so that players can interact with the selection selling device through voice instructions, thereby breaking the existing limitations.

In addition, another main object of the present invention is to provide a voice interaction method using a selection and sales device, which can be remotely controlled for subsequent interactive management and rewards, thereby creating novel and interesting gameplay and effectively improving its practicality. Sex.

Based on this, the present invention mainly achieves the foregoing objects and effects mainly through the following technical means: a voice interaction method using a selection and sales device, which includes the steps:

Step S01: Start the selection and sales equipment to obtain member identification information. If it is a registered member, execute step S02, otherwise end;

Step S02: The above-mentioned item selecting and selling device obtains the voice information of the player member, extracts the characteristic information in the voice information, and then executes step S03;

Step S03: Determine whether the characteristic information is an operation instruction. If it is, execute step S04; otherwise, execute step S02;

Step S04, performing a specified action according to the operation instruction, and then performing step S05;

In step S05, it is determined whether the item selection and selling equipment has taken out the objects, and the game is completed.

Furthermore, the present invention further has a voice interaction system using a selection and sales device for executing the voice interaction method, which includes:

A servo device including:

A built-in application and interactive processing module for man-machine interface for background operation.

An online interface module connected to the interactive processing module for external connection,

A member identification module connected to the interactive processing module for processing basic member data,

A commodity management module connected to the interactive processing module for processing commodity data,

An instruction operation module connected to the interactive processing module for extracting at least one feature information in a voice message to obtain at least one operation instruction, and

An image operation module connected to the interactive processing module for generating voice interaction using operation instructions;

At least one item selection selling device, which has an accommodation space for placing at least one object, the accommodation space includes a gripping area for placing items and a drop opening that communicates with the outside, and each of the item selection is sold A control module is provided inside the device, the control module has a processing unit, and a picking unit connected to the processing unit for selective grasping of objects is provided in the accommodation space, and the processing module is electrically connected to operate the picking The control unit of the unit and the processing unit are connected with a display unit, and the processing unit of the control module is connected with an activation unit for starting the control unit, and the processing unit is connected with a smart speaker for receiving and playing voice information, and the processing The unit is connected with an image capture unit that can obtain the player and the capture process, and the processing unit has a network unit for connecting with the servo device.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of a system architecture of a voice interaction system using a selection and sales device of the present invention.

FIG. 2 is a schematic configuration diagram of a servo device in a voice interaction system using a selection and sales device of the present invention.

FIG. 3 is a schematic structural diagram of a selection and sales device in a voice interaction system using the selection and sales device of the present invention.

FIG. 4 is a schematic diagram of a configuration of a selection selling device in a voice interaction system using the selection selling device according to the present invention.

FIG. 5 is a schematic flowchart of a voice interaction method using a selection and sales device of the present invention.

FIG. 6 is a schematic diagram of a practical use state of a voice interaction system using a selection and sales device of the present invention.

FIG. 7 is a schematic diagram of another state of the voice interactive system using the selection and sales equipment in actual use according to the present invention, for explaining the state of uploading video and audio.

FIG. 8 is a schematic diagram of another state of the voice interaction system using the object selection and selling equipment in practice according to the present invention, for explaining the state of sound-light interaction.

DESCRIPTION OF SYMBOLS: 10-servo equipment; 11- interactive processing module; 12- online interface module; 13- member identification module; 14- commodity management module; 15- instruction operation module; 16- image operation module; 17- gold flow Operation module; 18-merchant management module; 19-voice assistant module; 20-selection selling equipment; 200-receiving space; 201-grabbing area; 202-reading area; 23-retrieval unit; 24-control unit ; 25- display unit; 26- light and shadow unit; 30- control module; 31- processing module; 32- startup unit; 321- coin slot; 322- sensor; 323- virtual starter; 33- smart speaker; 34- image Retrieval unit; 35-networking unit; 36-tag reading unit; 60-object; 65-radio frequency tag; 80-community platform.

detailed description

The present invention discloses a product selection and selling device, and a voice interaction system and a voice interaction method using the same. The following describes the technical content of the present invention through specific embodiments, so that those skilled in the art can understand the content disclosed in this specification. Easily understand the advantages and effects of the present invention. However, the present invention can also be implemented or applied in other specific embodiments. Therefore, in the specific embodiments of the present invention and its components accompanying the illustrations, all references to front and back, left and right, top and bottom, upper and lower, and horizontal and vertical are for convenience of description and are not limiting. The invention does not limit its components to any position or spatial direction. The dimensions specified in the drawings and the description can be changed according to the design and requirements of the specific embodiments of the present invention without departing from the scope of the claims of the present invention.

The architecture of the voice interactive system using the selection selling device of the present invention, as shown in FIG. 1, includes a servo device 10 and at least one selection selling device 20 and, and the servo device 10 and each of the selection selling device 20 can Form a connection, and according to some embodiments, the servo device 10 can connect to at least one social platform 80, and social servers and applications such as social platform 80FB, IG, WeChat, etc .;

The servo device 10 shown in FIG. 2 includes an interactive processing module 11, an online interface module 12, a member identification module 13, a product management module 14, an instruction operation module 15 and an image operation module 16. The interactive processing module 11 is a program for generating a voice interactive function, and the interactive processing module 11 has a human-machine interface for the background management personnel to operate, and the interactive processing module 11 can be connected to the online interface module 12 for connection with each The selection selling device 20 is connected, so that the servo device 10 can send and receive data or instructions to each of the selection selling device 20 or the community platform 80 through the online interface module 12, and the member identification module 13 can be connected and interacted. The processing module 11 and the member identification module 13 are used to process and store basic data including but not limited to corresponding members, corresponding social platform addresses, voiceprints or images for identification, level authority data, and gold account data, etc. The servo device 10 can identify the corresponding member after receiving the voice or image data transmitted by the selection selling device 20, and the commodity management module 14 connects The interactive processing module 11 and the commodity management module 14 are used to process and store basic data including but not limited to corresponding products, barcodes or images for identification, grab prices and storage, etc. In addition, the interactive processing module 11 is connected The command operation module 15 can distinguish the command according to the member's voice command transmitted by the selection selling device 20 according to the member identification module 13 and perform data processing or manipulation of the command according to the member's voice command, such as capturing images and uploading to the social platform 80 Or the selection sales device 20 has a lower jaw, and the image operation module 16 connected to the interactive processing module 11 can be used to process the image data captured by the selection sales device 20, such as capturing position, length, or adding models;

In some other embodiments, the servo device 10 includes a gold flow management module 17 connected to the interactive processing module 11, and the gold flow management module 17 is pre-stored in the member's personal gold flow account when the member selects items for purchase. Debits. In addition, in some embodiments, the interactive processing module 11 is further connected with a merchant management module 18, and the merchant management module 18 can be used to store basic data, product data, and gold flow accounts of the owning merchants of each of the selection selling devices 20. Data, etc., and can be connected to a merchant's terminal device, such as a computer, through the interactive processing module 11 and the online interface module 12 for merchant and product management. Furthermore, in some embodiments, the interactive processing module 11 is further connected with a voice assistant module 19, and the voice assistant module 19 can be used for searching and replying to the questions returned by each of the selection vending devices 20;

For the detailed structure of the selection and sales device, please refer to FIG. 3 and FIG. 4. The selection and sales device 20 is a machine with an accommodation space 200 that can be selectively opened. A plurality of objects 60 that can be individually selected are placed, and the objects 60 can be goods such as dolls. In some embodiments, each of the objects 60 can be provided with a radio frequency tag 65 [that is, RFID tag, wireless Radio frequency tag], and the accommodating space 200 has a gripping area 201 for placing objects 60 and a falling object opening 202 that communicates with the outside, so that objects 60 falling into the falling object opening 202 can be removed by the player, and each should The selection selling device 20 is provided with a control module 30 for performing various functions. The control module 30 has a processing unit 31 for processing, reading, receiving, and transmitting instructions. In addition, a control connection 30 is provided inside the accommodation space 100. The picking unit 23 of the processing unit 31 of the module 30, and the picking unit 23 may be a gripper mechanism, a secant mechanism, or other mechanism that can be used to obtain the object 60, for grasping the object 60 in the accommodation space 100 for grasping. Displacement between the selection area 201 and the object opening 202 A control unit 24 electrically connected to the processing module 31 is provided on the outside of the machine of the vending device 20, for the operation of the picking unit 23 to selectively grab the objects 60 through the control unit 24. The control unit 24 may include a A joystick for controlling the direction and a mechanism for controlling the picking of objects. In addition, the item selecting and selling device 20 may further be provided with at least a display unit 25 connected to the processing unit 31. The display unit 25 may be used for displaying advertisements and game states. In addition, at least one light-shadow unit 26 connected to the processing unit 31 may be provided on the outside of the machine for selecting and selling the equipment 20, and the light-shadow unit 26 may include light-emitting elements and light-transmitting plates of different colors, or LEDs. , LCD screen, etc., for playing text or advertising information;

In addition, the processing unit 31 of the aforementioned control module 30 is connected to an activation unit 32, and the activation unit 32 may be a coin slot 321 provided on the machine for players to use coins to pay for games, and the activation unit 32 It may also be a sensor 322 provided on the machine for the player to play the game with the stored-value card induction method, and the starting unit 32 may further be a virtual launcher 323 connected to the gold flow operation module 17 of the servo device 10, which can be used After connecting to the network, the player will be deducted from the gold flow account of the player to play the game. In addition, the processing unit 31 is connected with a smart speaker 33, which can be used to receive player voice messages and playback sounds. The processing unit 31 is connected to an image capturing unit 34 provided in the containing space 200. The image capturing unit 34 can synchronously obtain the environment and the player screen in the containing space 200 for recording and product or player identification. The unit 31 has a network connection unit 35, which can be used to connect to the connection interface module 12 of the servo device 10 through a wired or wireless technology, and to transmit and receive voice Video and other data. And in some embodiments, the processing unit 31 of the control module 30 is further connected with a tag reading unit 36 provided in the receiving space 202 of the storage space 200, and the tag reading unit 36 can be used for the radio frequency corresponding to the scanned object 60 A tag 65 to read the corresponding inner code for identifying the captured object 60;

In this way, players can use voice instructions to operate the selection sales device 20 before each selection sales device 20, and can increase interaction after identifying the player's membership, thereby forming an application selection sales The device's voice interaction system.

The actual use state of the selection sales device 20 in the voice interaction system of the selection sales device using the present invention,

In addition, as for the method for applying the voice interaction system of the selection and sales device of the present invention, as shown in FIG. 5, FIG. 6, and FIG. 7, the player first registers as a member before the game, and logs in including but not limited to various personal basic data , Voiceprint, facial recognition features, designated community account or gold flow account in the member identification module 13 of the servo device 10, and the commodity management module 14 of the servo device 10 registers each of the selected item sales equipment 20 The type, quantity, or identification characteristics of the internal object 60, such as a radio frequency internal code or an image, and according to some embodiments, each of the selection selling devices 20 may have a different business, and the business may use the business management module of the servo device 10 The registration in 18 includes but is not limited to the basic data of the merchant, the selected item sales equipment 20 or the gold flow account, etc. The process steps of the voice interaction method of the selected item sales device are:

Step S01: Activate the selection selling device to obtain the member identification information: After the player pays for the activation unit 32 of a selection selling device 20, the selection selling device 20 can obtain the identification by using the smart speaker 33 connected to the processing unit 31 of the control module 30 The player's voice, for example, the player says "Please identify the membership status", and after transmitting to the servo device 10, the interactive processing module 11 and the member identification module 13 use the pre-stored recognition voiceprint to determine whether it is a registered member. According to some embodiments, the player's face image is obtained by the image capturing unit 34 of the selection selling device 20, and after being transmitted to the servo device 10, the interactive processing module 11 and the member identification module 13 use the pre-stored identification image to determine Whether it is a registered member. In addition, according to some embodiments, after touching the control unit 24 of the selection selling device 20, the player can determine whether it is a registered member through the aforementioned smart speaker 33 with a sound or image capturing unit 34 with a facial image, and if it is executed S02 or execute S06 first, otherwise end or execute step S08;

Step S02: The above-mentioned selection selling device acquires player member voice information: The smart speaker 33 connected to the processing unit 31 in the control module 30 of the selection selling device 20 can receive the player member's voice information and transmit the voice information to the servo The device 10 is also connected to the image capturing unit 34 of the processing unit 31 in the control module 30. After determining that it is a member, it starts automatic capturing, and transmits the continuous image information to the servo device 10, and executes S03;

Step S03: Determine whether the feature information is an operation instruction: the interactive processing module 11 and the instruction operation module 15 of the servo device 10 process the voice information of the aforementioned player member and identify whether the feature information is an operation instruction, and extract the feature information , And further determine whether the characteristic information is an operation instruction, such as including but not limited to "leftward", "forward", "lower claw", "playback image", "playback image", "cut", "length", “Upload FB”, “Upload IG”, “Start voice assistant”, “Play music”, “Search XXX” or “Ask XXX” and other default operation instructions or synonyms, and if the feature information is an operation instruction, execute S04, otherwise Execute S02;

Step S04: Perform the specified action according to the operation instruction: After the instruction operation module 15 of the servo device 10 determines that the voice information of the player member includes the characteristic information of the operation instruction, it starts to execute the instruction, such as selling the selected item. The operation instructions of the device 20 include, but are not limited to, “leftward”, “forward”, and “lower claw”, the servo device 10 returns instruction information to the selection selling device 20, and the selection selling device 20 The grabbing unit 23 is operated by the processing unit 31 of the control module 30. If this is the operation instruction for the servo device 10, it includes, but is not limited to, "play video", "playback video", "clip", "length" , "Upload FB", "Upload IG", "Start voice assistant", "Play music", "Search XXX" or "Ask XXX", the interactive processing module 11 of the servo device 10 executes according to the operation instruction, for example, by The voice assistant module 19 performs a question-and-answer interaction with a player member in front of the selection selling device 20, and then proceeds to step S05;

In step S05, it is determined whether the picking and selling device takes out the objects: whether the picking and selling device 20 is controlled by the control unit 24 or the voice operation instruction of the processing unit 31 of the control module 30 to control the grabbing unit 23 to pick up the objects 60, The selection and selling device 20 can determine whether the object 60 has fallen into the falling object 202 through the image capturing unit 34, and can cooperate with the retrieval image returned by the servo device 10 to identify which object 60 is taken out through the commodity management module 14. According to some embodiments, if the falling object 202 of the item selling device 20 is provided with a tag reading unit 36 connected to the processing unit 31, and each of the objects 60 is provided with a radio frequency tag 65, the tag can also be read by the tag Whether the unit 36 grabs the object 60 and completes the game, and can also return to step S01 to repeat the next cycle of the game or execute step S07. At the same time, the player member can also receive the operation instruction of the voice information through the smart speaker 33 of the control module 30 when performing the game, and perform the video editing of the game. Then the interactive processing module 11 of the servo device 10 according to the operation instruction For example, the image operation module 16 edits the player's pick-up image and uploads the pick-up image to the social platform 80 designated by the member [as shown in FIG. 7].

Step S06: Perform specific interaction according to the identified member data: the servo device 10 receives voiceprint or image capture unit 34 via the smart speaker 33 of the item selling device 20, and after receiving facial images to confirm that the player is a member, the servo device 10 can be used in the servo device 10 The member identification module 13 of the player obtains the basic data of the player member, such as the birthday of the player member, the servo device 10 can control the selection selling device 20 together with the surrounding selection selling device 20 by using the smart speaker 33 and the display unit 25 Or, the light and shadow unit 26 plays sound and light effects such as congratulations, music, or movies [as shown in FIG. 8] to increase interactivity, and then executes step S02;

Step S07: Generate interaction based on the specific results of the execution of the action: after receiving the picking information of the picking and selling device 20, the servo device 10 can accumulate and obtain the player's member level and membership level by the member identification module 13 in the servo device 10. Record, when the player member reaches a certain record or level, the servo device 10 can control the selection selling device 20 together with the surrounding selection selling device 20 by using the smart speaker 33, the display unit 25 or the light and shadow unit 26, etc. Sound and light effects such as congratulations, music or videos [shown in Figure 8] to increase interactivity.

Step S08: The picking and selling device executes the picking action: After the player starts the picking and selling device 20, when the voice or image capturing unit 34 determines the face as an unregistered member through the above-mentioned smart speaker 33, the general operation is entered. Mode, the player of the non-registered member can use the control unit 24 of the selection selling device 20 to move the retrieval unit 23 to selectively grasp the objects 60 in the holding area 200 grasping area 201 for general selection. Bargaining games.

From the above description, it can be known that the system of the present invention allows the selection sales device 20 to receive the voice of the player member through the special design of the smart speaker 33 of the control module 30 in the selection sales device 20 and the command operation module 15 of the servo device 10. After the information is obtained, the operation instructions of the characteristic information are obtained, so that the servo device 10 can feedback to operate the selection selling device 20 or connect to the social platform 80, so that players can use the selection selling device 20 to interact and create novel and interesting gameplay. So as to increase the added value of the product and enhance its economic benefits.

Claims

A voice interaction method using a selection and sales device, which comprises the following steps:

Step S01: Start the selection and sales equipment to obtain member identification information. If it is a registered member, execute step S02, otherwise end;

Step S02: The above-mentioned item selecting and selling device obtains the voice information of the player member, extracts the characteristic information in the voice information, and then executes step S03;

Step S03: Determine whether the characteristic information is an operation instruction. If yes, execute S04; otherwise, execute step S02;

Step S04, performing a specified action according to the operation instruction, and then performing step S05;

In step S05, it is determined whether the item selection and selling equipment has taken out the objects, and the game is completed.
The method for voice interaction using the item selection and selling device according to claim 1, wherein after step S01 is determined as a non-registered member, a step S08 is further performed;

Step S08: The item selection and selling equipment performs an object taking operation, and performs a selective grasping operation using a general operation mode.
The method for voice interaction using an item selection and selling device according to claim 1, wherein after step S01 is determined to be a registered member, step S06 is performed;

In step S06, a specific interaction is performed according to the identified member data, and then step S02 is performed.
The method for voice interaction using an item selection and selling device according to claim 1, wherein after step S05 ends, step S07 is performed;

Step S07: Generate an interaction according to a specific result of performing the action.
A voice interaction system using a selection and sales device for performing the method of claim 1, wherein the voice interaction system includes:

A servo device including:

A built-in application and interactive processing module for man-machine interface for background operation.

An online interface module connected to the interactive processing module for external connection,

A member identification module connected to the interactive processing module for processing basic member data,

A commodity management module connected to the interactive processing module for processing commodity data,

An instruction operation module connected to the interactive processing module for extracting at least one feature information in a voice message to obtain at least one operation instruction, and

An image operation module connected to the interactive processing module for generating voice interaction using operation instructions, and the servo device is connected to at least one social platform;

At least one item selection selling device, which has an accommodation space for placing at least one object, the accommodation space includes a gripping area for placing items and a drop opening that communicates with the outside, and each of the item selection is sold A control module is provided inside the device, the control module has a processing unit, and a picking unit connected to the processing unit for selective grasping of objects is provided in the accommodation space, and the processing module is electrically connected to operate the picking The control unit of the unit and the processing unit are connected with a display unit, and the processing unit of the control module is connected with an activation unit for starting the control unit, and the processing unit is connected with a smart speaker for receiving and playing voice information, and the processing The unit is connected with an image capturing unit for acquiring players and capturing process, and the processing unit has a network unit for connecting with the servo device.
The voice interactive system using a selection selling device according to claim 5, wherein the servo device includes a business management module connected to the interaction processing module, and the business management module is used for storing the ownership of each selection sales device The merchant's basic data, product data and gold flow account data, and the merchant is connected to the servo device through a terminal device for merchant and merchandise management.
The voice interactive system using a selection selling device according to claim 5, wherein the servo device comprises a voice assistant module connected to an interactive processing module, and the speech assistant module is used for searching and replying to each selection selling device Postback issues.
The voice interactive system using a selection selling device according to claim 5, wherein the processing unit in the control module of the selection selling device is further connected with a tag reading unit provided at the falling opening in the accommodation space, each An RF tag is provided inside the object for the tag reading unit to correspond to the RF tag of the scanned object.
The voice interactive system using a selection selling device according to claim 5, wherein at least one light and shadow unit connected to the processing unit is further provided outside the selection selling device machine for playing text or advertisement information.
An object selecting and selling device, which is characterized in that it has a receiving space for placing at least one object. The receiving space includes a grasping area for placing objects and a falling object opening connected to the outside. A control module is provided inside the selection and selling device, the control module has a processing unit, and a picking unit connected to the processing unit and for selectively grasping objects is provided in the accommodation space, and the processing module is electrically connected. A control unit for operating the picking unit, a processing unit is connected to a display unit, a processing unit of the control module is connected to an activation unit for starting the control unit, and the processing unit is connected to a smart speaker for receiving and playing voice information And, the processing unit is connected with an image capturing unit for acquiring players and capturing process, and the processing unit has a network unit for connecting with an external servo device.
The voice interactive system using a selection selling device according to claim 10, wherein a processing unit in the control module of the selection selling device is further connected with a tag reading unit provided at a falling port in the accommodation space, each An RF tag is provided inside the object, and the tag reading unit corresponds to the RF tag of the scanned object.
The voice interactive system using a selection selling device according to claim 10, wherein at least one light and shadow unit connected to the processing unit is further provided outside the selection selling device machine for playing text or advertisement information.