CN110689375A - Information interaction method, system, equipment and medium based on portable equipment - Google Patents

Information interaction method, system, equipment and medium based on portable equipment Download PDF

Info

Publication number
CN110689375A
CN110689375A CN201910920509.0A CN201910920509A CN110689375A CN 110689375 A CN110689375 A CN 110689375A CN 201910920509 A CN201910920509 A CN 201910920509A CN 110689375 A CN110689375 A CN 110689375A
Authority
CN
China
Prior art keywords
information
voice
portable device
commodity
client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910920509.0A
Other languages
Chinese (zh)
Inventor
周曦
易渝富
万珺
游宇
陈江豪
侯延年
雷雨佳
方凯
田元
刘桂渝
颜晖
黄铃
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Yuncong Artificial Intelligence Technology Co Ltd
Original Assignee
Guangzhou Yuncong Artificial Intelligence Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Yuncong Artificial Intelligence Technology Co Ltd filed Critical Guangzhou Yuncong Artificial Intelligence Technology Co Ltd
Priority to CN201910920509.0A priority Critical patent/CN110689375A/en
Publication of CN110689375A publication Critical patent/CN110689375A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0281Customer communication at a business location, e.g. providing product or service information, consulting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/332Query formulation
    • G06F16/3329Natural language query formulation or dialogue systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/3331Query processing
    • G06F16/334Query execution
    • G06F16/3343Query execution using phonetics
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/225Feedback of the input speech

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Computational Linguistics (AREA)
  • Acoustics & Sound (AREA)
  • Development Economics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Strategic Management (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Databases & Information Systems (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Artificial Intelligence (AREA)
  • Game Theory and Decision Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Multimedia (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention provides an information interaction method, a system, equipment and a medium based on portable equipment, which comprises the following steps: collecting voice information, acquiring voice information related to the commodity, and outputting voice response information; wherein, voice collection or output is carried out through the portable device; the invention completes the commodity shopping guide task by the aid of the portable device, improves the working efficiency and reduces the requirement on personal quality of salesmen.

Description

Information interaction method, system, equipment and medium based on portable equipment
Technical Field
The invention relates to the field of automobile sales, in particular to an information interaction method, system, device and medium based on portable equipment.
Background
In the current commodity sales industry, the traditional dealer inventory coefficient and the early warning index are both in high positions, market competition is aggravated, marketing drainage cost is high, customer-to-store conversion rate is low, service profitability is reduced, the condition of network quit caused by dealer loss occurs sometimes, survival pressure is high, and the Chinese commodity entity sales market faces deep adjustment.
Technically, the existing customer group analysis and identification technology still remains in identification of individual customers, identification is not carried out on customer batches, and the business requirements of the commodity sales industry cannot be met. The existing commodity attention technology is mainly based on human faces and head shoulders, based on the fact that the human faces cannot be snapshotted and identified by a camera from side to side and back to back due to limitation of snapshotting angles, and based on the fact that the head shoulders can only be used for counting and cannot identify the identity of a client, commodity attention information cannot be accurately corresponding to specific clients. And the customer will usually ask information about the performance parameters of the goods when purchasing the goods, which is highly demanding for the personal qualities of the shopping guide personnel.
Disclosure of Invention
In view of the problems in the prior art, the invention provides an information interaction method, system, device and medium based on a portable device, which mainly solve the problems of lack of pertinence to customer requirements and high personal quality requirements of sales personnel.
In order to achieve the above and other objects, the present invention adopts the following technical solutions.
An information interaction method based on a portable device comprises the following steps:
collecting voice information, acquiring voice information related to the commodity, and outputting voice response information; the guidance information is acquired through the portable equipment, and voice acquisition or output is performed.
Optionally, the biological recognition features of the same batch are recognized, guidance information is obtained, and the first voice prompt message is obtained according to the guidance information and is played in a voice mode.
Optionally, the guidance information includes guidance tasks, customer information, customer visit records, and customer interest goods information.
Optionally, the first voice prompt message is obtained according to the customer visit record.
Optionally, when a client visit record exists, acquiring a first voice prompt message prompting the identity and the demand information of the client according to the client visit record; and when the client visit record does not exist, directly acquiring the first voice prompt information to prompt the execution of the guidance task.
Optionally, a commodity information corpus is created, and the collected voice information is compared with the corpus information in the commodity information corpus to obtain the voice information related to the commodity.
Optionally, the word frequency related to the commodity in the collected voice is counted, and an audio output response is triggered according to the word frequency.
Optionally, second voice prompt information is obtained according to the related voice information of the commodity, and voice playing is carried out.
Optionally, a word frequency threshold is set, and when the statistical word frequency exceeds the word frequency threshold, third voice prompt information corresponding to the word is acquired.
Optionally, the merchandise includes vehicles, art, antiques, clothing.
Optionally, the connection server side obtains the attention information of the customer goods, and obtains the fourth voice prompt information for voice playing.
Optionally, the second voice prompt message is set to have the highest priority, and when the voice related information of the commodity is acquired, the second voice prompt message is played preferentially.
An information interaction system based on a portable device, comprising:
the voice acquisition module is used for acquiring voice information;
the commodity information identification module is used for acquiring the voice information related to the commodity;
the response module is used for outputting voice response information;
the portable device is used for acquiring the guidance information and carrying out voice acquisition or output.
Optionally, the system comprises a voice prompt module, configured to obtain voice prompt information according to the guidance information and the voice recognition result, and perform voice playing.
Optionally, the system comprises a corpus module, which is used for comparing the collected voice information with corpus information in a commodity information corpus to obtain voice information related to the commodity.
Optionally, a word frequency statistic module is included, configured to count frequencies of words related to the product in the customer audio, and trigger an audio output response according to the word frequencies.
Optionally, the system comprises a communication module, configured to connect to a server to obtain the commodity attention information of the client, obtain an audio response according to the commodity attention information, and perform voice playing.
An apparatus, comprising:
one or more processors; and
one or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the device to perform the portable device-based information interaction method.
One or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause a device to perform the portable device-based information interaction method.
As described above, the information interaction method, system, device and medium based on portable device of the present invention have the following advantages.
The portable device is used for voice response, so that the auxiliary salesperson can solve difficult problems brought by the customer, the requirement on personal quality of the salesperson is lowered, and the customer experience is enhanced.
Drawings
Fig. 1 is a flowchart of an information interaction method based on a portable device according to an embodiment of the present invention.
Fig. 2 is a block diagram of an information interaction system based on a portable device according to an embodiment of the present invention.
Fig. 3 is a schematic structural diagram of a terminal device in an embodiment of the present invention.
Fig. 4 is a schematic structural diagram of a terminal device in another embodiment of the present invention.
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
Referring to fig. 1, the present invention provides an information interaction method based on a portable device, including steps S01-S02.
In step S01, voice information is collected:
before the voice information is collected, the guide information is obtained through the portable device, wherein the guide information can comprise guide tasks, customer information, customer visit records and customer interest commodity information. Which may include vehicles, art, antiques, clothing, etc. Taking a vehicle as an example, the guiding information related to the vehicle is acquired, and a plurality of image acquisition devices can be arranged at the entrance of a vehicle exhibition hall to acquire the images of clients entering the vehicle exhibition hall. And performing feature extraction on the acquired customer image to acquire biological identification feature information corresponding to the customer. Biometric features may include face features, hair style features, clothing features, posture features, and the like. Taking the collection of human face characteristics at an entrance as an example, video stream data at the entrance is obtained through a camera, and passenger flow volume statistics can be carried out by obtaining human face images in the video stream. When the passenger flow statistics is carried out, a plurality of entrance images can be continuously collected within a specified time interval, passenger flow is screened according to the front face image and the back face image of the face, the back face image usually represents a user who leaves, the back face image in the collected images can be ignored when the passenger flow statistics is carried out, and repeated statistics is avoided. In another embodiment, a detection module may be provided to detect biometric features at the entrance of the vehicle exhibition hall, thereby triggering the image capturing device to capture images. If an infrared thermal sensor is arranged, whether a person visits or not can be confirmed by detecting the change of the infrared heat map of the designated area at the entrance. And when a person enters the designated area, sending a trigger signal to start the corresponding image acquisition device.
In one embodiment, a time threshold may be set for the image information collected at the entrance, and the customers entering the entrance within the set threshold may be divided into the same batch. If a certain time is set as a starting point, every two minutes from the starting point is a time threshold value, and the customer images collected in the same time threshold value belong to the same batch of customer images. The time threshold may also be a time interval when the camera device does not acquire the customer images, for example, when it is detected that the time interval from the time when a certain batch of customers enters the entrance to the time when the next batch of customers enters the entrance is 10 minutes, the set time threshold is 3 minutes, and since the time interval is greater than the set time threshold, it is determined that the two batches of customers belong to customers of different batches. The setting mode of the time threshold can be flexibly adjusted according to the historical passenger flow conditions of different storefronts and the time nodes in light/busy seasons, and the efficiency and the precision of batch identification can be effectively improved.
After the same batch of customer information is obtained, further screening can be performed on the same batch of customer information, for example, several continuous frames of images in a shot video stream can be obtained, and the action track of the corresponding customer is obtained by extracting the position of the corresponding face image in the image and the corresponding time node of the frame of image. Classifying the collected face images by adopting a clustering algorithm according to the action tracks of the clients, and screening client information according to classification information, wherein if the action tracks of the clients indicate that the clients enter an entrance of a vehicle exhibition hall, the clients are judged to be clients in corresponding batches; and if the action track of the client indicates that the client leaves the entrance of the vehicle exhibition hall, removing the corresponding client information from the acquired client information of the same batch.
And after the client batch information is determined, the client batch information and the corresponding biological identification characteristic information are sent to a background server. And the server performs task allocation for the client batch while performing information recording. Before task allocation, face recognition can be performed according to the acquired face features. And taking the face image of the historical visitor as a target set, and comparing the acquired face features with the face features in the target set through a recognition algorithm of a neural network. And if the matching is successful, sending the history visiting data of the client to the server. Taking a 4S store as an example, a plurality of 4S store clients visit data records can be acquired through network connection, and historical data of the corresponding clients in other 4S stores can be acquired through feature comparison of client face images acquired by the current 4S store, so that accurate positioning and analysis of client requirements can be facilitated.
The portable device acquires first voice prompt information according to the historical visiting record of the client, for example, when the visiting record of the client exists, the identity information, the demand information and the like of the client in the visiting record are acquired, the demand information and the identity information of the client are sent to the corresponding salespersons, the salesperson information which receives the same client last time can be acquired according to the visiting record, the guide information is sent to the corresponding salespersons, and the salespersons are reminded to execute guide multitask through the first voice information; and when the customer visit record does not exist, prompting the salesperson to execute a guidance task by directly prompting the salesperson through the first voice prompt message.
And after the salesperson obtains the guidance task according to the first voice prompt information, the salesperson moves to the customer position of the specified batch according to the prompt of the first voice information. The salesperson can wear the portable device on one's body, receive the voice prompt message at any time.
And in the process of the conversation between the salesperson and the client, voice information is collected through an audio collection module on the portable device.
In step S02, acquiring the voice information relating to the commodity, and outputting voice response information; wherein, acquire the guide information through portable device to voice acquisition or output:
and comparing the collected voice information with the corpus information in the pre-established vehicle information corpus, and acquiring the voice information related to the vehicle in the conversation process according to the comparison result. The vehicle information corpus can analyze possible inquiry contents of the client according to the types of the existing vehicles of the current 4S store and related parameters such as oil consumption, brands, engine parameters and the like, and establishes a vehicle related corpus. And acquiring second voice prompt information according to the recognized voice related information of the vehicle, wherein if the customer wants to know the parameters of the engine of the vehicle and the salesperson is difficult to make an accurate answer, the portable device can acquire the information required by the customer through voice recognition, acquire the data information related to the parameters of the engine from the server side and output the data information to the corresponding customer through voice playing.
In one embodiment, the portable device may also count the frequency of occurrence of words associated with the vehicle in the collected voice information. And a word frequency threshold value can be set, and when the counted frequency of a certain word exceeds the word frequency threshold value, third voice prompt information corresponding to the word is obtained. If the customer mentions that the oil consumption is low for many times, the sales staff can be prompted to adjust the sales strategy through the third voice prompt message. The situation that the salesperson omits key information due to excessive communication staff is avoided.
In one embodiment, the portable device may be connected to the server to obtain the vehicle attention information of the client, and may obtain the residence time of the client from entering a certain vehicle exhibition area to leaving the certain vehicle exhibition area according to the action track of the client, and if the residence time exceeds a set residence time threshold, it is determined that the corresponding vehicle is the vehicle concerned by the client. And the server side triggers fourth voice prompt information according to the concerned vehicle information, and introduces the basic information of the concerned vehicle to the client through voice playing.
In one embodiment, the second voice prompt message may be set to have the highest priority, and when the vehicle voice related information in the vehicle information corpus during the conversation is identified, whether the voice transmission channel is occupied is detected, and if the voice transmission channel is occupied, the voice signal transmission in the voice transmission channel is interrupted, and the second voice prompt message is transmitted preferentially.
Referring to fig. 2, the present invention provides an information interaction system based on a portable device, which includes a voice collecting module 10, a goods information identifying module 11 and a response module 12. The voice collecting module 10 is used to assist in executing the step S01 described in the foregoing method embodiment, and the goods information identifying module 11 and the response module 12 are used to assist in executing the step S02 described in the foregoing method embodiment.
In one embodiment, the voice collecting module 10, the goods information identifying module 11 and the response module 12 are respectively disposed on a portable device, and voice collection or output is performed through the portable device.
In an embodiment, the system further comprises a voice prompt module, wherein the voice prompt module acquires first voice prompt information according to the history visiting record of the client, for example, when the visiting record of the client exists, the voice prompt module acquires the identity information, the demand information and the like of the client in the visiting record, sends the demand information and the identity information of the client to the corresponding salespersons, or acquires the information of the salespersons who last received the same client according to the visiting record, sends the guidance information to the corresponding salespersons, and reminds the salespersons to execute guidance multitask through the first voice information; and when the customer visit record does not exist, prompting the salesperson to execute a guidance task by directly prompting the salesperson through the first voice prompt message.
And after the salesperson obtains the guidance task according to the first voice prompt information, the salesperson moves to the customer position of the specified batch according to the prompt of the first voice information. The salesperson can wear the portable device on one's body, receive the voice prompt message at any time.
And in the process of the conversation between the salesperson and the client, voice information is collected through an audio collection module on the portable device.
In one embodiment, the system further comprises a corpus module, wherein a vehicle information corpus is created through the corpus module, the collected voice information is compared with the corpus information in the pre-created vehicle information corpus, and the voice information related to the vehicle in the conversation process is obtained according to the comparison result. The vehicle information corpus can analyze possible inquiry contents of the client according to the types of the existing vehicles of the current 4S store and related parameters such as oil consumption, brands, engine parameters and the like, and establishes a vehicle related corpus. The voice prompt module acquires second voice prompt information according to the recognized vehicle voice related information, if a customer wants to know vehicle engine parameters and a salesperson is difficult to make an accurate answer, the portable device can acquire customer demand information through voice recognition, acquire data information related to the engine parameters from the server side and output the data information to a corresponding customer through voice playing.
In one embodiment, the system further comprises a word frequency statistic module, and the frequency of the words related to the vehicle in the collected voice information is counted through the word frequency statistic module. And a word frequency threshold value can be set, and when the counted frequency of a certain word exceeds the word frequency threshold value, third voice prompt information corresponding to the word is obtained. If the customer mentions that the oil consumption is low for many times, the sales staff can be prompted to adjust the sales strategy through the third voice prompt message. The situation that the salesperson omits key information due to excessive communication staff is avoided.
In one embodiment, the portable device may be connected to the server to obtain the vehicle attention information of the client, and may obtain the residence time of the client from entering a certain vehicle exhibition area to leaving the certain vehicle exhibition area according to the action track of the client, and if the residence time exceeds a set residence time threshold, it is determined that the corresponding vehicle is the vehicle concerned by the client. And the server side triggers fourth voice prompt information according to the concerned vehicle information, and introduces the basic information of the concerned vehicle to the client through voice playing.
In one embodiment, the second voice prompt message may be set to have the highest priority, and when the vehicle voice related information in the vehicle information corpus during the conversation is identified, whether the voice transmission channel is occupied is detected, and if the voice transmission channel is occupied, the voice signal transmission in the voice transmission channel is interrupted, and the second voice prompt message is transmitted preferentially.
In one embodiment, the portable device can establish a connection with the server through the communication module to perform data transmission. The portable device can be worn on the body of a salesperson to assist the salesperson to complete a sales task, and can also be picked up by a customer at an entrance of a vehicle exhibition hall, and when the portable device is worn on the body of the customer, the portable device can automatically identify voice conversation information among the customers in the same batch, and necessary information feedback is provided.
An embodiment of the present application further provides an apparatus, which may include: one or more processors; and one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method of fig. 1. In practical applications, the device may be used as a terminal device, and may also be used as a server, where examples of the terminal device may include: the mobile terminal includes a smart phone, a tablet computer, an electronic book reader, an MP3 (Moving Picture Experts Group Audio Layer III) player, an MP4 (Moving Picture Experts Group Audio Layer IV) player, a laptop, a vehicle-mounted computer, a desktop computer, a set-top box, an intelligent television, a wearable device, and the like.
The embodiment of the present application also provides a non-volatile readable storage medium, where one or more modules (programs) are stored in the storage medium, and when the one or more modules are applied to a device, the device may be caused to execute instructions (instructions) included in the method for information interaction based on a portable device in fig. 1 according to the embodiment of the present application.
Fig. 3 is a schematic diagram of a hardware structure of a terminal device according to an embodiment of the present application. As shown, the terminal device may include: an input device 1100, a first processor 1101, an output device 1102, a first memory 1103, and at least one communication bus 1104. The communication bus 1104 is used to implement communication connections between the elements. The first memory 1103 may include a high-speed RAM memory, and may also include a non-volatile storage NVM, such as at least one disk memory, and the first memory 1103 may store various programs for performing various processing functions and implementing the method steps of the present embodiment.
Alternatively, the first processor 1101 may be, for example, a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a controller, a microcontroller, a microprocessor, or other electronic components, and the processor 1101 is coupled to the input device 1100 and the output device 1102 through a wired or wireless connection.
Optionally, the input device 1100 may include a variety of input devices, such as at least one of a user-oriented user interface, a device-oriented device interface, a software programmable interface, a camera, and a sensor. Optionally, the device interface facing the device may be a wired interface for data transmission between devices, or may be a hardware plug-in interface (e.g., a USB interface, a serial port, etc.) for data transmission between devices; optionally, the user-facing user interface may be, for example, a user-facing control key, a voice input device for receiving voice input, and a touch sensing device (e.g., a touch screen with a touch sensing function, a touch pad, etc.) for receiving user touch input; optionally, the programmable interface of the software may be, for example, an entry for a user to edit or modify a program, such as an input pin interface or an input interface of a chip; the output devices 1102 may include output devices such as a display, audio, and the like.
In this embodiment, the processor of the terminal device includes a function for executing each module of the speech recognition apparatus in each device, and specific functions and technical effects may refer to the above embodiments, which are not described herein again.
Fig. 4 is a schematic hardware structure diagram of a terminal device according to another embodiment of the present application. Fig. 4 is a specific embodiment of fig. 3 in an implementation process. As shown, the terminal device of the present embodiment may include a second processor 1201 and a second memory 1202.
The second processor 1201 executes the computer program code stored in the second memory 1202 to implement the method described in fig. 1 in the above embodiment.
The second memory 1202 is configured to store various types of data to support operations at the terminal device. Examples of such data include instructions for any application or method operating on the terminal device, such as messages, pictures, videos, and so forth. The second memory 1202 may include a Random Access Memory (RAM) and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
Optionally, the first processor 1201 is provided in the processing assembly 1200. The terminal device may further include: communication component 1203, power component 1204, multimedia component 1205, speech component 1206, input/output interfaces 1207, and/or sensor component 1208. The specific components included in the terminal device are set according to actual requirements, which is not limited in this embodiment.
The processing component 1200 generally controls the overall operation of the terminal device. The processing assembly 1200 may include one or more second processors 1201 to execute instructions to perform all or part of the steps of the method illustrated in fig. 1 described above. Further, the processing component 1200 can include one or more modules that facilitate interaction between the processing component 1200 and other components. For example, the processing component 1200 can include a multimedia module to facilitate interaction between the multimedia component 1205 and the processing component 1200.
The power supply component 1204 provides power to the various components of the terminal device. The power components 1204 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the terminal device.
The multimedia components 1205 include a display screen that provides an output interface between the terminal device and the user. In some embodiments, the display screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the display screen includes a touch panel, the display screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.
The voice component 1206 is configured to output and/or input voice signals. For example, the voice component 1206 includes a Microphone (MIC) configured to receive external voice signals when the terminal device is in an operational mode, such as a voice recognition mode. The received speech signal may further be stored in the second memory 1202 or transmitted via the communication component 1203. In some embodiments, the speech component 1206 further comprises a speaker for outputting speech signals.
The input/output interface 1207 provides an interface between the processing component 1200 and peripheral interface modules, which may be click wheels, buttons, etc. These buttons may include, but are not limited to: a volume button, a start button, and a lock button.
The sensor component 1208 includes one or more sensors for providing various aspects of status assessment for the terminal device. For example, the sensor component 1208 may detect an open/closed state of the terminal device, relative positioning of the components, presence or absence of user contact with the terminal device. The sensor assembly 1208 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact, including detecting the distance between the user and the terminal device. In some embodiments, the sensor assembly 1208 may also include a camera or the like.
The communication component 1203 is configured to facilitate communications between the terminal device and other devices in a wired or wireless manner. The terminal device may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In one embodiment, the terminal device may include a SIM card slot therein for inserting a SIM card therein, so that the terminal device may log onto a GPRS network to establish communication with the server via the internet.
As can be seen from the above, the communication component 1203, the voice component 1206, the input/output interface 1207 and the sensor component 1208 referred to in the embodiment of fig. 4 can be implemented as the input device in the embodiment of fig. 3.
In summary, the information interaction method, the information interaction system, the information interaction equipment and the information interaction medium based on the portable equipment carry out voice acquisition and output through the portable device, and are convenient for sales personnel to carry; the method and the system have the advantages that the difficult and complicated problem requirements of the customers are obtained through voice recognition, voice response information is obtained in a targeted mode, the problem which cannot be solved by the salesperson is solved, and the requirements on personal quality of the salesperson are lowered. Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.

Claims (19)

1. An information interaction method based on portable equipment is characterized by comprising the following steps:
collecting voice information, acquiring voice information related to the commodity, and outputting voice response information; the guidance information is acquired through the portable equipment, and voice acquisition or output is performed.
2. The information interaction method based on portable device as claimed in claim 1, wherein the biometric features of the same batch are recognized, the guidance information is obtained, and the first voice prompt information is obtained according to the guidance information and is played in voice.
3. The information interaction method based on the portable device as claimed in claim 2, wherein the guidance information includes guidance tasks, customer information, customer visit records, and customer interest commodity information.
4. The information interaction method based on the portable device as claimed in claim 3, wherein the first voice prompt information is obtained according to a visit record of the client.
5. The information interaction method based on the portable device as claimed in claim 4, wherein when a client visit record exists, a first voice prompt message is obtained according to the client visit record to prompt the identity and the demand information of the client; and when the client visit record does not exist, directly acquiring the first voice prompt information to prompt the execution of the guidance task.
6. The information interaction method based on the portable device as claimed in claim 1, wherein a commodity information corpus is created, and the collected voice information is compared with the corpus information in the commodity information corpus to obtain the voice information related to the commodity.
7. The information interaction method based on the portable device as claimed in claim 1, wherein the frequency of words related to commodities in the collected voice is counted, and an audio output response is triggered according to the frequency of the words.
8. The information interaction method based on the portable device as claimed in claim 6, wherein a second voice prompt message is obtained according to the commodity-related voice message, and voice playing is performed.
9. The information interaction method based on portable device according to claim 7, wherein a word frequency threshold is set, and when the statistical word frequency exceeds the word frequency threshold, the third voice prompt information corresponding to the word is obtained.
10. The portable-device-based information interaction method of claim 1, wherein the commodities include vehicles, art, antiques and clothes.
11. The information interaction method based on the portable device as claimed in claim 1, wherein the connection server obtains the attention information of the customer goods and obtains the fourth voice prompt information for voice playing.
12. The information interaction recognition method based on portable device according to claim 8, wherein the second voice guidance information is set to have the highest priority, and when the voice-related information of the commodity is acquired, the second voice guidance information is preferentially played.
13. An information interaction system based on a portable device, comprising:
the voice acquisition module is used for acquiring voice information;
the commodity information identification module is used for acquiring the voice information related to the commodity;
the response module is used for outputting voice response information;
the portable device is used for acquiring the guidance information and carrying out voice acquisition or output.
14. The portable device based information interaction system of claim 13, comprising a voice prompt module for obtaining voice prompt information according to the guidance information and the voice recognition result and performing voice playing.
15. The portable device based information interaction system of claim 13, comprising a corpus module for comparing the collected voice information with corpus information in a commodity information corpus to obtain voice information related to commodities.
16. The portable device based information interaction system of claim 13, comprising a word frequency statistics module for counting frequencies of words related to commodities in the audio of the client, and triggering an audio output response according to the word frequencies.
17. The information interaction system based on the portable device as claimed in claim 13, comprising a communication module for connecting the server to obtain the commodity attention information of the client, and obtaining the audio response and performing the voice playing according to the commodity attention information.
18. An apparatus, comprising:
one or more processors; and
one or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method recited by one or more of claims 1-12.
19. One or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause an apparatus to perform the method recited by one or more of claims 1-12.
CN201910920509.0A 2019-09-27 2019-09-27 Information interaction method, system, equipment and medium based on portable equipment Pending CN110689375A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910920509.0A CN110689375A (en) 2019-09-27 2019-09-27 Information interaction method, system, equipment and medium based on portable equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910920509.0A CN110689375A (en) 2019-09-27 2019-09-27 Information interaction method, system, equipment and medium based on portable equipment

Publications (1)

Publication Number Publication Date
CN110689375A true CN110689375A (en) 2020-01-14

Family

ID=69110488

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910920509.0A Pending CN110689375A (en) 2019-09-27 2019-09-27 Information interaction method, system, equipment and medium based on portable equipment

Country Status (1)

Country Link
CN (1) CN110689375A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111243254A (en) * 2020-01-15 2020-06-05 安徽工程大学 Wireless transmission circuit, device and equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101636884B1 (en) * 2015-03-13 2016-07-20 주식회사 아크로노드 Intelligent script system services
CN107977852A (en) * 2017-09-29 2018-05-01 京东方科技集团股份有限公司 A kind of intelligent sound purchase guiding system and method
WO2018133723A1 (en) * 2017-01-23 2018-07-26 北京京东尚科信息技术有限公司 Voice shopping method and device, and computer readable storage medium
CN109636524A (en) * 2018-12-11 2019-04-16 优估(上海)信息科技有限公司 A kind of vehicle information acquisition method, apparatus and system
CN110070395A (en) * 2019-04-19 2019-07-30 优估(上海)信息科技有限公司 A kind of system, method and device assisting 0vehicle marketing

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101636884B1 (en) * 2015-03-13 2016-07-20 주식회사 아크로노드 Intelligent script system services
WO2018133723A1 (en) * 2017-01-23 2018-07-26 北京京东尚科信息技术有限公司 Voice shopping method and device, and computer readable storage medium
CN107977852A (en) * 2017-09-29 2018-05-01 京东方科技集团股份有限公司 A kind of intelligent sound purchase guiding system and method
CN109636524A (en) * 2018-12-11 2019-04-16 优估(上海)信息科技有限公司 A kind of vehicle information acquisition method, apparatus and system
CN110070395A (en) * 2019-04-19 2019-07-30 优估(上海)信息科技有限公司 A kind of system, method and device assisting 0vehicle marketing

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111243254A (en) * 2020-01-15 2020-06-05 安徽工程大学 Wireless transmission circuit, device and equipment

Similar Documents

Publication Publication Date Title
CN109976506B (en) Awakening method of electronic equipment, storage medium and robot
US8462224B2 (en) Image retrieval
JP4991440B2 (en) Product sales apparatus, product sales management system, product sales management method and program
US9536153B2 (en) Methods and systems for goods received gesture recognition
CN107454465A (en) Video playback progress display method and device, electronic equipment
JP4702877B2 (en) Display device
CN106856015B (en) A kind of Work attendance method and device
CN106548145A (en) Image-recognizing method and device
CN111047621B (en) Target object tracking method, system, equipment and readable medium
WO2021093427A1 (en) Visitor information management method and apparatus, electronic device, and storage medium
KR20210088600A (en) Exhibition area state recognition method, apparatus, electronic device and recording medium
JP6498900B2 (en) Advertisement evaluation system, advertisement evaluation method
CN108335317A (en) Shopping guide method and device under a kind of line
US20230252698A1 (en) Information processing device, display method, and program storage medium for monitoring object movement
CN111310725A (en) Object identification method, system, machine readable medium and device
CN110673723A (en) Speech interaction method, system, medium, and apparatus based on biometric features
JP2023507043A (en) DATA PROCESSING METHOD, DEVICE, DEVICE, STORAGE MEDIUM AND COMPUTER PROGRAM
JP5192842B2 (en) Gaze product data acquisition method and product sales management system
CN110689375A (en) Information interaction method, system, equipment and medium based on portable equipment
CN110677448A (en) Associated information pushing method, device and system
TW201502999A (en) A behavior identification and follow up system
CN110689374B (en) Commodity shopping guide management method, system, medium and equipment
CN111008842B (en) Tea detection method, system, electronic equipment and machine-readable medium
CN107341457A (en) Method for detecting human face and device
CN110674760A (en) Interactive guiding method, device, equipment and medium based on mobile robot

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200114