CN112185384A

CN112185384A - Account checking method and device and earphone

Info

Publication number: CN112185384A
Application number: CN202011066510.0A
Authority: CN
Inventors: 赵楠
Original assignee: Beijing Sogou Technology Development Co Ltd
Current assignee: Beijing Sogou Intelligent Technology Co Ltd
Priority date: 2020-09-30
Filing date: 2020-09-30
Publication date: 2021-01-05

Abstract

The embodiment of the invention provides an account checking method, an account checking device and an earphone, wherein the method comprises the following steps: acquiring user voice data; and searching account information according to the user voice data, and outputting according to the account information. According to the embodiment of the invention, the account checking can be completed without the user operating the earphone by hand. And the searching requirement of the user can be met under the condition that the user is inconvenient to operate by hands. For example, the user can say the content that needs to check out at any time when riding, and the earphone can accomplish the check out at the in-process of riding, need not that the user stops to take out the cell-phone and check out.

Description

Account checking method and device and earphone

Technical Field

The invention relates to the technical field of electronic equipment, in particular to an account checking method, an account checking device and an earphone.

Background

Along with the development of economy and the Internet, the financial consciousness of people is gradually enhanced, more and more people have billing requirements, and more billing software appears on the market based on the requirements.

Currently, users usually use accounting software on the electronic device to perform accounting or checking, but in some scenarios, there are still some limitations on the operation of the electronic device, which are not favorable for the users to operate the electronic device. For example, in driving a car, riding, running, etc., it is inconvenient for a user to operate a handheld electronic device.

Disclosure of Invention

In view of the above, embodiments of the present invention are proposed in order to provide an audit method, an audit device and a headset that overcome or at least partially address the above mentioned problems.

In order to solve the above problem, an embodiment of the present invention discloses an account checking method, which is applied to an earphone, and the method includes:

acquiring user voice data;

and searching account information according to the user voice data, and outputting according to the account information.

Optionally, the searching for account information according to the user voice data includes:

carrying out voice recognition on the user voice data to obtain a recognition text;

performing sentence detection on the identification text to obtain at least one sentence;

recognizing a user intention corresponding to the at least one statement, and determining the statement corresponding to the checking intention;

and searching account information according to the statement corresponding to the account checking intention.

Optionally, the determining statements corresponding to the audit intention includes:

determining a label corresponding to the at least one statement, and determining the statement corresponding to a preset label as the statement corresponding to the checking intention;

and/or determining the statement with the preset instruction word as the statement corresponding to the checking intention.

Optionally, the method further comprises:

performing at least one round of conversation according to the statement corresponding to the account checking intention, and acquiring user voice data in the at least one round of conversation;

and identifying sentences corresponding to the checking intention from the user voice data of the at least one round of conversation.

Optionally, the performing at least one round of dialog according to the statement corresponding to the audit trail includes:

and if the statement corresponding to the account checking intention does not exist in the statements corresponding to the preset tags, performing at least one round of conversation according to the statement corresponding to the account checking intention.

Optionally, the searching for account information according to the statement corresponding to the checking intention includes:

and searching account information according to the label corresponding to the statement corresponding to the account checking intention.

Optionally, the outputting according to the account information includes:

and outputting feedback information according to the account information.

Optionally, the outputting feedback information according to the account information includes:

and acquiring feedback information according to the account information, and playing the feedback information in a voice mode.

Optionally, the method further comprises:

and outputting reminding information when the preset conditions are met.

Optionally, when a preset condition is met, outputting a reminding message, including:

and when the preset condition is met, acquiring the reminding information, and playing the reminding information in a voice mode.

and outputting reminding information when the preset time condition is met.

and searching account information locally on the earphone according to the user voice data.

Optionally, the headset is in communication with a server; the searching for account information according to the user voice data comprises:

sending the user voice data to the server so that the server searches account information according to the user voice data;

and receiving the account information sent by the server.

Optionally, the headset is in communication with a headset receiving device, the headset receiving device being in communication with a server; the searching for account information according to the user voice data comprises:

sending the user voice data to the earphone accommodating device so that the earphone accommodating device sends the user voice data to the server, and searching account information according to the user voice data through the server; or enabling the earphone accommodating device to perform voice recognition on the user voice data to obtain a voice recognition result, and searching account information through the server according to the voice recognition result;

and receiving the account information sent by the earphone accommodating device.

Optionally, the headset communicates with a headset storage device, and the searching for account information according to the user voice data includes:

sending the user voice data to the earphone accommodating device so that the earphone accommodating device searches account information according to the user voice data;

Optionally, the earphone communicates with a mobile terminal, and the mobile terminal has a preset APP; the method further comprises the following steps:

and sending an account checking instruction to the mobile terminal so that the preset APP displays corresponding account information according to the account checking instruction.

Optionally, the headset has a voice assistant to which the audit method is applied.

Optionally, before the voice assistant acquires the user voice data, the method further includes:

and responding to the touch operation acting on the preset touch area of the earphone, and awakening by the voice assistant.

the voice assistant monitors user voice data;

and when detecting that the voice data of the user contains a preset awakening word, the voice assistant awakens.

The embodiment of the invention also discloses an account checking device which is applied to the earphone, and the account checking device comprises:

the user voice data acquisition module is used for acquiring user voice data;

and the account checking module is used for searching account information according to the user voice data and outputting according to the account information.

Optionally, the audit module includes:

the recognition text obtaining submodule is used for carrying out voice recognition on the user voice data to obtain a recognition text;

the sentence obtaining submodule is used for carrying out sentence detection on the identification text to obtain at least one sentence;

the statement determination submodule is used for identifying the user intention corresponding to the at least one statement and determining the statement corresponding to the account checking intention;

and the account information searching submodule is used for searching the account information according to the statement corresponding to the account checking intention.

Optionally, the sentence determination sub-module includes:

the first statement determining unit is used for determining a label corresponding to the at least one statement and determining the statement corresponding to a preset label as the statement corresponding to the checking intention;

and/or a second sentence determination unit for determining a sentence having a preset instruction word as a sentence corresponding to the checking intention.

Optionally, the method further comprises:

the dialogue module is used for carrying out at least one round of dialogue according to the statement corresponding to the account checking intention and acquiring user voice data in the at least one round of dialogue;

and the sentence recognition module is used for recognizing a sentence corresponding to the account checking intention from the user voice data of the at least one round of conversation.

Optionally, the dialog module includes:

and the dialogue submodule is used for carrying out at least one round of dialogue according to the statement corresponding to the account checking intention if the statement corresponding to the preset tag does not exist in the statement corresponding to the account checking intention.

Optionally, the account information searching sub-module includes:

and the account information searching unit is used for searching the account information according to the label corresponding to the statement corresponding to the account checking intention.

Optionally, the audit module includes:

and the feedback submodule is used for outputting feedback information according to the account information.

Optionally, the feedback sub-module includes:

and the feedback information playing unit is used for acquiring feedback information according to the account information and playing the feedback information in a voice mode.

Optionally, the method further comprises:

and the reminding module is used for outputting reminding information when the preset conditions are met.

Optionally, the reminding module includes:

and the reminding information playing submodule is used for acquiring the reminding information when the preset condition is met and playing the reminding information in a voice mode.

Optionally, the reminding module includes:

and the reminding submodule is used for outputting reminding information when a preset time condition is met.

Optionally, the audit module includes:

and the local searching submodule is used for locally searching account information in the earphone according to the user voice data.

Optionally, the headset is in communication with a server; the account checking module comprises:

the first sending submodule is used for sending the user voice data to the server so that the server searches account information according to the user voice data;

and the first receiving submodule is used for receiving the account information sent by the server.

Optionally, the headset is in communication with a headset receiving device, the headset receiving device being in communication with a server; the account checking module comprises:

the second sending submodule is used for sending the user voice data to the earphone accommodating device so that the earphone accommodating device sends the user voice data to the server, and account information is searched for through the server according to the user voice data; or enabling the earphone accommodating device to perform voice recognition on the user voice data to obtain a voice recognition result, and searching account information through the server according to the voice recognition result;

and the second receiving submodule is used for receiving the account information sent by the earphone accommodating device.

Optionally, the headset is in communication with a headset receiving device, the audit module comprising:

the third sending submodule is used for sending the user voice data to the earphone accommodating device so that the earphone accommodating device searches account information according to the user voice data;

and the third receiving submodule is used for receiving the account information sent by the earphone accommodating device.

Optionally, the earphone communicates with a mobile terminal, and the mobile terminal has a preset APP; the device further comprises:

and the account checking instruction sending module is used for sending an account checking instruction to the mobile terminal so that the preset APP shows corresponding account information according to the account checking instruction.

Optionally, the headset has a voice assistant deployed at the audit device.

Optionally, the method further comprises:

and the first awakening module is used for responding to the touch operation of a preset touch area acting on the earphone and awakening the voice assistant.

Optionally, the method further comprises:

the monitoring module is used for monitoring user voice data;

and the second awakening module is used for awakening the voice assistant when detecting that the voice data of the user contains a preset awakening word.

Also disclosed in an embodiment of the present invention is a headset comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors comprises instructions for:

acquiring user voice data;

Optionally, further comprising instructions for:

Optionally, the outputting according to the account information includes:

and outputting feedback information according to the account information.

Optionally, further comprising instructions for:

and outputting reminding information when the preset conditions are met.

and outputting reminding information when the preset time condition is met.

and receiving the account information sent by the server.

Optionally, the earphone communicates with a mobile terminal, and the mobile terminal has a preset APP; further comprising instructions for: and sending an account checking instruction to the mobile terminal so that the preset APP displays corresponding account information according to the account checking instruction.

Optionally, the one or more programs include a voice assistant.

Optionally, further comprising instructions for:

and responding to touch operation acting on a preset touch area of the earphone, and awakening the voice assistant.

Optionally, further comprising instructions for: user voice data;

and when detecting that the voice data of the user contains a preset awakening word, awakening the voice assistant.

The embodiment of the invention also discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and the computer program realizes the steps of the checking method when being executed by a processor.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, the earphone can acquire the voice data of the user, search the account information according to the voice data of the user and output according to the account information, and the account checking can be finished without operating the earphone by hands of the user. And the searching requirement of the user can be met under the condition that the user is inconvenient to operate by hands. For example, the user can say the content that needs to check out at any time when riding, and the earphone can accomplish the check out at the in-process of riding, need not that the user stops to take out the cell-phone and check out.

Drawings

FIG. 1 is a flowchart illustrating steps of a method for checking accounts according to an embodiment of the present invention;

FIG. 2 is a flow chart of steps in another audit method according to an embodiment of the present invention;

FIG. 3 is a flow chart of steps in another audit method according to an embodiment of the present invention;

FIG. 4 is a flow chart of steps in another audit method according to an embodiment of the present invention;

fig. 5 is a schematic diagram of a headset in an embodiment of the invention;

FIG. 6 is a flow chart of steps in another audit method according to an embodiment of the present invention;

FIG. 7 is a flow chart of steps in another audit method according to an embodiment of the present invention;

FIG. 8 is a flow chart of steps in another audit method according to an embodiment of the present invention;

FIG. 9 is a flow chart of steps in another method of checking accounts according to an embodiment of the present invention;

FIG. 10 is a flow chart of steps in another audit method according to an embodiment of the present invention;

FIG. 11 is a flow chart of steps in another method of checking accounts according to an embodiment of the present invention;

FIG. 12 is a block diagram of an embodiment of an account checking apparatus according to the present invention;

fig. 13 is a block diagram of a headset for billing according to an exemplary embodiment.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

Referring to fig. 1, a flowchart illustrating steps of an account checking method according to an embodiment of the present invention is shown, where the method is applied to a headset, and the method may specifically include the following steps:

step 101, acquiring user voice data.

The earphone is a portable electronic device frequently used in daily life, and can have a playing function, a sound pickup function and a communication function. The user can listen to the song or communicate over the phone using the headset.

And step 102, searching account information according to the user voice data, and outputting according to the account information.

The earphone can determine the account information wanted by the user from the voice data of the user, then searches the account information wanted by the user from the recorded account information, and finally outputs according to the account information. In the embodiment of the invention, the account information can be searched locally on the earphone according to the voice data of the user.

For example, a user wearing a headset speaks: "help me check account, how much money was spent going to supermarket yesterday? After the earphone picks up the user voice data, the user can recognize the account check that the user wants to check the account and how much money is spent in the supermarket yesterday check, and the earphone can search the corresponding account information from the recorded account information and play the account information: "flower 300 yuan".

Referring to fig. 2, a flowchart illustrating steps of another audit method according to an embodiment of the present invention is shown, where the method is applied to a headset, where the headset has a voice assistant, and the method may specifically include the following steps:

at step 201, the voice assistant obtains user voice data.

In the embodiment of the invention, the headset can be provided with a voice assistant, and the voice assistant can be a program which is installed in the headset and runs independently, and can provide various interactive functions, such as an account checking function.

Step 202, the voice assistant searches for account information according to the user voice data, and outputs according to the account information.

In the embodiment of the invention, the voice assistant can trigger the account checking function according to the voice data of the user, search the account information according to the voice data of the user, and output the account information according to the account information.

For example, a user wearing a headset speaks: "help me check account, how much money was spent going to supermarket yesterday? The earphone picks up the voice data of the user, the voice assistant can recognize the account information wanted by the user from the voice data of the user, then the account information wanted by the user is searched from the recorded account information, and finally, the voice assistant plays the account information according to the following steps: "flower 300 yuan".

In the embodiment of the invention, the voice assistant of the earphone can acquire the voice data of the user, search the account information according to the voice data of the user and output the account information, and the account checking can be finished without the user operating the earphone by hand. And the searching requirement of the user can be met under the condition that the user is inconvenient to operate by hands. For example, the user can speak the content to be checked out at any time when riding, and the voice assistant of the headset can complete checking out in the riding process without stopping the user to take out the mobile phone for checking out.

Referring to fig. 3, a flowchart illustrating steps of another account checking method according to an embodiment of the present invention is shown, where the method is applied to a headset, and the method may specifically include the following steps:

step 301, acquiring user voice data.

Step 302, performing voice recognition on the user voice data to obtain a recognition text.

In the embodiment of the present invention, the headset may have a Speech recognition asr (automatic Speech recognition) function. For example, the headset may be provided with a speech recognition chip, or a speech recognition program may be provided in the headset chip.

The voice recognition function of the earphone can be used for carrying out voice recognition on the voice data of the user locally on the earphone to obtain the recognized text.

Step 303, performing sentence detection on the recognition text to obtain at least one sentence.

And performing voice recognition on the user voice data to obtain a recognition text which is a pure text and has no punctuation marks. For example, the user speaks: "how much was a breakfast flower after a look-up? How much a night flower? ". The recognized text obtained by speech recognition of the spoken words of the user is "find out how much night-night breakfast takes".

If the recognition text has more contents, the analysis result obtained by directly performing semantic analysis processing on the recognition text cannot accurately reflect the meaning which the user actually wants to express, and the recognition text needs to be subjected to sentence detection to obtain a sentence, and then semantic analysis is performed according to the sentence.

Sentence detection includes sentence break detection and symbol addition. Sentence break detection is the detection of where in the recognized text a sentence break is needed. For example, a sentence break detection is performed on the recognition text "how much night-night spent breakfast takes" to determine that a sentence break is required after "take" and that a sentence break is required after "how much night-night spent breakfast takes". The symbol adding is to add punctuation marks, such as commas, periods, question marks and the like, at the positions of the punctuation. For example, a comma is added after "check-up", a question mark is added after "how much breakfast is bloomed", and a question mark is added after "how much night is bloomed". Three sentences detected by sentence detection are "find one time", "how much is spent for breakfast? "," how much the night flower? ".

Step 304, identifying a user intention corresponding to the at least one statement, and determining the statement corresponding to the audit trail.

The headset may recognize a user intention corresponding to the statement, and when it is recognized that the user intention includes an audit trail, determine the statement corresponding to the audit trail. In the embodiment of the invention, the earphone supports the instruction, and a plurality of sentences corresponding to the checking intention can be determined.

For example, the user speaks: to help me to check the account, the crayfish with the last five Zhang three spends money and wants to eat one more. The earphone can recognize three sentences, namely 'helping me to check account of the crayfish', 'how much money is spent by eating crayfish in the last friday and the third yearn', and 'one ideal sentence is eaten again' according to the voice data of the user. The earphone can determine that the user has the checking intention according to 'help me check and release account', determine that 'how much money is spent on last friday and three-piece crayfish' corresponds to the checking intention, 'who wants to eat one more' does not correspond to the checking intention.

In the embodiment of the present invention, the earphone may perform semantic analysis on the sentence by using a natural Language understanding (nlu) technology, so as to obtain the user intention. For example, the sentence is semantically analyzed using a semantic analysis model trained in advance.

Corresponding labels can be generated for the sentences by utilizing the natural language understanding technology, and the intentions of the user can be more accurately described according to the labels corresponding to the sentences. For example, "how much money was spent on crayfish eaten in last friday and three," the corresponding label of the sentence may include: meals, expenses, and money amounts.

In an embodiment of the present invention, the step of determining the statement corresponding to the checking intention may include the following sub-steps:

a substep S11, determining a label corresponding to the at least one statement, and determining the statement corresponding to the preset label as the statement corresponding to the checking intention;

the preset tag may be a tag related to the checking intention. For example, the preset tags associated with the audit intent may include: expenses, income, dollars, goods, breakfast, lunch, night falls, and the like.

For example, the user speaks: "how much was a breakfast flower after a look-up? How much the lunch was spent? How much a night flower? ". The sentence recognized by the headset may include: "look after", "how much is breakfast spent? "," how much the lunch flowers? "," how much the night flower? ". Wherein "how much was bloomed for breakfast? "corresponding tags may include breakfast, expenditure; "how much the lunch flowers? "corresponding tags may include lunch, expenditures; how much a night flower? "corresponding tags may include overnight, spending.

Wherein, breakfast, lunch, dinner and expenditure are all preset labels related to the checking intention. Thus "how much was breakfast? "," how much the lunch flowers? "," how much the night flower? "are statements that correspond to an audit trail.

And/or, in sub-step S12, determining the sentence with the preset instruction word as the sentence corresponding to the checking intention.

The preset instruction words can be words which are configured in advance to be related to the accounting intention, and can also be instruction words obtained through training according to a semantic analysis model. For example, "check account", etc.

In this embodiment of the present invention, the audit method may further include:

performing at least one round of conversation according to the statement corresponding to the account checking intention, and acquiring user voice data in the at least one round of conversation; and identifying sentences corresponding to the checking intention from the user voice data of the at least one round of conversation.

The headset may conduct at least one session in accordance with the statement corresponding to the audit trail, in which the headset may issue a query to the user, directing the user to speak more audit information.

In an embodiment of the present invention, the step of performing at least one round of dialog according to the statement corresponding to the audit trail may include: and if the statement corresponding to the account checking intention does not exist in the statements corresponding to the preset tags, performing at least one round of conversation according to the statement corresponding to the account checking intention.

For example, the user speaks: "help me check account.

The headset may determine that the statement "help me check down" corresponds to a checking intent, but that there is not yet a corresponding income or expense tag, the headset may further query: "what content needs to be queried? ".

The user speaks: "cost for the previous week".

The headset may determine that the tag corresponding to "spending last week" includes time, expense. But there is no tag corresponding to the event yet, the headset may further interrogate: "is the total cost of the last week to be queried or a certain cost? ".

The user speaks: to have a meal.

The headset may determine that the tag corresponding to "eat" is a meal, which is a branch of an event. Thus, the earphone obtains the statements corresponding to the labels of time, expense and items, the earphone can stop the conversation, and the obtained statements are checked by adopting the conversation.

Step 305, searching account information according to the statement corresponding to the account checking intention.

The headset may look up account information in terms of statements corresponding to the audit trail.

For example, the user says "how much yesterday night is spent", the headset may look up the yesterday night's account information "night-time cost 200". For another example, the user speaks: to help me check out what amount of lunch in the month's morning, the headset can look for the expenses in this category of lunch in the month's morning.

In an embodiment of the present invention, the step of searching for account information according to the statement corresponding to the checking intention may include: and searching account information according to the label corresponding to the statement corresponding to the account checking intention.

For example, the user speaks: to help me to check the account, the crayfish with the last five Zhang three spends money and wants to eat one more. The sentence recognized by the headset may include: "help me check account", "five days in the upper week have spent money with three crayfish", "want to eat one more". The label corresponding to how much money was spent on eating crayfish in the last friday and zhang san can include time and events. The event may belong to a payment category, and the headset may search the recorded account information for account information corresponding to the time and the event.

In the embodiment of the invention, a plurality of categories can be divided according to matters, and the earphone can inquire account information under a certain category.

For example, categories may include two broad categories: expenditure and income.

The categories of expenses can be subdivided into:

food wine: breakfast, lunch and supper, food materials, fruits, snacks, tobacco, wine and tea.

Clothes ornament: clothes, trousers, shoes, hats, bags and cosmetics.

And (3) traffic: public transportation, taxi taking, private car fee, refueling, car repair, car insurance, highway toll, violation fine, and parking fee.

Household property: daily articles, tenants, water, electricity, gas, property management and maintenance.

Communication: fixed phone fee, mobile phone fee, Internet fee and postal fee.

And (3) leisure and entertainment: sports fitness, putrefactive party, leisure and recreation, travel vacation, pet treasure.

Study and repair: books, newspapers, magazines, training, repairing and digital equipment.

The human situation comes and goes: sending a gift to ask for guests, mourning parents, returning money, charitable donation and red and white happiness.

Medical insurance: medicine fee, health care fee, beauty fee and treatment fee.

And (4) financial insurance: bank procedures, investment loss, mortgage repayment, tax consumption, interest expenditure, compensation fine and fund subscription.

Other miscellaneous items: other expenses, unexpected losses, bad account losses.

The income categories can be subdivided into:

occupational income: payroll income, bonus income, interest income, overtime income, investment income and part-time income.

Other revenues: operation result, winning income, unexpected money, gift income and donation by parents.

The following further lists examples, and describes finding account information in accordance with statements corresponding to the checking intention.

Statement: "how much money this month spent? ", the corresponding label may include: date + total expenditure. The headset may look up account information in reply based on the tag. At different audit times, the headset may reply with different content, for example, if the audit time is on the weekend, the headset may play: "4500 yuan hua". If the check-out time is at the end of the month, the headset may play: "4500 dollars are spent, 1000 dollars are left in excess of this month's control".

Statement: "how much money was spent in the week? ", the corresponding label may include: date + expense category. If the check-out time is not at the weekend, the headset can play: "flower 500 yuan". If the check-out time is on weekends, the headset may play: "spend 500 yuan, cost almost as much as the week.

Statement: "how much money is spent today," the corresponding labels may include: date + location. If the check-out time is on weekends, the headset can play: "flower 300 yuan". If the check-out time is at the end of the month, the headset may play: "spend 300 yuan, spend 800 yuan totally in this month going to supermarket, account for 15% of the total expenditure".

Statement: "how much money was rented? ", the corresponding label may include: and (5) classifying and paying out. If the check-out time is on weekends, the headset can play: "flower 2000 yuan". If the audit time is at the end of the year, the headset may play: "flower 2000 yuan, rent this year flower 24000 yuan, account for 25% of total expenditure".

Statement: "how much to go to KTV flowers? ", the corresponding label may include: site + cost. If the check-out time is not at the weekend, the headset can play: "flower 500 yuan". If the check-out time is at the end of the month, the headset may play: "spend 500 yuan, entertainment expenditure this month 3500 yuan, account for 25% of the total expenditure, account for 35% of the total expenditure".

Statement: "how much total revenue this year? ", the corresponding label may include: date + total income, if the check-out time is at the end of the month, the headset may play: "Total revenue at present 150000 Yuan". If the audit time is at the end of the year, the headset may play: "the total income at present is 150000 yuan, which is 10000 yuan more than the last year".

And step 306, outputting according to the account information.

The earphone can output according to the account information, for example, the account information is played in voice.

In this embodiment of the present invention, the step of outputting according to the account information may include: and outputting feedback information according to the account information.

The headset may interact with the user by outputting feedback information.

In an embodiment of the present invention, the step of outputting feedback information according to the account information may include: and acquiring feedback information according to the account information, and playing the feedback information in a voice mode.

The feedback information may include text, and the headset may generate and play speech corresponding To the text using text-To-speech (tts To speech) technology.

The headset may be fun kan to the user at the feedback information, e.g., the user says: "how much to look up an account, total revenue this year? ". The headset can play: "is the total income 14.7 ten thousand yuan, is the big brother enough to flower? "wherein," 14.7 ten thousand yuan of total income "is the account information played by the earphone," is big money enough to flower? ' is interesting feedback information played by the earphone.

For another example, the user speaks: "the first few items that spend most money in the month when searching dogs and listening? ". The headset can play: the shopping is to cut hands, home property, food, wine and water, the cost is the most, 8000 yuan, 5500 yuan and 2000 yuan are respectively spent, the month is 2400 yuan more than the last month, the upper limit is more than 1300 yuan, and the flowers are spent again, and the mines of the Zan families are all lost. The 'spending like this again, the mines of the families are all lost by you' is the interesting feedback information played by the earphone.

The headset may also inform the user of analytical information by means of feedback information. For example, the user speaks: "how much money was spent on the last week after checking account? ". The headset can play: "cost 2000 for last week, 500 out of arms". Where "last week cost 2000" is the account information played by the headphones and "overburdened 500" is the analytic feedback information played by the headphones.

The analytical information may include:

1. a change in payout; for example, if the cost of the week varies from the cost of the previous week, and if so, how much? Which items caused the change?

Annual expenditure varies, more than last year: how much to pay out? Which project costs more? Less than the last year: how much less is spent? Which items result in less expense?

2. An out-of-stock condition; whether the month is overcast, if not: how much the distance is exceeded? If the branch is exceeded: how much is the override? Which items caused the change?

3. Single item spending proportion; for example, a payout may be proportional to a certain payout in a certain month and a payout may be proportional to a certain year.

4. Average payout; for example, average spending for the month, average spending for approximately three months, average spending for the month of approximately one year.

The headset may also inform the user of constructive information through feedback information. For example, the user speaks: "check account, how much flowers the week. The headset can play: "cost 500 in the upper week, surpassed, suggested economical". Wherein, the 'suggestion economical' is constructive feedback information.

In this embodiment of the present invention, the audit method may further include: and outputting reminding information when the preset conditions are met.

When the user does not make an account check, the earphone can output reminding information to remind the user to check the account. For example, the user may be prompted to look up weekly expenses, monthly expenses, yearly expenses, and so forth.

When the preset condition is met, the step of outputting the reminding information may include: and when the preset condition is met, acquiring the reminding information, and playing the reminding information in a voice mode.

The reminding information can comprise a text, and the earphone can generate and play a voice corresponding to the text by using a TTS technology.

In one example, when the preset condition is met, the step of outputting the reminding information may include: and outputting reminding information when the preset time condition is met.

For example, the preset time condition may be that the current time reaches a preset time. It may be set that saturday per week is a preset audit date and the last day of each month is a preset audit date. When the check-out date is reached, the earphone can remind the user to check out.

For another example, if the earphone detects that the user frequently checks accounts in friday night, the earphone may set friday night as the preset time, and if the earphone detects that the user does not check accounts in friday night, the earphone may output; "host, you forget to check out".

In the embodiment of the invention, the earphone can be communicated with the mobile terminal, and the mobile terminal can be provided with a preset APP; the account checking method can also comprise the following steps:

The mobile terminal can be a mobile phone of a user, and an APP for accounting and checking can be installed on the mobile phone. After the user says that the account is required to be checked out to the earphone, the earphone can search for corresponding account information and can send out an account checking instruction to the mobile phone, and the APP can show the corresponding account information according to the account checking instruction. Visual account information is displayed through the APP, and a user can know the account condition more visually. For example, APP may show expenses, income in the form of a pie chart. Also for example, individual bills may be presented in a list.

In the embodiment of the invention, the earphone can acquire the voice data of the user; carrying out voice recognition on user voice data to obtain a recognition text; performing sentence detection on the identification text to obtain at least one sentence; recognizing a user intention corresponding to at least one statement, and determining the statement corresponding to the checking intention; and searching account information according to the statement corresponding to the account checking intention, and outputting according to the account information. According to the embodiment of the invention, the account checking can be finished without operating the earphone by the hand of the user. And the searching requirement of the user can be met under the condition that the user is inconvenient to operate by hands.

Referring to fig. 4, a flowchart illustrating steps of another audit method according to an embodiment of the present invention is shown, where the method is applied to a headset, where the headset has a voice assistant, and the method specifically includes the following steps:

step 401, the voice assistant obtains user voice data.

In the embodiment of the invention, the voice assistant can obtain the voice data of the user after waking up.

The manner in which the voice assistant wakes up may include: and responding to the touch operation acting on the preset touch area of the earphone, and awakening by the voice assistant. Referring to fig. 5, a schematic diagram of an earphone according to an embodiment of the present invention is shown. The preset touch area can be arranged on one side of the earphone, which is back to the earphone, and a user can wake up a voice assistant of the earphone by double-clicking the preset touch area.

The manner in which the voice assistant wakes up may also include: the voice assistant monitors user voice data; and when detecting that the voice data of the user contains a preset awakening word, the voice assistant awakens.

When the voice assistant monitors that the user speaks the wake-up word, the voice assistant wakes up itself. For example, the user speaks: the voice assistant monitors that the user speaks the awakening word ' listening to the dog ' to awaken the user's own voice.

After the voice assistant is awakened, if the user voice data is not acquired within a preset time period, the voice assistant may re-enter the sleep mode.

Step 402, the voice assistant performs voice recognition on the user voice data to obtain a recognition text.

The voice assistant can perform voice recognition on the voice data of the user locally on the earphone through the voice recognition function of the earphone to obtain a recognized text.

And 403, the voice assistant performs sentence detection on the recognition text to obtain at least one sentence.

In step 404, the voice assistant recognizes the user intention corresponding to the at least one statement and determines the statement corresponding to the audit trail.

The voice assistant can recognize the user intention corresponding to the statement, and when the user intention including the checking intention is recognized, the statement corresponding to the checking intention is determined. In embodiments of the present invention, the voice assistant supports instructions that, in conjunction with the utterance, may determine a plurality of statements corresponding to the audit trail.

For example, the user speaks: to help me to check the account, the crayfish with the last five Zhang three spends money and wants to eat one more. The voice assistant can recognize that three sentences are 'help me to check the account of the crayfish', 'how much money the crayfish spends in the last friday and the third yearn', and 'want to eat one more' according to the voice data of the user. The voice assistant can determine that the user has the checking intention according to ' help me check and release account ', determine that ' how much money is spent on last friday and Zhang Sanzhao ' corresponds to the checking intention ', and ' well want to eat one more ' does not correspond to the checking intention.

In the embodiment of the present invention, the voice assistant may perform semantic analysis on the sentence by using a natural Language understanding (nlu) technology, so as to obtain the user intention. For example, the sentence is semantically analyzed using a semantic analysis model trained in advance.

a substep S21, the voice assistant determining a label corresponding to the at least one sentence, and determining the sentence corresponding to the preset label as the sentence corresponding to the checking intention;

the preset tag may be a tag related to the checking intention. For example, the preset tags associated with the audit intent may include: expenses, incomes, amounts, events, goods, breakfast, lunch, night falls, and the like.

For example, the user speaks: "how much was a breakfast flower after a look-up? How much the lunch was spent? How much a night flower? ". The speech assistant may recognize the resulting sentence as including: "look after", "how much is breakfast spent? "," how much the lunch flowers? "," how much the night flower? ". Wherein "how much was bloomed for breakfast? "corresponding tags may include breakfast, expenditure; "how much the lunch flowers? "corresponding tags may include lunch, expenditures; how much a night flower? "corresponding tags may include overnight, spending.

And/or, in sub-step S22, the voice assistant determines the sentence with the preset instruction word as the sentence corresponding to the checking intention.

the voice assistant carries out at least one round of conversation according to the statement corresponding to the account checking intention and acquires user voice data in the at least one round of conversation; and identifying sentences corresponding to the checking intention from the user voice data of the at least one round of conversation.

The voice assistant may perform at least one round of dialog according to the statement corresponding to the audit trail, and the voice assistant may issue a query to the user in the at least one round of dialog, so as to guide the user to speak more audit trail information.

In an embodiment of the present invention, the step of the voice assistant performing at least one round of dialog according to the statement corresponding to the audit trail may include: and if the statement corresponding to the account checking intention does not exist in the statements corresponding to the preset tags, the voice assistant performs at least one round of conversation according to the statement corresponding to the account checking intention.

For example, the user speaks: "help me check account.

The voice assistant may determine that the statement "help me check out" corresponds to the checking intent, but that there is no corresponding income or expense tag, and the voice assistant may further ask: "what content needs to be queried? ".

The user speaks: "cost for the previous week".

The voice assistant may determine that the tag corresponding to "spending last week" includes time, expense. But there is no tag corresponding to the transaction yet, the voice assistant may further query: "is the total cost of the last week to be queried or a certain cost? ".

The user speaks: to have a meal.

The voice assistant may determine that the tag corresponding to "eat" is a meal, which is a branch of an event. Thus, the voice assistant obtains the statements corresponding to the tags of time, expense and matters, and the voice assistant can stop the conversation and check the obtained statements by adopting the conversation.

Step 405, the voice assistant searches account information according to the statement corresponding to the checking intention.

The voice assistant may look up account information according to the statement corresponding to the checking intent.

For example, the user says "how much yesterday night is spent," the voice assistant can look up the account information "night-time spent 200" yesterday night. For another example, the user speaks: the voice assistant can search the expenses of the category of the lunch in the month.

For example, the user speaks: to help me to check the account, the crayfish with the last five Zhang three spends money and wants to eat one more. The speech assistant may recognize the resulting sentence as including: "help me check account", "five days in the upper week have spent money with three crayfish", "want to eat one more". The label corresponding to how much money was spent on the last friday and zhang san crayfish may include time, events, and expenses. The voice assistant can search the recorded account information for account information corresponding to time, items and expenses.

In the embodiment of the invention, the items can be classified according to the category, and the voice assistant can inquire account information under a certain category.

And step 406, the voice assistant outputs according to the account information.

The voice assistant can output according to the account information, for example, playing the account information by voice.

In this embodiment of the present invention, the step of outputting by the voice assistant according to the account information may include: and the voice assistant outputs feedback information according to the account information.

The voice assistant may interact with the user by outputting feedback information.

In this embodiment of the present invention, the step of the voice assistant outputting feedback information according to the account information may include: and the voice assistant acquires feedback information according to the account information and plays the feedback information in a voice mode.

The feedback information may include text, and the voice assistant may generate and play speech corresponding To the text using text-To-speech (tts To speech) technology.

The voice assistant may take fun canon to the user in feedback information, for example, the user says: "how much to look up an account, total revenue this year? ". The voice assistant may play: "is the total income 14.7 ten thousand yuan, is the big brother enough to flower? "wherein," 14.7 ten thousand yuan of total income "is the account information played by the voice assistant," is big money enough to spend? "is the interesting feedback information played by the voice assistant.

The voice assistant may also inform the user of the analytical information through feedback information. For example, the user outputs: "how much money was spent on the last week after checking account? ". The voice assistant may play: "cost 2000 for last week, 500 out of arms". Where "last week cost 2000" is the account information played by the voice assistant and "overburdened 500" is the constructive feedback information played by the voice assistant.

The analytical information may include:

The voice assistant may also inform the user of constructive information through feedback information. For example, the user speaks: "check account, how much flowers the week. The voice assistant may play: "cost 500 in the upper week, surpassed, suggested economical". Wherein, the 'suggestion economical' is constructive feedback information.

In this embodiment of the present invention, the audit method may further include: and when the preset conditions are met, the voice assistant outputs reminding information.

When the user does not propose the account checking, the voice assistant can output reminding information to remind the user of checking the account. For example, the user may be prompted to look up weekly expenses, monthly expenses, yearly expenses, and so forth.

When the preset condition is met, the step of outputting the reminding information by the voice assistant may include: and when the preset conditions are met, the voice assistant acquires the reminding information and plays the reminding information in a voice mode.

The reminding information can comprise a text, and the voice assistant can generate and play a voice corresponding to the text by using TTS technology.

In one example, when the preset condition is met, the step of outputting the reminding information by the voice assistant can comprise the following steps: and when the preset time condition is met, the voice assistant outputs reminding information.

For example, the preset time condition may be that the current time reaches a preset time. It may be set that saturday per week is a preset audit date and the last day of each month is a preset audit date. When the audit date is reached, the voice assistant may prompt the user for an audit.

For another example, the voice assistant detects that the user frequently checks accounts in friday night, the voice assistant may set friday night as the preset time, and if the voice assistant detects that the user does not check accounts in friday night, the voice assistant may output; "host, you forget to check out".

and the voice assistant sends an account checking instruction to the mobile terminal so that the preset APP displays corresponding account information according to the account checking instruction.

The mobile terminal can be a mobile phone of a user, and an APP for accounting and checking can be installed on the mobile phone. After the user speaks to the earphone that needs to check account, the voice assistant can look for corresponding account information and can send an account checking instruction to the mobile phone, and the APP can show the corresponding account information according to the account checking instruction. Visual account information is displayed through the APP, and a user can know the account condition more visually. For example, APP may show expenses, income in the form of a pie chart.

In the embodiment of the invention, the voice assistant of the earphone can acquire the voice data of the user; carrying out voice recognition on user voice data to obtain a recognition text; performing sentence detection on the identification text to obtain at least one sentence; recognizing a user intention corresponding to at least one statement, and determining the statement corresponding to the checking intention; and searching account information according to the statement corresponding to the account checking intention, and outputting according to the account information. According to the embodiment of the invention, the account checking can be finished without operating the earphone by the hand of the user. And the searching requirement of the user can be met under the condition that the user is inconvenient to operate by hands.

Referring to fig. 6, a flowchart illustrating steps of another audit method according to an embodiment of the present invention is shown, where the method is applied to a headset, and the headset communicates with a server, and the method specifically includes the following steps:

step 601, acquiring user voice data.

Step 602, sending the user voice data to the server, so that the server searches account information according to the user voice data.

The headset may send the user voice data to the server, which may look up account information from the user voice data.

In the embodiment of the invention, the server can perform voice recognition on the user voice data to obtain a recognition text; performing sentence detection on the identification text to obtain at least one sentence; recognizing a user intention corresponding to the at least one statement, and determining the statement corresponding to the checking intention; and searching account information according to the statement corresponding to the account checking intention.

In an embodiment of the present invention, the step of the server determining the statement corresponding to the checking intention may include: determining a label corresponding to the at least one statement, and determining the statement corresponding to a preset label as the statement corresponding to the checking intention; and/or determining the statement with the preset instruction word as the statement corresponding to the checking intention.

In the embodiment of the invention, the server can perform at least one round of conversation according to the statement corresponding to the checking intention, and acquire user voice data in the at least one round of conversation; and identifying sentences corresponding to the checking intention from the user voice data of the at least one round of conversation.

In this embodiment of the present invention, the step of the server performing at least one round of dialog according to the statement corresponding to the audit trail may include: and if the statement corresponding to the account checking intention does not exist in the statements corresponding to the preset tags, the server performs at least one round of conversation according to the statement corresponding to the account checking intention.

In at least one round of conversation, the server can generate conversation information according to the recognized sentences and send the conversation information to the earphones, and the earphones can generate voice according to the conversation information and play the voice.

In this embodiment of the present invention, the step of the server searching for the account information according to the statement corresponding to the checking intention may include: and the server searches account information according to the label corresponding to the statement corresponding to the account checking intention.

Step 603, receiving the account information sent by the server.

After the server finds the account information, the server can return the account information to the earphone.

And step 604, outputting according to the account information.

In the embodiment of the present invention, the server may further generate feedback information according to the account information, and send the feedback information to the headset, and the headset may output the feedback information according to the feedback information.

In the embodiment of the invention, when the preset condition is met, the server can generate the reminding information and send the reminding information to the earphone, and the earphone can output the reminding information.

In the embodiment of the invention, the earphone can acquire the user voice data and send the user voice data to the server; the server can search account information according to the user voice data, the earphone can output according to the account information, and account checking can be completed without the user operating the earphone by hand. And the searching requirement of the user can be met under the condition that the user is inconvenient to operate by hands. For example, the user can say the content that needs to check out at any time when riding, and the earphone can accomplish the check out at the in-process of riding, need not that the user stops to take out the cell-phone and check out.

Referring to fig. 7, a flowchart illustrating steps of another audit method according to an embodiment of the present invention is shown, where the method is applied to a headset, where the headset communicates with a server, and the headset has a voice assistant, where the method specifically includes the following steps:

in step 701, the voice assistant obtains user voice data.

The manner in which the voice assistant wakes up may include: and responding to the touch operation acting on the preset touch area of the earphone, and awakening by the voice assistant. The user can wake up the voice assistant of the headset by double-clicking the preset touch area.

When the voice assistant monitors that the user speaks the wake-up word, the voice assistant wakes up itself. For example, the user speaks: "sniff and listen to the speech", the voice assistant listens to the user speaking the wake up word and then wakes up itself.

Step 702, the voice assistant sends the user voice data to the server, so that the server searches account information according to the user voice data.

The voice assistant may send the user voice data to the server, which may look up account information based on the user voice data.

In at least one round of conversation, the server can generate conversation information according to the recognized sentences, the server can send the conversation information to the headset, and the voice assistant can generate voice according to the conversation information and play the voice.

Step 703, the voice assistant receives the account information sent by the server.

Step 704, the voice assistant outputs according to the account information.

In the embodiment of the present invention, the server may further generate feedback information according to the account information, and send the feedback information to the headset, and the voice assistant may output the feedback information according to the feedback information.

In the embodiment of the invention, when the preset condition is met, the server can generate the reminding information and send the reminding information to the earphone, and the voice assistant can output the reminding information.

In the embodiment of the invention, the voice assistant of the earphone can acquire the voice data of the user and send the voice data of the user to the server; the server can search account information according to the voice data of the user, the voice assistant can output the account information according to the account information, and account checking can be completed without the user operating an earphone by hand. And the searching requirement of the user can be met under the condition that the user is inconvenient to operate by hands. For example, the user can speak the content to be checked out at any time when riding, and the voice assistant of the headset can complete checking out in the riding process without stopping the user to take out the mobile phone for checking out.

Referring to fig. 8, a flow chart illustrating steps of another audit method according to an embodiment of the present invention is shown, wherein the method is applied to a headset, the headset is in communication with a headset receiving device, and the headset receiving device is in communication with a server; the method may specifically comprise the steps of:

step 801, acquiring user voice data.

Step 802, sending the user voice data to the earphone accommodating device, so that the earphone accommodating device sends the user voice data to the server, and searching account information according to the user voice data through the server; or, the earphone storage device performs voice recognition on the user voice data to obtain a voice recognition result, and the server searches account information according to the voice recognition result.

A headset storage device is a device that is used in conjunction with a headset, and is generally used to store and charge a wireless headset. In the embodiment of the invention, the earphone accommodating device has a networking function, so that the earphone accommodating device can communicate with the server.

In one example, the headset may send the user voice data to the headset receiving device, which sends the user voice data to the server so that the server may look up account information from the user voice data. The manner in which the server searches for the account information according to the user voice data may be referred to in the above embodiments, and details are not described here.

In another example, the headset may send the user voice data to the headset receiving device, the headset receiving device may have a voice recognition function, the headset receiving device may perform voice recognition on the user voice data to obtain a voice recognition result, and then send the voice recognition result to the server, and the server may search the account information according to the voice recognition result.

After the server finds the account information, the account information can be sent to the earphone storage device, and then the earphone storage device sends the account information to the earphone.

Step 803, receiving the account information sent by the headset storing device.

And step 804, outputting according to the account information.

In the embodiment of the present invention, the server may further generate feedback information according to the account information, and send the feedback information to the earphone accommodating device, the earphone accommodating device may send the feedback information to the earphone, and the earphone may output the feedback information according to the feedback information.

In the embodiment of the invention, when the preset condition is met, the server can generate the reminding information and send the reminding information to the earphone accommodating device, the earphone accommodating device can send the reminding information to the earphone, and the earphone can output the reminding information according to the reminding information.

In the embodiment of the invention, the earphone can acquire the user voice data and send the user voice data to the earphone accommodating device, and the earphone accommodating device can send the user voice data to the server; the server can search account information according to the user voice data; or, the earphone receiving device can perform voice recognition on the voice data of the user to obtain a voice recognition result, and the server searches account information according to the voice recognition result; the earphone can be output according to account information, and account checking can be completed without the need of operating the earphone by hands of a user. And the searching requirement of the user can be met under the condition that the user is inconvenient to operate by hands. For example, the user can say the content that needs to check out at any time when riding, and the earphone can accomplish the check out at the in-process of riding, need not that the user stops to take out the cell-phone and check out.

Referring to fig. 9, a flow chart of steps of another audit method of an embodiment of the present invention is shown, the method is applied to a headset, the headset is in communication with a headset receiving device, the headset receiving device is in communication with a server, and the headset has a voice assistant; the method may specifically comprise the steps of:

step 901, the voice assistant obtains the user voice data.

Step 902, the voice assistant sends the user voice data to the headset receiving device, so that the headset receiving device sends the user voice data to the server, and the server searches account information according to the user voice data; or, the earphone storage device performs voice recognition on the user voice data to obtain a voice recognition result, and the server searches account information according to the voice recognition result.

In one example, the voice assistant may send the user voice data to the headset receiving device, which sends the user voice data to the server so that the server may look up account information according to the user voice data. The manner in which the server searches for the account information according to the user voice data may be referred to in the above embodiments, and details are not described here.

In another example, the voice assistant may send the user voice data to the headset receiving device, the headset receiving device may have a voice recognition function, the headset receiving device may perform voice recognition on the user voice data to obtain a voice recognition result, and then send the voice recognition result to the server, and the server may search the account information according to the voice recognition result.

Step 903, the voice assistant receives the account information sent by the headset receiving device.

And 904, outputting by the voice assistant according to the account information.

In the embodiment of the present invention, the server may further generate feedback information according to the account information, and send the feedback information to the earphone accommodating device, the earphone accommodating device may send the feedback information to the earphone, and the voice assistant may output the feedback information according to the feedback information.

In the embodiment of the invention, when the preset condition is met, the server can generate the reminding information and send the reminding information to the earphone accommodating device, the earphone accommodating device can send the reminding information to the earphone, and the voice assistant can output the reminding information.

In the embodiment of the invention, the voice assistant of the earphone can acquire the voice data of the user and send the voice data of the user to the earphone accommodating device, and the earphone accommodating device can send the voice data of the user to the server; the server can search account information according to the user voice data; or, the earphone receiving device can perform voice recognition on the voice data of the user to obtain a voice recognition result, and the server searches account information according to the voice recognition result; the voice assistant can output according to the account information, and the user can check the account without operating an earphone by hands. And the searching requirement of the user can be met under the condition that the user is inconvenient to operate by hands. For example, the user can speak the content to be checked out at any time when riding, and the voice assistant of the headset can complete checking out in the riding process without stopping the user to take out the mobile phone for checking out.

Referring to fig. 10, a flowchart illustrating steps of another audit method according to an embodiment of the present invention is shown, where the method is applied to a headset, and the headset is in communication with a headset receiving device, where the method specifically includes the following steps:

step 1001, acquiring user voice data.

Step 1002, sending the user voice data to the headset storage device, so that the headset storage device searches account information according to the user voice data.

The headset may send user voice data to the headset receiving device, which may look up account information from the user voice data.

In the embodiment of the invention, the earphone storage device can perform voice recognition on the user voice data to obtain a recognition text; performing sentence detection on the identification text to obtain at least one sentence; recognizing a user intention corresponding to the at least one statement, and determining the statement corresponding to the checking intention; and searching account information according to the statement corresponding to the account checking intention.

In an embodiment of the present invention, the step of the headset storing device determining the sentence corresponding to the checking intention may include: determining a label corresponding to the at least one statement, and determining the statement corresponding to a preset label as the statement corresponding to the checking intention; and/or determining the statement with the preset instruction word as the statement corresponding to the checking intention.

In the embodiment of the present invention, the earphone storage device may perform at least one round of dialog according to the statement corresponding to the checking intention, and acquire user voice data in the at least one round of dialog; and identifying sentences corresponding to the checking intention from the user voice data of the at least one round of conversation.

In an embodiment of the present invention, the step of the headset receiving device performing at least one round of dialog according to the statement corresponding to the checking intention may include: if the statement corresponding to the account checking intention does not exist in the statements corresponding to the preset tags, the earphone accommodating device carries out at least one round of conversation according to the statement corresponding to the account checking intention.

In at least one round of conversation, the earphone storage device can generate conversation information according to the recognized sentence and send the conversation information to the earphone, and the earphone can generate voice according to the conversation information and play the voice.

In an embodiment of the present invention, the step of finding account information according to the statement corresponding to the account checking intention by the headset storing device may include: and the earphone storage device searches account information according to the label corresponding to the statement corresponding to the account checking intention.

Step 1003, receiving the account information sent by the earphone accommodating device.

The earphone receiving device can return account information to the earphone after the account information is found.

And 1004, outputting according to the account information.

In the embodiment of the present invention, the earphone accommodating apparatus may further generate feedback information according to the account information, and send the feedback information to the earphone, and the earphone may output the feedback information according to the feedback information.

In the embodiment of the invention, when the preset condition is met, the earphone accommodating device can generate the reminding information and send the reminding information to the earphone, and the earphone can output the reminding information.

In the embodiment of the invention, the earphone can acquire the voice data of the user and send the voice data of the user to the earphone accommodating device; the earphone storage device can search account information according to user voice data, the earphone can output according to the account information, and account checking can be completed without the need of operating the earphone by hands of a user. And the searching requirement of the user can be met under the condition that the user is inconvenient to operate by hands. For example, the user can say the content that needs to check out at any time when riding, and the earphone can accomplish the check out at the in-process of riding, need not that the user stops to take out the cell-phone and check out.

Referring to fig. 11, a flowchart illustrating steps of another audit method according to an embodiment of the present invention is shown, where the method is applied to a headset, the headset is in communication with a headset storage device, and the headset has a voice assistant, where the method specifically includes the following steps:

at step 1101, the voice assistant obtains user voice data.

Step 1102, the voice assistant sends the user voice data to the headset storage device, so that the headset storage device searches account information according to the user voice data.

The voice assistant may send the user voice data to the headset receiving device, and the headset receiving device may look up account information according to the user voice data.

In at least one round of conversation, the headset storage device can generate conversation information according to the recognized sentences and send the conversation information to the headset, and the voice assistant can generate voice according to the conversation information and play the voice.

Step 1103, the voice assistant receives the account information sent by the headset receiving device.

And 1104, the voice assistant outputs according to the account information.

In the embodiment of the present invention, the headset storage device may further generate feedback information according to the account information, and send the feedback information to the headset, and the voice assistant may output the feedback information according to the feedback information.

In the embodiment of the invention, when the preset condition is met, the earphone accommodating device can generate the reminding information and send the reminding information to the earphone, and the voice assistant can output the reminding information.

In the embodiment of the invention, the voice assistant of the earphone can acquire the voice data of the user and send the voice data of the user to the earphone accommodating device; the earphone storage device can search account information according to user voice data, the voice assistant can output the account information according to the account information, and account checking can be completed without the need of operating the earphone by hands of a user. And the searching requirement of the user can be met under the condition that the user is inconvenient to operate by hands. For example, the user can speak the content to be checked out at any time when riding, and the voice assistant of the headset can complete checking out in the riding process without stopping the user to take out the mobile phone for checking out.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 12, a block diagram of an embodiment of an account checking device according to the present invention is shown, and is applied to a headset, where the account checking device includes:

a user voice data obtaining module 1201, configured to obtain user voice data;

and the account checking module 1202 is configured to search account information according to the user voice data, and output the account information according to the account information.

In this embodiment of the present invention, the audit module 1202 may include:

In an embodiment of the present invention, the statement determination sub-module may include:

In this embodiment of the present invention, the apparatus may further include:

In an embodiment of the present invention, the dialog module may include:

In this embodiment of the present invention, the account information searching sub-module may include:

In this embodiment of the present invention, the audit module 1202 may include:

In an embodiment of the present invention, the feedback sub-module may include:

In this embodiment of the present invention, the apparatus may further include:

In the embodiment of the present invention, the reminding module may include:

In this embodiment of the present invention, the audit module 1202 may include:

In an embodiment of the invention, the headset communicates with a server; the accounting module 1202 may include:

In an embodiment of the invention, the headset communicates with a headset receiving device, which communicates with a server; the accounting module 1202 may include:

In an embodiment of the present invention, the headset communicates with a headset receiving device, and the audit module 1202 may include:

In the embodiment of the invention, the earphone is communicated with a mobile terminal, and the mobile terminal is provided with a preset APP; the apparatus may further include:

In an embodiment of the invention, the headset has a voice assistant deployed at the audit device.

In this embodiment of the present invention, the apparatus may further include:

the monitoring module is used for monitoring user voice data;

The embodiment of the invention also discloses another account checking device which is applied to an earphone, wherein the earphone is provided with a voice assistant, the voice assistant is arranged on the account checking device, and the account checking device comprises:

the user voice data acquisition module is used for acquiring user voice data;

Fig. 13 is a block diagram illustrating a structure of a headset 1300 for audit trails according to an exemplary embodiment. Referring to fig. 13, the headset 1300 may include one or more of the following components: a processing component 1302, a memory 1304, a power component 1306, a multimedia component 1308, an audio component 1310, an interface for input/output (I/O) 1312, a sensor component 1314, and a communications component 1316.

The processing component 1302 generally controls overall operation of the headset 1300, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 1302 may include one or more processors 1320 to execute instructions to perform all or part of the steps of the method described above. Further, the processing component 1302 can include one or more modules that facilitate interaction between the processing component 1302 and other components. For example, the processing component 1302 may include a multimedia module to facilitate interaction between the multimedia component 1308 and the processing component 1302.

The memory 1304 is configured to store various types of data to support operation at the headset 1300. Examples of such data include instructions for any application or method operating on the headset 1300, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1304 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Power component 1306 provides power to the various components of headset 1300. Power components 1306 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for headset 1300.

The multimedia component 1308 includes a screen between the headset 1300 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1308 includes a front facing camera and/or a rear facing camera. When the headset 1300 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 1310 is configured to output and/or input audio signals. For example, the audio assembly 1310 includes a Microphone (MIC) configured to receive external audio signals when the headset 1300 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 1304 or transmitted via the communication component 1316. In some embodiments, the audio component 1310 also includes a speaker for outputting audio signals.

The I/O interface 1312 provides an interface between the processing component 1302 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

Sensor assembly 1314 includes one or more sensors for providing various aspects of state assessment for headset 1300. For example, sensor assembly 1314 may detect an open/closed state of headset 1300, the relative positioning of the components, such as the display and keypad of headset 1300, sensor assembly 1314 may also detect a change in the position of headset 1300 or one of the components of headset 1300, the presence or absence of user contact with headset 1300, the orientation or acceleration/deceleration of headset 1300, and a change in the temperature of headset 1300. The sensor assembly 1314 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1314 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1314 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 1316 is configured to facilitate wired or wireless communication between the headset 1300 and other devices. The headset 1300 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication section 1314 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 1314 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the headset 1300 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 1304 comprising instructions, executable by the processor 1320 of the headset 1300 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

acquiring user voice data;

Optionally, the method further comprises:

Optionally, the outputting according to the account information includes:

and outputting feedback information according to the account information.

Optionally, the method further comprises:

and outputting reminding information when the preset conditions are met.

and outputting reminding information when the preset time condition is met.

and receiving the account information sent by the server.

Optionally, the one or more programs include a voice assistant.

the voice assistant monitors user voice data;

Also disclosed in an embodiment of the present invention is an earpiece comprising a memory, and a voice assistant, wherein the voice assistant is stored in the memory and configured to be executed by one or more processors, the voice assistant comprising instructions for:

acquiring user voice data;

An embodiment of the present invention further discloses a non-transitory computer-readable storage medium, where instructions in the storage medium, when executed by a processor of a headset, enable the headset to perform a method for checking accounts, where the method may include:

acquiring user voice data;

Optionally, the method further comprises:

Optionally, the outputting according to the account information includes:

and outputting feedback information according to the account information.

Optionally, the method further comprises:

and outputting reminding information when the preset conditions are met.

and outputting reminding information when the preset time condition is met.

and receiving the account information sent by the server.

Optionally, the headset has a voice assistant.

the voice assistant monitors user voice data;

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The invention provides an account checking method, an account checking device and an earphone, which are introduced in detail, and a specific example is applied in the text to explain the principle and the implementation of the invention, and the description of the above embodiment is only used to help understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. An account checking method is applied to earphones, and the method comprises the following steps:

acquiring user voice data;

2. The method of claim 1, wherein said looking up account information from said user voice data comprises:

3. The method of claim 1, wherein determining statements corresponding to audit trails comprises:

4. The method of claim 3, further comprising:

5. The method of claim 3, wherein the performing at least one round of dialogue according to the statement corresponding to the audit trail comprises:

6. The method of claim 3, wherein searching for account information according to the statement corresponding to the checking intention comprises:

7. The method of claim 1, wherein the outputting based on the account information comprises:

and outputting feedback information according to the account information.

8. An account checking device, characterized in that, be applied to the earphone, account checking device includes:

the user voice data acquisition module is used for acquiring user voice data;

9. A headset comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors the one or more programs including instructions for:

acquiring user voice data;

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the audit method according to any one of claims 1 to 7.