CN111312028A - Intelligent bracelet, user communication intelligent auxiliary system and voice and text conversion method - Google Patents

Intelligent bracelet, user communication intelligent auxiliary system and voice and text conversion method Download PDF

Info

Publication number
CN111312028A
CN111312028A CN201811520749.3A CN201811520749A CN111312028A CN 111312028 A CN111312028 A CN 111312028A CN 201811520749 A CN201811520749 A CN 201811520749A CN 111312028 A CN111312028 A CN 111312028A
Authority
CN
China
Prior art keywords
text
voice
bracelet
smart
intelligent
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811520749.3A
Other languages
Chinese (zh)
Inventor
黄绍莽
潘剑锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Qihoo Technology Co Ltd
Original Assignee
Beijing Qihoo Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qihoo Technology Co Ltd filed Critical Beijing Qihoo Technology Co Ltd
Priority to CN201811520749.3A priority Critical patent/CN111312028A/en
Publication of CN111312028A publication Critical patent/CN111312028A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute

Abstract

The invention provides an intelligent bracelet, a user communication intelligent auxiliary system and a voice and text conversion method, wherein the intelligent bracelet comprises a communication unit, a text input device and a text output device, wherein the communication unit is configured to be in communication connection with the text input device; the text receiving unit is configured to receive text input signals from text input equipment in communication connection with the intelligent bracelet according to a preset input method and generate text contents; the voice broadcasting unit is configured to receive the text content generated by the text receiving unit and convert the text content into a voice signal; the display screen is configured to display the text content generated by the text receiving unit; and a speaker configured to receive the voice signal and play it. Based on the technical scheme provided by the invention, barrier-free communication between the deaf-mute and the common person can be realized.

Description

Intelligent bracelet, user communication intelligent auxiliary system and voice and text conversion method
Technical Field
The invention relates to the field of intelligent equipment, in particular to an intelligent bracelet, a user communication intelligent auxiliary system and a voice and text conversion method.
Background
China is the country with the largest population in the world, the number of corresponding deaf-mutes and other people with hearing language disorder is quite large, and the number of the deaf-mutes is about 2265.8 ten thousands of people in 2017. The number of people affected by deaf-mute disability reaches 7380.30 ten thousand, which is calculated by that the average family of deaf-mute has 3.5 people per family (disabled families usually select more children).
Sign language is the most important communication means for deaf-mutes and other people with hearing impairment, but the sound people do not know the sign language, so that the deaf-mutes cannot communicate with the sound people, the communication circle of the deaf-mutes is reduced, the deaf-mutes are more difficult to integrate into the society, and when danger is met, the deaf-mutes cannot call for help, and the life safety of the deaf-mutes is in danger.
Aiming at the problems faced by the deaf-mutes, the prior art provides a data glove for the deaf-mutes, which is mainly characterized in that sensor equipment is arranged on the glove and is used for collecting the hand movements of the deaf-mutes and further converting the hand movements into voice playing. There are two problems with this approach, one is inaccurate and the other can represent very few gestures. The main reason is that the bioelectric current is very weak, the recognition rate of the glove is not enough, the glove can only recognize a plurality of gestures, and the information quantity of language communication is too large, so that the free language communication in the mode can not be realized almost, and therefore, a new scheme is urgently needed to solve the communication problem between the deaf-mute and the normal person.
Disclosure of Invention
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
It should be noted that the technical features of the embodiments and the preferred embodiments of the present invention can be combined with each other without conflict.
According to an aspect of the present invention, there is provided a smart bracelet including:
the communication unit is configured to be in communication connection with a character input device;
the text receiving unit is configured to receive text input signals from text input equipment in communication connection with the intelligent bracelet according to a preset input method and generate text contents;
the voice broadcasting unit is configured to receive the text content generated by the text receiving unit and convert the text content into a voice signal;
the display screen is configured to display the text content generated by the text receiving unit; and
and the loudspeaker is configured to receive the voice signal and play the voice signal.
Optionally, the smart band further comprises:
a voice receiving unit configured to receive voice from an environment;
the voice recognition unit is configured to recognize the received voice according to a preset voice recognition rule and convert the voice to generate text content;
wherein the display is further configured to display the text content generated by the speech recognition unit.
Optionally, the communication unit is further configured to be in communication connection with a remote server;
the speech recognition unit is further configured to download and update the speech recognition rules from a remote server.
Optionally, the communication unit is further configured to be in communication connection with a remote server, send the voice received by the voice receiving unit to the remote server, and receive text generated by the remote server by recognizing the voice according to the voice recognition rule;
the display is further configured to display textual content generated by the remote server.
Optionally, the smart band further comprises a vibration prompting unit configured to vibrate the smart band to prompt the user when the text content generated according to the voice recognition includes a specific emergency vocabulary.
Optionally, the input method is a fast input method adapted to the key setting of the text input device and supporting the input of chinese characters and/or english and/or symbols.
Optionally, the display screen is a curved display screen matched with the shape of the smart bracelet.
Optionally, the smart bracelet further comprises at least one of the following components: the device comprises a heartbeat detection unit, a step counting unit and a timing unit.
According to another aspect of the present invention, there is also provided a user communication intelligent assistance system, including:
the smart bracelet as described in any of the above;
an intelligent glove; as a character input device, the intelligent bracelet is in communication connection with the intelligent bracelet; the smart glove includes:
a glove body;
the character input device is arranged on the glove body and comprises a plurality of keys, and the characters input device is configured to be used for inputting characters through the keys by a user according to an input method preset by the intelligent bracelet and generating character input signals;
and, the smart glove further comprises
And the communication connection module is configured to be in communication connection with the communication unit of the intelligent bracelet and send the character input signal to the intelligent bracelet.
Optionally, the intelligent glove is provided with a magnetic attraction device at a position of the glove body close to the wrist;
the intelligence bracelet be provided with in a side with the magnetism face of inhaling of device adaptation is inhaled to magnetism to make the user wear at homonymy arm the smart gloves with the two adsorbs through magnetic force during the intelligence bracelet and is connected.
Optionally, the communication unit of the smart band and the communication connection module of the smart glove are in communication connection through bluetooth.
Optionally, the plurality of keys of the text input device are micro-touch keys or thin film keys.
Optionally, the text input device is further configured to support combination key input.
According to another aspect of the present invention, there is provided a method for converting between voice and text, which is applied to any one of the above smart bracelets, including:
receiving a character input signal from a character input device in communication connection with the intelligent bracelet according to a preset input method and generating character content;
and displaying the text content and converting the text content into a voice signal for playing.
Optionally, the method further comprises: receiving speech from an environment;
and recognizing the received voice according to a preset voice recognition rule, and converting the voice into text content for displaying.
Optionally, the method further comprises:
downloading and updating the speech recognition rules from a remote server.
Optionally, after receiving the speech from the environment, the method further includes:
and sending the received voice to a remote server, and receiving and displaying the text contents generated by the remote server according to the voice recognition rule.
Optionally, the method further comprises:
and when the text content generated according to the voice recognition comprises a specific emergency vocabulary, vibrating the intelligent bracelet to prompt a user.
Optionally, the input method is a fast input method adapted to the key setting of the text input device and supporting the input of chinese characters and/or english and/or symbols.
Optionally, the method further comprises:
detecting and displaying heartbeat information of a user wearing the smart bracelet at present;
detecting and displaying the step number information of a user wearing the intelligent bracelet at present;
and displaying the current time point.
The invention provides an intelligent bracelet, a user communication intelligent auxiliary system and a voice and text conversion method, wherein the intelligent bracelet receives text input signals from text input equipment in communication connection with the intelligent bracelet according to a preset input method and generates text contents, and then the text contents are displayed and converted into voice signals for playing. Based on the technical scheme provided by the invention, the contents which the deaf-mute wants to express can be converted into voice to be heard by the ordinary person, and the external voice can also be converted into text contents to be displayed to be seen by the deaf-mute, so that barrier-free communication between the deaf-mute and the ordinary person is realized.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
The above and other objects, advantages and features of the present invention will become more apparent to those skilled in the art from the following detailed description of specific embodiments thereof, taken in conjunction with the accompanying drawings.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a functional block diagram of a smart bracelet according to an embodiment of the invention;
FIG. 2 is a functional block diagram of a smart bracelet according to a preferred embodiment of the present invention;
fig. 3 is a functional block diagram of a smart band according to another preferred embodiment of the present invention;
fig. 4 is a functional block diagram of a smart bracelet according to still another preferred embodiment of the present invention;
fig. 5 is a schematic structural diagram of a smart bracelet according to an embodiment of the invention;
FIG. 6 is a block diagram of a user interaction intelligent assistance system according to an embodiment of the present invention;
FIG. 7 is a functional block diagram of a smart glove according to an embodiment of the present invention;
FIG. 8 is a schematic view of a structure of a smart glove according to an embodiment of the present invention;
FIG. 9 is another schematic structural diagram of a smart glove according to an embodiment of the present invention;
FIG. 10 is a functional block diagram of a smart glove according to a preferred embodiment of the present invention;
FIG. 11 is a flowchart illustrating a method for converting a text to speech according to an embodiment of the invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
It should be noted that the technical features of the embodiments and alternative embodiments of the present invention may be combined with each other without conflict.
In order to solve the above problems, embodiments of the present invention provide an intelligent bracelet, which can ensure smooth communication between a deaf-mute and a normal person. The following is a detailed description of specific examples.
As shown in fig. 1, the smart band 200 in the embodiment of the present invention includes:
a communication unit 250 configured to be in communication connection with a text input device;
a text receiving unit 210 configured to receive a text input signal from a text input device communicatively connected to the smart band 200 according to a preset input method and generate text contents;
the voice broadcasting unit 220 is configured to receive the text content generated by the text receiving unit and convert the text content into a voice signal;
a display screen 230 configured to display the text content generated by the text receiving unit 210; and
and a speaker 240 configured to receive and play the voice signal.
The invention provides an intelligent bracelet 200, wherein the intelligent bracelet 200 receives a character input signal from a character input device in communication connection with the intelligent bracelet 200 according to a preset input method and generates character content, and then the character content is displayed and converted into a voice signal for playing. Based on the technical scheme provided by the invention, the contents which the deaf-mute wants to express can be converted into voice to be heard by the ordinary person, and the external voice can also be converted into text contents to be displayed to be seen by the deaf-mute, so that barrier-free communication between the deaf-mute and the ordinary person is realized.
The voice broadcasting function realized by the voice broadcasting unit 220 is specifically to convert characters into voice in an artificial intelligence mode, and the current voice broadcasting based on artificial intelligence is mature and can be realized by adopting the existing technology, and the invention point of the invention is not in this. The function can be realized by adopting SDK which is accessed to a third party, such as 'message flight voice synthesis SDK', 'Baidu voice synthesis SDK', 'Alibaba voice synthesis SDK' and 'Jinshan voice synthesis SDK'. Of course, other speech synthesis techniques can be selected and used, and the invention is not limited in any way to implement the speech broadcast function.
The input method built in the smart band 200 is a fast input method which is matched with the key setting of the character input device and supports the input of Chinese characters and/or English and/or symbols.
The input method can be a new stroke input method of a third party, can also use a cooperative access SDK, can also be developed by self, and supports fewer keys to input Chinese characters and/or English and/or symbols.
As shown in fig. 2, the smart band 200 further includes a voice receiving unit 260 configured to receive external voice from the environment.
The voice recognition unit 270 is configured to recognize the received voice according to a preset voice recognition rule and convert the received voice to generate text, and then display the generated text through the display screen 230.
Specifically, as shown in fig. 5, the power key 280 is provided on the smart band 200, and by pressing the power key 280 for more than three seconds, the smart band 200 can be converted from the power-off state to the standby state, in the standby state, the display 230 of the smart band 200 displays common information such as time, weather status, memo items, etc., and keywords are set inside the smart band 200 for triggering the listening status of the smart band, and the keywords may be the user's name, alias, nickname, honor, etc., or the common keywords for starting topics such as "hello", "feeding", "attention", and the like, may also be the keywords for explicitly waking up the smart band 200 like "Hi, tiger", and the user may also actively trigger the smart band 200 to enter the monitoring state by pressing the power key 280, and the smart band 200 may receive the voice in the external environment when in the monitoring state.
The switching of the plurality of states of the smart band 200 can be realized by pressing the power key 280, and the switching of other states will not be described herein, and this will be described in detail later.
The preset speech recognition rule may be based on the existing technology, and the invention is not limited thereto. In fact, current artificial intelligence based speech recognition techniques are well established and have been successfully used in a very large number of products. We can choose to access a third party's SDK, such as "news-flight voice SDK" or "hundredth voice SDK". Of course, other speech recognition techniques can be used alternatively, and the invention is not limited in any way to implement the speech recognition function.
As shown in fig. 3, the communication unit 250 is further configured to be communicatively connected to a remote server; the speech recognition unit 270 is further configured to download and update the speech recognition rules described above from a remote server.
In this embodiment, to ensure the timeliness of the voice recognition function, the voice recognition unit 270 downloads the latest voice recognition rule from the remote server and then updates the local voice recognition rule, so that the voice recognition unit can recognize the received voice according to the latest voice recognition rule and convert the received voice into text content.
As shown in fig. 4, the communication unit 250 is further configured to be in communication connection with a remote server, transmit the voice received by the voice receiving unit 260 to the remote server, and receive the text generated by the remote server by recognizing the voice according to the voice recognition rule, so that the text generated by the remote server is displayed on the display 230.
In the present embodiment, the voice recognition function is implemented in the remote server, which has an advantage in that recognition accuracy can be made higher than the voice recognition unit 270.
In a preferred embodiment, the smart band 200 further includes a vibration prompting unit configured to vibrate the smart band 200 to prompt the user when the text content generated according to the voice recognition includes a specific emergency vocabulary.
The emergency words may be "pay attention to", "dangerous", "rescue", "with car", etc., and the emergency words may be preset in the bracelet, and when the generated text content includes such words, the vibration prompting unit may vibrate the smart band 200 to prompt the user to pay attention to the danger.
Above-mentioned display screen 230 can be for with the curved surface display screen of intelligence bracelet shape adaptation, the design of convex surface can make display screen 230 possess the function of enlargeing.
This intelligence bracelet 200 still includes heartbeat detecting element, step count statistical unit. The heartbeat information and the step number information of the user wearing the corresponding smart band 200 are detected and then displayed on the display screen 230, so that the user wearing the smart band 200 can obtain more information related to the health of the user. In addition, the smart band 200 may also display the current time point.
This intelligent bracelet 200 still includes charging device, configures to and connects the power and supplies power for intelligent bracelet 200. In particular, the charging device may be a charger or a wireless charging cradle.
Based on the same inventive concept, the present invention further provides an intelligent auxiliary system 300 for user interaction, which is shown in fig. 6-7, and the intelligent auxiliary system 300 for user interaction includes: intelligent bracelet 200 and as text input device's intelligent gloves 100, the two communication connection, wherein, intelligent gloves 100 includes: the glove comprises a glove body 130 and a character input device 110 arranged on the glove body 130, wherein the character input device 110 comprises a plurality of keys 111 arranged on the glove body 130, so that a user can input characters through the plurality of keys 111 according to an input method preset by the smart bracelet and generate character input signals; furthermore, the smart glove 100 further includes a communication connection module 120 disposed on the glove body 130, and configured to be in communication connection with the communication unit of the smart bracelet 200 and transmit the text input signal to the smart bracelet 200 in communication connection with the smart glove 100.
Based on the user communication intelligent auxiliary system 300 provided by the invention, the intelligent glove 100 can convert the contents which the deaf-mute wants to express into voice to be heard by the ordinary person by combining with the intelligent bracelet 200, and can also convert the external voice into text contents to be displayed to be seen by the deaf-mute, thereby realizing barrier-free communication between the deaf-mute and the ordinary person.
As shown in fig. 8, the plurality of keys 111 of the text input device 110 may be disposed on the palm side of the glove body 130 of the smart glove 100. Specifically, some of the keys 111 of the plurality of keys 111 are disposed inside the other fingers of the glove body 130 except for the thumb, so that the user can operate the keys 111 via the thumb. The user can realize the operation only by one hand.
The plurality of keys 111 include a character key, a backspace key, a confirm key and a symbol key, and implement character input through an input method built in the character input device 110.
Since the user is not necessarily in a state where both hands are released all the time. Therefore, it is necessary for the user to input the characters only with one hand, and the keys 111 in this embodiment are disposed on the palm side of the glove body 130, so that the user can input the characters with the thumb, specifically, in this embodiment, the character input device 110 includes fourteen keys 111 in total, wherein some of the keys 111 are symbol keys and function as character input, and the rest of the keys 111 are confirmation keys and backspace keys to assist the user in inputting the characters, and the invention does not specifically limit which keys 111 are symbol keys, confirmation keys and backspace keys. The input method built in the character input device 110 may be a new stroke input method, which is an input method encoding algorithm that can complete character encoding only by using a very small number of keys 111, and is greatly convenient for the user to operate.
Based on the same inventive concept, as shown in fig. 9, a plurality of keys of the text input device may also be disposed on the back side of the glove body 130 of the smart glove 100. Specifically, the plurality of keys 111 are disposed in the back area of the glove body 130 excluding the fingers, so that the user can perform operations on the keys 111 via the other hand without wearing gloves.
In this embodiment, the text input device 110 includes sixteen keys 111, wherein some of the keys 111 are symbol keys and function as text input keys 111, and the other keys 111 are confirmation keys and backspace keys, and the invention does not specifically limit which keys 111 are symbol keys, confirmation keys and backspace keys.
The plurality of keys 111 of the text input device 110 may be micro-touch keys or membrane keys, and the text input device 110 is further configured to support input of combination keys, so that when a user presses the plurality of keys 111 simultaneously, the plurality of keys 111 can all generate text input signals.
As shown in fig. 10, a power supply device 140, which may be a button battery or a rechargeable battery, is further disposed inside the glove body 130, and is mainly used for supplying power to the text input device 110 and the communication connection module 120.
Communication connection module 120 on intelligent glove 100 specifically can be bluetooth connection module, sets up in the inside of gloves body 130, and communication unit 250 of intelligent bracelet 200 also is bluetooth connection unit, and the two realizes communication connection through the bluetooth.
As shown in fig. 8-9, in order to prevent the smart glove 100 from being separated from the smart bracelet 200 and thus leading to a possibility of one of the smart glove 100 and the smart bracelet 200 being lost, the glove body 120 of the smart glove 100 is provided with the magnetic attraction device 150 near the wrist, and correspondingly, a side surface of the smart bracelet 200 is provided with the magnetic attraction surface 290 adapted to the magnetic attraction device, so that when the user wears the smart glove and the smart bracelet 200 on one side of the arm, the smart glove 100 and the smart bracelet 200 are connected through magnetic attraction, thereby avoiding a possibility of one of the smart glove.
In a preferred embodiment, the glove body 130 of the smart glove 100 may further be provided with a status indicator light (not shown), which may include two light colors of red and green, and three light modes of flash, heartbeat, and constant illumination, so that six different statuses of the smart glove 100 may be expressed, specifically, the status of the smart glove 100 in a working status, an idle status, a status to be connected, and the like may be represented, and the status indicator light may enable a user to know the working status of the smart glove 100 more clearly.
The process of establishing connection between the intelligent glove 100 and the intelligent bracelet 200 is as follows: when intelligent glove 100 is in the on state, activate communication connection module 120 (the state of current intelligent glove is shown to the pilot lamp) through pressing the button on gloves body 130, press power key 280 on intelligent bracelet 200 and start intelligent bracelet 200 next time, when intelligent glove 100 is searched for to intelligent bracelet 200, intelligent bracelet 200 provides vibrations feedback this moment, confirm this intelligent glove 100 for the equipment that wants to connect, confirm the equipment of connecting and remembering this connection on intelligent bracelet 200, add this intelligent glove 100 to the input device list of intelligent bracelet 200, the connection is established and is accomplished.
It should be noted that the above listed connection establishing manner of the smart bracelet 200 and the smart glove 100 is a preferred example, in fact, the smart bracelet 200 and the smart glove 100 are both bluetooth smart devices, and the connection establishing manner of the smart bracelet 200 and the smart glove 100 is various, in another example, the smart glove 100 may also be used as a device to be connected, after the smart bracelet 200 is opened, the smart glove 100 searches the smart bracelet 200 to establish connection, and the connection manner of the smart glove 100 and the smart bracelet 200 is not specifically limited in the present invention.
Adding intelligent gloves 100 into the input device list of intelligent bracelet 200, can avoiding intelligent bracelet 200 to open the back at every turn and all will searching for very long time and just can search for intelligent gloves 100, guaranteed the high-speed joint between intelligent gloves 100 and the intelligent bracelet 200.
Based on the above, in the state where the smart band 200 and the smart glove 100 are connected, the communication between the deaf-mute and the normal person mainly includes the following two processes: one is as follows: the deaf-mute presses the key 111 on the intelligent glove 100 to input the sentence which the deaf-mute wants to express, the intelligent glove 100 generates a character input signal according to the input character when receiving the character input of the user and transmits the character input signal to the intelligent bracelet 200 which establishes communication connection with the intelligent glove 100, the intelligent bracelet 200 generates character content according to the character input signal and displays the character content on the display screen 230 after receiving the character input signal, so that the deaf-mute can know the character content input by the deaf-mute exactly, and presses the confirmation key after the input is finished, the intelligent bracelet converts the character content into a voice signal and plays the voice signal, thereby realizing the voice playing of the character content, and enabling ordinary people to receive the sentence which the deaf-mute wants to express.
The second step is as follows: the smart band 200 may receive the voice from the environment and convert the voice into text content to be displayed on the display screen 230, so that the deaf-mute may accurately know the response of the general person according to the content displayed on the display screen 230. The use of the smart glove 100 and the smart bracelet 200 in combination enables barrier-free communication between deaf-dumb users and ordinary persons.
In the two working processes, the functional state transition process of the smart glove 100 is as follows:
1) an idle state: the user does not perform any input action, and is generally used for not interfering with the left hand to do other things when the user wears the smart glove 100 without wanting to input.
2) Inputting a state: the user clicks the button 111 to complete the text input.
In the above two working processes, the function state transfer process of the smart bracelet 200 is:
1) shutdown state: when the power-off state is in the power-off state, the power supply main board supplies power, and if a user presses the power key for more than three seconds, the power-off state can be converted into the standby state.
2) Standby state: in standby mode, the display 230 of the smart band 200 displays common information such as time, weather status, and memo.
3) Monitoring state: the monitoring state of the smart band is triggered by presetting a keyword, the preset keyword can be set when leaving a factory, and the user can also actively trigger the smart band 200 to enter the monitoring state by pressing the power key 280.
In case of no signal for a long time or the user pressing the power key 280, the smart band 200 is converted from the listening state to the standby state.
4) And displaying the state: after recognizing the outside voice, the smart band 200 converts the voice into text and displays the text on a display screen; when a user inputs characters by using the intelligent gloves, the input method interface and the alternative words and phrases are also displayed on the intelligent bracelet 200 in real time.
The smart band 200 can be converted from the display state to the monitoring state by triggering the preset keyword or pressing the power key by the user.
5) Inputting a state: the user may select to enter an input state by pressing the power key 280, or automatically enter the input state after receiving a text signal of the smart glove 100, the input state displaying a completed part of a currently input sentence and an alternative word or phrase in the input process. The sentence that is in the input or completed is displayed on the display screen 230.
6) Pronunciation state: after the user completes the input of his/her sentence on the smart glove 100, the user presses the enter key, and the smart band 200 reads the current sentence and plays the current sentence to the outside through the speaker 240. After pronunciation, intelligent bracelet 200 is the monitoring state by pronunciation state transformation.
7) Other states: setting interfaces, alarm setting and reminding, health management, exercise management, and the like.
Wherein, in-process at the external pronunciation of receipt and with the pronunciation translation words, the working process of intelligent bracelet 200 can be irrelevant with intelligent gloves 100, intelligent bracelet 200 and intelligent gloves 100 can not be connected with, this kind of condition probably exists in the user who wears intelligent bracelet 200 at a certain moment and does not want to participate in voluntarily and exchange, publish the idea, can only open intelligent bracelet 200 this time, make intelligent bracelet 200 be in monitor state through pressing power key 280 can, receive external pronunciation and turn into the characters with pronunciation by intelligent bracelet 200 and read.
The method for switching the state of the smart band 200 by triggering the key or the keyword is only a preferred example of the present invention, and the specific implementation methods are various, and the present invention is not limited to this.
Based on the same inventive concept, the invention also provides a voice-to-text conversion method, as shown in fig. 11, the method comprises:
step S902: receiving a character input signal from a character input device in communication connection with the intelligent bracelet according to a preset input method and generating character content;
step S904: and displaying the text content, converting the text content into a voice signal and playing the voice signal.
Based on the technical scheme provided by the invention, the contents which the deaf-mute wants to express can be converted into voice to be heard by the ordinary person, and the external voice can also be converted into text contents to be displayed to be seen by the deaf-mute, so that barrier-free communication between the deaf-mute and the ordinary person is realized.
In a preferred embodiment, the method further comprises: receiving speech from an environment; and recognizing the received voice according to a preset voice recognition rule, and converting the voice into text content for displaying. So that the deaf-mute can receive the contents expressed by the common people.
In a preferred embodiment, the method further comprises: the speech recognition rules are downloaded and updated from a remote server.
In a preferred embodiment, after receiving the speech from the environment, the method further comprises: and sending the received voice to a remote server, and receiving and displaying the text contents generated by the voice recognition of the remote server according to the voice recognition rule.
In a preferred embodiment, the smart band is shaken to prompt the user when the textual content generated from speech recognition includes a particular emergency vocabulary.
In a preferred embodiment, the input method is a fast input method which is matched with the key arrangement of the character input device and supports Chinese character and/or English and/or symbol input.
In a preferred embodiment, the method further comprises:
detecting and displaying heartbeat information of a user wearing the smart bracelet at present;
detecting and displaying the step number information of a user wearing the intelligent bracelet at present;
and displaying the current time point.
The invention provides an intelligent bracelet, a user communication intelligent auxiliary system and a voice-character conversion method, based on the technical scheme provided by the embodiment of the invention, a deaf-mute inputs a sentence to be expressed into an intelligent glove through keys on the intelligent glove, and then the intelligent bracelet is converted into voice to be played, so that a common person can easily know the content to be expressed by the deaf-mute; the intelligent bracelet can also convert voice sent by common people into text content to be displayed on a display screen of the intelligent bracelet, so that deaf-mutes can clearly know the response of normal people, and the intelligent gloves and the intelligent bracelet are combined for use, thereby realizing barrier-free communication between the deaf-mutes and the common people.
In the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.
Thus, it should be appreciated by those skilled in the art that while a number of exemplary embodiments of the invention have been illustrated and described in detail herein, many other variations or modifications consistent with the principles of the invention may be directly determined or derived from the disclosure of the present invention without departing from the spirit and scope of the invention. Accordingly, the scope of the invention should be understood and interpreted to cover all such other variations or modifications.
According to an aspect of the embodiments of the present invention, there is provided a1. a smart bracelet, including:
the communication unit is configured to be in communication connection with a character input device;
the text receiving unit is configured to receive text input signals from text input equipment in communication connection with the intelligent bracelet according to a preset input method and generate text contents;
the voice broadcasting unit is configured to receive the text content generated by the text receiving unit and convert the text content into a voice signal;
the display screen is configured to display the text content generated by the text receiving unit; and
and the loudspeaker is configured to receive the voice signal and play the voice signal.
A2. The smart bracelet of a1, wherein the smart bracelet further comprises:
a voice receiving unit configured to receive voice from an environment;
the voice recognition unit is configured to recognize the received voice according to a preset voice recognition rule and convert the voice to generate text content;
wherein the display is further configured to display the text content generated by the speech recognition unit.
A3. The smart bracelet of a2, wherein,
the communication unit is further configured to be in communication connection with a remote server;
the speech recognition unit is further configured to download and update the speech recognition rules from a remote server.
A4. The smart bracelet of a2, wherein,
the communication unit is also configured to be in communication connection with a remote server, send the voice received by the voice receiving unit to the remote server, and receive text contents generated by the remote server by recognizing the voice according to the voice recognition rule;
the display is further configured to display textual content generated by the remote server.
A5. The smart bracelet of A2 or A4, wherein,
the intelligent bracelet further comprises a vibration prompting unit which is configured to vibrate the intelligent bracelet to prompt a user when the text content generated according to the voice recognition comprises a specific emergency vocabulary.
A6. The smart bracelet of A1 or A2, wherein,
the input method is a rapid input method which is matched with the key setting of the character input equipment and supports Chinese character and/or English and/or symbol input.
A7. The smart bracelet of A1 or A2, wherein,
the display screen is a curved surface display screen matched with the shape of the intelligent bracelet.
A8. The smart bracelet of a1 or a2, wherein the smart bracelet further comprises at least one of the following components: the device comprises a heartbeat detection unit, a step counting unit and a timing unit.
There is further provided B9. a user interaction intelligent assistance system according to yet another aspect of the embodiments of the present invention, including:
a smart bracelet as claimed in any one of a 1-A8;
an intelligent glove; as a character input device, the intelligent bracelet is in communication connection with the intelligent bracelet; the smart glove includes:
a glove body;
the character input device is arranged on the glove body and comprises a plurality of keys, and the characters input device is configured to be used for inputting characters through the keys by a user according to an input method preset by the intelligent bracelet and generating character input signals;
and, the smart glove further comprises
And the communication connection module is configured to be in communication connection with the communication unit of the intelligent bracelet and send the character input signal to the intelligent bracelet.
B10. The user interaction intelligent assistance system of B9, wherein,
the intelligent glove is characterized in that a magnetic attraction device is arranged on the glove body close to the wrist;
the intelligence bracelet be provided with in a side with the magnetism face of inhaling of device adaptation is inhaled to magnetism to make the user wear at homonymy arm the smart gloves with the two adsorbs through magnetic force during the intelligence bracelet and is connected.
B11. The user interactive intelligent assistance system of B9 or B10, wherein,
the communication unit of intelligence bracelet and the communication connection module of intelligent gloves realize communication connection through the bluetooth.
B12. The user communication intelligent assistance system of B9 or B10, wherein the plurality of keys of the text input device are micro-touch keys or membrane keys.
B13. The user interactive intelligent assistance system of B9 or B10, wherein the text input device is further configured to support combination key input.
According to another aspect of the embodiments of the present invention, there is further provided a method for converting speech into text, applied to any one of the smartband a1-A8, including:
receiving a character input signal from a character input device in communication connection with the intelligent bracelet according to a preset input method and generating character content;
and displaying the text content and converting the text content into a voice signal for playing.
C15. The method of C14, wherein the method further comprises:
receiving speech from an environment;
and recognizing the received voice according to a preset voice recognition rule, and converting the voice into text content for displaying.
C16. The method of C15, wherein the method further comprises:
downloading and updating the speech recognition rules from a remote server.
C17. The method according to C15, wherein after receiving the speech from the environment, further comprising:
and sending the received voice to a remote server, and receiving and displaying the text contents generated by the remote server according to the voice recognition rule.
C18. The method of C15 or C17, wherein the method further comprises:
and when the text content generated according to the voice recognition comprises a specific emergency vocabulary, vibrating the intelligent bracelet to prompt a user.
C19. The method of C14 or C15, wherein,
the input method is a rapid input method which is matched with the key setting of the character input equipment and supports Chinese character and/or English and/or symbol input
C20. The method of C14 or C15, wherein the method further comprises:
detecting and displaying heartbeat information of a user wearing the smart bracelet at present;
detecting and displaying the step number information of a user wearing the intelligent bracelet at present;
and displaying the current time point.

Claims (10)

1. An intelligent bracelet, comprising:
the communication unit is configured to be in communication connection with a character input device;
the text receiving unit is configured to receive text input signals from text input equipment in communication connection with the intelligent bracelet according to a preset input method and generate text contents;
the voice broadcasting unit is configured to receive the text content generated by the text receiving unit and convert the text content into a voice signal;
the display screen is configured to display the text content generated by the text receiving unit; and
and the loudspeaker is configured to receive the voice signal and play the voice signal.
2. The smart bracelet of claim 1, wherein the smart bracelet further comprises:
a voice receiving unit configured to receive voice from an environment;
the voice recognition unit is configured to recognize the received voice according to a preset voice recognition rule and convert the voice to generate text content;
wherein the display is further configured to display the text content generated by the speech recognition unit.
3. The smart bracelet of claim 2, wherein,
the communication unit is further configured to be in communication connection with a remote server;
the speech recognition unit is further configured to download and update the speech recognition rules from a remote server.
4. The smart bracelet of claim 2, wherein,
the communication unit is also configured to be in communication connection with a remote server, send the voice received by the voice receiving unit to the remote server, and receive text contents generated by the remote server by recognizing the voice according to the voice recognition rule;
the display is further configured to display textual content generated by the remote server.
5. Smart bracelet according to claim 2 or 4, wherein,
the intelligent bracelet further comprises a vibration prompting unit which is configured to vibrate the intelligent bracelet to prompt a user when the text content generated according to the voice recognition comprises a specific emergency vocabulary.
6. Smart bracelet according to claim 1 or 2, wherein,
the input method is a rapid input method which is matched with the key setting of the character input equipment and supports Chinese character and/or English and/or symbol input.
7. Smart bracelet according to claim 1 or 2, wherein,
the display screen is a curved surface display screen matched with the shape of the intelligent bracelet.
8. Smart bracelet according to claim 1 or 2, wherein the smart bracelet further comprises at least one of the following components: the device comprises a heartbeat detection unit, a step counting unit and a timing unit.
9. A user interaction intelligent assistance system, comprising:
the smart bracelet of any one of claims 1-8;
an intelligent glove; as a character input device, the intelligent bracelet is in communication connection with the intelligent bracelet; the smart glove includes:
a glove body;
the character input device is arranged on the glove body and comprises a plurality of keys, and the characters input device is configured to be used for inputting characters through the keys by a user according to an input method preset by the intelligent bracelet and generating character input signals;
and, the smart glove further comprises
And the communication connection module is configured to be in communication connection with the communication unit of the intelligent bracelet and send the character input signal to the intelligent bracelet.
10. A speech-text conversion method applied to the smart bracelet of any one of claims 1-8, comprising:
receiving a character input signal from a character input device in communication connection with the intelligent bracelet according to a preset input method and generating character content;
and displaying the text content and converting the text content into a voice signal for playing.
CN201811520749.3A 2018-12-12 2018-12-12 Intelligent bracelet, user communication intelligent auxiliary system and voice and text conversion method Pending CN111312028A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811520749.3A CN111312028A (en) 2018-12-12 2018-12-12 Intelligent bracelet, user communication intelligent auxiliary system and voice and text conversion method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811520749.3A CN111312028A (en) 2018-12-12 2018-12-12 Intelligent bracelet, user communication intelligent auxiliary system and voice and text conversion method

Publications (1)

Publication Number Publication Date
CN111312028A true CN111312028A (en) 2020-06-19

Family

ID=71146585

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811520749.3A Pending CN111312028A (en) 2018-12-12 2018-12-12 Intelligent bracelet, user communication intelligent auxiliary system and voice and text conversion method

Country Status (1)

Country Link
CN (1) CN111312028A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105118356A (en) * 2015-09-28 2015-12-02 王超 Sign language voice conversion method and device
CN206179322U (en) * 2016-07-29 2017-05-17 东莞市飞扬塑胶模具有限公司 Sign language interpreter bracelet
CN106952538A (en) * 2017-04-14 2017-07-14 齐爱民 A kind of electronic gloves suitable for deaf-mute
CN210040016U (en) * 2018-12-12 2020-02-07 北京奇虎科技有限公司 Intelligent glove and user communication intelligent auxiliary system
CN210348929U (en) * 2018-12-12 2020-04-17 北京奇虎科技有限公司 Intelligent glove and user communication intelligent auxiliary system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105118356A (en) * 2015-09-28 2015-12-02 王超 Sign language voice conversion method and device
CN206179322U (en) * 2016-07-29 2017-05-17 东莞市飞扬塑胶模具有限公司 Sign language interpreter bracelet
CN106952538A (en) * 2017-04-14 2017-07-14 齐爱民 A kind of electronic gloves suitable for deaf-mute
CN210040016U (en) * 2018-12-12 2020-02-07 北京奇虎科技有限公司 Intelligent glove and user communication intelligent auxiliary system
CN210348929U (en) * 2018-12-12 2020-04-17 北京奇虎科技有限公司 Intelligent glove and user communication intelligent auxiliary system

Similar Documents

Publication Publication Date Title
US8082152B2 (en) Device for communication for persons with speech and/or hearing handicap
US20220358926A1 (en) Methods and systems for processing, storing, and publishing data collected by an in-ear device
WO2016136062A1 (en) Information processing device, information processing method, and program
CN108763552B (en) Family education machine and learning method based on same
CN108710615A (en) Interpretation method and relevant device
JP2006005945A (en) Method of communicating and disclosing feelings of mobile terminal user and communication system thereof
US20180124225A1 (en) Wireless Earpiece with Walkie-Talkie Functionality
CN110070863A (en) A kind of sound control method and device
US20180122025A1 (en) Wireless earpiece with a legal engine
CN109005480A (en) Information processing method and related product
CN108814572A (en) Wearing state detection method and relevant device
CN111723855A (en) Learning knowledge point display method, terminal equipment and storage medium
CN107452383A (en) A kind of information processing method, server, terminal and information processing system
CN101494816A (en) Hearing-aid device and method suitable for anacusia patient
CN210040016U (en) Intelligent glove and user communication intelligent auxiliary system
CN210348929U (en) Intelligent glove and user communication intelligent auxiliary system
CN105446123B (en) A kind of speech-sound intelligent alarm clock
JP4284989B2 (en) Speech analyzer
CN204242466U (en) Sign language intertranslation device
CN112086094B (en) Method for correcting pronunciation, terminal equipment and computer readable storage medium
CN111312028A (en) Intelligent bracelet, user communication intelligent auxiliary system and voice and text conversion method
CN107592129A (en) A kind of method for early warning and device for wearable device
CN106791010A (en) A kind of method of information processing, device and mobile terminal
CN110248269A (en) A kind of information identifying method, earphone and terminal device
CN109684501A (en) Lyrics information generation method and its device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination