CN112887194B - Interactive method, device, terminal and storage medium for realizing communication of hearing-impaired people - Google Patents
Interactive method, device, terminal and storage medium for realizing communication of hearing-impaired people Download PDFInfo
- Publication number
- CN112887194B CN112887194B CN202110066896.3A CN202110066896A CN112887194B CN 112887194 B CN112887194 B CN 112887194B CN 202110066896 A CN202110066896 A CN 202110066896A CN 112887194 B CN112887194 B CN 112887194B
- Authority
- CN
- China
- Prior art keywords
- interface
- dialing
- call
- wechat applet
- conversation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L51/043—Real-time or near real-time messaging, e.g. instant messaging [IM] using or handling presence information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L51/046—Interoperability with other network applications or services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
Abstract
The invention relates to the field of terminal communication, and discloses an interaction method, a device, a terminal and a storage medium for realizing the conversation of a hearing-impaired person.
Description
Technical Field
The invention relates to the field of terminal communication, in particular to an interaction method and device for a call of a hearing-impaired person, a mobile terminal and a storage medium.
Background
With the popularization of mobile terminals and the development of wireless communication, calls of mobile terminals are more and more frequent, and the requirements on the voice call function of the mobile terminals are higher.
At present, the communication of a mobile terminal is divided into two types of answering and dialing, the existing incoming call interface can realize the functions of answering, hanging up and hanging up to send short messages, the dialing interface selects a corresponding number to dial, and after the dialing or answering is successful, the short messages can be communicated only in a voice mode. The more difficult is the conversation between the hearing-impaired people and the normal people, because the normal people can not understand the sign language generally, when carrying out the telephone voice communication, the normal people can not receive any sound and the hearing-impaired people who transmits the sound can not hear, can not communicate, then can only rely on the characters.
Disclosure of Invention
In view of the above technical problems, the present application provides an interactive method, an interactive device, a terminal and a storage medium for realizing the communication of hearing-impaired people, based on a wechat applet for realizing the bidirectional fast conversion and display of real-time characters and voice, a user can realize the real-time communication function by performing simple interactive operation on the wechat applet, thereby helping hearing-impaired people to perform barrier-free communication.
The invention provides an interactive method for realizing the communication of a hearing-impaired person, which comprises the following steps:
receiving a call request, starting a wechat applet based on the call request and a preset binding relationship between a telephone function and the wechat applet, and switching a current interface of a mobile terminal to a telephone interface of the wechat applet;
acquiring a first touch operation of a user on the telephone interface;
determining a corresponding interface jump instruction according to the first touch operation, calling a conversation page in the WeChat applet based on the interface jump instruction, and displaying the conversation page on the telephone interface, wherein the conversation page at least comprises a display area of conversation information and an information editing area;
acquiring a second touch operation of a user on the information editing area, sending data in the information editing area according to the second touch operation, and displaying the data on the conversation page in a text and voice mode;
and receiving the call information sent by the called terminal, and displaying the call information on the dialogue page in the form of text and voice at the same time.
Optionally, in a first implementation manner of the first aspect of the present invention, if the call request is a dialing request, the starting the wechat applet based on the call request and a preset binding relationship between a telephone function and the wechat applet, and switching a current interface of the mobile terminal to a telephone interface of the wechat applet includes:
calling a dialing interface in the WeChat small program according to the dialing request, wherein the dialing interface at least comprises a state bar, a dialing keyboard and a menu bar;
and acquiring multiple dialing operations of a user on a dialing keyboard of the dialing interface, determining a called number according to the multiple dialing operations, and displaying the called number on the dialing interface.
Optionally, in a second implementation manner of the first aspect of the present invention, after the acquiring the first touch operation of the user on the phone interface, the method further includes:
determining a dialing instruction according to the first touch operation, and identifying the attribution information of the called number;
executing the dialing instruction to perform dialing operation based on the called number to obtain an outbound interface;
and displaying the called number and the attribution information on the outbound interface.
Optionally, in a third implementation manner of the first aspect of the present invention, the executing the dialing instruction based on the called number to perform a dialing operation, and obtaining an outbound interface includes:
detecting whether the conversation service corresponding to the called number is displayed in the status bar and is connected online;
and if so, executing the dialing instruction to perform dialing operation, calling an outbound interface in the WeChat applet and displaying the outbound interface on the telephone interface.
Optionally, in a fourth implementation manner of the first aspect of the present invention, the determining, according to the first touch operation, a corresponding interface jump instruction, calling a dialog page in the wechat applet based on the interface jump instruction, and displaying the dialog page on the phone interface includes:
detecting whether receiving an answering signaling returned by the called number;
if so, adjusting display information in a calling process state bar of the outbound interface;
and determining a jump instruction of the dialogue page according to the first touch operation, calling the dialogue page in the WeChat applet based on the jump instruction, and displaying the dialogue page on the outbound interface.
Optionally, in a fifth implementation manner of the first aspect of the present invention, if the call request is an incoming call request, the starting the wechat applet based on the call request and a preset binding relationship between a telephone function and the wechat applet, and switching the current interface of the mobile terminal to the telephone interface of the wechat applet includes:
switching a current interface of the terminal to a caller identification interface based on the incoming call request, and collecting a first sliding operation of a user on the caller identification interface, wherein the caller identification interface comprises an answering area and a refusing area;
and when the first sliding operation is to drag the rejection area to the answering area, calling a call reminding interface of the WeChat applet for display through a call transfer function according to a binding relationship between a call display interface in a preset telephone function and the WeChat applet, wherein the call reminding interface comprises a called number, an assistant pickup icon, an answering icon and a rejection icon.
Optionally, in a sixth implementation manner of the first aspect of the present invention, the determining, according to the first touch operation, a corresponding interface jump instruction, calling a dialog page in the wechat applet based on the interface jump instruction, and displaying the dialog page on the phone interface includes:
acquiring a second sliding operation of the user on the incoming call reminding interface;
when the second sliding operation is to answer the incoming call and the first touch operation is to substitute the icon by the click assistant, executing a call instruction corresponding to the icon by the click assistant, and switching the incoming call reminding interface to a conversation page in the WeChat applet;
and displaying the conversation page on the incoming call reminding interface and covering the incoming call reminding interface.
The second aspect of the present invention provides an interactive device for realizing a call of a hearing-impaired person, where the interactive device for realizing a call of a hearing-impaired person includes:
the switching module is used for receiving a call request, starting the wechat applet based on the call request and a preset binding relationship between a telephone function and the wechat applet, and switching the current interface of the mobile terminal to the telephone interface of the wechat applet;
the acquisition module is used for acquiring a first touch operation of a user on the telephone interface;
the display module is used for determining a corresponding interface jump instruction according to the first touch operation, calling a dialogue page in the WeChat applet based on the interface jump instruction and displaying the dialogue page on the telephone interface, wherein the dialogue page at least comprises a display area of call information and an information editing area;
the editing module is used for acquiring a second touch operation of the user on the information editing area, sending out data in the information editing area according to the second touch operation and displaying the data on the conversation page in a text and voice mode; and receiving the call information sent by the called terminal, and displaying the call information on the dialogue page in the form of text and voice at the same time.
Optionally, in a first implementation manner of the second aspect of the present invention, the switching module includes:
the first calling unit is used for calling a dialing interface in the WeChat small program according to the dialing request when the call request is the dialing request, wherein the dialing interface at least comprises a state bar, a dialing keyboard and a menu bar;
the first identification unit is used for acquiring multiple dialing operations of a user on a dialing keyboard of the dialing interface, determining a called number according to the multiple dialing operations and displaying the called number on the dialing interface.
Optionally, in a second implementation manner of the second aspect of the present invention, the interaction apparatus for implementing a call of a hearing-impaired person further includes a dialing module, which is specifically configured to:
determining a dialing instruction according to the first touch operation, and identifying the attribution information of the called number;
executing the dialing instruction to carry out dialing operation based on the called number to obtain an outbound interface;
and displaying the called number and the attribution information on the outbound interface.
Optionally, in a third implementation manner of the second aspect of the present invention, the dialing module is specifically configured to:
detecting whether the conversation service corresponding to the called number is displayed in the status bar and is connected online;
and if so, executing the dialing instruction to perform dialing operation, calling an outbound interface in the WeChat applet and displaying the outbound interface on the telephone interface.
Optionally, in a fourth implementation manner of the second aspect of the present invention, the display module includes:
the detection unit is used for detecting whether receiving an answering signaling returned by the called number;
the adjusting unit is used for adjusting the display information in the calling process state bar of the outbound interface when receiving the answering signaling;
and the first display unit is used for determining a jump instruction of the dialogue page according to the first touch operation, calling the dialogue page in the WeChat applet based on the jump instruction and displaying the dialogue page on the outbound interface.
Optionally, in a fifth implementation manner of the second aspect of the present invention, the switching module further includes:
the second identification unit is used for switching a current interface of the terminal to a caller identification interface based on the caller identification request when the call request is the caller identification request, and acquiring a first sliding operation of a user on the caller identification interface, wherein the caller identification interface comprises an answering area and a refusing area;
and the second calling unit is used for calling the call reminding interface of the WeChat applet for display through a call transfer function according to the binding relationship between the preset call display interface in the telephone function and the WeChat applet when the first sliding operation is used for dragging the rejection area to the answering area, wherein the call reminding interface comprises a called number, an assistant pickup icon, an answering icon and a rejection icon.
Optionally, in a sixth implementation manner of the second aspect of the present invention, the display module further includes:
the obtaining unit is used for obtaining a second sliding operation of the user on the incoming call reminding interface;
a determining unit, configured to determine, when the second sliding operation is to answer an incoming call and the first touch operation is to substitute for an icon by the click assistant, a jump instruction of the dialog page according to the first touch operation;
the execution unit is used for executing a call instruction and a skip instruction corresponding to the assistant pickup icon and switching the incoming call reminding interface to a conversation page in the WeChat small program;
and the second display unit is used for displaying the conversation page on the call reminding interface and covering the call reminding interface.
A third aspect of the present invention provides a terminal, including: a memory having instructions stored therein and at least one processor, the memory and the at least one processor interconnected by a line;
the at least one processor calls the instructions in the memory to enable the terminal to execute the steps of the interactive method for realizing the conversation of the hearing-impaired people.
A fourth aspect of the present invention provides a computer-readable storage medium having stored therein instructions, which, when run on a computer, cause the computer to perform the above-mentioned steps of the interactive method for realizing a call by a hearing impaired person.
In the technical scheme provided by the invention, the telephone interface in the WeChat applet is started through the call request, the touch operation of the user on the telephone interface is collected, the current call request is transferred to the conversation page in the WeChat applet according to the touch operation, the user can directly carry out conversation on the conversation page, and the information displayed on the conversation page is displayed in a text form and a voice form, so that the requirements of different users can be ensured.
Drawings
Fig. 1 is a flowchart of an interaction method for implementing a call of a hearing-impaired person according to a first embodiment of the present invention;
fig. 2 is a flowchart of an interaction method for implementing a call of a hearing-impaired person according to a second embodiment of the present invention;
FIG. 3 is a schematic diagram of a dialing interface in accordance with the present invention;
FIG. 4 is a schematic illustration of the outbound interface of the present invention;
FIG. 5 is a schematic view of a conversation page of the present invention;
fig. 6 is a flowchart of an interaction method for implementing a call of a hearing-impaired person according to a third embodiment of the present invention;
FIG. 7 is a schematic diagram of an incoming call reminder interface in accordance with the present invention;
fig. 8 is a schematic structural diagram of an interactive apparatus for implementing a call of a hearing-impaired person according to an embodiment of the present invention;
fig. 9 is another schematic structural diagram of an interactive apparatus for implementing a call of a hearing-impaired person according to an embodiment of the present invention;
fig. 10 is a schematic diagram of an embodiment of a terminal in the embodiment of the present invention.
Detailed Description
The embodiment of the invention provides an interaction method, a device, a terminal and a storage medium for realizing the conversation of a hearing-impaired person, wherein a WeChat applet is utilized to bind a telephone function to provide a telephone communication platform for the hearing-impaired person, the terminal starts a telephone interface of the WeChat applet after receiving a conversation request, acquires the operation of the hearing-impaired person on the telephone interface to adjust different telephone interfaces, and finally jumps to a conversation page in the WeChat applet, the hearing-impaired person carries out the communication operation of the telephone based on the conversation page, and the interactive information utilizes an RTMP transmission protocol process, an audio-video coding and decoding protocol conversion, an account authentication and conversation safety through a background server of the conversation page, so that the purpose of making and receiving calls through the applet is finally realized; interactive data and call signaling are transmitted through an RTMP protocol and a websocket protocol in a program, and voice conversion and coding are performed by adopting a real-time message gateway, so that the efficiency of audio conversion and coding is greatly improved, the time delay of receiving information by a terminal is greatly shortened, the experience of calling a user is improved, and the problem of barrier-free remote communication of hearing-impaired people is solved.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," or "having," and any variations thereof, are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
For convenience of understanding, a specific flow of the embodiment of the present invention is described below, and referring to fig. 1, it is understood that an execution subject of the present invention may be a mobile terminal, where a wechat applet is installed on the mobile terminal, the wechat applet is used to implement telephone communication by binding a telephone function of the mobile terminal, when a call needs to be made, the wechat applet calls an interface of the wechat applet to perform communication, the wechat applet transmits interactive data and a call signaling through an RTMP protocol and a websocket protocol, and a real-time message gateway is used to perform voice conversion and encoding, and displays converted information on a conversation page of the wechat applet to be checked by a user. The method specifically comprises the following steps:
101. receiving a call request, starting a wechat applet based on the call request and a preset binding relationship between a telephone function and the wechat applet, and switching a current interface of the mobile terminal to a telephone interface of the wechat applet;
in this embodiment, the call request includes two types of requests, i.e., an incoming call and an outgoing call, where the incoming call request is a communication request sent by the mobile terminal through a normal manner, and the outgoing call request is a dialing request generated by a dialing interface of a WeChat applet in the mobile terminal accessed by the user. The mobile terminal is a mobile phone or handheld equipment such as an IPAD (internet protocol ad), the handheld equipment is provided with a WeChat applet, and based on the WeChat applet, the interactive method capable of realizing the conversation of the hearing-impaired people is developed.
In this embodiment, after the user installs the wechat applet, the user needs to register a phone number on the wechat applet in a binding registration manner, so as to bind the phone function on the mobile terminal and the wechat applet, and when the user leaves a call, the wechat applet is directly opened through touch operation, and then a dial keyboard on the wechat applet is called out to dial the call.
In the process of registration, the method also comprises the steps of setting call forwarding, namely binding the call forwarding with a telephone function on the mobile terminal, when the mobile terminal receives an incoming call, the mobile terminal can detect whether the WeChat applet operates on line or not, if the WeChat applet operates on line, the WeChat applet is directly skipped to display an incoming call reminding interface, and if the WeChat applet does not operate on line, the WeChat applet is started after being hung up, and the incoming call reminding interface is automatically detected to be displayed by call forwarding.
In practical application, the telephone interface comprises a dialing interface and an incoming call reminding interface, specifically, which interface is switched to is selected to be switched according to the type of the call request, if the call is going, touch operation of a user on the mobile terminal is collected, the dialing interface of the WeChat applet is started, and if the call is coming, the WeChat applet is directly called out according to the binding relation to display the incoming call reminding interface.
102. Acquiring a first touch operation of a user on a telephone interface;
in this embodiment, the first touch operation is a touch operation for jumping the phone interface to a dialog page of the wechat applet, and when the phone interface is a dialing interface, the first touch operation is a dialing operation, that is, a dialing key on the dialing interface is clicked, and then an interface change is firstly jumped from the dialing interface to an outbound interface, and then after the phone is connected, the interface change is jumped from the outbound interface to the dialog page.
When the telephone interface is an incoming call interface, the first touch operation is to click an answering key, and then the interface jumps to a conversation page from the incoming call interface.
In practical application, after a first touch operation is acquired, a websocket submits a Connect request to an RTMPSMP gateway (real-time message gateway) by using a websocket protocol, the RTMPSMP gateway applies for a channel SESSION to a soft switch in a way of RTMP protocol (real-time message transmission protocol) after receiving a message, the RTMPSMP gateway returns the SESSION to the westsET after acquiring the SESSION from the soft switch, the westSMP gateway sends a login request to the RTMPSMP gateway by using an extension number, a password and the SESSION as parameters after acquiring the SESSION, the soft switch forwards the login request of a terminal where the westSMP is located to the soft switch by using the RTMP protocol, the soft switch completes the login after completing the password verification of the SESSION and the number of the extension, and completes the binding of the SESSION and a branch number on the soft switch, thereby realizing the establishment of a communication link, and calling a page of the westSMS for displaying based on the established communication link.
103. Determining a corresponding interface jump instruction according to the first touch operation, calling a dialogue page in the WeChat applet based on the interface jump instruction, and displaying the dialogue page on a telephone interface;
in this step, the dialog page at least includes a display area and an information editing area of the call information;
in this embodiment, the determining of the interface jump instruction specifically includes detecting whether the telephone interface is a dialing interface, if so, determining that the interface jump instruction is an outbound interface jump instruction, executing the outbound interface jump instruction to dial a telephone number on the current dialing interface of the mobile terminal, and jumping to the outbound interface to display a dialing state.
If the interface is not the dialing interface, determining that the interface is the incoming call reminding interface, determining that the interface jump instruction is a dialogue page jump instruction, and executing the dialogue page jump instruction after detecting the first touch operation to switch the current page of the mobile terminal to the dialogue page.
104. Acquiring a second touch operation of the user on the information editing area, sending out data in the information editing area according to the second touch operation, and displaying the data on the conversation page in a text and voice mode;
in the step, after the mobile terminal displays the conversation page, it is determined that the mobile terminal is based on the wechat applet and the speech-to-text conversion server in the wechat program background through the conversation window of the quick call established by the operator, and the user inputs the data to be sent on the conversation page, so that the conversation communication in the telephone form can be realized.
In this embodiment, the dialog page includes a display area and an information editing area, where the information editing area specifically includes an input area and a template area, and for the input area, a user inputs characters by calling a keyboard, or inputs the characters by voice, and after detecting that information is input in the input area, the wechat applet sends the information to a real-time message gateway of a voice-to-text conversion server through a real-time communication protocol for analysis processing, and sends the analyzed interaction information to a soft switch of the voice-to-text conversion server for conversion processing of a transmission protocol, and then sends the interaction information to the called terminal through the operator, and the interaction information is displayed in the display area of the dialog page, and is also displayed in a voice mode and a text mode.
105. And receiving the call information sent by the called terminal, and simultaneously displaying the call information on the conversation page in the forms of text and voice.
In the step, when receiving the call information sent by the called terminal, an operator sends the call information to a real-time message gateway through a soft switch and a real-time message transmission protocol, the real-time message gateway identifies the voice through a preset voice identification model to obtain a text, the text is encapsulated into the call signaling in a signaling band mode to obtain a control signaling, a websocket protocol is called to send the control signaling to a program, the text in the control signaling is displayed through the program, the real-time message transmission protocol is called to send the voice to a micro-signaling small program, and the voice and the text are played through a conversation page of the micro-signaling small program.
In the embodiment of the invention, live-layer and live-push components, websocket communication capacity and http-based API service capacity provided by a WeChat applet for network live broadcast services are utilized, RTMP transmission protocol processing, audio/video coding/decoding protocol conversion, account authentication and conversation safety are realized at a cloud end, finally call receiving and calling through the applet are realized, a telephone interface in the applet is started through a conversation request based on the applet, touch operation of a user on the telephone interface is collected, the current conversation request is transferred to a conversation page in the applet according to the touch operation, the user can directly carry out conversation on the conversation page, and information displayed on the conversation page is displayed in two forms of characters and voice, so that the requirements of different users can be ensured, and compared with the telephone function in the prior art, the problem that a person listening to the Internet is in barrier-free remote communication is solved.
Referring to fig. 2, a second embodiment of an interaction method for realizing a call of a hearing impaired person according to the embodiment of the present invention is to take a call request as a dialing request to describe in detail the interaction method for a call of a hearing impaired person according to the present invention, and the method is based on an interaction method provided by a mobile terminal installed with a wechat applet, where the wechat applet includes four basic GUI components of "dialing", "call record", "address book", and "my". By combining the four GUI components, the hearing impaired person can complete all the conversation functions in the invention. The method specifically comprises the following steps:
201. acquiring a dialing request triggered by a user on an interface of a mobile terminal;
202. calling a dialing interface in the WeChat applet according to the dialing request;
in this step, the dialing interface at least includes a state bar, a dialing keypad and a menu bar, as shown in fig. 3, the state bar is located above the dialing keypad for prompting a user of a current service state and a network state, the dialing keypad is used for providing a number input for the user, and the menu bar is located below the dialing keypad, that is, the menu bar is used for selecting four basic GUI components of "dial", "call record", "address book" and "my"; furthermore, an address book adding button is arranged between the dialing keyboard and the status bar, so that a user can store dialed numbers into the address book conveniently, the function of adding the numbers into the address book is arranged in the dialing keyboard, and the user can store the input numbers quickly.
203. Collecting multiple dialing operations of a user on a dialing keyboard of a dialing interface, determining a called number according to the multiple dialing operations, and displaying the called number on the dialing interface;
in this embodiment, the user selects a number on the keypad according to the phone number to be input, and displays the number on the keypad, and the wechat applet authenticates the input called number to the operator through the RTMP transmission protocol via the real-time message gateway and the software switch to determine whether the corresponding service is available, and if "the call service is connected, the user can make a call" on the status bar.
204. Acquiring a first touch operation of a user on a dialing interface;
in the step, after a called number is input, whether a pressing operation of a user exists in a dialing key area in a dialing interface is detected, if yes, the pressing force is read, and whether the pressing operation is selected as a first touch operation is determined based on the pressing force.
205. Determining a dialing instruction according to the first touch operation, and identifying the attribution information of the called number;
in the step, matching is carried out on the position information of the first touch operation and the position information of the dialing instruction according to the position information of the first touch operation, if the difference of the position information is within a preset range, the dialing instruction is determined, then the called number is used as a sending parameter, user information is inquired from a database of an operator through an RTMP transmission protocol through a real-time message gateway and a software switch, and the user information is analyzed to obtain corresponding attribution information.
206. Executing a dialing instruction based on the called number to perform dialing operation to obtain an outbound interface;
in this step, the outbound interface is obtained specifically by the following means:
detecting whether the conversation service corresponding to the called number is displayed in the status bar and is connected online;
and if so, executing the dialing instruction to carry out dialing operation, calling an outbound interface in the WeChat applet and displaying the outbound interface on the telephone interface.
207. Displaying the called number and the attribution information on an outbound interface;
in the step, displaying the called number and the attribution information on an outbound interface specifically comprises:
detecting whether the called number is a fixed number, if so, identifying the area code, converting the area code into a corresponding city name for displaying, and simultaneously acquiring the positioning information and the attribution information of the number for displaying, as shown in fig. 4.
Furthermore, besides the called number and the information of the home location, a calling process status bar is displayed on the outbound interface, and since the hearing-impaired person cannot know the outbound process through the prompt tone of the operator like a hearing-impaired person, the user can be clear of the whole calling process through the calling process status bar by using the text status information, for example, "successfully called" is displayed in the middle of the outbound interface and the user is waiting for the other party to answer ". Meanwhile, the call-out interface is also provided with a hang-up function, which is a key to restrain the call-out for the convenience of hearing-impaired people needing to actively finish the call-out, and after the call-out is finished, the interface directly quits from the WeChat small program to display the main interface of the mobile terminal.
Further, in the state of an outbound interface, a background of the WeChat applet detects whether an answering signaling returned by the called number is received in real time;
if so, adjusting display information in a calling process state bar of the outbound interface;
and determining a jump instruction of the dialogue page according to the first touch operation, calling the dialogue page in the WeChat applet based on the jump instruction, and displaying the dialogue page on the outbound interface.
When the answer signaling is detected to return, the answer is prompted through a 'answer vibration' informing mode, namely, for a hearing-impaired person to know that the call is answered when the call is perceived to be answered, the outbound interface is bound with a mobile phone vibration function, and when the call is answered, the user is prompted through vibration.
208. Determining a corresponding interface jump instruction according to the first touch operation, calling a dialogue page in the WeChat applet based on the interface jump instruction, and displaying the dialogue page on an outbound interface;
209. acquiring a second touch operation of the user on the information editing area, sending out data in the information editing area according to the second touch operation, and displaying the data on the conversation page in a text and voice mode;
210. and receiving the call information sent by the called terminal, and displaying the call information on the dialogue page in the form of text and voice at the same time.
In practical application, the WeChat applet is also provided with a conversation page, the conversation page is in jump association with an outbound interface, and after an answering signaling is detected, the WeChat applet automatically jumps to the conversation page so as to facilitate a hearing-impaired person to quickly enter conversation chat. For example, as shown in fig. 5, when jumping to the dialog page, the first sentence is automatically sent to inform the opposite party of the identity.
In this embodiment, the dialog page specifically includes the following functional regions:
1) The invention discloses a 'call number/information', which is used for a hearing-impaired person to know the number of the user who calls the user and know who the user has called the user.
2) The invention provides a 'communication tool bar' which provides communication time, a hang-up button, a sound switch and a microphone switch, and aims to provide convenience for hearing-impaired people to know own communication process information, control functions used in communication and hang up a telephone.
3) The invention provides a function of directly transmitting the sound of the words of the other party to the user, which is convenient for hearing impaired people to practice hearing.
4) The invention provides a microphone unvarnished transmission function, which is used for unvarnished transmission of user voice collected by a mobile phone to the opposite side for direct listening, so that a spoken language family in a hearing-impaired person can communicate with the opposite side directly through voice.
5) The invention converts the conversation process into the chat process because the hearing-impaired people can not communicate by voice like the healthy-listening people, clearly displays the conversation information of the two parties in the modes of head portrait, conversation strips distributed left and right, different colors and the like, is convenient for users to read and master the conversation process.
6) The invention provides character input function, calls system input method keyboard, user can input content conveniently, after clicking and sending, the invention converts the content into sound to be played to the other side to listen.
7) The invention relates to a 'dialogue vibration' which is used for enabling hearing-impaired people to know that the conversation senses that the conversation of the other party is finished.
8) The invention provides a state prompt at the side of a character bar input by a user, prompts the opposite side to listen through sound wave animation, stops switching the animation into a round point and prompts the opposite side to listen to the content input by the user.
9) The invention relates to a transmission queue control, which aims to avoid misoperation of hearing-impaired people and continuously transmit a plurality of contents to an opposite side so that the opposite side cannot hear each sentence of a user.
10 "real-time dialogue redisplay", in order to speed up the communication between the hearing impaired and the other party and improve the accuracy of the communication, the invention converts the voice of the other party into characters in real time, automatically updates and corrects the recognition result, and updates the character to the user for reading in an automatic character redisplay mode.
11 'quick reply bar'), in order to accelerate the communication between the hearing impaired person and the other party, the invention provides the quick reply bar, which shows a series of contents input by the user at high frequency, and the user can send the contents to the other party only by a little.
12 Fast reply' to accelerate the communication between the hearing impaired and the other party, the invention provides a fast reply function, and displays the fast reply contents edited by the user in advance in a classification and list manner, thereby facilitating the selection of the user and fast transmitting the contents to the other party.
13 DTMF keypad) for the convenience of hearing impaired people to dial some IVR hotline, business, service, customer service telephone, and needs to interact with the system through the number keys, such as: the invention provides DTMF keyboard function, converting the number, star number and # number input by user into DTMF signal required by telecommunication system to make interactive control with IVR system.
14 The invention) is hung up and prompted, in order to avoid the misoperation when the hearing-impaired person controls to hang up the telephone or the feedback is received when the opposite side hangs up the telephone, the invention provides the function of hanging up and prompting, reduces the misoperation of the user and knows whether the opposite side hangs up the telephone.
In the embodiment of the invention, interface display in the WeChat applet is called according to touch operation of a user on the mobile terminal, and input operation of conversation is carried out on the interface, the RTMP protocol and the websocket protocol in the WeChat applet transmit interactive data and a conversation signaling, and a real-time message gateway is adopted for voice conversion and coding, so that the compatibility of telephone voice and an operator is realized, the problem that the dialing or answering of the telephone for voice communication is not realized through the WeChat applet in the current market is solved, and the telephone realization of a hearing-impaired person is also realized.
Furthermore, the telephone function is realized through the operation on the WeChat applet, the interactive call information can be quickly converted through the real-time message gateway and the soft switch, and the method for answering and making a call for hearing-impaired people with better experience is realized.
In this embodiment, as shown in fig. 6, a third embodiment of an interaction method for realizing a call of a hearing-impaired person in the embodiment of the present invention is shown, and the embodiment takes a call request as an incoming call request as an example to describe in detail the interaction method for realizing a call of a hearing-impaired person in the present application, and its implementation steps are as follows:
301. receiving an incoming call request forwarded by an operator;
302. switching a current interface of the terminal to a caller identification interface based on the caller identification request, and collecting a first sliding operation of a user on the caller identification interface;
the caller identification interface comprises an answering area and a rejecting area; after the first sliding operation is collected, it is determined whether the sliding track of the first sliding operation is a hanging-up sliding track, that is, the sliding track slides from the reject area to the answer area, if yes, step 303 is executed. If not, executing normal telephone answering operation.
303. If the first sliding operation is to drag the refusing area to the answering area, calling the incoming call reminding interface of the WeChat applet for display through the call transfer function according to the preset binding relationship between the incoming call display interface in the telephone function and the WeChat applet;
the incoming call reminding interface comprises a called number, an assistant pick-up icon, an answering icon and a refusing icon, and is shown in fig. 7; after the refusing operation is determined, the WeChat small program can generate a call transfer request according to the refusing operation and send the call transfer request to an operator, the operator returns a call request to the WeChat small program from a real-time message gateway through a soft switch based on the call transfer request, after the refusing operation is determined, the mobile terminal calls an interface of the WeChat small program to be displayed on the mobile terminal through the binding relationship between a call display interface and the WeChat small program, and calls an incoming call reminding interface to be displayed after the WeChat small program receives the call request returned by the operator.
304. Acquiring a first touch operation and a second sliding operation of a user on an incoming call reminding interface;
in this embodiment, the first touch operation and the second sliding operation may be two triggers in one operation sliding track, the second sliding operation is to determine whether to answer a call, and if so, the position of the first touch operation is determined so as to be on the assistant pickup icon.
Further, after the user jumps to the answer interface according to the second sliding operation, when a control of the jump dialog page is clicked on the answer interface, the first touch operation is obtained, and step 305 is executed.
305. When the second sliding operation is used for answering the incoming call and the first touch operation is used for clicking the assistant for connecting the icon, determining a jump instruction of the dialog page according to the first touch operation;
306. executing a call instruction and a jump instruction corresponding to the assistant pickup icon, and switching the call prompting interface to a conversation page in the WeChat applet;
307. displaying a conversation page on the incoming call reminding interface and covering the incoming call reminding interface;
308. acquiring a second touch operation of the user on the information editing area, sending out data in the information editing area according to the second touch operation, and displaying the data on the conversation page in a text and voice mode;
in this embodiment, a user calls a keyboard through touch operation on a dialog page displayed on a mobile terminal, then inputs characters to be input on the keyboard, sends the characters to a background server through a WeChat applet, converts the characters into voice through a real-time message gateway, sends the voice to the opposite side through a soft switch, and displays the voice on the dialog page.
309. And receiving the call information sent by the called terminal, and simultaneously displaying the call information on the conversation page in the forms of text and voice.
In the step, after receiving data sent by the opposite side, the data is converted through a real-time message gateway to obtain voice and characters, the voice and the characters are displayed on a conversation page, the voice is displayed and played simultaneously, a trumpet mark is displayed on the conversation page, and after the voice is played, the trumpet is displayed as a dot which prompts the user that the opposite side speaks.
In this embodiment, when the first touch operation is an SOS operation, an emergency call interface in the WeChat applet is called, the current position of the user is obtained through a positioning function of the mobile terminal and displayed on the emergency call interface, and a plurality of different emergency rescue telephones are displayed at the same time.
To sum up, a telephone interface in the WeChat applet is started through the call request, touch operation of a user on the telephone interface is collected, the current call request is transferred to a conversation page in the WeChat applet according to the touch operation, the user can directly carry out conversation on the conversation page, information displayed on the conversation page is displayed in a text mode and a voice mode, requirements of different users can be met, and compared with the prior art, the implementation mode has the advantages that only single voice interaction can be used for a telephone function, and the problem of barrier-free remote communication of hearing-impaired people is solved.
Furthermore, because the WeChat applet adopts the real-time message gateway to convert AI voice or text, and can quickly display text and play voice in the WeChat applet, the problem that whether the user has a listening or speaking obstacle is not considered in the telephone voice conversation, the applicable crowd of the telephone voice conversation is greatly improved, and meanwhile, the real-time message gateway and the RTMP protocol are used for transmitting data, so that the delay of information transmission is greatly shortened, and the conversation real-time experience of the user is provided.
With reference to fig. 8, the following describes an interaction apparatus for implementing a call for a hearing impaired person in the embodiment of the present invention, and an embodiment of the interaction apparatus for implementing a call for a hearing impaired person in the embodiment of the present invention includes:
a switching module 801, configured to receive a call request, start a wechat applet based on the call request and a preset binding relationship between a telephone function and the wechat applet, and switch a current interface of a mobile terminal to a telephone interface of the wechat applet;
the acquisition module 802 is configured to acquire a first touch operation of a user on the phone interface;
the display module 803 is configured to determine a corresponding interface jump instruction according to the first touch operation, call a dialog page in the wechat applet based on the interface jump instruction, and display the dialog page on the phone interface, where the dialog page at least includes a display area of call information and an information editing area;
the editing module 804 is configured to acquire a second touch operation of the user on the information editing area, send out data in the information editing area according to the second touch operation, and display the data on the dialog page in a text and voice manner; and receiving the call information sent by the called terminal, and displaying the call information on the dialogue page in the form of text and voice at the same time.
In the embodiment of the invention, based on the WeChat applet, the telephone interface in the WeChat applet is started through the call request, the touch operation of a user on the telephone interface is collected, the current call request is transferred to the conversation page in the WeChat applet according to the touch operation, the user can directly carry out conversation on the conversation page, and information displayed on the conversation page is displayed in a text mode and a voice mode, so that the requirements of different users can be met, and compared with the prior art, the realization mode can only use single voice interaction, and the problem of barrier-free remote communication of hearing-impaired people is solved.
Referring to fig. 9, another embodiment of the telephone voice communication apparatus according to the embodiment of the present invention includes:
a switching module 801, configured to receive a call request, start a wechat applet based on the call request and a preset binding relationship between a telephone function and the wechat applet, and switch a current interface of a mobile terminal to a telephone interface of the wechat applet;
the acquisition module 802 is configured to acquire a first touch operation of a user on the phone interface;
the display module 803 is configured to determine a corresponding interface jump instruction according to the first touch operation, call a dialog page in the wechat applet based on the interface jump instruction, and display the dialog page on the phone interface, where the dialog page at least includes a display area of call information and an information editing area;
the editing module 804 is configured to acquire a second touch operation of the user on the information editing area, send out data in the information editing area according to the second touch operation, and display the data on the dialog page in a text and voice manner; and receiving the call information sent by the called terminal, and displaying the call information on the dialogue page in the form of text and voice at the same time.
Wherein, the switching module 801 comprises:
the first invoking unit 8011 is configured to, when the call request is a dialing request, invoke a dialing interface in a wechat applet according to the dialing request, where the dialing interface at least includes a state bar, a dialing keyboard, and a menu bar;
the first identifying unit 8012 is configured to collect multiple dialing operations of a user on a dialing keyboard of the dialing interface, determine a called number according to the multiple dialing operations, and display the called number on the dialing interface.
In this embodiment, the interactive apparatus for implementing a call of a hearing-impaired person further includes a dialing module 805, which is specifically configured to:
determining a dialing instruction according to the first touch operation, and identifying the attribution information of the called number;
executing the dialing instruction to perform dialing operation based on the called number to obtain an outbound interface;
and displaying the called number and the attribution information on the outbound interface.
Optionally, the dialing module 805 is specifically configured to:
detecting whether the conversation service corresponding to the called number is displayed in the status bar and is connected online;
and if so, executing the dialing instruction to perform dialing operation, calling an outbound interface in the WeChat applet and displaying the outbound interface on the telephone interface.
In this embodiment, the display module 803 includes:
a detecting unit 8031, configured to detect whether an answering signaling returned by the called number is received;
an adjusting unit 8032, configured to adjust display information in a call process state bar of the outbound interface when detecting that an answer signaling is received;
the first display unit 8033 is configured to determine a jump instruction of the dialog page according to the first touch operation, call the dialog page in the wechat applet based on the jump instruction, and display the dialog page on the outbound interface.
In this embodiment, the switching module 801 further includes:
the second identifying unit 8013 is configured to, when the call request is a call request, switch a current interface of the terminal to a call display interface based on the call request, and collect a first sliding operation of a user on the call display interface, where the call display interface includes an answering area and a rejection area;
a second invoking unit 8014, configured to, when the first sliding operation is to drag the reject area to the answering area, invoke, by using a call forwarding function, a call alert interface of the wechat applet for display according to a binding relationship between a call display interface in a preset telephone function and the wechat applet, where the call alert interface includes a called number, an assistant pickup icon, an answering icon, and a reject icon.
In this embodiment, the display module 803 further includes:
an obtaining unit 8034, configured to obtain a second sliding operation of the user on the incoming call reminding interface;
a determining unit 8035, configured to determine, according to the first touch operation, a skip instruction of the dialog page when the second sliding operation is answering an incoming call and the first touch operation is the pointing assistant connection icon;
an execution unit 8036, configured to execute a call instruction and a jump instruction corresponding to the assistant pickup icon, and switch the incoming call reminding interface to a dialog page in the wechat applet;
the second display unit 8037 is configured to display the dialog page on the incoming call reminding interface and cover the incoming call reminding interface.
In summary, interface display in the WeChat applet is called according to touch operation of a user on the mobile terminal, and input operation of conversation is performed on the interface, an RTMP protocol and a websocket protocol in the WeChat applet transmit interactive data and a call signaling, and a real-time message gateway is adopted for voice conversion and coding, so that compatibility between telephone voice and an operator is achieved, the problem that dialing or answering of a telephone for voice communication is not achieved through the WeChat applet in the current market is solved, and meanwhile, the telephone of a hearing-impaired person is achieved.
Furthermore, the telephone function is realized through the operation on the WeChat applet, the interactive call information can be quickly converted through the real-time message gateway and the soft switch, and the method for answering and making a call for hearing-impaired people with better experience is realized.
Fig. 8 and 9 describe the interaction apparatus for implementing a call of a hearing-impaired person in the embodiment of the present invention in detail from the perspective of a modular functional entity, and the interaction apparatus for implementing a call of a hearing-impaired person in the embodiment of the present invention is described in detail from the perspective of hardware processing.
Fig. 10 is a schematic structural diagram of a terminal 900 according to an embodiment of the present invention, where the terminal 900 may have a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 910 (e.g., one or more processors) and a memory 920, and one or more storage media 930 (e.g., one or more mass storage devices) for storing applications 933 or data 932. Memory 920 and storage media 930 may be, among other things, transient storage or persistent storage. The program stored in the storage medium 930 may include one or more modules (not shown), each of which may include a series of instructions for the terminal 900 to operate. Still further, the processor 910 may be arranged to communicate with the storage medium 930 to execute a series of instruction operations in the storage medium 930 on the terminal 900.
Terminal 900 can also include one or more power supplies 940, one or more wired or wireless network interfaces 950, one or more input-output interfaces 960, and/or one or more operating systems 931, such as Windows Server, mac OS X, unix, linux, freeBSD, and so forth. Those skilled in the art will appreciate that the configuration of the terminal shown in fig. 10 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The invention further provides a terminal, where the computer device includes a memory and a processor, where the memory stores computer readable instructions, and when the computer readable instructions are executed by the processor, the processor executes the steps of the above-mentioned embodiments of the interaction method for implementing a call of a hearing-impaired person.
The present invention also provides a computer readable storage medium, which may be a non-volatile computer readable storage medium, and may also be a volatile computer readable storage medium, wherein instructions are stored in the computer readable storage medium, and when the instructions are run on a computer, the instructions cause the computer to execute the steps of the interaction method for realizing the conversation of the hearing-impaired person.
It can be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (9)
1. An interaction method for realizing the communication of the hearing-impaired people is characterized in that the interaction method for realizing the communication of the hearing-impaired people comprises the following steps:
receiving a call request, starting a wechat applet based on the call request and a preset binding relationship between a telephone function and the wechat applet, and switching a current interface of a mobile terminal to a telephone interface of the wechat applet; the starting of the wechat applet based on the call request and the preset binding relationship between the telephone function and the wechat applet and the switching of the current interface of the mobile terminal to the telephone interface of the wechat applet comprise: if the call request is a dialing request, calling a dialing interface in the WeChat small program according to the dialing request, wherein the dialing interface at least comprises a state bar, a dialing keyboard and a menu bar; collecting multiple dialing operations of a user on a dialing keyboard of the dialing interface, determining a called number according to the multiple dialing operations, authenticating the called number by the micro-message applet through a real-time message transmission protocol through communication between a real-time message gateway and a soft switch and an operator, determining whether corresponding service is available, and if the service is available, displaying a corresponding service state on the state bar;
acquiring a first touch operation of a user on the telephone interface, controlling a real-time message gateway to apply a channel session to a soft switch by the Websocket protocol and the first touch operation control small WeChat program, and establishing a communication link between the telephone function and a conversation page in the small WeChat program based on the channel session;
determining a corresponding interface jump instruction according to the first touch operation, calling a conversation page in the WeChat applet based on the interface jump instruction and the communication link, and displaying the conversation page on the telephone interface, wherein the conversation page at least comprises a display area of call information and an information editing area;
acquiring a second touch operation of a user on the information editing area, sending data in the information editing area according to the second touch operation, and displaying the data on the conversation page in a text and voice mode;
and receiving the call information sent by the called terminal, and displaying the call information on the conversation page in the form of text and voice at the same time.
2. The interaction method for realizing the conversation of the hearing impaired person according to claim 1, further comprising, after the collecting the first touch operation of the user on the phone interface:
determining a dialing instruction according to the first touch operation, and identifying the attribution information of the called number;
executing the dialing instruction to carry out dialing operation based on the called number to obtain an outbound interface;
and displaying the called number and the attribution information on the outbound interface.
3. The interaction method for realizing the communication of the hearing-impaired people according to claim 2, wherein the step of executing the dialing instruction to perform the dialing operation based on the called number to obtain the outbound interface comprises the following steps:
detecting whether the conversation service corresponding to the called number is displayed in the status bar and is connected online;
and if so, executing the dialing instruction to perform dialing operation, calling an outbound interface in the WeChat applet and displaying the outbound interface on the telephone interface.
4. The interaction method for realizing the conversation of the hearing-impaired person according to claim 3, wherein the determining a corresponding interface jump instruction according to the first touch operation, calling a conversation page in the WeChat applet based on the interface jump instruction, and displaying the conversation page on the phone interface comprises:
detecting whether receiving an answering signaling returned by the called number;
if so, adjusting display information in a calling process state bar of the outbound interface;
and determining a jump instruction of the dialogue page according to the first touch operation, calling the dialogue page in the WeChat applet based on the jump instruction, and displaying the dialogue page on the outbound interface.
5. The interaction method for realizing the call of the hearing-impaired person according to claim 1, wherein if the call request is an incoming call request, the initiating the wechat applet based on the call request and a preset binding relationship between the telephone function and the wechat applet, and switching the current interface of the mobile terminal to the telephone interface of the wechat applet comprises:
switching a current interface of the terminal to a caller identification interface based on the incoming call request, and collecting a first sliding operation of a user on the caller identification interface, wherein the caller identification interface comprises an answering area and a refusing area;
and when the first sliding operation is to drag the rejection area to the answering area, calling a call reminding interface of the WeChat applet for display through a call transfer function according to a binding relationship between a call display interface in a preset telephone function and the WeChat applet, wherein the call reminding interface comprises a called number, an assistant pickup icon, an answering icon and a rejection icon.
6. The interaction method for realizing the conversation of the hearing-impaired person according to claim 5, wherein the determining a corresponding interface jump instruction according to the first touch operation, calling a conversation page in the WeChat applet based on the interface jump instruction, and displaying the conversation page on the phone interface comprises:
acquiring a second sliding operation of the user on the incoming call reminding interface;
when the second sliding operation is to answer an incoming call and the first touch operation is to click an assistant to replace an icon, determining a jump instruction of the dialog page according to the first touch operation;
executing a call instruction and a jump instruction corresponding to the assistant pickup icon, and switching the incoming call reminding interface to a conversation page in the WeChat applet;
and displaying the conversation page on the call reminding interface and covering the call reminding interface.
7. The utility model provides an interactive installation that realizes hearing impaired people's conversation which characterized in that, interactive installation that hearing impaired people's conversation includes:
the switching module is used for receiving a call request, starting the wechat applet based on the call request and a preset binding relationship between a telephone function and the wechat applet, and switching the current interface of the mobile terminal to the telephone interface of the wechat applet; the starting of the wechat applet based on the call request and the preset binding relationship between the telephone function and the wechat applet and the switching of the current interface of the mobile terminal to the telephone interface of the wechat applet comprise: if the call request is a dialing request, calling a dialing interface in the WeChat small program according to the dialing request, wherein the dialing interface at least comprises a state bar, a dialing keyboard and a menu bar; collecting multiple dialing operations of a user on a dialing keyboard of the dialing interface, determining a called number according to the multiple dialing operations, authenticating the called number with an operator through a real-time message transmission protocol by the WeChat applet through a real-time message gateway and a soft switch, determining whether corresponding service is available, and if the service is available, displaying a corresponding service state on the state bar;
the collection module is used for collecting a first touch operation of a user on the telephone interface, the wessock applet utilizes a websocket protocol and the first touch operation control real-time message gateway to apply for a channel session to the soft switch, and a communication link between the telephone function and a conversation page in the wessock applet is established based on the channel session;
the display module is used for determining a corresponding interface jump instruction according to the first touch operation, calling a conversation page in the WeChat applet based on the interface jump instruction and the communication link, and displaying the conversation page on the telephone interface, wherein the conversation page at least comprises a display area of conversation information and an information editing area;
the editing module is used for acquiring second touch operation of a user on the information editing area, sending out data in the information editing area according to the second touch operation, and displaying the data on the conversation page in a text and voice mode; and receiving the call information sent by the called terminal, and displaying the call information on the dialogue page in the form of text and voice at the same time.
8. A terminal, characterized in that the mobile terminal comprises: a memory having instructions stored therein and at least one processor, the memory and the at least one processor interconnected by a line;
the at least one processor invokes the instructions in the memory to cause the terminal to execute the steps of the interactive method for realizing the hearing impaired person conversation according to any one of claims 1-6.
9. A computer-readable storage medium having instructions stored thereon, wherein the instructions, when executed by a processor, implement the steps of the interactive method for hearing impaired people to talk according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110066896.3A CN112887194B (en) | 2021-01-19 | 2021-01-19 | Interactive method, device, terminal and storage medium for realizing communication of hearing-impaired people |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110066896.3A CN112887194B (en) | 2021-01-19 | 2021-01-19 | Interactive method, device, terminal and storage medium for realizing communication of hearing-impaired people |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112887194A CN112887194A (en) | 2021-06-01 |
| CN112887194B true CN112887194B (en) | 2022-12-09 |
Family
ID=76049329
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110066896.3A Active CN112887194B (en) | 2021-01-19 | 2021-01-19 | Interactive method, device, terminal and storage medium for realizing communication of hearing-impaired people |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112887194B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114489557B (en) * | 2021-12-15 | 2024-03-22 | 青岛海尔科技有限公司 | Voice interaction method, device, equipment and storage medium |
| CN114285910A (en) * | 2021-12-23 | 2022-04-05 | 号百信息服务有限公司 | System and method for remodeling communication terminal and internet audio format |
| CN115118692A (en) * | 2022-06-24 | 2022-09-27 | 拉扎斯网络科技（上海）有限公司 | Information processing method, device, system, electronic equipment and readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108650419A (en) * | 2018-05-09 | 2018-10-12 | 深圳市知远科技有限公司 | Telephone interpretation system based on smart mobile phone |
| CN109274831A (en) * | 2018-11-01 | 2019-01-25 | 科大讯飞股份有限公司 | A kind of audio communication method, device, equipment and readable storage medium storing program for executing |
| WO2020078337A1 (en) * | 2018-10-15 | 2020-04-23 | 华为技术有限公司 | Translation method and electronic device |
| CN111768786A (en) * | 2020-06-24 | 2020-10-13 | 重庆蓝岸通讯技术有限公司 | Deaf-mute conversation intelligent terminal platform and conversation method thereof |
-
2021
- 2021-01-19 CN CN202110066896.3A patent/CN112887194B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108650419A (en) * | 2018-05-09 | 2018-10-12 | 深圳市知远科技有限公司 | Telephone interpretation system based on smart mobile phone |
| WO2020078337A1 (en) * | 2018-10-15 | 2020-04-23 | 华为技术有限公司 | Translation method and electronic device |
| CN109274831A (en) * | 2018-11-01 | 2019-01-25 | 科大讯飞股份有限公司 | A kind of audio communication method, device, equipment and readable storage medium storing program for executing |
| CN111768786A (en) * | 2020-06-24 | 2020-10-13 | 重庆蓝岸通讯技术有限公司 | Deaf-mute conversation intelligent terminal platform and conversation method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112887194A (en) | 2021-06-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112887194B (en) | Interactive method, device, terminal and storage medium for realizing communication of hearing-impaired people | |
| CN110891124B (en) | System for artificial intelligence pick-up call | |
| US6587558B2 (en) | System and method for virtual interactive response unit | |
| US6763089B2 (en) | System for enabling TDD communication in a telephone network and method for using same | |
| US10015311B2 (en) | Device independent text captioned telephone service | |
| US8428228B1 (en) | Unified communication system | |
| US6546082B1 (en) | Method and apparatus for assisting speech and hearing impaired subscribers using the telephone and central office | |
| US6678359B1 (en) | Called party identification in packet switched networks | |
| EP1768369A1 (en) | Presence and preference enabled voice response system and method | |
| US20070189267A1 (en) | Voice Assisted Click-to-Talk | |
| JP5592690B2 (en) | Voice communication method | |
| KR20080082486A (en) | A communications server for handling parallel voice and data connections and method of using the same | |
| US8671149B1 (en) | Unified messaging platform with intelligent voice recognition (IVR) | |
| US11258900B2 (en) | Device independent text captioned telephone service | |
| EP1418740A1 (en) | Simultaneous interpretation system and method thereof | |
| CN112600824B (en) | Telephone voice communication method, device, server and storage medium | |
| CN112040073B (en) | Intelligent directory assistance server, directory assistance system and directory assistance method | |
| US20040109543A1 (en) | Method of accessing an information source | |
| CN111884886B (en) | Intelligent household communication method and system based on telephone | |
| JP2003069720A (en) | Communication method and communication control device | |
| JP4001574B2 (en) | Telephone response system and telephone response server | |
| US8644465B2 (en) | Method for processing audio data on a network and device therefor | |
| JP2003069718A (en) | System for supporting remote interaction between person handicapped in hearing and person having no difficulty in hearing | |
| JP3950379B2 (en) | Communication server, communication system, and communication method | |
| CN114143404A (en) | Data interaction method, user terminal and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |