CN111818214A - Terminal device control method, terminal device, and medium - Google Patents
Terminal device control method, terminal device, and medium Download PDFInfo
- Publication number
- CN111818214A CN111818214A CN202010618331.7A CN202010618331A CN111818214A CN 111818214 A CN111818214 A CN 111818214A CN 202010618331 A CN202010618331 A CN 202010618331A CN 111818214 A CN111818214 A CN 111818214A
- Authority
- CN
- China
- Prior art keywords
- terminal device
- application
- text data
- interface
- audio data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/64—Automatic arrangements for answering calls; Automatic arrangements for recording messages for absent subscribers; Arrangements for recording conversations
- H04M1/65—Recording arrangements for recording a message from the calling party
- H04M1/656—Recording arrangements for recording a message from the calling party for recording conversations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/74—Details of telephonic subscriber devices with voice recognition means
Abstract
The invention discloses a control method of terminal equipment, which comprises the following steps: recording audio data corresponding to the currently running application; converting the audio data into text data; and displaying the text data in the running interface of the application. The invention also discloses a terminal device and a computer readable storage medium, which achieve the effect of audio data visualization.
Description
Technical Field
The present invention relates to the field of electronic information technologies, and in particular, to a control method for a terminal device, and a computer-readable storage medium.
Background
With the development of science and technology, mobile terminals such as mobile phones and tablet computers have become an indispensable part of people's daily life and work. The popularization of the mobile terminal greatly improves the efficiency of remote communication of people.
However, when a user needs to record call content during a voice call, the existing mobile terminal can only record the call voice of the user through a preset recording function, so that the user can review the call content according to the recording file after finishing the call. This results in the disadvantage of poor visibility of the content of the call log.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a control method of a terminal device, the terminal device and a computer readable storage medium, aiming at achieving the effect of audio data visualization.
In order to achieve the above object, the present invention provides a method for controlling a terminal device, including:
recording audio data corresponding to the currently running application;
converting the audio data into text data;
and displaying the text data in the running interface of the application.
Optionally, the audio data is real-time call data of the application.
Optionally, the text data is synchronized with the audio data.
Optionally, the audio data is audio data that is instantly saved according to the real-time interactive audio data of the application.
Optionally, the running interface further includes an end button, and when the end button is triggered, the displaying of the text data is stopped.
Optionally, after the step of displaying the text data in the running interface of the application, the method further includes:
and saving the text data to a text application.
Optionally, the text data is presented when the running interface with the application is presented, and is presented to the text-type application.
Optionally, the application is a voice call application, and before the step of saving the text data to the text application, the method further includes:
acquiring contact information and/or current time information corresponding to a current call;
generating file names of the audio data and the text data according to the contact information and/or the current time information;
the step of saving the text data to a text type application comprises:
and saving the text data to the text type application based on the file name.
Optionally, the text data is displayed on a secondary interface of the running interface.
Optionally, the secondary interface is overlapped with the operation interface or embedded in the operation interface.
Optionally, before the step of recording the audio data corresponding to the currently running application, the method further includes:
displaying a preset control on the running interface;
and when the preset control is triggered, executing the step of recording the audio data corresponding to the currently running application.
Optionally, before the step of displaying the text data in the running interface of the application, the method further includes:
acquiring display control parameters of the operation interface;
determining a target position according to the display control parameters;
the step of displaying the text data in the running interface of the application comprises the following steps:
and displaying the text data at the target position in the running interface.
In addition, in order to achieve the above object, the present invention further provides a terminal device, where the terminal device includes a memory, a processor, and a control program of the terminal device stored in the memory and operable on the processor, and the control program of the terminal device implements the steps of the control method of the terminal device as described above when executed by the processor.
Further, to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a control program of a terminal device, which when executed by a processor, implements the steps of the control method of the terminal device as described above.
According to the control method of the terminal device, the terminal device and the computer readable storage medium provided by the embodiment of the invention, the audio data corresponding to the currently running application is recorded, then the audio data is converted into the text data, and the text data is displayed in the running interface of the application.
Drawings
Fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a control method of a terminal device according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating a control method of a terminal device according to another embodiment of the present invention;
fig. 4 is a schematic view of a call interface provided with a text display area according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Because, when a user needs to record call content in the voice call process, the existing mobile terminal can only record the call voice of the user through the preset recording function, so that the user can review the call content according to the recording file after finishing the call. This results in the disadvantage of poor visibility of the content of the call log.
In order to solve the foregoing defects in the prior art, an embodiment of the present invention provides a method for controlling a terminal device, which includes:
recording audio data corresponding to the currently running application;
converting the audio data into text data;
and displaying the text data in the running interface of the application.
The corresponding text data can be directly generated and displayed according to the applied audio data, so that the effect of visualizing the audio content is realized, and the information output capability of the terminal is improved.
As shown in fig. 1, fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention.
The terminal of the embodiment of the invention can be terminal equipment such as a smart phone, a tablet computer or a PC.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), a mouse, etc., and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a control program of a terminal device.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the processor 1001 may be configured to call a control program of the terminal device stored in the memory 1005 and perform the following operations:
recording audio data corresponding to the currently running application;
converting the audio data into text data;
and displaying the text data in the running interface of the application.
Further, the processor 1001 may call the control program of the terminal device stored in the memory 1005, and also perform the following operations:
and saving the text data to a text application.
Further, the processor 1001 may call the control program of the terminal device stored in the memory 1005, and also perform the following operations:
acquiring contact information and/or current time information corresponding to a current call;
generating file names of the audio data and the text data according to the contact information and/or the current time information;
the step of saving the text data to a text type application comprises:
and saving the text data to the text type application based on the file name.
Further, the processor 1001 may call the control program of the terminal device stored in the memory 1005, and also perform the following operations:
displaying a preset control on the running interface;
and when the preset control is triggered, executing the step of recording the audio data corresponding to the currently running application.
Further, the processor 1001 may call the control program of the terminal device stored in the memory 1005, and also perform the following operations:
acquiring display control parameters of the operation interface;
determining a target position according to the display control parameters;
the step of displaying the text data in the running interface of the application comprises the following steps:
and displaying the text data at the target position in the running interface.
Referring to fig. 2, in an embodiment of the method for controlling a terminal device of the present invention, the method for controlling a terminal device includes the following steps:
step S10, recording the audio data corresponding to the currently running application;
step S20, converting the audio data into text data;
and step S30, displaying the text data in the running interface of the application.
The implementation terminal of the embodiment may be a terminal with a voice playing function, such as an intelligent mobile terminal and a PC.
In this embodiment, the implementation terminal is further provided with a voice call function, an instant voice function and/or a multimedia file playing function. The terminal can record the audio data corresponding to the currently running application in real time. The audio data may be audio data that is interacted with the current application process in real time, that is, the audio data is audio data that is instantly stored according to the real-time interactive audio data of the application, or may also be audio data that is stored in a delayed manner.
Example 1, when a terminal is performing a voice call, for example, a voice call or a video call through a web call application such as WeChat, QQ, and/or nailing, and/or a real-time call is performed based on an operator network, audio data corresponding to a progress of the call may be acquired.
Example 2, when the terminal plays a multimedia file such as a video file or an audio file through an update video, a QQ music, or a browser, the terminal may record audio data corresponding to an application currently in a multimedia file playing state.
After the terminal records the audio data corresponding to the application, voice recognition can be performed based on the recorded audio data, and the audio data is converted into text data through the voice recognition.
Specifically, the terminal can have a voice recognition function, so that after audio data are recorded, the recorded audio data can be directly converted into text data through the local voice recognition function. The terminal can also synchronize the recorded audio data to the server in real time, so that the server can generate corresponding text data according to the audio data after receiving the audio data, and feed the text data back to the terminal in real time, so that the terminal can receive the text data as the text data corresponding to the currently recorded audio data.
Further, after the audio data is converted into the text data, the text data may be presented in the running interface of the application corresponding to the audio data. It can be understood that the terminal can convert the audio data corresponding to the application into text data in real time, that is, the text data displayed in the running interface is synchronized with the voice content corresponding to the audio data currently output by the application.
Example 1, in a call process, a terminal may convert a local terminal voice and an opposite terminal voice corresponding to a current call process into response words in real time, and then display a word call content in a call interface.
Referring to fig. 4, in this example, a text display interface may be displayed in a floating manner in a call interface, and in a call process, a local-end voice and an opposite-end voice corresponding to the call process are obtained in real time, and are converted into characters, and the characters corresponding to the local-end voice and the opposite-end voice are displayed in the text display interface.
Example 2, when the terminal plays a video or plays music through an Tencent video and/or a UC browser, the terminal may acquire audio data of the currently played video or the music as audio data, and then perform voice recognition on the audio data, so that video lines or lyrics corresponding to the music may be displayed in a playing interface.
In the technical scheme disclosed in this embodiment, the audio data corresponding to the currently running application is recorded first, then the audio data is converted into the text data, and the text data is displayed in the running interface of the application.
Optionally, based on the above embodiment, in the first embodiment, an end button is further disposed in the running interface, and when the end button is triggered, presentation of the text data may be stopped. The end button can be embedded in the running interface or suspended and displayed on the running interface. It is understood that the display interface may also be configured not to set the end button, and stop displaying the text data when the terminal receives a gesture preset by the user and configured to control the terminal to stop displaying the text data. The preset gestures set to control the terminal to stop displaying the text data include, but are not limited to, double-click, single-click on the operation interface, down/up-slide, and other control gestures.
Optionally, based on the above example, in the second embodiment, after the text data is generated, the text data may be saved in a text-type application. For example, after the text data is generated, the text data may be saved to a notepad.
Optionally, in this embodiment, before the text data is saved, source information of audio data corresponding to the text data may also be obtained. The source information comprises the name of the application corresponding to the audio data, the running information of the acquired application and the like. And then generating a file name of the text data according to the source information, and saving the text data based on the file name.
Example 1, when the application is a WeChat, a QQ, a telephone or the like, the real-time call reference may be to obtain an application name, contact information and/or call time related to a call process corresponding to the text data, and then generate a file name according to the reference name, the contact information and/or the call time. For example, WeChat _ Zhang _ 2020.05.22.
Example 2, when the application is a multimedia file playing application such as Tencent video and/or QQ music, a file name and an application name of a source file of audio data may be obtained, and a file name of the text data may be generated according to the file name and the application name of the source file. For example, the words "Qing Ping le" from the 23 rd Pop, the words "Gou Yan" lyrics.
Optionally, in this embodiment, the text data may be classified and stored based on the attribute and/or name of the application. For example, text data corresponding to the same application is set as the same category, and the name of the category is named as the name of the application. Alternatively, the primary class may be determined according to the application attribute, and the secondary class may be determined according to the application name. For example, a call class application is used as one class in a first class, a multimedia playing application is used as another class in a first class, and then under the first class, a corresponding second class is determined by an application name.
Optionally, based on the foregoing embodiment, in a third implementation manner, the terminal may be triggered to display a secondary interface of an operation interface through the operation interface of the terminal, where the secondary interface may be displayed in a floating manner with the operation interface, or may be embedded in the operation interface, so as to display the text data in the improved secondary interface.
Optionally, the user may preset a control gesture for triggering the secondary interface, where the control gesture includes, but is not limited to, a control gesture of clicking the operation interface, sliding down/up, and pulling down/up. Or displaying a secondary interface trigger button in the running interface, and displaying the secondary interface by the terminal when the secondary interface trigger button is selected. The secondary interface trigger button can be displayed on the operation interface in a suspension mode or embedded in the operation interface.
Optionally, in a fourth embodiment, a preset control may be displayed in the running interface of the application, wherein the preset space is embedded in the running interface or is displayed in the running interface in a floating manner, and when the preset control is triggered, the steps S10 to S30 are performed.
Optionally, in another embodiment, before the step S30, the method further includes:
step S40, acquiring display control parameters of the running interface;
step S50, determining the target position according to the display control parameter
The step S30 further includes:
step S31, displaying the text data at the target position in the running interface
In this embodiment, the terminal may first obtain display parameters of the operation interface, where the display parameters include display content of the operation interface and a display position corresponding to the display content, and then may determine the target position based on the display parameters.
For example, when the running interface is a video playing interface, the target position may be set to the bottom or the top of the video, and the like.
When the text data is displayed, the text data can be displayed at a target position in the running interface.
In addition, an embodiment of the present invention further provides a terminal device, where the terminal device includes a memory, a processor, and a control program of the terminal device that is stored in the memory and is executable on the processor, and the control program of the terminal device implements the steps of the control method of the terminal device according to the above embodiments when executed by the processor.
Furthermore, an embodiment of the present invention further provides a computer-readable storage medium, where a control program of a terminal device is stored on the computer-readable storage medium, and the control program of the terminal device, when executed by a processor, implements the steps of the control method of the terminal device according to the above embodiments.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g. a smart phone, a tablet computer, or a PC) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (15)
1. A control method of a terminal device is characterized by comprising the following steps:
recording audio data corresponding to the currently running application;
converting the audio data into text data;
and displaying the text data in the running interface of the application.
2. The method for controlling a terminal device according to claim 1, wherein the audio data is real-time call data of the application.
3. The method for controlling a terminal device according to claim 1, wherein the text data is synchronized with the audio data.
4. The method for controlling a terminal device according to claim 1, wherein the audio data is audio data that is instantly saved according to real-time interactive audio data of the application.
5. The method for controlling a terminal device according to claim 1, wherein the operation interface further includes an end button, and when the end button is triggered, presentation of the text data is stopped.
6. The method for controlling a terminal device according to claim 1, wherein after the step of presenting the text data in the execution interface of the application, further comprising:
and saving the text data to a text application.
7. The method for controlling a terminal device according to claim 6, wherein the text data is presented when a running interface with the application is presented and when presented to the text-type application.
8. The method for controlling a terminal device according to claim 6, wherein the application is a voice call application, and before the step of saving the text data to a text-based application, the method further comprises:
acquiring contact information and/or current time information corresponding to a current call;
generating file names of the audio data and the text data according to the contact information and/or the current time information;
the step of saving the text data to a text type application comprises:
and saving the text data to the text type application based on the file name.
9. The method for controlling a terminal device according to claim 1, wherein the text data is presented in a secondary interface of the execution interface.
10. The method for controlling a terminal device according to claim 9, wherein the secondary interface is disposed to overlap with the operation interface or is embedded in the operation interface.
11. The method for controlling a terminal device according to claim 1, wherein the step of recording the audio data corresponding to the currently running application is preceded by:
displaying a preset control on the running interface;
and when the preset control is triggered, executing the step of recording the audio data corresponding to the currently running application.
12. The method for controlling a terminal device according to claim 1, wherein before the step of presenting the text data in the execution interface of the application, the method further comprises:
acquiring display control parameters of the operation interface;
and determining the target position according to the display control parameters.
13. The control method of a terminal device according to claim 12,
the step of displaying the text data in the running interface of the application comprises the following steps:
and displaying the text data at the target position in the running interface.
14. A terminal device, characterized in that the terminal device comprises: memory, a processor and a control program of a terminal device stored on the memory and executable on the processor, the control program of the terminal device implementing the steps of the control method of the terminal device according to any one of claims 1 to 13 when executed by the processor.
15. A computer-readable storage medium, characterized in that a control program of a terminal device is stored thereon, which when executed by a processor implements the steps of the control method of the terminal device according to any one of claims 1 to 13.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010618331.7A CN111818214A (en) | 2020-06-30 | 2020-06-30 | Terminal device control method, terminal device, and medium |
| PCT/CN2020/117505 WO2022000829A1 (en) | 2020-06-30 | 2020-09-24 | Audio data processing method, terminal device, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010618331.7A CN111818214A (en) | 2020-06-30 | 2020-06-30 | Terminal device control method, terminal device, and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111818214A true CN111818214A (en) | 2020-10-23 |
Family
ID=72855742
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010618331.7A Pending CN111818214A (en) | 2020-06-30 | 2020-06-30 | Terminal device control method, terminal device, and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111818214A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101068271A (en) * | 2007-06-26 | 2007-11-07 | 华为技术有限公司 | Telephone summery generating system, communication terminal, media server and method |
| CN106601251A (en) * | 2016-10-27 | 2017-04-26 | 乐视控股（北京）有限公司 | Generating method and system of communication text |
| CN110364154A (en) * | 2019-07-30 | 2019-10-22 | 深圳市沃特沃德股份有限公司 | Voice is converted into the method, apparatus, computer equipment and storage medium of text in real time |
-
2020
- 2020-06-30 CN CN202010618331.7A patent/CN111818214A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101068271A (en) * | 2007-06-26 | 2007-11-07 | 华为技术有限公司 | Telephone summery generating system, communication terminal, media server and method |
| CN106601251A (en) * | 2016-10-27 | 2017-04-26 | 乐视控股（北京）有限公司 | Generating method and system of communication text |
| CN110364154A (en) * | 2019-07-30 | 2019-10-22 | 深圳市沃特沃德股份有限公司 | Voice is converted into the method, apparatus, computer equipment and storage medium of text in real time |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108319489B (en) | Application page starting method and device, storage medium and electronic equipment | |
| CN110020292B (en) | Webpage content extraction method and terminal equipment | |
| US9021507B2 (en) | Dynamic use of data across multiple programs | |
| CN111490927B (en) | Method, device and equipment for displaying message | |
| KR20140126702A (en) | Extension activation for related documents | |
| KR20160125401A (en) | Inline and context aware query box | |
| CN109656444B (en) | List positioning method, device, equipment and storage medium | |
| JP2016531352A (en) | Method, device, program and device for updating input system | |
| CN111324352A (en) | Code generation method of application page and related equipment | |
| CN112506854A (en) | Method, device, equipment and medium for storing page template file and generating page | |
| CN111813305A (en) | Application program starting method and device | |
| CN111158841A (en) | Page jump method, page jump creation method, device and terminal equipment | |
| CN112286485B (en) | Method and device for controlling application through voice, electronic equipment and storage medium | |
| EP4130960A1 (en) | Ui control generation and trigger methods, and terminal | |
| CN114020197A (en) | Cross-application message processing method, electronic device and readable storage medium | |
| CN112306450A (en) | Information processing method and device | |
| CN107357481B (en) | Message display method and message display device | |
| KR101303672B1 (en) | Device and method of sharing contents by devices | |
| CN111818214A (en) | Terminal device control method, terminal device, and medium | |
| CN113779321A (en) | Electronic whiteboard file saving method and device, electronic whiteboard and storage medium | |
| CN113362802A (en) | Voice generation method and device and electronic equipment | |
| CN111787155A (en) | Audio data processing method, terminal device and medium | |
| CN113157966A (en) | Display method and device and electronic equipment | |
| CN112764634A (en) | Content processing method and device | |
| US20170235827A1 (en) | Vocalizing short responses to voice queries |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201023 |