CN111243258B - Terminal screen control method based on audio and storage medium - Google Patents
Terminal screen control method based on audio and storage medium Download PDFInfo
- Publication number
- CN111243258B CN111243258B CN202010012032.9A CN202010012032A CN111243258B CN 111243258 B CN111243258 B CN 111243258B CN 202010012032 A CN202010012032 A CN 202010012032A CN 111243258 B CN111243258 B CN 111243258B
- Authority
- CN
- China
- Prior art keywords
- terminal
- mask layer
- sound sequence
- audio
- control method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C23/00—Non-electrical signal transmission systems, e.g. optical systems
- G08C23/02—Non-electrical signal transmission systems, e.g. optical systems using infrasonic, sonic or ultrasonic waves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a terminal screen control method and a storage medium based on audio, wherein the method comprises the following steps: when a terminal microphone receives a specific frequency sound sequence with amplitude higher than a threshold value, which is sent by a loudspeaker of the terminal microphone, a mask layer is arranged on the uppermost layer of all applications of the terminal; intercepting all touch events of the terminal through the mask layer; when the amplitude of the specific frequency sound sequence received by the terminal microphone is lower than a threshold value, the mask layer is reduced to a specified size. The invention can not only maintain the normal playing of the head-wearing equipment, but also effectively prevent the false touch; furthermore, the terminal can be conveniently and accurately controlled in the dark to interact with the app; furthermore, the electric quantity of the terminal can be saved.
Description
Technical Field
The invention relates to the field of head-mounted equipment, in particular to a terminal screen control method based on audio and a storage medium.
Background
More and more head-mounted devices support outputting terminal (mobile phone, tablet, etc.) pictures to the head-mounted devices for display. Based on the prior art, if the terminal is locked, the terminal cannot continuously output the picture to the head-mounted equipment. If the terminal does not lock the screen, the terminal is easy to touch by mistake, and particularly placed in a pocket; and when the terminal (such as a mobile phone) is placed in a pocket and the screen is locked, the terminal is difficult to operate, and the display of the head-mounted device cannot be controlled.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: provided are a terminal screen control method and a storage medium based on audio, which can maintain an output picture to a head-mounted device and can operate a terminal in a dark.
In order to solve the technical problems, the invention adopts the technical scheme that:
a terminal screen control method based on audio comprises the following steps:
when a terminal microphone receives a specific frequency sound sequence with amplitude higher than a threshold value, which is sent by a loudspeaker of the terminal microphone, a transparent mask layer is arranged on the uppermost layer of all applications of the terminal;
intercepting all touch events of the terminal through the transparent mask layer;
when the amplitude of the specific frequency sound sequence received by the terminal microphone is lower than a threshold value, the transparent mask layer is reduced to a specified size.
The invention provides another technical scheme as follows:
a computer-readable storage medium having stored thereon a computer program, which when executed by a processor, is capable of implementing the steps involved in a method for audio-based terminal screen control as described above.
The invention has the beneficial effects that: when the terminal receives a specific frequency sound sequence which is larger than the amplitude threshold value, the mask layer is started to intercept all touch events, so that the problem of mistaken touch is effectively solved, the terminal is ensured not to be locked actually, and the head-mounted equipment can display the content of the terminal as usual; meanwhile, the mask layer can be unlocked by providing a simple and easy way (blocking the microphone so that the terminal cannot receive or receives a sound sequence lower than a threshold value), and the feasibility of controlling the terminal is provided. The invention has the advantages of easy implementation, low cost and the like.
Drawings
Fig. 1 is a flowchart illustrating a method for controlling a terminal screen based on audio according to an embodiment of the present invention;
fig. 2 is a schematic interface diagram of a screen of a head-mounted device during a dark operation process according to an embodiment of the present invention.
Detailed Description
In order to explain technical contents, achieved objects, and effects of the present invention in detail, the following description is made with reference to the accompanying drawings in combination with the embodiments.
The most key concept of the invention is as follows: setting a mask layer to prevent error touch; the playing and receiving of the sound sequence with the specific frequency are set to realize flexible and convenient unlocking and screen locking, and the feasibility of dark interaction is provided.
Referring to fig. 1 and 2, the present invention provides a terminal screen control method based on audio, including:
when a terminal microphone receives a specific frequency sound sequence with amplitude higher than a threshold value, which is sent by a loudspeaker of the terminal microphone, a mask layer is arranged on the uppermost layer of all applications of the terminal;
intercepting all touch events of the terminal through the mask layer;
when the amplitude of the specific frequency sound sequence received by the terminal microphone is lower than a threshold value, the mask layer is reduced to a specified size.
From the above description, the beneficial effects of the present invention are: the mask layer is arranged to shield all touch events so as to effectively prevent mistaken touch in the bag; the playing and receiving of the sound sequence with the specific frequency are set to realize flexible and convenient unlocking and screen locking, namely, the feasibility of dark interaction is provided, and the range of the applicable terminal is expanded.
Further, still include:
and adjusting the brightness of the terminal to be the lowest.
According to the description, the automatic dimming device has the function of automatically dimming the brightness, and effectively saves the electric quantity.
Further, when the microphone of the terminal receives a specific frequency sound sequence with amplitude higher than a threshold value emitted by the speaker of the terminal, the mask layer is set on the top layer of all applications of the terminal, specifically:
controlling a terminal loudspeaker to continuously emit a sound sequence with the amplitude higher than a threshold value;
the terminal microphone receives the sound sequence and judges whether the amplitude of the sound sequence is higher than a threshold value, and if so, the terminal microphone analyzes the sound sequence to obtain a corresponding frequency band sequence;
searching a preset code table, if the character string corresponding to the frequency band sequence is matched with a preset unlocking character string, judging that the sound sequence is a sound sequence with a specific frequency, and setting a mask layer on the uppermost layer of all applications of the terminal;
intercepting all touch events of the terminal through the mask layer;
if the terminal continuously receives the specific frequency sound sequence with the amplitude higher than the threshold value, the mask layer is maintained to be the same.
As can be seen from the above description, the terminal initiates and maintains the mask layer setting according to the specific frequency sound sequence received with the amplitude greater than the threshold value, and the implementation is convenient.
Further, the frequency-specific sound sequence includes at least three frequency bands of low frequencies.
As can be seen from the above description, the low frequency setting makes the human ear inaudible, which brings influence to the user; and at least three frequency bands are included, so that the accuracy of the sound control mask layer can be improved, and noise interference can be avoided.
Further, the mask layer is shrunk to a specified size, and then the method further comprises the following steps:
and displaying the touch track and the current touch position on the terminal interface in the head-mounted equipment.
According to the description, the user can know the current touch position and operation, the interaction is convenient, and the control accuracy is improved.
Further, still include:
and displaying horizontal and vertical coordinates in opposite colors at the position of a frame corresponding to the terminal interface in the head-mounted equipment.
According to the description, the user can combine the frame coordinate prompt to more accurately control.
Further, displaying the touch trajectory using a reverse color; identifying the current touch location using a dot or cross center point.
According to the description, the touch track can be more prominently displayed, the current touch position can be accurately positioned, the control accuracy is ensured, and the control is more convenient.
Further, the specified size is one pixel point.
It can be known from the above description that this not only can prevent the transparent mask layer from being recovered by the system, but also is favorable for quick start again, and restores the state of completely covering the screen, i.e. locks the screen again.
Further, the mask layer is a transparent mask layer.
Therefore, the state of the unlocked screen can be simulated, and the playing content of the terminal is more visual.
The invention provides another technical scheme as follows:
a computer-readable storage medium having stored thereon a computer program, which when executed by a processor, enables the following steps included in an audio-based terminal screen control method:
when a terminal microphone receives a specific frequency sound sequence with amplitude higher than a threshold value, which is sent by a loudspeaker of the terminal microphone, a mask layer is arranged on the uppermost layer of all applications of the terminal;
intercepting all touch events of the terminal through the mask layer;
when the amplitude of the specific frequency sound sequence received by the terminal microphone is lower than a threshold value, the mask layer is reduced to a specified size.
Further, still include:
and adjusting the brightness of the terminal to be the lowest.
Further, when the microphone of the terminal receives a specific frequency sound sequence with amplitude higher than a threshold value emitted by the speaker of the terminal, the mask layer is set on the top layer of all applications of the terminal, specifically:
controlling a terminal loudspeaker to continuously emit a sound sequence with the amplitude higher than a threshold value;
the terminal microphone receives the sound sequence and judges whether the amplitude of the sound sequence is higher than a threshold value, and if so, the terminal microphone analyzes the sound sequence to obtain a corresponding frequency band sequence;
searching a preset code table, if the character string corresponding to the frequency band sequence is matched with a preset unlocking character string, judging that the sound sequence is a sound sequence with a specific frequency, and setting a mask layer on the uppermost layer of all applications of the terminal;
intercepting all touch events of the terminal through the mask layer;
if the terminal continuously receives the specific frequency sound sequence with the amplitude higher than the threshold value, the mask layer is maintained to be the same.
Further, the frequency-specific sound sequence includes at least three frequency bands of low frequencies.
Further, the mask layer is shrunk to a specified size, and then the method further comprises the following steps:
and displaying the touch track and the current touch position on the terminal interface in the head-mounted equipment.
Further, still include:
and displaying horizontal and vertical coordinates in opposite colors at the position of a frame corresponding to the terminal interface in the head-mounted equipment.
Further, displaying the touch trajectory using a reverse color; identifying the current touch location using a dot or cross center point.
Further, the specified size is one pixel point.
Further, the mask layer is a transparent mask layer.
As can be understood from the above description, those skilled in the art can understand that all or part of the processes in the above technical solutions can be implemented by instructing related hardware through a computer program, where the program can be stored in a computer-readable storage medium, and when executed, the program can include the processes of the above methods. After the flow is executed, the beneficial effects of the corresponding method can still be obtained.
The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
Example one
Referring to fig. 1 and fig. 2, the present embodiment provides a method for controlling a terminal screen based on audio, which can still ensure that a headset can normally play or display the content of the terminal screen after a terminal is stored, and can also implement dark operation.
The method comprises the following steps:
firstly, when a microphone of the terminal receives a specific frequency sound sequence with amplitude higher than a threshold value emitted by a loudspeaker of the terminal, a mask layer (display) is arranged at the uppermost layer of all applications of the terminal; and intercepting all touch events of the terminal through the mask layer.
Due to the arrangement of the shielding layer, the terminal can still play the original app content, the head-mounted device connected with the terminal can still normally play the terminal display content, and the terminal cannot be touched to achieve a pseudo screen locking effect. The intercepting mode may be intercepting all touch events and not transferring to the upper layer application for processing.
Preferably, after the transparent mask layer is opened, the brightness of the terminal is automatically adjusted to be the lowest, so as to save electric quantity. The display brightness of the head-mounted equipment can be independently controlled through the brightness adjusting button arranged on the head-mounted equipment, so that the display effect of the head-mounted equipment cannot be influenced.
Through the operation, even if the terminal is accomodate in the pocket, in the package or other dark places, still can guarantee the normal broadcast of head-mounted device, and solved the mistake and touched the terminal display screen and influence the problem of broadcast.
Alternatively, the mask layer may be a transparent mask layer, or may be a customized interface pattern. The present embodiment is described with reference to a transparent mask layer.
The transparent mask layer has a substantially different background mask effect from the background mask effect of the current browser when the current webpage pops up (e.g., pops up a confirmation form). The application is a cross-application transparent mask implemented for native android applications, rather than for browser web pages.
"unlock" and "maintain" for the mask layer specifically include:
and controlling the terminal loudspeaker to continuously emit a sound sequence with the amplitude (corresponding to the volume) higher than the threshold value, namely a preset specific frequency sound sequence. The terminal microphone receives the sound sequence, firstly judges whether the amplitude of the sound sequence is higher than a preset threshold (the average amplitude can be calculated by filtering out the waveform of the characteristic frequency), and if so, analyzes the received sound sequence to obtain a corresponding frequency band sequence; then searching a preset code table, if the character string corresponding to the frequency band sequence obtained by analysis is matched with a preset unlocking character string, judging that the received sound sequence is a specific frequency sound sequence, setting a mask layer on the top layer of all applications of the terminal, and intercepting all touch events of the terminal through the mask layer; if the terminal continues to receive the specific frequency sound sequence with the amplitude higher than the threshold value, the mask layer is maintained as it is, namely the setting of the mask layer is kept.
Preferably, the specific frequency sound sequence comprises at least three frequency bands, and all of the frequency bands are low frequencies. The low frequency setting can make the human ear unable to hear, can not bring noise interference for the user. And the setting of at least three frequency bands can avoid the confusion of the sound sequence and other noises, thereby ensuring the correctness of the terminal according to the execution.
For example, a code table is preset, and sine waves of 700Hz are corresponding to characters 'a'; the sine wave of 800HZ corresponds to the number 'b'; the sine wave of 900HZ corresponds to the number 'c', and so on. Then the string "abc" corresponds to the frequency string 700, 800, 900. The corresponding relation between the frequency and the character is recorded by a code table. This frequency string is then changed to 3 syllables of sine wave audio. If each syllable is specified to last 100ms, the frequency string 700, 800, 900 corresponds to a 300 ms segment of audio. The terminal speaker plays audio segments, a receiving party (terminal microphone) records received sound, whether the amplitude of the received sound is higher than a threshold value or not is judged, if yes, the received sound is analyzed, three sections of sine wave frequencies of 700HZ, 800HZ and 900HZ are identified, then a code table is searched, and the decoded character string is 'abc'. If the string matches the predetermined unlock string, the mask layer is opened/maintained on the top layer of all applications of the terminal.
Furthermore, when the user has a requirement for controlling the terminal application, the user cannot watch the terminal screen through eyes and control the terminal screen with the head-mounted device. The embodiment provides a function of controlling the terminal in the dark, so that a user can control the terminal even in the dark without detaching the head-mounted device, and the function of interacting the terminal and the head-mounted device is realized.
Specifically, when the amplitude of the specific frequency sound sequence received by the terminal microphone is lower than a threshold value, the mask layer is reduced to a specified size. In this embodiment, if the average amplitude is below the predetermined threshold, it indicates that the microphone or speaker is manually pressed with a finger, thereby triggering an unlock event.
The specific unlocking method is to reduce the transparent mask layer to a specified size, such as to reduce the size of one pixel. Therefore, the thread of the transparent mask layer can be prevented from being recycled by the system, the quick start again is facilitated, and the state of completely covering the screen is recovered, namely the screen is locked again.
In this embodiment, as long as the terminal microphone cannot receive or the amplitude of the received sound sequence with the specific frequency is lower than the threshold, the mask layer is kept to be reduced to a specified size (at this time, the thread of the transparent mask layer is not recycled by the system, but is in a "sleep" state, which can ensure the realization of "screen locking" again). After the mask layer is reduced, all touch instructions controlled by the user on the terminal application are not intercepted any more, but are transmitted to the upper layer application for analysis processing as usual.
That is, when the mask layer is "unlocked", the user can operate the application on the terminal as usual, and the application will receive the touch event and execute as usual.
And once the specific frequency sound sequence with the amplitude higher than the threshold value is received again, if the user releases the shielding of the microphone or the loudspeaker, the state that the transparent mask layer completely covers the screen is restored, namely, the state is restored from the unlocking state to the locking state.
The control modes of 'screen locking' and 'unlocking' of the mask layer are characterized by easy implementation and operation.
Particularly, as shown in fig. 2, the terminal projects a touch trajectory and a touch position corresponding to an operation after the user is "unlocked" into the head-mounted device in real time, so that the user can clearly identify the touch position of the user, thereby facilitating interaction.
Specifically, when in operation, the current touch position is located on the screen of the head-mounted device through a cross or a dot, and the horizontal and vertical positions are displayed in opposite colors on the frame, which can be embodied in a coordinate form; in addition, the track that the touch passes will also be displayed using the opposite color, and the current position of the finger touch will be displayed using the circle. Therefore, the user can conveniently and accurately touch. The display in the opposite color, namely the color opposite to the original pixel display of the current screen, can avoid the same color from being unclear.
Example two
This embodiment provides a specific application scenario corresponding to the first embodiment:
the user connects with the mobile phone through the head-mounted device (similar to google glasses, but no operating system is arranged in the glasses, and all display contents are projected into the head-mounted device through the hdmi screen by the mobile phone), and the video played on the mobile phone is watched through the head-mounted device so as to obtain a better film watching effect. But in the process, the mobile phone needs to keep bright screen to ensure that the mobile phone and the head-mounted device can play normally. If the mobile phone screen is locked and put into a pocket, the screen is blacked, and the content on the head-mounted equipment is not displayed; if the screen is not locked and the screen is put into a pocket, the mistaken touch is easy to generate. By using the method provided by the first embodiment, the transparent mask layer can be displayed on the screen of the mobile phone, so that the mobile phone can be put into a pocket or a bag to continue to keep video playing (namely, screen lighting), and error touch can be effectively prevented.
Firstly, a mobile phone loudspeaker is utilized to emit a sound sequence with specific frequency which can not be heard by human ears, such as a sine wave audio sequence consisting of 100hz, 200hz, 300hz, 200hz and 100 hz; when the terminal microphone receives the sound sequence with the specific frequency (100hz, 200hz, 300hz, 200hz, 100hz), filtering the amplitude average value of the sound sequence, judging whether the amplitude average value is greater than a threshold value, if so, analyzing, judging whether the analysis result is matched with a preset unlocking key, and if so, opening and keeping the setting of the transparent screen locking.
When a microphone or a loudspeaker is pressed by a finger, because a specific frequency sound sequence is shielded, the amplitude average value of the sound sequence is lower than a threshold value, the transparent mask layer automatically reduces the window to 1 pixel point, a touch event received by the terminal can automatically and directly transmit an upper application, and the upper application responds to the touch event just like no screen locking. Thereby enabling the terminal application to be operated in darkness (in a situation where the user's eyes cannot look straight).
When the user releases the shielding of the terminal microphone or the loudspeaker, the shielding transparent window body can be used for covering the whole screen again.
When the combined operation is used, a cross positioning line is drawn on the screen of the head-mounted device by using the central point of the touch position, the horizontal position and the vertical position are displayed in opposite colors of the frame, the track which is touched to pass is displayed in the opposite colors, and the current position of the finger touch is displayed by using the circle. Therefore, the user can clearly see the position touched by the user, and therefore, the user can operate and make the required gesture operation.
EXAMPLE III
This embodiment corresponds to the first embodiment or the second embodiment, and provides a computer-readable storage medium, on which a computer program is stored, where the computer program is capable of implementing the steps included in the audio-based terminal screen control method according to the first embodiment or the second embodiment when the computer program is executed by a processor. The detailed steps are not repeated here, and refer to the description of the first embodiment or the second embodiment in detail.
In summary, the terminal screen control method and the storage medium based on the audio frequency provided by the invention can maintain normal playing of the head-mounted device and effectively prevent mistaken touch; furthermore, the terminal can be conveniently and accurately controlled in the dark to interact with the app; furthermore, the electric quantity of the terminal can be saved.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent changes made by using the contents of the present specification and the drawings, or applied directly or indirectly to the related technical fields, are included in the scope of the present invention.
Claims (10)
1. A terminal screen control method based on audio is characterized by comprising the following steps:
when a terminal microphone receives a specific frequency sound sequence with amplitude higher than a threshold value, which is sent by a loudspeaker of the terminal microphone, a mask layer is arranged on the uppermost layer of all applications of the terminal;
intercepting all touch events of the terminal through the mask layer;
when the amplitude of the specific frequency sound sequence received by the terminal microphone is lower than a threshold value, the mask layer is reduced to a specified size.
2. The audio-based terminal screen control method of claim 1, further comprising:
and adjusting the brightness of the terminal to be the lowest.
3. The method as claimed in claim 1, wherein when the microphone of the terminal receives a specific frequency sound sequence with amplitude higher than a threshold value from the speaker, the mask layer is set on the top of all applications of the terminal, specifically:
controlling a terminal loudspeaker to continuously emit a sound sequence with the amplitude higher than a threshold value;
the terminal microphone receives the sound sequence and judges whether the amplitude of the sound sequence is higher than a threshold value, and if so, the terminal microphone analyzes the sound sequence to obtain a corresponding frequency band sequence;
searching a preset code table, if the character string corresponding to the frequency band sequence is matched with a preset unlocking character string, judging that the sound sequence is a sound sequence with a specific frequency, and setting a mask layer on the uppermost layer of all applications of the terminal;
intercepting all touch events of the terminal through the mask layer;
if the terminal continuously receives the specific frequency sound sequence with the amplitude higher than the threshold value, the mask layer is maintained to be the same.
4. The audio-based terminal screen control method of claim 3, wherein the specific frequency sound sequence includes at least three low frequency bands.
5. The audio-based terminal screen control method of claim 1, wherein the mask layer is reduced to a designated size, and thereafter, further comprising:
and displaying the touch track and the current touch position on the terminal interface in the head-mounted equipment.
6. The audio-based terminal screen control method of claim 5, further comprising:
and displaying horizontal and vertical coordinates in opposite colors at the position of a frame corresponding to the terminal interface in the head-mounted equipment.
7. The audio-based terminal screen control method of claim 6, wherein the touch trajectory is displayed using a reverse color; identifying the current touch location using a dot or cross center point.
8. The audio-based terminal screen control method of claim 1, wherein the designated size is one pixel point.
9. The audio-based terminal screen control method of claim 1, wherein the mask layer is a transparent mask layer.
10. A computer-readable storage medium having stored thereon a computer program, characterized in that the program, when being executed by a processor, is capable of carrying out the steps included in an audio-based terminal screen control method according to any one of the preceding claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010012032.9A CN111243258B (en) | 2020-01-07 | 2020-01-07 | Terminal screen control method based on audio and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010012032.9A CN111243258B (en) | 2020-01-07 | 2020-01-07 | Terminal screen control method based on audio and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111243258A CN111243258A (en) | 2020-06-05 |
| CN111243258B true CN111243258B (en) | 2020-11-17 |
Family
ID=70864693
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010012032.9A Active CN111243258B (en) | 2020-01-07 | 2020-01-07 | Terminal screen control method based on audio and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111243258B (en) |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7593005B2 (en) * | 2005-12-13 | 2009-09-22 | Awr Consulting Inc. | Touch detection system |
| CN103197858B (en) * | 2012-01-04 | 2016-10-05 | 广州三星通信技术研究有限公司 | The method of the screen display direction of portable terminal and control portable terminal |
| CN103472994B (en) * | 2013-09-06 | 2017-02-08 | 网易乐得科技有限公司 | Operation control achieving method, device and system based on voice |
| CN103810017B (en) * | 2013-11-15 | 2016-05-11 | 深圳光启智能光子技术有限公司 | The method of sending and receiving of command information and device thereof |
| CN103793177A (en) * | 2014-02-28 | 2014-05-14 | 广州视源电子科技股份有限公司 | Interface processing method for touch screen device and touch screen device |
| CN106662915B (en) * | 2014-05-09 | 2020-09-29 | 索尼互动娱乐股份有限公司 | Scheme for embedding control signal into audio signal using pseudo white noise |
| CN106488034A (en) * | 2016-11-24 | 2017-03-08 | 努比亚技术有限公司 | A kind of method realizing unlocking and mobile terminal |
| CN107894830B (en) * | 2017-10-12 | 2019-07-26 | 深圳大学 | A kind of interaction input method based on acoustic perceptual, system and medium |
-
2020
- 2020-01-07 CN CN202010012032.9A patent/CN111243258B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111243258A (en) | 2020-06-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10542323B2 (en) | Real-time modifiable text captioning | |
| US9398247B2 (en) | Audio volume control device, control method and program | |
| CN109521935A (en) | It is a kind of to record screen, the reproducing method based on record screen, terminal | |
| US20130141551A1 (en) | Mobile terminal and control method thereof | |
| CN109451349A (en) | A kind of video broadcasting method, device and mobile terminal | |
| CN105704539A (en) | Video sharing device and video sharing method | |
| US8818003B2 (en) | Mobile terminal and control method thereof | |
| CN111010608B (en) | Video playing method and electronic equipment | |
| CN109361960A (en) | Barrage display methods, device, mobile terminal and readable storage medium storing program for executing | |
| CN109032481A (en) | A kind of display control method and mobile terminal | |
| CN111459447B (en) | Volume adjustment display method and electronic equipment | |
| CN109981904A (en) | A kind of method for controlling volume and terminal device | |
| CN111243258B (en) | Terminal screen control method based on audio and storage medium | |
| US20240186920A1 (en) | Method and apparatus for controlling linear motor, device, and readable storage medium | |
| CN110198421B (en) | Video processing method and related product | |
| WO2022121551A1 (en) | Multimedia data processing method and apparatus, and electronic device | |
| WO2020007010A1 (en) | Volume display method and apparatus, terminal device, and storage medium | |
| CN111176454B (en) | Terminal screen locking method combined with camera and storage medium | |
| CN108089830B (en) | Song information display methods, device and mobile terminal | |
| CN110225282A (en) | A kind of video record control method, equipment and computer readable storage medium | |
| CN108399057A (en) | message display method, terminal and computer readable storage medium | |
| CN112511779A (en) | Video data processing method and device, computer storage medium and electronic equipment | |
| CN111241510B (en) | Terminal screen control method based on fingerprint identification and storage medium | |
| CN110069184A (en) | Control method, wearable device and the computer readable storage medium of mobile terminal | |
| CN111240566B (en) | Terminal screen control method based on Bluetooth and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |