CN113905110B - Display screen control method and device, computer equipment and storage medium - Google Patents

Display screen control method and device, computer equipment and storage medium Download PDF

Info

Publication number
CN113905110B
CN113905110B CN202010561945.6A CN202010561945A CN113905110B CN 113905110 B CN113905110 B CN 113905110B CN 202010561945 A CN202010561945 A CN 202010561945A CN 113905110 B CN113905110 B CN 113905110B
Authority
CN
China
Prior art keywords
display screen
terminal
sound signal
control instruction
amplitude
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010561945.6A
Other languages
Chinese (zh)
Other versions
CN113905110A (en
Inventor
冯东杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202010561945.6A priority Critical patent/CN113905110B/en
Priority to PCT/CN2021/090003 priority patent/WO2021253992A1/en
Publication of CN113905110A publication Critical patent/CN113905110A/en
Application granted granted Critical
Publication of CN113905110B publication Critical patent/CN113905110B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026—Details of the structure or mounting of specific components
    • H04M1/0266—Details of the structure or mounting of specific components for a display module assembly
    • H04M1/0268—Details of the structure or mounting of specific components for a display module assembly including a flexible display panel
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C23/00—Non-electrical signal transmission systems, e.g. optical systems
    • G08C23/02—Non-electrical signal transmission systems, e.g. optical systems using infrasonic, sonic or ultrasonic waves
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
    • G09F9/30—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72433—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for voice messaging, e.g. dictaphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions

Abstract

The application discloses a display screen control method and device, computer equipment and a storage medium, and belongs to the technical field of terminal control. The method is used in a terminal, the terminal comprises a telescopic display screen, and the method comprises the following steps: receiving an input first sound signal; responding to the first sound signal meeting the specified condition, and acquiring a display screen control instruction, wherein the display screen control instruction is used for indicating to control the extension or contraction of the display screen; and controlling the expansion or contraction of the display screen according to the display screen control instruction. This application carries out the condition judgement through the terminal to the first sound signal of input, when first sound signal satisfies the appointed condition, acquires display screen control command to the display screen at automatic control terminal extends and contracts, has realized that the user passes through input sound signal, alright in order to accomplish the flexible control to the terminal display screen, flexibility when having improved the scalable display screen of terminal show.

Description

Display screen control method and device, computer equipment and storage medium
Technical Field
The present application relates to the field of terminal control technologies, and in particular, to a display screen control method and apparatus, a computer device, and a storage medium.
Background
With the rapid development of science and technology, various terminals have appeared in daily life of people, wherein a series of terminals with a retractable display screen (also called flexible display screen) such as a curled screen and a folded screen are popular with users.
Among these terminals with a retractable display, the user can control the flexible display of the terminal to be extended or retracted manually or by key operation (including virtual key and physical key). For example, for an example that a part of the display screen is displayed outside the terminal and a part of the display screen is rolled and contracted inside the terminal, the user can display the part of the display screen rolled and contracted inside the terminal by means of manual dragging, so that the display screen of the terminal becomes larger and is combined with the part of the display screen displayed outside the terminal to display an application interface in the terminal.
When the telescopic display screen which can be retracted in the terminal is displayed, manual operation of a user or control through a key is needed, so that the flexibility of the terminal in displaying the telescopic display screen is low.
Disclosure of Invention
The embodiment of the application provides a display screen control method and device, computer equipment and a storage medium, which can improve the flexibility of a terminal in displaying a telescopic display screen. The technical scheme is as follows:
in one aspect, an embodiment of the present application provides a display screen control method, where the method is performed by a terminal, where the terminal includes a scalable display screen, and the method includes:
receiving an input first sound signal;
responding to the first sound signal meeting a specified condition, and acquiring a display screen control instruction, wherein the display screen control instruction is used for instructing to control the extension or contraction of the display screen;
and controlling the extension or contraction of the display screen according to the display screen control instruction.
On the other hand, the embodiment of the present application provides a display screen control device, the device is used in a terminal, the terminal includes a telescopic display screen, the device includes:
the sound signal receiving module is used for receiving an input first sound signal;
the control instruction acquisition module is used for responding to the first sound signal and meeting a specified condition and acquiring a display screen control instruction, and the display screen control instruction is used for indicating to control the extension or contraction of the display screen;
and the display screen control module is used for controlling the extension or contraction of the display screen according to the display screen control instruction.
In another aspect, an embodiment of the present application provides a computer device, which includes a processor and a memory, where the memory stores at least one instruction, at least one program, a code set, or a set of instructions, and the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by the processor to implement the display screen control method described above.
In another aspect, an embodiment of the present application provides a computer-readable storage medium, where at least one instruction, at least one program, a code set, or a set of instructions is stored in the storage medium, and the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by a processor to implement the display screen control method as described above.
In another aspect, an embodiment of the present application provides a computer program product, which includes computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and executes the computer instructions to enable the computer device to execute the display screen control method provided by the above aspect.
The beneficial effects brought by the technical scheme provided by the embodiment of the application at least comprise:
the terminal receives an input first sound signal; responding to the first sound signal meeting the specified condition, and acquiring a display screen control instruction, wherein the display screen control instruction is used for indicating to control the extension or contraction of the display screen; and controlling the expansion or contraction of the display screen according to the display screen control instruction. This application carries out the condition judgement through the terminal to the first sound signal of input, when first sound signal satisfies the appointed condition, acquires display screen control command to the display screen at automatic control terminal extends and contracts, has realized that the user passes through input sound signal, alright in order to accomplish the flexible control to the terminal display screen, flexibility when having improved the scalable display screen of terminal show.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 to 5 are schematic structural diagrams of a terminal according to an exemplary embodiment of the present application;
FIG. 6 is a flowchart illustrating a method for controlling a display screen according to an exemplary embodiment of the present application;
FIG. 7 is a flowchart illustrating a method for controlling a display screen according to an exemplary embodiment of the present application;
FIG. 8 is a flowchart of a method for controlling a display screen according to an exemplary embodiment of the present application;
FIG. 9 is a flowchart of a method for controlling a display screen according to an exemplary embodiment of the present application;
FIG. 10 is a schematic illustration of a user inputting speech into a cell phone in accordance with an exemplary embodiment of the present application;
fig. 11 is a block diagram of a display screen control device according to an exemplary embodiment of the present application;
fig. 12 is a schematic structural diagram of a computer device according to an exemplary embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The scheme provided by the application can be used in a real scene of controlling the expansion or contraction of the flexible display screen of the terminal when people use the terminal with the flexible display screen in daily life, and for the convenience of understanding, a few terms related to the embodiment of the application and the structure of the terminal are firstly and simply introduced below.
And (3) voice awakening: the user wakes up the terminal by speaking the wake-up word, so that the terminal starts the voice conversation function and enters a state of waiting for the voice command or directly executes the preset voice command.
Please refer to fig. 1 to fig. 5, which are schematic diagrams illustrating a terminal structure according to an exemplary embodiment of the present application. The terminal 100 in the embodiment of the present application includes a housing assembly 10, a flexible display 30, a driver 50, and a driving mechanism 70. The shell assembly 10 is a hollow structure; the components of the driver 50, the driving mechanism 70, and the camera 60 may be disposed in the housing assembly 10. It is understood that the terminal 100 in the embodiment of the present application includes, but is not limited to, a mobile terminal such as a mobile phone, a tablet, or other portable electronic devices, and herein, the terminal 100 is taken as a mobile phone for example.
In the practice of the present application, the housing assembly 10 includes a first housing 12 and a second housing 14, the first housing 12 and the second housing 14 being capable of relative movement. In one possible embodiment, the first housing 12 and the second housing 14 are slidably connected, that is, the second housing 14 is slidable relative to the first housing 12.
Optionally, referring to fig. 4 and fig. 5, the first casing 12 and the second casing 14 together form an accommodating space 16. The accommodating space 16 can be used for accommodating components such as the driver 50, the camera 60, the driving mechanism 70 and the like. The housing assembly 10 may further include a rear cover 18, and the rear cover 18 and the first and second housings 12 and 14 together form an accommodating space 16.
Optionally, the driving element 50 is disposed on the second housing 14, one end of the flexible display 30 is disposed on the first housing 12, the flexible display 30 bypasses the driving element 50, and the other end of the flexible display is disposed in the accommodating space 16, so that a part of the flexible display 30 is hidden in the accommodating space 16, and a part of the flexible display 30 hidden in the accommodating space 16 may not be lighted. The first housing 12 and the second housing 14 are relatively far away from each other, and the driving member 50 can drive the flexible display 30 to unfold, so that more flexible display 30 is exposed out of the accommodating space 16. The flexible display 30 exposed to the outside of the accommodating space 16 is illuminated so that a display area presented by the terminal 100 becomes large.
Optionally, the driving member 50 is a rotating shaft structure with teeth 52 on the outside, the flexible display screen 30 is linked with the driving member 50 by means of meshing, and when the first casing 12 and the second casing 14 are relatively far away from each other, the driving member 50 drives a part of the flexible display screen 30 meshed with the driving member 50 to move and unfold.
It is understood that the driver 50 can also be a circular shaft without the belt 52, and when the first casing 12 and the second casing 14 are relatively far away from each other, the driver 50 can stretch the portion of the flexible display 30 wound on the driver 50, so that more flexible display is exposed out of the accommodating space 16 and is in a flat state. Optionally, the driving member 50 is rotatably disposed on the second housing 14, and the driving member 50 can rotate along with the movement of the flexible display 30 when the flexible display 30 is gradually opened. In other embodiments, the driver 50 may be fixed to the second housing 14, and the driver 50 may have a smooth surface. When the flexible display 30 is spread, the driver 50 is slidably contacted with the flexible display 30 through its smooth surface.
When the first casing 12 and the second casing 14 are relatively close to each other, the flexible display screen can be retracted by the driving member 50. Alternatively, the terminal 100 further includes a reset member (not shown), one end of the flexible display screen, which is accommodated in the accommodating space 16, is linked with the reset member, and when the first shell 12 and the second shell 14 are relatively close to each other, the reset member drives the flexible display screen 30 to reset, so that a part of the flexible display screen is retracted into the accommodating space 16.
In the embodiment of the present application, the driving mechanism 70 may be disposed in the accommodating space 16, the driving mechanism 70 may be linked with the second housing 14, and the driving mechanism 70 is configured to drive the second housing 14 to move away from the first housing 12, so as to drive the flexible display panel assembly 30 to extend. It will be appreciated that the drive mechanism 70 may be omitted and the user may directly move the first and second housings relative to one another, manually, etc.
Optionally, the terminal 100 may be a terminal having a voice wake-up function, for example, the terminal may be a mobile phone, a tablet computer, an e-book reader, smart glasses, a smart watch, an MP3 player (Moving Picture Experts Group Audio Layer III, motion Picture Experts Group Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion Picture Experts Group Audio Layer 4), a notebook computer, a laptop computer, or the like.
Optionally, the user may start the voice wake-up function in the terminal 120 in advance, and input a corresponding wake-up word to the terminal, so that the terminal executes a voice instruction corresponding to the wake-up word. For example, taking the wake-up word "hello, hello" as an example, when the user speaks to the microphone of the terminal: when the voice is "hello, hello", the terminal can obtain the awakening voice and awaken the terminal.
For the terminal shown in fig. 1 to 5, when the flexible display screen in the terminal needs to be expanded or contracted, the flexible display screen in the terminal often needs to be manually dragged by a user, or the flexible display screen in the terminal is operated by the user to have a control for controlling the expansion or contraction of the flexible display screen, so that the flexible display screen in the terminal can be expanded from fig. 4 to fig. 5 or contracted from fig. 5 to fig. 4. Under the two implementation modes, not only the manual operation of a user is needed, but also the corresponding hardware device needs to be arranged in the terminal, so that the complexity of the terminal hardware design is increased, and the flexibility of the terminal for displaying the telescopic display screen is reduced.
In order to improve flexibility of the terminal when displaying the retractable display screen and extend a manner of controlling the retractable display screen in the terminal, the present application provides a solution, please refer to fig. 6, which shows a flowchart of a method for controlling a display screen according to an exemplary embodiment of the present application. The method can be applied to the terminal having the retractable display screen shown in fig. 1 to 5. As shown in fig. 6, the display screen control method may include the following steps:
step 601, receiving an input first sound signal.
Optionally, the user may input the first sound signal through a microphone of the terminal, and the terminal collects the first sound signal input by the user through its own microphone. Alternatively, the terminal may collect an ambient sound signal of its own surrounding environment through the microphone, and the ambient sound signal may also be the first sound signal.
And step 602, responding to the first sound signal meeting the specified condition, and acquiring a display screen control instruction, wherein the display screen control instruction is used for instructing to control the extension or the contraction of the display screen.
Optionally, the terminal may determine whether the first sound signal satisfies a specified condition according to the received first sound signal, and obtain the display screen control instruction when the first sound signal satisfies the specified condition. Wherein the specified condition may be preset in the terminal.
Alternatively, the specified condition may refer to a condition to be satisfied by a first attribute of the first sound signal, where the first attribute is any one or more of a sound amplitude attribute, a sound tone attribute, and a text content attribute of the first sound signal.
Step 603, controlling the expansion or contraction of the display screen according to the display screen control instruction.
And the terminal controls the expansion or contraction of the retractable display screen according to the acquired display screen control instruction.
In summary, the terminal receives the input first sound signal; responding to the first sound signal meeting the specified condition, and acquiring a display screen control instruction, wherein the display screen control instruction is used for indicating to control the extension or contraction of the display screen; and controlling the expansion or contraction of the display screen according to the display screen control instruction. This application carries out the condition judgement through the terminal to the first sound signal of input, when first sound signal satisfies the appointed condition, acquires display screen control command to the display screen at automatic control terminal extends and contracts, has realized that the user passes through input sound signal, alright in order to accomplish the flexible control to the terminal display screen, flexibility when having improved the scalable display screen of terminal show.
In a possible implementation manner, the scheme shown in fig. 6 is described as an example, in which the specified condition indicates a condition to be satisfied by a first attribute of the first sound signal, and the first attribute is at least one of a sound amplitude attribute of the first sound signal and a text content attribute of the first sound signal. That is, the specified condition includes at least one of a condition to be satisfied by the voice recognition result of the first sound signal and a condition to be satisfied by the volume amplitude of the first sound signal, thereby determining whether to acquire the display control instruction and controlling the retractable display of the terminal to be extended or retracted.
Referring to fig. 7, a flowchart of a method of controlling a display screen according to an exemplary embodiment of the present application is shown. The method may be executed by the terminal shown in fig. 1 to 5, and as shown in fig. 7, the display screen control method may include the following steps:
in step 701, in response to the display screen being in the off state, it is determined that the specified condition includes a condition to be satisfied by a voice recognition result of the first sound signal.
Optionally, when the terminal executes the embodiment shown in this application, it may be determined whether the scalable display screen of the terminal is in a turned-off state, that is, the display screen is in a turned-off state. When the terminal determines that its own display screen is in the extinguished state, it may be determined that the specified condition is a condition to be satisfied by the voice recognition result of the first voice signal. That is, the condition to be satisfied by the text content included in the speech recognition result obtained after the speech recognition of the first sound signal is performed.
Step 702, receiving an input second sound signal.
Optionally, the user may start the voice wake-up function in the terminal in advance, and the terminal may wake up the terminal after receiving the wake-up voice when the terminal starts the voice wake-up function, so as to execute other steps of the present application. In a possible implementation manner, a user may set the voice wake-up function to be turned on or turned off in a setting interface of the terminal, and in this step, the user turns on the voice wake-up function of the terminal.
Optionally, when the terminal has the voice wake-up function, the user may input a sound signal to the terminal by speaking into a microphone of the terminal, and accordingly, the microphone of the terminal may collect the sound signal input by the user. In this application, before the terminal is woken up, the voice input by the user may be collectively referred to as a second sound signal.
And step 703, in response to the second sound signal containing the wake-up word, controlling the terminal to enter a voice wake-up state.
In a possible implementation manner, a target detection algorithm may be preset in the terminal, and the target detection algorithm may extract and detect a voiceprint feature of a voice input by a user. After obtaining the voiceprint features of the second sound signal input by the user, the terminal compares the voiceprint features of the second sound signal with the voiceprint features of the preset wake-up word, and if the two voiceprint features are the same, the terminal determines that the voiceprint features of the second sound signal match the voiceprint features of the preset wake-up word, then the terminal may determine that the second sound signal includes the wake-up word, and perform step 704. Otherwise, the terminal continues to receive the second sound signal input by the user.
Optionally, the preset wakeup word may be pre-entered in the terminal by the user. For example, when the user starts the voice wake-up function, the terminal may prompt the user to input a preset wake-up word through voice, and record a voiceprint feature corresponding to the preset wake-up word input by the user through voice as the voiceprint feature of the preset wake-up word. For example, taking the preset wake-up word as "hello, hello" as an example, when the user speaks to the microphone of the terminal: when the voice is 'hello, hello', the terminal can obtain the awakening voice, the awakening voice is identified by the terminal to obtain the awakening words contained in the awakening voice, the voiceprint characteristics of the awakening voice are further obtained, and the terminal identifies which user speaks according to the voiceprint characteristics of the voice information, so that whether the corresponding function is started or not is determined.
Optionally, the number of voiceprint features of the preset wake-up word may be multiple. For example, the terminal stores the voiceprint feature of the preset wake-up word of the user a and also stores the voiceprint feature of the preset wake-up word of the user B, and the voiceprint feature of the preset wake-up word may include the voiceprint feature of the user a and the voiceprint feature of the user B. Optionally, after the terminal obtains the second sound signal input by the user, the terminal may compare the voiceprint feature of the second sound signal with the voiceprint features of the preset wake-up words stored in the terminal. When the voiceprint feature of the second sound signal is the same as the voiceprint feature of any one of the preset awakening words, the voiceprint feature of the second sound signal can be considered to be matched with the voiceprint feature of the preset awakening word, the second sound signal is determined to contain the awakening word, and the terminal can be controlled to enter a voice awakening state after the second sound signal is determined to contain the awakening word.
That is, in this step, the terminal matches the voiceprint features of the obtained second sound signal with the voiceprint features of the preset wakeup word, and when the voiceprint feature of the second voice is any one of the voiceprint features belonging to the preset wakeup word, the terminal can respond to the corresponding voice, activate the voice conversation function, and activate the voice recognition module in the terminal. The voice recognition module can be used for recognizing the voice input by the user to obtain characters corresponding to the voice, namely voice content. For example, the voiceprint features of the preset wake-up word include the voiceprint features corresponding to the 'hello, hello' voice of the user a and the voiceprint features corresponding to the 'hello, hello' voice of the user B, the user a inputs the second sound signal 'hello, hello' to the terminal through the steps, the terminal can process the second sound signal through the target detection model to obtain the voiceprint features corresponding to the 'hello, hello' voice of the user a, the voiceprint features are matched with the voiceprint features of the preset wake-up word stored in the terminal, the voiceprint features of the second sound signal obtained at this time are the voiceprint features corresponding to the user a in the voiceprint features of the preset wake-up word, and therefore the terminal is woken up.
Step 704, receiving a first sound signal input when the terminal is in a voice wake-up state.
Optionally, after waking up the terminal, the terminal in the voice wake-up state may continue to receive the first sound signal input by the user. In the present application, the sound signal received by the terminal after being awakened and input by the user is collectively referred to as a first sound signal. That is, the user may input the first sound signal through the microphone of the terminal, and the terminal collects the sound signal input by the user through its own microphone. For example, the input sound signal may be "open display screen", "shrink display screen", or the like.
Step 705, in response to the specified condition including a condition to be satisfied by the speech recognition result of the first sound signal, performing speech recognition on the first sound signal to obtain a speech recognition result.
The terminal is awakened, the terminal activates a voice recognition function, and voice recognition can be performed on a first voice signal input by a user to obtain first voice content corresponding to the first voice signal. For example, if the voice input by the user is "please open the first application", then the terminal recognizes, through the voice recognition function, that the first voice content of the first sound signal input by the user this time is "please open the first application". If the voice input by the user is 'unfolded display screen', the terminal recognizes that the first voice content of the first sound signal input by the user at this time is 'unfolded display screen' through the voice recognition function.
Step 706, in response to the matching of the speech recognition result and the first keyword, determining that the first sound signal satisfies a specified condition.
The first keyword is any keyword in a target keyword set, each keyword in the target keyword set corresponds to a control instruction, and the control instruction is an instruction capable of controlling the expansion and contraction of a display screen of the terminal. Optionally, the target keyword set may be pre-entered in the terminal by a developer. For example, a set of keywords such as "expand display screen", "contract display screen", "open to half", "close to half", and the like are stored in the terminal, the keyword of "expand display screen" corresponds to a control instruction for expanding the display screen of the control terminal, the keyword of "contract display screen" corresponds to a control instruction for contracting the display screen of the control terminal, the keyword of "open to half" corresponds to a control instruction for expanding the display screen of the control terminal to half of the total length of the display screen, and the keyword of "close to half" corresponds to a control instruction for contracting the display screen of the control terminal to half of the total length of the display screen.
Optionally, after the terminal identifies the first sound signal, when the first speech content in the obtained speech identification result matches the first keyword, the terminal may determine that the first sound signal satisfies the specified condition. For example, after a first voice signal is input by a user, the terminal recognizes the first voice signal, the first voice content in the obtained voice recognition result is an expanded display screen, it is determined that the first voice content is the same as the keyword of the expanded display screen in the target keyword set, and the terminal knows that the voice recognition result is matched with the first keyword, so that it is determined that the first voice signal meets the specified condition.
Step 707, in response to the first sound signal satisfying a specified condition, acquiring a display control instruction corresponding to the first keyword.
Optionally, when it is determined that the first sound signal satisfies the specified condition, the terminal may acquire a display control instruction corresponding to the first keyword. For example, if the first voice content obtained in step 706 is "display screen expansion" and is the same as one keyword in the target keyword set, the terminal may consider that the obtained first voice content matches the first keyword. In this step, the terminal can acquire a control instruction for controlling the expansion and contraction of the display screen of the terminal corresponding to the first keyword. If the first voice content is 'display screen expansion', the terminal can acquire a control instruction for controlling the display screen expansion of the terminal. If the first voice content is 'shrink display screen', the terminal can acquire a control instruction for controlling the shrink of the display screen of the terminal.
In step 708, in response to the terminal being in the designated state, it is determined that the designated condition includes a condition to be satisfied by the volume amplitude of the first sound signal.
Wherein the specified state comprises at least one of: the display screen is in a lighting state; and the terminal is in a target scene. Optionally, the target scene is any one of a voice call scene, a recording scene, a video call scene, a voice message sending scene, and a video playing scene.
In a possible implementation manner, when the terminal determines whether the self retractable display screen is in the off state, the terminal finds that the display screen is in the on state. The terminal can also judge whether the current use scene of the terminal is the target scene, and if the display screen of the terminal is in the off state and the current use scene of the terminal is the target scene, the terminal is in the designated state at the moment. Optionally, the retractable display screen is in a lighting state, which means that the retractable display screen is not in a completely extinguished state, and when part of the display screens in the retractable display screen are in the lighting state, it can also be regarded that the retractable display screen is in the lighting state.
Alternatively, the terminal may determine the usage scenario in which the terminal itself is located in the following manner. For example, the terminal obtains the current usage scenario of the terminal according to the program name of the running application program.
Optionally, when the display screen of the terminal is in a lighting state, the terminal may further obtain a current usage scene of the terminal according to a program name of an application program that is running. In a possible implementation manner, the terminal may store a correspondence table between application names and usage scenarios. Please refer to table 1, which shows a table of correspondence between application names and usage scenarios provided in an exemplary embodiment of the present application.
Application name Usage scenarios
Application program one Usage scenario one
Application program two Usage scenario two
Application program three Usage scenario three
Application program one and application program two Usage scenario one
Application program one and application program three Usage scenario three
…… ……
TABLE 1
As shown in table 1, the usage scenario of the terminal may correspond to the running application one to one, or may be one to many. For example, if the program name of the application program that the terminal acquires that the terminal is running is application program one, the terminal may acquire that the current usage scenario is usage scenario one through table 1.
In a possible implementation manner, the third application in table 1 is a phone application in the terminal, and when the phone application runs, the current usage scenario acquired by the terminal is a voice call scenario. The third application in table 1 is a recording application in the terminal, and when the recording application runs, the current usage scene acquired by the terminal is a recording scene. The third application program in table 1 is a video playing application program in the terminal, and when the video playing application program runs, the current usage scene acquired by the terminal is a video scene.
After acquiring the current use scene of the terminal, the terminal can continuously judge whether the use scene of the terminal is a target scene, and if the use scene is the target scene, the specified condition is determined to include a condition to be met by the volume amplitude of the first sound signal in the step.
Step 709, in response to the specified condition including a condition to be satisfied by the volume amplitude of the first sound signal, obtaining the volume amplitude of the first sound signal.
Optionally, after determining that the specified condition includes a condition to be satisfied by the volume amplitude of the first sound signal, the terminal may further obtain the volume amplitude of the first sound signal. Optionally, the volume amplitude of the first sound signal may be obtained in advance through a microphone when the first sound signal input by the user is received, and in this step, the volume amplitude of the first sound signal that has been obtained is directly obtained. Alternatively, the volume amplitude may also be regarded as the sound intensity.
Alternatively, the terminal may also calculate an average value of the volume amplitudes of the first sound signal, and use the average value of the volume amplitudes of the first sound signal as the volume amplitude of the first sound signal. Alternatively, the time taken in the calculation of the average value may be set in advance in the terminal by the user. For example, if the time taken for calculating the average value of the volume amplitudes of the first sound signal is set to be the duration of the first sound signal by the user, the terminal may obtain the average value of the volume amplitudes of the first sound signal by dividing the volume amplitudes of the first sound signal by the duration of the first sound signal. Or, if the time taken for calculating the average value of the volume amplitudes of the first sound signal is set to be 2 seconds, the terminal may divide the acquired volume amplitudes of the first sound signal according to 2 seconds to obtain a plurality of volume amplitudes of the first sound signal, and divide the volume amplitudes by 2 seconds to obtain the average value of each of the volume amplitudes of the first sound signal.
Step 710, in response to the magnitude relation between the volume magnitude and the magnitude threshold satisfying a specified magnitude relation, determining that the first sound signal satisfies a specified condition.
Optionally, the terminal may further obtain a magnitude relation between the volume amplitude of the first sound signal and an amplitude threshold, and when the magnitude relation between the volume amplitude of the first sound signal and the amplitude threshold satisfies a specified magnitude relation, the terminal determines that the first sound signal satisfies a specified condition.
In one possible implementation, the magnitude threshold includes a first magnitude threshold and a second magnitude threshold, wherein the specified magnitude relationship is that the volume magnitude is less than the first magnitude threshold. That is, the terminal determines that the first sound signal satisfies the specified condition in response to the volume magnitude being less than the first magnitude threshold.
Optionally, the terminal may directly compare the volume amplitude of the acquired first sound signal with a first amplitude threshold to obtain a magnitude relationship between the two; in response to one possible implementation manner, the specified magnitude relationship is that the volume magnitude is smaller than a first magnitude threshold. The terminal may calculate an average value of the volume amplitudes of the first sound signal; it is detected whether an average of the volume amplitudes of the first sound signal is smaller than a first amplitude threshold. When the average value of the volume amplitudes of the first sound signal is smaller than a first amplitude threshold value, it is determined that the magnitude relationship between the two satisfies a specified magnitude relationship. Optionally, the specified size relationship and the first amplitude threshold may be preset in the terminal by a developer or an operation and maintenance person.
For example, the first amplitude threshold is 20 db, if the average value of the volume amplitudes of the first sound signal acquired by the terminal is 15 db, it is indicated that the magnitude relation between the volume amplitude and the first amplitude threshold satisfies the specified magnitude relation, and correspondingly, the terminal determines that the first sound signal satisfies the specified condition. If the average value of the volume amplitudes of the first sound signal acquired by the terminal is 25 decibels, it is indicated that the magnitude relation between the volume amplitude and the first amplitude threshold value does not meet the specified magnitude relation, and correspondingly, the terminal determines that the first sound signal does not meet the specified condition.
In one possible implementation, the specified magnitude relationship is that the volume magnitude is greater than a second magnitude threshold. That is, the terminal determines that the first sound signal satisfies the specified condition in response to the volume magnitude being greater than the second magnitude threshold.
Optionally, the terminal may directly compare the volume amplitude of the acquired first sound signal with a second amplitude threshold to obtain a magnitude relationship between the two; in response to one possible implementation manner, the specified magnitude relationship is that the volume magnitude is greater than the second magnitude threshold. The terminal may calculate an average value of the volume amplitudes of the first sound signal; it is detected whether an average value of the volume amplitudes of the first sound signal is larger than a second amplitude threshold. And when the average value of the volume amplitudes of the first sound signal is larger than a second amplitude threshold value, determining that the size relation between the two satisfies the specified size relation. Optionally, the second amplitude threshold may also be preset in the terminal by a developer or an operation and maintenance person.
For example, the first amplitude threshold is 20 db, if the average value of the volume amplitudes of the first sound signal acquired by the terminal is 25 db, it is indicated that the magnitude relationship between the volume amplitude and the first amplitude threshold satisfies the specified magnitude relationship, and correspondingly, the terminal determines that the first sound signal satisfies the specified condition. If the average value of the volume amplitudes of the first sound signal acquired by the terminal is 15 decibels, it is indicated that the magnitude relation between the volume amplitude and the first amplitude threshold value does not meet the specified magnitude relation, and correspondingly, the terminal determines that the first sound signal does not meet the specified condition. Optionally, the first amplitude threshold and the second amplitude threshold may be the same or different in magnitude.
Step 711, in response to the volume amplitude being smaller than the first amplitude threshold, a first control instruction is obtained, where the first control instruction is used to instruct to control the stretching of the display screen.
That is, if the specified magnitude relationship is that the volume amplitude is smaller than the first amplitude threshold, when the terminal determines that the volume amplitude is smaller than the first amplitude threshold, the terminal may obtain the first control instruction, so as to control the extension of the display screen.
Optionally, if the above specified magnitude relationship is that the volume magnitude is greater than the second magnitude threshold, this step may be replaced by: and responding to the volume amplitude value larger than a second amplitude threshold value, and acquiring a second control instruction, wherein the second control instruction is used for indicating to control the contraction of the display screen. That is, when the terminal determines that the volume amplitude is greater than the second amplitude threshold, the terminal may obtain a second control instruction, so as to control the display screen to shrink.
In a possible implementation manner, if the terminal determines that the first sound signal does not satisfy the specified condition in step 710, the terminal may keep the size of the display screen unchanged without performing the subsequent steps. That is, in response to the first sound signal not satisfying the specified condition, the terminal may not perform the expansion and contraction process on the display screen, and the original expansion and contraction state is maintained.
And 712, controlling the expansion or contraction of the display screen according to the display screen control instruction.
And the terminal calls a driving chip interface function for controlling the extension and the contraction of the display screen according to the acquired display screen control instruction, so that the extension and the contraction of the display screen are controlled.
In a possible implementation manner, the display control instruction corresponding to the first keyword, acquired in step 707 above, is used to shrink the display, and then the terminal may control the shrinking of the display through the display control instruction. If the display control instruction corresponding to the first keyword obtained in step 707 is used to expand the display, the terminal may control the expansion of the display through the display control instruction. Accordingly, if the first control command is acquired in step 711, the terminal may control the expansion of the display screen according to the first control command. If the terminal acquires the second control command in step 711, which is replaced by the case described in the above step, the terminal may control the contraction of the display screen through the second control command.
In a possible implementation manner, the display screen control instruction is to unfold the display screen, and before the terminal controls the unfolding of the display screen, the terminal can also detect whether the display screen of the terminal is in a maximum unfolding state; and controlling the display screen of the terminal to stretch in response to the display screen of the terminal not being in the maximum unfolding state. That is, before the terminal unfolds the display screen, the terminal may detect whether the display screen has been unfolded to the maximum, if the display screen has been unfolded to the maximum, the terminal may keep the size of the display screen unchanged, and if the display screen has not been unfolded to the maximum, the terminal may control the display screen to unfold.
Correspondingly, if the display screen control instruction is to shrink the display screen, the terminal can also detect whether the display screen of the terminal is in the maximum shrinkage state before controlling the expansion of the display screen; and controlling the display screen of the terminal to be expanded in response to the display screen of the terminal not being in the maximum contraction state. That is, the terminal may detect whether the display has shrunk to the maximum before the terminal shrinks the display, and if so, the terminal may keep the size of the display unchanged, and if not, the terminal may control the display to shrink.
In one possible implementation, the display control instruction corresponding to the first keyword acquired in step 707 also has a corresponding target state in the terminal. The terminal acquires a target state corresponding to the display screen control instruction according to the display screen control instruction; the terminal can detect whether the display screen of the terminal is in a target state or not, responds to the fact that the display screen of the terminal is not in the target state, and controls the display screen of the terminal to extend or contract according to the display screen control instruction, so that the display screen of the terminal extends or contracts to the target state. Optionally, the terminal may store a corresponding relationship between the target state and the display screen control instruction in advance. Please refer to table 2, which shows a corresponding relationship table between a display screen control command and a target state according to an exemplary embodiment of the present application.
Display screen control instruction Target state
Control instruction one Target State one
Control instruction two Target state two
Control instruction three Goal State three
…… ……
TABLE 2
As shown in Table 2, different display control commands may correspond to their own target states. Alternatively, the target state may indicate the length of the terminal display in the telescopic or telescopic direction. For example, when the display screen of the terminal is fully unfolded, the length in the unfolding direction is 20 cm, and the control instruction is an instruction corresponding to the fully unfolded display screen of the terminal, so that a target state corresponding to the control instruction may be a state in which the length of the display screen is 20 cm. Or when the display screen of the terminal is unfolded to a half, the length in the unfolding direction is 15 cm, and the control instruction II corresponds to an instruction for unfolding the display screen of the terminal to a half, so that the target state I corresponding to the control instruction II can be a state that the length of the display screen is 15 cm. Correspondingly, the terminal can judge whether the display screen of the terminal is in a corresponding state at the moment, if so, the terminal can not process the display screen, and if not, the terminal can also control the display screen of the terminal to extend or contract according to the display screen control instruction.
In summary, the terminal receives the input first sound signal; responding to the first sound signal meeting the specified condition, and acquiring a display screen control instruction, wherein the display screen control instruction is used for indicating to control the extension or contraction of the display screen; and controlling the expansion or contraction of the display screen according to the display screen control instruction. This application carries out the condition judgement through the terminal to the first sound signal of input, when first sound signal satisfies the appointed condition, acquires display screen control command to the display screen at automatic control terminal extends and contracts, has realized that the user passes through input sound signal, alright in order to accomplish the flexible control to the terminal display screen, flexibility when having improved the scalable display screen of terminal show.
In addition, when the terminal is in a target scene, the corresponding display screen control instruction is obtained by determining the size relationship between the volume amplitude and the first amplitude threshold value and the second amplitude threshold value, so that the size of the display screen can be actively changed by the terminal in the target scene, and the effect of acquiring or playing sound by a microphone of the terminal in the target scene is flexibly improved.
In a possible implementation manner, in the embodiment shown in fig. 7, when the specified condition includes a condition to be satisfied by the voice recognition result of the first sound signal and a condition to be satisfied by the volume amplitude of the first sound signal, that is, when both the condition to be satisfied by the voice recognition result of the first sound signal and the condition to be satisfied by the volume amplitude of the first sound signal exist in the specified condition, the terminal not only obtains the voice recognition result, but also obtains the volume amplitude of the first sound signal.
Referring to fig. 8, a flowchart of a method for controlling a display screen according to an exemplary embodiment of the present application is shown. The method may be performed by the terminal shown in fig. 1 to 5, and as shown in fig. 8, the display screen control method may include the following steps:
step 801, starting a voice wake-up function of the terminal.
Optionally, the user may start the voice wake-up function in the terminal in advance, and the terminal may wake up the terminal after receiving the wake-up voice when the voice wake-up function is started, so as to execute other steps of the application. In a possible implementation manner, a user may set the voice wake-up function to be turned on and off in a setting interface of the terminal, and in this step, the user turns on the voice wake-up function of the terminal.
Step 802, receiving an input second sound signal.
And step 803, in response to the fact that the second sound signal contains the wakeup word, controlling the terminal to enter a voice wakeup state.
Step 804, receiving a first sound signal input when the terminal is in a voice wake-up state.
Step 805, performing speech recognition on the first sound signal to obtain a speech recognition result.
Optionally, the implementation manner of step 802 to step 805 may refer to the description of step 702 to step 705 in the embodiment of fig. 7, which is not described herein again.
Step 806 obtains a volume amplitude of the first sound signal.
Optionally, the implementation manner of step 806 may refer to the description of step 709 in the above embodiment of fig. 7, and is not described herein again.
In step 807, in response to the matching of the speech recognition result and the second keyword and the size relationship between the volume amplitude and the amplitude threshold satisfying the specified size relationship, it is determined that the first sound signal satisfies the specified condition.
Alternatively, the second keyword and the first keyword may be the same and are both keywords in the target keyword set. The terminal determines whether the voice recognition result matches the second keyword, and whether the magnitude relationship between the volume amplitude and the amplitude threshold satisfies the specified magnitude relationship, which may refer to the descriptions of step 706 and step 710 in the embodiment of fig. 7, and is not described herein again.
And step 808, responding to that the first sound signal meets the specified condition, and acquiring a display screen control instruction.
In one possible implementation, in response to the volume magnitude being greater than the third magnitude threshold, a display control instruction corresponding to the second keyword is obtained. That is, when the terminal determines that the first voice signal meets the specified condition, the terminal may further determine the obtained volume amplitude again, determine a magnitude relationship between the volume amplitude and the third amplitude threshold, and if the volume amplitude is greater than the third amplitude threshold, obtain a display screen control instruction corresponding to the second keyword. For example, if the third amplitude threshold is 25 db, and the volume amplitude obtained by the terminal is 30 db, the terminal may obtain the display control instruction corresponding to the second keyword. Optionally, if the volume amplitude is not greater than the third amplitude threshold, the terminal may not perform stretching or shrinking processing on the display screen, that is, does not obtain a display screen control instruction, and keeps the size of the display screen unchanged.
In a possible implementation manner, in response to the matching of the voice recognition result and the second keyword, an amplitude interval where the volume amplitude is located is obtained, and a display screen control instruction corresponding to the amplitude interval is obtained. That is, when the terminal determines that the first voice signal satisfies the specified condition, the terminal may further obtain a display screen control instruction corresponding to the amplitude interval for the amplitude interval corresponding to the obtained volume amplitude. For example, the terminal may store a correspondence between the amplitude interval and the display screen control instruction in advance. Please refer to table 3, which shows a corresponding relationship table between an amplitude interval and a display screen control command according to an exemplary embodiment of the present application.
Amplitude interval Display screen control instructions
Amplitude interval one Display screen control instruction one
Amplitude interval two Display screen control instruction two
Amplitude interval three Display screen control instruction three
…… ……
TABLE 3
As shown in table 3, different amplitude intervals may correspond to their own display control commands. After the terminal acquires the amplitude interval where the volume amplitude is located, a display screen control instruction corresponding to the amplitude interval can be obtained by inquiring the table 3. For example, if the amplitude interval in which the volume amplitude is obtained by the terminal is the amplitude interval two, the display screen control instruction finally obtained by the terminal is the display screen control instruction two.
And step 809, controlling the expansion or contraction of the display screen according to the display screen control instruction.
Optionally, the implementation of step 809 may refer to the description of step 712 in the embodiment of fig. 7, which is not described herein again.
In summary, the terminal receives the input first sound signal; responding to the first sound signal meeting the specified condition, and acquiring a display screen control instruction, wherein the display screen control instruction is used for indicating to control the extension or contraction of the display screen; and controlling the expansion or contraction of the display screen according to the display screen control instruction. This application carries out the condition judgement through the terminal to the first sound signal of input, when first sound signal satisfies the appointed condition, acquires display screen control command to the display screen at automatic control terminal extends and contracts, has realized that the user passes through input sound signal, alright in order to accomplish the flexible control to the terminal display screen, flexibility when having improved the scalable display screen of terminal show.
In addition, according to the method and the device, through judgment of the target scene, when the terminal is in the target scene, whether the terminal needs to be subjected to telescopic operation is further determined through the sound amplitude, and whether the terminal needs to be subjected to telescopic operation is further determined through the distance between the terminal and a user, so that error control of the terminal on a display screen of the terminal in the target scene is avoided. In addition, in the application, when the terminal judges that the sound amplitude does not meet the third amplitude threshold condition, the terminal is not subjected to stretching operation, noise generated when the terminal stretches the display screen in the target scene can be reduced, and the sound quality in the target scene is improved.
In a possible implementation manner, the method embodiment shown in fig. 6, fig. 7 or fig. 8 is exemplified by taking the terminal as a mobile phone, where the mobile phone includes a voice chip, and the voice chip in the mobile phone executes the steps shown in fig. 7 related to the acquisition, detection, identification and the like of the voice signal. Referring to fig. 9, a flowchart of a method for controlling a display screen according to an exemplary embodiment of the present application is shown. The method is executed by a hand in daily life, and as shown in fig. 9, the display screen control method may include the following steps:
step 901, a voice wake-up function is started in the mobile phone.
Step 902, recording a wakeup word, a first keyword and an amplitude threshold value which can be detected by the voice chip in the mobile phone in advance.
And step 903, detecting whether the display screen of the mobile phone is in a turning-off state.
If yes, go to step 904, if no, go to step 911.
Step 904, a first voice is received.
Referring to fig. 10, a schematic diagram of a user inputting speech to a mobile phone according to an exemplary embodiment of the present application is shown. As shown in fig. 10, a user may speak into terminal 1001 so that terminal 1001 picks up the user's voice.
Step 905, detecting whether the first voice contains a wakeup word through a voice chip.
If so, go to step 906, otherwise go to step 904.
Step 906, the voice chip starts a voice recognition mode to wake up the terminal.
Optionally, before waking up the terminal, the voice chip may be regarded as being in a light sleep state, that is, the voice recognition function is not turned on, and voice recognition cannot be performed on the input voice for a while. After the terminal is awakened, the voice chip can start the voice recognition function of the voice chip, can be regarded as being in a voice recognition mode, and can perform voice recognition on voice input by a user.
Step 907, receiving the second voice.
And 908, recognizing the voice content of the second voice by the voice chip and reporting the voice content.
And step 909, matching the reported voice content with the first keyword.
And executing step 910 when the reported voice content is matched with the first keyword, otherwise executing step 907.
Step 910, the terminal obtains a control instruction corresponding to the second voice.
And step 911, detecting whether the terminal is in a target scene.
If so, go to step 912, otherwise go to step 917.
Step 912, obtaining the volume amplitude of the sound collected by the microphone.
Step 913, detecting whether the volume amplitude is greater than the amplitude threshold.
If so, go to step 914, otherwise go to step 917.
In step 914, a control command is obtained.
Step 915, detecting whether the display screen is in a maximum expansion state or a maximum contraction state.
If so, go to step 916, otherwise go to step 917.
And step 916, controlling the display screen to expand or contract.
Step 917, keeping the size of the display screen of the terminal unchanged.
For example, the algorithm logic corresponding to the second voice is to unfold the terminal in fig. 10, and the display screen of the terminal may be unfolded according to the arrow direction shown in fig. 10. In fig. 10, the dotted line represents the position of the display before the display is unfolded, and the solid line represents the position of the display after the display is unfolded. If the algorithm logic corresponding to the second voice is to shrink the terminal in fig. 10, the display screen of the terminal may be shrunk in the direction opposite to the arrow shown in fig. 10. At this time, the solid line in fig. 10 represents the position before the screen is contracted, and the broken line represents the position after the screen is contracted.
In summary, the terminal receives the input first sound signal; responding to the first sound signal meeting the specified condition, and acquiring a display screen control instruction, wherein the display screen control instruction is used for indicating to control the extension or contraction of the display screen; and controlling the expansion or contraction of the display screen according to the display screen control instruction. This application carries out the condition judgement through the terminal to the first sound signal of input, when first sound signal satisfies the appointed condition, acquires display screen control command to the display screen at automatic control terminal extends and contracts, has realized that the user passes through input sound signal, alright in order to accomplish the flexible control to the terminal display screen, flexibility when having improved the scalable display screen of terminal show.
The following are embodiments of the apparatus of the present application that may be used to perform embodiments of the method of the present application. For details which are not disclosed in the embodiments of the apparatus of the present application, reference is made to the embodiments of the method of the present application.
Referring to fig. 11, a block diagram of a display screen control device according to an exemplary embodiment of the present application is shown. The display control apparatus 1100 may be used in a terminal including a retractable display to perform all or part of the steps performed by the terminal in the methods provided by the embodiments shown in fig. 6, 7, 8 or 9. The display screen control apparatus 1100 may include: the device comprises a sound signal receiving module 1101, a control instruction obtaining module 1102 and a display screen control module 1103.
A sound signal receiving module 1101 for receiving an input first sound signal;
a control instruction obtaining module 1102, configured to obtain a display screen control instruction in response to that the first sound signal meets a specified condition, where the display screen control instruction is used to instruct to control extension or contraction of the display screen;
and the display screen control module 1103 is configured to control extension or contraction of the display screen according to the display screen control instruction.
In summary, the terminal receives the input first sound signal; responding to the first sound signal meeting the specified condition, and acquiring a display screen control instruction, wherein the display screen control instruction is used for indicating to control the extension or contraction of the display screen; and controlling the expansion or contraction of the display screen according to the display screen control instruction. This application carries out the condition judgement through the terminal to the first sound signal of input, when first sound signal satisfies the appointed condition, acquires display screen control command to the display screen at automatic control terminal extends and contracts, has realized that the user passes through input sound signal, alright in order to accomplish the flexible control to the terminal display screen, flexibility when having improved the scalable display screen of terminal show.
Optionally, the specified condition includes at least one of the following conditions:
a condition to be satisfied by a speech recognition result of the first sound signal;
and a condition to be satisfied by a volume amplitude of the first sound signal.
Optionally, the apparatus further comprises:
a first obtaining module, configured to, before the control instruction obtaining module 1102 obtains a display screen control instruction in response to that the first sound signal meets a specified condition, perform speech recognition on the first sound signal in response to that the specified condition includes a condition that a speech recognition result of the first sound signal needs to be met, and obtain the speech recognition result;
and the first determining module is used for responding to the matching of the voice recognition result and a first keyword and determining that the first sound signal meets the specified condition.
Optionally, the control instruction obtaining module 1102 is configured to obtain the display screen control instruction corresponding to the first keyword in response to that the first sound signal satisfies a specified condition.
Optionally, the apparatus further comprises:
and the second determination module is used for determining that the specified condition comprises a condition to be met by a voice recognition result of the first sound signal in response to the display screen being in a blank state.
Optionally, the apparatus further comprises:
a first receiving module, configured to receive an input second sound signal before the sound signal receiving module 1101 receives an input first sound signal;
the first control module is used for responding to the fact that the second sound signal contains a wakeup word and controlling the terminal to enter a voice wakeup state;
the sound signal receiving module 1101 is configured to receive the first sound signal input when the terminal is in the voice wakeup state.
Optionally, the apparatus further comprises:
a second obtaining module, configured to, before the control instruction obtaining module 1102 obtains a display screen control instruction in response to a first sound signal meeting a specified condition, obtain a volume amplitude of the first sound signal in response to the specified condition including a condition that the volume amplitude of the first sound signal is to meet;
a second determining module, configured to determine that the first sound signal satisfies the specified condition in response to a magnitude relationship between the volume magnitude and a magnitude threshold satisfying a specified magnitude relationship.
Optionally, the control instruction obtaining module 1102 is configured to obtain a first control instruction in response to that the volume amplitude is smaller than a first amplitude threshold, where the first control instruction is used to instruct to control extension of the display screen.
Optionally, the control instruction obtaining module 1102 is configured to obtain a second control instruction in response to that the volume amplitude is greater than a second amplitude threshold, where the second control instruction is used to instruct to control the contraction of the display screen.
Optionally, the apparatus further comprises:
a third determining module, configured to determine, in response to the terminal being in a designated state, that the designated condition includes a condition that a volume amplitude of the first sound signal is to be satisfied;
the specified state includes at least one of:
the display screen is in a lighting state; and the terminal is in a target scene.
Optionally, the target scene is any one of a voice call scene, a recording scene, a video call scene, a voice message sending scene, and a video playing scene.
Optionally, the apparatus further comprises:
a first obtaining module, configured to perform speech recognition on the first sound signal to obtain the speech recognition result before the control instruction obtaining module 1102 obtains a display screen control instruction in response to that the first sound signal satisfies a specified condition;
a third obtaining module, configured to obtain a volume amplitude of the first sound signal;
and the fourth determining module is used for determining that the first sound signal meets the specified condition in response to the fact that the voice recognition result is matched with the second keyword and the magnitude relation between the volume amplitude and the amplitude threshold value meets the specified magnitude relation.
Optionally, the control instruction obtaining module 1102 includes: a first acquisition unit or a second acquisition unit;
the first obtaining unit is used for responding to the situation that the volume amplitude is larger than a third amplitude threshold value, and obtaining the display screen control instruction corresponding to the second keyword;
alternatively, the first and second electrodes may be,
the second obtaining unit is used for responding to the matching of the voice recognition result and the second keyword, obtaining an amplitude interval where the volume amplitude is located, and obtaining the display screen control instruction corresponding to the amplitude interval.
Referring to fig. 12, a schematic structural diagram of a computer device according to an exemplary embodiment of the present application is shown. The computer device 1200 may include: a processor 1201, a receiver 1202, a transmitter 1203, a memory 1204 and a bus 1205.
The processor 1201 includes one or more processing cores, and the processor 1201 executes various functional applications and information processing by executing software programs and modules.
The receiver 1202 and the transmitter 1203 may be implemented as one communication component, which may be a communication chip. The communication chip may also be referred to as a transceiver.
The memory 1204 is coupled to the processor 1201 via a bus 1205.
The memory 1204 may be used for storing a computer program for execution by the processor 1201 to perform the various steps performed by the computer device in the above-described method embodiments.
Further, the memory 1204 may be implemented by any type or combination of volatile or non-volatile storage devices, including, but not limited to: magnetic or optical disks, electrically Erasable Programmable Read-Only memories (EEPROMs), erasable Programmable Read-Only memories (EPROMs), static Random Access Memories (SRAMs), read-Only memories (ROMs), magnetic memories, flash memories, programmable Read-Only memories (PROMs).
In an exemplary embodiment, the computer device includes a processor and a memory;
the processor is configured to perform at least one of,
receiving an input first sound signal;
responding to the first sound signal meeting a specified condition, and acquiring a display screen control instruction, wherein the display screen control instruction is used for instructing to control the extension or contraction of the display screen;
and controlling the expansion or contraction of the display screen according to the display screen control instruction.
In one possible implementation, the specified condition includes at least one of the following conditions:
a condition to be satisfied by a speech recognition result of the first sound signal;
and a condition to be satisfied by a volume amplitude of the first sound signal.
In one possible implementation, the processor is further configured to,
performing voice recognition on the first sound signal to obtain a voice recognition result in response to the specified condition comprising a condition to be met by the voice recognition result of the first sound signal;
determining that the first sound signal satisfies the specified condition in response to the voice recognition result matching a first keyword.
In one possible implementation, the processor is configured to,
and responding to the first sound signal meeting a specified condition, and acquiring the display screen control instruction corresponding to the first keyword.
In one possible implementation, the processor is configured to,
in response to the display screen being in an off state, determining that the specified condition includes a condition to be satisfied by a voice recognition result of the first sound signal.
In one possible implementation, the processor is further configured to,
receiving an input second sound signal;
responding to the fact that the second sound signal contains a wakeup word, and controlling the terminal to enter a voice wakeup state;
the receiving of the input first sound signal comprises:
receiving the first sound signal input when the terminal is in the voice wake-up state.
In one possible implementation, the processor is further configured to,
acquiring the volume amplitude of the first sound signal in response to the specified condition comprising a condition to be met by the volume amplitude of the first sound signal;
determining that the first sound signal satisfies the specified condition in response to a magnitude relationship between the volume magnitude and a magnitude threshold satisfying a specified magnitude relationship.
In one possible implementation, the processor is configured to,
and responding to the volume amplitude smaller than a first amplitude threshold value, and acquiring a first control instruction, wherein the first control instruction is used for indicating to control the extension of the display screen.
In one possible implementation, the processor is configured to,
and responding to the volume amplitude larger than a second amplitude threshold value, and acquiring a second control instruction, wherein the second control instruction is used for indicating to control the contraction of the display screen.
In one possible implementation, the processor is further configured to,
in response to the terminal being in a designated state, determining that the designated condition includes a condition to be satisfied by a volume amplitude of the first sound signal;
the specified state includes at least one of:
the display screen is in a lighting state; and the terminal is in a target scene.
In a possible implementation manner, the target scene is any one of a voice call scene, a recording scene, a video call scene, a voice message sending scene, and a video playing scene.
In one possible implementation, the processor is further configured to,
performing voice recognition on the first sound signal to obtain a voice recognition result;
acquiring the volume amplitude of the first sound signal;
and determining that the first sound signal meets the specified condition in response to the fact that the voice recognition result is matched with a second keyword and the magnitude relation between the volume amplitude and the amplitude threshold value meets the specified magnitude relation.
In one possible implementation, the processor is configured to,
responding to the fact that the volume amplitude is larger than a third amplitude threshold value, and obtaining the display screen control instruction corresponding to the second keyword;
alternatively, the first and second electrodes may be,
and responding to the matching of the voice recognition result and the second keyword, obtaining an amplitude interval where the volume amplitude is located, and obtaining the display screen control instruction corresponding to the amplitude interval.
The embodiment of the present application further provides a computer-readable medium, where at least one instruction is stored, and the at least one instruction is loaded and executed by the processor to implement all or part of the steps executed by the terminal in the display screen control method according to the above embodiments.
Embodiments of the present application further provide a computer program product, which includes computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the display screen control method provided in the various optional implementation manners of the various embodiments.
It should be noted that: in the display control device provided in the foregoing embodiment, when the display control method is executed, the foregoing embodiments are merely illustrated, and in an actual program, the foregoing function distribution may be completed by different function modules as needed, that is, the internal structure of the apparatus is divided into different function modules, so as to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments for details, which are not described herein again.
The above-mentioned serial numbers of the embodiments of the present application are merely for description, and do not represent the advantages and disadvantages of the embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the storage medium may be a read-only memory, a magnetic disk or an optical disk.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (6)

1. A display screen control method, wherein the method is executed by a terminal, and the terminal comprises a retractable display screen, and the method comprises:
receiving an input first sound signal;
responding to the terminal in a specified state and the first sound signal meeting specified conditions, and acquiring a display screen control instruction; the specified condition comprises that the magnitude relation between the volume amplitude of the first sound signal and an amplitude threshold value meets a specified magnitude relation; wherein the display screen control instruction is a first control instruction instructing to control the stretching of the display screen when the volume amplitude is less than a first amplitude threshold; when the volume amplitude is larger than a second amplitude threshold value, the display screen control instruction is a second control instruction for controlling the contraction of the display screen; the specified state includes that the terminal is in a target scene, and the target scene includes: any one of a voice call scene, a recording scene, a video call scene and a voice message sending scene;
and controlling the extension or contraction of the display screen according to the display screen control instruction.
2. The method according to claim 1, wherein before the step of acquiring the display control command in response to the terminal being in the designated state and the first sound signal satisfying the designated condition, the method further comprises:
performing voice recognition on the first sound signal to obtain a voice recognition result;
acquiring the volume amplitude of the first sound signal;
and determining that the first sound signal meets the specified condition in response to the fact that the voice recognition result is matched with a second keyword and the magnitude relation between the volume amplitude and the amplitude threshold value meets the specified magnitude relation.
3. The method according to claim 2, wherein the acquiring a display control instruction in response to the terminal being in a specified state and the first sound signal satisfying a specified condition comprises:
responding to the fact that the volume amplitude is larger than a third amplitude threshold value, and obtaining the display screen control instruction corresponding to the second keyword;
alternatively, the first and second liquid crystal display panels may be,
and responding to the matching of the voice recognition result and the second keyword, obtaining an amplitude interval where the volume amplitude is located, and obtaining the display screen control instruction corresponding to the amplitude interval.
4. A display screen control apparatus, the apparatus comprising:
the sound signal receiving module is used for receiving an input first sound signal;
the control instruction acquisition module is used for responding to the fact that the terminal is in a specified state and the first sound signal meets specified conditions, and acquiring a display screen control instruction; the terminal comprises a telescopic display screen; the specified condition comprises that the magnitude relation between the volume amplitude of the first sound signal and an amplitude threshold value meets a specified magnitude relation; wherein the display screen control instruction is a first control instruction instructing to control the stretching of the display screen when the volume amplitude is less than a first amplitude threshold; when the volume amplitude is larger than a second amplitude threshold value, the display screen control instruction is a second control instruction for controlling the contraction of the display screen; the specified state comprises that the terminal is in a target scene, and the target scene comprises: any one of a voice call scene, a recording scene, a video call scene and a voice message sending scene;
and the display screen control module is used for controlling the extension or the contraction of the display screen according to the display screen control instruction.
5. A computer device comprising a processor and a memory, the memory having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, the at least one instruction, the at least one program, the set of codes, or the set of instructions being loaded and executed by the processor to implement a display screen control method according to any one of claims 1 to 3.
6. A computer readable storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by a processor to implement the display screen control method according to any one of claims 1 to 3.
CN202010561945.6A 2020-06-18 2020-06-18 Display screen control method and device, computer equipment and storage medium Active CN113905110B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202010561945.6A CN113905110B (en) 2020-06-18 2020-06-18 Display screen control method and device, computer equipment and storage medium
PCT/CN2021/090003 WO2021253992A1 (en) 2020-06-18 2021-04-26 Method and apparatus for controlling display screen, and computer device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010561945.6A CN113905110B (en) 2020-06-18 2020-06-18 Display screen control method and device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN113905110A CN113905110A (en) 2022-01-07
CN113905110B true CN113905110B (en) 2022-11-18

Family

ID=79186116

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010561945.6A Active CN113905110B (en) 2020-06-18 2020-06-18 Display screen control method and device, computer equipment and storage medium

Country Status (2)

Country Link
CN (1) CN113905110B (en)
WO (1) WO2021253992A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010025887A (en) * 1999-09-01 2001-04-06 공관식 Cellular phone having a dual functioned antenna with a directional mike
WO2018043895A1 (en) * 2016-08-31 2018-03-08 삼성전자 주식회사 Display device and method for controlling display device

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140149216A1 (en) * 2013-09-24 2014-05-29 Peter McGie Voice Recognizing Digital Messageboard System and Method
KR20170050270A (en) * 2015-10-30 2017-05-11 엘지전자 주식회사 Rollable mobile device and method for controlling the same
CN108377279A (en) * 2018-02-09 2018-08-07 维沃移动通信有限公司 A kind of mobile terminal and control method
CN110752973B (en) * 2018-07-24 2020-12-25 Tcl科技集团股份有限公司 Terminal equipment control method and device and terminal equipment
CN109087649A (en) * 2018-09-05 2018-12-25 努比亚技术有限公司 Terminal, terminal control method and computer readable storage medium
CN109286706B (en) * 2018-10-12 2021-01-26 京东方科技集团股份有限公司 Display device
CN109656498B (en) * 2018-10-30 2021-12-03 努比亚技术有限公司 Display control method, flexible screen terminal and computer readable storage medium
CN111385393B (en) * 2018-12-29 2021-05-25 Oppo广东移动通信有限公司 Electronic equipment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010025887A (en) * 1999-09-01 2001-04-06 공관식 Cellular phone having a dual functioned antenna with a directional mike
WO2018043895A1 (en) * 2016-08-31 2018-03-08 삼성전자 주식회사 Display device and method for controlling display device

Also Published As

Publication number Publication date
CN113905110A (en) 2022-01-07
WO2021253992A1 (en) 2021-12-23

Similar Documents

Publication Publication Date Title
US10838765B2 (en) Task execution method for voice input and electronic device supporting the same
US20210065716A1 (en) Voice processing method and electronic device supporting the same
EP3410435A1 (en) Electronic apparatus for recognizing keyword included in your utterance to change to operating state and controlling method thereof
WO2019214361A1 (en) Method for detecting key term in speech signal, device, terminal, and storage medium
CN106463112B (en) Voice recognition method, voice awakening device, voice recognition device and terminal
TWI525532B (en) Set the name of the person to wake up the name for voice manipulation
CN108694944B (en) Method and apparatus for generating natural language expressions by using a framework
KR20180117485A (en) Electronic device for processing user utterance and method for operation thereof
CN110444210B (en) Voice recognition method, awakening word detection method and device
CN108810280B (en) Voice acquisition frequency processing method and device, storage medium and electronic equipment
US20190019509A1 (en) Voice data processing method and electronic device for supporting the same
CN108806684B (en) Position prompting method and device, storage medium and electronic equipment
CN111968635B (en) Speech recognition method, device and storage medium
KR102369083B1 (en) Voice data processing method and electronic device supporting the same
KR20190109916A (en) A electronic apparatus and a server for processing received data from the apparatus
KR20190009488A (en) An electronic device and system for deciding a duration of receiving voice input based on context information
US20200034112A1 (en) Electronic device for performing operation according to user input after partial landing
CN114333774B (en) Speech recognition method, device, computer equipment and storage medium
CN113905110B (en) Display screen control method and device, computer equipment and storage medium
CN108922523B (en) Position prompting method and device, storage medium and electronic equipment
CN114333854A (en) Voice awakening method, electronic equipment and chip system
EP4095850A1 (en) Instruction execution method and apparatus, storage medium, and electronic device
CN115312068A (en) Voice control method, device and storage medium
CN114765026A (en) Voice control method, device and system
CN113852721B (en) Device control method, device, storage medium and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant