CN113568556A - Split screen control method and device, intelligent terminal and computer readable storage medium - Google Patents
Split screen control method and device, intelligent terminal and computer readable storage medium Download PDFInfo
- Publication number
- CN113568556A CN113568556A CN202110757625.2A CN202110757625A CN113568556A CN 113568556 A CN113568556 A CN 113568556A CN 202110757625 A CN202110757625 A CN 202110757625A CN 113568556 A CN113568556 A CN 113568556A
- Authority
- CN
- China
- Prior art keywords
- screen
- split
- target
- window
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000009286 beneficial effect Effects 0.000 abstract description 7
- 230000006870 function Effects 0.000 description 17
- 238000010586 diagram Methods 0.000 description 8
- 230000003993 interaction Effects 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000004044 response Effects 0.000 description 4
- 230000009467 reduction Effects 0.000 description 3
- 206010063385 Intellectualisation Diseases 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000003062 neural network model Methods 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a split screen control method, a split screen control device, an intelligent terminal and a computer readable storage medium, wherein the split screen control method comprises the following steps: acquiring voice information of a target object; acquiring split screen control instruction information based on the voice information; and controlling the target terminal to perform corresponding screen splitting operation based on the screen splitting control instruction information. Compared with the scheme of performing screen splitting control through touch operation of a user in the prior art, the scheme of the invention can control the target terminal to perform corresponding screen splitting operation based on the acquired voice information, so that the target object can perform screen splitting control on the target terminal through voice without requiring the screen of the display terminal to support touch operation. Therefore, the scheme of the invention is beneficial to the split screen control of the display terminal of which the screen does not support touch operation, and the split screen control is simpler, thereby improving the use experience of a user.
Description
Technical Field
The invention relates to the technical field of display control, in particular to a split screen control method and device, an intelligent terminal and a computer readable storage medium.
Background
With the development of science and technology, people have higher and higher requirements on intellectualization, and more display terminals provide a split screen function so as to facilitate the operation and use of users. For example, a computer, a tablet computer, a mobile phone, a television and other intelligent terminals with a display function generally provide a split screen function for a user.
In the prior art, the split screen of the display terminal needs to be controlled through touch operation of a user, for example, by dragging one application to a half-screen area and opening another application in another half-screen area to realize the split screen. The problem of the prior art is that the screen splitting control needs to be performed through touch control, which is not beneficial to performing the screen splitting control on the display terminal of which the screen does not support touch control operation, and affects the use experience.
Thus, there is still a need for improvement and development of the prior art.
Disclosure of Invention
The invention mainly aims to provide a screen splitting control method, a screen splitting control device, an intelligent terminal and a computer readable storage medium, and aims to solve the problems that in the prior art, screen splitting control needs to be performed through touch control, screen splitting control on a display terminal of which a screen does not support touch operation is not facilitated, and use experience is influenced.
In order to achieve the above object, a first aspect of the present invention provides a split screen control method, where the method includes:
acquiring voice information of a target object;
acquiring split screen control instruction information based on the voice information;
and controlling the target terminal to perform corresponding screen splitting operation based on the screen splitting control instruction information.
Optionally, the acquiring the voice information of the target object includes: and acquiring the voice information of the target object through an audio acquisition terminal.
Optionally, the target terminal is a television, and the audio acquisition terminal is a remote controller of the television.
Optionally, the obtaining of the split-screen control instruction information based on the voice information includes:
analyzing the voice information to obtain text information;
and acquiring split screen control instruction information based on the text information.
Optionally, before the obtaining of the voice information of the target object, the method further includes:
and when the target object triggers voice input, controlling the target terminal to mark the serial number of the currently opened split screen window.
Optionally, the split-screen control information includes at least one of opening a split screen, exiting the split screen, splicing the target application, switching to a target split-screen window, exchanging a first target split-screen window and a second target split-screen window, enlarging the target split-screen window, reducing the target split-screen window, and closing the target split-screen window.
Optionally, the controlling the target terminal to perform the corresponding screen splitting operation based on the screen splitting control instruction information includes:
when the split screen control information is that split screen is started, controlling the target terminal to enter a split screen mode, and displaying a split screen application list;
when the split screen control information indicates that the split screen is quitted, controlling the target terminal to close all split screen windows and quitting the split screen mode;
when the split-screen control information is a spliced target application, controlling the target terminal to open the target application in a new split-screen window, and splicing the new split-screen window with other split-screen windows which are already opened;
when the split screen control information is switched to a target split screen window, controlling the target terminal to switch the target split screen window to a main window;
and when the split-screen control information is to exchange a first target split-screen window and a second target split-screen window, controlling the target terminal to exchange the positions and the sizes of the first target split-screen window and the second target window.
A second aspect of the present invention provides a split screen control apparatus, wherein the apparatus includes:
the voice information acquisition module is used for acquiring the voice information of the target object;
the split screen control instruction information acquisition module is used for acquiring split screen control instruction information based on the voice information;
and the control module is used for controlling the target terminal to perform corresponding screen splitting operation based on the screen splitting control instruction information.
A third aspect of the present invention provides an intelligent terminal, where the intelligent terminal includes a memory, a processor, and a split-screen control program stored in the memory and executable on the processor, and the split-screen control program implements any one of the steps of the split-screen control method when executed by the processor.
A fourth aspect of the present invention provides a computer-readable storage medium, where a split-screen control program is stored on the computer-readable storage medium, and when executed by a processor, the split-screen control program implements any one of the steps of the split-screen control method.
In the above, the scheme of the invention obtains the voice information of the target object; acquiring split screen control instruction information based on the voice information; and controlling the target terminal to perform corresponding screen splitting operation based on the screen splitting control instruction information. Compared with the scheme of performing screen splitting control through touch operation of a user in the prior art, the scheme of the invention can control the target terminal to perform corresponding screen splitting operation based on the acquired voice information, so that the target object can perform screen splitting control on the target terminal through voice without requiring the screen of the display terminal to support touch operation. Therefore, the scheme of the invention is beneficial to the split screen control of the display terminal of which the screen does not support touch operation, and the split screen control is simpler, thereby improving the use experience of a user.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a schematic flowchart of a split-screen control method according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart illustrating the implementation of step S200 in FIG. 1;
FIG. 3 is a schematic flow chart of another split-screen control method according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a serial number mark of a split screen window according to an embodiment of the present invention;
FIG. 5 is a schematic flow chart illustrating the implementation of step S300 in FIG. 1;
FIG. 6 is a schematic structural diagram of a split-screen control device according to an embodiment of the present invention;
fig. 7 is a schematic flowchart of a process of performing split-screen control on a target terminal through a split-screen control device according to an embodiment of the present invention;
fig. 8 is a schematic block diagram of an internal structure of an intelligent terminal according to an embodiment of the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the specification of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when …" or "upon" or "in response to a determination" or "in response to a detection". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted depending on the context to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".
The technical solutions in the embodiments of the present invention are clearly and completely described below with reference to the drawings of the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways than those specifically described and will be readily apparent to those of ordinary skill in the art without departing from the spirit of the present invention, and therefore the present invention is not limited to the specific embodiments disclosed below.
In the contemporary society, people's demand for intellectualization is also higher and higher, and more display terminals provide the split screen function to make things convenient for user's operation and use. For example, a computer, a tablet computer, a mobile phone, a television, an educational machine, an advertising machine, a conference machine, an automobile-mounted display screen, and other intelligent terminals with display functions generally provide a split screen function for a user.
In the prior art, the split screen of the display terminal needs to be controlled through the touch operation of a user. Specifically, for a display terminal using an Android (Android) system, the split screen operation is generally the same as the native split screen interactive operation of the Android system. For example, when the split screen is entered, a recently-operated application list needs to be called out, a certain recently-operated application half-screen area is dragged, and another application is selected to be opened on the other half-screen; when the main window is switched, the window area needs to be clicked; when the size of the split screen window is adjusted, a dividing strip between two half screens needs to be dragged to move towards a certain half screen, and then the size of the left and right (or upper and lower) half screens can be adjusted; and dragging the dividing strip between the two half screens to the edge of the screen when the split screen is withdrawn. At present, an Android terminal supporting split screen basically inherits the native split screen interaction of Android. The problem of this interaction scheme lies in, need carry out the split screen control through touch-control, be unfavorable for carrying out the split screen control to the display terminal that the screen does not support touch operation, be not suitable for the realization split screen control that comes the convenience through the remote control, influence user's use experience. For example, the screen splitting control scheme cannot perform screen splitting control on the television through the remote controller, and the operation steps for realizing the screen splitting control based on the key operation of the remote controller are complicated, so that the screen splitting control scheme is inconvenient for users to use, influences the efficiency of the screen splitting control, and cannot enable the users to quickly and simply realize the screen splitting control.
In order to solve the problems of the prior art, the scheme of the invention obtains the voice information of the target object; acquiring split screen control instruction information based on the voice information; and controlling the target terminal to perform corresponding screen splitting operation based on the screen splitting control instruction information. Compared with the scheme of performing screen splitting control through touch operation of a user in the prior art, the scheme of the invention can control the target terminal to perform corresponding screen splitting operation based on the acquired voice information, so that the target object can perform screen splitting control on the target terminal through voice without requiring the screen of the display terminal to support touch operation. Therefore, the scheme of the invention is beneficial to the split screen control of the display terminal of which the screen does not support touch operation, and the split screen control is simpler, thereby improving the use experience of a user.
Exemplary method
As shown in fig. 1, an embodiment of the present invention provides a split-screen control method, specifically, the method includes the following steps:
step S100, acquiring voice information of a target object.
The target object is a user needing to control the target terminal. The voice information includes audio data corresponding to the voice of the user, and the voice information may be acquired in real time and in the field of the target terminal, or the user may generate corresponding voice information in a far-field voice manner, which is not limited specifically herein.
And step S200, acquiring split screen control instruction information based on the voice information.
Specifically, the screen splitting control instruction information can be acquired after voice character recognition is performed on the voice information, and the voice information and the screen splitting control instruction information can be matched and corresponding based on a preset and trained neural network model, so that the corresponding screen splitting control instruction information is acquired. Other acquisition methods are also possible and are not specifically limited herein.
And step S300, controlling the target terminal to perform corresponding screen splitting operation based on the screen splitting control instruction information.
Specifically, in this embodiment, the split-screen control instruction information is information corresponding to the split-screen control instruction, for example, a certain application is opened in a split-screen window, or a certain current split-screen window is enlarged and another current split-screen window is reduced. The target terminal is a display terminal that a user needs to perform split screen control, and the target terminal may be a computer, a tablet computer, a mobile phone, a television, an education machine, an advertisement machine, a conference machine, an automobile-mounted display screen, a projector, or other terminal equipment with a display function, and is not limited specifically here. In this embodiment, the target terminal is based on an Android system. In this embodiment, based on the obtained split-screen control instruction information, the target terminal is controlled to perform corresponding split-screen operations, for example, enter a split screen, open more than two split-screen windows, switch a window position, switch a window size (for example, enlarge or reduce a certain split-screen window), open a certain application in a certain split-screen window, exit the split screen, and the like. The content of the specific split-screen control instruction information and the corresponding split-screen control operation can be set and adjusted according to actual requirements, for example, a specific magnification factor when a certain split-screen window is magnified can be set according to actual requirements, and no specific limitation is made herein.
As can be seen from the above, the split-screen control method provided by the embodiment of the present invention obtains the voice information of the target object; acquiring split screen control instruction information based on the voice information; and controlling the target terminal to perform corresponding screen splitting operation based on the screen splitting control instruction information. Compared with the scheme of performing screen splitting control through touch operation of a user in the prior art, the scheme of the invention can control the target terminal to perform corresponding screen splitting operation based on the acquired voice information, so that the target object can perform screen splitting control on the target terminal through voice without requiring the screen of the display terminal to support touch operation. Therefore, the scheme of the invention is beneficial to the split screen control of the display terminal of which the screen does not support touch operation, and the split screen control is simpler, thereby improving the use experience of a user.
Specifically, in this embodiment, the step S100 includes: and acquiring the voice information of the target object through an audio acquisition terminal.
The audio acquisition terminal is a terminal device for recording a user (target object), and the user can input voice through the audio acquisition terminal (such as a microphone, a remote controller, and the like). In an application scenario, the speech input may also be performed through far-field speech, and is not limited herein.
Specifically, in this embodiment, the target terminal is a television, and the audio acquisition terminal is a remote controller of the television.
The television set is a television set using an Android system, the remote controller has a recording function, and a user can input voice information through the remote controller. Furthermore, the remote controller is provided with a key for triggering voice input, and a user can trigger the recording function of the remote controller through the key, so that voice input is performed, the recording function does not need to be started all the time by the remote controller, and the energy consumption of the remote controller is reduced. Optionally, the user can also control the remote controller to enter a working mode of collecting voice for a long time, so that the remote controller can be continuously in a recording state, voice information of the user is obtained in real time, and the user can conveniently perform split screen control at any time.
Specifically, in this embodiment, as shown in fig. 2, the step S200 includes:
step S201, analyzing the voice information to obtain text information.
Specifically, speech character recognition is performed based on the speech information, and text information corresponding to the speech information is acquired.
And step S202, acquiring split screen control instruction information based on the text information.
Specifically, the corresponding split-screen control instruction information may be obtained based on matching between the text information obtained after the speech character recognition and each preset split-screen control instruction, or semantic analysis and intention analysis may be performed on the text information, so as to directly obtain the split-screen operation that the user wants to perform expressed in the speech input by the user, thereby obtaining the corresponding split-screen control instruction information. The split-screen control instruction information corresponding to the text information may also be obtained by other methods, which are not specifically limited herein.
In this embodiment, the step S202 specifically includes: performing semantic recognition on the text information to acquire semantic information; and matching the semantic information with a preset screen splitting instruction to acquire corresponding screen splitting control instruction information.
Specifically, the semantic information may be input into a preset and trained semantic recognition model, and the corresponding semantic information may be obtained after semantic recognition. For example, when the corresponding text information is "i want to open application a now", the semantic recognition removes the meaningless words, and obtains "open application a" as the corresponding semantic information. Further, corresponding split-screen instructions may be preset, for example, each split-screen instruction is stored in a list form, for example, instructions such as entering a split screen, opening a new split screen window, opening more than two split screen windows, switching window positions, enlarging the split screen window, and reducing the split screen window are stored in advance. When the corresponding semantic information is obtained, the semantic information is matched with each preset split-screen instruction, for example, the semantic information "open application a" may correspond to the split-screen instruction "open a new split-screen window". Specifically, a matching relationship may be preset, or matching may be performed based on semantic recognition, text information and a split screen instruction with the same semantic meaning are regarded as matching, a matching model may be trained in advance, and other matching methods may be used, which are not specifically limited herein.
Optionally, the split-screen control instruction information may include a corresponding split-screen instruction and a split-screen control parameter, where the split-screen control parameter is a parameter required when the split-screen instruction is performed, for example, when the split-screen instruction is to open a new split-screen window, the corresponding split-screen control parameter may be an application that needs to be opened in the new split-screen window, for example, the "application a" mentioned above, where the "application a" should be a name or a number of a specific application, and in this embodiment, only the "application a" is taken as an example for description, and is not specifically limited.
Specifically, in this embodiment, as shown in fig. 3, before the step S100, the method further includes: step A100, when the target object triggers voice input, controlling the target terminal to mark the serial number of the currently opened split screen window.
Specifically, in this embodiment, when the user triggers voice input, the television may be controlled to mark the serial number of each split-screen window that has been opened currently, so as to assist the user in quickly positioning the window to be operated, and facilitate the user to send out corresponding voice according to the serial number of each window for control. Fig. 4 is a schematic diagram illustrating a serial number marking of a split screen window according to an embodiment of the present invention, as shown in fig. 4, in the present invention, serial numbers are sequentially increased from 1 according to a sorting mode from left to right and from top to bottom, that is, the serial number of a window at the top left corner of a screen is the smallest (No. 1), and the serial number of a window at the bottom right corner of the screen is the largest. Further, in this embodiment, when the target object triggers voice input, a voice input box is also displayed in the screen. As shown in fig. 4, a semitransparent voice input box may be displayed below the screen, and text information corresponding to the voice information input by the user is displayed in the voice input box, so that the user can check and judge whether the obtained text information is incorrect, and the user can modify and edit the text information through a remote controller. Furthermore, in this embodiment, when the user wakes up the voice input box, the sequence numbers corresponding to the windows are also displayed in the split-screen windows, so that the user can conveniently and clearly know the sequence numbers of the windows, and the operation is facilitated. For example, the user may directly describe "zoom in window 2" by voice, thereby controlling the television to zoom in the corresponding window with serial number 2. Specifically, each serial number is displayed in each split screen window in a mask manner, that is, a layer of semitransparent layer is added on the upper layer of the application window corresponding to each split screen window, the layer may be gray, and the serial number is displayed in the middle of the layer.
Specifically, in this embodiment, the split-screen control information includes at least one of opening a split screen, exiting the split screen, splicing the target application, switching to the target split-screen window, exchanging the first target split-screen window and the second target split-screen window, enlarging the target split-screen window, reducing the target split-screen window, and closing the target split-screen window.
In this embodiment, the description is given by taking the example that the split-screen control information includes one of opening a split screen, exiting a split screen, splicing a target application, switching to a target split screen window, exchanging a first target split screen window and a second target split screen window, enlarging the target split screen window, reducing the target split screen window, and closing the target split screen window, but is not limited to specific limitations, and when the number of the split screen control information includes multiple types, the split screen control information may be combined with multiple types of split screen control operations. In this embodiment, the split-screen control information may include a corresponding split-screen instruction, and may further include a split-screen parameter required when the corresponding split-screen instruction is implemented, where the target application, the target split-screen window, the first target split-screen window, and the second target split-screen window are split-screen parameters input by a user. For example, the "zoom-in target split-screen window" may specifically be "zoom-in number 2 split-screen window", the corresponding split-screen instruction is to zoom in the split-screen window, the corresponding split-screen parameter is to number 2 split-screen window, and the split-screen control information may be obtained by combining the corresponding split-screen instruction and the split-screen parameter. Further, when the operation of enlarging and reducing the split screen window is performed, a specific magnification factor and a specific reduction factor may be used as the split screen parameters, and the magnification factor and the reduction factor may be input by a user or may be preset, which is not specifically limited herein.
Specifically, in this embodiment, as shown in fig. 5, the step S300 includes:
step S301, when the split screen control information is to start the split screen, controlling the target terminal to enter a split screen mode, and displaying a split screen application list.
Step S302, when the split screen control information indicates that the split screen is quitted, the target terminal is controlled to close all split screen windows, and the split screen mode is quitted.
And step S303, when the split-screen control information is a splicing target application, controlling the target terminal to open the target application in a new split-screen window, and splicing the new split-screen window with other opened split-screen windows.
Step S304, when the split-screen control information is to be switched to a target split-screen window, controlling the target terminal to switch the target split-screen window to a main window.
Step S305, when the split-screen control information indicates to exchange a first target split-screen window and a second target split-screen window, controlling the target terminal to exchange the positions and sizes of the first target split-screen window and the second target window.
The target application, the target split-screen window, the first target split-screen window and the second target split-screen window are corresponding applications or windows input by a user. Specifically, in this embodiment, when the voice input by the user is "i want to split the screen", the corresponding split-screen control information is "open split screen", and at this time, the target terminal is controlled to enter the split-screen mode, and all selectable split-screen application lists are displayed. When the voice input by the user is 'I want to spell an application A', the corresponding split-screen control information is 'a splicing application A', wherein the application A is a target application input by the user, and if the application A is in a split-screen mode and other applications are not opened, the application A is opened in a full-screen window; if the current split screen mode is in the split screen mode and other applications are already opened, opening an application A in a new split screen window, splicing the new split screen window with other already opened split screen windows, for example, splicing the new split screen window into a 'two-part window' from a 'single window', or splicing the 'two-part window' into a 'three-part window', or splicing the 'one-large one-small window' into a 'one-large two-small window', wherein a specific splicing mode can be specified or preset by a user and is not specifically limited herein; and if the current split screen window is not in the split screen mode, opening the application A in the new split screen window, and splicing the new split screen window and the current window into an 'equal split window'. When the voice input by the user is 'I want to switch to the window of x', the corresponding split-screen control information is 'switch to the window of x', wherein x is a specific serial number input by the user, the window of x is a target split-screen window input by the user, and at the moment, the target terminal is controlled to exchange the window with the serial number of x with the main window, wherein the main window is the window with the serial number of 1 or the largest window. When the voice input by the user is 'I want to enlarge/reduce the window of the number x', the corresponding split-screen control information is 'enlarge/reduce the window of the number x', at the moment, the control target terminal enlarges/reduces the size of the window with the sequence number x, and the specific enlargement/reduction times can be input by the user or can be preset; in this embodiment, while the window x is enlarged/reduced, the sizes and positions of other split-screen windows are adjusted accordingly, for example, in a scene of "one large window and two small windows", if an instruction of "enlarging the window 2" is executed, the window 2 is enlarged, the window 1 is reduced, and the positions of the window 1 and the window 2 are exchanged; under the scene of 'one big window and one small window', executing the 'amplifying No. 2 window' instruction, and then amplifying the No. 2 window to the same size as the No. 1 window to become a 'halving window'; in the scene of 'halving windows', executing the 'amplifying window 2' instruction can amplify the window 2, reduce the window 1 and exchange the positions of the window 1 and the window 2. When the voice input by the user is 'I want to exchange an x window and a y window', the corresponding split-screen control information is 'exchange an x window and a y window', wherein the x window and the y window are respectively a first target split-screen window and a second target split-screen window input by the user, and the position and the size of the windows with the sequence number x and the sequence number y are exchanged by the control target terminal; further, the window sizes of the two can be adjusted according to the exchanged positions. When the voice input by the user is 'i want to exit from the window x', the corresponding split-screen control information is 'close the window x', and at this time, the control target terminal closes the window with the sequence number x, and accordingly, the positions and sizes of other split-screen windows are adjusted, for example, in a scene of 'one large window and two small windows', the instruction of 'exiting from the window 1' is executed, and the positions of the windows 2 and 3 are adjusted and amplified to become 'two split windows'. Further, when no window with the sequence number x exists (namely, no target split screen window exists), the user is prompted that the window does not exist. When the voice input by the user is 'i want to quit split screen', the corresponding split screen control information is 'quit split screen', and at this time, the target terminal is controlled to close all application windows opened in the split screen mode and return to the main interface (for example, return to Launcher).
In the embodiment of the invention, based on the split-screen control method, the television can be controlled to carry out rapid split-screen operation through the voice of the user, so that the split-screen interaction limitation of a non-touch-screen Android terminal is overcome; simple voice instructions are adopted to replace complex key operation instructions, the operation cost of remote controller interaction is reduced, and the efficiency of split screen interaction is improved; the easily-read and easily-understood voice instruction also reduces the learning cost of split screen interaction, and is beneficial to the user to accept and use the split screen function.
Exemplary device
As shown in fig. 6, corresponding to the split screen control method, an embodiment of the present invention further provides a split screen control device, where the split screen control device includes:
and a voice information obtaining module 410, configured to obtain voice information of the target object.
The target object is a user needing to control the target terminal. The voice information includes audio data corresponding to the voice of the user, and the voice information may be acquired in real time and in the field of the target terminal, or the user may generate corresponding voice information in a far-field voice manner, which is not limited specifically herein.
And a split-screen control instruction information obtaining module 420, configured to obtain split-screen control instruction information based on the voice information.
Specifically, the screen splitting control instruction information can be acquired after voice character recognition is performed on the voice information, and the voice information and the screen splitting control instruction information can be matched and corresponding based on a preset and trained neural network model, so that the corresponding screen splitting control instruction information is acquired. Other acquisition methods are also possible and are not specifically limited herein.
And the control module 430 is configured to control the target terminal to perform a corresponding screen splitting operation based on the screen splitting control instruction information.
Specifically, in this embodiment, the split-screen control instruction information is information corresponding to the split-screen control instruction, for example, a certain application is opened in a split-screen window, or a certain current split-screen window is enlarged and another current split-screen window is reduced. The target terminal is a display terminal that a user needs to perform split screen control, and the target terminal may be a computer, a tablet computer, a mobile phone, a television, an education machine, an advertisement machine, a conference machine, an automobile-mounted display screen, a projector, or other terminal equipment with a display function, and is not limited specifically here. In this embodiment, the target terminal is based on an Android system. In this embodiment, based on the obtained split-screen control instruction information, the target terminal is controlled to perform corresponding split-screen operations, for example, enter a split screen, open more than two split-screen windows, switch a window position, switch a window size (for example, enlarge or reduce a certain split-screen window), open a certain application in a certain split-screen window, exit the split screen, and the like. The content of the specific split-screen control instruction information and the corresponding split-screen control operation can be set and adjusted according to actual requirements, for example, a specific magnification factor when a certain split-screen window is magnified can be set according to actual requirements, and no specific limitation is made herein.
As can be seen from the above, the split-screen control apparatus provided in the embodiment of the present invention obtains the voice information of the target object through the voice information obtaining module 410; acquiring split-screen control instruction information based on the voice information through a split-screen control instruction information acquisition module 420; and controlling the target terminal to perform corresponding screen splitting operation based on the screen splitting control instruction information through the control module 430. Compared with the scheme of performing screen splitting control through touch operation of a user in the prior art, the scheme of the invention can control the target terminal to perform corresponding screen splitting operation based on the acquired voice information, so that the target object can perform screen splitting control on the target terminal through voice without requiring the screen of the display terminal to support touch operation. Therefore, the scheme of the invention is beneficial to the split screen control of the display terminal of which the screen does not support touch operation, and the split screen control is simpler, thereby improving the use experience of a user.
Specifically, in this embodiment, the specific functions of each module of the split-screen control device may also refer to the corresponding descriptions in the split-screen control method, which are not described herein again.
Furthermore, each module of the split screen control device and the corresponding function thereof may be divided and adjusted according to actual requirements, which is not specifically limited herein. In an application scenario, the split-screen control device may include a voice acquisition module, a voice recognition module, a semantic recognition module, an instruction distribution module, and a multi-window management module, as shown in fig. 7, fig. 7 is a schematic flow diagram illustrating a split-screen control of a target terminal by the split-screen control device according to an embodiment of the present invention. Specifically, a user sends out voice, the voice acquisition module acquires the voice of the user to obtain corresponding audio data, the voice recognition module recognizes the audio data to obtain corresponding voice text content, and the semantic recognition module recognizes the voice text content to obtain corresponding instruction content. When the instruction distribution module identifies that the instruction content corresponds to the split-screen interaction instruction, the instruction is sent to the multi-window management module, and the multi-window sends corresponding split-screen control instruction information to the target terminal based on the instruction content, so that the target terminal is controlled to realize corresponding split-screen operation.
Based on the above embodiment, the present invention further provides an intelligent terminal, and a schematic block diagram thereof may be as shown in fig. 8. The intelligent terminal comprises a processor, a memory, a network interface and a display screen which are connected through a system bus. Wherein, the processor of the intelligent terminal is used for providing calculation and control capability. The memory of the intelligent terminal comprises a nonvolatile storage medium and an internal memory. The nonvolatile storage medium stores an operating system and a split screen control program. The internal memory provides an environment for the operation of an operating system and a split screen control program in the nonvolatile storage medium. The network interface of the intelligent terminal is used for being connected and communicated with an external terminal through a network. The split screen control program realizes the steps of any one of the split screen control methods when executed by the processor. The display screen of the intelligent terminal can be a liquid crystal display screen or an electronic ink display screen.
It will be understood by those skilled in the art that the block diagram of fig. 8 is only a block diagram of a part of the structure related to the solution of the present invention, and does not constitute a limitation to the intelligent terminal to which the solution of the present invention is applied, and a specific intelligent terminal may include more or less components than those shown in the figure, or combine some components, or have different arrangements of components.
In one embodiment, an intelligent terminal is provided, where the intelligent terminal includes a memory, a processor, and a split-screen control program stored in the memory and executable on the processor, and the split-screen control program performs the following operation instructions when executed by the processor:
acquiring voice information of a target object;
acquiring split screen control instruction information based on the voice information;
and controlling the target terminal to perform corresponding screen splitting operation based on the screen splitting control instruction information.
The embodiment of the present invention further provides a computer-readable storage medium, where a split-screen control program is stored in the computer-readable storage medium, and when the split-screen control program is executed by a processor, the steps of any one of the split-screen control methods provided in the embodiments of the present invention are implemented.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned functions may be distributed as different functional units and modules according to needs, that is, the internal structure of the apparatus may be divided into different functional units or modules to implement all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art would appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the above modules or units is only one logical division, and the actual implementation may be implemented by another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed.
The integrated modules/units described above, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium and can implement the steps of the embodiments of the method when the computer program is executed by a processor. The computer program includes computer program code, and the computer program code may be in a source code form, an object code form, an executable file or some intermediate form. The computer readable medium may include: any entity or device capable of carrying the above-mentioned computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signal, telecommunication signal, software distribution medium, etc. It should be noted that the contents contained in the computer-readable storage medium can be increased or decreased as required by legislation and patent practice in the jurisdiction.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art; the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein.
Claims (10)
1. A split screen control method, characterized in that the method comprises:
acquiring voice information of a target object;
acquiring split screen control instruction information based on the voice information;
and controlling the target terminal to perform corresponding screen splitting operation based on the screen splitting control instruction information.
2. The screen-splitting control method of claim 1, wherein the acquiring of the voice information of the target object comprises: and acquiring the voice information of the target object through an audio acquisition terminal.
3. The screen-splitting control method of claim 2, wherein the target terminal is a television, and the audio acquisition terminal is a remote controller of the television.
4. The screen splitting control method according to claim 1, wherein the acquiring of the screen splitting control instruction information based on the voice information includes:
analyzing the voice information to obtain text information;
and acquiring split screen control instruction information based on the text information.
5. The screen division control method of claim 1, wherein prior to the obtaining of the voice information of the target object, the method further comprises:
and when the target object triggers voice input, controlling the target terminal to mark the serial number of the currently opened split screen window.
6. The split-screen control method of claim 1, wherein the split-screen control information comprises at least one of opening a split screen, exiting a split screen, splicing a target application, switching to a target split screen window, swapping a first target split screen window and a second target split screen window, enlarging the target split screen window, reducing the target split screen window, and closing the target split screen window.
7. The screen splitting control method of claim 6, wherein the controlling of the target terminal to perform the corresponding screen splitting operation based on the screen splitting control instruction information comprises:
when the split screen control information is that split screen is started, controlling the target terminal to enter a split screen mode, and displaying a split screen application list;
when the split screen control information indicates that the split screen is quitted, controlling the target terminal to close all split screen windows and quitting the split screen mode;
when the split-screen control information is a spliced target application, controlling the target terminal to open the target application in a new split-screen window, and splicing the new split-screen window with other split-screen windows which are already opened;
when the split-screen control information is that the split-screen window is switched to a target split-screen window, controlling the target terminal to switch the target split-screen window to a main window;
and when the split-screen control information is to exchange a first target split-screen window and a second target split-screen window, controlling the target terminal to exchange the positions and the sizes of the first target split-screen window and the second target window.
8. A split screen control apparatus, the apparatus comprising:
the voice information acquisition module is used for acquiring the voice information of the target object;
the split screen control instruction information acquisition module is used for acquiring split screen control instruction information based on the voice information;
and the control module is used for controlling the target terminal to perform corresponding screen splitting operation based on the screen splitting control instruction information.
9. An intelligent terminal, characterized in that the intelligent terminal comprises a memory, a processor and a split-screen control program stored on the memory and operable on the processor, wherein the split-screen control program, when executed by the processor, implements the steps of the split-screen control method according to any one of claims 1 to 7.
10. A computer-readable storage medium, having a screen-splitting control program stored thereon, which, when executed by a processor, implements the steps of the screen-splitting control method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110757625.2A CN113568556A (en) | 2021-07-05 | 2021-07-05 | Split screen control method and device, intelligent terminal and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110757625.2A CN113568556A (en) | 2021-07-05 | 2021-07-05 | Split screen control method and device, intelligent terminal and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113568556A true CN113568556A (en) | 2021-10-29 |
Family
ID=78163718
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110757625.2A Pending CN113568556A (en) | 2021-07-05 | 2021-07-05 | Split screen control method and device, intelligent terminal and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113568556A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103678047A (en) * | 2012-09-21 | 2014-03-26 | 联想(北京)有限公司 | Data processing method and electronic equipment |
| CN106537319A (en) * | 2016-10-31 | 2017-03-22 | 北京小米移动软件有限公司 | Screen-splitting display method and device |
| CN109309751A (en) * | 2017-07-28 | 2019-02-05 | 腾讯科技（深圳）有限公司 | Voice recording method, electronic equipment and storage medium |
| CN109992336A (en) * | 2018-01-03 | 2019-07-09 | 阿里巴巴集团控股有限公司 | A kind of interface display method, device, terminal device and storage medium |
| CN110910872A (en) * | 2019-09-30 | 2020-03-24 | 华为终端有限公司 | Voice interaction method and device |
| CN111638847A (en) * | 2020-05-27 | 2020-09-08 | 维沃移动通信有限公司 | Split screen display method and device and electronic equipment |
-
2021
- 2021-07-05 CN CN202110757625.2A patent/CN113568556A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103678047A (en) * | 2012-09-21 | 2014-03-26 | 联想(北京)有限公司 | Data processing method and electronic equipment |
| CN106537319A (en) * | 2016-10-31 | 2017-03-22 | 北京小米移动软件有限公司 | Screen-splitting display method and device |
| CN109309751A (en) * | 2017-07-28 | 2019-02-05 | 腾讯科技（深圳）有限公司 | Voice recording method, electronic equipment and storage medium |
| CN109992336A (en) * | 2018-01-03 | 2019-07-09 | 阿里巴巴集团控股有限公司 | A kind of interface display method, device, terminal device and storage medium |
| CN110910872A (en) * | 2019-09-30 | 2020-03-24 | 华为终端有限公司 | Voice interaction method and device |
| CN111638847A (en) * | 2020-05-27 | 2020-09-08 | 维沃移动通信有限公司 | Split screen display method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109196464A (en) | User agent based on context | |
| CN111935532B (en) | Video interaction method and device, electronic equipment and storage medium | |
| CN112148181B (en) | Menu display method and device, electronic equipment and storage medium | |
| CN113282424B (en) | Information reference method and device and electronic equipment | |
| EP3438952A1 (en) | Systems and methods for intelligent generation of inclusive system designs | |
| CN109002184A (en) | A kind of association method and device of input method candidate word | |
| US20230244363A1 (en) | Screen capture method and apparatus, and electronic device | |
| CN109144447B (en) | Split screen window adjusting method and device, storage medium and electronic equipment | |
| CN115357173A (en) | Screen control method and device and electronic equipment | |
| CN112698895A (en) | Display method, device, equipment and medium of electronic equipment | |
| WO2022257916A1 (en) | Recommendation method and apparatus | |
| CN114661219A (en) | Device control method, device, storage medium and electronic device | |
| CN112148167A (en) | Control setting method and device and electronic equipment | |
| CN115357158A (en) | Message processing method and device, electronic equipment and storage medium | |
| CN111897475A (en) | Message viewing method and device | |
| CN114063845A (en) | Display method, display device and electronic equipment | |
| WO2024037419A1 (en) | Display control method and apparatus, electronic device, and readable storage medium | |
| CN113485779A (en) | Operation guiding method and device for application program | |
| CN113672327A (en) | Application notification split-screen interaction method and device, intelligent terminal and storage medium | |
| CN112306320A (en) | Page display method, device, equipment and medium | |
| CN112565912B (en) | Video call method and device, electronic equipment and readable storage medium | |
| CN112306601A (en) | Application interaction method and device, electronic equipment and storage medium | |
| CN107179837A (en) | Input method and device | |
| CN111625176A (en) | Device control method, device, storage medium and electronic device | |
| CN113568556A (en) | Split screen control method and device, intelligent terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |