CN112799577B - Method, terminal and storage medium for projecting small window - Google Patents
Method, terminal and storage medium for projecting small window Download PDFInfo
- Publication number
- CN112799577B CN112799577B CN202110103586.4A CN202110103586A CN112799577B CN 112799577 B CN112799577 B CN 112799577B CN 202110103586 A CN202110103586 A CN 202110103586A CN 112799577 B CN112799577 B CN 112799577B
- Authority
- CN
- China
- Prior art keywords
- screen
- reverse control
- small window
- screen end
- small
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 230000002441 reversible effect Effects 0.000 claims abstract description 102
- 230000001960 triggered effect Effects 0.000 claims abstract description 43
- 230000003993 interaction Effects 0.000 claims abstract description 32
- 238000004891 communication Methods 0.000 claims description 14
- 238000013507 mapping Methods 0.000 claims description 8
- 238000012795 verification Methods 0.000 claims description 8
- 230000006870 function Effects 0.000 description 16
- 230000008569 process Effects 0.000 description 16
- 238000005516 engineering process Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 5
- 230000002452 interceptive effect Effects 0.000 description 4
- 238000010295 mobile communication Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 230000009977 dual effect Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
Abstract
The embodiment of the invention discloses a method for projecting a small window, a terminal and a storage medium, and belongs to the technical field of terminal projection. The method is based on a large screen end and comprises the following steps: receiving interface content sent by an application displayed by a small window on a small screen end, and displaying the interface content on a current screen in a full screen manner; and detecting whether a reverse control mode is triggered, and sending a reverse control instruction to an application displayed by a small window on the small screen end when the reverse control mode is triggered so as to realize corresponding application interaction operation. According to the technical scheme, the technical problem that applications such as games in the prior art which need frequent interaction cannot enjoy convenience brought by small window projection can be effectively solved.
Description
Technical Field
The embodiment of the invention relates to the technical field of terminal screen projection, in particular to a method for projecting a small window screen, a terminal and a storage medium.
Background
Currently, a small window screen-throwing function has been implemented on some mobile phones, and the principle of small window screen throwing is similar to that of a computer using a dual display, except that the host becomes a mobile phone processor and the dual display becomes a mobile phone screen and a device to be thrown. In the screen throwing process, an application can be placed in the small window, at the moment, the screen throwing only projects the interface content of the application in the small window, and the mobile phone is released to do other work. However, in the existing small window screen projection technology, since the mobile phone picture is displayed on the large screen device during screen projection, at this time, the display of the mobile phone screen is not necessary, and the purpose that the small window screen projection is designed is that the mobile phone can be released during screen projection, so that the mobile phone is generally used for projecting audio and video applications. However, if the application is an application such as a game which needs frequent interaction, the application cannot enjoy the convenience brought by the small window screen projection.
Disclosure of Invention
The embodiment of the invention mainly aims to provide a method, a terminal and a storage medium for projecting a small window, and aims to solve the technical problem that applications requiring frequent interaction such as games in the prior art cannot enjoy the convenience brought by projecting the small window.
In order to achieve the above object, an embodiment of the present invention provides a method for projecting a small window, based on a large screen end, the method includes the following steps: receiving interface content sent by an application displayed by a small window on a small screen end, and displaying the interface content on a current screen in a full screen manner; and detecting whether a reverse control mode is triggered, and sending a reverse control instruction to an application displayed by a small window on the small screen end when the reverse control mode is triggered so as to realize corresponding application interaction operation.
Optionally, the step of receiving the interface content sent by the application displayed by the small window on the small screen end and displaying the interface content on the current screen in a full screen further includes: and receiving a small window screen-throwing instruction sent by the small screen end so as to establish wireless screen-throwing connection with the small screen end under the small window screen-throwing instruction.
Optionally, the step of detecting whether to trigger the reverse control mode specifically includes: detecting whether a preset trigger instruction is received or not, and triggering the reverse control mode when the preset trigger instruction is received.
Optionally, when the reverse control mode is triggered, a reverse control instruction is sent to an application displayed by a small window on the small screen end, so as to implement corresponding application interaction operation, where the steps include: and when the reverse control mode is triggered, a reverse control request is sent to the small screen end, and when the reverse control request passes verification, a current input event is converted into a control instruction required by the application displayed by the small window on the small screen end according to a preset mapping relation table so as to reversely control the application displayed by the small window on the small screen end, thereby realizing corresponding application interaction operation.
In addition, in order to achieve the above purpose, the embodiment of the present invention further provides a method for projecting a small window, based on a small screen end, the method includes the following steps: detecting whether a current application triggers a small window screen-throwing mode, displaying the current application in a small window on a current screen when the small window screen-throwing mode is triggered, and sending interface content of the current application to a large screen end so as to display the interface content in a full screen mode through a screen of the large screen end; and detecting whether a reverse control mode is triggered or not, and responding to a reverse control instruction of the large screen end to the current application when the reverse control mode is triggered so as to realize corresponding application interaction operation.
Optionally, the step of detecting whether the current application triggers a small window screen-throwing mode, and displaying the current application in a small window on a current screen when the small window screen-throwing mode is triggered, and sending the interface content of the current application to a large screen end so as to display the interface content in a full screen through a screen of the large screen end specifically includes: detecting whether a small window screen-throwing mode is triggered by the current application, and sending a small window screen-throwing instruction to the large screen end when the small window screen-throwing mode is triggered so as to establish wireless screen-throwing connection with the large screen end under the small window screen-throwing instruction; and displaying the current application on a current screen in a small window, and sending the interface content of the current application to the large screen end so as to display the interface content in a full screen mode through the screen of the large screen end.
Optionally, the step of detecting whether to trigger the reverse control mode specifically includes: and detecting whether a reverse control request sent by the large screen end is received, and triggering the reverse control mode when the reverse control request is received.
Optionally, when the reverse control mode is triggered, responding to a reverse control instruction of the large screen end to the current application, so as to implement a corresponding application interaction operation specifically includes: and when the reverse control mode is triggered, verifying a reverse control request sent by the large screen end, and when the reverse control request passes the verification, receiving the operation of converting the current input event of the large screen end into a control instruction required by the current application by the large screen end according to a preset mapping relation table, so as to respond to the reverse control instruction of the large screen end on the current application, and realizing corresponding application interaction operation.
In addition, in order to achieve the above object, an embodiment of the present invention also proposes a terminal including a memory, a processor, a program stored on the memory and executable on the processor, and a data bus for implementing connection communication between the processor and the memory, the program implementing the steps of the above method when executed by the processor.
In addition, to achieve the above object, an embodiment of the present invention also proposes a storage medium for computer-readable storage, the storage medium storing one or more programs executable by one or more processors to implement the steps of the above method.
According to the method, the terminal and the storage medium for small window screen projection, when the large screen end performs small window screen projection, on one hand, interface content sent by an application displayed by a small window on the small screen end is received, and the interface content is displayed on the current screen in a full screen mode. On the other hand, when the reverse control mode is triggered, a reverse control instruction can be sent to the application displayed by the small window on the small screen end so as to realize corresponding application interaction operation. Similarly, when the small screen end performs small window screen projection, on one hand, the current application is displayed on the current screen by the small window, and the interface content of the current application is sent to the large screen end so as to display the interface content through the screen of the large screen end in a full screen mode. On the other hand, when the reverse control mode is triggered, the large screen end responds to a reverse control instruction of the current application so as to realize corresponding application interaction operation. Therefore, by combining the small window screen projection technology and the reverse control technology in screen projection, the technology can ensure that applications such as games and the like needing frequent interaction can also release the small screen end through reverse control of the large screen end when the small window screen projection is carried out, so that any type of application can enjoy the convenience brought by the large screen and the small screen. Therefore, the technical scheme can effectively solve the technical problem that applications requiring frequent interaction such as games in the prior art cannot enjoy convenience brought by small window projection.
Drawings
Fig. 1 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention.
Fig. 2 is a diagram of a communication network system architecture on which the mobile terminal shown in fig. 1 is based.
Fig. 3 is a flowchart of a method for projecting a small window according to an embodiment of the present invention.
Fig. 4 is a flowchart of a method for projecting a two-window screen according to an embodiment of the present invention.
Fig. 5 is a specific flowchart of step S210 of the method for projecting a small window in fig. 4.
Fig. 6 is a block diagram of a third terminal according to an embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
In the following description, suffixes such as "module", "component", or "unit" for representing elements are used only for facilitating the description of the present invention, and have no specific meaning per se. Thus, "module," "component," or "unit" may be used in combination.
The terminal may be implemented in various forms. For example, the terminals described in the present invention may include mobile terminals such as a mobile phone, a tablet computer, a notebook computer, a palm computer, a Personal digital assistant (Personal DIGITAL ASSISTANT, PDA), a Portable media player (Portable MEDIA PLAYER, PMP), a navigation device, a wearable device, a smart bracelet, a pedometer, and the like, as well as fixed terminals such as a digital TV, a desktop computer, and the like.
The following description will be given taking a mobile terminal as an example, and those skilled in the art will understand that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for a moving purpose.
Referring to fig. 1, which is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention, the mobile terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an a/V (audio/video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. Those skilled in the art will appreciate that the mobile terminal structure shown in fig. 1 is not limiting of the mobile terminal and that the mobile terminal may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
The following describes the components of the mobile terminal in detail with reference to fig. 1:
The radio frequency unit 101 may be used for receiving and transmitting signals during a message or a call, specifically, receiving a downlink message of a base station, and then processing the downlink message with the processor 110; and, the uplink data is transmitted to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, global System for Mobile communications), GPRS (GENERAL PACKET Radio Service), CDMA2000 (Code Division Multiple Access, code Division multiple Access 2000), WCDMA (Wideband Code Division Multiple Access ), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, time Division synchronous code Division multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency Division Duplex Long term evolution) and TDD-LTE (Time Division Duplexing-Long Term Evolution, time Division Duplex Long term evolution), etc.
WiFi belongs to a short-distance wireless transmission technology, and a mobile terminal can help a user to send and receive e-mails, browse web pages, access streaming media and the like through the WiFi module 102, so that wireless broadband Internet access is provided for the user. Although fig. 1 shows a WiFi module 102, it is understood that it does not belong to the necessary constitution of a mobile terminal, and can be omitted entirely as required within a range that does not change the essence of the invention.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output (e.g., a call signal reception sound, a message reception sound, etc.) related to a specific function performed by the mobile terminal 100. The audio output unit 103 may include a speaker, a buzzer, and the like.
The a/V input unit 104 is used to receive an audio or video signal. The a/V input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, the graphics processor 1041 processing image data of still pictures or video obtained by an image capturing device (e.g. a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound into audio data. The processed audio (voice) data may be converted into a format output that can be transmitted to the mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting the audio signal.
The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and the proximity sensor can turn off the display panel 1061 and/or the backlight when the mobile terminal 100 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when stationary, and can be used for applications of recognizing the gesture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; as for other sensors such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that may also be configured in the mobile phone, the detailed description thereof will be omitted.
The display unit 106 is used to display a message input by a user or a message provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a Liquid crystal display (Liquid CRYSTAL DISPLAY, LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 107 may be used to receive an input numeric or character message and to generate key signal inputs related to user settings and function control of the mobile terminal. In particular, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 1071 or thereabout by using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives a touch message from the touch detection device and converts it into touch point coordinates, which are then sent to the processor 110, and can receive commands from the processor 110 and execute them. Further, the touch panel 1071 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 107 may include other input devices 1072 in addition to the touch panel 1071. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, mouse, joystick, etc., as specifically not limited herein.
Further, the touch panel 1071 may overlay the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or thereabout, the touch panel 1071 is transferred to the processor 110 to determine the type of touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of touch event. Although in fig. 1, the touch panel 1071 and the display panel 1061 are two independent components for implementing the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 may be integrated with the display panel 1061 to implement the input and output functions of the mobile terminal, which is not limited herein.
The interface unit 108 serves as an interface through which at least one external device can be connected with the mobile terminal 100. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data messages, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.
Memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area that may store an operating system, application programs required for at least one function (such as a sound playing function, an image playing function, etc.), and a storage data area; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by running or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The mobile terminal 100 may further include a power source 111 (e.g., a battery) for supplying power to the respective components, and preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to perform functions of managing charging, discharging, and power consumption management through the power management system.
Although not shown in fig. 1, the mobile terminal 100 may further include a bluetooth module or the like, which is not described herein.
In order to facilitate understanding of the embodiments of the present invention, a communication network system on which the mobile terminal of the present invention is based will be described below.
Referring to fig. 2, fig. 2 is a schematic diagram of a communication network system according to an embodiment of the present invention, where the communication network system is an LTE system of a general mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an e-UTRAN (Evolved UMTS Terrestrial Radio Access Network ) 202, an epc (Evolved Packet Core, evolved packet core) 203, and an IP service 204 of an operator that are sequentially connected in communication.
Specifically, the UE201 may be the terminal 100 described above, and will not be described herein.
The E-UTRAN202 includes eNodeB2021 and other eNodeB2022, etc. The eNodeB2021 may be connected with other eNodeB2022 by a backhaul (e.g., an X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide access from the UE201 to the EPC 203.
EPC203 may include MME (Mobility MANAGEMENT ENTITY ) 2031, hss (Home Subscriber Server, home subscriber server) 2032, other MMEs 2033, SGW (SERVING GATE WAY ) 2034, pgw (PDN GATE WAY, packet data network gateway) 2035, PCRF (Policy AND CHARGING Rules Function) 2036, and so on. The MME2031 is a control node that handles signaling between the UE201 and EPC203, providing bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location registers (not shown) and to hold subscriber-specific messages regarding service characteristics, data rates, etc. All user data may be sent through SGW2034 and PGW2035 may provide IP address allocation and other functions for UE201, PCRF2036 is a policy and charging control policy decision point for traffic data flows and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).
IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem ), or other IP services, etc.
Although the LTE system is described above as an example, it should be understood by those skilled in the art that the present invention is not limited to LTE systems, but may be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems.
Based on the above mobile terminal hardware structure and the communication network system, various embodiments of the method of the present invention are provided.
Example 1
As shown in fig. 3, a first embodiment of the present invention provides a method for projecting a small window, based on a large screen end, the method specifically includes the following steps:
Step S110: and receiving interface contents sent by an application displayed by a small window on the small screen end, and displaying the interface contents on the current screen in a full screen mode.
Specifically, to realize the screen-throwing of the small window between two terminals (a large screen end and a small screen end), a wireless screen-throwing connection needs to be established between the two terminals, so before the step of executing the method is executed, the step of receiving interface content sent by an application displayed by the small window on the small screen end and displaying the interface content on the current screen in a full screen is executed, the method further comprises the following steps: and receiving a small window screen-throwing instruction sent by the small screen end so as to establish wireless screen-throwing connection with the small screen end under the small window screen-throwing instruction.
The small screen end generally refers to a mobile phone or a tablet computer, and the large screen end generally refers to a television or a computer. The small screen end can send a small window screen throwing instruction to the large screen end by shaking or touching the large screen end nearby the large screen end or performing specific operation on the terminal, and when the large screen end receives the small window screen throwing instruction, wireless screen throwing connection can be established with the small screen end under the small window screen throwing instruction.
Step S120: and detecting whether a reverse control mode is triggered, and sending a reverse control instruction to an application displayed by a small window on the small screen end when the reverse control mode is triggered so as to realize corresponding application interaction operation.
Specifically, after the small window is projected by the application on the small screen end, not all applications need to perform corresponding application interaction operation, that is, in general, when the small window is projected by the application on the small screen end, the large screen end only displays the interface content sent by the application displayed by the small window on the small screen end on the current screen in a full screen manner, and only when the large screen end triggers the reverse control mode, a reverse control instruction is sent to the application displayed by the small window on the small screen end so as to realize corresponding application interaction operation.
The specific process of detecting whether to trigger the reverse control mode in the above steps is as follows: detecting whether a preset trigger instruction is received or not, and triggering a reverse control mode when the preset trigger instruction is received. Namely, a user can input a preset trigger instruction to the large screen end through an input device (such as a mouse, a keyboard or a touch screen and the like) of the large screen end, and when the large screen end receives the preset trigger instruction, a reverse control mode is triggered, and a reverse control instruction is sent to an application displayed by a small window on the small screen end so as to realize corresponding application interactive operation, and the specific process is as follows: when the reverse control mode is triggered, a reverse control request is sent to the small screen end, when the reverse control request passes verification, a current input event is converted into a control instruction required by an application displayed by a small window on the small screen end according to a preset mapping relation table, so that the application displayed by the small window on the small screen end is reversely controlled, and corresponding application interactive operation is realized.
Taking a small screen terminal using an android system as an example, in an android frame, a MotionEvent event has an attribute deviceId for indicating from which device the event originates, and the frame also predefines a number of event sources, such as an external keyboard, an external mouse, a screen touch, etc., and these definitions are located in the inputdevice. We can modify the framework by adding an event source at inputDevice, indicating that the event source is a screen shot reverse control. When the large screen end sends a reverse control request to the small screen end and the reverse control request passes verification, the large screen end converts a current input event (such as a key mouse input event) into information required by a corresponding MotionEvent of the android device according to a mapping table and sends the information to the small screen end (namely); after the small screen end receives the information, the information is assembled into a MotionEvent event, the event is injected into the android frame, and the deviceId attribute is set as the reverse control id added by us in the assembling process; at this time, the large screen end can reversely control the application displayed by the small window on the small screen end through the input equipment of the large screen end, so that corresponding application interaction operation is realized.
Example two
As shown in fig. 4, a second embodiment of the present invention provides a method for projecting a small window, based on a small screen end, the method includes the following steps:
step S210: detecting whether the current application triggers a small window screen-throwing mode, displaying the current application in a small window on a current screen when the small window screen-throwing mode is triggered, and sending the interface content of the current application to a large screen end so as to display the interface content through the screen of the large screen end in a full screen mode.
Specifically, to realize the small window screen-throwing between two terminals (large screen end and small screen end), a wireless screen-throwing connection needs to be established between the two terminals at the same time, so, as shown in fig. 5, when the method is executed, the specific process of detecting whether the current application triggers the small window screen-throwing mode, displaying the current application on the current screen by the small window and sending the interface content of the current application to the large screen end so as to display the interface content through the screen full screen of the large screen end is as follows:
Step S221: and detecting whether the current application triggers a small window screen-throwing mode, and sending a small window screen-throwing instruction to a large screen end when the small window screen-throwing mode is triggered so as to establish wireless screen-throwing connection with the large screen end under the small window screen-throwing instruction.
Step S222: and displaying the current application on the current screen in a small window, and sending the interface content of the current application to the large screen end so as to display the interface content through the screen of the large screen end in a full screen mode.
When the current application on the small screen end triggers the small window screen-throwing mode, a small window screen-throwing instruction is sent to the large screen end, so that wireless screen-throwing connection is established with the large screen end under the small window screen-throwing instruction. When the wireless screen-throwing connection is established, on one hand, the current application can be displayed in a small window on the current screen, and the small window display can be in the form of a suspension ball or other small-area display on the current screen without affecting the display of a terminal desktop or other application interfaces. And on the other hand, the interface content of the current application is sent to the large screen end so as to display the interface content through the screen of the large screen end in a full screen mode, namely, the interface content of the current application is sent to the large screen end for 1, and the screen of the small screen end is released so as to be capable of doing other works.
Step S220: detecting whether the reverse control mode is triggered or not, and responding to a reverse control instruction of the large screen end to the current application when the reverse control mode is triggered so as to realize corresponding application interaction operation.
Specifically, after the small window is projected by the application on the small screen end, not all applications need to perform corresponding application interaction operation, that is, in general, when the small window is projected by the application on the small screen end, the large screen end only displays the interface content sent by the application displayed by the small window on the small screen end on the current screen in a full screen manner, and only when the large screen end triggers a reverse control mode, the large screen end responds to a reverse control instruction of the current application so as to realize corresponding application interaction operation.
Since the reverse control mode of the small screen end is a response based on the triggering of the reverse control mode of the large screen end, the specific process of detecting whether to trigger the reverse control mode in the above steps is as follows: and detecting whether a reverse control request sent by the large screen end is received, and triggering a reverse control mode when the reverse control request is received. The user can input a preset trigger instruction to the large screen end through an input device (such as a mouse, a keyboard or a touch screen) of the large screen end, when the large screen end receives the preset trigger instruction, the large screen end triggers the reverse control mode, a reverse control request is sent to an application displayed by a small window on the small screen end, and when the small screen end receives the reverse control request, the reverse control mode is triggered. Meanwhile, when the reverse control mode is triggered, responding to a reverse control instruction of the large screen end to the current application so as to realize corresponding application interactive operation, wherein the specific process is as follows: when the reverse control mode is triggered, verifying a reverse control request sent by the large screen end, and when the reverse control request passes the verification, receiving the operation that the large screen end converts the current input event of the large screen end into a control instruction required by the current application according to a preset mapping relation table, so as to respond to the reverse control instruction of the large screen end to the current application, and realizing corresponding application interactive operation.
Taking a small screen terminal using an android system as an example, in an android frame, a MotionEvent event has an attribute deviceId for indicating from which device the event originates, and the frame also predefines a number of event sources, such as an external keyboard, an external mouse, a screen touch, etc., and these definitions are located in the inputdevice. We can modify the framework by adding an event source at inputDevice, indicating that the event source is a screen shot reverse control. When the large screen end sends a reverse control request to the small screen end and the reverse control request passes verification, the large screen end converts a current input event (such as a key mouse input event) into information required by a corresponding MotionEvent of the android device according to a mapping table and sends the information to the small screen end (namely); after the small screen end receives the information, the information is assembled into a MotionEvent event, the event is injected into the android frame, and the deviceId attribute is set as the reverse control id added by us in the assembling process; at this time, the large screen end can reversely control the application displayed by the small window on the small screen end through the input equipment of the large screen end, so that corresponding application interaction operation is realized.
Example III
As shown in fig. 6, a third embodiment of the present invention proposes a terminal 20, where the terminal 20 includes a memory 21, a processor 22, a program stored on the memory and capable of running on the processor, and a data bus 23 for implementing connection communication between the processor 21 and the memory 22, and the program is executed by the processor to implement the steps of the method for projecting a small window in the above embodiment, which is specifically described above and will not be repeated herein.
It should be noted that the embodiment of the terminal 20 and the embodiment of the method in the embodiment of the present invention belong to the same concept, the detailed implementation process of the embodiment of the method in the embodiment of the present invention is shown in the embodiment of the method in the embodiment one, and the technical features in the embodiment of the method in the embodiment one are correspondingly applicable in the embodiment of the terminal 20, and are not repeated herein.
Example IV
The fourth embodiment of the present invention proposes a storage medium for computer readable storage, where one or more programs are stored, and the one or more programs may be executed by one or more processors, so as to implement the specific steps of the method for projecting a small window in the first embodiment.
It should be noted that the storage medium and the method embodiment belong to the same concept, the detailed implementation process of the storage medium and the method embodiment one are shown in the method embodiment one, and the technical features in the method embodiment one are correspondingly applicable to the storage medium embodiment, which is not repeated herein.
According to the method, the terminal and the storage medium for small window screen projection, when the large screen end performs small window screen projection, on one hand, interface content sent by an application displayed by a small window on the small screen end is received, and the interface content is displayed on the current screen in a full screen mode. On the other hand, when the reverse control mode is triggered, a reverse control instruction can be sent to the application displayed by the small window on the small screen end so as to realize corresponding application interaction operation. Similarly, when the small screen end performs small window screen projection, on one hand, the current application is displayed on the current screen by the small window, and the interface content of the current application is sent to the large screen end so as to display the interface content through the screen of the large screen end in a full screen mode. On the other hand, when the reverse control mode is triggered, the large screen end responds to a reverse control instruction of the current application so as to realize corresponding application interaction operation. Therefore, by combining the small window screen projection technology and the reverse control technology in screen projection, the technology can ensure that applications such as games and the like needing frequent interaction can also release the small screen end through reverse control of the large screen end when the small window screen projection is carried out, so that any type of application can enjoy the convenience brought by the large screen and the small screen. Therefore, the technical scheme can effectively solve the technical problem that applications requiring frequent interaction such as games in the prior art cannot enjoy convenience brought by small window projection.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (6)
1. A method for projecting a small window based on a large screen end, comprising the following steps:
Receiving interface content sent by an application displayed by a small window on a small screen end, and displaying the interface content on a current screen in a full screen manner;
Detecting whether a reverse control mode is triggered or not, and sending a reverse control instruction to an application displayed by a small window on the small screen end when the reverse control mode is triggered so as to realize corresponding application interaction operation;
the step of receiving the interface content sent by the application displayed by the small window on the small screen end and displaying the interface content on the current screen in a full screen mode, and the method further comprises the following steps:
Receiving a small window screen-throwing instruction sent by the small screen end, and establishing wireless screen-throwing connection with the small screen end under the small window screen-throwing instruction;
when the reverse control mode is triggered, a reverse control instruction is sent to an application displayed by a small window on the small screen end, so that corresponding application interaction operation is realized, and the method comprises the following steps:
And when the reverse control mode is triggered, a reverse control request is sent to the small screen end, and when the reverse control request passes verification, a current input event is converted into a control instruction required by the application displayed by the small window on the small screen end according to a preset mapping relation table so as to reversely control the application displayed by the small window on the small screen end, thereby realizing corresponding application interaction operation.
2. The method according to claim 1, wherein the step of detecting whether the reverse control mode is triggered comprises:
detecting whether a preset trigger instruction is received or not, and triggering the reverse control mode when the preset trigger instruction is received.
3. A method for projecting a small window based on a small screen end, comprising the following steps:
detecting whether a current application triggers a small window screen-throwing mode, displaying the current application in a small window on a current screen when the small window screen-throwing mode is triggered, and sending interface content of the current application to a large screen end so as to display the interface content in a full screen mode through a screen of the large screen end;
Detecting whether a reverse control mode is triggered or not, and responding to a reverse control instruction of the large screen end to the current application when the reverse control mode is triggered so as to realize corresponding application interaction operation;
The steps of detecting whether the current application triggers a small window screen-throwing mode, displaying the current application in a small window on a current screen when the small window screen-throwing mode is triggered, and sending the interface content of the current application to a large screen end so as to display the interface content in a full screen mode through the screen of the large screen end specifically comprise the following steps:
Detecting whether a small window screen-throwing mode is triggered by the current application, and sending a small window screen-throwing instruction to the large screen end when the small window screen-throwing mode is triggered so as to establish wireless screen-throwing connection with the large screen end under the small window screen-throwing instruction;
Displaying the current application on a current screen in a small window, and sending the interface content of the current application to the large screen end so as to display the interface content in a full screen mode through the screen of the large screen end;
when the reverse control mode is triggered, responding to a reverse control instruction of the large screen end to the current application, so as to realize corresponding application interaction operation, wherein the method specifically comprises the following steps of:
And when the reverse control mode is triggered, verifying a reverse control request sent by the large screen end, and when the reverse control request passes the verification, receiving the operation of converting the current input event of the large screen end into a control instruction required by the current application by the large screen end according to a preset mapping relation table, so as to respond to the reverse control instruction of the large screen end on the current application, and realizing corresponding application interaction operation.
4. A method according to claim 3, wherein the step of detecting whether the reverse control mode is triggered comprises:
And detecting whether a reverse control request sent by the large screen end is received, and triggering the reverse control mode when the reverse control request is received.
5. A terminal, comprising: a memory, a processor, a program stored on the memory and executable on the processor, and a data bus for enabling a connected communication between the processor and the memory, which program, when being executed by the processor, implements the steps of the method according to any of claims 1-4.
6. A storage medium for computer readable storage, wherein the storage medium stores one or more programs executable by one or more processors to implement the steps of the method of any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110103586.4A CN112799577B (en) | 2021-01-26 | 2021-01-26 | Method, terminal and storage medium for projecting small window |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110103586.4A CN112799577B (en) | 2021-01-26 | 2021-01-26 | Method, terminal and storage medium for projecting small window |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112799577A CN112799577A (en) | 2021-05-14 |
| CN112799577B true CN112799577B (en) | 2024-04-23 |
Family
ID=75811805
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110103586.4A Active CN112799577B (en) | 2021-01-26 | 2021-01-26 | Method, terminal and storage medium for projecting small window |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112799577B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113473217A (en) * | 2021-06-23 | 2021-10-01 | 四川长虹电器股份有限公司 | Screen projection connection method, device and system |
| CN113590248A (en) * | 2021-07-22 | 2021-11-02 | 上汽通用五菱汽车股份有限公司 | Screen projection method and device of vehicle-mounted terminal and readable storage medium |
| CN114063960A (en) * | 2021-11-22 | 2022-02-18 | 深圳创维－Rgb电子有限公司 | Large and small screen interaction method and device and computer readable storage medium |
| CN114281288A (en) * | 2021-12-10 | 2022-04-05 | 海宁奕斯伟集成电路设计有限公司 | Screen projection processing method and device and electronic equipment |
| CN114546239A (en) * | 2021-12-28 | 2022-05-27 | 浙江零跑科技股份有限公司 | Screen projection gesture operation method for intelligent cockpit copilot |
| CN114466239B (en) * | 2022-01-30 | 2023-04-25 | 深圳创维－Rgb电子有限公司 | Screen projection control method and device, screen projector and computer readable storage medium |
| CN114466230B (en) * | 2022-01-30 | 2024-06-04 | 深圳创维－Rgb电子有限公司 | Display equipment function expanding method and device, screen projector and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105681542A (en) * | 2014-11-21 | 2016-06-15 | 中兴通讯股份有限公司 | Information processing method and system and terminal |
| CN106371608A (en) * | 2016-09-21 | 2017-02-01 | 努比亚技术有限公司 | Display control method and device for screen projection |
| CN108668027A (en) * | 2018-05-22 | 2018-10-16 | 武汉卡比特信息有限公司 | Split screen projects the system and method for computer terminal and Reverse Turning Control when mobile phone interconnects |
| CN110175008A (en) * | 2019-04-11 | 2019-08-27 | 努比亚技术有限公司 | Method, wearable device and the computer readable storage medium of operating terminal |
| CN111880757A (en) * | 2020-06-30 | 2020-11-03 | 北京小米移动软件有限公司 | Screen projection method, screen projection device and storage medium |
| CN112162718A (en) * | 2020-10-16 | 2021-01-01 | 深圳乐播科技有限公司 | Reverse interaction method, device, equipment and storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6097679B2 (en) * | 2013-02-28 | 2017-03-15 | エルジー アプラス コーポレーション | Inter-terminal function sharing method and terminal |
-
2021
- 2021-01-26 CN CN202110103586.4A patent/CN112799577B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105681542A (en) * | 2014-11-21 | 2016-06-15 | 中兴通讯股份有限公司 | Information processing method and system and terminal |
| CN106371608A (en) * | 2016-09-21 | 2017-02-01 | 努比亚技术有限公司 | Display control method and device for screen projection |
| CN108668027A (en) * | 2018-05-22 | 2018-10-16 | 武汉卡比特信息有限公司 | Split screen projects the system and method for computer terminal and Reverse Turning Control when mobile phone interconnects |
| CN110175008A (en) * | 2019-04-11 | 2019-08-27 | 努比亚技术有限公司 | Method, wearable device and the computer readable storage medium of operating terminal |
| CN111880757A (en) * | 2020-06-30 | 2020-11-03 | 北京小米移动软件有限公司 | Screen projection method, screen projection device and storage medium |
| CN112162718A (en) * | 2020-10-16 | 2021-01-01 | 深圳乐播科技有限公司 | Reverse interaction method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112799577A (en) | 2021-05-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112799577B (en) | Method, terminal and storage medium for projecting small window | |
| CN107807767B (en) | Communication service processing method, terminal and computer readable storage medium | |
| CN107172605B (en) | Emergency call method, mobile terminal and computer readable storage medium | |
| CN112637410B (en) | Method, terminal and storage medium for displaying message notification | |
| CN112822538A (en) | Screen projection display method, screen projection device, terminal and storage medium | |
| CN111190559A (en) | Screen projection control synchronization method, mobile terminal and computer readable storage medium | |
| CN112631535A (en) | Screen projection reverse control method and device, mobile terminal and storage medium | |
| CN111324407A (en) | Animation display method, terminal and computer readable storage medium | |
| CN108563388B (en) | Screen operation method, mobile terminal and computer-readable storage medium | |
| CN109117069B (en) | Interface operation method, terminal and computer readable storage medium | |
| CN111158617A (en) | Screen-casting content synchronization method, mobile terminal and computer-readable storage medium | |
| CN112437472B (en) | Network switching method, equipment and computer readable storage medium | |
| CN107239208B (en) | Method, apparatus, and computer-readable storage medium for processing screenshot | |
| CN111381762A (en) | Double-screen switching method and device and computer readable storage medium | |
| CN111970738A (en) | Network switching control method, equipment and computer readable storage medium | |
| CN109462829B (en) | Call transfer method, device and computer readable storage medium | |
| CN110955397A (en) | Method for setting frame rate of game terminal, game terminal and storage medium | |
| CN107678622B (en) | Application icon display method, terminal and storage medium | |
| CN112947831B (en) | Screen-throwing reverse control method, mobile terminal and computer readable storage medium | |
| CN115202474A (en) | Edge gesture touch response method and device and computer readable storage medium | |
| CN113485667A (en) | Method for screen projection display of terminal, terminal and storage medium | |
| CN110287381B (en) | Page control node searching method, terminal and computer readable storage medium | |
| CN110377359B (en) | Game performance optimization method, mobile terminal and computer readable storage medium | |
| CN109558049B (en) | Notification message display processing method, mobile terminal and storage medium | |
| CN109379719B (en) | Application program broadcast processing method and device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |