CN105487802B

CN105487802B - Screen projection management method, device and system

Info

Publication number: CN105487802B
Application number: CN201510851784.3A
Authority: CN
Inventors: 陶冬
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2015-11-30
Filing date: 2015-11-30
Publication date: 2020-03-31
Anticipated expiration: 2035-11-30
Also published as: CN105487802A

Abstract

The invention discloses a screen projection management method, which is applied to a first mobile terminal and comprises the following steps: receiving a screen projection request sent by a second mobile terminal; receiving a media data stream sent by a second mobile terminal to display a current picture of a display interface of the second mobile terminal; detecting whether an input track of a user meets a first preset condition; when the input track of the user meets the first preset condition, the media data stream is processed, so that the user can control the operating system of the first mobile terminal. The invention also discloses a screen projection management device and a screen projection management system. By processing the media data stream received by the first mobile terminal in the screen projection process, the touch screen of the first mobile terminal can respond to an operation instruction input by a user to the operating system of the first mobile terminal, and the user can control the local operating system of the mobile terminal in the projection process.

Description

Screen projection management method, device and system

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a method, an apparatus, and a system for managing screen projection.

Background

As mobile terminals are rapidly popularized, more and more users start to hold two or more mobile devices, and therefore, the Wi-Fi Display function comes along with the development wave of technology, that is, the WFD function in the mobile device is realized. The function can project one device interface and the condition of the mobile phone to another device in a wireless mode, and the receiving device can operate the projection device. The function provides convenient operation management function for users holding a plurality of mobile devices.

However, the Wi-Fi Display function is not effective to develop the function of managing the mobile device, and is limited to the screen mutual projection function. Therefore, the scheme provides a management device function based on the Wi-Fi Display.

Disclosure of Invention

The invention mainly aims to provide a screen projection management method, a screen projection management device and a screen projection management system, which can effectively manage a plurality of mobile terminals participating in screen projection.

The invention provides a screen projection management method, which is applied to a first mobile terminal and comprises the following steps: receiving a screen projection request sent by a second mobile terminal; receiving a media data stream sent by a second mobile terminal to display a current picture of a display interface of the second mobile terminal; detecting whether an input track of a user meets a first preset condition; when the input track of the user meets the first preset condition, the media data stream is processed, so that the user can control the operating system of the first mobile terminal.

Optionally, a side frame of the mobile terminal is provided with a pressure sensor, and a user touches and presses the pressure sensor to form an input track.

Optionally, the step of detecting whether the input track of the user meets a first preset condition includes: detecting whether a first pressure value P1 and a first time T1 applied to the pressure sensor by a user meet a first preset pressure value P1 and a first preset time T1; when the first pressure value P1 applied to the pressure sensor by the user is greater than the first preset pressure value P1 and the first time T1 is greater than the first preset time T1, determining that the input track of the user meets a first preset condition; when the first pressure value P1 applied to the pressure sensor by the user is smaller than the first preset pressure value P1 and/or the first time T1 is smaller than the first preset time T1, the input track of the user is judged not to meet the first preset condition.

Optionally, processing the media data stream to enable the user to control the operating system of the first mobile terminal includes: and controlling the display interface of the first mobile terminal to enter a split screen mode, wherein the split screen mode divides the display interface of the receiving terminal into at least two sub-screens, one sub-screen is used for receiving a control instruction input by a user to the first mobile terminal, and the other sub-screens are used for displaying the current picture of the display interface of the second mobile terminal.

Optionally, the content of the media data stream transmitted by the second mobile terminal is the content to be projected, which satisfies the projection condition, where the projection condition is that the second time T2 applied by the user to the content to be projected exceeds the second preset time T2.

The invention also provides a screen projection management device, which is applied to the first mobile terminal and comprises: the receiving module is used for receiving a screen projection request sent by the projection terminal; the display module is used for receiving the media data stream sent by the projection end so as to display the current picture of the display interface of the projection end; the detection module is used for detecting whether the input track of the user meets a first preset condition; and the control module is used for processing the media data stream when the input track of the user meets a first preset condition so that the user can control the operating system of the first mobile terminal.

Optionally, the receiving end is a mobile terminal, a side frame of the mobile terminal is provided with a pressure sensor, and the user generates an input track through the pressure sensor.

Optionally, the detection module is further configured to detect whether the first pressure value P1 and the first time T1 applied to the pressure sensor by the user satisfy the first preset pressure value P1 and the first preset time T1; the control module is further used for judging that the input track of the user meets a first preset condition when a first pressure value P1 applied to the pressure sensor by the user is greater than a first preset pressure value P1 and a first time T1 is greater than a first preset time T1; when the first pressure value P1 applied to the pressure sensor by the user is smaller than the first preset pressure value P1 and/or the first time T1 is smaller than the first preset time T1, the input track of the user is judged not to meet the first preset condition.

Optionally, the control module is further configured to control the display interface of the first mobile terminal to enter a split screen mode, where the split screen mode divides the display interface of the receiving end into at least two sub-screens, one of the sub-screens is used to receive a control instruction input by a user to the receiving end of the first mobile terminal, and the other sub-screens are used to display a current picture of the display interface of the second mobile terminal.

The invention also provides a screen projection management system, which comprises a first mobile terminal and a second mobile terminal, wherein the second mobile terminal is used for detecting whether a second time T2 applied by a user of the second mobile terminal to the content to be projected is greater than a second preset time T2, and when the second time T2 applied by the user of the second mobile terminal to the content to be projected is greater than the second preset time T2, the second mobile terminal sends a screen projection request to the first mobile terminal; the first mobile terminal is used for receiving the media data stream sent by the second mobile terminal so as to display the current picture of the display interface of the second mobile terminal; the first mobile terminal is further configured to detect whether a user input track of the first mobile terminal meets a first preset condition, and when the user input track meets the first preset condition, the first mobile terminal processes the media data stream, so that the user can control information of the first mobile terminal.

The implementation of the screen projection management method, the device and the system has the following beneficial effects: the media data stream received by the first mobile terminal is processed in the screen projection process, so that the touch screen of the first mobile terminal can respond to an operation instruction input by a user to the operation system of the first mobile terminal, the user can control the local operation system of the mobile terminal in the projection receiving process, convenience is brought to the life of the user holding a plurality of devices, and meanwhile, the humanized design concept of the mobile terminal can be well embodied.

Drawings

The invention will be further described with reference to the accompanying drawings and examples, in which:

fig. 1 is a schematic diagram of a hardware structure of an alternative mobile terminal for implementing various embodiments of the present invention;

fig. 2 is a schematic diagram of a network architecture of a mobile communication system in which a mobile terminal according to an embodiment of the present invention is located;

FIG. 3 is a diagram of an alternative mobile terminal according to various embodiments of the present invention;

FIG. 4 is a flowchart illustrating a first embodiment of a screen projection management method according to the present invention;

FIG. 5 is a schematic diagram illustrating an "interface switch" button virtual key being set in a display interface of a first mobile terminal according to an embodiment of the present invention;

fig. 6 is a flowchart of an alternative implementation manner of step S450 in the first embodiment of the screen projection management method of the present invention;

FIG. 7 is a diagram illustrating a first mobile terminal receiving a control command of a user in a full screen manner according to an embodiment of the present invention;

FIG. 8 is a diagram illustrating a first mobile terminal receiving a control command from a user in a split-screen manner according to an embodiment of the present invention;

FIG. 9 is a flowchart illustrating a second embodiment of a screen projection management method according to the present invention;

fig. 10 is a flowchart illustrating that the second mobile terminal transmits the content to be projected that satisfies the projection condition according to an embodiment of the present invention;

FIG. 11 is a block diagram of a screen projection management apparatus according to a first embodiment of the present invention;

FIG. 12 is a block diagram of a screen projection management apparatus according to a second embodiment of the present invention

FIG. 13 is a schematic diagram of interaction between two mobile terminals of the screen projection management system according to the present invention;

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "part", or "unit" used to denote elements are used only for facilitating the description of the present invention, and have no specific meaning by themselves. Thus, "modules" and "components" may be used in a mixture.

The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a cellular phone, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, etc., and a stationary terminal such as a digital TV, a desktop computer, etc. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.

Fig. 1 is a schematic hardware structure of an optional mobile terminal for implementing various embodiments of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, etc. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.

The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication device or network. For example, the wireless communication unit may include at least one of a broadcast receiving unit 111, a mobile communication unit 112, a wireless internet unit 113, a short-range communication unit 114, and a location information unit 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Also, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of digital video broadcasting-handheld (DVB-H), and the like. The broadcast receiving module 111 may receive a signal broadcast by using various types of broadcasting devices. In particular, the broadcast receiving module 111 may receive digital broadcasting by using a digital broadcasting device such as a digital broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video broadcasting-handheld (DVB-H), data broadcasting device of forward link media (MediaFLO @), terrestrial digital broadcasting integrated service (ISDB-T), and the like. The broadcast receiving module 111 may be constructed as various broadcasting devices suitable for providing broadcast signals as well as the above-described digital broadcasting device. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).

The mobile communication module 112 transmits and/or receives radio signals to and/or from at least one of a base station (e.g., access point, node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received according to text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module may be internally or externally coupled to the terminal. The wireless internet access technology to which the module relates may include WLAN (wireless LAN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave access), HSDPA (high speed downlink packet access), and the like.

The short-range communication module 114 is a module for supporting short-range communication. Some examples of short-range communication technologies include bluetooth (TM), Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), zigbee (TM), and the like.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module is a GPS (global positioning device). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS module 115 can calculate speed information by continuously calculating current position information in real time.

The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 122, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 151. The image frames processed by the cameras 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the construction of the mobile terminal. The microphone 122 may receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication unit 112 in case of the phone call mode. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 151 in the form of a layer, a touch screen may be formed.

The sensing unit 140 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or jerky movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide-type mobile phone, the sensing unit 140 may sense whether the slide-type phone is opened or closed. In addition, the sensing unit 140 can detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled with an external device. The sensing unit 140 may include a proximity sensor 1410 as will be described below in connection with a touch screen.

The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.

In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output unit 152, an alarm unit 153, and the like.

The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The display unit 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.

The audio output unit 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 into an audio signal and output as sound when the mobile terminal is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 152 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 152 may include a sound pickup, a buzzer, and the like.

The alarm unit 153 may provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alarm unit 153 may provide output in different ways to notify the occurrence of an event. For example, the alarm unit 153 may provide an output in the form of vibration, and when a call, a message, or some other incoming communication (communicating communication) is received, the alarm unit 153 may provide a tactile output (i.e., vibration) to inform the user thereof. By providing such a tactile output, the user can recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 may also provide an output notifying the occurrence of an event via the display unit 151 or the audio output unit 152.

The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia unit 181 for reproducing (or playing back) multimedia data, and the multimedia unit 181 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.

The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a procedure or a function may be implemented with separate software units allowing to perform at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.

Up to this point, mobile terminals have been described in terms of their functionality. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication means such as wired and wireless communication means and satellite-based communication means that transmit data via frames or packets.

A communication apparatus in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.

Such communication devices may use different air interfaces and/or physical layers. For example, the air interface used by the communication device includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and universal mobile telecommunications device (UMTS) (in particular, Long Term Evolution (LTE)), global system for mobile communications (GSM), and so forth. The following description relates to a CDMA communication device, as a non-limiting example, but such teachings are equally applicable to other types of devices.

Referring to fig. 2, the CDMA wireless communication apparatus may include a plurality of mobile terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and a Mobile Switching Center (MSC) 280. The MSC280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul may be constructed according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame Relay, HDSL, ADSL, or xDSL. It will be understood that an apparatus as shown in fig. 2 may include a plurality of BSCs 2750.

Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz, 5MHz, etc.).

The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a base transceiver sub-assembly (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cell sites". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.

As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the apparatus. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several global positioning device (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.

In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. The GPS module 115 as shown in fig. 1 is generally configured to cooperate with satellites 300 to obtain desired positioning information. Other techniques that can track the location of the mobile terminal may be used instead of or in addition to GPS tracking techniques. In addition, at least one GPS satellite 300 may selectively or additionally process satellite DMB transmission.

As a typical operation of the wireless communication apparatus, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.

Based on the above-mentioned hardware structure of the mobile terminal and the structure of the communication device, the present invention provides various embodiments of the method.

Fig. 3 is a schematic structural diagram of an alternative mobile terminal according to various embodiments of the present invention.

The mobile terminal shown in fig. 3 includes a housing, a touch screen, and a physical key (home key).

The housing is used for accommodating internal components of the mobile terminal and supporting the touch screen. And a pressure sensor is arranged at the side frame of the shell. It should be understood that the position where the pressure sensor is disposed is not limited to the side frame of the housing, and the pressure sensor may also be disposed on the surface of the housing opposite to the touch screen, for example, the back surface of the mobile terminal, the front surface of the housing, or the pressure sensor and the physical key may be integrated together, so that the user may trigger the pressure sensor when pressing the physical key.

The touch screen is used as an input/output device of the mobile terminal, receives touch operations such as sliding and clicking of a user, converts the touch operations into signal instructions and transmits the signal instructions to the processor so as to correspond to the touch operations of the user. Meanwhile, the touch screen is also used for displaying a display interface of the mobile terminal. And virtual keys with various functions are arranged in the display interface, and when a user triggers the virtual keys through a touch screen, the mobile terminal can respond to the corresponding functions of the virtual pieces.

The physical key is a physical key combined with a fingerprint sensor. When the user presses the entity key, the fingerprint sensor extracts fingerprint information of the user.

Referring to fig. 4, fig. 4 is a schematic diagram of a screen projection management method according to a first embodiment of the present invention. The screen projection management method provided by the invention relates to interaction between two or more mobile terminals, such as: between two mobile phones, one mobile phone is used as a second mobile terminal, and the other mobile phone is used as a first mobile terminal. In this embodiment, the screen projection management method is applied to a first mobile terminal, and the method includes:

step S410, receiving a screen projection request sent by the second mobile terminal.

When the second mobile terminal and the first mobile terminal perform screen projection, a user inputs an operation instruction through an input device of the first mobile terminal and an input device of the second mobile terminal respectively to control the first mobile terminal and the second mobile terminal to start a screen projection function. In this embodiment, the first mobile terminal and the second mobile terminal are configured with screen projection virtual keys and support a Wi-Fi Direct function, allowing devices in a wireless network to be connected to each other without a wireless router, and a user clicks the screen projection virtual keys through touch screens of the first mobile terminal and the second mobile terminal to control the first mobile terminal and the second mobile terminal to start the screen projection function, at this time, the first mobile terminal and the second mobile terminal respectively scan surrounding mobile terminals that can support the screen projection function, the first mobile terminal and the second mobile terminal respectively display searched mobile terminals that can support the screen projection function in a display interface in a list form, and after the second mobile terminal searches the first mobile terminal, the user clicks a mark representing the first mobile terminal on the display interface of the second mobile terminal, and sending a connection request, namely a screen projection request, through the Wi-FiDirect, prompting the screen projection request of the second mobile terminal by a display interface of the first mobile terminal, and confirming the connection with the second mobile terminal by clicking the touch screen by a user.

Optionally, when the second mobile terminal and the first mobile terminal need to be projected, whether the user input trajectory of the first mobile terminal and the user input trajectory of the second mobile terminal meet the connection condition may be detected, and when the connection condition is met, the second mobile terminal sends a screen projection request to the first mobile terminal, and the first mobile terminal receives the projection request. The input trace is formed by the user pressing the pressure sensor. The method for detecting whether the user input track of the first mobile terminal and the user input track of the second mobile terminal meet the connection condition specifically comprises the following steps: detecting whether a user touch pressure value P3 of the second mobile terminal meets a preset value P3 or not and whether touch time T3 meets a preset value T3 or not; when the touch pressure value P3 of the second mobile terminal is larger than P3 and the touch time T3 is larger than a preset value T3, sending a connection request to the first mobile terminal through Wi-Fi Direct; detecting whether a user touch pressure value P4 of a receiving end meets a preset value P4 and touch time T4 meets a preset value T4 during continuous pressing of a user of the second mobile terminal; and when the user touch pressure value P4 of the receiving end is greater than the preset value P4 and the touch time T4 is greater than the set value T4 during the continuous pressing of the user of the second mobile terminal, receiving the screen projection request of the second mobile terminal and connecting with the second mobile terminal.

Step S430, receiving a media data stream sent by the second mobile terminal, so as to display a current screen of a display interface of the second mobile terminal.

Specifically, after the first mobile terminal and the second mobile terminal establish connection through the Wi-Fi Direct, the second mobile terminal sends the media data stream to the first mobile terminal through the Wi-Fi Direct in real time, and the first mobile terminal decompresses the media data stream to play the current picture of the second mobile terminal. It can be understood that the first mobile terminal now corresponds to a player, and the picture in the display interface of the second mobile terminal corresponds to a video file, which is played at the first mobile terminal. In this embodiment, the current screen refers to the content displayed on the display interface after the second mobile terminal is turned on, and for example: when the second mobile terminal receives that the user presses the power key, the display interface of the second mobile terminal is the picture to be unlocked, the content displayed on the display interface of the first mobile terminal is the picture to be unlocked of the second mobile terminal, when the second mobile terminal is turned off but is not turned off, the second mobile terminal is still connected with the first mobile terminal, and the first mobile terminal suspends displaying the current picture of the second mobile terminal.

Step S450, detecting whether the input track of the user meets a first preset condition, and if the input track meets the first preset condition, executing step S470.

When detecting whether the input track of the user meets the first preset condition, the following method can be used for judging:

alternative mode one

As shown in fig. 5, the mobile terminal is preset with an "interface switch" button. The input track of the user is formed by the touch action of the user on the touch screen of the first mobile terminal, for example: click, slide, etc. The "interface switch" button may be displayed on the display interface of the first mobile terminal in the form of a virtual key when the first mobile terminal displays (plays) the current screen of the second mobile terminal in real time, or a physical key (home) is used for the "interface switch" button when the first mobile terminal displays (plays) the current screen of the second mobile terminal in real time. When the position of a touch screen of the first mobile terminal, which corresponds to the virtual key of the interface switching button, detects the touch of a user, the input track of the user is judged to meet a first preset condition. Or when the first mobile terminal detects that an entity key (home) is pressed and excited, judging that the input track of the user meets a first preset condition. By setting the virtual key or the entity key, the user can meet the first preset condition through simple clicking action, and how to operate can be intuitively suggested by the user through the virtual key or the entity key.

In order to further improve the user experience, when the "interface switching" button is a virtual key, the virtual key may be displayed in the form of a switch in a pull-down menu of the display interface of the first mobile terminal. When the first mobile terminal detects that the user slides downwards from the top end of the display interface to start the pull-down menu and detects that the interface switching switch is started, the input track of the user is judged to meet a first preset condition. The interface switching button is arranged in the pull-down menu, so that the condition that the interface switching button shields the content of the current picture of the second mobile terminal displayed on the display interface of the first mobile terminal can be avoided.

Alternative mode two

As shown in fig. 6, in step S610, it is detected whether the first pressure value P1 and the first time T1 applied to the pressure sensor by the user satisfy the first preset pressure value P1 and the first preset time T1.

Specifically, the side frame of the mobile terminal is provided with a pressure sensor. The first mobile terminal stores a first preset pressure value p1 and a first preset time t2 in a memory in advance. The pressure sensor is pressed by a finger while the user holds the mobile terminal, and the pressure sensor detects a first pressure value P1 applied by the user. The first mobile terminal times the duration of the pressure applied by the user to the pressure sensor to obtain a first time T1.

In step S630, when the first pressure value P1 applied to the pressure sensor by the user is greater than the first preset pressure value P1 and the first time T1 is greater than the first preset time T1, it is determined that the input trajectory of the user satisfies the first preset condition.

Specifically, the input trace of the user is generated by the user by triggering a pressure sensor arranged on the mobile terminal. When the processor of the first mobile terminal determines that the pressure sensor detects that the first pressure value P1 is greater than the first preset pressure value P1, a timing instruction is sent to the timer, and after the timer receives the timing instruction sent by the processor, the timer is continuously timed to obtain the first time T1. The first time T1 is: after the processor judges that the first pressure value P1 applied by the user is greater than the first preset pressure value P1 for the first time, the processor judges that the first pressure value P1 applied by the user is less than the first preset pressure value P1 for the first time, that is, after the first pressure value P1 applied by the user and detected by the sensor for the first time is greater than the first preset pressure value P1, even if the first pressure value P1 measured for the first time is not maintained by the user, the user can only ensure that the touch pressure value provided by the user is continuously greater than the first preset pressure value P1. After the processor judges that the first pressure value P1 of the user obtained by the pressure sensor is greater than the first preset pressure value P1, the timer is controlled to obtain the first time T1, the operation can be performed as effectively as possible, the power consumption of the first mobile terminal can be reduced to a certain extent, the time of the timer for the user to perform the false touch action on the pressure sensor or the time of the touch action less than the first preset pressure value P1 is avoided, and the power consumption waste and the operating pressure of the processor are caused.

Optionally, after the processor determines that the first pressure value P1 applied by the user identified by the pressure sensor is greater than the first preset pressure value P1, if the processor determines that the current pressure value of the user identified by the pressure sensor changes and is less than the first preset pressure value P1, the timer continues to count time within the buffer time, and if the processor determines that the current pressure value of the user identified by the pressure sensor changes again and is greater than the first preset pressure value P1 within the buffer time, the timer continues to count time to obtain a final first time T1; if the processor determines that the current pressure value of the user identified by the pressure sensor is still smaller than the first preset pressure value p1 within the buffer time, the timer abandons the timing. The buffer time is mainly used for connecting two adjacent times when the user pressure value is greater than the first preset pressure value p1, so that the timer is prevented from timing interruption. By means of setting the buffering time, the situation that the value of the user pressure is smaller than the first preset pressure value p1 in a very short time due to the fact that the timer is stopped due to the fact that the value of the user pressure is smaller than the first preset pressure value p1 due to the fact that the user presses the pressure sensor in a shaking mode and the like can be effectively prevented, and corresponding instructions of the user cannot be responded timely and sensitively.

When the processor determines that the first time T1 acquired by the timer is greater than the first preset time T1, it is determined that the input track of the user satisfies the first preset condition.

In step S650, when the first pressure value P1 applied to the pressure sensor by the user is less than the first preset pressure value P1, and/or the first time T1 is less than the first preset time T1, it is determined that the input track of the user does not satisfy the first preset condition.

For the first pressure value P1 and the first time T1 applied by the user, as long as one value is smaller than the preset value of the system, the input track of the user is judged not to meet the first preset condition.

In step S470, when the input trajectory of the user meets the first preset condition, the media data stream is processed, so that the user can control the operating system of the first mobile terminal.

When the first mobile terminal is in projection connection with the second mobile terminal, the first mobile terminal receives a message prompt or a call request and the like, and at the moment, the first mobile terminal judges whether to process and display the received media data stream of the second mobile terminal according to the input track of the user. If the original interface of the first mobile terminal needs to be displayed, the received media data stream is cached, so that an input device (such as a touch screen and an entity key) of the first mobile terminal can respond to a user to process an operating system belonging to the first mobile terminal. For example, when the first mobile terminal receives the media data stream sent by the second mobile terminal, the first mobile terminal cannot operate the application program and the like belonging to the first mobile terminal, for example, cannot view the photographing program installed in the operating system of the first mobile terminal, and when the first mobile terminal determines that the input trajectory of the user satisfies the first preset condition, the user may perform the operation on the operating system of the first mobile terminal, for example, the application program installed in the operating system of the first mobile terminal. When the touch screen of the first mobile terminal receives the input track of the user, the following optional modes can be adopted:

alternative mode one

As shown in fig. 7, when the input trajectory of the user meets a first preset condition, the first mobile terminal receives a control instruction input by the user for an operating system of the first mobile terminal in a full-screen manner. Specifically, the first mobile terminal places the received media data stream sent by the second mobile terminal in a cache, at this time, the first mobile terminal suspends displaying the current picture of the second mobile terminal, detects whether an entity key (home) of the first mobile terminal is pressed, and switches the display content to the desktop of the first mobile terminal after detecting that the entity key is pressed, so that the input instruction input by a user for the operating system of the first mobile terminal is received in a full-screen mode. For example, when the first mobile terminal detects that the user clicks the "interface switching" virtual key, the received media data stream is cached, and then the user switches the display interface of the first mobile terminal from the current screen of the second mobile terminal to the original desktop of the first mobile terminal by pressing the physical key.

Alternative mode two

As shown in fig. 8, the display interface of the first mobile terminal is controlled to enter a split screen mode, where the split screen mode divides the display interface of the first mobile terminal into two sub-screens, one of the sub-screens is used to display a current picture of the display interface of the second mobile terminal, and the other sub-screen is used to receive a control instruction input by a user to the first mobile terminal.

Specifically, when the first mobile terminal determines that the input track of the user meets a first preset condition, the first mobile terminal starts a split screen mode and displays the received media data stream in one of the sub-screens. And the other one is switched to the original desktop of the first mobile terminal from the screen and is used for receiving the control instruction input by the user to the first mobile terminal.

And the number of the sub-screens displayed in the split screen mode is subjected to an adaptive condition according to the number of the second mobile terminals connected with the first mobile terminal. For example, if two second mobile terminals are connected with the first mobile terminal, when the first mobile terminal determines that the input trajectory of the user meets the first preset condition, the display interface is divided into three sub-screens, wherein one of the sub-screens is used for receiving a control instruction input by the user to the first mobile terminal, and the other two sub-screens are used for displaying the current picture of the second mobile terminal.

The first mobile terminal detects a control instruction of a user in real time, and when it is judged that a function corresponding to the control instruction of the user occupies a larger operation memory of the first mobile terminal, the first mobile terminal caches a received media data stream to control the first mobile terminal to suspend display of the media data stream transmitted by the second mobile terminal, so that the operation pressure of the first mobile terminal is relieved.

The operation instruction of the user to the first mobile terminal is received in a split screen mode, and the operation instruction of the user to the first mobile terminal can be responded under the condition that the first mobile terminal can display the current picture of the second mobile terminal. And whether the control instruction of the user occupies larger content or not is detected to control the display of the media data stream, so that the operating pressure of the first mobile terminal can be relieved, and the smooth operation of the first mobile terminal system is ensured.

The screen projection management method provided by the embodiment combines the screen projection function with the pressure sensor, so that when the first mobile terminal performs screen projection with the second mobile terminal, the first mobile terminal is controlled to control the received media data stream by detecting the pressure value and time applied to the pressure sensor by the user, so that the user can control information, application programs, an operating system and the like of the first mobile terminal, screen projection and local control of the first mobile terminal are performed simultaneously, convenience is brought to the user who holds a plurality of mobile terminal devices in life, and meanwhile, the humanized design concept of the mobile terminal can be well embodied.

Fig. 9 is a schematic diagram of a screen projection management method according to a second embodiment of the present invention.

Step S910, receiving a screen projection request sent by the second mobile terminal.

The specific content is the same as that of step S410 in the first embodiment, and therefore, the detailed description thereof is omitted.

Step S930, starting the split screen according to the screen projection request sent by the second mobile terminal.

Specifically, after the first mobile terminal and the second mobile terminal successfully establish the screen projection connection, the first mobile terminal automatically starts the screen splitting function. The display interface is divided into a plurality of sub-screens according to the number of the connected second mobile terminals. For example, when the number of connected second mobile terminals is 1, then the number of split sub-screens is 2; when the number of the connected second mobile terminals is 2, then, the number of the divided sub-screens is 3, as long as it is ensured that the number of the divided sub-screens is greater than the number of the connected second mobile terminals. One of the self-screens is used for displaying an operation interface of an operation system of the first mobile terminal, and the other sub-screens are used for displaying a current picture of a display interface of the second mobile terminal.

Optionally, after the first mobile terminal and the second mobile terminal successfully establish the screen projection connection, the display interface of the first mobile terminal may prompt the user whether to start the split screen function and the number of the split sub-screens, and when the user inputs an instruction for confirming to start the split screen through the touch screen and inputs the number of the sub-screens, the first mobile terminal starts the split screen function.

In this step, the second mobile terminal and the first mobile terminal only establish a screen projection connection, the second mobile terminal does not send the current picture of the second mobile terminal to the first mobile terminal in a media data stream manner, and the sub-screen prompt for displaying the display interface content of the second mobile terminal at this time waits for receiving the projection content of the second mobile terminal. Therefore, the first mobile terminal can be prevented from seeing the contents which are not wanted to be projected by the second mobile terminal user, and the privacy of the second mobile terminal user is protected.

Step 950, receiving a media data stream meeting a projection condition sent by a second mobile terminal, so as to display a current picture of a display interface of the second mobile terminal.

And the first mobile terminal receives the media data stream and then processes the media data stream so as to display the current picture of the second mobile terminal on the display interface of the first mobile terminal. The user can select the content needing to be projected according to the requirement and project the content to the first mobile terminal, and after receiving the projected content, the first mobile terminal displays the projected content through one of the sub-screens. In this way, user-defined projection content can be realized.

The second mobile terminal may send the media data stream meeting the projection condition to the first mobile terminal by:

as shown in fig. 10, in step S1010, it is detected whether the selected content to be projected satisfies the projection condition.

The content to be projected may be various applications installed in the first mobile terminal, such as: WeChat App, Youkou App, etc., may also be files stored in the first mobile terminal, such as: word documents, excel documents. The first mobile terminal detects whether the long-pressed second time T2 of the content to be projected is greater than a second preset time T2, and when the long-pressed second time T2 of the content to be projected is greater than the second preset time T2, the content to be projected is judged to meet the projection condition.

Step S1030, when it is detected that the selected content to be projected satisfies the projection condition, the second mobile terminal detects whether a sending instruction of the user is received.

And when the second mobile terminal judges that the selected content to be projected meets the projection condition, the second mobile terminal display interface pops up an option of 'projecting to the first mobile terminal', and the user clicks confirmation, and then the content to be projected is projected to the first mobile terminal.

Step S1050, when the second mobile terminal detects that the sending instruction of the user is received, the selected content to be projected is converted into a media data stream and sent to the first mobile terminal.

Taking the second mobile terminal to project the wechat App to the first mobile terminal as an example, the implementation manner of the steps S1010 to S1050 is described as follows:

when the second mobile terminal wants to project the content of the WeChat App to the first mobile terminal, the user needs to press the WeChat App icon for a long time, when the long-time T2 exceeds a preset time value T2, the display interface of the second mobile terminal pops up an option for projecting the WeChat App to the first mobile terminal, when the user clicks confirmation, the second mobile terminal automatically enters the WeChat App operation interface and sends the interface to the first mobile terminal in a media data stream mode, the first mobile terminal receives the media data stream and then processes the media data stream, and the WeChat App operation interface of the second mobile terminal is displayed through one of the sub-screens.

In step S970, it is detected whether the input trajectory of the user satisfies a first preset condition.

The mobile terminal is provided with a pressure sensor, and the input trace of the user can be generated by touching and pressing the pressure sensor.

Optionally, if one of the sub-screens of the first mobile terminal is used to display the operation interface of the first mobile terminal, when the first mobile terminal detects that the sub-screen used to display the first mobile terminal receives a touch instruction, it is determined that the input trajectory of the user satisfies a first preset condition.

Optionally, if the sub-screens of the first mobile terminal are all in a state of displaying the operation interface of the first mobile terminal, when the first mobile terminal detects that the pressure value and the time applied by the user to the pressure sensor are greater than the preset pressure value and time value, it is determined that the input track of the user meets the first preset condition. The specific manner is the same as the second alternative manner in step S450 in the first embodiment, and is not described herein again.

In step S990, when the input trajectory of the user meets the first preset condition, the media data stream is processed, so that the user can control the operating system of the first mobile terminal.

If one of the sub-screens of the first mobile terminal is used for displaying the operation interface of the first mobile terminal, when the first mobile terminal determines that the input track of the user meets the first preset condition, the sub-screen can report the operation instruction of the user in the area of the sub-screen, so that the first mobile terminal can respond to the touch instruction.

If the sub-screens of the first mobile terminal are all in the state of displaying the operation interface of the first mobile terminal, it indicates that at least two second mobile terminals perform screen projection with the first mobile terminal, and at this time, the first mobile terminal receives media data streams sent by different second mobile terminals. Then, when the first mobile terminal determines that the input trajectory of the user meets the first preset condition, the first mobile terminal selectively performs caching processing on the media data stream sent by one of the second mobile terminals, directly jumps to the original desktop of the first mobile terminal, and normally displays the current picture of the other second mobile terminal on the other sub-screen.

It should be understood that the specific implementation details of the first embodiment are also applicable to this embodiment, and are not described herein again, and the steps in the above embodiments may be combined in any way without contradiction, so as to obtain better user experience.

According to the screen projection management method provided by the second embodiment of the invention, the first mobile terminal receives the screen projection of the second mobile terminal on the basis of screen splitting, so that the combination of projection and local operation can be better realized, and meanwhile, the sub-screen only displays the content to be projected, which is projected by the second mobile terminal and meets the projection condition, so that the first mobile terminal is effectively prevented from browsing the private content, which is not wanted to be seen by other people, of the second mobile terminal. The problem that the user experience is influenced by projecting the whole second mobile terminal desktop to the first mobile terminal at present is solved, and user-defined projection content is provided.

The invention further provides a screen projection management device which is applied to the mobile terminal. A first embodiment of the screen projection management device of the present invention is now presented. As shown in fig. 11, the apparatus includes a receiving module, a display module, a detection module, and a control module, wherein:

and the receiving module is used for receiving the screen projection request sent by the second mobile terminal.

And the display module is used for receiving the media data stream sent by the second mobile terminal so as to display the current picture of the display interface of the second mobile terminal.

The detection module is used for detecting whether the input track of the user meets a first preset condition.

Optionally, the mobile terminal is preset with an "interface switching" button. The input track of the user is formed by the touch action of the user on the touch screen of the first mobile terminal, for example: click, slide, etc. The "interface switch" button may be displayed on the display interface of the first mobile terminal in the form of a virtual key when the first mobile terminal displays (plays) the current screen of the second mobile terminal in real time, or a physical key (home) is used for the "interface switch" button when the first mobile terminal displays (plays) the current screen of the second mobile terminal in real time. When the position of a touch screen of the first mobile terminal, which corresponds to the virtual key of the interface switching button, detects the touch of a user, the input track of the user is judged to meet a first preset condition. Or when the first mobile terminal detects that an entity key (home) is pressed and excited, judging that the input track of the user meets a first preset condition. By setting the virtual key or the entity key, the user can meet the first preset condition through simple clicking action, and how to operate can be intuitively suggested by the user through the virtual key or the entity key.

The detection module may be further configured to detect whether the first pressure value P1 and the first time T1 applied to the pressure sensor by the user satisfy the first preset pressure value P1 and the first preset time T1.

Specifically, the side frame of the mobile terminal is provided with a pressure sensor. The first mobile terminal stores a first preset pressure value p1 and a first preset time t2 in a memory in advance. The pressure sensor is pressed by a finger while the user holds the mobile terminal, and the pressure sensor detects a first pressure value P1 applied by the user. And the timer of the first mobile terminal counts the touch operation of the user to obtain the first time T1.

The detection module is further used for judging that the input track of the user meets a first preset condition when the first pressure value P1 applied to the pressure sensor by the user is greater than a first preset pressure value P1 and the first time T1 is greater than a first preset time T1.

Specifically, the input trace of the user is generated by the user by triggering a pressure sensor arranged on the mobile terminal. When the processor of the first mobile terminal determines that the pressure sensor detects that the first pressure value P1 is greater than the first preset pressure value P1, a timing instruction is sent to the timer, and after the timer receives the timing instruction sent by the processor, the timer is continuously timed to obtain the first time T1. The first time T1 is: after the processor judges that the first pressure value P1 applied by the user is greater than the first preset pressure value P1 for the first time, the processor judges that the first pressure value P1 applied by the user is less than the first preset pressure value P1 for the first time, that is, after the first pressure value P1 applied by the user and detected by the sensor for the first time is greater than the first preset pressure value P1, even if the first pressure value P1 measured for the first time is not maintained by the user, the user can only ensure that the touch pressure value provided by the user is continuously greater than the first preset pressure value P1. After the processor determines that the first pressure value P1 applied by the user and obtained by the pressure sensor is greater than the first preset pressure value P1, the timer is controlled to acquire a first time T1, the operation can be performed as effectively as possible, the power consumption of the first mobile terminal can be reduced to a certain extent, and the phenomenon that the time of the timer is used for timing the mistaken touch behavior of the user on the pressure sensor or the time of the touch behavior smaller than the first preset pressure value P1, so that the power consumption is wasted and the operating pressure of the processor is avoided.

The detection module is further used for judging that the input track of the user does not meet the first preset condition when the first pressure value P1 applied to the pressure sensor by the user is smaller than the first preset pressure value P1 and/or the first time T1 is smaller than the first preset time T1.

And the control module is used for processing the media data stream when the input track of the user meets a first preset condition so that the user can control the information of the first mobile terminal.

Specifically, when the first mobile terminal performs a projection connection with the second mobile terminal, the first mobile terminal receives a message prompt or a call request, and at this time, the first mobile terminal determines whether to process and display the media data stream received by the second mobile terminal according to the input trajectory of the user. If the original interface of the first mobile terminal needs to be displayed, the control module caches the received media data stream, so that an input device (such as a touch screen and an entity key) of the first mobile terminal can respond to a user and process information belonging to the first mobile terminal. For example, when the first mobile terminal receives the media data stream sent by the second mobile terminal, the first mobile terminal cannot operate the application program and the like belonging to the first mobile terminal, for example, cannot view the photographing program installed in the operating system of the first mobile terminal, and when the first mobile terminal determines that the input trajectory of the user satisfies the first preset condition, the user may perform the operation on the operating system of the first mobile terminal, for example, the application program installed in the operating system of the first mobile terminal.

The invention further provides a screen projection management device which is applied to the mobile terminal. As shown in fig. 12, a second embodiment of the screen projection management apparatus of the present invention is now proposed. The device includes receiving module, split screen module, display module, detection module and control module, wherein:

The specific content is the same as that of the receiving module in the first embodiment of the screen projection apparatus, and therefore, the detailed description thereof is omitted.

And the screen splitting module is used for controlling the first mobile terminal to start screen splitting according to the screen projection request sent by the second mobile terminal.

Specifically, after the first mobile terminal and the second mobile terminal successfully establish the screen projection connection, the screen splitting module controls the first mobile terminal to automatically start the screen splitting function. The display interface is divided into a plurality of sub-screens according to the number of the connected second mobile terminals. For example, when the number of connected second mobile terminals is 1, then the number of split sub-screens is 2; when the number of the connected second mobile terminals is 2, then, the number of the divided sub-screens is 3, as long as it is ensured that the number of the divided sub-screens is greater than the number of the connected second mobile terminals. One of the self-screens is used for displaying an operation interface of an operation system of the first mobile terminal, and the other sub-screens are used for displaying a current picture of a display interface of the second mobile terminal.

And the display module is used for receiving the media data stream which is sent by the second mobile terminal and meets the projection condition so as to display the current picture of the display interface of the second mobile terminal.

If one of the sub-screens of the first mobile terminal is used for displaying an operation interface of the first mobile terminal, the detection module is used for judging that the input track of the user meets a first preset condition when the sub-screen used for displaying the first mobile terminal receives a touch instruction.

If the sub-screens of the first mobile terminal are all in a state of displaying the operation interface of the first mobile terminal, the detection module is used for judging that the input track of the user meets a first preset condition when detecting that the pressure value and the time applied to the pressure sensor by the user are greater than a preset pressure value and a preset time value. The detailed manner and part of the contents in the detection module in the first embodiment of the screen projection apparatus are not described herein again.

And the control module is used for processing the media data stream when the input track of the user meets a first preset condition so that the user can control the operating system of the first mobile terminal.

If one of the sub-screens of the first mobile terminal is used for displaying the operation interface of the first mobile terminal, when the detection module determines that the input track of the user meets a first preset condition, the control module is used for controlling the sub-screen to report the operation instruction of the user in the area of the sub-screen, so that the first mobile terminal can respond to the touch instruction.

If the sub-screens of the first mobile terminal are all in the state of displaying the operation interface of the first mobile terminal, it indicates that at least two second mobile terminals perform screen projection with the first mobile terminal, and at this time, the first mobile terminal receives media data streams sent by different second mobile terminals. Then, when the detection module determines that the input trajectory of the user meets the first preset condition, the control module selectively performs caching processing on the media data stream sent by one of the second mobile terminals, directly jumps to the original desktop of the first mobile terminal, and normally displays the current picture of the other second mobile terminal on the other sub-screen.

It should be understood that the specific implementation details of the first embodiment of the screen projection management apparatus are also applicable to this embodiment, and are not described herein again, and the steps in the above embodiments may be combined in any way without contradiction, so as to obtain better user experience.

The method and the device are applied to the screen projection management method and the device, when the first mobile terminal performs screen projection with the second mobile terminal, the first mobile terminal is controlled to control the received media data stream by detecting the pressure value and the time applied by a user to the pressure sensor, so that the user can control the information, the application program and the like of the first mobile terminal, and screen projection and local control of the first mobile terminal are simultaneously performed; the first mobile terminal receives the screen projection of the second mobile terminal on the basis of split screen, the combination of projection and local operation can be better realized, meanwhile, the sub-screen only displays the content to be projected which is projected by the second mobile terminal and meets the projection condition, and the first mobile terminal is effectively prevented from browsing the private content of the second mobile terminal and is not wanted to be seen by other people. The problem that the user experience is influenced by projecting the whole second mobile terminal desktop to the first mobile terminal at present is solved, and user-defined projection content is provided.

The invention also provides a screen projection management system which is applied to the second mobile terminal and the first mobile terminal. An embodiment of a screen projection management system of the present invention is now presented. As shown in the figure timer, the system comprises a second mobile terminal and a first mobile terminal, wherein,

the second mobile terminal is used for detecting whether a second time T2 of the user of the second mobile terminal touching the content to be projected is greater than a second preset time T2, and when the second time T2 of the user of the second mobile terminal touching the content to be projected is greater than the second preset time T2, sending a screen projection request to the first mobile terminal.

Specifically, the second mobile terminal detects whether the selected content to be projected meets the projection condition.

When detecting that the selected content to be projected meets the projection condition, the first mobile terminal detects whether a sending instruction of a user is received.

And when the first mobile terminal judges that the selected content to be projected meets the projection condition, the second mobile terminal display interface pops up an option of 'projecting to the first mobile terminal', and the user clicks confirmation, and then the content to be projected is projected to the first mobile terminal.

And when the first mobile terminal judges that a sending instruction of the user is received, the second mobile terminal converts the selected content to be projected into a media data stream and sends the media data stream to the first mobile terminal.

And the first mobile terminal is used for receiving the media data stream sent by the second mobile terminal so as to display the current picture of the display interface of the second mobile terminal.

The first mobile terminal is further configured to detect whether a user input trajectory of the first mobile terminal meets a first preset condition, and when the user input trajectory meets the first preset condition, the media data stream is processed, so that a user can control an operating system of the first mobile terminal.

The details in the above embodiments are also applied to the second mobile terminal and the first mobile terminal in this embodiment, and therefore, the details are not described herein again.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the statement "comprises a" or "comprising" a defined element does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a mobile terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A screen projection management method is applied to a first mobile terminal, and is characterized by comprising the following steps:

receiving a screen projection request sent by a second mobile terminal;

receiving a media data stream sent by the second mobile terminal to display a current picture of a display interface of the second mobile terminal, wherein the content of the media data stream sent by the second mobile terminal is a content to be projected meeting a projection condition, and the content to be projected is an application installed on the first mobile terminal or a file stored in the first mobile terminal;

detecting whether an input track of a user meets a first preset condition;

when the input track of the user meets a first preset condition, the media data stream is processed to enable the user to control the operating system of the first mobile terminal, wherein,

detecting whether a first pressure value P1 and a first time T1 applied to the pressure sensor by the user meet a first preset pressure value P1 and a first preset time T1;

when the first pressure value P1 applied by the user to the pressure sensor is greater than the first preset pressure value P1 and the first time T1 is greater than the first preset time T1, determining that the input track of the user meets a first preset condition, wherein,

after the processor determines that the first pressure value P1 applied by the user identified by the pressure sensor is greater than the first preset pressure value P1, if the processor determines that the current pressure value of the user identified by the pressure sensor changes and is less than the first preset pressure value P1, the timer keeps timing within the buffer time, and if the processor determines that the current pressure value of the user identified by the pressure sensor changes again and is greater than the first preset pressure value P1 within the buffer time, the timer continues timing to obtain the final first time T1; if the processor determines that the current pressure value of the user identified by the pressure sensor is still smaller than the first preset pressure value p1 within the buffer time, the timer abandons the timing.

2. The screen projection management method of claim 1, wherein a side frame of the mobile terminal is provided with a pressure sensor, and a user touches and presses the pressure sensor to form the input track.

3. The screen projection management method of claim 2, wherein the step of detecting whether the input trajectory of the user satisfies a first preset condition comprises:

when the first pressure value P1 applied by the user to the pressure sensor is smaller than the first preset pressure value P1 and/or the first time T1 is smaller than the first preset time T1, determining that the input track of the user does not meet a first preset condition.

4. The screen projection management method of claim 2, wherein the processing the media data stream to enable a user to control an operating system of the first mobile terminal comprises:

and controlling the display interface of the first mobile terminal to enter a split screen mode, wherein the split screen mode divides the display interface of the receiving end into at least two sub-screens, one sub-screen is used for receiving a control instruction input by a user to the first mobile terminal, and the other sub-screens are used for displaying the current picture of the display interface of the second mobile terminal.

5. The screen projection management method of claim 1, wherein the content of the media data stream transmitted by the second mobile terminal is a content to be projected which satisfies a projection condition, wherein the projection condition is that a second time T2 applied by the user to the content to be projected exceeds a second preset time T2.

6. A screen projection management device is applied to a first mobile terminal, and is characterized by comprising:

the receiving module is used for receiving a screen projection request sent by the second mobile terminal;

the display module is configured to receive a media data stream sent by the second mobile terminal to display a current picture of a display interface of the second mobile terminal, where content of the media data stream sent by the second mobile terminal is to-be-projected content meeting a projection condition, where the to-be-projected content is an application installed in the first mobile terminal or a file stored in the first mobile terminal;

the detection module is used for detecting whether the input track of the user meets a first preset condition;

a control module, configured to process the media data stream when the input trajectory of the user meets a first preset condition, so that the user can control the media data stream with respect to an operating system of the first mobile terminal, where,

7. The screen projection management device of claim 6, wherein the receiving end is a mobile terminal, a side frame of the mobile terminal is provided with a pressure sensor, and the user generates the input track through the pressure sensor.

8. The screen projection management device of claim 6,

the detection module is further used for detecting whether a first pressure value P1 and a first time T1, which are applied to the pressure sensor by the user, meet a first preset pressure value P1 and a first preset time T1;

the control module is further configured to determine that the input trajectory of the user does not satisfy a first preset condition when the first pressure value P1 applied by the user to the pressure sensor is smaller than the first preset pressure value P1 and/or the first time T1 is smaller than the first preset time T1.

9. The screen projection management device according to claim 7, wherein the control module is further configured to control the display interface of the first mobile terminal to enter a split screen mode, where the split screen mode divides the display interface of the receiving end into at least two sub-screens, one of the sub-screens is configured to receive a control instruction input by a user to the first mobile terminal, and the other sub-screens are configured to display a current picture of the display interface of the second mobile terminal.

10. A screen projection management system comprises a first mobile terminal and a second mobile terminal, and is characterized in that,

the second mobile terminal is configured to detect whether a second time T2, which is applied by a user of the second mobile terminal to the content to be projected, is greater than a second preset time T2, and when the second time T2, which is applied by the user of the second mobile terminal to the content to be projected, is greater than the second preset time T2, the second mobile terminal sends a screen projection request to the first mobile terminal;

the first mobile terminal is configured to receive a media data stream sent by the second mobile terminal to display a current picture of a display interface of the second mobile terminal, where a content of the media data stream sent by the second mobile terminal is a content to be projected that meets a projection condition, where the content to be projected is an application installed in the first mobile terminal or a file stored in the first mobile terminal;

the first mobile terminal is further configured to detect whether a user input trajectory of the first mobile terminal meets a first preset condition, and when the user input trajectory meets the first preset condition, the first mobile terminal processes the media data stream, so that a user can control an operating system of the first mobile terminal, where,