CN114201130A

CN114201130A - Screen projection method and device and storage medium

Info

Publication number: CN114201130A
Application number: CN202010988528.XA
Authority: CN
Inventors: 王双; 常琳
Original assignee: Hisense Mobile Communications Technology Co Ltd
Current assignee: Hisense Mobile Communications Technology Co Ltd
Priority date: 2020-09-18
Filing date: 2020-09-18
Publication date: 2022-03-18

Abstract

The invention relates to the field of wireless transmission, and discloses a screen projection method, a screen projection device and a storage medium, which improve the flexibility of terminal operation. The receiving terminal receives screen projection data sent by the sending terminal; the screen projection data are obtained by screen recording of screen display contents by a sending terminal; and the receiving terminal displays the screen display content of the sending terminal in a target area in the display interface according to the received screen projection data, wherein the target area is a partial area in the display interface of the receiving terminal. In the embodiment of the invention, after the receiving terminal receives the screen projection data, the screen display content of the sending terminal is only displayed in a partial area in the display interface, and the screen display content of the sending terminal can be continuously displayed in other areas.

Description

Screen projection method and device and storage medium

Technical Field

The present invention relates to the field of wireless transmission, and in particular, to a method, an apparatus, and a storage medium for screen projection.

Background

With the development of communication technology, communication workers such as terminals have a good development trend, and have a plurality of functions such as network integration, social contact, photographing, music, radio, video, remote control, connection and the like, and in addition, the intelligence and the extremely high portability of the terminals further promote the rapid development of the terminals.

In order to meet the requirements of different occasions, the same user can simultaneously own a plurality of terminals. For example, when a user needs to use a certain terminal, the user can only view the content on the terminal through the display interface of the terminal; if the user needs to check the two terminals, the user can only operate the two terminals respectively. Therefore, the operation mode of the terminal is not flexible at present.

Disclosure of Invention

The invention provides a screen projection method, a screen projection device and a storage medium, and through the screen projection scheme provided by the invention, the display contents of other terminals can be checked through a terminal, so that the flexibility of the terminal operation mode is improved.

According to a first aspect of the exemplary embodiments, there is provided a screen projection method applied to a receiving terminal, the method including:

the receiving terminal receives screen projection data sent by the sending terminal; the screen projection data are obtained by screen recording of screen display contents by a sending terminal;

and the receiving terminal displays the screen display content of the sending terminal in a target area in a display interface according to the received screen projection data, wherein the target area is a partial area in the display interface of the receiving terminal.

In the above embodiment, after the receiving terminal receives the screen projection data sent by the sending terminal, the screen display content recorded by the sending terminal on the screen is displayed in a partial area of the display interface, so that after the screen display content of the sending terminal is projected to the receiving terminal, the screen display content of the sending terminal is displayed only in the partial area of the display interface of the receiving terminal, and other areas of the display interface of the receiving terminal can continue to display the screen display content of the receiving terminal.

In some exemplary embodiments, after the receiving terminal presents the screen display content of the sending terminal in the target area in the display interface, the method further includes:

responding to a control instruction triggered by a user in the target area, and generating control data corresponding to the control instruction and used for expressing the triggering position and/or the control type of the control instruction by the receiving terminal;

and the receiving terminal sends the control data corresponding to the control instruction to the sending terminal so that the sending terminal executes corresponding response operation according to the control data.

In some exemplary embodiments, the sending terminal sends control data corresponding to the control instruction to the receiving terminal, including:

and the receiving terminal sends the control data corresponding to the operation instruction to the sending terminal through the GATT connection between the receiving terminal and the sending terminal.

responding to a first transmission instruction which is triggered in the display interface by a user and is used for transmitting data from the receiving terminal to the sending terminal, determining first target data which needs to be transmitted to the sending terminal by the receiving terminal, and sending the first target data to the sending terminal; and/or

Responding to a second transmission instruction, triggered by a user in the display interface, for transmitting data from the sending terminal to the receiving terminal, determining second target data needing to be transmitted by the sending terminal by the receiving terminal, and informing the sending terminal of transmitting the second target data to the receiving terminal; and receiving the second target data transmitted by the sending terminal.

In some exemplary embodiments, the sending terminal sends the first target data to the receiving terminal, including:

the receiving terminal sends the first target data to the sending terminal through the TCP connection between the receiving terminal and the sending terminal;

the notifying, by the receiving terminal, the sending terminal of the transmission of the second target data to the receiving terminal includes:

the receiving terminal informs the sending terminal of transmitting the second target data to the receiving terminal through the GATT connection between the receiving terminal and the sending terminal;

the receiving terminal receiving the second target data transmitted by the sending terminal, including:

and the receiving terminal receives the second target data transmitted by the sending terminal through the TCP connection between the receiving terminal and the sending terminal.

In some exemplary embodiments, the receiving terminal receives screen projection data sent by a sending terminal, and the screen projection data includes:

and the receiving terminal receives the screen projection data sent by the sending terminal through the UDP connection with the sending terminal.

According to a second aspect of the exemplary embodiments, there is provided a screen projection method applied to a transmitting terminal, the method including:

the sending terminal carries out screen recording on the screen display content to obtain screen projection data;

the sending terminal sends the screen projection data to a receiving terminal so that the receiving terminal can display the screen display content of the sending terminal in a target area in a display interface according to the received screen projection data, wherein the target area is a partial area in the display interface of the receiving terminal.

In some exemplary embodiments, after the sending terminal sends the screen projection data to the receiving terminal, the method further includes:

the sending terminal receives control data corresponding to the control instruction sent by the receiving terminal and executes corresponding response operation according to the control data; the control data is data which is generated by the receiving terminal in response to a control instruction triggered by a user in the target area and corresponds to the control instruction and is used for representing the triggering position and/or the control type of the control instruction.

In some exemplary embodiments, the receiving, by the sending terminal, control data corresponding to the control instruction sent by the receiving terminal includes:

and the sending terminal receives the control data corresponding to the control instruction sent by the receiving terminal through the GATT connection with the receiving terminal.

the sending terminal receives first target data sent by the receiving terminal; the first target data is sent by the receiving terminal after responding to a first transmission instruction of data transmission from the receiving terminal to the sending terminal, which is triggered by a user on the display interface; and/or

The sending terminal receives a notification of transmitting second target data sent by the receiving terminal and transmits the second target data to the receiving terminal; and the second target data is determined by the receiving terminal according to a second transmission instruction which is triggered by the user in the display interface and is used for transmitting data from the sending terminal to the receiving terminal.

In some exemplary embodiments, the receiving terminal receives first target data sent by the receiving terminal, including:

the sending terminal receives first target data sent by the receiving terminal through TCP connection with the receiving terminal;

the sending terminal receiving the notification sent by the receiving terminal for determining that the sending terminal needs to transmit the second target data includes:

the sending terminal receives a notification which is sent by the receiving terminal and used for determining second target data needing to be transmitted by the sending terminal through the GATT connection with the receiving terminal;

the transmitting terminal transmits the second target data to the receiving terminal, and the method includes:

and the sending terminal transmits the second target data to the receiving terminal through the TCP connection between the sending terminal and the receiving terminal.

In some exemplary embodiments, the sending terminal sends the screen projection data to the receiving terminal, including:

and the sending terminal sends the screen projection data to the receiving terminal through the UDP connection with the receiving terminal.

According to a third aspect of the exemplary embodiments, there is provided a first terminal, the terminal comprising a processor and a transceiver unit:

the transceiving unit is configured to receive screen projection data sent by a sending terminal; the screen projection data are obtained by screen recording of screen display contents by a sending terminal;

the processor is configured to display the screen display content of the sending terminal in a target area in a display interface according to the received screen projection data, wherein the target area is a partial area in the display interface of the receiving terminal.

In some exemplary embodiments, the processor is configured to, in response to a control instruction triggered by a user in the target area, generate control data corresponding to the control instruction and indicating a trigger position and/or a control type of the control instruction, and transmit the generated control data corresponding to the control instruction to the transceiver unit;

the transceiving unit is configured to send control data corresponding to the control instruction to the sending terminal, so that the sending terminal executes corresponding response operation according to the control data.

In some exemplary embodiments, the transceiver unit is configured to transmit the control data corresponding to the operation instruction to the transmitting terminal through a GATT connection with the transmitting terminal.

In some exemplary embodiments, the processor is configured to determine first target data required to be transmitted to the sending terminal in response to a first transmission instruction for transmitting data from the receiving terminal to the sending terminal, which is triggered by a user in the display interface, and transmit the first target data to the transceiver unit;

the transceiving unit is configured to transmit the first target data to the transmitting terminal;

the processor is configured to respond to a second transmission instruction which is triggered by a user in the display interface and is used for transmitting data from the sending terminal to the receiving terminal, and determine second target data which needs to be transmitted by the sending terminal;

the transceiving unit is configured to notify the transmitting terminal to transmit the second target data to the receiving terminal; and receiving the second target data transmitted by the sending terminal.

In some exemplary embodiments, the transceiving unit is configured to transmit the first target data to the transmitting terminal through a TCP connection with the transmitting terminal; informing the sending terminal to transmit the second target data to the receiving terminal through the GATT connection with the sending terminal; and receiving the second target data transmitted by the sending terminal through the TCP connection with the sending terminal.

In some exemplary embodiments, the transceiving unit is configured to receive the screen-shot data transmitted by the transmitting terminal through a UDP connection with the transmitting terminal.

According to a fourth aspect of the exemplary embodiments there is provided a terminal comprising a processor and a transceiver unit:

the processor is configured to perform screen recording on screen display content to obtain screen projection data, and transmit the screen projection data to the transceiver unit;

the transceiver is configured to send the screen projection data to a receiving terminal, so that the receiving terminal displays screen display content of the sending terminal in a target area in a display interface according to the received screen projection data, wherein the target area is a partial area in the display interface of the receiving terminal.

In some exemplary embodiments, the transceiver unit is configured to receive control data corresponding to a control instruction sent by the receiving terminal;

the processor is configured to perform a corresponding response operation in accordance with the control data; the control data is data which is generated by the receiving terminal in response to a control instruction triggered by a user in the target area and corresponds to the control instruction and is used for representing the triggering position and/or the control type of the control instruction.

In some exemplary embodiments, the transceiver unit is configured to receive, through a GATT connection with the receiving terminal, control data corresponding to the control instruction sent by the receiving terminal.

In some exemplary embodiments, the transceiving unit is configured to receive first target data transmitted by the receiving terminal; the first target data is sent by the receiving terminal after responding to a first transmission instruction of data transmission from the receiving terminal to the sending terminal, which is triggered by a user on the display interface; and/or

Receiving a notification of transmitting second target data sent by the receiving terminal, and transmitting the second target data to the receiving terminal; and the second target data is determined by the receiving terminal according to a second transmission instruction which is triggered by the user in the display interface and is used for transmitting data from the sending terminal to the receiving terminal.

In some exemplary embodiments, the transceiving unit is configured to receive first target data transmitted by the receiving terminal through a TCP connection with the receiving terminal; receiving a notification which is sent by the receiving terminal and used for determining second target data which needs to be transmitted by the sending terminal through the GATT connection with the receiving terminal; and transmitting the second target data to the receiving terminal through the TCP connection between the transmitting terminal and the receiving terminal.

In some exemplary embodiments, the transceiving unit is configured to transmit the screen projection data to the receiving terminal through a UDP connection with the receiving terminal.

According to a fifth aspect of the exemplary embodiments there is provided a third terminal comprising:

the receiving module is used for receiving screen projection data sent by the sending terminal; the screen projection data are obtained by screen recording of screen display contents by a sending terminal;

and the processing module is used for displaying the screen display content of the sending terminal in a target area in a display interface according to the received screen projection data, wherein the target area is a partial area in the display interface of the receiving terminal.

According to a sixth aspect of the exemplary embodiments there is provided a fourth terminal comprising:

the recording module is used for carrying out screen recording on the screen display content to obtain screen projection data;

the sending module is used for sending the screen projection data to a receiving terminal so that the receiving terminal can display the display content of the sending terminal in a target area in a display interface according to the received screen projection data, wherein the target area is a partial area in the display interface of the receiving terminal.

In a seventh aspect, the present invention also provides a computer storage medium having a computer program stored thereon, which when executed by a processor, performs the steps of the method of the first aspect.

In addition, for technical effects brought by any one implementation manner of the second aspect to the seventh aspect, reference may be made to technical effects brought by different implementation manners of the first aspect, and details are not described here.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

Fig. 1 schematically illustrates a structure of a mobile terminal according to an embodiment of the present invention;

fig. 2 is a schematic diagram illustrating a software architecture of a mobile terminal according to an embodiment of the present invention;

FIG. 3 is a schematic diagram illustrating a user interface of a mobile terminal according to an embodiment of the present invention;

FIG. 4 is a diagram illustrating an application scenario provided by an embodiment of the present invention;

fig. 5A is a diagram illustrating an exemplary display interface of a mobile phone screen according to an embodiment of the present invention;

FIG. 5B is a diagram illustrating an exemplary flat panel display interface provided by an embodiment of the invention;

FIG. 5C is a schematic diagram illustrating a display interface of a tablet after screen projection is implemented according to an embodiment of the present invention;

FIG. 6 is a flow chart illustrating a screen projection method provided by an embodiment of the invention;

fig. 7 is a schematic diagram illustrating a flow chart of establishing a GATT connection according to an embodiment of the present invention;

fig. 8 is a flowchart illustrating a first IP address acquisition process based on WiFi P2P connection according to an embodiment of the present invention;

fig. 9 is a flowchart illustrating an IP address acquisition process based on a WiFi P2P connection according to a second embodiment of the present invention;

FIG. 10 is a diagram illustrating a display interface of a user at a target area control command trigger position according to an embodiment of the present invention;

fig. 11 is a schematic diagram illustrating a first data transmission application scenario provided by an embodiment of the present invention;

fig. 12 is a schematic diagram illustrating a second scenario of data transmission according to an embodiment of the present invention;

fig. 13 is a schematic diagram illustrating a third scenario of data transmission application provided in the embodiment of the present invention;

fig. 14 is a schematic diagram illustrating a fourth scenario of data transmission application provided in the embodiment of the present invention;

fig. 15 is a schematic diagram illustrating a fifth data transmission application scenario provided by the embodiment of the present invention;

fig. 16 is a schematic diagram illustrating a sixth scenario of data transmission according to an embodiment of the present invention;

fig. 17 is a schematic diagram illustrating a first screen projection process provided by an embodiment of the present invention;

fig. 18 is a schematic diagram illustrating a second screen projection process provided by the embodiment of the present invention;

fig. 19 is a schematic structural diagram illustrating a first terminal according to an embodiment of the present invention;

fig. 20 is a schematic structural diagram illustrating a second terminal according to an embodiment of the present invention;

fig. 21 is a schematic structural diagram illustrating a third terminal according to an embodiment of the present invention;

fig. 22 is a schematic structural diagram illustrating a fourth terminal according to an embodiment of the present invention.

Detailed Description

The technical solution in the embodiments of the present invention will be described in detail and removed with reference to the accompanying drawings. In the description of the embodiments of the present invention, where "/" denotes an or meaning, for example, a/B may denote a or B; "and/or" in the text is only an association relationship describing an associated object, and means that three relationships may exist, for example, a and/or B may mean: three cases of a alone, a and B both, and B alone exist, and in addition, "a plurality" means two or more than two in the description of the embodiment of the present invention.

In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first" and "second" may explicitly or implicitly include one or more of the features, and in the description of embodiments of the invention, "plurality" means two or more unless indicated otherwise.

Some of the words that appear in the text are explained below:

1. the term BLE, also called Bluetooth Low Energy (BLE), is a short-range, Low-cost, interoperable wireless technology that utilizes many intelligent means to minimize power consumption, and Low-speed and simple interaction protocols are important components for reducing power consumption. BLE is therefore generally applied to low-rate near-field control and data interaction, such as smart appliances, sports bracelets, and so on. BLE connections are built on the Generic Attribute Profile (GATT) protocol.

2. The term "GATT" in embodiments of the present invention is a general specification for sending and receiving very short data segments, referred to as attributes (attributes), over a bluetooth connection.

3. In the term of MTU negotiation, that is, Maximum Transmission Unit (MTU), in the embodiment of the present invention, considering that some Bluetooth Smart devices are weak in function and do not have too much memory space, a default MTU of an ATT is specified to be 23 bytes in Bluetooth Core Specification (Bluetooth Specification protocol), and only 20 bytes are actually available in GATT training after one byte of Opcode of the ATT and 2 bytes of Handle of the ATT are removed. In fact, the maximum length of the ATT is 512 bytes, so the maximum length of the MTU of the ATT can be regarded as 512 bytes.

4. The term "MAC address", i.e. a Medium Access Control (MAC) address, also called a local area network address, an ethernet address or a physical address, is used to identify the location of a network device. The MAC address is used to uniquely identify a network card in the network, and if one or more network cards exist in a device, each network card needs to have a unique MAC address.

5. The term "UDP/TCP Protocol" in the embodiments of the present invention belongs to a User Data Protocol (UDP) and a transport layer Protocol (TCP), and the UDP Protocol are the core of the TCP/IP Protocol. Where TCP provides reliable transport of data in an IP environment, it provides services including data streaming, reliability, efficient flow control, full duplex operation, and multiplexing. Sending through connection-oriented, end-to-end and reliable data packets. In popular terms, a connected channel is opened for transmitted data in advance, and then the data is transmitted; while UDP does not provide reliability, flow control or error recovery functions for IP. Generally, TCP corresponds to applications with high reliability requirements, while UDP corresponds to applications with low reliability requirements and economical transmission.

6. The term "Wi-Fi Direct", also called Wi-Fi P2P, of the embodiment of the invention, the Wi-Fi Direct technology is a challenge initiated by the Wi-Fi industry chain to the Bluetooth technology, the Wi-Fi Direct technology is intended to completely replace Bluetooth, the Wi-Fi Direct technology is a point-to-point connection technology, tcp/ip link can be directly established between two stations, and AP participation is not needed; one of the stations functions as a conventional AP and is called Group Owner (GO), and the other station is called Group Client (GC) and is connected to the GO like an AP. GO and GC may be not only one-to-one but also one-to-many.

7. The term "Miracast" in the embodiments of the present invention is a wireless display standard based on WiFi Direct (WiFi Direct), and a 3C device supporting the standard can share audio and video images in an unlimited manner, for example, the audio and video images of a mobile phone or a tablet mobile device can be shared to another screen display device such as a tablet, a computer, or a projector.

8. In the embodiment of the present invention, the term "RTSP", i.e., Real Time Streaming Protocol (RTSP), the screen projection is generally implemented by the RTSP Protocol, the RTSP is an application layer Protocol in the TCP/IP Protocol system, the RTSP is a multimedia Streaming Protocol for controlling sound or images, and a network communication Protocol used in transmission is not within a defined range.

9. The term "mobile terminal", mobile terminal or mobile communication terminal in the embodiments of the present invention refers to a computer device that can be used in mobile, and broadly includes a mobile phone, a notebook, a tablet computer, a POS machine, and even a vehicle-mounted computer. But most often refer to cell phones or smart phones and tablets with multiple application functions.

Fig. 1 shows a schematic configuration of a mobile terminal 100.

The following describes an embodiment specifically by taking the mobile terminal 100 as an example. It should be understood that the mobile terminal 100 shown in fig. 1 is merely an example, and that the mobile terminal 100 may have more or fewer components than shown in fig. 1, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

A block diagram of a hardware configuration of a mobile terminal 100 according to an exemplary embodiment is exemplarily shown in fig. 1. As shown in fig. 1, the mobile terminal 100 includes: a Radio Frequency (RF) circuit 110, a memory 120, a display unit 130, a camera 140, a sensor 150, an audio circuit 160, a Wireless Fidelity (Wi-Fi) module 170, a processor 180, a bluetooth module 181, and a power supply 190.

The RF circuit 110 may be used for receiving and transmitting signals during information transmission and reception or during a call, and may receive downlink data of a base station and then send the downlink data to the processor 180 for processing; the uplink data may be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.

The memory 120 may be used to store software programs and data. The processor 180 performs various functions of the mobile terminal 100 and data processing by executing software programs or data stored in the memory 120. The memory 120 may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. The memory 120 stores an operating system that enables the mobile terminal 100 to operate. The memory 120 may store an operating system and various application programs, and may also store codes for performing the methods described in the embodiments of the present application.

The display unit 130 may be used to receive input numeric or character information and generate signal input related to user settings and function control of the mobile terminal 100, and particularly, the display unit 130 may include a touch screen 131 disposed on the front of the mobile terminal 100 and may collect touch operations of a user thereon or nearby, such as clicking a button, dragging a scroll box, and the like.

The display unit 130 may also be used to display a Graphical User Interface (GUI) of information input by or provided to the user and various menus of the terminal 100. In particular, the display unit 130 may include a display screen 132 disposed on the front surface of the mobile terminal 100. The display screen 132 may be configured in the form of a liquid crystal display, a light emitting diode, or the like. The display unit 130 may be used to display various graphical user interfaces described herein.

The touch screen 131 may cover the display screen 132, or the touch screen 131 and the display screen 132 may be integrated to implement the input and output functions of the mobile terminal 100, and after the integration, the touch screen may be referred to as a touch display screen for short. In the present application, the display unit 130 may display the application programs and the corresponding operation steps.

The camera 140 may be used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing elements convert the light signals into electrical signals which are then passed to the processor 180 for conversion into digital image signals.

The mobile terminal 100 may further include at least one sensor 150, such as an acceleration sensor 151, a distance sensor 152, a fingerprint sensor 153, a temperature sensor 154. The mobile terminal 100 may also be configured with other sensors such as a gyroscope, barometer, hygrometer, thermometer, infrared sensor, light sensor, motion sensor, and the like.

The audio circuitry 160, speaker 161, microphone 162 may provide an audio interface between a user and the mobile terminal 100. The audio circuit 160 may transmit the electrical signal converted from the received audio data to the speaker 161, and convert the electrical signal into a sound signal for output by the speaker 161. The mobile terminal 100 may also be provided with a volume button for adjusting the volume of the sound signal. On the other hand, the microphone 162 converts the collected sound signal into an electrical signal, converts the electrical signal into audio data after being received by the audio circuit 160, and outputs the audio data to the RF circuit 110 to be transmitted to, for example, another terminal or outputs the audio data to the memory 120 for further processing. In this application, the microphone 162 may capture the voice of the user.

Wi-Fi belongs to a short-distance wireless transmission technology, and the mobile terminal 100 may help a user to receive and transmit e-mails, browse webpages, access streaming media, and the like through the Wi-Fi module 170, which provides a wireless broadband internet access for the user.

The processor 180 is a control center of the mobile terminal 100, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the mobile terminal 100 and processes data by running or executing software programs stored in the memory 120 and calling data stored in the memory 120. In some embodiments, processor 180 may include one or more processing units; the processor 180 may also integrate an application processor, which mainly handles operating systems, user interfaces, applications, etc., and a baseband processor, which mainly handles wireless communications. It will be appreciated that the baseband processor described above may not be integrated into the processor 180. In the present application, the processor 180 may run an operating system, an application program, a user interface display, and a touch response, and the processing method described in the embodiments of the present application. Further, the processor 180 is coupled with the display unit 130.

And the bluetooth module 181 is configured to perform information interaction with other bluetooth devices having a bluetooth module through a bluetooth protocol. For example, the mobile terminal 100 may establish a bluetooth connection with a wearable electronic device (e.g., a smart watch) having a bluetooth module via the bluetooth module 181, so as to perform data interaction.

The mobile terminal 100 also includes a power supply 190 (e.g., a battery) that powers the various components. The power supply may be logically connected to the processor 180 through a power management system to manage charging, discharging, power consumption, etc. through the power management system. The mobile terminal 100 may also be configured with power buttons for powering the terminal on and off, and locking the screen.

Fig. 2 is a block diagram of a software configuration of the mobile terminal 100 according to the embodiment of the present invention.

The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, and a kernel layer from top to bottom.

The application layer may include a series of application packages.

As shown in fig. 2, the application package may include applications such as camera, gallery, calendar, phone call, map, navigation, WLAN, bluetooth, music, video, short message, etc.

The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 2, the application framework layers may include a window manager, content provider, view system, phone manager, resource manager, notification manager, and the like.

The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide a communication function of the mobile terminal 100. Such as management of call status (including on, off, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.

The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, text information is prompted in the status bar, a prompt tone is given, the mobile terminal vibrates, an indicator light flashes, and the like.

The Android Runtime comprises a core library and a virtual machine. The Android runtime is responsible for scheduling and managing an Android system.

The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. And executing java files of the application program layer and the application program framework layer into a binary file by the virtual machine. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface managers (surface managers), Media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), and the like.

The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, and the like.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The following describes exemplary workflow of the mobile terminal 100 software and hardware in connection with capturing a photo scene.

When the touch screen 131 receives a touch operation, a corresponding hardware interrupt is issued to the kernel layer. The kernel layer processes the touch operation into an original input event (including touch coordinates, a time stamp of the touch operation, and other information). The raw input events are stored at the kernel layer. And the application program framework layer acquires the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch click operation, and taking a control corresponding to the click operation as a control of a camera application icon as an example, the camera application calls an interface of an application framework layer, starts the camera application, further starts a camera drive by calling a kernel layer, and captures a still image or a video through the camera 140.

The mobile terminal 100 in the embodiment of the present application may be a mobile phone, a tablet computer, a wearable device, a notebook computer, a television, and the like.

Fig. 3 is a schematic diagram illustrating a user interface on a mobile terminal (e.g., mobile terminal 100 of fig. 1). In some implementations, a user can open a corresponding application by touching an application icon on the user interface, or can open a corresponding folder by touching a folder icon on the user interface.

With the development of communication technology, communication tools such as mobile terminals and the like can meet the requirements of users in different occasions, and one user can own a plurality of mobile terminals.

In view of this, in the embodiment of the present invention, the sending terminal performs screen recording on the screen display content to obtain screen projection data, and sends the screen projection data to the receiving terminal; the receiving terminal receives the screen projection data sent by the sending terminal, and displays the screen display content of the sending terminal in a target area in the display interface according to the received screen projection data. In the embodiment of the invention, after the receiving terminal receives the screen projection data sent by the sending terminal, the screen display content recorded by the sending terminal is displayed in a partial area in the display interface, so that after the screen display content of the sending terminal is projected to the receiving terminal, the screen display content of the sending terminal is displayed only in the partial area in the display interface of the receiving terminal, and other areas in the display interface of the receiving terminal can continuously display the screen display content of the receiving terminal.

As shown in fig. 4, a schematic diagram of an application scenario provided in an embodiment of the present invention includes a target user 40, a sending terminal 41, and a receiving terminal 42.

The screen projecting applications are installed on the sending terminal 41 and the receiving terminal 42, and the target user 40 starts the screen projecting applications installed on the sending terminal 41 and the receiving terminal 42; wherein, the sending terminal 41 and the receiving terminal 42 are connected through a near-field internal network established by the WiFi P2P which is not based on an external network; responding to a screen recording instruction triggered by a target user 40, recording screen display contents by a sending terminal 41 to obtain screen projection data, and sending the screen projection data to a receiving terminal 42 by the sending terminal 41; the receiving terminal 42 presents the screen display content of the transmitting terminal 41 in a partial area in the display interface.

For example, assume that the sending terminal is a mobile phone and the receiving terminal is a tablet; the mobile phone screen shown in fig. 5A displays content, and the flat panel display interface shown in fig. 5B displays content; the WiFi P2P connection is established between the mobile phone and the tablet, after screen display content of the mobile phone is recorded to obtain screen projection data, the mobile phone sends the screen projection data to the tablet, the tablet displays the screen display content of the mobile phone in a partial area of a display interface, and after screen projection, the display interface of the tablet is as shown in FIG. 5C.

As shown in fig. 6, a schematic flow chart of a screen projection method provided in an embodiment of the present invention mainly includes the following steps:

s601, a sending terminal carries out screen recording on screen display contents to obtain screen projection data;

step S602, the sending terminal sends screen projection data to the receiving terminal;

step S603, the receiving terminal receives screen projection data sent by the sending terminal;

s604, the receiving terminal displays the screen display content of the sending terminal in a target area in a display interface according to the received screen projection data;

the target area is a partial area in the display interface of the receiving terminal, and meanwhile, the area except the target area in the display interface of the receiving terminal can continuously display the current interface of the receiving terminal.

In the implementation, in order to realize the connection between the sending terminal and the receiving terminal before the screen projection from the sending terminal to the receiving terminal;

the sending terminal and the receiving terminal establish BLE GATT connection and WiFi P2P connection; the two connection establishment methods are described below.

1. And the transmitting terminal and the receiving terminal establish BLE GATT connection.

As shown in fig. 7, a flowchart for establishing BLE GATT connection according to an embodiment of the present invention mainly includes the following steps:

step S701, a receiving terminal sends BLE broadcast;

step S702, a sending terminal performs BLE broadcast scanning;

step S703, the sending terminal initiates a GATT connection request to the receiving terminal after scanning the BLE broadcast sent by the receiving terminal;

it should be noted that the BLE broadcast includes the device name of the receiving terminal, and the sending terminal scans the peripheral BLE broadcast and determines the corresponding receiving terminal according to the device name of the receiving terminal;

step S704, the receiving terminal receives the GATT connection request sent by the sending terminal;

step S705, after the receiving terminal confirms the establishment of the GATT connection, the receiving terminal establishes the GATT connection with the sending terminal.

It should be noted that, when data is transmitted between the sending terminal and the receiving terminal through the GATT connection, if the size of the data content exceeds 20 bytes, MTU negotiation needs to be performed through the requestMTU interface.

2. GATT connection is established between the sending terminal and the receiving terminal.

After confirming the establishment of the GATT connection, the embodiment of the invention can establish WiFi P2P connection between the sending terminal and the receiving terminal;

in implementation, the receiving terminal sends the MAC address of the WiFi P2P to the sending terminal through GATT connection, the sending terminal sends a WiFi P2P connection request to the receiving terminal according to the MAC address of the WiFi P2P, the receiving terminal receives the WiFi P2P connection request and confirms acceptance, and then the sending terminal and the receiving terminal establish WiFi P2P connection.

It should be noted that the receiving terminal may send the MAC address of the WiFi P2P to the sending terminal through the GATT connection, and since the MAC address has only 6 bytes and adds the format separator ": i.e. similar to the format separator": "form, such as" 02:00:00:00:00 ", the content does not exceed 20 bytes, the receiving terminal may send the MAC address of the WiFi P2P to the sending terminal directly through the GATT connection without performing MTU negotiation of GATT charateristic here.

In addition, before the WiFi P2P connection is established, if a Group is not created, the system automatically creates a Group and randomly allocates GO (Group owner), generally, the device initiating the WiFi P2P connection is used as GC (Group client), and the party accepting the invitation is used as GO, but it is not absolute, so when there is no method to explicitly specify that a certain device is necessarily GO and another device is necessarily GC, the opposite device can be suggested as GC or GO through the groupoowernent parameter, but finally the result of the bottom layer negotiation is still the standard.

It should be noted that, one device is negotiated as a GO end and the other device is negotiated as a GC end according to a bottom negotiation result, in general, Android native design GC devices may directly obtain an IP address of GO through an upper interface (the IP address is generally 192.168.49.1 specified by a protocol), but the GO does not have an explicit method to obtain the IP address of the GC.

After the WiFi P2P connection is established, the embodiment of the invention can acquire the IP address of the opposite terminal based on the WiFi P2P connection;

as shown in fig. 8, an IP address acquisition process schematic diagram based on WiFi P2P connection in the embodiment of the present invention assumes that a sending terminal is a GC terminal and a receiving terminal is a GO terminal, and mainly includes the following steps:

step S801, a transmitting terminal initiates a WiFi P2P connection request to a receiving terminal;

step S802, the receiving terminal receives a WiFi P2P connection request sent by the sending terminal;

step S803, the receiving terminal confirms to establish WiFi P2P connection;

step S804, the sending terminal directly obtains and saves the IP address of the receiving terminal;

step S805, the sending terminal sends a first UDP connection establishment request to the receiving terminal according to the IP address of the receiving terminal;

step S806, the receiving terminal receives a first UDP connection establishment request sent by the sending terminal and confirms that a first UDP connection is established with the sending terminal;

step S807, the sending terminal sends the IP address of the sending terminal to the receiving terminal through the first UDP connection;

step S808, the receiving terminal receives the IP address of the sending terminal through the first UDP connection;

and step S809, the receiving terminal establishes a second UDP connection with the sending terminal according to the IP address of the sending terminal.

As shown in fig. 9, an IP address acquisition process schematic diagram based on WiFi P2P connection in the embodiment of the present invention, assuming that a sending terminal is a GO terminal and a receiving terminal is a GC terminal, mainly includes the following steps:

step S901, the receiving terminal initiates a WiFi P2P connection request to the sending terminal;

step S902, the sending terminal receives a WiFi P2P connection request sent by the receiving terminal;

step S903, the sending terminal confirms to establish WiFi P2P connection;

step S904, the receiving terminal directly obtains and saves the IP address of the sending terminal;

step S905, the receiving terminal sends a first UDP connection establishment request to the sending terminal according to the IP address of the sending terminal;

step S906, the sending terminal receives a first UDP connection establishment request sent by the receiving terminal and confirms that a first UDP connection is established with the receiving terminal;

step S907, the receiving terminal sends the IP address of the receiving terminal to the receiving terminal through the first UDP connection;

step S908, the sending terminal receives the IP address of the receiving terminal through the first UDP connection;

step S909, the sending terminal establishes a second UDP connection with the receiving terminal according to the IP address of the receiving terminal.

It should be noted that after the sending terminal establishes a WiFi P2P connection with the receiving terminal, the GC terminal obtains the IP address of the GO terminal and sends the GC terminal address to the GO terminal through a first UDP connection according to the IP address, specifically, the GC terminal specifies an IP _ Port, where the IP _ Port may be 11788, the GC terminal sends the IP address corresponding to the WiFi P2P of the GC terminal to the GO terminal according to the IP address, and the GO terminal waits to receive the IP address corresponding to the WiFi P2P transmitted from the GC terminal by monitoring the IP _ Port before the Wi-Fi P2P connection is established.

It should be noted that the IP address of the opposite end is generally stored in the proc/net/arp cache table of the local computer, but the arp table is often updated in a non-timely manner or the mac address does not correspond to the arp table, so that the conventional method of obtaining the IP address by querying the arp table is not very reliable. In the Android system, a native IP address with an iface (network interface) type of p2p-wlan0 can be acquired through a network interface object.

In implementation, based on the above described embodiments, a GATT connection is established between a sending terminal and a receiving terminal; the receiving terminal sends the MAC address of the receiving terminal to the sending terminal through GATT connection, the sending terminal sends a WiFi P2P connection request to the sending terminal according to the MAC address of the WiFi P2P, and WiFi P2P connection is established between the sending terminal and the receiving terminal; based on the WiFi P2P connection established between the sending terminal and the receiving terminal, the IP address of the opposite terminal can be obtained and the first UDP connection and the second UDP connection can be established.

In implementation, the sending terminal performs screen recording on the content displayed in the screen to obtain screen projection data, the screen projection data is sent to the receiving terminal through a second UDP connection, the receiving terminal receives the screen projection data through the second UDP connection, and the screen display content of the sending terminal is displayed in a target area in a display interface.

According to the embodiment of the invention, after the screen display content of the sending terminal is displayed in the target area of the display interface of the receiving terminal, the control operation of the sending terminal by the receiving terminal triggered in the target area can be realized.

An optional implementation manner is that a user can trigger operation in a target area, and a receiving terminal responds to a control instruction triggered by the user in the target area and generates control data corresponding to the control instruction and used for expressing a control instruction triggering position and/or a control type; the receiving terminal sends the control data to the sending terminal through the GATT connection between the receiving terminal and the sending terminal; and the sending terminal receives the control data corresponding to the control instruction sent by the receiving terminal through the GATT connection with the receiving terminal and executes corresponding response operation.

It should be noted that, besides the control command trigger position and the control type, the control data may also include the flat screen resolution and the horizontal and vertical screen states.

In implementation, the triggering position of the control command is represented by X, Y axis coordinates of the currently clicked screen, so that accurate position coordinates are obtained, and the accuracy of information transmission can be ensured.

Specifically, the user may trigger the corresponding position of the target area according to the own requirement, in the implementation, the sending terminal takes a mobile phone as an example, the receiving terminal takes a tablet as an example, as shown in fig. 10, a display interface of the tablet is shown, and the user may trigger a control instruction in the display area of the mobile phone in the display interface of the tablet, for example, the user triggers to open a gallery application in the mobile phone.

In implementation, the control type corresponding to the control instruction may include, but is not limited to:

and pressing, bouncing, dragging, selecting text content, and then releasing through multi-finger sliding/grabbing.

When the embodiment of the invention transmits control data through the GATT connection between the sending terminal and the receiving terminal, the size of the control data exceeds 20 bytes, so that the flat panel firstly needs to request to carry out MTU negotiation through a request MTU interface when the GATT transmission is carried out, and if the negotiation at the two ends is successful, the receiving terminal informs the sending terminal to receive the control data through executing a GATT read Characteriodic change interface once. If the negotiation between the two ends fails, the receiving terminal needs to split the control data into a plurality of segments with 20 bytes as a unit and execute a plurality of GATT read probabilistic change interfaces to inform the sending terminal to receive the control data for a plurality of times, and finally, the sending terminal executes corresponding response operation after the sending terminal assembles the control data segments into complete control data.

According to the embodiment of the invention, after the screen display content sent by the mobile phone is displayed in the target area in the flat panel display interface, the bidirectional transmission of data can be realized.

An optional implementation manner is that the receiving terminal transmits data to the sending terminal, where the transmitted data may be pictures and videos in a gallery, files in a file gallery, or a certain piece of text information.

Specifically, a user triggers a first transmission instruction for transmitting data from a receiving terminal to a sending terminal in a display interface of the receiving terminal, the receiving terminal responds to the first transmission instruction, determines first target data needing to be transmitted to the sending terminal, and sends the first target data to the sending terminal through TCP connection between the receiving terminal and the sending terminal; the sending terminal receives first target data sent by the receiving terminal.

It should be noted that, data transmission focuses on the integrity of the transmission content, so that a TCP connection with high reliability is used in implementation to transmit information such as audio, video, and files with large data volume.

In implementation, the sending terminal takes a mobile phone as an example, the receiving terminal takes a tablet as an example, the tablet transmits data to the mobile phone, and there may be schematic diagrams corresponding to many actual application scenarios, for example, if the tablet supports a touch screen operation, as shown in fig. 11, a user selects a picture to be sent from a gallery of the tablet, and sends the picture selected from the gallery to the mobile phone through a drag operation, such as a touch trajectory of the user in fig. 11, where an initial touch position of the drag operation is in a region of a display interface of the tablet other than a display region of a screen of the mobile phone, and an end position of the drag operation is in the display region of the screen of the mobile phone in the display interface of the tablet;

for another example, as shown in fig. 12, the user selects a picture to be sent from the gallery of the tablet, triggers a sending operation in a region other than the display region of the mobile phone screen in the display interface of the tablet, and selects to send the picture to the mobile phone, so that the tablet sends the selected picture to the mobile phone;

for another example, the user copies text information in an area other than the display area of the screen of the mobile phone in the display interface of the tablet, and sends the selected text information to the mobile phone through a drag operation, as shown in the touch trajectory of the user in fig. 13, after receiving the text information sent by the tablet, the mobile phone may store the text information in the note application.

In an alternative implementation, the user triggers an operation in the target area, and the sending terminal transmits data to the receiving terminal.

The receiving terminal responds to a second transmission instruction which is triggered by the user in the display interface and transmits data from the sending terminal to the receiving terminal, determines second target data needing to be transmitted, and informs the sending terminal of transmitting the second target data to the receiving terminal; and the sending terminal receives the notification of transmitting the second target data sent by the receiving terminal and transmits the second target data to the receiving terminal.

In implementation, a GATT connection is established between the sending terminal and the receiving terminal, the receiving terminal notifies the sending terminal to transmit second target data to the receiving terminal through the GATT connection, the sending terminal receives a notification that the second target data to be transmitted is determined, the notification is sent by the receiving terminal through the GATT connection, the second target data is transmitted to the receiving terminal through a TCP connection between the sending terminal and the receiving terminal, and the receiving terminal receives the second target data transmitted by the sending terminal through the TCP connection between the receiving terminal and the sending terminal.

In implementation, the sending terminal takes a mobile phone as an example, the receiving terminal takes a tablet as an example, and an operation is triggered in a target region, so that the mobile phone can transmit data to the tablet, and a plurality of schematic diagrams corresponding to practical application scenes can be provided;

for another example, as shown in fig. 15, a user selects a picture to be sent from a gallery of the mobile phone, a mobile phone screen display area in a display interface of the tablet triggers a sending operation, and selects to send the picture to the tablet, so that the mobile phone sends the selected picture to the tablet;

for another example, the user copies text information in the mobile phone in the display area of the mobile phone screen in the display interface of the tablet, and sends the selected text information to the tablet through a drag operation, as shown in the touch trajectory of the user in fig. 16, after receiving the text information sent by the mobile phone, the tablet may store the text information in the note application.

As shown in fig. 17, a first screen projection method provided in the embodiment of the present invention is applied to a receiving terminal side, and mainly includes the following steps:

step S1701, the receiving terminal receives screen projection data sent by the sending terminal; the screen projection data are obtained by screen recording of screen display contents by a sending terminal;

step 1702, the receiving terminal displays the screen display content of the sending terminal in a target area in the display interface according to the received screen projection data, wherein the target area is a partial area in the display interface of the receiving terminal.

As shown in fig. 18, the second screen projection method provided in the embodiment of the present invention is applied to a sending terminal side, and mainly includes the following steps:

step S1801, the sending terminal performs screen recording on the screen display content to obtain screen projection data;

step S1801, the sending terminal sends the screen projection data to the receiving terminal, so that the receiving terminal displays the screen display content of the sending terminal in a target area in the display interface according to the received screen projection data, where the target area is a partial area in the display interface of the receiving terminal.

Based on the same concept, as shown in fig. 19, the first terminal provided by the embodiment of the present invention, the terminal processor 1901 and the transceiver 1902:

the transceiver 1902 is configured to receive screen projection data sent by a sending terminal; the screen projection data are obtained by screen recording of screen display contents by a sending terminal;

the processor 1901 is configured to display the screen display content of the sending terminal in a target area in a display interface according to the received screen projection data, where the target area is a partial area in the display interface of the receiving terminal.

Optionally, the processor 1901 is configured to, in response to a control instruction triggered by a user in the target area, generate control data corresponding to the control instruction and used for indicating a trigger position and/or a control type of the control instruction, and transmit the generated control data corresponding to the control instruction to the transceiver unit;

the transceiver 1902 is configured to send control data corresponding to the control instruction to the sending terminal, so that the sending terminal performs a corresponding response operation according to the control data.

Optionally, the transceiver 1902 is configured to transmit, through a GATT connection with the transmitting terminal, control data corresponding to the operation instruction to the transmitting terminal.

Optionally, the processor 1901 is configured to determine, in response to a first transmission instruction triggered in the display interface by a user to transmit data from the receiving terminal to the sending terminal, first target data that needs to be transmitted to the sending terminal, and transmit the first target data to the transceiver unit;

the transceiver 1902 is configured to transmit the first target data to the transmitting terminal;

the processor 1901 is configured to determine, in response to a second transmission instruction triggered in the display interface by the user to transmit data from the sending terminal to the receiving terminal, second target data that needs to be transmitted by the sending terminal;

the transceiver 1902 is configured to notify the sending terminal to transmit the second target data to the receiving terminal; and receiving the second target data transmitted by the sending terminal.

Optionally, the transceiver 1902 is configured to transmit the first target data to the sending terminal through a TCP connection with the sending terminal; informing the sending terminal to transmit the second target data to the receiving terminal through the GATT connection with the sending terminal; and receiving the second target data transmitted by the sending terminal through the TCP connection with the sending terminal.

Optionally, the transceiver 1902 is configured to receive, through a UDP connection with the sending terminal, screen projection data sent by the sending terminal.

Based on the same concept, as shown in fig. 20, the second terminal provided in the embodiment of the present invention includes a processor 2001 and a transceiver unit 2002:

the processor 2001 is configured to perform screen recording on screen display content to obtain screen projection data, and transmit the screen projection data to the transceiver unit;

the transceiver 2002 is configured to transmit the screen projection data to a receiving terminal, so that the receiving terminal displays screen display content of the transmitting terminal in a target area in a display interface according to the received screen projection data, wherein the target area is a partial area in the display interface of the receiving terminal.

Optionally, the transceiver 2002 is configured to receive control data corresponding to the control instruction sent by the receiving terminal;

the processor 2001 is configured to perform a corresponding response operation according to the control data; the control data is data which is generated by the receiving terminal in response to a control instruction triggered by a user in the target area and corresponds to the control instruction and is used for representing the triggering position and/or the control type of the control instruction.

Optionally, the transceiver 2002 is configured to receive, through GATT connection with the receiving terminal, control data corresponding to the control instruction sent by the receiving terminal.

Optionally, the transceiver 2002 is configured to receive first target data sent by the receiving terminal; the first target data is sent by the receiving terminal after responding to a first transmission instruction of data transmission from the receiving terminal to the sending terminal, which is triggered by a user on the display interface; and/or

Optionally, the transceiver 2002 is configured to receive, through a TCP connection with the receiving terminal, first target data sent by the receiving terminal; receiving a notification which is sent by the receiving terminal and used for determining second target data which needs to be transmitted by the sending terminal through the GATT connection with the receiving terminal; and transmitting the second target data to the receiving terminal through the TCP connection between the transmitting terminal and the receiving terminal.

Optionally, the transceiver 2002 is configured to transmit the screen projection data to the receiving terminal through a UDP connection with the receiving terminal.

Based on the same concept, as shown in fig. 21, a third terminal provided in the embodiment of the present invention includes:

a receiving module 2101, configured to receive screen projection data sent by a sending terminal; the screen projection data are obtained by screen recording of screen display contents by a sending terminal;

a processing module 2102, configured to display, according to the received screen projection data, a screen display content of the sending terminal in a target area in a display interface, where the target area is a partial area in the display interface of the receiving terminal.

Optionally, the processing module 2102 is further configured to:

and sending the control data corresponding to the control instruction to the sending terminal so that the sending terminal executes corresponding response operation according to the control data.

Optionally, the processing module 2102 is specifically configured to:

and sending the control data corresponding to the operation instruction to the sending terminal through the GATT connection with the sending terminal.

Optionally, the processing module 2102 is further configured to:

Optionally, the processing module 2102 is specifically configured to:

transmitting the first target data to the transmitting terminal through a TCP connection with the transmitting terminal;

notifying the sending terminal to transmit the second target data to the receiving terminal, including:

informing the sending terminal to transmit the second target data to the receiving terminal through the GATT connection with the sending terminal;

receiving the second target data transmitted by the sending terminal, including:

and receiving the second target data transmitted by the sending terminal through the TCP connection with the sending terminal.

Optionally, the receiving module 2101 is specifically configured to:

and receiving screen projection data sent by the sending terminal through UDP connection with the sending terminal.

Based on the same concept, as shown in fig. 22, a fourth terminal according to an embodiment of the present invention includes:

a recording module 2201, configured to perform screen recording on screen display content to obtain screen projection data;

a sending module 2202, configured to send the screen projection data to a receiving terminal, so that the receiving terminal displays, according to the received screen projection data, screen display content of the sending terminal in a target area in a display interface, where the target area is a partial area in the display interface of the receiving terminal.

Optionally, the sending module 2202 is further configured to:

receiving control data corresponding to the control instruction sent by the receiving terminal, and executing corresponding response operation according to the control data; the control data is data which is generated by the receiving terminal in response to a control instruction triggered by a user in the target area and corresponds to the control instruction and is used for representing the triggering position and/or the control type of the control instruction.

Optionally, the sending module 2202 is specifically configured to:

and receiving control data corresponding to the control instruction sent by the receiving terminal through the GATT connection with the receiving terminal.

Optionally, the sending module 2202 is further configured to:

receiving first target data sent by the receiving terminal; the first target data is sent by the receiving terminal after responding to a first transmission instruction of data transmission from the receiving terminal to the sending terminal, which is triggered by a user on the display interface; and/or

Optionally, the sending module 2202 is specifically configured to:

receiving first target data sent by the receiving terminal through a TCP connection with the receiving terminal;

receiving a notification sent by the receiving terminal to determine that the sending terminal needs to transmit second target data, including:

the terminal receives a notification which is sent by the receiving terminal and used for determining second target data which needs to be transmitted by the sending terminal through the GATT connection with the receiving terminal;

the end transmits the second target data to the receiving terminal, and the method comprises the following steps:

and transmitting the second target data to the receiving terminal through the TCP connection between the transmitting terminal and the receiving terminal.

Optionally, the sending module 2202 is specifically configured to:

and sending the screen projection data to a receiving terminal through UDP connection with the receiving terminal.

Since the computer storage medium in the embodiment of the present invention may be applied to the processing method, the technical effect obtained by the computer storage medium may also refer to the method embodiment described above, and the embodiment of the present invention is not described herein again.

Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.

While specific embodiments of the invention have been described above, it will be appreciated by those skilled in the art that these are by way of example only, and that the scope of the invention is defined by the appended claims. Various changes and modifications to these embodiments may be made by those skilled in the art without departing from the spirit and scope of the invention, and these changes and modifications are within the scope of the invention.

Claims

1. A terminal, comprising a processor and a transceiver unit:

2. The terminal of claim 1, wherein the processor is configured to, in response to a control instruction triggered by a user in the target area, generate control data corresponding to the control instruction and indicating a trigger position and/or a control type of the control instruction, and transmit the generated control data corresponding to the control instruction to the transceiver unit;

3. The terminal according to claim 2, wherein the transceiving unit is configured to transmit the control data corresponding to the operation instruction to the transmitting terminal through a GATT connection with the transmitting terminal.

4. The terminal of claim 1, wherein the processor is configured to determine first target data to be transmitted to the sending terminal in response to a first transmission instruction for transmitting data from the receiving terminal to the sending terminal, which is triggered by a user in the display interface, and transmit the first target data to the transceiving unit;

5. The terminal according to claim 4, wherein the transceiving unit is configured to transmit the first target data to the transmitting terminal through a TCP connection with the transmitting terminal; informing the sending terminal to transmit the second target data to the receiving terminal through the GATT connection with the sending terminal; and receiving the second target data transmitted by the sending terminal through the TCP connection with the sending terminal.

6. The terminal of claim 1, wherein the transceiving unit is configured to receive the screen-shot data transmitted by the transmitting terminal through a UDP connection with the transmitting terminal.

7. A terminal, comprising a processor and a transceiver unit:

8. A screen projection method, comprising:

9. A method of projecting a screen, comprising:

10. A computer storage medium having computer program instructions stored therein which, when run on a computer, cause the computer to perform the method of any of claims 8 to 9.