WO2023071655A1

WO2023071655A1 - Screen projection processing method and apparatus, and device and storage medium

Info

Publication number: WO2023071655A1
Application number: PCT/CN2022/121178
Authority: WO
Inventors: 李郗
Original assignee: 青岛海尔科技有限公司; 海尔智家股份有限公司
Priority date: 2021-10-25
Filing date: 2022-09-26
Publication date: 2023-05-04
Also published as: CN114089935B; CN114089935A

Abstract

The present application belongs to the field of computers, and specifically relates to a screen projection processing method and apparatus, and a device and a storage medium. The method in the present application comprises: starting a screen projection application according to a received starting operation of the screen projection application; if a first terminal device is a mobile device, acquiring movement operation data in response to a movement operation of a user for the first terminal device; sending, by means of the screen projection application, the movement operation data to a server, which is used for providing a screen projection service for the user; receiving first indication information, which is sent by the server; and on the basis of the first indication information and the screen projection application, projecting display content on the screen of the first terminal device to a second terminal device.

Description

Screen projection processing method, device, equipment and storage medium

This application claims the priority of the Chinese patent application with the application number 202111251675.X and the application name "screen projection processing method, device, equipment and storage medium" submitted to the China Patent Office on October 25, 2021, the entire content of which is passed References are incorporated in this application.

technical field

The present application belongs to the field of computers, and in particular relates to a screen projection processing method, device, equipment and storage medium.

Background technique

With the development of computer technology, more and more smart devices with screens are used by users, such as TVs, refrigerators, and home surveillance cameras. During use, the user can perform screen projection between terminal devices such as mobile phones and smart devices with screens.

In the prior art, when implementing screen projection between a terminal device such as a mobile phone and a smart device with a screen, the corresponding screen projection software is usually downloaded on the terminal device such as a mobile phone and the smart device with a screen. When casting a screen, open the screen projection software on terminal devices such as mobile phones and smart devices with screens, and then operate according to the guidance information of the screen projection software, so as to realize screen projection. However, this method often requires the user to perform repeated operations on terminal devices such as mobile phones and smart devices with screens. Therefore, due to the relatively complicated operation process of the user, there is a problem that the efficiency of the user's screen projection is low.

Contents of the invention

In order to solve the above-mentioned problems in the prior art, that is, to solve the problem that the user’s screen projection efficiency is low due to the complicated operation process of the user, the present application provides a screen projection processing method, which is applied to the first terminal device , the method includes: if the first terminal device is a mobile device, acquiring mobile operation data in response to a user's mobile operation on the first terminal device, wherein the mobile operation data includes acceleration data and moving direction data of the first terminal device; The mobile operation data is sent to the server for providing the user with the screen projection service through the screen projection application; the first indication information sent by the server is received, wherein the first indication information is generated by the server according to the judgment result, and the judgment result is used to determine the movement Whether the operation is a screen projection operation, the first indication information is used to indicate that when the mobile operation is a screen projection operation, the display content of the first terminal device is projected to the second terminal device; when the mobile operation is not a screen projection operation, no Projecting the display content to the second terminal device; when the user's first instruction information is used to instruct to project the display content of the first terminal device to the second terminal device, based on the first instruction information and the screen projection application, the second The content displayed on the screen of a terminal device is projected to the second terminal device.

The embodiment of the present application also provides a screen projection processing method, which is applied to a server, and the method includes: if the first terminal device is a mobile device, receiving mobile operation data sent by the first terminal device when performing a mobile operation, wherein, The mobile operation data includes acceleration data and moving direction data of the first terminal device; judging whether the mobile operation of the first terminal device is a screen projection operation according to the mobile operation data, and generating a judgment result; generating first instruction information according to the judgment result, wherein, the first The instruction information is used to indicate that when the mobile operation is a screen projection operation, the display content of the first terminal device is projected to the second terminal device, and when the mobile operation is not a screen projection operation, the display content is not projected to the second terminal device. On the terminal device; sending the first indication information to the first terminal device.

An embodiment of the present application also provides a screen projection processing device, including: an acquisition module configured to acquire mobile operation data in response to a user's mobile operation on the first terminal device if the first terminal device is a mobile device, wherein, The mobile operation data includes acceleration data and moving direction data of the first terminal device; the first sending module is configured to send the mobile operation data to a server for providing screen projection services for users through the screen projection application; the first receiving module is configured to To receive the first indication information sent by the server, wherein the first indication information is generated by the server according to the judgment result, the judgment result is used to determine whether the mobile operation is a screen projection operation, and the first indication information is used to indicate that the mobile operation is a screen projection operation During operation, the display content of the first terminal device is projected to the second terminal device, and when the mobile operation is not a screen projection operation, the display content is not projected to the second terminal device; The first instruction information is used to indicate that when the display content of the first terminal device is projected to the second terminal device, based on the first instruction information and the screen projection application, the display content on the screen of the first terminal device is projected to the second terminal device. Terminal Equipment.

The embodiment of the present application also provides a screen projection processing device, including: a second receiving module, configured to receive the mobile operation data sent when the first terminal device performs a mobile operation if the first terminal device is a mobile device, wherein, The mobile operation data includes acceleration data and moving direction data of the first terminal device; the first generation module is configured to judge whether the mobile operation of the first terminal device is a screen projection operation according to the mobile operation data, and generate a judgment result; the second generation module, It is set to generate the first instruction information according to the judgment result, wherein the first instruction information is used to indicate that when the mobile operation is a screen projection operation, the display content of the first terminal device is projected to the second terminal device, and when the mobile operation is not During the screen projection operation, the display content is not projected to the second terminal device; the second sending module is configured to send the first indication information to the first terminal device.

The embodiment of the present application also provides a terminal device, including: a processor, and a memory connected to the processor in communication; screen processing method.

The embodiment of the present application also provides a server, including: a processor, and a memory communicatively connected to the processor; the processor executes computer-executed instructions stored in the memory, so as to implement the screen projection processing method applied to the server in the foregoing method.

The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it is used to implement the screen projection processing method applied to the first terminal device in the foregoing method, or, Screen projection processing method applied to the server.

The embodiment of the present application also provides a computer program product, including a computer program. When the computer program is executed by a processor, the computer program is used to implement the screen projection processing method applied to the first terminal device in the foregoing method, or the projection process applied to the server. screen processing method.

Those skilled in the art can understand that the screen projection processing method of the present application is applied to the first terminal device. When the first terminal device is a mobile device, if the user wants to realize the screen projection to display on the second terminal device, the first terminal device can be moved towards the direction of the second terminal device, so that after receiving the first instruction information sent by the server, and the first instruction information indicates that the first terminal device After the display content of the first terminal device is projected to the second terminal device, the display content on the screen of the first terminal device can be projected to the second terminal device through the first instruction information and the screen projection application.

The screen projection processing method of the present application can also be applied to the server. When the first terminal device is a mobile device, if the user wants to realize the projection of the display content of the first terminal device to the second terminal device for display, then The server may generate a judgment result according to the mobile operation data, determine whether the user's mobile operation on the first terminal device is a screen projection operation, and then generate first indication information according to the judgment result, and send the first indication information to the first terminal device, thus After the first terminal device receives the first instruction information sent by the server, and the first instruction information indicates to project the display content of the first terminal device to the second terminal device, it can use the first instruction information and the screen projection The application realizes projecting the display content on the screen of the first terminal device to the second terminal device.

Description of drawings

Preferred implementations of the screen projection processing method of the present application are described below with reference to the accompanying drawings. Attached are:

FIG. 1 is a schematic diagram of an application scenario of a projection processing method provided in an embodiment of the present application;

FIG. 2 is a schematic structural diagram of a screen projection processing system provided by an embodiment of the present application;

FIG. 3 is a flow chart of Embodiment 1 of the projection processing method provided by the embodiment of the present application;

FIG. 4 is a flow chart of Embodiment 2 of the projection processing method provided by the embodiment of the present application;

FIG. 5 is a flow chart of Embodiment 3 of the projection processing method provided by the embodiment of the present application;

FIG. 6 is a schematic diagram of acquiring mobile operation data provided by an embodiment of the present application;

FIG. 7 is a schematic diagram of Embodiment 1 of Bluetooth gateway positioning processing provided by the embodiment of the present application;

FIG. 8 is a schematic diagram of Embodiment 2 of Bluetooth gateway positioning processing provided by the embodiment of the present application;

FIG. 9 is a schematic diagram of Embodiment 1 of the screen projection processing device provided by the embodiment of the present application;

Fig. 10 is a schematic diagram of Embodiment 2 of the screen projection processing device provided by the embodiment of the present application;

FIG. 11 is a schematic structural diagram of a terminal device provided by an embodiment of the present application;

FIG. 12 is a schematic structural diagram of a server provided by an embodiment of the present application.

Detailed ways

First of all, those skilled in the art should understand that these embodiments are only used to explain the technical principle of the present application, and are not intended to limit the protection scope of the present application. Those skilled in the art can make adjustments as needed so as to adapt to specific applications.

Secondly, it should be noted that in the description of the embodiments of the present application, the terms "first", "second", "third", "fourth" and so on (if they exist) are used to distinguish similar objects and do not necessarily Used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the application described herein can be practiced in sequences other than those illustrated or described herein.

In addition, it should be noted that in the description of the embodiments of the present application, the terms "comprising" and "having" and any variations thereof are intended to cover a non-exclusive inclusion, for example, a process comprising a series of steps or units A method, system, product or device is not necessarily limited to those steps or elements explicitly listed, but may include other steps or elements not explicitly listed or inherent to the process, method, product or device.

In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

In the prior art provided in the background art, there are at least the following technical problems in the solution for users to cast screens:

If the user wants to cast the contents of the mobile phone to other smart devices with a screen, he needs to perform repeated operations on the phone and the device with a smart screen. Screen software, the mobile terminal operates according to the instructions of the screen projection software, and waits for the smart device with screen to display the content. Therefore, the user's actual operation is very complicated, which leads to the problem that the user's screen projection efficiency is low.

In view of the above-mentioned problems, this application proposes a screen projection processing method. When the first terminal device is a mobile device, if the user wants to project the display content of the first terminal device to the second terminal device, the When a terminal device moves, the first terminal device can obtain the moving direction data of the first terminal device through the gyroscope, obtain the acceleration data of the first terminal device through the acceleration sensor, and then send the moving direction data and acceleration data to the user In the server that provides the screen projection service, the server judges whether the user's mobile operation on the first terminal device is a screen projection operation according to the moving direction data and acceleration data, and generates first instruction information and sends it to the first terminal device. The mobile operation of the first terminal device is a screen projection operation, then the first terminal device can project the display content of the first terminal device to the second terminal device according to the first instruction information, and project the display content to the second terminal device display in the device; if the user's mobile operation on the first terminal device is not a screen projection operation, then the first terminal device cannot project the display content of the first terminal device to the second terminal device according to the first indication information, The display content is not projected to the second terminal device for display.

If the first terminal device is not a mobile device, the first terminal device can realize screen projection through the thumbnail map on the screen projection application interface, and the thumbnail map includes the first icon corresponding to the first terminal device and the second terminal device The corresponding second icon, when the user wants to project the display content of the first terminal device to the second terminal device, drag the corresponding first icon of the first terminal device to the second terminal on the thumbnail map The location of the second icon corresponding to the device triggers a screen projection request at this time, the first terminal device sends the screen projection request to the server, and the server generates second instruction information according to the screen projection request and sends it to the first terminal device, so that the first The terminal device can project the displayed content to the second terminal device for display.

Figure 1 is a schematic diagram of the application scenario of the screen projection processing method provided by the embodiment of the present application. As shown in Figure 1, in this scenario, if the first terminal device is a mobile device, the first terminal device is a mobile phone, and the second terminal device Take the TV as an example. If the user wants to project the content displayed on the screen of the mobile phone to the TV for display, he can open the screen-casting application on the mobile phone, move the mobile phone towards the TV, and make a throwing action. The moving direction data can be obtained through the gyroscope in the mobile phone, the acceleration data can be obtained through the acceleration sensor in the mobile phone, and then the mobile phone can send the moving direction data and acceleration data to the server that provides the user with screen casting services through the screen projection application. According to the acceleration data and the moving direction data, it is judged whether the user's throwing action is to cast a screen, and then the first indication information is generated according to the judgment result and sent to the mobile phone. If the user's throwing action is to cast a screen, the first indication The information confirms that the display content on the mobile phone screen can be projected to the TV for display. If the user’s throwing action is not intended to project the screen, the first instruction information determines that the display content on the mobile phone screen cannot be projected to the TV. show.

If the first terminal device is not a mobile device, for example, the first terminal device is a refrigerator and the second terminal device is a TV. If the user wants to project the display content on the refrigerator screen to the TV for display, he can turn on the refrigerator. After the screencasting application, drag the icon corresponding to the refrigerator to the location of the icon corresponding to the TV in the thumbnail map displayed on the screencasting application interface. At this time, a screencasting request can be triggered and the screencasting request will be sent to to the server, the server generates second instruction information according to the screen projection request, and sends it to the refrigerator, and the refrigerator projects the display content on the screen to the TV for display according to the second instruction information and the screen projection application.

FIG. 2 is a schematic structural diagram of a screen projection processing system provided by an embodiment of the present application. As shown in FIG. 2 , the system includes a first terminal device, a second terminal device and a server.

The first terminal device includes a direction module (that is, a gyroscope), a position module (that is, a Bluetooth module) and a gesture module, wherein the first terminal device can be a mobile device such as a mobile phone, and the direction module is used to analyze the movement of the user to the mobile phone or the like. The direction logic when the device performs mobile operations. The location module is used to analyze the relative position of mobile devices such as mobile phones in the current room. The gesture module is used to analyze the user’s intention to slide the screen of mobile devices such as mobile phones, and determine whether the user opens the mobile device such as mobile phones. screencasting application.

The second terminal device includes a location module (that is, a Bluetooth module) and a gesture module, wherein the second terminal device can be a non-mobile device with a screen such as a refrigerator, a TV, a computer, etc., and the location module is used to analyze the status of the refrigerator, TV, computer, etc. The relative position of non-mobile devices in the current room. The gesture module is used to analyze the user's intention to slide the screen of non-mobile devices such as refrigerators, TVs, and computers, and determine whether the user opens the screen-casting application on non-mobile devices such as refrigerators, TVs, and computers.

The server is the screen projection background service in the local area network of the user's home. The server includes a location module (that is, a Beacon device group) and a screen projection processing module. The Beacon device group of the location module is used to broadcast Bluetooth signals to the room at regular intervals. The processing module is used to determine the relative positions of the first terminal device and the second terminal device after the indoor first terminal device and the second terminal device receive the Bluetooth signal, and process the actual screen projection logic.

The server can also be used to perform screen projection pairing among all smart devices in the room, and establish an association relationship between the user and all the smart devices in the room. The server may also include a screen projection security verification component, a device information database, a user database, and a user screen projection operation database, wherein the screen projection security verification component is used to verify the legality of the user's screen projection behavior, and the device information The database is used to save the device information that the user wants to cast the screen, the user database is used to save the user's biological characteristics (face data, iris data, fingerprint data, etc.), and the user screen projection operation database is used to save the historical operation of the user's screen projection Record.

The principles and features of the embodiments of the present application are described below based on the above-mentioned application scenarios and systems, and in conjunction with the accompanying drawings. The examples given are only used to explain the embodiments of the present application, and are not used to limit the scope of the embodiments of the present application.

FIG. 3 is a flow chart of Embodiment 1 of the screen projection processing method provided by the embodiment of the present application. As shown in FIG. 3 , the screen projection processing method is applied to the first terminal device and includes the following steps:

S301: If the first terminal device is a mobile device, acquire mobile operation data in response to a user's mobile operation on the first terminal device.

In this step, the moving operation data includes acceleration data and moving direction data of the first terminal device. If the first terminal device is a mobile device, such as a mobile phone, when the user wants to perform a screen projection operation, after opening the screen projection application on the first terminal device, the first terminal device is moved, for example, the user moves the mobile phone toward the second The direction of the second terminal device (such as a TV) performs a throwing action, and the first terminal device can obtain the acceleration data and moving direction data of the first terminal device after responding to the user's movement operation.

S302: Send the mobile operation data to a server for providing a screen projection service for the user through the screen projection application.

In this step, there is a screen projection application in the first terminal device, and the first terminal device can send the mobile operation data to the server for providing the screen projection service for the user through the screen projection application.

In the above scheme, since the server is provided with a user screen projection operation database, the database stores the user's historical screen projection operation records, and the server stores the location information of all terminal devices, therefore, the first terminal device can cast The screen operation data is sent to the server, and the server processes the screen projection operation data.

S303: Receive first indication information sent by the server.

In this step, the first indication information is generated by the server according to the judgment result, and the judgment result is used to determine whether the mobile operation is a screen projection operation, and the first indication information is used to indicate that when the mobile operation is a screen projection operation, the first terminal The display content of the device is projected to the second terminal device, and when the mobile operation is not a screen projection operation, the display content is not projected to the second terminal device.

In the above scheme, after receiving the mobile operation data sent by the first terminal device, the server first determines whether there is a second terminal device that can cast the screen on the path of the first terminal device's moving direction according to the mobile operation data, and if so, Then compare the mobile operation data with the historical data in the user's screen projection operation database to determine whether the mobile operation of the first terminal device is an operation that the user wants to project a screen; screen operation, the first indication information generated by the server is used to instruct to project the display content of the first terminal device to the second terminal device; The generated first indication information is used to indicate not to project the display content of the first terminal device to the second terminal device. Then the server sends the first indication information to the first terminal device.

In the above solution, if there is no historical data of the user in the user's screen projection operation database, a preset data can be stored in advance, so that the mobile operation data can be compared with the preset data.

S304: When the first instruction information is used to indicate to project the display content of the first terminal device to the second terminal device, project the display content on the screen of the first terminal device based on the first instruction information and the screen projection application to the second terminal device.

In this step, after receiving the first instruction information, the first terminal device determines that the first instruction information indicates that the display content of the first terminal device can be projected to the second terminal device, then the first terminal device can follow the first instruction information. An indication of instruction information, and use the screen projection application to project the display content on the screen of the first terminal device to the second terminal device for display, the first terminal device is the device that initiates the screen projection operation, and the second terminal device It is a device for receiving screen projection content. After receiving the display content projected by the first terminal device, the second terminal device displays the display content on the screen of the second terminal device.

In the above solution, if the first terminal device, after receiving the first indication information, determines that the first indication information indicates that the display content of the first terminal device cannot be projected to the second terminal device, then the first terminal device determines that the user The operation at this time is a misoperation, therefore, the first terminal device does not project the displayed content on the screen to the second terminal device for display.

In the above solution, both the first terminal device and the second terminal device are smart devices with a screen.

In a specific implementation, before obtaining the mobile operation data in response to the user's mobile operation on the first terminal device, the method further includes: starting the screen projection application according to the received start operation of the screen projection application.

In this solution, when the user wants to perform a screen projection operation, he first opens the screen projection application on the first terminal device, and the first terminal device can start the screen projection application after receiving the user's start operation on the screen projection application, In order to facilitate users to perform screen mirroring operations.

In a specific implementation, after starting the screen projection application, the method further includes: receiving the first location information of the first terminal device and the second location information of the second terminal device sent by the server through the screen projection application, wherein the first One position information is used to represent the relative position between the first terminal device and the server, and the second position information is used to represent the relative position between the second terminal device and the server; A thumbnail map is generated on the interface of the application, wherein the thumbnail map includes a first icon corresponding to the first terminal device and a second icon corresponding to the second terminal device, and the thumbnail map is used to determine the first terminal device and the second terminal device The relative position of the device.

In this solution, the thumbnail map can be generated in the screen projection application in the first terminal device. Since the relative position information of all terminal devices and the server is stored in the server, the first terminal device can receive the server map through the screen projection application. The first location information of the first terminal device and the second location information of the second terminal device are sent, so that after determining the location information of all terminal devices, one can be determined on the screen projection application interface of the first terminal device A thumbnail map containing the locations of all terminal devices. Each terminal device in the thumbnail map corresponds to an icon. For example, if the first terminal device is a mobile phone, the corresponding first icon is a mobile phone icon, and the second terminal device If it is a TV, the corresponding second icon is the TV icon, etc. Since the terminal devices in the user’s home are not just mobile phones and TVs, there are many icons corresponding to the terminal devices displayed in the thumbnail map, and the relative positions of each icon It also corresponds to the actual relative position between each terminal device.

In a specific implementation, the method further includes: if the first terminal device is not a mobile device, moving the first icon to where the second icon is located in response to a drag operation on the first icon on the interface of the screen casting application; Location; sending a screen projection request to the server, wherein the screen projection request is used by the first terminal device to request to project the display content on the screen to the second terminal device; receiving second indication information sent by the server, wherein the second indication information It is used for instructing to project the display content of the first terminal device to the second terminal device; based on the second instruction information and the screen projection application, the display content on the screen of the first terminal device is projected to the second terminal device.

In this solution, the first terminal device is not a mobile device, for example, the first terminal device is a refrigerator, when the user wants to project the content displayed on the screen of the first terminal device to the second terminal device, for example, the second terminal The device is a TV. Since a thumbnail map is displayed on the screen-casting application of the first terminal device, the user can directly drag the first icon corresponding to the first terminal device to the icon corresponding to the second terminal device on the thumbnail map. The position of the second icon triggers the generation of a screen projection request, and then sends the screen projection request to the server, and the server generates the second indication information according to the screen projection request, and sends the second indication information to the first terminal device, then When the first terminal device determines that screen projection is possible, it can follow the instructions of the second instruction information and use the screen projection application to project the display content on the screen of the first terminal device to the second terminal device for display.

In a specific implementation, the method further includes: receiving a Bluetooth signal sent by the Bluetooth gateway of the server; determining a signal strength indicator value of the Bluetooth signal received by the first terminal device according to the Bluetooth signal; and sending the signal strength indicator value to the server.

In this solution, a Bluetooth gateway is deployed in the user's home, that is, a beacon (Beacon) device group, and a Beacon device group is set in the server, and each Beacon device in the Beacon device group will broadcast a Bluetooth signal at regular intervals To the surrounding, the first terminal device will receive the Bluetooth signal through its own Bluetooth device, and determine the Received Signal Strength Indication (RSSI for short) value according to the received Bluetooth signal, and then send the RSSI value to server.

In the above solution, the second terminal device may also receive the Bluetooth signal according to its own Bluetooth device, determine the RSSI value according to the received Bluetooth signal, and then send the RSSI value to the server. The first terminal device and the second terminal device may send the RSSI value to the server through wireless communication technology (Wi-Fi).

In a specific implementation, obtaining the mobile operation data in response to the user's mobile operation on the first terminal device includes: in response to the user's mobile operation on the first terminal device, acquiring the moving direction data through the gyroscope of the first terminal device , and acquire acceleration data through the acceleration sensor of the first terminal device.

In this solution, when the first terminal device is a mobile device, the first terminal device is provided with a gyroscope and an acceleration sensor, for example, the first terminal device is a mobile phone, so that when the user performs a mobile operation on the first terminal device, The moving direction data of the first terminal device may be acquired through the gyroscope of the first terminal device, and the acceleration data of the first terminal device may be acquired through the acceleration sensor of the first terminal device.

In the above solution, when the first terminal device obtains the moving direction data and acceleration data, it can obtain the data through the application programming interface (Application Programming Interface, API for short) that comes with the first terminal device, and the Android (Android) system and Apple ( iOS) system has this kind of system interface, wherein the application program interface of Android system is SensorManager, and the program interface of Studio City of iOS system is CoreMotion. Therefore, both the acceleration data and the moving direction data of the first terminal device can be acquired by these two interfaces. Fig. 6 is a schematic diagram of obtaining mobile operation data provided by the embodiment of the present application. As shown in Fig. 6, the acceleration data and the moving direction data are all according to the x-axis, y-axis and z-axis of the first terminal device on the space coordinate system integrated from the data.

In the screen projection processing method provided in this embodiment, when the first terminal device is a mobile device, if the user wants to project the display content of the first terminal device to the second terminal device for display, the first The terminal device moves towards the direction of the second terminal device, so that after receiving the first instruction information sent by the server, and the first instruction information indicates that the display content of the first terminal device can be projected to the second terminal device, the The display content on the screen of the first terminal device can be projected to the second terminal device through the first instruction information and the screen casting application; when the first terminal device is not a mobile device, if the user wants to implement the first terminal device The displayed content of the first terminal device can be projected to the second terminal device for display, then the first icon corresponding to the first terminal device can be moved to the second terminal device in the thumbnail map displayed on the screen projection application interface of the first terminal device The position of the second icon corresponding to the device, so that after receiving the second indication information sent by the server, the display content on the screen of the first terminal device can be projected to the second through the second indication information and the screen casting application. The terminal device avoids complicated operations performed by the user on the first terminal device, and achieves the purpose of improving the efficiency of the user's screen projection.

FIG. 4 is a flow chart of Embodiment 2 of the screen projection processing method provided by the embodiment of the present application. As shown in FIG. 4 , the screen projection processing method is applied to a server that provides users with screen projection services, and includes the following steps:

S401: If the first terminal device is a mobile device, receive moving operation data sent when the first terminal device performs a moving operation.

In this step, the moving operation data includes acceleration data and moving direction data of the first terminal device. If the first terminal device is a mobile device, such as a mobile phone, when the user wants to perform a screen projection operation, after opening the screen projection application on the first terminal device, the first terminal device is moved, for example, the user moves the mobile phone toward the second The direction of the second terminal device (for example, a TV) performs a throwing action. After the first terminal device responds to the user's mobile operation, it can generate mobile operation data, and send the mobile operation data to the server according to the screen projection application. Process the received mobile operation data.

In the above solution, when the user throws the mobile phone towards the direction of the second terminal device, the acceleration data of the second terminal device can be based on the x-axis, y-axis and z-axis on the spatial coordinate system as shown in Figure 6 Acceleration data are integrated.

S402: Determine whether the movement operation of the first terminal device is a screen projection operation according to the movement operation data, and generate a determination result.

In this step, after the server receives the mobile operation data sent by the first terminal device, since the server is provided with a user screen projection operation database, the database stores the user's historical screen projection operation records, and the server stores all The location information of the terminal device. Therefore, after receiving the mobile operation data sent by the first terminal device, the server first determines whether there is a second terminal device that can cast the screen on the path of the first terminal device's moving direction according to the mobile operation data. If so, compare the mobile operation data with the historical data in the user’s screen projection operation database to determine whether the mobile operation on the first terminal device is an operation that the user wants to project the screen. If the operation is an operation that the user wants to perform screen projection, the judgment result is that the user's mobile operation on the first terminal device is a screen projection operation; if it is determined that the user's operation on the first terminal device is not an operation that the user wants to perform screen projection, then The judgment result is that the user's mobile operation on the first terminal device is not a screen projection operation.

In the above scheme, every time the user performs screen projection operation, after receiving the user's current mobile operation data, the server will store the current mobile operation data in the user's screen projection operation database, so that the user's screen projection operation can be expanded The data in the database will facilitate the subsequent server to more quickly match the user's screen projection operation according to the user's screen projection operation database.

S403: Generate first indication information according to the judgment result.

In the above solution, if the judgment result is that the mobile operation of the first terminal device by the user is a screen projection operation, the first instruction information is used to indicate that when the mobile operation is a screen projection operation, the display content of the first terminal device is projected to the screen. to the second terminal device; if the judgment result is that the user’s mobile operation on the first terminal device is not a screen projection operation, then the first indication information is used to indicate that when the mobile operation is not a screen projection operation, the displayed content will not be projected to the second terminal device. on the second terminal device.

S404: Send the first indication information to the first terminal device.

In a specific implementation, the method further includes: if the first terminal device is not a mobile device, receiving a screen projection request sent by the first terminal device, wherein the screen projection request is used for the first terminal device to request that the displayed content on the screen Projecting the screen to the second terminal device; generating second instruction information according to the screen projection request, wherein the second instruction information is used to indicate that the display content of the first terminal device is projected to the second terminal device; the second instruction information sent to the first terminal device.

In this solution, the first terminal device is not a mobile device, for example, the first terminal device is a refrigerator, when the user wants to project the content displayed on the screen of the first terminal device to the second terminal device, for example, the second terminal The device is a TV. Since a thumbnail map is displayed on the screen-casting application of the first terminal device, the user can directly drag the first icon corresponding to the first terminal device to the icon corresponding to the second terminal device on the thumbnail map. The location of the second icon triggers the generation of a screen projection request, and then sends the screen projection request to the server. After receiving the screen projection request, the server determines that the first terminal device wants to perform screen projection. Therefore, the server can The screen request generates second indication information, and sends the second indication information to the first terminal device, and the first terminal device can determine that the display content can be projected to the second terminal device through the second indication information.

In a specific implementation, judging whether the moving operation of the first terminal device is a screen projection operation according to the moving operation data, and generating a judgment result includes: determining whether there is a second terminal device in the moving direction of the first terminal device according to the moving operation data ; When there is a second terminal device in the moving direction of the first terminal device, comparing the mobile operation data with the preset data to determine whether the mobile operation data exists in the preset interval of the preset data; if the mobile operation data exists in the preset interval of the preset data; In the preset interval of the preset data, a first result is generated, wherein the first result is used to indicate that the mobile operation of the first terminal device is a screen projection operation; if the mobile operation data does not exist in the preset interval of the preset data, A second result is generated, where the second result is used to indicate that the moving operation of the first terminal device is not a screen casting operation.

In this solution, since the server is provided with a user screen projection operation database, the database stores the user's historical screen projection operation records, and the server stores the location information of all terminal devices, therefore, the server is generated according to the mobile operation data. In the case of the first instruction information, after receiving the mobile operation data, it is necessary to determine whether there is a second terminal device capable of projecting in the moving direction of the first terminal device. The second terminal device of the screen can compare the mobile operation data with the preset data. The preset data can be the historical data in the user's screen projection operation database, or the user's screen projection operation database set in advance by the developer. Reasonable data in , if the difference between the mobile operation data and the preset data is not big, that is, the mobile operation data is within the preset range of the preset data, it means that the user's mobile operation is a screen projection operation, and screen projection can be realized ; If the difference between the mobile operation data and the preset data is large, that is to say, the mobile operation data is not within the preset range of the preset data, it means that the user's mobile operation is not a screen projection operation. The mobile operation of the device may be a wrong operation, so screen projection cannot be realized.

In the above solution, if there is no second terminal device that can cast the screen in the moving direction of the first terminal device, the server will return a prompt message to the first terminal device, so that the first terminal device can determine that it is not possible to cast the screen at this time. Screencasting operation.

In a specific implementation, generating the second indication information according to the screen casting request includes: determining whether the screen casting request is a request triggered when the first icon is moved to the position of the second icon, wherein the first icon is a thumbnail map The icon corresponding to the first terminal device, the second icon is the icon corresponding to the second terminal device in the thumbnail map, and the thumbnail map is used to determine the relative position of the first terminal device and the second terminal device; When the request is triggered when the first icon is moved to the location of the second icon, the second indication information is generated according to the screen casting request.

In this solution, the first terminal device is not a mobile device. Therefore, when the user implements the screen projection operation on the first terminal device, he needs to operate on the thumbnail map of the screen projection application of the first terminal device, that is, The user drags the first icon corresponding to the first terminal device to the position of the second icon corresponding to the second terminal device on the thumbnail map. At this time, the first terminal device will trigger the generation of a screen projection request, and the server will The screen request is a request triggered by the user dragging the first icon to the position of the second icon on the thumbnail map. The server determines that the user needs to project the display content on the screen of the first terminal device to the second terminal device. Therefore, the server may generate second indication information according to the screen projection request, and send the second indication information to the first terminal device, so that the first terminal device can perform a screen projection operation.

In a specific implementation, the method further includes: periodically broadcasting Bluetooth signals according to a preset time interval; receiving the signal strength indicator value sent by the first terminal device and the signal strength indicator value sent by the second terminal device; based on The signal strength indicator value sent by the first terminal device determines the first distance between the first terminal device and the server; determines the second distance between the second terminal device and the server based on the signal strength indicator value sent by the second terminal device; The first position information is determined based on the first distance, wherein the first position information is used to indicate the relative position between the first terminal device and the server; the second position information is determined based on the second distance, wherein the second position information is used to indicate the first terminal device and the server. The relative position between the two terminal devices and the server; sending the first position information and the second position information to the first terminal device.

In this solution, in order to facilitate the operation of users in each family, the server can be set in the user's family. The server can also be called a micro server, and the Beacon device group in the server can periodically The broadcast Bluetooth signal, so that the first terminal device and the second terminal device (or other smart display devices in the user's home) can receive the Bluetooth signal through the Bluetooth module of the device, and according to the received Bluetooth The signal sends the RSSI value to the server respectively.

In the above solution, the server can determine the first distance between the first terminal device and the server according to the RSSI value sent by the first terminal device, and the server can determine the distance between the first terminal device and the server through the first distance. relative position; the server can determine the second distance between the second terminal device and the server according to the RSSI value sent by the second terminal device, and the server can determine the distance between the second terminal device and the server through the second distance Relative location, therefore, the server includes the location information of all smart display devices in the user's home, and can update the location information of the first terminal device and the second terminal device in real time according to the Bluetooth signal.

In the above solution, after the server obtains the first location information of the first terminal device and the second location information of the second terminal device, it can send the first location information and the second location information to the first terminal device, so that The screen-casting application on the first terminal device can generate a thumbnail map.

In the above solution, FIG. 7 is a schematic diagram of the first embodiment of Bluetooth gateway positioning processing provided by the embodiment of the present application. The server determines the location information of all smart devices with screens in the user's home through the Bluetooth gateway (Beacon device group), which can be as follows As shown in Figure 7, assuming that the current room is a large room of 8*8 square meters, a Beacon device is deployed every 2 meters in the room, and the position of each Beacon device can be expressed by coordinates, as shown in Figure 7 (x0, y2 ), (x0, y3), (x1, y3), etc., since the location information of each Beacon device is predetermined and has been uploaded to the server, when the smart device with a screen is in any position indoors, the deployed The Beacon device group can ensure that each smart device with a screen will have the three nearest Beacon devices. Therefore, in theory, the server can determine the location information of any smart device with a screen in the room through the three Beacon devices. That is to say , the location information of the smart display device can be obtained according to the location data of the three nearest Beacon devices.

In the above solution, FIG. 8 is a schematic diagram of the second embodiment of the positioning processing of the Bluetooth gateway provided by the embodiment of the present application. As shown in FIG. 8, it is known that there are three Beacon devices closest to the target smart device with screen (px, py) The positions are (x0, y0), (x1, y0), (x1, y1), and the relative distances between the target smart device with screen (px, py) and the above three Beacon devices can be obtained through the Euler formula, which are respectively D1, D2, D3, and then by weighting the actual distance of the corresponding Beacon device in the room, the relative position of the target smart device with screen in the whole room can be obtained. Therefore, the server includes the relative position information of all smart devices with screens in the room.

In the projection processing method provided in this embodiment, when the first terminal device is a mobile device, if the user wants to project the display content of the first terminal device to the second terminal device for display, the server can The operation data judges whether the user's throwing action is intended to cast a screen, and then generates the first indication information according to the judgment result, and sends the first indication information to the first terminal device, so that the first terminal device receives the first indication information sent by the server. After the first instruction information indicates that the display content of the first terminal device can be projected to the second terminal device, the display on the screen of the first terminal device can be realized through the first instruction information and the screen projection application Content projection to the second terminal device; when the first terminal device is not a mobile device, if the user wants to realize the projection of the display content of the first terminal device to the second terminal device for display, the server can according to the screen projection request Generate the second indication information, and send the second indication information to the first terminal device, so that after the first terminal device receives the second indication information sent by the server, the second indication information and the screen-casting application can be used to implement the second indication information. The content displayed on the screen of a terminal device is projected to the second terminal device, thereby preventing the user from performing complicated operations on the first terminal device, and achieving the purpose of improving the efficiency of the user's screen projection.

Fig. 5 is a flow chart of Embodiment 3 of the screen projection processing method provided by the embodiment of the present application. As shown in Fig. 5, the screen projection processing method includes the following steps:

S501: Determine that the first terminal device is a mobile device.

In this step, the first terminal device may be a mobile device such as a mobile phone.

S502: The first terminal device determines whether the user has a screen projection behavior.

In this step, if the user has screen projection behavior, jump to step S503; if the user does not have screen projection behavior, the solution ends.

S503: The first terminal device sends the mobile operation data corresponding to the user's screen projection behavior to the server that provides the user with a screen projection service.

In this solution, the movement operation data includes movement direction data of the first terminal device.

S504: The server judges whether there is a second terminal device capable of receiving screen projection content in the moving direction of the first terminal device.

In this step, if there is a second terminal device capable of receiving screen-casting content in the moving direction of the first terminal device, jump to step S505; if there is no second terminal device capable of receiving screen-casting content in the moving direction of the first terminal device two terminal devices, the solution ends.

S505: The server retrieves the mobile operation data from the user screen projection operation database.

S506: The server judges whether the mobile operation data can enable the first terminal device to start a screen projection function.

In this solution, if the mobile operation data can enable the first terminal device to start the screen projection function, then jump to step S507; if the mobile operation data cannot enable the first terminal device to start the screen projection function, the solution ends.

S507: The first terminal device activates a screen projection function, and projects the content displayed on the screen of the first terminal device to the second terminal device for display.

S508: The server records the mobile operation data in the user screen projection operation database.

In the screen projection processing method provided in this embodiment, when the user wants to project the display content on the screen of a mobile device such as a mobile phone to other terminal devices, the user only needs to open the screen projection application in the mobile device such as a mobile phone, and then take Pick up a mobile device such as a mobile phone and make a throwing action towards other terminal devices, so that the display content on the screen of the mobile device such as a mobile phone can be projected to other terminal devices for display; When the displayed content on the screen is projected to other terminal devices, a thumbnail map is displayed on the screen-casting application interface of non-mobile devices such as refrigerators, and then the user drags the icons corresponding to non-mobile devices such as refrigerators on the thumbnail map Move to the position of the icon corresponding to other terminal devices, which can realize the display content on the screen of non-mobile devices such as refrigerators to be displayed on other terminal devices.

Generally speaking, in the technical solution provided by this application, since the location information of all indoor terminal devices is stored in the server, the user opens the screen-casting application on the terminal device that initiates the screen-casting operation and the terminal device that receives the screen-casting content respectively. , and the user only needs to perform the corresponding screen-casting operation on the terminal device that initiates the screen-casting operation, and the server can determine whether the corresponding terminal device that receives the screen-casting content can be matched, so that when the corresponding terminal device that receives the screen-casting content is matched Realizing the user's screen projection operation after the terminal device is a technical implementation method that can greatly improve the user's screen projection efficiency.

The embodiment of the present application also provides a screen projection processing device. FIG. 9 is a schematic diagram of Embodiment 1 of the screen projection processing device provided in the embodiment of the present application. As shown in FIG. 9 , the screen projection processing device 90 includes:

The acquiring module 91 is configured to, if the first terminal device is a mobile device, acquire mobile operation data in response to the user's mobile operation on the first terminal device, wherein the mobile operation data includes acceleration data and moving direction data of the first terminal device ;

The first sending module 92 is configured to send the mobile operation data to a server for providing screen projection services for users through the screen projection application;

The first receiving module 93 is configured to receive the first indication information sent by the server, wherein the first indication information is generated by the server according to the judgment result, and the judgment result is used to determine whether the mobile operation is a screen projection operation, and the first indication information is used for Instructing to project the display content of the first terminal device to the second terminal device when the mobile operation is a screen projection operation, and not to project the display content to the second terminal device when the mobile operation is not a screen projection operation;

The screen projection module 94 is configured to, when the user's first instruction information is used to indicate to project the display content of the first terminal device to the second terminal device, based on the first instruction information and the screen projection application, the screen of the first terminal device The content displayed on the screen is projected to the second terminal device.

Optionally, the apparatus is further configured to start the screen projection application according to the received start operation of the screen projection application before acquiring the movement operation data in response to the user's movement operation on the first terminal device.

Optionally, the apparatus is further configured to receive the first location information of the first terminal device and the second location information of the second terminal device sent by the server through the screen-casting application, wherein the first location information is used to indicate that the first terminal device The relative position between the server and the server, the second position information is used to indicate the relative position between the second terminal device and the server; according to the first position information and the second position information, a thumbnail map is generated on the interface of the screen-casting application, wherein , the thumbnail map includes a first icon corresponding to the first terminal device and a second icon corresponding to the second terminal device, and the thumbnail map is used to determine the relative positions of the first terminal device and the second terminal device.

Optionally, the device is further configured to, if the first terminal device is not a mobile device, move the first icon to the position of the second icon in response to a drag operation on the first icon on the screen projection application interface; The server sends a screen projection request, wherein the screen projection request is used by the first terminal device to request to project the displayed content on the screen to the second terminal device; receiving the second indication information sent by the server, wherein the second indication information is used to indicate Projecting the display content of the first terminal device to the second terminal device; projecting the display content on the screen of the first terminal device to the second terminal device based on the second instruction information and the screen projection application.

Optionally, the device is also used to receive the Bluetooth signal sent by the Bluetooth gateway of the server; determine the signal strength indicator value of the Bluetooth signal received by the first terminal device according to the Bluetooth signal; and send the signal strength indicator value to the server.

Optionally, the acquiring module 91 is further configured to acquire moving direction data through a gyroscope of the first terminal device, and acquire acceleration data through an acceleration sensor of the first terminal device in response to a user's mobile operation on the first terminal device.

The screen projection processing device is used to implement the technical solution of the first terminal device in the foregoing method embodiments, and its implementation principle and technical effect are similar to those in the foregoing method embodiments, and will not be repeated here.

The embodiment of the present application also provides a screen projection processing device. FIG. 10 is a schematic diagram of Embodiment 2 of the screen projection processing device provided in the embodiment of the present application. As shown in FIG. 10 , the screen projection processing device 1000 includes:

The second receiving module 1001 is configured to, if the first terminal device is a mobile device, receive mobile operation data sent when the first terminal device performs a mobile operation, wherein the mobile operation data includes acceleration data and moving direction data of the first terminal device ;

The first generating module 1002 is configured to judge whether the mobile operation of the first terminal device is a screen projection operation according to the mobile operation data, and generate a judgment result;

The second generation module 1003 is configured to generate first instruction information according to the judgment result, wherein the first instruction information is used to indicate that when the moving operation is a screen projection operation, the display content of the first terminal device is projected to the second terminal device When the mobile operation is not a screen projection operation, the displayed content will not be projected to the second terminal device;

The second sending module 1004 is configured to send the first indication information to the first terminal device.

Optionally, the device is also used to receive a screen projection request sent by the first terminal device if the first terminal device is not a mobile device, wherein the screen projection request is used for the first terminal device to request to project the display content on the screen to On the second terminal device; generate second indication information according to the screen casting request, wherein the second indication information is used to indicate to cast the display content of the first terminal device to the second terminal device; send the second indication information to the second terminal device a terminal device.

Optionally, the first generating module 1002 is also configured to determine whether there is a second terminal device in the moving direction of the first terminal device according to the moving operation data; when there is a second terminal device in the moving direction of the first terminal device, the mobile comparing the operation data with the preset data to determine whether the movement operation data exists in the preset interval of the preset data; if the movement operation data exists in the preset interval of the preset data, a first result is generated, wherein the first result It is used to indicate that the movement operation of the first terminal device is a screen projection operation; if the movement operation data does not exist in the preset interval of the preset data, a second result is generated, wherein the second result is used to indicate the movement of the first terminal device The operation is not a mirroring operation.

Optionally, the device is further configured to determine whether the screen casting request is a request triggered when the first icon is moved to the position of the second icon, wherein the first icon is an icon corresponding to the first terminal device in the thumbnail map, The second icon is the icon corresponding to the second terminal device in the thumbnail map, and the thumbnail map is used to determine the relative position of the first terminal device and the second terminal device; the screen casting request is to move the first icon to the second icon When the request is triggered at the location, the second indication information is generated according to the screen projection request.

Optionally, the device is also used to periodically broadcast Bluetooth signals according to a preset time interval; receive the signal strength indicator value sent by the first terminal device and the signal strength indicator value sent by the second terminal device; Determine the first distance between the first terminal device and the server based on the signal strength indicator value sent by the device; determine the second distance between the second terminal device and the server based on the signal strength indicator value sent by the second terminal device; determine the second distance between the second terminal device and the server based on the first distance determining first location information, wherein the first location information is used to indicate the relative location between the first terminal device and the server; determining second location information based on the second distance, wherein the second location information is used to indicate the second terminal device and the relative position between the server; sending the first position information and the second position information to the first terminal device.

The screen projection processing device is used to implement the technical solution of the server in the foregoing method embodiments, and its realization principle and technical effect are similar to those in the foregoing method embodiments, and will not be repeated here.

FIG. 11 is a schematic structural diagram of a terminal device provided in an embodiment of the present application. As shown in FIG. 11 , the terminal device 1100 includes:

A processor 1111, and a memory 1112 communicatively connected to the processor 1111;

The memory 1111 is used to store computer-executable instructions, and the processor 1112 executes the computer-executable instructions stored in the memory 1111 to implement the technical solution of the screen projection processing method of the first terminal device in the foregoing method embodiments.

Optionally, the memory 1112 can be independent or integrated with the processor 1111 .

Optionally, when the memory 1112 is a device independent of the processor 1111, the terminal device 1100 may further include:

The display 1113 can be used for the user to interact with the terminal device 1100; the bus is used for connecting the above devices.

FIG. 12 is a schematic structural diagram of a server provided in an embodiment of the present application. As shown in FIG. 12, the server 1200 includes:

The processing component 1201 further includes one or more processors, and a memory resource represented by the memory 1202 for storing instructions executable by the processing component 1201 , such as application programs. The application program stored in memory 1202 may include one or more modules each corresponding to a set of instructions. In addition, the processing component 1201 is configured to execute instructions, so as to implement the technical solution of the server's screen projection processing method in the foregoing method embodiments.

The server 1200 may also include a power supply component 1203 configured to perform power management of the server 1200, a wired or wireless network interface 1204 configured to connect the server 1200 to a network, and an input-output interface 1205, which may also Called the I/O interface 1205 . The server 1200 may operate based on an operating system stored in the memory 1202, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™ or the like.

The embodiment of the present application also provides a readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the screen projection processing method provided in the foregoing method embodiment is implemented.

An embodiment of the present application further provides a computer program product, including a computer program, and when the computer program is executed by a processor, the screen projection processing method provided in the foregoing method embodiments is implemented.

Those of ordinary skill in the art can understand that all or part of the steps for implementing the above method embodiments can be completed by program instructions and related hardware. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps including the above-mentioned method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit it; although the application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the various embodiments of the present application. scope.

Claims

A screen projection processing method applied to a first terminal device, the method comprising:

If the first terminal device is a mobile device, acquiring mobile operation data in response to a user's mobile operation on the first terminal device, wherein the mobile operation data includes acceleration data and moving direction data of the first terminal device ;

Sending the mobile operation data to a server for providing users with screen casting services through the screen casting application;

receiving first indication information sent by the server, wherein the first indication information is generated by the server according to a judgment result, the judgment result is used to determine whether the mobile operation is a screen projection operation, and the first The instruction information is used to indicate that when the moving operation is a screen casting operation, the display content of the first terminal device is projected to the second terminal device, and when the moving operation is not a screen projection operation, the Projecting the display content to the second terminal device;

When the first indication information is used to indicate to cast the display content of the first terminal device to the second terminal device, based on the first indication information and the screen casting application, the first The display content on the screen of the terminal device is projected to the second terminal device.
The method according to claim 1, wherein, before obtaining the mobile operation data in response to the mobile operation of the first terminal device by the user, the method further comprises:

Start the screen projection application according to the received start operation of the screen projection application.
The method according to claim 2, wherein, after the launching of the screen-casting application, the method further comprises:

Receive the first location information of the first terminal device and the second location information of the second terminal device sent by the server through the screen projection application, wherein the first location information is used to indicate the first location information A relative position between the terminal device and the server, the second position information is used to indicate the relative position between the second terminal device and the server;

A thumbnail map is generated on the interface of the screen casting application according to the first location information and the second location information, wherein the thumbnail map includes the first icon corresponding to the first terminal device and the the second icon corresponding to the second terminal device, and the thumbnail map is used to determine the relative positions of the first terminal device and the second terminal device.
The method according to claim 3, wherein the method further comprises:

If the first terminal device is not a mobile device, moving the first icon to the position of the second icon in response to a drag operation on the first icon on the interface of the screen-casting application;

Sending a screen projection request to the server, wherein the screen projection request is used for the first terminal device to request that the display content on the screen be sent to the second terminal device;

receiving second instruction information sent by the server, where the second instruction information is used to instruct to cast the display content of the first terminal device to the second terminal device;

Projecting the display content on the screen of the first terminal device to the second terminal device based on the second indication information and the screen projection application.
The method according to claim 1, wherein the method further comprises:

receiving the bluetooth signal sent by the bluetooth gateway of the server;

determining a signal strength indicator value for the first terminal device to receive the Bluetooth signal according to the Bluetooth signal;

sending the signal strength indicator value to the server.
The method according to claim 1, wherein said obtaining mobile operation data in response to the user's mobile operation on the first terminal device comprises:

In response to a user's mobile operation on the first terminal device, the direction data is acquired through a gyroscope of the first terminal device, and the acceleration data is acquired through an acceleration sensor of the first terminal device.
A screen projection processing method applied to a server, the method comprising:

If the first terminal device is a mobile device, receiving mobile operation data sent when the first terminal device performs a mobile operation, wherein the mobile operation data includes acceleration data and moving direction data of the first terminal device;

judging whether the moving operation of the first terminal device is a screen projection operation according to the moving operation data, and generating a judgment result;

Generate first instruction information according to the judgment result, wherein the first instruction information is used to indicate that when the moving operation is a screen projection operation, project the display content of the first terminal device to the second terminal device. On the terminal device, when the mobile operation is not a screen projection operation, the display content is not projected to the second terminal device;

Send the first indication information to the first terminal device.
The method according to claim 7, wherein the method further comprises:

If the first terminal device is not a mobile device, receive a screen projection request sent by the first terminal device, wherein the screen projection request is used for the first terminal device to request to project the display content on the screen to the on the second terminal device;

generating the second instruction information according to the screen projection request, where the second instruction information is used to instruct to project the display content of the first terminal device to the second terminal device;

Send the second indication information to the first terminal device.
The method according to claim 7, wherein the judging whether the moving operation of the first terminal device is a screen-casting operation based on the moving operation data, and generating a judging result includes:

determining whether there is the second terminal device in the moving direction of the first terminal device according to the moving operation data;

When there is the second terminal device in the moving direction of the first terminal device, comparing the moving operation data with preset data, and determining whether the moving operation data exists in the preset data of the preset data in the interval;

If the moving operation data exists in the preset interval of the preset data, generate a first result, where the first result is used to indicate that the moving operation of the first terminal device is a screen projection operation;

If the moving operation data does not exist in the preset interval of the preset data, generate a second result, wherein the second result is used to indicate that the moving operation of the first terminal device is not a screen projection operation .
The method according to claim 8, wherein said generating said second indication information according to said screen projection request comprises:

determining whether the screen casting request is a request triggered when the first icon is moved to the location of the second icon, wherein the first icon is an icon corresponding to the first terminal device in the thumbnail map, and the second The second icon is an icon corresponding to the second terminal device in the thumbnail map, and the thumbnail map is used to determine the relative positions of the first terminal device and the second terminal device;

When the screen casting request is a request triggered when the first icon is moved to the location of the second icon, the second indication information is generated according to the screen casting request.
The method according to claim 7, wherein the method further comprises:

Periodically broadcast Bluetooth signals according to the preset time interval;

receiving the signal strength indicator value sent by the first terminal device and the signal strength indicator value sent by the second terminal device;

determining a first distance between the first terminal device and the server based on a signal strength indicator value sent by the first terminal device;

determining a second distance between the second terminal device and the server based on the signal strength indicator value sent by the second terminal device;

determining first location information based on the first distance, where the first location information is used to represent a relative location between the first terminal device and the server;

determining second location information based on the second distance, where the second location information is used to represent a relative location between the second terminal device and the server;

sending the first location information and the second location information to the first terminal device.
A screen projection processing device, comprising:

An acquisition module, configured to acquire mobile operation data in response to a user's mobile operation on the first terminal device if the first terminal device is a mobile device, wherein the mobile operation data includes the first terminal device Acceleration data and moving direction data;

The first sending module is configured to send the mobile operation data to a server for providing screen projection services for users through the screen projection application;

The first receiving module is configured to receive the first indication information sent by the server, wherein the first indication information is generated by the server according to the judgment result, and the judgment result is used to determine whether the mobile operation is casting Screen operation, the first indication information is used to indicate that when the mobile operation is a screen projection operation, project the display content of the first terminal device to the second terminal device, and when the mobile operation is not During the screen projection operation, the display content is not projected to the second terminal device;

The screen projection module is configured to, when the user's first instruction information is used to indicate to project the display content of the first terminal device to the second terminal device, based on the first instruction information and the projection The screen application projects the display content on the screen of the first terminal device to the second terminal device.
A screen projection processing device, comprising:

The second receiving module is configured to receive mobile operation data sent by the first terminal device if the first terminal device is a mobile device, wherein the mobile operation data includes acceleration data and a moving direction of the first terminal device data;

The first generation module is configured to judge whether the mobile operation of the first terminal device is a screen projection operation according to the mobile operation data, and generate a judgment result;

The second generating module is configured to generate first indication information according to the judgment result, wherein the first indication information is used to indicate that when the moving operation is a screen projection operation, the display content of the first terminal device Projecting the screen to the second terminal device, and not projecting the display content to the second terminal device when the mobile operation is not a screen projection operation;

The second sending module is configured to send the first indication information to the first terminal device.
A terminal device comprising:

a processor, and a memory communicatively connected to the processor;

The processor executes the computer-executed instructions stored in the memory, so as to realize the screen projection processing method according to any one of claims 1-6.
A server comprising:

a processor, and a memory communicatively connected to the processor;

The processor executes the computer-executed instructions stored in the memory, so as to realize the screen projection processing method according to any one of claims 7 to 11.
A computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the screen projection processing method according to any one of claims 1 to 11 is realized.
A computer program product, including a computer program, the computer program is used to implement the screen projection processing method according to any one of claims 1 to 11 when executed by a processor.