CN114089935A

CN114089935A - Screen projection processing method, device, equipment and storage medium

Info

Publication number: CN114089935A
Application number: CN202111251675.XA
Authority: CN
Inventors: 李郗
Original assignee: Qingdao Haier Technology Co Ltd; Haier Smart Home Co Ltd
Current assignee: Qingdao Haier Technology Co Ltd; Haier Smart Home Co Ltd
Priority date: 2021-10-25
Filing date: 2021-10-25
Publication date: 2022-02-25
Anticipated expiration: 2041-10-25
Also published as: WO2023071655A1; CN114089935B

Abstract

The application belongs to the field of computers, and particularly relates to a screen projection processing method, device, equipment and storage medium. The screen projection method and the screen projection device aim at solving the problem that in the prior art, due to the fact that the operation process of a user is complex, the efficiency of screen projection of the user is low. The method of the present application comprises: starting the screen projection application according to the received starting operation of the screen projection application; if the first terminal equipment is mobile equipment, responding to the mobile operation of a user on the first terminal equipment, and acquiring mobile operation data; sending the mobile operation data to a server for providing screen projection service for a user through a screen projection application; receiving first indication information sent by a server; and projecting the display content on the screen of the first terminal equipment to the second terminal equipment based on the first indication information and the screen projecting application, so that the purpose of improving the screen projecting efficiency of a user is achieved.

Description

Screen projection processing method, device, equipment and storage medium

Technical Field

The application belongs to the field of computers, and particularly relates to a screen projection processing method, device, equipment and storage medium.

Background

With the development of computer technology, intelligent screen devices are increasingly used by users, such as televisions, refrigerators, home monitoring cameras and the like. When the user uses the screen projection device, the screen projection device can project a screen between the terminal device such as a mobile phone and the intelligent screen-equipped device.

In the prior art, when a screen is projected between a terminal device such as a mobile phone and an intelligent screen-equipped device, corresponding screen-projecting software is generally downloaded on the terminal device such as the mobile phone and the intelligent screen-equipped device, and when a user wants to project a screen, the screen-projecting software is opened on the terminal device such as the mobile phone and the intelligent screen-equipped device, and then the operation is performed according to guidance information of the screen-projecting software, so that the screen projection is realized. However, this method often requires the user to repeatedly operate the terminal device such as a mobile phone and the smart device with a screen, and therefore, the operation process of the user is complicated, and the efficiency of screen projection by the user is low.

Disclosure of Invention

In order to solve the above problems in the prior art, that is, to solve the problem that the efficiency of screen projection by a user is low due to a complex operation process of the user, the present application provides a screen projection processing method, which is applied to a first terminal device, and the method includes: if the first terminal equipment is mobile equipment, responding to the mobile operation of a user on the first terminal equipment, and acquiring mobile operation data, wherein the mobile operation data comprises acceleration data and moving direction data of the first terminal equipment; sending the mobile operation data to a server for providing screen projection service for a user through a screen projection application; receiving first indication information sent by a server, wherein the first indication information is generated by the server according to a judgment result, the judgment result is used for determining whether the mobile operation is screen projection operation, the first indication information is used for indicating that when the mobile operation is screen projection operation, display content of first terminal equipment is projected to second terminal equipment, and when the mobile operation is not screen projection operation, the display content is not projected to the second terminal equipment; when the first indication information of the user is used for indicating that the display content of the first terminal device is projected to the second terminal device, the display content on the screen of the first terminal device is projected to the second terminal device based on the first indication information and the screen projection application.

In a preferred technical solution of the screen-projection processing method, before the mobile operation data is acquired in response to the mobile operation of the user on the first terminal device, the method further includes: and starting the screen projection application according to the received starting operation of the screen projection application.

In a preferred embodiment of the screen projection processing method, after the screen projection application is started, the method further includes: receiving first position information of first terminal equipment and second position information of second terminal equipment, which are sent by a server through a screen-casting application, wherein the first position information is used for indicating the relative position between the first terminal equipment and the server, and the second position information is used for indicating the relative position between the second terminal equipment and the server; and generating a thumbnail map on an interface of the screen projection application according to the first position information and the second position information, wherein the thumbnail map comprises a first icon corresponding to the first terminal device and a second icon corresponding to the second terminal device, and the thumbnail map is used for determining the relative positions of the first terminal device and the second terminal device.

In a preferred embodiment of the screen projection processing method, the method further includes: if the first terminal equipment is not mobile equipment, responding to the dragging operation of the first icon on the screen-casting application interface, and moving the first icon to the position of the second icon; sending a screen projection request to a server, wherein the screen projection request is used for a first terminal device to request to send display content on a screen to a second terminal device; receiving second indication information sent by the server, wherein the second indication information is used for indicating that the display content of the first terminal equipment is projected to the second terminal equipment; and projecting the display content on the screen of the first terminal equipment to the second terminal equipment based on the second indication information and the screen projecting application.

In a preferred embodiment of the screen projection processing method, the method further includes: receiving a Bluetooth signal sent by a Bluetooth gateway of a server; determining a signal strength indicating value of a first terminal device for receiving a Bluetooth signal according to the Bluetooth signal; the signal strength indication value is sent to a server.

In a preferred technical solution of the screen-projection processing method, acquiring mobile operation data in response to a mobile operation of a user on a first terminal device includes: and responding to the movement operation of the user on the first terminal equipment, acquiring movement direction data through a gyroscope of the first terminal equipment, and acquiring acceleration data through an acceleration sensor of the first terminal equipment.

The embodiment of the application also provides a screen projection processing method, which is applied to a server and comprises the following steps: if the first terminal equipment is mobile equipment, receiving mobile operation data sent when the first terminal equipment executes mobile operation, wherein the mobile operation data comprises acceleration data and moving direction data of the first terminal equipment; judging whether the mobile operation of the first terminal equipment is screen projection operation or not according to the mobile operation data, and generating a judgment result; generating first indication information according to the judgment result, wherein the first indication information is used for indicating that the display content of the first terminal equipment is projected to the second terminal equipment when the mobile operation is the screen projection operation, and the display content is not projected to the second terminal equipment when the mobile operation is not the screen projection operation; and sending the first indication information to the first terminal equipment.

In a preferred embodiment of the screen projection processing method, the method further includes: if the first terminal equipment is not the mobile equipment, receiving a screen projection request sent by the first terminal equipment, wherein the screen projection request is used for the first terminal equipment to request to project the display content on the screen to the second terminal equipment; generating second indication information according to the screen projection request, wherein the second indication information is used for indicating that the display content of the first terminal equipment is projected to the second terminal equipment; and sending the second indication information to the first terminal equipment.

In a preferred technical solution of the screen-projection processing method, determining whether the mobile operation of the first terminal device is a screen-projection operation according to the mobile operation data, and generating a determination result includes: determining whether a second terminal device exists in the moving direction of the first terminal device according to the moving operation data; when a second terminal device exists in the moving direction of the first terminal device, comparing the moving operation data with preset data, and determining whether the moving operation data exists in a preset interval of the preset data; if the mobile operation data exist in a preset interval of the preset data, generating a first result, wherein the first result is used for indicating that the mobile operation of the first terminal equipment is screen projection operation; and if the mobile operation data does not exist in the preset interval of the preset data, generating a second result, wherein the second result is used for indicating that the mobile operation of the first terminal equipment is not screen projection operation.

In a preferred technical solution of the screen-projection processing method, generating second indication information according to a screen-projection request includes: determining whether the screen projection request is a request triggered when a first icon is moved to the position of a second icon, wherein the first icon is an icon corresponding to first terminal equipment in a thumbnail map, the second icon is an icon corresponding to second terminal equipment in the thumbnail map, and the thumbnail map is used for determining the relative positions of the first terminal equipment and the second terminal equipment; and when the screen projection request is a request triggered when the first icon is moved to the position of the second icon, generating second indication information according to the screen projection request.

In a preferred embodiment of the screen projection processing method, the method further includes: periodically broadcasting a Bluetooth signal according to a preset time interval; receiving a signal strength indicated value sent by a first terminal device and a signal strength indicated value sent by a second terminal device; determining a first distance between the first terminal equipment and the server based on a signal strength indicated value sent by the first terminal equipment; determining a second distance between the second terminal equipment and the server based on the signal strength indicated value sent by the second terminal equipment; determining first position information based on the first distance, wherein the first position information is used for representing the relative position between the first terminal equipment and the server; determining second position information based on the second distance, wherein the second position information is used for indicating the relative position between the second terminal equipment and the server; and sending the first position information and the second position information to the first terminal equipment.

The embodiment of the present application further provides a screen projection processing apparatus, including: the mobile terminal device comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for responding to the mobile operation of a user on the first terminal device and acquiring mobile operation data if the first terminal device is the mobile device, and the mobile operation data comprises acceleration data and moving direction data of the first terminal device; the first sending module is used for sending the mobile operation data to a server for providing screen projection service for a user through a screen projection application; the first receiving module is used for receiving first indication information sent by the server, wherein the first indication information is generated by the server according to a judgment result, the judgment result is used for determining whether the mobile operation is screen projection operation, the first indication information is used for indicating that when the mobile operation is screen projection operation, the display content of the first terminal equipment is projected to the second terminal equipment, and when the mobile operation is not screen projection operation, the display content is not projected to the second terminal equipment; and the screen projection module is used for projecting the display content on the screen of the first terminal device to the second terminal device based on the first indication information and the screen projection application when the first indication information of the user is used for indicating that the display content of the first terminal device is projected to the second terminal device.

The embodiment of the present application further provides a screen projection processing apparatus, including: the second receiving module is used for receiving mobile operation data sent by the first terminal equipment when the first terminal equipment executes mobile operation if the first terminal equipment is mobile equipment, wherein the mobile operation data comprises acceleration data and moving direction data of the first terminal equipment; the first generation module is used for judging whether the mobile operation of the first terminal equipment is screen projection operation according to the mobile operation data and generating a judgment result; the second generation module is used for generating first indication information according to the judgment result, wherein the first indication information is used for indicating that the display content of the first terminal equipment is projected to the second terminal equipment when the mobile operation is screen projection operation, and the display content is not projected to the second terminal equipment when the mobile operation is not screen projection operation; and the second sending module is used for sending the first indication information to the first terminal equipment.

An embodiment of the present application further provides a terminal device, including: a processor, a memory, a display; the memory is used for storing programs and data, and the processor calls the programs stored in the memory to execute the screen projection processing method applied to the first terminal equipment in the method.

An embodiment of the present application further provides a server, including: a processor, a memory, a display; the memory is used for storing programs and data, and the processor calls the programs stored in the memory to execute the screen projection processing method applied to the server in the method.

The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and the computer program is used for implementing a screen projection processing method applied to the first terminal device or a screen projection processing method applied to the server in the foregoing methods when being executed by the processor.

The embodiment of the present application further provides a computer program product, which includes a computer program, and the computer program is used for implementing the screen projection processing method applied to the first terminal device in the foregoing methods, or the screen projection processing method applied to the server when the computer program is executed by the processor.

The technical personnel in the field can understand that the screen projection processing method is applied to the first terminal device, and when the first terminal device is a mobile device, if a user wants to implement screen projection of the display content of the first terminal device onto the second terminal device for display, the first terminal device can be moved towards the direction of the second terminal device, so that after the first indication information sent by the server is received and indicates that the display content of the first terminal device is projected onto the second terminal device, the display content on the screen of the first terminal device can be projected onto the second terminal device through the first indication information and the screen projection application, thereby avoiding complex operation performed on the first terminal device by the user, and achieving the purpose of improving the screen projection efficiency of the user.

The screen projection processing method can be also applied to a server, when a first terminal device is a mobile device, if a user wants to project the display content of the first terminal device to a second terminal device for display, the server can generate a judgment result according to mobile operation data, determine whether the mobile operation of the user on the first terminal device is the screen projection operation, then generate first indication information according to the judgment result, and send the first indication information to the first terminal device, so that after the first terminal device receives the first indication information sent by the server and the first indication information indicates that the display content of the first terminal device is projected to the second terminal device, the display content on the screen of the first terminal device can be projected to the second terminal device through the first indication information and a screen projection application, thereby avoiding the user from performing complex operation on the first terminal device, the purpose of improving the screen projection efficiency of the user is achieved.

Drawings

Preferred embodiments of the screen projection processing method of the present application are described below with reference to the accompanying drawings. The attached drawings are as follows:

fig. 1 is a schematic view of an application scenario of a screen projection processing method provided in an embodiment of the present application;

FIG. 2 is a schematic structural diagram of a screen projection processing system provided in an embodiment of the present application;

fig. 3 is a flowchart of a first embodiment of a screen projection processing method provided in an embodiment of the present application;

fig. 4 is a flowchart of a second embodiment of a screen projection processing method provided in the embodiment of the present application;

fig. 5 is a flowchart of a third embodiment of a screen projection processing method provided in the embodiment of the present application;

FIG. 6 is a schematic diagram of obtaining mobile operation data according to an embodiment of the present application;

fig. 7 is a schematic diagram of a first embodiment of a bluetooth gateway location processing provided in an embodiment of the present application;

fig. 8 is a schematic diagram of a second embodiment of a bluetooth gateway location processing provided in the embodiment of the present application;

fig. 9 is a schematic view of a first embodiment of a screen projection processing apparatus provided in an embodiment of the present application;

fig. 10 is a schematic diagram of a second embodiment of a screen projection processing apparatus provided in the embodiment of the present application;

fig. 11 is a schematic structural diagram of a terminal device provided in an embodiment of the present application;

fig. 12 is a schematic structural diagram of a server according to an embodiment of the present application.

Detailed Description

First, it should be understood by those skilled in the art that these embodiments are merely for explaining the technical principles of the present application, and are not intended to limit the scope of the present application. And can be adjusted as needed by those skilled in the art to suit particular applications.

Furthermore, it should be noted that in the description of the embodiments of the present application, the terms "first", "second", "third", "fourth", etc. (if present) are used for distinguishing similar objects, and are not necessarily used for describing a specific order or sequence. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein.

Furthermore, it should be further noted that in the description of the embodiments of the present application, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In the prior art provided in the background art, a scheme for a user to project a screen at least has the following technical problems:

if a user wants to screen the mobile phone content on other intelligent screen equipment, repeated operation needs to be performed on the mobile phone and the intelligent screen equipment, for example, firstly, the mobile phone end screen-casting software is started, then the screen-casting software is started in the intelligent screen equipment, the mobile phone end operates according to the indication of the screen-casting software, and the user waits for the intelligent screen equipment to display the content. Therefore, the actual operation of the user is very complicated, resulting in a problem that the screen projection efficiency of the user is low.

In order to solve the problems, the application provides a screen projection processing method, when a first terminal device is a mobile device, if a user wants to project display content of the first terminal device into a second terminal device, the first terminal device is moved, the first terminal device can acquire moving direction data of the first terminal device through a gyroscope, acquire acceleration data of the first terminal device through an acceleration sensor, then send the moving direction data and the acceleration data to a server providing screen projection service for the user, the server judges whether the moving operation of the user on the first terminal device is screen projection operation according to the moving direction data and the acceleration data, generates first indication information and sends the first indication information to the first terminal device, and if the moving operation of the user on the first terminal device is screen projection operation, the first terminal device can project the display content of the first terminal device into the second terminal device according to the indication information Standby, screen-casting the display content to the second terminal equipment for displaying; if the user does not perform screen projection operation on the first terminal device, the first terminal device does not perform screen projection on the display content of the first terminal device to the second terminal device according to the indication of the first indication information, and does not perform screen projection on the display content to the second terminal device for display.

If the first terminal device is not a mobile device, the first terminal device can realize screen projection through a thumbnail map on a screen projection application interface, the thumbnail map comprises a first icon corresponding to the first terminal device and a second icon corresponding to the second terminal device, when a user wants to project the display content of the first terminal device into the second terminal device, the first icon corresponding to the first terminal device is dragged to the position of the second icon corresponding to the second terminal device on the thumbnail map, a screen projection request is triggered at the moment, the first terminal device sends the screen projection request to a server, the server generates second indication information according to the screen projection request and sends the second indication information to the first terminal device, and therefore the first terminal device can project the display content into the second terminal device for display.

Fig. 1 is a schematic view of an application scenario of a screen projection processing method provided in an embodiment of the present application, as shown in fig. 1, in the scenario, if a first terminal device is a mobile device, taking the first terminal device as a mobile phone and a second terminal device as a television as an example, a user wants to project a display content on a screen of the mobile phone onto the television for displaying, after a screen projection application on the mobile phone is opened, the mobile phone may be moved toward the television to perform a throwing motion, so that moving direction data may be obtained by a gyroscope in the mobile phone, acceleration data may be obtained by an acceleration sensor in the mobile phone, then the mobile phone sends the moving direction data and the acceleration data to a server providing a screen projection service for the user through the screen projection application, and the server determines whether the throwing motion of the user is intended to be screen projection according to the acceleration data and the moving direction data, and then generating first indication information according to the judgment result, sending the first indication information to the mobile phone, if the throwing action of the user is to throw the screen, determining that the display content on the screen of the mobile phone can be thrown onto the television for displaying, and if the throwing action of the user is not to throw the screen, determining that the display content on the screen of the mobile phone cannot be thrown onto the television for displaying.

If the first terminal device is not a mobile device, taking the first terminal device as a refrigerator and the second terminal device as a television as an example, a user wants to screen display content on a screen of the refrigerator onto the television for display, after a screen-casting application on the refrigerator is opened, an icon corresponding to the refrigerator is dragged to the position of the icon corresponding to the television in a thumbnail map displayed on an interface of the screen-casting application, at this moment, a screen-casting request can be triggered and sent to a server, the server generates second indication information according to the screen-casting request and sends the second indication information to the refrigerator, and the refrigerator screens the display content on the screen onto the television for display according to the second indication information and the screen-casting application.

Fig. 2 is a schematic structural diagram of a screen projection processing system provided in an embodiment of the present application, and as shown in fig. 2, the system includes a first terminal device, a second terminal device, and a server.

The first terminal device comprises a direction module (namely, a gyroscope), a position module (namely, a Bluetooth module) and a gesture module, wherein the first terminal device can be mobile devices such as a mobile phone, the direction module is used for analyzing direction logic of a user when the user moves the mobile devices such as the mobile phone, the position module is used for analyzing the relative positions of the mobile devices such as the mobile phone in a current room, and the gesture module is used for analyzing the intention of the user to slide the screen of the mobile devices such as the mobile phone and determining whether the user opens screen projection application on the mobile devices such as the mobile phone.

The second terminal device comprises a position module (namely a Bluetooth module) and a gesture module, wherein the second terminal device can be a non-mobile device with a screen, such as a refrigerator, a television, a computer and the like, the position module is used for analyzing the relative position of the non-mobile device, such as the refrigerator, the television, the computer and the like, in a current room, and the gesture module is used for analyzing the intention of a user to slide the screen of the non-mobile device, such as the refrigerator, the television, the computer and the like, and determining whether the user opens a screen projection application on the non-mobile device, such as the refrigerator, the television, the computer and the like.

The server is a screen projection background service in a local area network of a user family, and comprises a position module (namely a Beacon device group) and a screen projection processing module, wherein the Beacon device group of the position module is used for broadcasting a Bluetooth signal to the indoor at regular time, and the screen projection processing module is used for determining the relative positions of a first terminal device and a second terminal device after the indoor first terminal device and the indoor second terminal device receive the Bluetooth signal and processing the actual screen projection logic.

The server can also be used for performing screen projection pairing among all indoor intelligent devices and establishing an association relationship between the user and all indoor intelligent devices. The server also comprises a screen projection safety verification component, an equipment information database, a user database and a user screen projection operation database, wherein the screen projection safety verification component is used for verifying the legality of the screen projection behavior of the user, the equipment information database is used for storing the equipment information which the user wants to project the screen, the user database is used for storing the biological characteristics (face data, iris data, fingerprint data and the like) of the user, and the user screen projection operation database is used for storing the historical operation record of screen projection performed by the user.

The principles and features of the embodiments of the present application are described below with reference to the above application scenarios and systems and the accompanying drawings, which are used for illustration of the embodiments of the present application and are not intended to limit the scope of the embodiments of the present application.

Fig. 3 is a flowchart of a first embodiment of a screen projection processing method provided in an embodiment of the present application, and as shown in fig. 3, the screen projection processing method applied to a first terminal device includes the following steps:

s301: and if the first terminal equipment is mobile equipment, responding to the mobile operation of the user on the first terminal equipment, and acquiring mobile operation data.

In this step, the movement operation data includes acceleration data and movement direction data of the first terminal device. If the first terminal device is a mobile device, for example, a mobile phone, when a user wants to perform a screen projection operation, after opening a screen projection application on the first terminal device, the user moves the first terminal device, for example, the user throws the mobile phone towards a second terminal device (for example, a television), and after responding to the movement operation of the user, the first terminal device can acquire acceleration data and moving direction data of the first terminal device.

S302: and sending the mobile operation data to a server for providing screen projection service for the user through the screen projection application.

In this step, the first terminal device has a screen-casting application, and the first terminal device may send the mobile operation data to a server for providing a screen-casting service for the user through the screen-casting application.

In the above scheme, since the server is provided with the screen-projecting operation database in which historical screen-projecting operation records of the user are stored, and the server stores the position information of all the terminal devices, the first terminal device can send the screen-projecting operation data to the server, and the server processes the screen-projecting operation data.

S303: and receiving first indication information sent by the server.

In this step, the first indication information is generated by the server according to the determination result, the determination result is used to determine whether the mobile operation is a screen-casting operation, the first indication information is used to indicate that the display content of the first terminal device is screen-cast to the second terminal device when the mobile operation is the screen-casting operation, and the display content is not screen-cast to the second terminal device when the mobile operation is not the screen-casting operation.

In the scheme, after receiving mobile operation data sent by a first terminal device, a server determines whether a second terminal device capable of screen projection exists on a path of a moving direction of the first terminal device according to the mobile operation data, if so, the mobile operation data is compared with historical data in a user screen projection operation database, whether the mobile operation of the first terminal device is an operation that a user wants to screen projection is judged, and if the mobile operation of the user is determined to be the operation that the user wants to screen projection, first indication information generated by the server is used for indicating that display contents of the first terminal device are screen projected to the second terminal device; and if the mobile operation of the user is determined not to be the operation that the user wants to perform screen projection, the first indication information generated by the server is used for indicating that the display content of the first terminal device is not projected to the second terminal device. And then the server sends the first indication information to the first terminal equipment.

In the above scheme, if the user screen-casting operation database does not have the historical data of the user, a preset datum can be stored in advance, so that the mobile operation datum can be compared with the preset datum.

S304: and when the first indication information is used for indicating that the display content of the first terminal device is projected to the second terminal device, the display content on the screen of the first terminal device is projected to the second terminal device based on the first indication information and the screen projection application.

In this step, after receiving the first indication information, the first terminal device determines that the first indication information indicates that the display content of the first terminal device can be projected onto the second terminal device, and then the first terminal device may project the display content on the screen of the first terminal device onto the second terminal device for display by using the screen projection application according to the indication of the first indication information, where the first terminal device is a device that initiates a screen projection operation, the second terminal device is a device that receives the screen projection content, and the second terminal device displays the display content on the screen of the second terminal device after receiving the display content projected by the first terminal device.

In the above scheme, if the first terminal device determines that the first indication information indicates that the display content of the first terminal device cannot be projected onto the second terminal device after receiving the first indication information, the first terminal device determines that the current operation of the user is a wrong operation, and therefore the first terminal device does not project the display content on the screen onto the second terminal device for display.

In the above scheme, the first terminal device and the second terminal device are both intelligent screen devices.

In one specific implementation, before the mobile operation data is acquired in response to the mobile operation of the first terminal device by the user, the method further includes: and starting the screen projection application according to the received starting operation of the screen projection application.

According to the scheme, when a user wants to perform screen projection operation, a screen projection application is firstly opened on first terminal equipment, and the first terminal equipment can start the screen projection application after receiving the start operation of the user on the screen projection application, so that the user can perform screen projection operation conveniently.

In one implementation, after the screen projection application is started, the method further comprises: receiving first position information of first terminal equipment and second position information of second terminal equipment, which are sent by a server through a screen-casting application, wherein the first position information is used for indicating the relative position between the first terminal equipment and the server, and the second position information is used for indicating the relative position between the second terminal equipment and the server; and generating a thumbnail map on an interface of the screen projection application according to the first position information and the second position information, wherein the thumbnail map comprises a first icon corresponding to the first terminal device and a second icon corresponding to the second terminal device, and the thumbnail map is used for determining the relative positions of the first terminal device and the second terminal device.

In the scheme, a thumbnail map can be generated in a screen projection application in a first terminal device, and since the server stores relative position information of all terminal devices and the server, the first terminal device can receive, by the screen projection application, first position information of the first terminal device and second position information of a second terminal device, which are sent by the server, so that after the position information of all terminal devices is determined, a thumbnail map including the positions of all terminal devices can be determined on a screen projection application interface of the first terminal device, each terminal device in the thumbnail map corresponds to an icon, for example, if the first terminal device is a mobile phone, the corresponding first icon is a mobile phone icon, if the second terminal device is a television, the corresponding second icon is a television icon, and the like, because the terminal devices in a user's family are not only mobile phones and televisions, therefore, a plurality of icons corresponding to the terminal devices are displayed in the thumbnail map, and the relative position between each icon corresponds to the actual relative position between each terminal device.

In one implementation, the method further comprises: if the first terminal equipment is not mobile equipment, responding to the dragging operation of the first icon on the screen-casting application interface, and moving the first icon to the position of the second icon; sending a screen projection request to a server, wherein the screen projection request is used for a first terminal device to request to project the display content on the screen to a second terminal device; receiving second indication information sent by the server, wherein the second indication information is used for indicating that the display content of the first terminal equipment is projected to the second terminal equipment; and projecting the display content on the screen of the first terminal equipment to the second terminal equipment based on the second indication information and the screen projecting application.

In this scenario, the first terminal device is not a mobile device, e.g., the first terminal device is a refrigerator, when a user wants to project the display content on the screen of a first terminal device to a second terminal device, for example, the second terminal device is a television, because the screen-casting application of the first terminal device displays the thumbnail map, the user can directly drag the first icon corresponding to the first terminal device to the position of the second icon corresponding to the second terminal device on the thumbnail map and trigger to generate a screen-casting request, then sending the screen-throwing request to a server, generating second indication information by the server according to the screen-throwing request, and sending the second indication information to the first terminal device, at this time, the first terminal device determines that the screen projection can be performed, the display content on the screen of the first terminal device can be projected to the second terminal device for displaying by using the screen projection application according to the indication of the second indication information.

In one implementation, the method further comprises: receiving a Bluetooth signal sent by a Bluetooth gateway of a server; determining a signal strength indicating value of a first terminal device for receiving a Bluetooth signal according to the Bluetooth signal; the signal strength indication value is sent to a server.

In the scheme, a Bluetooth gateway, namely a Beacon (Beacon) device group, is deployed in a home of a user, a Beacon device group is arranged in a server, each Beacon device in the Beacon device group broadcasts a Bluetooth Signal to the surroundings at regular intervals, a first terminal device receives the Bluetooth Signal through the Bluetooth device of the first terminal device, determines a Received Signal Strength Indication (RSSI) value according to the Received Bluetooth Signal, and then sends the RSSI value to the server.

In the above scheme, the second terminal device may also receive the bluetooth signal according to its own bluetooth device, determine the RSSI value according to the received bluetooth signal, and then send the RSSI value to the server. The first terminal device and the second terminal device may transmit the RSSI value to the server through a wireless communication technology (Wi-Fi).

In one specific implementation, the obtaining of the mobile operation data in response to the mobile operation of the first terminal device by the user includes: and responding to the movement operation of the user on the first terminal equipment, acquiring movement direction data through a gyroscope of the first terminal equipment, and acquiring acceleration data through an acceleration sensor of the first terminal equipment.

In this scheme, when the first terminal device is a mobile device, a gyroscope and an acceleration sensor are disposed in the first terminal device, for example, the first terminal device is a mobile phone, so that when a user moves the first terminal device, the moving direction data of the first terminal device can be acquired through the gyroscope of the first terminal device, and the acceleration data of the first terminal device can be acquired through the acceleration sensor of the first terminal device.

In the above scheme, when the first terminal device obtains the moving direction data and the acceleration data, the moving direction data and the acceleration data may be obtained through an Application Programming Interface (API) of the first terminal device, and both an Android (Android) system and an apple (iOS) system have such system interfaces, where an Application program Interface of the Android system is SensorManager and a shadow city program Interface of the iOS system is CoreMotion. Thus, both acceleration data and movement direction data of the first terminal device can be acquired by both interfaces. Fig. 6 is a schematic diagram of acquiring movement operation data according to an embodiment of the present application, and as shown in fig. 6, acceleration data and movement direction data are integrated according to data of the first terminal device on an x-axis, a y-axis and a z-axis of a spatial coordinate system.

In the screen projection processing method provided by this embodiment, when a first terminal device is a mobile device, if a user wants to implement screen projection of display content of the first terminal device onto a second terminal device for display, the first terminal device may be moved toward the second terminal device, so that after first indication information sent by a server is received and the first indication information indicates that the display content of the first terminal device can be screen projected onto the second terminal device, the display content on the screen of the first terminal device can be screen projected onto the second terminal device through the first indication information and a screen projection application; when the first terminal device is not a mobile device, if a user wants to implement screen projection of the display content of the first terminal device to the second terminal device for display, the first icon corresponding to the first terminal device can be moved to the position of the second icon corresponding to the second terminal device in a thumbnail map displayed on a screen projection application interface of the first terminal device, so that after second indication information sent by the server is received, screen projection of the display content on the screen of the first terminal device to the second terminal device can be implemented through the second indication information and the screen projection application, thereby avoiding complex operation performed on the first terminal device by the user, and achieving the purpose of improving screen projection efficiency of the user.

Fig. 4 is a flowchart of a second embodiment of a screen projection processing method provided in an embodiment of the present application, and as shown in fig. 4, the screen projection processing method is applied to a server for providing a screen projection service for a user, and includes the following steps:

s401: and if the first terminal equipment is mobile equipment, receiving mobile operation data sent when the first terminal equipment executes mobile operation.

In this step, the movement operation data includes acceleration data and movement direction data of the first terminal device. If the first terminal device is a mobile device, for example, a mobile phone, when a user wants to perform a screen projection operation, after opening a screen projection application on the first terminal device, the user moves the first terminal device, for example, the user throws the mobile phone towards a second terminal device (for example, a television), after responding to the user's movement operation, the first terminal device may generate movement operation data, and send the movement operation data to a server according to the screen projection application, and the server processes the received movement operation data.

In the above solution, when the user throws the mobile phone towards the second terminal device, the acceleration data of the second terminal device may be obtained by integrating the acceleration data of the x-axis, the y-axis and the z-axis on the spatial coordinate system as shown in fig. 6.

S402: and judging whether the mobile operation of the first terminal equipment is screen projection operation according to the mobile operation data, and generating a judgment result.

In this step, after the server receives the mobile operation data sent by the first terminal device, since the server is provided with a user screen-casting operation database, the database stores the historical screen-casting operation records of the user, and the server stores the position information of all the terminal devices, after receiving the mobile operation data sent by the first terminal device, the server firstly determines whether a second terminal device capable of casting a screen exists on the path of the moving direction of the first terminal device according to the mobile operation data, if so, compares the mobile operation data with the historical data in the user screen-casting operation database, judges whether the mobile operation of the first terminal device is the screen-casting operation intended by the user, if the operation of the first terminal device by the user is determined to be the screen-casting operation intended by the user, judges that the mobile operation of the first terminal device by the user is the screen-casting operation, and if the operation of the user on the first terminal device is determined not to be the screen projection operation which the user wants to perform, judging that the mobile operation of the user on the first terminal device is not the screen projection operation.

In the above scheme, each time the user performs the screen projection operation, the server stores the current mobile operation data into the user screen projection operation database after receiving the current mobile operation data of the user, so that the data in the user screen projection operation database can be expanded, and the subsequent server can conveniently match the screen projection operation of the user more quickly according to the user screen projection operation database.

S403: and generating first indication information according to the judgment result.

In the above scheme, if the determination result is that the mobile operation of the user on the first terminal device is a screen projection operation, the first indication information is used for indicating that the display content of the first terminal device is projected onto the second terminal device when the mobile operation is the screen projection operation; if the judgment result is that the mobile operation of the user on the first terminal device is not the screen projection operation, the first indication information is used for indicating that the display content is not projected to the second terminal device when the mobile operation is not the screen projection operation.

S404: and sending the first indication information to the first terminal equipment.

In one implementation, the method further comprises: if the first terminal equipment is not the mobile equipment, receiving a screen projection request sent by the first terminal equipment, wherein the screen projection request is used for the first terminal equipment to request to project the display content on the screen to the second terminal equipment; generating second indication information according to the screen projection request, wherein the second indication information is used for indicating that the display content of the first terminal equipment is projected to the second terminal equipment; and sending the second indication information to the first terminal equipment.

In this scenario, the first terminal device is not a mobile device, e.g., the first terminal device is a refrigerator, when a user wants to project the display content on the screen of a first terminal device to a second terminal device, for example, the second terminal device is a television, because the screen-casting application of the first terminal device displays the thumbnail map, the user can directly drag the first icon corresponding to the first terminal device to the position of the second icon corresponding to the second terminal device on the thumbnail map and trigger to generate a screen-casting request, then sending the screen projection request to a server, after receiving the screen projection request, the server determines that the first terminal equipment wants to perform screen projection, therefore, the server can generate second indication information according to the screen projection request and send the second indication information to the first terminal device, and the first terminal device can determine that the display content can be projected to the second terminal device through the second indication information.

In one specific implementation, the determining, according to the mobile operation data, whether the mobile operation of the first terminal device is a screen-throwing operation, and generating a determination result includes: determining whether a second terminal device exists in the moving direction of the first terminal device according to the moving operation data; when a second terminal device exists in the moving direction of the first terminal device, comparing the moving operation data with preset data, and determining whether the moving operation data exists in a preset interval of the preset data; if the mobile operation data exist in a preset interval of the preset data, generating a first result, wherein the first result is used for indicating that the mobile operation of the first terminal equipment is screen projection operation; and if the mobile operation data does not exist in the preset interval of the preset data, generating a second result, wherein the second result is used for indicating that the mobile operation of the first terminal equipment is not screen projection operation.

In the solution, since the server is provided with a user screen-casting operation database, the database stores the historical screen-casting operation records of the user, and the server stores the position information of all terminal devices, when generating the first indication information according to the mobile operation data, the server needs to determine whether there is a second terminal device capable of performing screen casting in the moving direction of the first terminal device after receiving the mobile operation data, if there is a second terminal device capable of performing screen casting in the moving direction of the first terminal device, the mobile operation data can be compared with the preset data, the preset data can be the historical data in the user screen-casting operation database, or the reasonable data in the user screen-casting operation database set in advance for developers, if the mobile operation data is not greatly different from the preset data, that is, if the mobile operation data is in the preset interval of the preset data, the mobile operation of the user is screen projection operation, and screen projection can be realized; if the difference between the mobile operation data and the preset data is large, that is, the mobile operation data is not in the preset interval of the preset data, it is indicated that the mobile operation of the user is not the screen-projection operation, and at this time, the mobile operation of the user on the first terminal device may be a misoperation, so that the screen-projection cannot be realized.

In the above scheme, if there is no second terminal device capable of performing screen projection in the moving direction of the first terminal device, the server returns a prompt message to the first terminal device, so that the first terminal device can determine that the screen projection operation cannot be performed at this time.

In one specific implementation, generating the second indication information according to the screen-casting request includes: determining whether the screen projection request is a request triggered when a first icon is moved to the position of a second icon, wherein the first icon is an icon corresponding to first terminal equipment in a thumbnail map, the second icon is an icon corresponding to second terminal equipment in the thumbnail map, and the thumbnail map is used for determining the relative positions of the first terminal equipment and the second terminal equipment; and when the screen projection request is a request triggered when the first icon is moved to the position of the second icon, generating second indication information according to the screen projection request.

In the scheme, the first terminal device is not a mobile device, so that when the user performs a screen-casting operation on the first terminal device, the user needs to perform the operation on a thumbnail map of a screen-casting application of the first terminal device, that is, the user drags a first icon corresponding to the first terminal device to a position of a second icon corresponding to the second terminal device on the thumbnail map, at this time, the first terminal device triggers to generate a screen-casting request, and when the server determines that the screen-casting request is a request triggered by the user dragging the first icon to the position of the second icon on the thumbnail map, the server determines that the user needs to cast display content on a screen of the first terminal device onto the second terminal device for display, so the server can generate second indication information according to the screen-casting request and send the second indication information to the first terminal device, so that the first terminal equipment can perform screen projection operation.

In one implementation, the method further comprises: periodically broadcasting a Bluetooth signal according to a preset time interval; receiving a signal strength indicated value sent by a first terminal device and a signal strength indicated value sent by a second terminal device; determining a first distance between the first terminal equipment and the server based on a signal strength indicated value sent by the first terminal equipment; determining a second distance between the second terminal equipment and the server based on the signal strength indicated value sent by the second terminal equipment; determining first position information based on the first distance, wherein the first position information is used for representing the relative position between the first terminal equipment and the server; determining second position information based on the second distance, wherein the second position information is used for indicating the relative position between the second terminal equipment and the server; and sending the first position information and the second position information to the first terminal equipment.

In the scheme, in order to facilitate the operation of the user at each home, the server may be set in the home of the user, the server may also be referred to as a micro server, and the Beacon device group in the server may periodically broadcast the bluetooth signal according to a preset time interval, so that the first terminal device and the second terminal device (or may further include other intelligent screen devices in the home of the user) may receive the bluetooth signal through a bluetooth module of the device itself and respectively send the RSSI value to the server according to the received bluetooth signal.

In the scheme, the server can determine a first distance between the first terminal device and the server according to the RSSI value sent by the first terminal device, and the server can determine the relative position between the first terminal device and the server according to the first distance; the server can determine a second distance between the second terminal device and the server according to the RSSI value sent by the second terminal device, and the server can determine the relative position between the second terminal device and the server according to the second distance, so that the server contains the position information of all the intelligent screen devices in the family of the user, and can update the position information of the first terminal device and the second terminal device in real time according to the Bluetooth signal.

In the above scheme, after acquiring the first location information of the first terminal device and the second location information of the second terminal device, the server may send the first location information and the second location information to the first terminal device, so that the screen-casting application of the first terminal device may generate the thumbnail map.

In the above solution, fig. 7 is a schematic diagram of an embodiment of the bluetooth gateway positioning processing provided in this application, where the server determines location information of all the intelligent screen devices in a room of a user's home through the bluetooth gateway (Beacon device group), as shown in fig. 7, it may be assumed that the current room is a large opening of 8 × 8 square meters, and a Beacon device is deployed in the room every 2 meters, and the location of each Beacon device may be represented by coordinates, such as (x0, y2), (x0, y3), (x1, y3) in fig. 7, and since the location information of each Beacon device is predetermined and uploaded to the server, when the intelligent screen device is located at any position in the room, it may be ensured that each intelligent screen device has 3 closest Beacon devices through the deployed Beacon device group, and therefore, theoretically, the server may determine the location information of any intelligent screen device in the room through 3 Beacon devices, that is to say, the position information of the intelligent screen device can be obtained according to the positioning data of the nearest 3 Beacon devices.

In the foregoing solution, fig. 8 is a schematic diagram of a second bluetooth gateway positioning processing embodiment provided in this application, and as shown in fig. 8, positions of 3 Beacon devices closest to a target smart band screen device (px, py) are respectively (x0, y0), (x1, y0), (x1, y1), relative distances between the target smart band screen device (px, py) and the above 3 Beacon devices can be obtained through the euler equation, which are respectively D1, D2, and D3, and then the relative position of the target smart band screen device in the whole room can be obtained by weighting an actual distance of the corresponding Beacon device in the room. Therefore, the server includes the relative position information of all the intelligent screen devices in the room.

In the screen projection processing method provided by this embodiment, when a first terminal device is a mobile device, if a user wants to implement screen projection of display content of the first terminal device onto a second terminal device for display, a server may determine, according to mobile operation data, whether a throwing motion of the user is intended to be screen projected, then generate first indication information according to a determination result, and send the first indication information to the first terminal device, so that after the first terminal device receives the first indication information sent by the server, and the first indication information indicates that the display content of the first terminal device can be screen projected onto the second terminal device, the display content on a screen of the first terminal device can be screen projected onto the second terminal device through the first indication information and a screen projection application; when the first terminal device is not a mobile device, if a user wants to implement screen projection of the display content of the first terminal device onto the second terminal device for display, the server can generate second indication information according to the screen projection request and send the second indication information to the first terminal device, so that after the first terminal device receives the second indication information sent by the server, the display content on the screen of the first terminal device can be projected onto the second terminal device through the second indication information and the screen projection application, thereby avoiding complex operation performed on the first terminal device by the user, and achieving the purpose of improving the screen projection efficiency of the user.

Fig. 5 is a flowchart of a third embodiment of a screen projection processing method provided in the embodiment of the present application, and as shown in fig. 5, the screen projection processing method includes the following steps:

s501: the first terminal device determines to be a mobile device.

In this step, the first terminal device may be a mobile device such as a mobile phone.

S502: the first terminal equipment judges whether the user has screen projection behavior.

In this step, if the user has a screen-projecting behavior, the process jumps to step S503, and if the user has no screen-projecting behavior, the scheme ends.

S503: the first terminal equipment sends the mobile operation data corresponding to the screen projection behavior of the user to a server providing screen projection service for the user.

In this scheme, the moving operation data includes moving direction data of the first terminal device.

S504: the server judges whether a second terminal device capable of receiving screen projection content exists in the moving direction of the first terminal device.

In this step, if there is a second terminal device capable of receiving the screen-shot content in the moving direction of the first terminal device, the process jumps to step S505, and if there is no second terminal device capable of receiving the screen-shot content in the moving direction of the first terminal device, the scheme is ended.

S505: and the server retrieves the mobile operation data through the screen-projection operation database of the user.

S506: the server judges whether the mobile operation data can realize the screen projection function started by the first terminal equipment.

In the scheme, if the mobile operation data can realize that the first terminal device starts the screen projection function, the step S507 is skipped to, and if the mobile operation data cannot realize that the first terminal device starts the screen projection function, the scheme is ended.

S507: the first terminal equipment starts a screen projection function, and display content on a screen of the first terminal equipment is projected to the second terminal equipment for display.

S508: and the server records the mobile operation data in the screen projection operation database of the user.

According to the screen projection processing method provided by the embodiment, when a user wants to project the display content on the screen of the mobile equipment such as the mobile phone to other terminal equipment, the user only needs to open the screen projection application in the mobile equipment such as the mobile phone, pick up the mobile equipment such as the mobile phone and throw the mobile equipment towards other terminal equipment, and the display content on the screen of the mobile equipment such as the mobile phone can be projected to other terminal equipment for displaying; when a user wants to realize screen projection of display content on a screen of non-mobile equipment such as a refrigerator to other terminal equipment, a thumbnail map is displayed on an interface of a screen projection application of the non-mobile equipment such as the refrigerator, and then the user drags an icon corresponding to the non-mobile equipment such as the refrigerator to the position of the icon corresponding to the other terminal equipment on the thumbnail map, so that the display content on the screen of the non-mobile equipment such as the refrigerator can be displayed on the other terminal equipment in a screen projection manner.

In summary, according to the technical scheme provided by the application, since the server stores the position information of all indoor terminal devices, the user respectively opens the screen-casting application on the terminal device initiating the screen-casting operation and the terminal device receiving the screen-casting content, and the server can determine whether the corresponding terminal device receiving the screen-casting content can be matched or not only by performing the corresponding screen-casting operation on the terminal device initiating the screen-casting operation, so that the screen-casting operation of the user is realized after the corresponding terminal device receiving the screen-casting content is matched, and the technical implementation method can greatly improve the screen-casting efficiency of the user.

An embodiment of the present application further provides a screen projection processing apparatus, and fig. 9 is a schematic diagram of a first embodiment of the screen projection processing apparatus provided in the embodiment of the present application, and as shown in fig. 9, the screen projection processing apparatus 90 includes:

an obtaining module 91, configured to, if the first terminal device is a mobile device, obtain mobile operation data in response to a mobile operation of a user on the first terminal device, where the mobile operation data includes acceleration data and moving direction data of the first terminal device;

a first sending module 92, configured to send the mobile operation data to a server for providing a screen-casting service for a user through a screen-casting application;

the first receiving module 93 is configured to receive first indication information sent by the server, where the first indication information is generated by the server according to a determination result, the determination result is used to determine whether the mobile operation is a screen-casting operation, the first indication information is used to indicate that, when the mobile operation is the screen-casting operation, display content of the first terminal device is screen-cast on the second terminal device, and, when the mobile operation is not the screen-casting operation, the display content is not screen-cast on the second terminal device;

and a screen projection module 94, configured to, when the first indication information of the user is used to indicate that the display content of the first terminal device is projected onto the second terminal device, project the display content on the screen of the first terminal device onto the second terminal device based on the first indication information and the screen projection application.

Optionally, the apparatus is further configured to start the screen projecting application according to the received start operation of the screen projecting application before the mobile operation data is acquired in response to the mobile operation of the user on the first terminal device.

Optionally, the apparatus is further configured to receive, by the screen-casting application, first location information of the first terminal device and second location information of the second terminal device, where the first location information is used to indicate a relative location between the first terminal device and the server, and the second location information is used to indicate a relative location between the second terminal device and the server; and generating a thumbnail map on an interface of the screen projection application according to the first position information and the second position information, wherein the thumbnail map comprises a first icon corresponding to the first terminal device and a second icon corresponding to the second terminal device, and the thumbnail map is used for determining the relative positions of the first terminal device and the second terminal device.

Optionally, the apparatus is further configured to, if the first terminal device is not a mobile device, respond to a drag operation on the first icon on the screen-casting application interface, move the first icon to a position where the second icon is located; sending a screen projection request to a server, wherein the screen projection request is used for a first terminal device to request to project the display content on the screen to a second terminal device; receiving second indication information sent by the server, wherein the second indication information is used for indicating that the display content of the first terminal equipment is projected to the second terminal equipment; and projecting the display content on the screen of the first terminal equipment to the second terminal equipment based on the second indication information and the screen projecting application.

Optionally, the apparatus is further configured to receive a bluetooth signal sent by a bluetooth gateway of the server; determining a signal strength indicating value of a first terminal device for receiving a Bluetooth signal according to the Bluetooth signal; the signal strength indication value is sent to a server.

Optionally, the obtaining module 91 is further configured to, in response to a moving operation of the first terminal device by the user, obtain moving direction data through a gyroscope of the first terminal device, and obtain acceleration data through an acceleration sensor of the first terminal device.

The screen projection processing apparatus is configured to execute the technical solution of the first terminal device in the foregoing method embodiment, and the implementation principle and technical effect of the screen projection processing apparatus are similar to those in the foregoing method embodiment, and are not described herein again.

An embodiment of the present application further provides a screen projection processing apparatus, and fig. 10 is a schematic diagram of a second embodiment of the screen projection processing apparatus provided in the embodiment of the present application, and as shown in fig. 10, the screen projection processing apparatus 1000 includes:

a second receiving module 1001, configured to receive, if the first terminal device is a mobile device, mobile operation data sent when the first terminal device executes a mobile operation, where the mobile operation data includes acceleration data and moving direction data of the first terminal device;

the first generating module 1002 is configured to determine whether the mobile operation of the first terminal device is a screen-throwing operation according to the mobile operation data, and generate a determination result;

a second generating module 1003, configured to generate first indication information according to the determination result, where the first indication information is used to indicate that the display content of the first terminal device is projected onto the second terminal device when the moving operation is a screen projection operation, and the display content is not projected onto the second terminal device when the moving operation is not a screen projection operation;

a second sending module 1004, configured to send the first indication information to the first terminal device.

Optionally, the apparatus is further configured to receive a screen projection request sent by the first terminal device if the first terminal device is not a mobile device, where the screen projection request is used for the first terminal device to request that the display content on the screen be projected onto the second terminal device; generating second indication information according to the screen projection request, wherein the second indication information is used for indicating that the display content of the first terminal equipment is projected to the second terminal equipment; and sending the second indication information to the first terminal equipment.

Optionally, the first generating module 1002 is further configured to determine whether there is a second terminal device in the moving direction of the first terminal device according to the moving operation data; when a second terminal device exists in the moving direction of the first terminal device, comparing the moving operation data with preset data, and determining whether the moving operation data exists in a preset interval of the preset data; if the mobile operation data exist in a preset interval of the preset data, generating a first result, wherein the first result is used for indicating that the mobile operation of the first terminal equipment is screen projection operation; and if the mobile operation data does not exist in the preset interval of the preset data, generating a second result, wherein the second result is used for indicating that the mobile operation of the first terminal equipment is not screen projection operation.

Optionally, the apparatus is further configured to determine whether the screen-casting request is a request triggered when the first icon is moved to the position of the second icon, where the first icon is an icon corresponding to the first terminal device in the thumbnail map, the second icon is an icon corresponding to the second terminal device in the thumbnail map, and the thumbnail map is used to determine the relative positions of the first terminal device and the second terminal device; and when the screen projection request is a request triggered when the first icon is moved to the position of the second icon, generating second indication information according to the screen projection request.

Optionally, the apparatus is further configured to periodically broadcast the bluetooth signal according to a preset time interval; receiving a signal strength indicated value sent by a first terminal device and a signal strength indicated value sent by a second terminal device; determining a first distance between the first terminal equipment and the server based on a signal strength indicated value sent by the first terminal equipment; determining a second distance between the second terminal equipment and the server based on the signal strength indicated value sent by the second terminal equipment; determining first position information based on the first distance, wherein the first position information is used for representing the relative position between the first terminal equipment and the server; determining second position information based on the second distance, wherein the second position information is used for indicating the relative position between the second terminal equipment and the server; and sending the first position information and the second position information to the first terminal equipment.

The screen projection processing device is used for executing the technical scheme of the server in the method embodiment, and the implementation principle and the technical effect of the screen projection processing device are similar to those in the method embodiment, and are not described again here.

Fig. 11 is a schematic structural diagram of a terminal device provided in an embodiment of the present application, and as shown in fig. 11, the terminal device 1100 includes:

a processor 1111, a memory 1112, a display 1113;

the memory 1111 is used for storing programs and data, and the processor 1112 calls the programs stored in the memory to execute the technical solution of the screen projection processing method of the first terminal device in the foregoing method embodiment.

Alternatively, the memory 1112 may be separate or integrated with the processor 1111.

Alternatively, when the memory 1112 is a separate device from the processor 1111, the terminal device 1100 may further include:

and the bus is used for connecting the devices.

The terminal device is configured to execute the technical scheme of the screen projection processing method of the first terminal device in the foregoing method embodiment, and the implementation principle and technical effect of the terminal device are similar to those in the foregoing method embodiment, which is not described herein again.

Fig. 12 is a schematic structural diagram of a server according to an embodiment of the present application, and as shown in fig. 12, the server 1200 includes:

a processor 1211, a memory 1212, a display 1213;

the memory 1211 is used for storing programs and data, and the processor 1212 calls the programs stored in the memory to execute the technical solution of the screen projection processing method of the server in the foregoing method embodiment.

Optionally, the memory 1212 may be separate or integrated with the processor 1211.

Optionally, when the memory 1212 is a device separate from the processor 1211, the server 1200 may further include:

and the bus is used for connecting the devices.

The terminal device is configured to execute the technical scheme of the screen projection processing method of the server in the foregoing method embodiment, and the implementation principle and technical effect of the terminal device are similar to those in the foregoing method embodiment, and are not described again here.

The embodiment of the application also provides a readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the screen projection processing method provided by the foregoing method embodiment is implemented.

The embodiment of the present application further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the screen projection processing method provided by the foregoing method embodiment is implemented.

Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A screen projection processing method is applied to a first terminal device, and comprises the following steps:

if the first terminal equipment is mobile equipment, responding to the mobile operation of a user on the first terminal equipment, and acquiring mobile operation data, wherein the mobile operation data comprises acceleration data and moving direction data of the first terminal equipment;

sending the mobile operation data to a server for providing screen projection service for a user through a screen projection application;

receiving first indication information sent by the server, wherein the first indication information is generated by the server according to a judgment result, the judgment result is used for determining whether the mobile operation is a screen projection operation, the first indication information is used for indicating that when the mobile operation is the screen projection operation, the display content of the first terminal device is projected to the second terminal device, and when the mobile operation is not the screen projection operation, the display content is not projected to the second terminal device;

and when the first indication information is used for indicating that the display content of the first terminal device is projected to the second terminal device, the display content on the screen of the first terminal device is projected to the second terminal device based on the first indication information and the screen projection application.

2. The method according to claim 1, wherein before the obtaining of the mobile operation data in response to the mobile operation of the first terminal device by the user, the method further comprises:

and starting the screen projection application according to the received starting operation of the screen projection application.

3. The method of claim 2, wherein after the launching of the screen-casting application, the method further comprises:

receiving first position information of the first terminal device and second position information of the second terminal device, which are sent by the server, through the screen-casting application, wherein the first position information is used for representing a relative position between the first terminal device and the server, and the second position information is used for representing a relative position between the second terminal device and the server;

and generating a thumbnail map on an interface of the screen projection application according to the first position information and the second position information, wherein the thumbnail map comprises a first icon corresponding to the first terminal device and a second icon corresponding to the second terminal device, and the thumbnail map is used for determining the relative positions of the first terminal device and the second terminal device.

4. The method of claim 3, further comprising:

if the first terminal device is not a mobile device, responding to the dragging operation of the first icon on the screen-casting application interface, and moving the first icon to the position of the second icon;

sending a screen projection request to the server, wherein the screen projection request is used for the first terminal device to request to send display content on a screen to the second terminal device;

receiving second indication information sent by the server, wherein the second indication information is used for indicating that the display content of the first terminal equipment is projected to the second terminal equipment;

and projecting the display content on the screen of the first terminal equipment to second terminal equipment based on the second indication information and the screen projecting application.

5. The method of claim 1, further comprising:

receiving a Bluetooth signal sent by a Bluetooth gateway of the server;

determining a signal strength indicating value of the Bluetooth signal received by the first terminal equipment according to the Bluetooth signal;

sending the signal strength indication value to the server.

6. The method of claim 1, wherein the obtaining mobile operation data in response to the mobile operation of the first terminal device by the user comprises:

and responding to the movement operation of the user on the first terminal equipment, acquiring the direction data through a gyroscope of the first terminal equipment, and acquiring the acceleration data through an acceleration sensor of the first terminal equipment.

7. A screen projection processing method is applied to a server, and comprises the following steps:

if the first terminal device is a mobile device, receiving mobile operation data sent when the first terminal device executes a mobile operation, wherein the mobile operation data comprises acceleration data and moving direction data of the first terminal device;

judging whether the mobile operation of the first terminal equipment is screen projection operation or not according to the mobile operation data, and generating a judgment result;

generating first indication information according to the judgment result, wherein the first indication information is used for indicating that the display content of the first terminal device is projected to the second terminal device when the mobile operation is a screen projection operation, and the display content is not projected to the second terminal device when the mobile operation is not a screen projection operation;

and sending the first indication information to the first terminal equipment.

8. The method of claim 7, further comprising:

if the first terminal device is not a mobile device, receiving a screen projection request sent by the first terminal device, wherein the screen projection request is used for the first terminal device to request screen projection of display content on a screen to the second terminal device;

generating second indication information according to the screen projection request, wherein the second indication information is used for indicating that the display content of the first terminal device is projected to the second terminal device;

and sending the second indication information to the first terminal equipment.

9. The method according to claim 7, wherein the determining whether the moving operation of the first terminal device is a screen-throwing operation according to the moving operation data and generating a determination result comprises:

determining whether the second terminal equipment exists in the moving direction of the first terminal equipment or not according to the moving operation data;

when the second terminal equipment exists in the moving direction of the first terminal equipment, comparing the mobile operation data with preset data, and determining whether the mobile operation data exists in a preset interval of the preset data;

if the mobile operation data exist in a preset interval of the preset data, generating a first result, wherein the first result is used for indicating that the mobile operation of the first terminal device is screen projection operation;

and if the mobile operation data does not exist in a preset interval of the preset data, generating a second result, wherein the second result is used for indicating that the mobile operation of the first terminal equipment is not screen projection operation.

10. The method of claim 8, wherein the generating the second indication information according to the screen-casting request comprises:

determining whether the screen-casting request is a request triggered when a first icon is moved to the position of a second icon, wherein the first icon is an icon corresponding to the first terminal device in a thumbnail map, the second icon is an icon corresponding to the second terminal device in the thumbnail map, and the thumbnail map is used for determining the relative positions of the first terminal device and the second terminal device;

and when the screen projection request is a request triggered when the first icon is moved to the position of the second icon, generating the second indication information according to the screen projection request.

11. The method of claim 7, further comprising:

periodically broadcasting a Bluetooth signal according to a preset time interval;

receiving a signal strength indicating value sent by the first terminal equipment and a signal strength indicating value sent by the second terminal equipment;

determining a first distance between the first terminal device and the server based on the signal strength indicating value sent by the first terminal device;

determining a second distance between the second terminal device and the server based on the signal strength indicating value sent by the second terminal device;

determining first position information based on the first distance, wherein the first position information is used for representing the relative position between the first terminal equipment and the server;

determining second position information based on the second distance, wherein the second position information is used for representing the relative position between the second terminal equipment and the server;

and sending the first position information and the second position information to the first terminal equipment.

12. A screen projection processing apparatus, comprising:

an obtaining module, configured to, if the first terminal device is a mobile device, obtain mobile operation data in response to a mobile operation of a user on the first terminal device, where the mobile operation data includes acceleration data and moving direction data of the first terminal device;

the first sending module is used for sending the mobile operation data to a server for providing screen projection service for a user through the screen projection application;

a first receiving module, configured to receive first indication information sent by the server, where the first indication information is generated by the server according to a determination result, the determination result is used to determine whether the mobile operation is a screen-casting operation, and the first indication information is used to indicate that, when the mobile operation is the screen-casting operation, display content of the first terminal device is cast on the second terminal device, and, when the mobile operation is not the screen-casting operation, the display content is not cast on the second terminal device;

and the screen projection module is used for projecting the display content on the screen of the first terminal device to the second terminal device based on the first indication information and the screen projection application when the first indication information of the user is used for indicating that the display content of the first terminal device is projected to the second terminal device.

13. A screen projection processing apparatus, comprising:

a second receiving module, configured to receive mobile operation data sent by a first terminal device if the first terminal device is a mobile device, where the mobile operation data includes acceleration data and moving direction data of the first terminal device;

the first generation module is used for judging whether the mobile operation of the first terminal equipment is screen projection operation according to the mobile operation data and generating a judgment result;

a second generating module, configured to generate first indication information according to the determination result, where the first indication information is used to indicate that, when the moving operation is a screen-casting operation, the display content of the first terminal device is cast on the second terminal device, and when the moving operation is not a screen-casting operation, the display content is not cast on the second terminal device;

and the second sending module is used for sending the first indication information to the first terminal equipment.

14. A terminal device, comprising:

a processor, a memory, a display;

the memory is used for storing programs and data, and the processor calls the programs stored in the memory to execute the screen projection processing method of any one of claims 1 to 6.

15. A server, comprising:

a processor, a memory, a display;

the memory is used for storing programs and data, and the processor calls the programs stored in the memory to execute the screen projection processing method of any one of claims 7 to 11.

16. A computer-readable storage medium on which a computer program is stored, the computer program, when being executed by a processor, implementing the screen projection processing method according to any one of claims 1 to 11.

17. A computer program product comprising a computer program which, when executed by a processor, is adapted to implement the screen projection processing method of any one of claims 1 to 11.