WO2020216156A1

WO2020216156A1 - Screen projection method and computing device

Info

Publication number: WO2020216156A1
Application number: PCT/CN2020/085499
Authority: WO
Inventors: 徐致欣; 许浩维; 周明; 王同波
Original assignee: 华为技术有限公司
Priority date: 2019-04-26
Filing date: 2020-04-20
Publication date: 2020-10-29
Also published as: CN111061445A

Abstract

Disclosed are a screen projection method and a computing device. The method comprises: detecting, by means of a first electronic device, a touch control object suspended on a screen of the first electronic device (S401); determining whether the touch control object meets a response condition, wherein the response condition comprises the distance between the touch control object and the screen of the first electronic device meeting a distance condition (S402); determining the position of the touch control object on the screen of the first electronic device (S403); and in response to determining that the touch control object meets the response condition, projecting, onto a second electronic device, information of the above-mentioned position and the content to be projected, so as to trigger the second electronic device to display the content to be projected, and to indicate a projection point of the above-mentioned position (S404). Therefore, when a user looks up at the second electronic device, the user can determine the position of the touch control object on the screen of the first electronic device by means of the projection point on the second electronic device, and at this point, if the user needs to manipulate the screen projection content, the user can accurately carry out an operation on the first electronic device on the basis of the above-mentioned position without lowering the head to check the screen of the first electronic device, such that use is convenient, and the user experience is improved.

Description

Screen projection method and computing device

This application claims the priority of a Chinese patent application filed with the State Intellectual Property Office of China with application number 201910345141.X on April 26, 2019, and a Chinese patent application with the title of “a method and device for screen projection interaction” Priority, the priority of the Chinese patent application filed with the State Intellectual Property Office of China, the application number is 201911076649.0, the priority of the Chinese patent application with the title of the invention "Screen projection method and computing equipment", all of which are submitted on November 6, 2019 The content is incorporated in this application by reference.

Technical field

This application relates to the field of communication technology, and in particular to a screen projection method and computing device.

Background technique

With the continuous development of communication technology, electronic devices such as mobile phones have gradually become an indispensable part of people's daily lives. Taking mobile phones as an example, the functions of mobile phones are becoming more and more diversified to meet people's increasing application needs. When the user is operating the mobile phone, looking down at the mobile phone screen for a long time causes great pressure on the neck, and because the mobile phone screen is small, the user's eyesight is affected, and it is difficult to share with friends.

In order to solve the above-mentioned problems, the video, picture and/or audio content on the mobile phone is usually projected to other electronic devices, such as televisions, projectors and other electronic devices through projection devices. Utilizing the projection function of the projection device, users can more conveniently display the content in the mobile phone on other electronic devices, and provide users with a better viewing experience.

However, in the above-mentioned projection method, after the corresponding content is projected, when the user looks up at other electronic devices, the visual range is limited to the other electronic devices. At this time, if the user needs to operate the projected content, he still needs to lower his head to The mobile phone is inconvenient to use and the user experience is poor.

Summary of the invention

This application provides a screen projection method and computing device to solve the problem that after the content on the mobile phone is projected to other electronic devices, when the user looks up at other electronic devices, the visual range is limited to the other electronic devices. To operate the screen content, you still need to lower your head to operate the mobile phone screen, which is inconvenient to use and poor user experience.

In a first aspect, the present application provides a screen projection method. The first electronic device detects a touch object hovering on the screen of the first electronic device to determine whether the touch object meets a response condition, wherein the response condition includes touch The distance between the object and the screen of the first electronic device meets the preset distance condition, the position of the touch object on the screen of the first electronic device is determined, and in response to determining that the touch object meets the response condition, the information of the position and the waiting The projected content is projected onto the second electronic device to trigger the second electronic device to display the above-mentioned content to be projected and the projection point indicating the above-mentioned location, so that the user can use the projected screen when looking up at the second electronic device. At the projection point on the second electronic device, determine the position of the touch object on the screen of the first electronic device. At this time, if the user needs to operate the projected content, he can set it on the first electronic device based on the determined position. Perform corresponding operations accurately without looking down at the screen of the first electronic device, which is convenient to use and improves user experience.

A possible design, the projection of the location information and the content to be projected onto the second electronic device includes:

Projecting the location information and the content to be projected onto the second electronic device through a 60GHz wireless communication spectrum.

Among them, the wireless transmission speed of the 60GHz wireless communication spectrum is much higher than that of Bluetooth technology. The 60GHz wireless communication spectrum is used for file transmission and data synchronization between devices to reduce information transmission delay.

A possible design is that after the said location information and the content to be projected are projected onto the second electronic device, the method further includes:

Acquiring the touch operation of the touch object on the screen of the first electronic device;

The new content to be cast corresponding to the response result of the touch operation is determined, and the new content to be cast is projected to the second electronic device for display.

Here, after the information of the aforementioned location and the content to be projected are projected on the second electronic device, the second electronic device displays the content to be projected and the projection point indicating the aforementioned location. If the user needs to perform corresponding operations, The position of the touch object is determined by the above-mentioned projection point, so that based on the position, a corresponding touch operation is performed on the screen of the first electronic device without looking down at the screen of the first electronic device, which is convenient to use.

A possible design, before the projection of the location information and the content to be projected onto the second electronic device, further includes:

Compression processing is performed on the location information and the content to be projected.

Among them, by compressing the above-mentioned location information and the content to be projected, the amount of storage required to represent the original content to be projected is reduced, facilitating the transmission and storage of data.

In a possible design, the response condition further includes: the time that the touch object is suspended on the screen of the first electronic device is greater than a time threshold.

Here, by setting the time threshold, the subsequent operation is performed only when the time that the touch object is suspended on the screen of the first electronic device is greater than the time threshold, which reduces the probability of false touch and is suitable for practical applications.

In a possible design, the screen of the first electronic device includes a self-capacitance touch sensor.

Specifically, the screen of the first electronic device adopts a self-capacitance touch sensor to implement touch technology, where the self-capacitance touch sensor can implement floating touch on the touch screen to meet the application requirements of floating touch.

In the second aspect, this application provides another screen projection method, including:

Start the target game application;

Turn on the 60GHz wireless communication spectrum;

Search for the screen projection device, and establish a screen projection connection with the searched second electronic device;

Activate the floating touch function to detect the touch object floating on the screen of the first electronic device;

Determining whether the touch object meets a response condition, where the response condition includes that the distance between the touch object and the screen of the first electronic device meets a preset distance condition;

Determining the position of the touch object on the screen of the first electronic device;

In response to determining that the touch object meets the response condition, compressing the location information and the content to be cast on the screen, wherein the content to be cast on the screen is determined according to the target game application;

Project the processed location information and the content to be projected onto the second electronic device through the 60GHz wireless communication spectrum to trigger the second electronic device to display the content to be projected and indicate the location Projection point

In a third aspect, this application provides a screen projection device, which includes:

The detection module is used to detect the touch object suspended on the screen of the first electronic device;

A judging module, configured to judge whether the touch object meets a response condition, and the response condition includes that the distance between the touch object and the screen of the first electronic device meets a preset distance condition;

A determining module, configured to determine the position of the touch object on the screen of the first electronic device;

The projection module is configured to, in response to determining that the touch object meets the response condition, project the location information and the content to be projected onto the second electronic device to trigger the second electronic device to display the The content to be projected, and the projection point indicating the location.

A possible design, the projection module is specifically used for:

In a possible design, after the screen projection module projects the location information and the content to be screened onto the second electronic device, it is also used to:

A possible design, further comprising a compression module, used to screen the location information and the content to be projected on the second electronic device before the projection module projects the location information and the The content to be projected is compressed.

In a fourth aspect, this application provides another screen projection device, which includes:

The startup module is used to start the target game application;

Turn on the module to turn on the 60GHz wireless communication spectrum;

The search module is used to search for screen projection devices and establish a screen projection connection with the searched second electronic device;

The detection module is used to activate the floating touch function and detect the touch object floating on the screen of the first electronic device;

The compression module is configured to compress the location information and the content to be cast on the screen in response to determining that the touch object meets the response condition, wherein the content to be cast on the screen is determined according to the target game application;

The projection module is used to project the processed location information and the content to be projected onto the second electronic device through the 60GHz wireless communication spectrum to trigger the second electronic device to display the content to be projected , And the projection point indicating the position; acquire the touch operation of the touch object on the screen of the first electronic device; determine the new content to be projected corresponding to the response result of the touch operation, and change the The new content to be projected is projected to the second electronic device for display.

In a fifth aspect, the present application provides a computing device, which includes a processor and a memory. The memory stores computer instructions; the processor executes the computer instructions stored in the memory, so that the computing device executes the foregoing first aspect or the methods provided by various possible designs of the first aspect, so that the computing device deploys the foregoing third aspect or the first aspect. The three possible designs provide the projection device.

In a sixth aspect, the present application provides a computing device, which includes a processor and a memory. The memory stores computer instructions; the processor executes the computer instructions stored in the memory, so that the computing device executes the method provided in the above second aspect, so that the computing device deploys the screen projection device provided in the above fourth aspect.

In a seventh aspect, the present application provides a computer-readable storage medium having computer instructions stored in the computer-readable storage medium, and the computer instructions instruct the computing device to execute the foregoing first aspect or various possible designs provided by the first aspect. The method or the computer instruction instructs the computing device to deploy the aforementioned third aspect or various possible designs of the third aspect to provide the screen projection device.

In an eighth aspect, the present application provides a computer-readable storage medium having computer instructions stored in the computer-readable storage medium, the computer instructions instructing the computing device to perform the method provided in the second aspect, or the computer instructions instructing the calculation The fourth aspect of equipment deployment provides the projection device.

In a ninth aspect, the present application provides a computer program product, which includes computer instructions, when the computer program product runs on an electronic device, the electronic device is made to perform the first aspect or various possibilities of the first aspect. The method provided by the design allows the electronic device to deploy the above-mentioned third aspect or various possible designs of the third aspect to provide the screen projection device.

In a tenth aspect, the present application provides a computer program product, the computer program product including computer instructions, when the computer program product runs on an electronic device, the electronic device is caused to execute the method provided in the second aspect, so that the electronic device The above-mentioned fourth aspect is deployed to provide the projection device.

Description of the drawings

FIG. 1 is a schematic diagram of the architecture of a screen projection system provided by an embodiment of the application;

FIG. 2 is a schematic structural diagram of a first electronic device provided by an embodiment of the application;

FIG. 3 is a schematic diagram of an application scenario provided by an embodiment of the application;

4 is a schematic flowchart of a screen projection method provided by an embodiment of the application;

FIG. 5 is a schematic flowchart of another screen projection method provided by an embodiment of the application;

FIG. 6 is a schematic diagram of touch points on the screen of an electronic device according to an embodiment of the application;

FIG. 7 is a schematic flowchart of another screen projection method provided by an embodiment of the application;

FIG. 8 is a schematic structural diagram of a screen projection device provided by this application;

FIG. 9 is a schematic structural diagram of another screen projection device provided by this application;

FIG. 10 is a schematic structural diagram of still another screen projection device provided by this application;

FIG. 11 is a schematic diagram of the basic hardware architecture of a computing device provided by this application;

FIG. 12 is a schematic diagram of the basic hardware architecture of another computing device provided by this application.

Detailed ways

The network architecture and business scenarios described in the embodiments of this application are intended to more clearly illustrate the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. Those of ordinary skill in the art will know that with the network With the evolution of architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are equally applicable to similar technical problems.

Hereinafter, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as implying or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, the features defined with “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the embodiments of the present application, unless otherwise specified, “multiple” The meaning is two or more.

The screen projection referred to in this application refers to the transmission of content (such as audio, video, picture, text, etc.) on an electronic device to another electronic device for presentation, achieving the effect of simultaneously displaying the same content among multiple electronic devices. The projections involved in this application may include wired projections and wireless projections. The wired projections can establish connections between multiple electronic devices through a high definition multimedia interface (HDMI), and transmit media through HDMI transmission lines data. Wireless projection can establish a connection between multiple electronic devices through the Miracast protocol, and transmit media data through WIFI.

The projection system of the present application includes at least two electronic devices and one projection port, where the projection port may include a wired port and/or a wireless port. The wired port can be HDMI; the wireless port can be an application programming interface (API). As shown in FIG. 1, FIG. 1 is a schematic structural diagram of a screen projection system provided by an embodiment of the present application. As shown in FIG. 1, the projection system includes a first electronic device 100, a second electronic device 200, a first wired port 101, a first wireless port 102, a second wired port 201, and a second wireless port 202.

Among them, the first wired port 101 and the first wireless port 102 may be integrated on the first electronic device 100 or may exist independently of the first electronic device 100. In the same way, the second wired port 201 and the second wireless port 202 may be integrated on the second electronic device 200, or may exist independently of the second electronic device 200, which is not limited in the embodiment of the present application.

The first electronic device 100 and the second electronic device 200 can establish a screen projection connection through the aforementioned ports. Among them, the first electronic device 100 has at least a screen projection capability. The second electronic device 100 has at least a projection screen receiving capability, an image display capability, and a sound output capability.

Here, the first electronic device 100 may be an electronic device such as a mobile phone, a tablet computer, a personal digital assistant (PDA) or a desktop computer. The second electronic device 200 may be an electronic device such as a TV, a tablet computer, or a desktop computer.

In some feasible implementation manners, the screen projection method of the present application can be applied to the first electronic device 100. The first electronic device 100 detects a touch object suspended on the screen of the first electronic device to determine whether the touch object meets a response condition, where the response condition includes that the distance between the touch object and the touch screen of the first electronic device meets a preset To determine the position of the touch object on the screen of the first electronic device, and in response to determining that the touch object meets the response condition, project the above-mentioned position information and the content to be projected onto the second electronic device 200, The second electronic device 200 is triggered to display the above-mentioned content to be projected and the projection point indicating the above-mentioned position, thereby enabling the user to use the above-mentioned projection on the second electronic device 200 when looking up at the second electronic device 200. Click to determine the position of the touch object on the screen of the first electronic device 100. At this time, if the user needs to operate the projected content, he can accurately perform the corresponding operation on the first electronic device 100 based on the determined position. Look down at the screen of the first electronic device, which is easy to use and improves user experience.

For ease of understanding, the structure of the first electronic device 100 provided in the embodiments of the present application will be illustrated below. Refer to FIG. 2, which is a schematic structural diagram of a first electronic device according to an embodiment of the present application.

As shown in FIG. 2, the first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, and a power management module 141, Battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 171, receiver 172, microphone 173, earphone interface 174, sensor module 180, button 190, motor 191, indicator 192, Camera 193, display screen 194, subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the first electronic device 100. In other feasible implementation manners of the present application, the first electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components, specifically Determined according to the actual application scenario, there is no restriction here. The components shown in Figure 2 can be implemented in hardware, software, or a combination of software and hardware.

Optionally, the foregoing processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, and a memory. Video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Among them, the different processing units may be independent devices or integrated in one or more processors.

Wherein, the controller may be the nerve center and command center of the first electronic device 100. The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions. The digital signal processor DSP is used to process digital signals. In addition to digital image signals, it can also process other digital signals. Video codecs are used to compress or decompress digital video. The first electronic device 100 may support one or more video codecs. In this way, the first electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on. NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, for example, the transfer mode between human brain neurons, it can quickly process input information and can continuously learn by itself. Through the NPU, applications such as intelligent cognition of the first electronic device 100 can be realized, such as: image recognition, face recognition, voice recognition, text understanding, etc.

A memory may also be provided in the processor 110 to store instructions and data. The instructions stored in the memory are used by the first electronic device 100 to execute the screen projection method in the embodiment of the present application. In some feasible implementation manners of the present application, the data stored in the memory may include media data, and the media data may be audio and video data. In some feasible implementation manners, the memory in the processor 110 is a cache memory. The memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the aforementioned memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

In some feasible implementation manners, the processor 110 may include one or more interfaces. Interfaces may include integrated circuit (I2C) interfaces, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interfaces, pulse code modulation (PCM) interfaces, universal asynchronous receivers /transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and/or Universal serial bus (USB) interface, etc.

It can be understood that the interface connection relationship between the modules illustrated in the embodiment of the present application is merely illustrative and does not constitute a structural limitation of the first electronic device 100. In other feasible implementation manners of the present application, the first electronic device 100 may also adopt different interface connection manners in the above-mentioned embodiments, or a combination of multiple interface connection manners.

The charging management module 140 is configured to receive charging input from the charger and charge the power management module 141 of the first electronic device 100. Among them, the charger can be a wireless charger or a wired charger.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

The wireless communication function of the first electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.

In some feasible implementation manners, the first electronic device 100 may use wireless communication functions to communicate with other devices. For example, the first electronic device 100 can communicate with the second electronic device 200, the first electronic device 100 establishes a projection connection with the second electronic device 200, and the first electronic device 100 outputs projection data to the second electronic device 200 and so on. The projection data output by the first electronic device 100 may be audio and video data, pictures, text, and so on.

The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the first electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other feasible embodiments, the antenna can be used in combination with a tuning switch.

The mobile communication module 150 may provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the first electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform processing such as filtering, amplifying and transmitting the received electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation via the antenna 1. In some feasible implementation manners, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110. In some feasible implementation manners, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 171, a receiver 172, etc.), or displays an image or video through the display screen 194. In some feasible implementation manners, the modem processor may be an independent device. In other feasible implementation manners, the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the first electronic device 100, including wireless local area networks (WLAN) such as Wi-Fi networks, Bluetooth (bluetooth, BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, perform frequency modulation, amplify it, and convert it into electromagnetic wave radiation via the antenna 2.

In some feasible implementations, the antenna 1 of the first electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the first electronic device 100 can communicate with the network and other devices (for example, The second electronic device 200, etc.) communicate. Wireless communication technologies can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), and broadband code division multiple access. (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/ Or IR technology, etc. The aforementioned GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), and quasi-zenith satellite system (quasi-zenith). satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).

The first electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode). , AMOLED), flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc. In some feasible implementation manners, the first electronic device 100 may include one or N display screens 194, and N is a positive integer greater than one.

In some feasible implementations, the display screen 194 may be used to display various interfaces output by the system of the first electronic device 100. For each interface output by the first electronic device 100, reference may be made to related descriptions in subsequent embodiments.

The first electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

The ISP is used to process the data fed back from the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transfers the above-mentioned electrical signal to the ISP for processing, which is converted into an image visible to the naked eye. ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some feasible implementation manners, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. ISP outputs digital image signals to DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats. In some feasible implementation manners, the first electronic device 100 may include 1 or N cameras 193, and N is a positive integer greater than 1. In some feasible implementation manners, the camera 193 is used to obtain a real image of the user.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the first electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.

The internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the first electronic device 100 by running instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. Among them, the storage program area can store an operating system, at least one application program (such as a sound playback function, an image playback function, etc.) required by at least one function. The data storage area can store data (such as audio data, etc.) created during the use of the first electronic device 100. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.

The first electronic device 100 can implement audio functions through the audio module 170, the speaker 171, the receiver 172, the microphone 173, the earphone interface 174, and the application processor. For example, music playback, recording, etc. In some feasible implementation manners, the audio module 170 may be used to play the sound corresponding to the video. For example, when the display screen 194 displays a video playback screen, the audio module 170 outputs the sound of the video playback.

The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The speaker 171, also called "speaker", is used to convert audio electrical signals into sound signals. The receiver 172, also called "earpiece", is used to convert audio electrical signals into sound signals. The microphone 173, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. The earphone interface 174 is used to connect wired earphones. The earphone interface 174 may be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, and a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some feasible embodiments, the pressure sensor may be provided on the display screen 194. The gyroscope sensor may be used to determine the movement posture of the first electronic device 100. The air pressure sensor is used to measure air pressure. The acceleration sensor can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three-axis). Distance sensor, used to measure distance. The ambient light sensor is used to sense the brightness of the ambient light. The fingerprint sensor is used to collect fingerprints. The temperature sensor is used to detect temperature. Touch sensor, also called "touch panel". The touch sensor may be provided on the display screen 194, and the touch screen is composed of the touch sensor and the display screen 194, which is also called a “touch screen”. The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. The visual output related to the touch operation can be provided through the display screen 194. In other feasible implementation manners, the touch sensor 180K may also be disposed on the surface of the first electronic device 100, which is different from the position of the display screen 194.

The button 190 includes a power button, a volume button, and so on. The button 190 may be a mechanical button or a touch button. The motor 191 can generate vibration prompts. The indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, or to indicate messages, missed calls, notifications, and so on.

The SIM card interface 195 is used to connect to the SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the first electronic device 100. In some feasible implementation manners, the first electronic device 100 adopts an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the first electronic device 100 and cannot be separated from the first electronic device 100.

At present, by using the projection function of the projection screen device, users can display content from electronic devices such as mobile phones on electronic devices such as TVs, providing users with a better viewing experience. However, after using this projection method to project the corresponding content, when the user looks up to watch TV, the visual range is limited to the TV. At this time, if the user needs to operate the projected content, he still needs to lower his head to perform the corresponding operation on the phone. Inconvenient to use and poor user experience.

Therefore, in order to solve the above-mentioned problem, an embodiment of the present application provides a screen projection method in which the first electronic device detects a touch object suspended on the screen of the first electronic device to determine whether the touch object meets the response condition, wherein: The response condition includes that the distance between the touch object and the screen of the first electronic device meets a preset distance condition, the position of the touch object on the screen of the first electronic device is determined, and in response to determining that the touch object meets the response condition, the The location information and the content to be projected are projected onto the second electronic device to trigger the second electronic device to display the content to be projected and the projection point indicating the location, thereby enabling the user to look up at the second electronic device. In the case of equipment, the position of the touch object on the screen of the first electronic device is determined by the projection point of the projection on the second electronic device. At this time, if the user needs to operate the projected content, it can be based on the determined position Corresponding operations are performed accurately on the first electronic device without looking down at the screen of the first electronic device, which is convenient to use and improves user experience.

Fig. 3 is a schematic diagram of a possible application scenario of an embodiment of the present application.

Here, take a user playing a game on a mobile phone and casting a screen on the TV as an example. The user's finger is suspended on the mobile phone screen. After the mobile phone detects the user's finger, it is judged that the distance between the user's finger and the mobile phone screen is within the preset distance range. (For example, 1mm～50mm, this preset distance range is preset and can be other values). If within the preset range, according to the position of the user’s finger, the projection point corresponding to the position is displayed on the mobile phone screen, or only the projection point corresponding to the position is determined but the projection point is not displayed on the mobile phone screen (according to the projection mode Different, the mobile phone can display the same content as on the big screen, can also display different content, and can also not display on the mobile phone but only display on the big screen, etc. This is the prior art and will not be repeated here). The location information and the content to be projected are projected onto the TV display screen to trigger the display screen to display the content to be projected and the projection point corresponding to the location information. Wherein, the information of this location may be only the location coordinates, or it may be location + indication information. For only the position coordinates, after the TV receives it, it needs to determine the position and determine the display information indicating the position, and display the visual element indicating the position at the determined position. For example, the TV determines the corresponding on its display screen according to the position coordinates. Position, and determine and display visual elements according to their own preset display strategy. For example, visual elements such as cursors, arrows, circles, etc. are displayed at the corresponding positions, so that the user can intuitively understand that there is a touch object floating on the position. For location + indication information, the TV only needs to parse the information, determine the location and visual elements contained in the information, and display it accordingly. The mobile phone can also acquire the touch operation of the user's finger on the screen of the mobile phone, perform a response operation corresponding to the touch operation, and project the execution result on the TV to trigger the TV to display the above execution result. For example, when a user uses a mobile phone to play a game and the screen is projected to a TV scene, as shown in Figure 3, the user controls the game on the TV display on the mobile phone. When the user hoveres his finger on the mobile phone screen, Can see a cursor indicating the position of the finger, so that the user can accurately know whether the position of his finger is the position he wants without looking down at the phone, and can make adjustments and decisions quickly.

It should be understood that the above-mentioned FIG. 3 only takes the user playing a game on a mobile phone as an example, and shows a screencasting scene of a mobile phone game. In essence, there are many other screencasting scenes, and any screencasting scene is within the scope of this application.

The following uses several embodiments as examples to describe the technical solutions of the present application, and the same or similar concepts or processes may not be repeated in some embodiments.

FIG. 4 is a schematic flowchart of a method for projecting a screen according to an embodiment of this application. The execution subject of this embodiment may be the first electronic device 100 in the embodiment shown in FIG. 2. As shown in FIG. 4, the method may include :

S401: Detect a touch object suspended on the screen of the first electronic device.

The touch object is an object located above the screen of the first electronic device, such as a user's finger, a conductive object, and so on.

Optionally, the screen of the first electronic device includes at least a self-capacitance touch sensor, and may further include a mutual-capacitance touch sensor. Among them, mutual capacitance can realize direct contact touch, and self-capacitance can realize floating touch on the touch screen to meet application requirements in different scenarios.

Exemplarily, before the first electronic device detects the touch object hovering on the screen of the first electronic device, the method further includes: receiving a hover touch activation instruction, and activate the hover touch function through self-capacitance according to the instruction. Further, the first electronic device can sense touch objects within a certain range above the screen of the first electronic device through the hover touch function, and then perform subsequent operations based on the sensed touch objects.

In addition, before detecting the touch object, it also includes:

Receiving a start instruction, the start instruction carrying a target identifier;

Start the corresponding target according to the target identifier.

Among them, the target identifier can be information capable of identifying the target identity, such as the target name and code. The first electronic device receives the start instruction, and starts the corresponding target according to the target identifier in the instruction. Taking the first electronic device as a mobile phone as an example, the user can send a start instruction to the mobile phone. The start instruction carries a target identifier. The mobile phone receives the start instruction and starts the corresponding target according to the target identifier.

Exemplarily, multiple applications may be installed in the first electronic device, such as game applications, video applications, and social applications. Among them, the game application can be used for users to play games, the video application can be used for users to watch videos, live broadcasts, novels and/or comics, etc., and the social application can be used for users to conduct video chats, voice chats, and/or text chats. Specifically, the game application, the video application, and the social application may be pre-installed when the first electronic device leaves the factory, or may be installed by the user after downloading. The game application may be a game application (application, APP) developed by a manufacturer of the first electronic device, or a game APP developed by a third-party manufacturer. Similarly, the video application may be a video application developed by a manufacturer of the first electronic device, or a video APP developed by a third-party manufacturer. The social application may be a social APP developed by a manufacturer of the first electronic device, or a social APP developed by a third-party manufacturer.

Here, the aforementioned target can be any of the aforementioned applications (such as a game APP). When the first electronic device receives a certain application start instruction, it starts the corresponding application according to the target identifier in the start instruction, and after the corresponding application is started, the corresponding content is projected to the second electronic device for display, thereby realizing the first Multi-screen interaction between the electronic device and the second electronic device, and the display content can be shared simultaneously on different platforms or devices, enriching the multimedia life of the user.

Specifically, after the first electronic device starts any of the above-mentioned applications (such as game APP), the user can search or select the content he wants in the main interface of the application, and the first electronic device can search the cloud platform for the user’s The information entered in the search bar, and the icon of the searched content is displayed. After the user selects the desired content, he can click the icon of the content to enter the corresponding interface. The application of the first electronic device obtains the resource of the content selected by the user from the cloud platform.

S402: Determine whether the touch object meets a response condition, where the response condition includes that the distance between the touch object and the screen of the first electronic device meets a preset distance condition.

Among them, the response condition can be set according to the actual situation. Here, it is set to determine that the distance between the touch object and the screen of the first electronic device meets a preset distance condition. The above-mentioned preset distance condition can be set according to actual conditions, for example, 1mm-50mm. This preset distance range is preset and can be other values to meet different requirements of various application scenarios.

Optionally, the response condition further includes: the time that the touch object is suspended on the screen of the first electronic device is greater than a time threshold.

S403: Determine the position of the touch object on the screen of the first electronic device.

Here, the action of determining the position of the touch object on the screen of the first electronic device may occur before, after, or at the same time when determining whether the touch object meets the response condition. Specifically, it can be determined according to actual application scenarios.

S404: In response to determining that the touch object satisfies the response condition, project the position information and the content to be projected onto the second electronic device to trigger the second electronic device to display the content to be projected , And the projection point indicating the location.

Wherein, the above-mentioned position information may be only position coordinates, or position+indication information. For only the location coordinates, after receiving the second electronic device, it needs to determine the location and determine the display information indicating the location, and display the visual element indicating the location at the determined location. For example, the second electronic device determines the location based on the location coordinates. The corresponding position on the display screen, and according to its own preset display strategy, determine and display the visual elements, for example, display the cursor, arrow, circle and other visual elements at the corresponding position, so that the user can intuitively understand that there is a touch on the position Suspended on it. For the location + indication information, the second electronic device only needs to analyze the information, determine the location and visual elements contained in the information, and display the information accordingly.

Here, the above-mentioned content to be projected may be displayed on the first electronic device, or may not be displayed on the first electronic device. Specifically, it can be determined according to actual application scenarios. For example, taking the user in FIG. 3 playing a game on a mobile phone as an example, the content to be cast is displayed on both the first electronic device and the second electronic device.

If the above-mentioned touch object does not meet the above-mentioned response conditions, the first electronic device can output alarm information, which carries the above-mentioned response conditions, so that the user can make corresponding adjustments in time according to the above-mentioned alarm information, and then realize subsequent screen projection operations.

Here, before the location information and the content to be projected are projected on the second electronic device, it further includes:

It is detected whether the first electronic device has established a screen projection connection currently.

When the first electronic device detects that the screen projection connection is not currently established, the first electronic device searches for the screen projection device, displays the searched screen projection device, prompts the user to select the screen projection device, receives the screen projection device selected by the user, and sends the user The selected screen projection device is determined to be the second electronic device, and a screen projection connection is established with the second electronic device.

Exemplarily, when the first electronic device detects that the screen projection connection is not currently established, the first electronic device searches for one or more screen projection devices connected to it. Among them, the screen projection device involved in the embodiment of the present application is an electronic device with projection/reception capability. When one or more screen projection devices are found, the first electronic device displays a search box connected to the screen projection. After the user selects the device to be screened, the first electronic device establishes a screen-casting connection with the device selected by the user. For example, if the screen projection device selected by the user is a TV in the living room, the first electronic device establishes a screen projection connection with the TV in the living room.

Further, after the screen projection connection is established between the first electronic device and the second electronic device, the second electronic device may return a screen projection connection response. Wherein, during the process of establishing a projection connection between the first electronic device and the second electronic device, the first electronic device and the second electronic device will exchange and negotiate performance parameters, that is, the first electronic device can obtain the image on the second electronic device Size parameters, data format parameters that the second electronic device can receive, and so on.

Optionally, after the screen projection connection between the first electronic device and the second electronic device is established, if the user needs to replace the screen projection device, the user can also send a screen projection device replacement request to the first electronic device, and the request carries the screen projection device identifier. After receiving the above request, the first electronic device can first query the searched screen projection device for the screen projection device corresponding to the screen projection device identification carried in the above request, and if it is found, compare the above second electronic device identification with the above request Whether the carried screen projection device IDs are the same, if they are different, a new second electronic device is determined according to the screen projection device ID carried in the above request, and the subsequent steps are performed to meet the needs of replacing the screen projection device in actual applications.

In addition, before the projection of the location information and the content to be projected onto the second electronic device, the method further includes:

Here, by compressing the above-mentioned location information and the content to be projected, the amount of storage required to represent the original content to be projected is reduced, facilitating the transmission and storage of data.

Exemplarily, if the content to be projected is a video, video compression technology may be used to compress the content to be projected. Among them, the video compression technology can include: MPEG1, MPEG2, etc. If the content to be projected is audio, audio compression technology can be used to compress the content to be projected. Among them, audio compression technology can include: MP3, WMA, etc. If the content to be projected is a picture, image compression technology can be used to compress the content to be projected. Among them, the image compression technology may include: transform coding, entropy coding and so on.

Specifically, the projecting the location information and the content to be projected onto the second electronic device includes:

Among them, the 60GHz wireless communication spectrum can realize the transmission of wireless high-definition audio and video signals, bringing more complete high-definition video solutions for multimedia applications. Here, the above-mentioned location information and the content to be projected are projected to the second electronic device through the 60GHz wireless communication spectrum, which can bring the experience of wireless transmission with low latency (compared to wired transmission) and meet the requirements of high latency. Applications, such as those that meet high latency requirements such as game projection.

Exemplarily, before the above-mentioned projection of the location information and the content to be projected onto the second electronic device through the 60 GHz wireless communication spectrum, the method further includes:

It is detected whether a communication establishment request is received, for example, the user's finger slides down on the main interface of the first electronic device. When the first electronic device detects the above operation on the main interface, it is determined that the communication establishment request is received, and the communication is displayed. Management interface, which can include mobile data icons, 60GHz wireless communication spectrum icons, wifi icons, etc. The user clicks the 60GHz wireless communication spectrum icon on the above interface, and the first electronic device starts the 60GHz wireless communication spectrum projection function. The first electronic device automatically searches for screen projection devices connected to the 60GHz wireless communication spectrum through the 60GHz wireless communication spectrum (representing electronic devices with projection/reception capabilities). The first electronic device displays the searched screen projection device on the above interface to prompt the user to select a screen projection device from the searched screen projection device to establish a screen projection connection. After the user selects the projection device that the user wants to project, the first electronic device establishes a projection connection with the projection device selected by the user. In other feasible implementation manners, the user can also activate the 60GHz wireless communication spectrum projection function of the first electronic device by setting an icon on the main interface of the first electronic device.

In some feasible implementations, after the first electronic device projects the above-mentioned location information and the content to be projected on the second electronic device, the user can control the content to be projected on the second electronic device through the remote control of the second electronic device. Play on the second electronic device. Exemplarily, if the user presses the pause key on the remote control of the second electronic device, the second electronic device sends a pause playback instruction to the first electronic device. When the first electronic device receives the playback pause instruction, the first electronic device pauses the playback of the content to be projected. At the same time, the first electronic device will suspend the transmission of the above-mentioned location information and the content to be projected, and the second electronic device will also pause the playback because there is no content to be projected. If the user presses the play key on the remote control of the second electronic device, the second electronic device sends a continue playing instruction to the first electronic device. When the first electronic device receives the instruction to continue playing, the first electronic device continues to play from the current playback progress of the content to be projected, and the first electronic device continues to transmit the above-mentioned location information and the content to be projected, so the second The electronic device continues to play the content to be cast when it receives it.

In this embodiment, after determining that the touch object suspended on the screen of the first electronic device satisfies the response condition, the first electronic device projects the position information of the touch object and the content to be projected onto the second electronic device , The second electronic device displays the content to be projected on the screen and the projection point indicating the position, so that when the user looks up at the second electronic device, the projection point on the second electronic device can be used to determine the touch The position of the control object on the screen of the first electronic device. At this time, if the user needs to operate the projected content, he can accurately perform the corresponding operation on the first electronic device based on the determined position above, without looking down on the screen of the first electronic device , Easy to use and improve user experience.

In addition, this embodiment can also perform touch operations based on the projection point displayed on the second electronic device. FIG. 5 is a schematic flowchart of another screen projection method proposed in an embodiment of this application. The execution subject of this embodiment may be the first electronic device 100 in the embodiment shown in FIG. 2. As shown in FIG. 5, the method may include:

S501: Detect a touch object suspended on the screen of the first electronic device.

S502: Determine whether the touch object meets a response condition, where the response condition includes that the distance between the touch object and the screen of the first electronic device meets a preset distance condition.

S503: Determine the position of the touch object on the screen of the first electronic device.

S504: In response to determining that the touch object satisfies the response condition, project the position information and the content to be projected onto the second electronic device to trigger the second electronic device to display the content to be projected , And the projection point indicating the location.

Wherein, steps S501-S504 are implemented in the same manner as the foregoing steps S401-S404, and will not be repeated here.

S505: Acquire a touch operation of the touch object on the screen of the first electronic device.

Here, it can be seen from the above that the screen of the first electronic device includes a mutual capacitance touch sensor, the mutual capacitance can realize direct contact touch, and the first electronic device can obtain the touch operation of the touch object on the screen of the first electronic device based on the mutual capacitance.

In addition, the screen of the first electronic device includes a self-capacitance touch sensor, and the self-capacitance can realize floating touch on the touch screen. The first electronic device can also acquire the floating touch operation of the touch object on the screen of the first electronic device. Where the user performs a hovering touch operation on the screen of the first electronic device, a capacitance change corresponding to the hovering touch operation will be generated on the screen of the first electronic device. Specifically, the floating touch operation will affect the capacitance arrays in the horizontal electrodes and the vertical electrodes of the screen of the first electronic device, so that the capacitance in the screen of the first electronic device changes.

Exemplarily, when there is only one point on the screen of the first electronic device that changes the capacitance of the horizontal electrode and the vertical electrode, the above floating touch operation is a single-point touch. That is, during single-point touch, only the capacitance of one touch point changes. When there are multiple points on the screen of the first electronic device that generate changes in the capacitance of the horizontal electrodes and the vertical electrodes, the above floating touch operation is a multi-point touch. That is, during multi-touch, the capacitance of multiple touch points will change. As shown in FIG. 6, the touch point array is arranged on the horizontal electrodes and the vertical electrodes of the screen of the first electronic device. When the floating touch operation triggers the touch point 21 on the screen of the first electronic device, the capacitance on the horizontal and vertical coordinates of the corresponding touch point 21 changes. When the hovering touch operation triggers the touch point 22 on the screen of the first electronic device, the capacitance corresponding to the horizontal and vertical coordinates of the touch point 22 changes.

S506: Determine the new content to be projected corresponding to the response result of the touch operation, and project the new content to be projected on the second electronic device for display.

Optionally, before the new content to be projected on the screen is displayed on the second electronic device, the new content to be projected can also be compressed to reduce the amount of storage required to represent the original content , Improve the efficiency of data transmission and storage.

Optionally, before projecting the new content to be projected onto the second electronic device for display, it may include:

Projecting the new content to be projected onto the second electronic device through the 60 GHz wireless communication spectrum. That is, file transmission and data synchronization between devices are performed through the 60GHz wireless communication spectrum, which reduces the delay of information transmission.

In addition, the first electronic device may also preset the corresponding relationship between the touch operation and the response result before determining the new content to be projected corresponding to the response result of the touch operation.

Here, the correspondence relationship may not be a one-to-one correspondence relationship. For example, for different interfaces, the same touch operation may correspond to different response results. Exemplarily, for a certain touch operation, the response result corresponding to the short message sending interface is sending a short message, and the corresponding response result on the phone answering interface is answering the phone.

Specifically, according to the above-mentioned touch operation and the currently displayed interface, and the corresponding relationship between the above-mentioned preset touch operation and the response result, the corresponding response result is determined, and the new screen to be projected corresponding to the response result of the above-mentioned touch operation is determined. content. If in the above-mentioned corresponding relationship, the response result corresponding to the above-mentioned touch operation and the currently displayed interface is not found, a corresponding prompt may be generated, such as a response failure prompt, so that the user can view and process in time.

In addition, before determining the new content to be screened corresponding to the response result of the touch operation, the first electronic device may also preset and set the correspondence between the movement track of the touch operation and the response result. That is, each movement track corresponds to a response result. Exemplarily, the response result corresponding to the movement trajectory from top to bottom is to move the interface up and down, and the response result corresponding to the movement trajectory from front to back is to enlarge the interface.

Specifically, according to the movement trajectory of the aforementioned touch operation, and the corresponding relationship between the movement trajectory of the aforementioned touch operation and the response result preset, the corresponding response result is determined, and then the new pending cast corresponding to the response result of the aforementioned touch operation is determined. Screen content. Similarly, if the response result corresponding to the movement track of the touch operation is not found in the above corresponding relationship, a corresponding prompt can be generated to prompt the user to deal with it in time.

In this embodiment, after determining that the touch object meets the response condition, the first electronic device projects the position of the touch object and the content to be cast onto the second electronic device to trigger the second electronic device to display the The content of the screen and the projection point indicating the above position, therefore, when the user looks up at the second electronic device, the location of the touch object can be determined by the projection point on the second electronic device when the user looks up. To operate the projected content, the projected content can be accurately operated on the first electronic device based on the aforementioned projection points and touch objects, without looking down at the screen of the first electronic device, which is convenient to use and improves user experience.

In addition, this embodiment also proposes another screen projection method. Specifically, as shown in FIG. 7, FIG. 7 is a schematic flowchart of another screen projection method proposed in an embodiment of this application. The execution subject of this embodiment may be the first electronic device 100 in the embodiment shown in FIG. 2. As shown in Figure 7, the method may include:

S701: Start the target game application.

Among them, the target game application is any one or more game applications. Exemplarily, the first electronic device receives a start instruction, the start instruction carries a game identifier, and the corresponding game application is started according to the game identifier.

S702: Turn on the 60GHz wireless communication spectrum.

Here, the aforementioned target game application may be started after the 60 GHz wireless communication spectrum is started, and the specific time to start the target game application may be determined according to actual conditions.

S703: Search for the screen projection device, and establish a screen projection connection with the searched second electronic device.

Specifically, the first electronic device activates the 60GHz wireless communication spectrum projection function. The first electronic device automatically searches for screen projection devices connected to the 60 GHz wireless communication spectrum through the 60 GHz wireless communication spectrum. The first electronic device displays the searched screen projection device on the above interface to prompt the user to select a screen projection device from the searched screen projection device to establish a screen projection connection. After the user selects the projection device that the user wants to project, the first electronic device establishes a projection connection with the projection device selected by the user.

S704: Activate the floating touch function to detect the touch object floating on the screen of the first electronic device.

In the embodiment of the present application, the screen of the first electronic device includes a self-capacitance touch sensor, where the self-capacitance can realize floating touch on the touch screen.

Here, the first electronic device may receive a hovering touch activation instruction, and activate the hovering touch function through self-capacitance according to the instruction, and then sense the touch object within a certain range above the screen of the first electronic device through the hovering touch function. Perform subsequent operations based on the sensed touch object.

S705: Determine whether the aforementioned touch object meets a response condition, where the response condition includes that the distance between the touch object and the screen of the first electronic device meets a preset distance condition.

S706: Determine the position of the touch object on the screen of the first electronic device.

Here, the action of determining the position of the touch object on the screen of the first electronic device may occur before, after, or at the same time when determining whether the touch object meets the response condition.

S707: In response to determining that the touch object meets the response condition, compress the information of the position and the content to be projected.

Wherein, the aforementioned content to be cast can be determined according to the aforementioned launched game application.

S708: Project the processed location information and the content to be projected onto the second electronic device through the 60GHz wireless communication spectrum to trigger the second electronic device to display the content to be projected and the projection point indicating the location.

Specifically, the second electronic device receives the compressed content to be screened, decompresses the content, and displays the decompressed content.

S709: Acquire the touch operation of the touch object on the screen of the first electronic device.

Here, the screen of the first electronic device includes a mutual capacitance touch sensor, the mutual capacitance can realize direct contact touch, and the first electronic device can acquire the touch operation of the touch object on the screen of the first electronic device based on the mutual capacitance.

S710: Determine the new content to be projected corresponding to the response result of the touch operation, and project the new content to be projected on the second electronic device for display.

In this embodiment, the first electronic device projects the position information of the touch object suspended on the screen of the first electronic device and the content to be projected onto the second electronic device, triggering the second electronic device to display the aforementioned screen to be projected The first electronic device obtains the touch operation of the touch object on the screen of the first electronic device, determines the new content to be projected corresponding to the response result of the touch operation, and sets the new The projected content is projected to the second electronic device for display, so that when the user looks up at the second electronic device, if he needs to operate the projected content, he does not need to look down at the screen of the first electronic device. Based on the above projection points and touch The object can accurately perform corresponding operations on the projected content on the first electronic device, which is convenient to use and improves user experience.

FIG. 8 is a schematic structural diagram of a screen projection device provided by this application. The device includes: a detection module 801, a judgment module 802, a determination module 803, and a screen projection module 804.

Wherein, the detection module 801 is used to detect the touch object suspended on the screen of the first electronic device.

The determining module 802 is configured to determine whether the touch object meets a response condition, and the response condition includes that the distance between the touch object and the screen of the first electronic device meets a preset distance condition.

The determining module 803 is configured to determine the position of the touch object on the screen of the first electronic device.

The projection module 804 is configured to, in response to determining that the touch object meets the response condition, project the position information and the content to be projected onto the second electronic device to trigger the second electronic device to display the Describe the content to be projected, and the projection point indicating the location.

The device in this embodiment can correspondingly be used to execute the technical solutions in the foregoing method embodiments, and its implementation principles and technical effects are similar, and will not be repeated here.

FIG. 9 is a schematic structural diagram of another screen projection device provided by this application. As shown in FIG. 9, this embodiment further includes a compression module 805 based on the embodiment in FIG. 8.

Optionally, the screen projection module 804 is specifically used for:

Projecting the location information and the content to be projected onto the second electronic device through a 60 GHz wireless communication spectrum.

Optionally, after the projection module 804 projects the location information and the content to be projected onto the second electronic device, it is further used to:

Optionally, the compression module 805 is configured to: before the projection module 804 projects the location information and the content to be projected onto the second electronic device, the location information and all the information The content to be projected is compressed.

Optionally, the screen of the first electronic device includes a self-capacitance touch sensor.

FIG. 10 is a schematic structural diagram of another screen projection device provided by this application. The device includes: an activation module 1001, an activation module 1002, a search module 1003, a detection module 1004, a judgment module 1005, a determination module 1006, a compression module 1007, and a projection module. Screen module 1008.

Among them, the start module 1001 is used to start the target game application.

The activation module 1002 is used to activate the 60 GHz wireless communication spectrum.

The search module 1003 is used to search for screen projection devices and establish a screen projection connection with the searched second electronic device.

The detection module 1004 is used to activate the floating touch function and detect the touch object suspended on the screen of the first electronic device.

The determining module 1005 is configured to determine whether the touch object meets a response condition, and the response condition includes that the distance between the touch object and the screen of the first electronic device meets a preset distance condition.

The determining module 1006 is used to determine the position of the touch object on the screen of the first electronic device.

The compression module 1007 is configured to, in response to determining that the touch object satisfies the response condition, compress the location information and the content to be cast, wherein the content to be cast is determined according to the target game application.

The projection module 1008 is used to project the processed location information and the content to be projected onto the second electronic device through the 60GHz wireless communication spectrum, so as to trigger the second electronic device to display the to-be-projected screen Content, and the projection point indicating the location; acquire the touch operation of the touch object on the screen of the first electronic device; determine the new content to be projected corresponding to the response result of the touch operation, The new content to be screened is screened and displayed on the second electronic device.

Optionally, FIG. 11 schematically provides a possible basic hardware architecture of the computing device described in this application.

Referring to FIG. 11, the computing device 1100 includes a processor 1101, a memory 1102, a communication interface 1103, and a bus 1104.

The computing device 1100 may be a computer or a server, which is not particularly limited in this application. In the computing device 1100, the number of processors 1101 may be one or more, and FIG. 11 only illustrates one of the processors 1101. Optionally, the processor 1101 may be a central processing unit (CPU). If the computing device 1100 has multiple processors 1101, the types of the multiple processors 1101 may be different or may be the same. Optionally, multiple processors 1101 of the computing device 1100 may also be integrated into a multi-core processor.

The memory 1102 stores computer instructions and data; the memory 1102 can store computer instructions and data required to implement the screen projection method provided in the present application. For example, the memory 1102 stores instructions for implementing the steps of the screen projection method. The memory 1102 may be any one or any combination of the following storage media: non-volatile memory (for example, read only memory (ROM), solid state drive (SSD), hard disk (HDD), optical disk)), volatile memory.

The communication interface 1103 may be any one or any combination of the following devices: a network interface (for example, an Ethernet interface), a wireless network card, and other devices with a network access function.

The communication interface 1103 is used for data communication between the computing device 1100 and other computing devices or electronic devices.

FIG. 11 shows the bus 1104 with a thick line. The bus 1104 may connect the processor 1101 with the memory 1102 and the communication interface 1103. In this way, through the bus 1104, the processor 1101 can access the memory 1102, and can also use the communication interface 1103 to interact with other computing devices or electronic devices.

In this application, the computing device 1100 executes computer instructions in the memory 1102, so that the computing device 1100 implements the screen projection method provided in FIG. 4 or FIG. 5 of this application, or causes the computing device 1100 to deploy the screen projection device provided in FIG. 8 or FIG. 9 .

In addition, the screen projection device provided in FIG. 8 or FIG. 9 can be implemented by software as shown in FIG. 11, and can also be implemented as a hardware module or as a circuit unit through hardware.

Optionally, FIG. 12 schematically provides a possible basic hardware architecture of the computing device described in this application.

Referring to FIG. 12, the computing device 1200 includes a processor 1201, a memory 1202, a communication interface 1203, and a bus 1204.

The computing device 1200 may be a computer or a server, which is not particularly limited in this application. In the computing device 1200, the number of processors 1201 may be one or more, and FIG. 12 only illustrates one of the processors 1201. Optionally, the processor 1201 may be a central processing unit. If the computing device 1200 has multiple processors 1201, the types of the multiple processors 1201 may be different or may be the same. Optionally, multiple processors 1201 of the computing device 1200 may also be integrated into a multi-core processor.

The memory 1202 stores computer instructions and data; the memory 1202 can store computer instructions and data required to implement the screen projection method provided in the present application. For example, the memory 1202 stores instructions for implementing the steps of the screen projection method. The memory 1202 may be any one or any combination of the following storage media: non-volatile memory (for example, read-only memory, solid-state hard disk, hard disk, optical disk), and volatile memory.

The communication interface 1203 may be any one or any combination of the following devices: a network interface (for example, an Ethernet interface), a wireless network card, and other devices with a network access function.

The communication interface 1203 is used for data communication between the computing device 1200 and other computing devices or electronic devices.

FIG. 12 shows the bus 1204 with a thick line. The bus 1204 may connect the processor 1201 with the memory 1202 and the communication interface 1203. In this way, through the bus 1204, the processor 1201 can access the memory 1202, and can also use the communication interface 1203 to interact with other computing devices or electronic devices.

In this application, the computing device 1200 executes computer instructions in the memory 1202 to enable the computing device 1200 to implement the screen projection method provided in FIG. 7 of this application, or to cause the computing device 1200 to deploy the screen projection device provided in FIG. 10.

In addition, the screen projection device provided in FIG. 10 can be implemented as a hardware module or as a circuit unit in addition to being implemented by software as in the above-mentioned FIG. 12, and implemented by hardware.

The present application also provides a computer-readable storage medium. The computer program product includes computer instructions, and the computer instructions instruct a computing device to execute the screen projection method provided in FIG. 4 or FIG. 5 of this application.

The present application also provides a computer-readable storage medium. The computer program product includes computer instructions, and the computer instructions instruct a computing device to execute the screen projection method provided in FIG. 7 of the present application.

This application also provides a computer program product containing instructions, which when the computer program product runs on an electronic device, causes the electronic device to execute the screen projection method provided in FIG. 4 or FIG. 5 of this application.

This application also provides a computer program product containing instructions, which when the computer program product runs on an electronic device, causes the electronic device to execute the screen projection method provided in FIG. 7 of this application.

In the several embodiments provided in this application, it should be understood that the disclosed device and method may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware, or may be implemented in the form of hardware plus software functional units.

Claims

A screen projection method, characterized in that it comprises:

Detecting a touch object suspended on the screen of the first electronic device;

Determining whether the touch object meets a response condition, where the response condition includes that the distance between the touch object and the screen of the first electronic device meets a preset distance condition;

Determining the position of the touch object on the screen of the first electronic device;

In response to determining that the touch object satisfies the response condition, project the position information and the content to be projected onto the second electronic device to trigger the second electronic device to display the content to be projected, and Indicates the projection point of the location.
The method according to claim 1, wherein the projecting the location information and the content to be projected onto the second electronic device comprises:

Projecting the location information and the content to be projected onto the second electronic device through a 60GHz wireless communication spectrum.
The method according to claim 1 or 2, characterized in that, after the projection of the location information and the content to be projected onto the second electronic device, the method further comprises:

Acquiring the touch operation of the touch object on the screen of the first electronic device;

The new content to be cast corresponding to the response result of the touch operation is determined, and the new content to be cast is projected to the second electronic device for display.
The method according to any one of claims 1 to 3, characterized in that, before the projection of the location information and the content to be projected onto the second electronic device, the method further comprises:

Compression processing is performed on the location information and the content to be projected.
The method according to any one of claims 1 to 4, wherein the response condition further comprises: the time that the touch object is suspended on the screen of the first electronic device is greater than a time threshold.
The method according to any one of claims 1 to 5, wherein the screen of the first electronic device includes a self-capacitance touch sensor.
A screen projection method, characterized in that it comprises:

Start the target game application;

Turn on the 60GHz wireless communication spectrum;

Search for the screen projection device, and establish a screen projection connection with the searched second electronic device;

Activate the floating touch function to detect the touch object floating on the screen of the first electronic device;

Determining whether the touch object meets a response condition, where the response condition includes that the distance between the touch object and the screen of the first electronic device meets a preset distance condition;

Determining the position of the touch object on the screen of the first electronic device;

In response to determining that the touch object meets the response condition, compressing the location information and the content to be cast on the screen, wherein the content to be cast on the screen is determined according to the target game application;

Project the processed location information and the content to be projected onto the second electronic device through the 60GHz wireless communication spectrum to trigger the second electronic device to display the content to be projected and indicate the location The projection point;

Acquiring the touch operation of the touch object on the screen of the first electronic device;

The new content to be cast corresponding to the response result of the touch operation is determined, and the new content to be cast is projected to the second electronic device for display.
A computing device, characterized by comprising a processor and a memory;

The memory is used to store computer instructions;

The processor is configured to execute computer instructions stored in the memory, so that the computing device executes:

Detecting a touch object suspended on the screen of the first electronic device;

Determining whether the touch object meets a response condition, where the response condition includes that the distance between the touch object and the screen of the first electronic device meets a preset distance condition;

Determining the position of the touch object on the screen of the first electronic device;

In response to determining that the touch object satisfies the response condition, project the position information and the content to be projected onto the second electronic device to trigger the second electronic device to display the content to be projected, and Indicates the projection point of the location.
The computing device according to claim 8, wherein the projecting the location information and the content to be projected onto the second electronic device comprises:

Projecting the location information and the content to be projected onto the second electronic device through a 60GHz wireless communication spectrum.
The computing device according to claim 8 or 9, characterized in that, after the projection of the location information and the content to be projected onto the second electronic device, the method further comprises:

Acquiring the touch operation of the touch object on the screen of the first electronic device;

The new content to be cast corresponding to the response result of the touch operation is determined, and the new content to be cast is projected to the second electronic device for display.
The computing device according to any one of claims 8 to 10, wherein before the projection of the location information and the content to be projected on the second electronic device, the method further comprises:

Compression processing is performed on the location information and the content to be projected.
The computing device according to any one of claims 8 to 11, wherein the response condition further comprises: the time that the touch object is suspended on the screen of the first electronic device is greater than a time threshold.
The computing device according to any one of claims 8 to 12, wherein the screen of the first electronic device comprises a self-capacitance touch sensor.
A computing device, characterized by comprising a processor and a memory;

The memory is used to store computer instructions;

The processor is configured to execute computer instructions stored in the memory, so that the computing device executes:

Start the target game application;

Turn on the 60GHz wireless communication spectrum;

Search for the screen projection device, and establish a screen projection connection with the searched second electronic device;

Activate the floating touch function to detect the touch object floating on the screen of the first electronic device;

Determining whether the touch object meets a response condition, where the response condition includes that the distance between the touch object and the screen of the first electronic device meets a preset distance condition;

Determining the position of the touch object on the screen of the first electronic device;

In response to determining that the touch object meets the response condition, compressing the location information and the content to be cast on the screen, wherein the content to be cast on the screen is determined according to the target game application;

Project the processed location information and the content to be projected onto the second electronic device through the 60GHz wireless communication spectrum to trigger the second electronic device to display the content to be projected and indicate the location The projection point;

Acquiring the touch operation of the touch object on the screen of the first electronic device;

The new content to be cast corresponding to the response result of the touch operation is determined, and the new content to be cast is projected to the second electronic device for display.
A computer-readable storage medium, wherein the computer program product includes computer instructions, and the computer instructions instruct a computing device to execute the screen projection method according to any one of claims 1 to 6.
A computer-readable storage medium, wherein the computer program product includes computer instructions, and the computer instructions instruct a computing device to execute the screen projection method of claim 7.
A computer program product containing instructions, wherein when the computer program product runs on an electronic device, the electronic device is caused to execute the method according to any one of claims 1 to 6.
A computer program product containing instructions, characterized in that when the computer program product runs on an electronic device, the electronic device is caused to execute the method according to claim 7.