CN116736968A - Gesture-based screen sharing method and device, electronic equipment and storage medium - Google Patents

Gesture-based screen sharing method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN116736968A
CN116736968A CN202210197695.1A CN202210197695A CN116736968A CN 116736968 A CN116736968 A CN 116736968A CN 202210197695 A CN202210197695 A CN 202210197695A CN 116736968 A CN116736968 A CN 116736968A
Authority
CN
China
Prior art keywords
screen
throwing
equipment
target
communication channel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210197695.1A
Other languages
Chinese (zh)
Inventor
许经国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Rockwell Technology Co Ltd
Original Assignee
Beijing Rockwell Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Rockwell Technology Co Ltd filed Critical Beijing Rockwell Technology Co Ltd
Priority to CN202210197695.1A priority Critical patent/CN116736968A/en
Publication of CN116736968A publication Critical patent/CN116736968A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W8/00—Network data management
    • H04W8/005—Discovery of network devices, e.g. terminals

Abstract

The disclosure relates to a gesture-based screen sharing method, a gesture-based screen sharing device, an electronic device and a storage medium, wherein the gesture-based screen sharing method comprises the following steps: responding to a first gesture instruction of a target object, determining at least one receiving device which can be used for screen casting of the screen casting device, and displaying the at least one receiving device on the screen casting device, wherein the screen casting device is used for providing data information to be screen casting; in response to a second gesture instruction of the target object, determining target receiving equipment from at least one receiving equipment displayed by the screen throwing equipment, wherein the target receiving equipment is used for receiving data information to be thrown, provided by the screen throwing equipment; and sending the data information to be projected to the target receiving equipment, so that the data information to be projected of the screen projecting equipment is shared to the target receiving equipment based on gesture operation, the interaction of screen sharing is more convenient, and the use experience of a user is improved.

Description

Gesture-based screen sharing method and device, electronic equipment and storage medium
Technical Field
The disclosure relates to the technical field of intelligent control, in particular to a gesture-based screen sharing method, a gesture-based screen sharing device, electronic equipment and a storage medium.
Background
With the development of screen projection technology, the screen projection technology is widely applied to daily life, and people can send the screen images of mobile phones and computers which are currently used to other devices (such as remote computers and large screens) for display through the screen projection technology.
However, the conventional screen-throwing devices in the current market have some defects, for example, the conventional screen-throwing scheme is complicated to operate, a user needs to click a screen-throwing button first, then wait for a period of time to search for the device, click on the target device, and then wait for the target device to be successfully connected to throw the screen, so that the conventional scheme cannot meet the screen-throwing requirement of the user for more convenience.
In view of the above problems, no effective solution has been proposed at present.
Disclosure of Invention
In order to solve the technical problems or at least partially solve the technical problems, the disclosure provides a gesture-based screen sharing method, device electronic equipment and storage medium, which realize that screen data information to be screened of a screen-screening device is shared to target receiving equipment based on gesture operation, so that interaction of screen sharing is more convenient, and use experience of a user is improved.
In a first aspect, an embodiment of the present disclosure provides a gesture-based screen sharing method, including:
responding to a first gesture instruction of a target object, determining at least one receiving device which can be used for screen casting of a screen casting device, and displaying the at least one receiving device on the screen casting device, wherein the screen casting device is used for providing data information to be screen cast;
in response to a second gesture instruction of the target object, determining target receiving equipment from at least one receiving equipment displayed by the screen throwing equipment, wherein the target receiving equipment is used for receiving data information to be thrown, provided by the screen throwing equipment;
and sending the data information to be screened to the target receiving equipment.
Optionally, the determining, in response to the second gesture instruction of the target object, the target receiving device from at least one receiving device displayed by the screen projection device includes:
and responding to a second gesture instruction of the target object, and determining a target receiving device from at least one receiving device displayed by the screen projection device based on the position information of the second gesture instruction.
Optionally, before the sending the to-be-screened data information to the target receiving device, the method further includes:
establishing a communication channel between the screen throwing device and the target receiving device;
the sending the to-be-screen data information to the target receiving device includes:
and based on the communication channel, sending the data information to be screened to the target receiving equipment.
Optionally, the establishing a communication channel between the screen projection device and the target receiving device includes:
controlling a wireless communication module of the screen throwing device to establish a connection communication channel with the target receiving device;
and establishing a screen-throwing communication channel between the screen-throwing equipment and the target receiving equipment based on the connection communication channel.
Optionally, the establishing a screen-projection communication channel between the screen-projection device and the target receiving device based on the connection communication channel includes:
controlling the screen throwing device to send a screen throwing communication channel connection request to the target receiving device based on the connection communication channel, wherein the target receiving device is used for authenticating the screen throwing communication channel connection request after receiving the screen throwing communication channel connection request, and returning an authentication passing indication to the screen throwing device after the screen throwing communication channel connection request passes the authentication;
and after receiving the authentication passing indication, the screen-throwing equipment establishes a screen-throwing communication channel between the screen-throwing equipment and the target receiving equipment.
Optionally, the sending the to-be-screened data information to the target receiving device based on the communication channel includes:
the screen throwing equipment is controlled to encode the data information to be thrown to obtain encoded data;
and transmitting the encoded data to target receiving equipment based on the communication channel, wherein the target receiving equipment is used for receiving the encoded data of the screen projection equipment and decoding the encoded data to obtain a screen projection picture.
Optionally, the determining, in response to the first gesture instruction of the target object, at least one receiving device that can be projected by the projection device, and displaying the at least one receiving device on the projection device includes:
when a first gesture instruction of a target object is acquired and the state time of maintaining the first gesture instruction is longer than or equal to the preset state time, at least one receiving device capable of being used for screen projection in the screen projection device is determined in response to the first gesture instruction of the target object, and the at least one receiving device is displayed in the screen projection device.
In a second aspect, an embodiment of the present disclosure provides a gesture-based screen sharing device, including:
the display module is used for responding to a first gesture instruction of a target object, determining at least one receiving device which can be used for screen casting of the screen casting device, and displaying the at least one receiving device on the screen casting device, wherein the screen casting device is used for providing data information to be screen cast;
the target receiving equipment determining module is used for responding to gesture operation of a target object, and determining target receiving equipment from at least one receiving equipment displayed by the screen throwing equipment, wherein the target receiving equipment is used for receiving data information to be thrown, provided by the screen throwing equipment;
and the sending module is used for sending the data information to be screened to the target receiving equipment.
In a third aspect, an embodiment of the present disclosure provides an electronic device, including:
one or more processors;
storage means for storing one or more programs,
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of any of the first aspects.
In a fourth aspect, embodiments of the present disclosure provide a computer storage medium having stored thereon a computer program which, when executed by a processor, implements a method according to any of the first aspects.
Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages:
the gesture-based screen sharing method, device, electronic equipment and storage medium provided by the embodiment of the disclosure are used for responding to a first gesture instruction of a target object, determining at least one receiving equipment capable of being used for screen casting of a screen casting device, and displaying the at least one receiving equipment on the screen casting device, wherein the screen casting device is used for providing data information to be screen cast; in response to a second gesture instruction of the target object, determining target receiving equipment from at least one receiving equipment displayed by the screen throwing equipment, wherein the target receiving equipment is used for receiving data information to be thrown, provided by the screen throwing equipment; the method comprises the steps of sending data information to be screened to target receiving equipment, namely after a first gesture instruction of a target object is received, determining at least one receiving equipment capable of screening by the screening equipment based on the first gesture instruction, determining the target receiving equipment from at least one receiving equipment displayed by the screening equipment based on a second gesture instruction of the target object, and sending the data information to be screened to the target receiving equipment, so that the data information to be screened of the screening equipment is shared to the target receiving equipment based on gesture operation, screen sharing interaction is more convenient, and user experience is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.
In order to more clearly illustrate the embodiments of the present disclosure or the solutions in the prior art, the drawings that are required for the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
Fig. 1 is a flowchart of a gesture-based screen sharing method according to an embodiment of the present disclosure;
FIG. 2 is a flowchart of another gesture-based screen sharing method provided by an embodiment of the present disclosure;
FIG. 3 is a flowchart of another gesture-based screen sharing method according to an embodiment of the present disclosure;
FIG. 4 is a flowchart of another gesture-based screen sharing method provided by an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a gesture-based screen sharing device according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
Detailed Description
In order that the above objects, features and advantages of the present disclosure may be more clearly understood, a further description of aspects of the present disclosure will be provided below. It should be noted that, without conflict, the embodiments of the present disclosure and features in the embodiments may be combined with each other.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced otherwise than as described herein; it will be apparent that the embodiments in the specification are only some, but not all, embodiments of the disclosure.
Based on the problems existing in the prior art, an embodiment of the present disclosure provides a gesture-based screen sharing method, including: responding to a first gesture instruction of a target object, determining at least one receiving device which can be used for screen casting of the screen casting device, and displaying the at least one receiving device on the screen casting device, wherein the screen casting device is used for providing data information to be screen casting; in response to a second gesture instruction of the target object, determining target receiving equipment from at least one receiving equipment displayed by the screen throwing equipment, wherein the target receiving equipment is used for receiving data information to be thrown, provided by the screen throwing equipment; the method comprises the steps of sending data information to be screened to target receiving equipment, namely after a first gesture instruction of a target object is received, determining at least one receiving equipment capable of screening by the screening equipment based on the first gesture instruction, determining the target receiving equipment from at least one receiving equipment displayed by the screening equipment based on a second gesture instruction of the target object, and sending the data information to be screened to the target receiving equipment, so that the data information to be screened of the screening equipment is shared to the target receiving equipment based on gesture operation, screen sharing interaction is more convenient, and user experience is improved.
The gesture-based screen sharing method is executed by a server of the screen throwing device. The screen-throwing device may be a tablet computer, a mobile phone, a wearable, a vehicle-mounted, an augmented reality (augmented reality, AR)/Virtual Reality (VR), a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (personal digital assistant, PDA), a smart television, a smart screen, a high definition television, a 4K television, a smart speaker, a smart projector, etc., and the present disclosure does not impose any limitation on the specific type of screen-throwing device.
The type of the operating system of the screen throwing device is not limited in the disclosure. For example, an Android system, a Linux system, a Windows system, an iOS system, and the like.
The technical scheme of the present disclosure will be described in detail with several specific embodiments.
Fig. 1 is a flow chart of a gesture-based screen sharing method provided in the present disclosure, as shown in fig. 1, the method in this embodiment is as follows:
s10, responding to a first gesture instruction of a target object, determining at least one receiving device which can be used for screen casting by the screen casting device, and displaying the at least one receiving device on the screen casting device.
The screen throwing equipment is used for providing data information to be thrown.
Specifically, the first gesture instruction may be an open or open palm, or may be a gesture of the instruction number, an OK gesture, or the like, which is not specifically limited in the embodiments of the present disclosure.
The target object may be a user performing screen sharing on the screen capturing device, when the target object is a user performing screen sharing, the user displays the first gesture instruction in the area that can be acquired by the screen capturing device, at this time, the screen capturing device acquires the first gesture instruction, and determines at least one receiving device that can capture the screen by the screen capturing device after acquiring the first gesture instruction.
It should be noted that, the screen-throwing device may collect the first gesture instruction based on the optical module, and an example of the optical module may be a camera, and collect gesture instruction information of the target object based on the optical module of the screen-throwing device, and when the collected gesture instruction information of the user is the first gesture instruction, at least one receiving device that can be thrown by the screen-throwing device is displayed on the screen-throwing device.
In the technical scheme disclosed by the embodiment, the first gesture instruction can be obtained by performing image processing analysis on the user image acquired by the camera; after the image acquired by the camera is acquired, the acquired image is identified, when the hand is identified, the acquired image can be judged to be the hand image, and whether the hand image is the first gesture instruction is determined by carrying out secondary image identification on the hand image; or when the hand is identified, determining an image area where the hand is located, intercepting the image area where the hand is located in the acquired image for secondary image identification, and determining whether the image area is the first gesture instruction.
It can be understood that, in order to facilitate gesture recognition, binarization processing may be performed on the hand image, and whether gesture information of the user is a first gesture instruction may be determined according to the hand outline obtained after the binarization processing.
In addition, the specific process of determining at least one receiving device that the screen-throwing device can throw the screen is that if the screen-throwing device and the receiving device access the same wireless access point (WAP, wireless Access Point), then it is determined that the receiving device can receive the data information to be thrown provided by the screen-throwing device, and in an exemplary P2P scene, if the screen-throwing device does GO (Group operator), the receiving device does GC (Group Client) access or other connection modes, then it is determined that the receiving device can receive the data information to be thrown provided by the screen-throwing device;
it should be noted that, the above embodiment exemplarily represents at least one receiving device that determines that the screen throwing device may throw the screen after the screen throwing device and the receiving device access the same wireless access point, and in other embodiments, in addition, if the screen throwing device and the receiving device are in the same local area network, for example, the screen throwing device and the receiving device access the same local area network through wireless or wired, at this time, the receiving device in the same local area network through wired or wireless access may be used as the receiving device that may throw the screen of the screen throwing device of the local area network.
And S20, responding to a second gesture instruction of the target object, and determining the target receiving device from at least one receiving device displayed by the screen throwing device.
The target receiving device is used for receiving the to-be-screen-projected data information provided by the screen projection device.
Specifically, the second gesture instruction includes a gesture instruction different from the first gesture instruction, such as a palm fist-making movement, a palm opening movement, and the like, and may also include a gesture instruction which is the same as or similar to the first gesture instruction but occurs with a time difference, for example, a repeated OK gesture.
When at least one receiving device which can be used for screen throwing of the screen throwing device is displayed on the screen throwing device, at the moment, the optical module of the screen throwing device continuously collects gesture instructions of the target object, and the server of the screen throwing device determines the target receiving device from the at least one receiving device displayed by the screen throwing device based on the gesture instructions collected by the optical module of the screen throwing device.
Optionally, in response to a second gesture instruction of the target object, determining the target receiving device from at least one receiving device displayed by the screen projection device, including:
in response to a second gesture instruction of the target object, a target receiving device is determined from at least one receiving device displayed by the screen projection device based on the position information of the second gesture instruction.
Specifically, in response to a second gesture instruction of the target object, position information corresponding to the second gesture instruction is acquired, and then the target receiving device is determined from at least one receiving device displayed by the screen throwing device based on the position information of the second gesture instruction. As an implementation manner, first, a motion parameter of a target object for performing a second gesture instruction is acquired, and exemplary includes: the motion direction, the motion distance and the motion duration pair, specifically, when the motion is stopped by acquiring the second gesture instruction, the time point of stopping the motion is taken as the end time point of the motion duration, the time point of acquiring the second gesture instruction is taken as the start time point, or after the second gesture instruction is acquired, the time point of detecting the hand operation is taken as the start time point, the start time point and the end time point form the motion duration, and the motion distance is obtained from the distance between the position information corresponding to the start time point and the end time point, and can also be obtained through the actual motion track. The movement direction can be obtained based on the actual movement track of the second gesture instruction. And then, determining the moving distance of the screen throwing device based on the current second gesture instruction based on the motion parameters of the second gesture instruction, and determining the target receiving device.
As an implementation manner, when the second gesture instruction of the target object is a gesture repeated with the first gesture instruction, the target receiving device is determined based on the target receiving device corresponding to the repeated occurrence of the preset gesture.
S40, sending the data information to be screened to the target receiving equipment.
After the target receiving equipment is determined, the screen to-be-screened data information of the screen-screened equipment is sent to the target receiving equipment, so that the screen to-be-screened data information of the screen-screened equipment is shared to the target receiving equipment based on gesture operation, screen sharing interaction is more convenient, and the use experience of a user is improved.
In a specific embodiment, the to-be-screen-projected data information provided by the screen projection device may be screen information that can be directly played, or may be address information corresponding to a playing screen, and the receiving device acquires the screen information corresponding to the address information from the server according to the address information, so as to play the screen.
According to the gesture-based screen sharing method provided by the embodiment of the disclosure, at least one receiving device which can be used for screen casting of the screen casting device is determined in response to a first gesture instruction of a target object, and the at least one receiving device is displayed on the screen casting device, wherein the screen casting device is used for providing data information to be screen cast; in response to a second gesture instruction of the target object, determining target receiving equipment from at least one receiving equipment displayed by the screen throwing equipment, wherein the target receiving equipment is used for receiving data information to be thrown, provided by the screen throwing equipment; the method comprises the steps of sending data information to be screened to target receiving equipment, namely after a first gesture instruction of a target object is received, determining at least one receiving equipment which can be screened by the screening equipment based on the first gesture instruction, determining the target receiving equipment from at least one receiving equipment displayed by the screening equipment based on gesture operation of the target object, and sending the data information to be screened to the target receiving equipment, so that the data information to be screened of the screening equipment is shared to the target receiving equipment based on gesture operation, screen sharing interaction is more convenient, and user experience is improved.
Fig. 2 is a flowchart of another gesture-based screen sharing method according to an embodiment of the present disclosure, where, based on the above embodiment, as shown in fig. 2, before step S40, the method further includes:
s30, establishing a communication channel between the screen throwing device and the target receiving device.
When the gesture-based screen sharing method includes step S30, one implementation manner of step S40 includes:
s41, based on the communication channel, sending the data information to be screened to the target receiving equipment.
After the target receiving equipment for receiving the to-be-screened data information provided by the screening equipment is determined, a communication channel between the screening equipment and the target receiving equipment is established before the to-be-screened data information of the screening equipment is sent to the target receiving equipment, and the to-be-screened data information is shared to the target receiving equipment based on the communication channel between the screening equipment and the target receiving equipment.
The specific procedure of establishing a communication channel between the screen throwing device and the target receiving device will be described below by means of specific embodiment distances.
Fig. 3 is a flowchart of another gesture-based screen sharing method according to an embodiment of the present disclosure, where, based on the embodiment corresponding to fig. 2, as shown in fig. 3, a specific implementation manner of step S30 includes:
s31, a wireless communication module of the screen throwing device is controlled to establish a connection communication channel with the target receiving device.
According to the gesture-based screen sharing method provided by the embodiment of the disclosure, firstly, a wireless communication module of a screen throwing device is controlled to establish a connection communication channel with a target receiving device, namely, the wireless communication module based on the screen throwing device is used as a rapid discovery protocol carrier, nearby receiving devices are searched through the wireless communication module, the connection communication channel is established after the target receiving device is searched, and the establishment of a high-speed data channel based on the wireless communication module is realized.
Specifically, the wireless communication module includes bluetooth, bluetooth low energy, and the like.
S32, based on the connection communication channel, establishing a screen-throwing communication channel between the screen-throwing equipment and the target receiving equipment.
Optionally, based on the connection communication channel, establishing a screen-projection communication channel between the screen-projection device and the target receiving device, including:
based on the connection communication channel, controlling the screen throwing device to send a screen throwing communication channel connection request to the target receiving device, wherein the target receiving device is used for authenticating the screen throwing communication channel connection request after receiving the screen throwing communication channel connection request, and returning an authentication passing indication to the screen throwing device after the screen throwing communication channel connection request passes the authentication;
after receiving the authentication passing indication, the screen throwing device establishes a screen throwing communication channel between the screen throwing device and the target receiving device.
Specifically, on the basis of the connection communication channel established in the step S31, a screen-throwing communication channel is established, at this time, the screen-throwing device sends a screen-throwing communication channel connection request to the target receiving device, and sends the screen-throwing communication channel connection request to the target receiving device through the connection communication channel, the target receiving device receives the screen-throwing communication channel connection request sent by the screen-throwing device through the connection communication channel, the screen-throwing initiating terminal actively initiates the request, and sends the request to the screen-throwing receiving terminal through the data link, the target receiving device authenticates the screen-throwing communication channel connection request after receiving the screen-throwing communication channel connection request, returns an authentication passing indication to the screen-throwing device receiving terminal after the screen-throwing communication channel connection request passes the authentication, and establishes the screen-throwing communication channel between the screen-throwing device and the target receiving device after receiving the screen-throwing device receives the authentication passing indication.
In the process of establishing the screen-throwing communication channel between the screen-throwing device and the target receiving device, the screen-throwing communication channel connection request sent by the screen-throwing device comprises a designated IP address and a designated port, and the request is sent to the designated IP address and the designated port in the connection communication channel connection request, at this time, the target receiving device starts socket monitoring and waits for receiving the communication channel connection request.
According to the gesture-based screen sharing method provided by the embodiment of the disclosure, the specific process of establishing the communication channel between the screen throwing device and the target receiving device comprises the steps of controlling the wireless communication module of the screen throwing device to establish a connection communication channel with the target receiving device, and establishing the screen throwing communication channel between the screen throwing device and the target receiving device based on the connection communication channel, namely firstly establishing the connection communication channel between the screen throwing device and the target receiving device, wherein the connection communication channel is established based on the wireless communication module of the screen throwing device, and further establishing the screen throwing communication channel on the basis of the established connection communication channel, so that the time consumption for establishing a screen throwing link between the screen throwing device and the target receiving device is reduced, the waiting time of a user is shortened, and the use experience of the user is improved.
Fig. 4 is a flowchart of another gesture-based screen sharing method according to an embodiment of the present disclosure, where, based on the embodiment corresponding to fig. 2, as shown in fig. 4, a specific implementation manner of step S41 includes:
s410, controlling the screen throwing equipment to encode the data information to be thrown to obtain encoded data.
S411, the encoded data is transmitted to the target reception apparatus based on the communication channel.
The target receiving device is used for receiving the coded data of the screen throwing device and decoding the coded data to obtain a screen throwing picture.
Specifically, the screen-throwing device is a mobile phone, the target object selects the data information to be thrown as the video A, and the specific process of the gesture-based screen sharing method is as follows: the method comprises the steps that a screen throwing device responds to a first gesture instruction of a user, at least one receiving device capable of throwing a screen is displayed on the screen throwing device, then a television is selected from the displayed at least one receiving device of the screen throwing device to serve as a target receiving device in response to gesture operation of a target object, and a data information video A to be thrown is sent to the target receiving device through a server of the screen throwing device; in the process that the server of the screen throwing device sends the data information video A to be thrown to the target receiving device, the screen throwing device carries out coding processing on the data information video A to be thrown, then the target receiving device receives coded data from the screen throwing device based on the fact that the server of the screen throwing device sends the coded data information video A to be thrown, the target receiving device decodes the received coded data, and plays and displays the decoded data information video A to be thrown.
The method includes the steps that one frame of data is circularly obtained through a screen recording API and a sound recording API, the frame of data is sent to an encoder for encoding, the encoded data is sent to target receiving equipment through a TCP/UDP protocol, the target receiving equipment receives the encoded data and then sends the encoded data to a decoder, after the original audio and video data are obtained, video drawing and audio playing are carried out, and sharing of data information to be projected in the projection equipment is achieved.
According to the gesture-based screen sharing method provided by the embodiment of the disclosure, in the process that the screen throwing device sends the data information to be thrown to the target receiving device, the screen throwing device carries out coding processing on the data information to be thrown, then the coded data information to be thrown is sent based on the server of the screen throwing device, the target receiving device receives the coded data from the screen throwing device, decodes the received coded data, plays and displays the decoded data information to be thrown, namely, the sharing of the data information to be thrown in the screen throwing device is realized based on the coding and decoding methods, and intelligent screen throwing is realized.
Optionally, in response to the first gesture instruction of the target object, determining at least one receiving device that the screen-throwing device can throw a screen, and displaying the at least one receiving device on the screen-throwing device, including:
when a first gesture instruction of a target object is acquired and the state time length of the first gesture instruction is longer than or equal to the preset state time length, at least one receiving device capable of being used for screen projection in the screen projection device is determined in response to the first gesture instruction of the target object, and at least one receiving device is displayed in the screen projection device.
In order to avoid the problems of misidentification and the like, after the first gesture command is acquired, and when the state time length of the first gesture command is longer than or equal to the preset state time length, at least one receiving device capable of being used for screen throwing in the screen throwing device is determined in response to the first gesture command of the target object, and at least one receiving device is displayed in the screen throwing device.
Fig. 5 is a schematic structural diagram of a gesture-based screen sharing device according to an embodiment of the present disclosure, where, as shown in fig. 5, the gesture-based screen sharing device includes:
the display module 510 is configured to determine at least one receiving device that the screen-casting device can cast a screen in response to a first gesture instruction of the target object, and display the at least one receiving device on the screen-casting device, where the screen-casting device is configured to provide data information to be cast.
The target receiving device determining module 520 is configured to determine, in response to a second gesture instruction of the target object, a target receiving device from at least one receiving device displayed by the screen capturing device, where the target receiving device is configured to receive data information to be captured provided by the screen capturing device.
And the sending module 530 is configured to send the data information to be screened to the target receiving device.
The gesture-based screen sharing device provided by the embodiment of the disclosure is used for responding to a first gesture instruction of a target object, determining at least one receiving device which can be used for screen casting by screen casting equipment, and displaying the at least one receiving device on the screen casting equipment, wherein the screen casting equipment is used for providing data information to be screen cast; in response to a second gesture instruction of the target object, determining target receiving equipment from at least one receiving equipment displayed by the screen throwing equipment, wherein the target receiving equipment is used for receiving data information to be thrown, provided by the screen throwing equipment; the method comprises the steps of sending data information to be screened to target receiving equipment, namely after a first gesture instruction of a target object is received, determining at least one receiving equipment which can be screened by the screening equipment based on the first gesture instruction, determining the target receiving equipment from at least one receiving equipment displayed by the screening equipment based on gesture operation of the target object, and sending the data information to be screened to the target receiving equipment, so that the data information to be screened of the screening equipment is shared to the target receiving equipment based on gesture operation, screen sharing interaction is more convenient, and user experience is improved.
Optionally, one implementation manner of the target receiving device determining module includes:
in response to a second gesture instruction of the target object, a target receiving device is determined from at least one receiving device displayed by the screen projection device based on the position information of the second gesture instruction.
Optionally, the method further comprises:
the communication channel establishment module is used for establishing a communication channel between the screen throwing equipment and the target receiving equipment;
one specific implementation manner of the sending module comprises:
and based on the communication channel, sending the data information to be screened to the target receiving equipment.
Optionally, the communication channel establishment module includes:
the connection communication channel establishing unit is used for controlling the wireless communication module of the screen throwing device to establish a connection communication channel with the target receiving device;
the screen-throwing communication channel establishing unit is used for establishing the screen-throwing communication channel of the screen-throwing equipment and the target receiving equipment based on the connection communication channel.
Optionally, a specific implementation manner of the screen-throwing communication channel establishing unit includes:
based on the connection communication channel, controlling the screen throwing device to send a screen throwing communication channel connection request to the target receiving device, wherein the target receiving device is used for authenticating the screen throwing communication channel connection request after receiving the screen throwing communication channel connection request, and returning an authentication passing indication to the screen throwing device after the screen throwing communication channel connection request passes the authentication;
after receiving the authentication passing indication, the screen throwing device establishes a screen throwing communication channel between the screen throwing device and the target receiving device.
Optionally, based on the communication channel, one implementation manner of sending the data information to be screened to the target receiving device includes:
the screen throwing equipment is controlled to encode the data information to be thrown to obtain encoded data;
and transmitting the encoded data to target receiving equipment based on the communication channel, wherein the target receiving equipment is used for receiving the encoded data of the screen throwing equipment and decoding the encoded data to obtain the screen throwing picture.
Optionally, a specific implementation manner of the display module includes:
when a first gesture instruction of a target object is acquired and the state time length of the first gesture instruction is longer than or equal to the preset state time length, at least one receiving device capable of being used for screen projection in the screen projection device is determined in response to the first gesture instruction of the target object, and at least one receiving device is displayed in the screen projection device.
The device provided by the embodiment of the invention can execute the method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of executing the method.
It should be noted that, in the embodiment of the apparatus, each unit and module included are only divided according to the functional logic, but not limited to the above-mentioned division, so long as the corresponding function can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present invention.
Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure, and as shown in fig. 6, the electronic device includes a processor 610, a memory 620, an input device 630, and an output device 640; the number of processors 610 in the computer device may be one or more, one processor 610 being taken as an example in fig. 6; the processor 610, memory 620, input device 630, and output device 640 in the electronic device may be connected by a bus or other means, for example in fig. 6.
The memory 620 is a computer readable storage medium, and may be used to store a software program, a computer executable program, and modules, such as program instructions/modules corresponding to the methods in the embodiments of the present invention. The processor 610 executes various functional applications of the computer device and data processing by running software programs, instructions and modules stored in the memory 620, namely, implementing the methods provided by embodiments of the present invention:
responding to a first gesture instruction of a target object, determining at least one receiving device which can be used for screen casting of the screen casting device, and displaying the at least one receiving device on the screen casting device, wherein the screen casting device is used for providing data information to be screen casting;
in response to a second gesture instruction of the target object, determining target receiving equipment from at least one receiving equipment displayed by the screen throwing equipment, wherein the target receiving equipment is used for receiving data information to be thrown, provided by the screen throwing equipment;
and sending the data information to be screened to the target receiving equipment.
Memory 620 may include primarily a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application program required for functionality; the storage data area may store data created according to the use of the terminal, etc. In addition, memory 620 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, memory 620 may further include memory remotely located relative to processor 610, which may be connected to the computer device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 630 may be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the electronic device, which may include a keyboard, mouse, etc. The output device 640 may include a display device such as a display screen.
The disclosed embodiments also provide a storage medium containing computer executable instructions which, when executed by a computer processor, are to implement the methods provided by embodiments of the present invention:
responding to a first gesture instruction of a target object, determining at least one receiving device which can be used for screen casting of the screen casting device, and displaying the at least one receiving device on the screen casting device, wherein the screen casting device is used for providing data information to be screen casting;
in response to a second gesture instruction of the target object, determining target receiving equipment from at least one receiving equipment displayed by the screen throwing equipment, wherein the target receiving equipment is used for receiving data information to be thrown, provided by the screen throwing equipment;
and sending the data information to be screened to the target receiving equipment.
Of course, the storage medium containing computer executable instructions provided in the embodiments of the present invention is not limited to the method operations described above, and may also perform related operations in the method provided in any embodiment of the present invention.
From the above description of embodiments, it will be clear to a person skilled in the art that the present invention may be implemented by means of software and necessary general purpose hardware, but of course also by means of hardware, although in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, etc., and include several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments of the present invention.
It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing is merely a specific embodiment of the disclosure to enable one skilled in the art to understand or practice the disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown and described herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A gesture-based screen sharing method, comprising:
responding to a first gesture instruction of a target object, determining at least one receiving device which can be used for screen casting of a screen casting device, and displaying the at least one receiving device on the screen casting device, wherein the screen casting device is used for providing data information to be screen cast;
in response to a second gesture instruction of the target object, determining target receiving equipment from at least one receiving equipment displayed by the screen throwing equipment, wherein the target receiving equipment is used for receiving data information to be thrown, provided by the screen throwing equipment;
and sending the data information to be screened to the target receiving equipment.
2. The method of claim 1, wherein the determining, in response to the gesture operation of the target object, the target receiving device from the at least one receiving device displayed by the screen-projecting device comprises:
and responding to a second gesture instruction of the target object, and determining a target receiving device from at least one receiving device displayed by the screen projection device based on the position information of the second gesture instruction.
3. The method according to claim 1 or 2, wherein before the sending the data information to be screened to the target receiving device, further comprises:
establishing a communication channel between the screen throwing device and the target receiving device;
the sending the to-be-screen data information to the target receiving device includes:
and based on the communication channel, sending the data information to be screened to the target receiving equipment.
4. A method according to claim 3, wherein said establishing a communication channel between said screen-casting device and said target receiving device comprises:
controlling a wireless communication module of the screen throwing device to establish a connection communication channel with the target receiving device;
and establishing a screen-throwing communication channel between the screen-throwing equipment and the target receiving equipment based on the connection communication channel.
5. The method of claim 4, wherein establishing a screen-cast communication channel between the screen-cast device and the target receiving device based on the connection communication channel comprises:
controlling the screen throwing device to send a screen throwing communication channel connection request to the target receiving device based on the connection communication channel, wherein the target receiving device is used for authenticating the screen throwing communication channel connection request after receiving the screen throwing communication channel connection request, and returning an authentication passing indication to the screen throwing device after the screen throwing communication channel connection request passes the authentication;
and after receiving the authentication passing indication, the screen-throwing equipment establishes a screen-throwing communication channel between the screen-throwing equipment and the target receiving equipment.
6. The method of claim 3, wherein the sending the data information to be screened to the target receiving device based on the communication channel comprises:
the screen throwing equipment is controlled to encode the data information to be thrown to obtain encoded data;
and transmitting the encoded data to target receiving equipment based on the communication channel, wherein the target receiving equipment is used for receiving the encoded data of the screen projection equipment and decoding the encoded data to obtain a screen projection picture.
7. The method of claim 1, wherein the determining at least one receiving device that the screen casting device can cast in response to the first gesture command of the target object and displaying the at least one receiving device at the screen casting device comprises:
when a first gesture instruction of a target object is acquired and the state time of maintaining the first gesture instruction is longer than or equal to the preset state time, at least one receiving device capable of being used for screen projection in the screen projection device is determined in response to the first gesture instruction of the target object, and the at least one receiving device is displayed in the screen projection device.
8. A gesture-based screen sharing apparatus, comprising:
the display module is used for responding to a first gesture instruction of a target object, determining at least one receiving device which can be used for screen casting of the screen casting device, and displaying the at least one receiving device on the screen casting device, wherein the screen casting device is used for providing data information to be screen cast;
the target receiving equipment determining module is used for responding to a second gesture instruction of the target object and determining target receiving equipment from at least one receiving equipment displayed by the screen throwing equipment, wherein the target receiving equipment is used for receiving data information to be thrown, provided by the screen throwing equipment;
and the sending module is used for sending the data information to be screened to the target receiving equipment.
9. An electronic device, comprising:
one or more processors;
storage means for storing one or more programs,
when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-7.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any one of claims 1-7.
CN202210197695.1A 2022-03-02 2022-03-02 Gesture-based screen sharing method and device, electronic equipment and storage medium Pending CN116736968A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210197695.1A CN116736968A (en) 2022-03-02 2022-03-02 Gesture-based screen sharing method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210197695.1A CN116736968A (en) 2022-03-02 2022-03-02 Gesture-based screen sharing method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116736968A true CN116736968A (en) 2023-09-12

Family

ID=87901727

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210197695.1A Pending CN116736968A (en) 2022-03-02 2022-03-02 Gesture-based screen sharing method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116736968A (en)

Similar Documents

Publication Publication Date Title
CN111897507B (en) Screen projection method and device, second terminal and storage medium
CN106488335B (en) Live-broadcast control method and device
CN106105246B (en) Display methods, apparatus and system is broadcast live
US9379783B2 (en) Transmission system
JP6843359B2 (en) Video display device and video display method (DEVICE AND METHOD OF DISPLAYING IMAGES)
EP3316582B1 (en) Multimedia information processing method and system, standardized server and live broadcast terminal
EP3264774B1 (en) Live broadcasting method and device for live broadcasting
KR102315863B1 (en) Camera control and image streaming
CN112148245B (en) Method and device for monitoring, adjusting and projecting screen, computer equipment, readable storage medium and monitoring, adjusting and projecting screen interaction system
WO2017181545A1 (en) Object monitoring method and device
CN107105339B (en) A kind of methods, devices and systems playing live video
US20180035170A1 (en) Method and device for controlling playing state
CN113240053A (en) Camera detection method and device, storage medium and electronic equipment
JP2017501598A5 (en)
CN112820014A (en) Intelligent access control system control method, device, equipment and medium
CN104991855A (en) Processing method and device for interface lag
CA3102425C (en) Video processing method, device, terminal and storage medium
WO2014194586A1 (en) Method, device and system for realizing visual identification
CN113727193A (en) Method and system for processing connection of multimedia content, and storage medium
WO2016062191A1 (en) Information publication method, information receiving method and apparatus, and information sharing system
CN112235510A (en) Shooting method, shooting device, electronic equipment and medium
CN116736968A (en) Gesture-based screen sharing method and device, electronic equipment and storage medium
CN113938742B (en) Control method, system, equipment and storage medium for automatic screen-throwing content playing
KR102051828B1 (en) Method of making video communication and device of mediating video communication
CN112561809A (en) Image processing method, device and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination