CN114564142A - Screen projection control method and device, electronic equipment and storage medium - Google Patents
Screen projection control method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114564142A CN114564142A CN202210189604.XA CN202210189604A CN114564142A CN 114564142 A CN114564142 A CN 114564142A CN 202210189604 A CN202210189604 A CN 202210189604A CN 114564142 A CN114564142 A CN 114564142A
- Authority
- CN
- China
- Prior art keywords
- screen projection
- electronic equipment
- screen
- image
- electronic device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 68
- 230000001960 triggered effect Effects 0.000 claims abstract description 10
- 238000006243 chemical reaction Methods 0.000 claims description 38
- 230000005540 biological transmission Effects 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 description 25
- 238000004891 communication Methods 0.000 description 12
- 230000003993 interaction Effects 0.000 description 10
- 238000004590 computer program Methods 0.000 description 6
- 230000033001 locomotion Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The application discloses a screen projection control method, a screen projection control device, electronic equipment and a storage medium, wherein the screen projection control method comprises the following steps: acquiring operation information triggered by a user and sent by first electronic equipment, wherein the operation information comprises an operation type and an operation position on the first electronic equipment; generating a control instruction according to the operation type and the operation position; and sending the control instruction to second electronic equipment so that the second electronic equipment can execute the control instruction. The application solves the technical problem that the screen throwing operation in the prior art is low in convenience.
Description
Technical Field
The present application relates to the field of screen projection technologies, and in particular, to a screen projection control method and apparatus, an electronic device, and a storage medium.
Background
With the development of science and technology and the improvement of living standards of people, the functions of displaying screens of mobile devices such as mobile phones, tablet computers and computers through display devices such as television large screens and projectors are increasingly popularized, users often push pictures, music, videos and the like of the mobile devices to the display devices for playing, however, in a multi-player interactive scene such as a conference, a multi-player game and the like, in the prior art, a mobile device at a screen projection pushing end controls a screen projection picture, while a display device at a screen projection receiving end can only passively receive the screen projection picture, however, in a meeting, a multiplayer game and other scenes, when an operator at the screen projection receiving end wants to interact with a screen projection picture, the operator at the screen projection pushing end needs to be informed, and the control of the screen projection picture is finished by an operator at the screen projection pushing end, the operation process is very complicated, and the screen projection experience is seriously influenced.
Disclosure of Invention
The application mainly aims to provide a screen projection control method and device, electronic equipment and a storage medium, and aims to solve the technical problem that screen projection operation in the prior art is low in convenience.
In order to achieve the above object, the present application provides a screen projection control method, including:
acquiring operation information triggered by a user and sent by first electronic equipment, wherein the operation information comprises an operation type and an operation position on the first electronic equipment;
generating a control instruction according to the operation type and the operation position;
and sending the control instruction to second electronic equipment so that the second electronic equipment can execute the control instruction.
Optionally, the step of generating a control instruction according to the operation type and the operation position includes:
converting the operation position into a control coordinate of the corresponding second electronic equipment according to a preset image conversion rule;
and generating a control instruction for executing the operation corresponding to the operation type on the control coordinate.
Optionally, the step of converting the operation position into a control coordinate of the corresponding second electronic device according to the image conversion rule includes:
acquiring the resolution of an image to be projected corresponding to second electronic equipment and the size of a projection display area corresponding to first electronic equipment;
and converting the operation position into a control coordinate of the corresponding second electronic equipment according to the ratio of the resolution of the image to be projected to the screen and the size of the screen projection display area.
Optionally, the step of generating a control instruction according to the operation type and the operation position includes:
acquiring area position information of a screen projection display area corresponding to the first electronic equipment;
judging whether the operation position is in the screen projection display area or not according to the area position information;
and if the operation position is determined to be in the screen projection display area, generating a control instruction according to the operation type and the operation position.
Optionally, before the step of obtaining the operation information sent by the first electronic device, the method further includes:
receiving an image to be projected sent by second electronic equipment;
converting the to-be-projected screen image into at least one target projection screen image according to a preset image conversion rule, wherein each target projection screen image corresponds to each first electronic device one to one;
and sending each target screen projection image to the corresponding first electronic equipment so that each first electronic equipment can receive and display the target screen projection image.
Optionally, the step of converting the image to be projected into at least one target screen projection image according to a preset image conversion rule, where the step of one-to-one correspondence between each target screen projection image and each first electronic device includes:
acquiring display specification information of at least one first electronic device;
and stretching and adjusting the image to be projected according to the image specification information corresponding to the image to be projected and the display specification information to obtain at least one target screen projection image, wherein each target screen projection image corresponds to each first electronic device one to one.
Optionally, the step of acquiring the operation information sent by the first electronic device includes:
when a screen projection reverse control instruction sent by second electronic equipment is received, screen projection reverse control connection between the first electronic equipment and the second electronic equipment is established according to the screen projection reverse control instruction;
and acquiring operation information sent by the first electronic equipment based on the screen projection inverse control connection.
The application also provides a throw screen controlling means, it is applied to and throws screen controlgear to throw screen controlling means, it includes to throw screen controlling means:
the device comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring user operation information sent by first electronic equipment, and the operation information comprises an operation type and an operation position;
the instruction generation module is used for generating a control instruction according to the operation type and the operation position;
and the instruction sending module is used for sending the control instruction to second electronic equipment so that the second electronic equipment can execute the control instruction.
The present application further provides an electronic device, the electronic device is an entity device, the electronic device includes: a memory, a processor and a program of the screen projection control method stored on the memory and executable on the processor, the program of the screen projection control method being executable by the processor to implement the steps of the screen projection control method as described above.
The present application further provides a storage medium, which is a computer-readable storage medium, and a program for implementing the screen projection control method is stored on the computer-readable storage medium, and when executed by a processor, the program for implementing the screen projection control method implements the steps of the screen projection control method as described above.
The present application also provides a computer program product comprising a computer program which, when executed by a processor, performs the steps of the screen projection control method as described above.
The application provides a screen projection control method, a screen projection control device, electronic equipment and a storage medium, which realize the acquisition of the operation type and the operation position of user operation generated by first electronic equipment in the screen projection process by acquiring operation information triggered by a user and sent by the first electronic equipment, further generate a control instruction according to the operation type and the operation position, send the control instruction to second electronic equipment so as to enable the second electronic equipment to execute the control instruction, realize the control of the second electronic equipment according to the operation type and the operation position of the user operation generated by the user on the first electronic equipment, further realize the electronic equipment at any end in screen projection connection, and can directly operate the content of the current screen projection through the electronic equipment at the end, the interaction with the screen projection picture is completed, the screen projection device serves as an execution main body, conversion and transmission of screen projection data are carried out, the data transmission process is more stable and smooth, the time for a user to receive operation feedback information is shorter, the operation is smoother, unnecessary operation caused by the fact that feedback is not received in time can be reduced, the technical problem that the screen projection operation convenience is low in the prior art is solved, and the multi-end interaction operation convenience in the screen projection process is effectively improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and, together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.
Fig. 1 is a schematic view of a screen projection connection scene according to an embodiment of a screen projection control method of the present application;
fig. 2 is a schematic structural diagram of an electronic device in a hardware operating environment related to a screen projection control method in an embodiment of the present application;
FIG. 3 is a schematic flowchart illustrating an embodiment of a screen projection control method according to the present application;
FIG. 4 is a schematic view of a scene in which an implementation manner of the screen projection control method of the present application is shown;
FIG. 5 is a schematic flowchart of another embodiment of a screen projection control method according to the present application;
fig. 6 is a schematic structural diagram of a device related to a screen projection control method in an embodiment of the present application;
fig. 7 is a schematic view of a coordinate transformation scene in an embodiment of a screen projection control method in the embodiment of the present application.
The objectives, features, and advantages of the present application will be further described with reference to the accompanying drawings.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a schematic view of a screen projection connection according to an embodiment of the present invention.
As shown in fig. 1, the screen projector includes: the electronic device comprises a screen projector transmitter and/or a screen projector receiver, wherein the first electronic device can be a personal computer, or can be a mobile terminal device such as a smart phone, a tablet computer, an electronic book reader, a portable computer, or the like, and the second electronic device can be a television, or can be a display device such as a display, a projector, or the like, having a display function.
In some embodiments, the first electronic device is connected with the screen projector transmitter and/or the screen projector receiver through a wired or wireless network for data transmission and interaction; the screen projector transmitter is connected with the screen projector receiver through a wireless network to perform data transmission and interaction, or the screen projector transmitter is connected with the second electronic equipment through the wireless network to perform data transmission and interaction; the screen projector receiver is connected with the second electronic equipment through a wired or wireless network to perform data transmission and interaction. In an optional implementation manner, the wired connection between the screen projector receiver and the second electronic device and the wired connection between the screen projector transmitter and the first electronic device may include wired connections based on HDMI (High Definition Multimedia Interface), USB (Universal Serial Bus), DP (display Interface), VGA (Video Graphics Array), and the like. The wireless communication modes between the first electronic device and the screen projector and between the first electronic device and the screen projector receiver and between the second electronic device and the screen projector receiver can include wireless communication such as Bluetooth (Bluetooth), wireless broadband (Wi-Fi) and infrared communication.
Therefore, the possible connection modes for realizing screen projection between the first electronic device, the screen projector transmitter, the screen projector receiver and the second electronic device at least include:
(1) the screen projector transmitter is connected with the screen projector receiver, and the first electronic equipment picture is finally projected to the second electronic equipment through the screen projector transmitter and the screen projector receiver;
(2) the screen projector transmitter is wirelessly connected with the second electronic equipment, the picture of the first electronic equipment is projected to the second electronic equipment through the screen projector transmitter, and at the moment, the screen projector transmitter is connected with a wireless communication module arranged in the second electronic equipment through a wireless network;
(3) the first electronic equipment is connected with the screen projector receiver, and the first electronic equipment picture is projected to the second electronic equipment through the screen projector receiver.
Referring to fig. 2, fig. 2 is a schematic diagram of a terminal structure of a screen projector in a hardware operating environment according to an embodiment of the present invention.
As shown in fig. 2, the screen projector further includes: a processor 1001, such as a Central Processing Unit (CPU), a communication bus 1002, a network interface 1003, and a memory 1004. Wherein a communication bus 1002 is used to enable connective communication between these components. The network interface 1003 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (WI-FI) interface). The Memory 1004 may be a high-speed Random Access Memory (RAM) Memory, or a Non-Volatile Memory (NVM), such as a disk Memory. The memory 1004 may alternatively be a storage device separate from the processor 1001.
Optionally, the screen projector may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like. Such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display screen according to the brightness of ambient light, and a proximity sensor that may turn off the display screen and/or the backlight when the mobile terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when the mobile terminal is stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer and tapping) and the like for recognizing the attitude of the mobile terminal; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.
Those skilled in the art will appreciate that the configuration shown in FIG. 2 does not constitute a limitation of the operating device and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 2, the memory 1004, which is a storage medium, may include therein an operating system, a data storage module, a network communication module, and a screen projection control program.
In the operation device shown in fig. 2, the network interface 1003 is mainly used for data communication with other devices. The processor 1001 and the memory 1004 in the execution device of the present invention may be provided in the execution device, and the execution device calls the screen projection control program stored in the memory 1004 through the processor 1001 and performs the following operations:
acquiring operation information triggered by a user and sent by first electronic equipment, wherein the operation information comprises an operation type and an operation position on the first electronic equipment;
generating a control instruction according to the operation type and the operation position;
and sending the control instruction to second electronic equipment so that the second electronic equipment can execute the control instruction.
Further, the processor 1001 may call a screen projection control program stored in the memory 1004, and further perform the following operations:
converting the operation position into a control coordinate of the corresponding second electronic equipment according to a preset image conversion rule;
and generating a control instruction for executing the operation corresponding to the operation type on the control coordinate.
Further, the processor 1001 may call a screen projection control program stored in the memory 1004, and further perform the following operations:
acquiring the resolution of an image to be projected corresponding to second electronic equipment and the size of a projection display area corresponding to first electronic equipment;
and converting the operation position into a control coordinate of the corresponding second electronic equipment according to the ratio of the resolution of the image to be projected to the screen and the size of the screen projection display area.
Further, the processor 1001 may call a screen projection control program stored in the memory 1004, and further perform the following operations:
acquiring area position information of a screen projection display area corresponding to the first electronic equipment;
judging whether the operation position is in the screen projection display area or not according to the area position information;
and if the operation position is determined to be in the screen projection display area, generating a control instruction according to the operation type and the operation position.
Further, the processor 1001 may call a screen projection control program stored in the memory 1004, and further perform the following operations:
receiving a screen image to be projected sent by second electronic equipment;
converting the to-be-projected screen image into at least one target projection screen image according to a preset image conversion rule, wherein each target projection screen image corresponds to each first electronic device one to one;
and sending each target screen projection image to the corresponding first electronic equipment so that each first electronic equipment can receive and display the target screen projection image.
Further, the processor 1001 may call a screen projection control program stored in the memory 1004, and further perform the following operations:
acquiring display specification information of at least one first electronic device;
and stretching and adjusting the image to be projected according to the image specification information corresponding to the image to be projected and the display specification information to obtain at least one target screen projection image, wherein each target screen projection image corresponds to each first electronic device one to one.
Further, the processor 1001 may call a screen projection control program stored in the memory 1004, and further perform the following operations:
when a screen-projecting anti-control instruction sent by second electronic equipment is received, screen-projecting anti-control connection between the first electronic equipment and the second electronic equipment is established according to the screen-projecting anti-control instruction;
and acquiring operation information sent by the first electronic equipment based on the screen projection inverse control connection.
In a first embodiment of the screen projection control method of the present application, referring to fig. 3, the screen projection control method includes:
step S10, acquiring operation information triggered by a user and sent by a first electronic device, where the operation information includes an operation type and an operation position on the first electronic device;
in this embodiment, it should be noted that the screen projection is a process of projecting the display screen and/or sound of the second electronic device to at least one first electronic device for outputting and displaying. The execution main body of this embodiment is a screen projector, the screen projector includes a screen projector receiver and/or a screen projector transmitter, the screen projector is respectively connected with a first electronic device and a second electronic device through a wired or wireless connection, the first electronic device is a device for receiving screen projection, such as a television, a computer, or a projector, the second electronic device is a mobile device for pushing screen projection, such as a mobile phone, a computer, or a tablet computer, the first electronic device sends operation information generated based on user operation to the screen projector, the operation information is converted into a control instruction for the second electronic device through the screen projector, so as to realize a process of controlling the second electronic device at the first electronic device, the screen projector transfers screen projection data, one or more first electronic devices can be accessed, and an operation of one electronic device for projecting screen to a plurality of electronic devices is realized, and through the preset data transmission protocol and data transmission channel, data transmission between the first electronic equipment and the second electronic equipment is realized, compared with the direct data transmission between the first electronic equipment and the second electronic equipment, the data transmission process is more stable and smooth, and the time for the second electronic equipment to execute the corresponding control instruction after the first electronic equipment generates the operation information is effectively reduced, namely, the time for receiving the operation feedback information is shorter after the user operates the first electronic equipment, so that the operation process of the user is smoother, unnecessary operation caused by the fact that the feedback is not received in time can be reduced, and further the user experience is improved.
Specifically, operation information generated and sent by a first electronic device based on an operation triggered by a user is obtained, where the operation information includes an operation type and an operation position, the operation position is a position where the user generates a user operation in a display interface of the first electronic device, and the operation type includes a click operation, a long press operation, a focus movement operation, a focus positioning operation, and the like, it is easy to understand that the operation type may be directly generated through an operation, for example, an operation type corresponding to performing the click operation on a touch screen is a click operation, an operation type corresponding to performing the long press on a key on a television remote control is a long press operation, and the like, and the operation type may also be determined through a preset operation conversion rule, for example, an operation type corresponding to performing one click operation on the touch screen is set as the focus movement operation, the operation type corresponding to the secondary click operation executed on the touch screen is set as the click operation, the operation type corresponding to the pressing operation executed on the direction key on the television remote control is set as the focus moving operation, the operation type corresponding to the pressing operation executed on the confirmation key on the television remote control is set as the click operation and the like, different operation types can adapt to different screen projection scenes, the flexibility of user operation is effectively improved, no matter the first electronic equipment is operated through the touch screen, the mouse or the remote controller, the operation conversion can be freely and flexibly completed, and the user can complete the control process of the second electronic equipment on the first electronic equipment more flexibly and conveniently.
It is easily understood that the first electronic device may be one or more, wherein the first electronic device having the screen-projection operation module may generate the user operation information based on the user operation.
Optionally, before the step of obtaining the operation information sent by the first electronic device, the method further includes:
step A10, when a screen projection reverse control instruction sent by a second electronic device is received, screen projection reverse control connection between the first electronic device and the second electronic device is established according to the screen projection reverse control instruction
And A20, acquiring operation information sent by the first electronic equipment based on the screen projection inverse control connection.
In this embodiment, specifically, in the screen projection process, when a screen projection inverse control instruction sent by a second electronic device is received, a screen projection inverse control connection between the first electronic device and the second electronic device corresponding to the screen projection inverse control instruction is established according to the screen projection inverse control instruction, and operation information sent by the first electronic device based on the screen projection inverse control connection is acquired, where the screen projection inverse control instruction may be generated when the second electronic device detects a trigger operation of a screen projection inverse control, or may be generated according to feedback information of the screen projection inverse control permission when the second electronic device receives the screen projection inverse control request and returns feedback information of the screen projection inverse control permission based on the screen projection inverse control request.
It is easy to understand that the second electronic device corresponding to the screen projection connection may be one or more, that is, the screen projector may establish screen projection connection with multiple user devices, so that the second electronic device can project screens to multiple first electronic devices simultaneously, therefore, the screen projection inverse control command includes first electronic device information corresponding to the screen projection inverse control connection, and the screen projector establishes screen projection inverse control connection between the first electronic device and the second electronic device corresponding to the screen projection inverse control command according to the first electronic device information in the screen projection inverse control command, for example, referring to fig. 4, when the mobile phone 100 of the second electronic device establishes screen projection connection with the television 400 of the first electronic device, the tablet computer 500 and the mobile phone 600 through the screen projector transmitter 200 and the screen projector transmitter 300, and when a screen projection inverse control button on the mobile phone 100 is triggered during screen projection, the screen projection device transmitter 200 and the screen projection device receiver 300 establish screen projection inverse control connection between the tablet computer 500 and the mobile phone 600 and the mobile phone 100 according to the screen projection inverse control instruction, so that user operation generated on the tablet computer 500 and the mobile phone 600 can be converted into a control instruction for the mobile phone 100, reverse control over the mobile phone 100 is realized, and even if the user operation is generated on the television 400, reverse control over the mobile phone 100 cannot be performed because screen projection inverse control connection is not established.
Step S20, generating a control instruction according to the operation type and the operation position;
in this embodiment, specifically, according to an operation type of a user operation generated in the display interface of the first electronic device and a position where the user operation is generated in the display interface of the first electronic device, the user operation is converted into a control instruction for operating the display interface of the second electronic device.
In an implementation manner, the manner of generating the control instruction according to the operation type and the operation position may be that a target control in a display interface of the second electronic device corresponding to the operation position is determined, and a control instruction for executing an operation corresponding to the operation type on the target control is generated according to the operation type and the target control.
In an implementation manner, the manner of generating the control instruction according to the operation type and the operation position may be that a control coordinate in a display interface of the second electronic device corresponding to the operation position is determined, and a control instruction for executing an operation corresponding to the operation type at the control coordinate is generated according to the operation type and the control coordinate.
Optionally, the step of generating a control instruction according to the operation type and the operation position includes:
step S21, converting the operation position into a control coordinate of the corresponding second electronic device according to a preset image conversion rule;
in the embodiment, specifically, the operation position is converted into the control coordinate of the corresponding second electronic device according to a preset image conversion rule, wherein, the image conversion rule is a conversion rule of a target screen projection image suitable for output display at the first electronic equipment by converting display parameters or reconstructing the image of the screen to be projected sent by the second electronic equipment in the screen projection process, wherein, the display parameters comprise display size, display resolution, display position, etc., the image conversion rule is preset in the computing module of the screen projector, it is easy to understand that the screen projection image conversion process is inversely operated according to the image conversion rule, the position information of the picture of the first electronic device can be converted into the position information of the screen projection display area of the second electronic device, therefore, the mutual conversion of the position information of the first electronic equipment and the second electronic equipment can be realized.
Optionally, the step of converting the operation position into a control coordinate of the corresponding second electronic device according to the image conversion rule includes:
step S211, acquiring the resolution of an image to be projected corresponding to second electronic equipment and the size of a projection display area corresponding to first electronic equipment;
step S212, converting the operation position into a control coordinate of the corresponding second electronic device according to the ratio of the resolution of the image to be projected to the size of the screen projection display area.
In this embodiment, specifically, a resolution of a to-be-projected image corresponding to a to-be-projected image sent by the second electronic device and a size of a projection display area corresponding to the first electronic device are obtained, and the operation position is converted into a control coordinate of the corresponding second electronic device according to a ratio between the resolution of the to-be-projected image and the size of the projection display area corresponding to the first electronic device, where the projection display area is an area range where a projection picture corresponding to the second electronic device is displayed on the display device corresponding to the first electronic device, and it is easy to understand that the projection display area may be the same as or smaller than all screen display areas of the display device corresponding to the first electronic device, which may output displays, for example, referring to fig. 7, when the second electronic device is in a vertical screen display mode, when the first electronic device displays the horizontal screen, in the process that the second electronic device projects the screen to the first electronic device, a screen projection display area of an image to be projected sent by the second electronic device, which is output and displayed on the first electronic device, is smaller than a screen display area of the first electronic device.
In an implementation manner, referring to fig. 7, the step of converting the operation position into a corresponding control coordinate of the second electronic device according to a ratio between the resolution of the image to be projected and the size of the display area to be projected includes inputting the operation position, the resolution of the image to be projected and the size of the display area to be projected into a preset coordinate conversion algorithm to obtain a corresponding control coordinate of the second electronic device, where the preset coordinate conversion algorithm is:
the x2 is an abscissa corresponding to the control coordinate, the y2 is an ordinate corresponding to the control coordinate, the x1 is an abscissa corresponding to the operation position, the y2 is an ordinate corresponding to the operation position, the resolution of the image to be projected is bx by y, (ax1, ay1) is the coordinates of the left lower vertex of the projection display area, and (ax2, ay2) is the coordinates of the right upper vertex of the projection display area.
Step S22 is to generate a control command for executing the operation corresponding to the operation type at the control coordinate.
In this embodiment, specifically, a control instruction is generated according to the operation type and the control coordinate, so that the second electronic device executes an operation corresponding to the operation type at the control coordinate, for example, if the control coordinate is (a, b) and the operation type is click, a control instruction for executing a click operation at a coordinate point (a, b) is generated.
Optionally, the step of generating a control instruction according to the operation type and the operation position includes:
step B10, acquiring area position information of a screen projection display area corresponding to the first electronic equipment;
step B20, judging whether the operation position is in the screen projection display area according to the area position information;
and step B30, if the operation position is determined to be in the screen projection display area, generating a control instruction according to the operation type and the operation position.
In this embodiment, specifically, area position information of a screen projection display area corresponding to the first electronic device is obtained, whether the operation position is in the screen projection display area is determined according to the area position information, if it is determined that the operation position is in the screen projection display area, a control instruction for executing an operation corresponding to the operation type at the control coordinate is generated according to the operation type and the operation position, and if it is determined that the operation position is not in the screen projection display area, the operation information is used as invalid operation information without performing subsequent operations, so as to reduce operation resources occupied by the invalid operations.
Step S30, sending the control instruction to a second electronic device, so that the second electronic device can execute the control instruction.
In this embodiment, specifically, the control instruction is sent to the second electronic device, so that the second electronic device executes the control instruction, and the interaction between the second electronic device and the display interface is completed according to the user operation, it is easy to understand that, in the process of executing the control instruction by the second electronic device, the screen projection process is still continued, that is, both the process of executing the control instruction by the second electronic device and the feedback information generated after executing the control instruction are transmitted to the first electronic device through screen projection and output, so that the user can know the feedback result of the operation in time according to the information output by the first electronic device.
In an implementation manner, referring to fig. 4, the screen projector includes a screen projector transmitter 200 and a screen projector receiver 300, the screen projector receiver 300 is in communication connection with the screen projector transmitter 200, the first electronic device includes a television 400, a tablet computer 500 and a mobile phone 600, the television 400, the tablet computer 500 and the mobile phone 600 are in communication connection with the screen projector receiver 300, the second electronic device is the mobile phone 100, the mobile phone 100 is in communication connection with the screen projector transmitter 200, during the screen projection process of the mobile phone 100 on the television 400, the tablet computer 500 and the mobile phone 600, the screen projector receiver 300 acquires user operation information generated by the television 400, the tablet computer 500 or the mobile phone 600, generates a control instruction according to the operation type and the operation position, and sends the control instruction to the mobile phone 100 so that the mobile phone 100 can execute the control instruction, it is easy to understand that, during the process of executing the control command by the mobile phone 100, the screen projection process is still continued, that is, both the process of executing the control command by the mobile phone 100 and the feedback information generated after executing the control command are transmitted to the television 400, the tablet computer 500, and the mobile phone 600 through screen projection for output.
In this embodiment, the operation information triggered by the user and sent by the first electronic device is obtained, where the operation information includes an operation type and an operation position on the first electronic device, so that the operation type and the operation position of the user operation generated by the first electronic device in the screen projection process are obtained, and then a control instruction is generated according to the operation type and the operation position and sent to the second electronic device, so that the second electronic device executes the control instruction, so that the second electronic device is controlled according to the operation type and the operation position of the user operation generated by the user on the first electronic device, and thus the electronic device at any end of the screen projection connection can directly operate the currently projected content through the electronic device at the end to complete interaction with the screen projection picture, and the screen projector is used as an execution main body to convert and transmit screen projection data, so that the data transmission process is more stable and smooth, the time for receiving operation feedback information by a user is shorter, and the operation is smoother, thereby reducing unnecessary operation caused by not receiving feedback in time, overcoming the technical problem of low screen projection operation convenience in the prior art, and effectively improving the multi-terminal interaction operation convenience in the screen projection process.
Further, in another embodiment of the screen projection control method according to the present application, with reference to fig. 5, before the step of obtaining the operation information sent by the first electronic device, the method further includes:
step C10, receiving an image to be projected sent by the second electronic device;
step C20, converting the image to be projected into at least one target screen projection image according to a preset image conversion rule, wherein each target screen projection image corresponds to each first electronic device one by one;
in this embodiment, it should be noted that, in the process of screen projection, because the display specifications of different display devices are different, the display parameters of the image to be projected sent by the second electronic device may be adapted or not adapted to the first electronic device, and the image conversion rule is that, in the process of screen projection, the image to be projected sent by the second electronic device is converted into the display parameters to obtain a conversion rule of a target screen projection image suitable for output display on the first electronic device, where the display parameters include a display size, a display resolution, a display position, and the like, the image conversion rule is preset in a computing module of the screen projector, and it is easy to understand that, when the image conversion rule performs inverse operation, the position information of the screen to be projected on the first electronic device can be converted into the position information of the screen projection display area of the second electronic device, therefore, the mutual conversion of the position information of the first electronic equipment and the second electronic equipment can be realized.
Specifically, in the screen projection process, a to-be-projected image sent by a second electronic device is received, a display parameter or a device model and the like of the first electronic device determine a specification and a position of a screen display area for output display at the first electronic device, the to-be-projected image is subjected to conversion of the display parameter or image reconstruction according to a preset image conversion rule to obtain a target screen projection image adapted to the screen display area of the first electronic device, each target screen projection image corresponds to each first electronic device one by one, wherein the display parameter includes a display size, a display resolution, a display position and the like, it is easy to understand that the manner of converting the to-be-projected image into at least one target screen projection image according to the preset image conversion rule can be used for adjusting the resolution or the size of the to-be-projected image, the image to be projected can be cut and rotationally adjusted, or the image to be projected can be split and accepted or rejected by a control, so that an image reconstruction can be performed on a display interface in the image to be projected.
It is easy to understand that the display parameters of the display device corresponding to the first electronic device may be the same or different, and for different display devices, image adjustment may be performed according to the actual display parameters of the display devices, so as to better adapt to different display devices, and improve the user experience of screen projection.
Optionally, the step of converting the image to be projected into at least one target screen projection image according to a preset image conversion rule, where the step of one-to-one correspondence between each target screen projection image and each first electronic device includes:
step C21, acquiring display specification information of at least one first electronic device;
and step C22, stretching and adjusting the image to be projected according to the image specification information corresponding to the image to be projected and each piece of display specification information to obtain at least one target screen projection image, wherein each target screen projection image corresponds to each first electronic device one to one.
In this embodiment, specifically, display specification information of at least one first electronic device is obtained, the image to be projected is respectively adjusted by stretching according to a difference between the image specification information corresponding to the image to be projected and each display specification information, so as to obtain a target screen projection image corresponding to each display specification information, each target screen projection image corresponds to each display specification information of the first electronic device one to one, so as to adapt to different display devices, thereby improving the screen projection user experience, and the stretching adjustment processing speed is fast, the position conversion operation speed is fast, further effectively improving the conversion efficiency of converting an operation position corresponding to a user operation generated by the first electronic device into a control coordinate of a corresponding second electronic device, shortening the feedback time when the user receives an operation feedback, and thus reducing unnecessary operations caused by not receiving the feedback in time, the operation is smoother, the operation convenience of multi-end interaction in the screen projection process is effectively improved, the feedback delay time is shortened, and the user experience is improved.
Step C30, sending each target screen projection image to the corresponding first electronic device, so that each first electronic device receives and displays the target screen projection image.
In this embodiment, specifically, each target screen projection image is sent to the corresponding first electronic device, so that each first electronic device receives and displays the target screen projection image.
Further, an embodiment of the present application further provides a screen projection control device, with reference to fig. 6, the screen projection control device is applied to a screen projection control device, and the screen projection control device includes:
the system comprises an acquisition module 10, a processing module and a display module, wherein the acquisition module is used for acquiring user operation information sent by first electronic equipment, and the operation information comprises an operation type and an operation position;
an instruction generating module 20, configured to generate a control instruction according to the operation type and the operation position;
the instruction sending module 30 is configured to send the control instruction to a second electronic device, so that the second electronic device executes the control instruction.
Optionally, the instruction generating module 20 is further configured to:
converting the operation position into a control coordinate of the corresponding second electronic equipment according to a preset image conversion rule;
and generating a control instruction for executing the operation corresponding to the operation type on the control coordinate.
Optionally, the instruction generating module 20 is further configured to:
acquiring the resolution of an image to be projected corresponding to second electronic equipment and the size of a projection display area corresponding to first electronic equipment;
and converting the operation position into a control coordinate of the corresponding second electronic equipment according to the ratio of the resolution of the image to be projected to the screen and the size of the screen projection display area.
Optionally, the instruction generating module 20 is further configured to:
acquiring area position information of a screen projection display area corresponding to the first electronic equipment;
judging whether the operation position is in the screen projection display area or not according to the area position information;
and if the operation position is determined to be in the screen projection display area, generating a control instruction according to the operation type and the operation position.
Optionally, the screen projection control device further includes an image processing module, and the image processing module is configured to:
receiving an image to be projected sent by second electronic equipment;
converting the to-be-projected screen image into at least one target projection screen image according to a preset image conversion rule, wherein each target projection screen image corresponds to each first electronic device one to one;
and sending each target screen projection image to the corresponding first electronic equipment so that each first electronic equipment can receive and display the target screen projection image.
Optionally, the image processing module is further configured to:
acquiring display specification information of at least one first electronic device;
and stretching and adjusting the image to be projected according to the image specification information corresponding to the image to be projected and the display specification information to obtain at least one target screen projection image, wherein each target screen projection image corresponds to each first electronic device one to one.
Optionally, the obtaining module 10 is further configured to:
when a screen projection reverse control instruction sent by second electronic equipment is received, screen projection reverse control connection between the first electronic equipment and the second electronic equipment is established according to the screen projection reverse control instruction;
and acquiring operation information sent by the first electronic equipment based on the screen projection inverse control connection.
The screen projection control device provided by the invention adopts the screen projection control method in the embodiment, and solves the technical problem of low convenience in screen projection operation in the prior art. Compared with the prior art, the beneficial effects of the screen projection control device provided by the embodiment of the invention are the same as the beneficial effects of the screen projection control method provided by the embodiment, and other technical characteristics of the screen projection control device are the same as those disclosed by the embodiment method, which are not repeated herein.
Further, the present application also provides a computer program product comprising a computer program which, when being executed by a processor, realizes the steps of the screen projection control method as described above.
The computer program product provided by the application solves the technical problem that the screen projection operation is low in convenience in the prior art. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the invention are the same as those of the screen projection control method provided by the embodiment, and are not repeated herein.
The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all equivalent structures or equivalent processes, which are directly or indirectly applied to other related technical fields, and which are not limited by the present application, are also included in the scope of the present application.
Claims (10)
1. A screen projection control method is applied to a screen projector and comprises the following steps:
acquiring operation information triggered by a user and sent by first electronic equipment, wherein the operation information comprises an operation type and an operation position on the first electronic equipment;
generating a control instruction according to the operation type and the operation position;
and sending the control instruction to second electronic equipment so that the second electronic equipment can execute the control instruction.
2. The screen projection control method according to claim 1, wherein the step of generating a control instruction according to the operation type and the operation position comprises:
converting the operation position into a control coordinate of the corresponding second electronic equipment according to a preset image conversion rule;
and generating a control instruction for executing the operation corresponding to the operation type on the control coordinate.
3. The screen projection control method according to claim 2, wherein the step of converting the operation position into the control coordinate of the corresponding second electronic device according to the image conversion rule comprises:
acquiring the resolution of an image to be projected corresponding to second electronic equipment and the size of a projection display area corresponding to first electronic equipment;
and converting the operation position into a control coordinate of the corresponding second electronic equipment according to the ratio of the resolution of the image to be projected to the screen and the size of the screen projection display area.
4. The screen projection control method according to claim 1, wherein the step of generating a control instruction according to the operation type and the operation position comprises:
acquiring area position information of a screen projection display area corresponding to the first electronic equipment;
judging whether the operation position is in the screen projection display area or not according to the area position information;
and if the operation position is determined to be in the screen projection display area, generating a control instruction according to the operation type and the operation position.
5. The screen projection control method of claim 1, wherein the step of obtaining the operation information sent by the first electronic device is preceded by the step of:
receiving a screen image to be projected sent by second electronic equipment;
converting the image to be projected into at least one target screen projection image according to a preset image conversion rule, wherein each target screen projection image corresponds to each first electronic device one to one;
and sending each target screen projection image to the corresponding first electronic equipment so that each first electronic equipment can receive and display the target screen projection image.
6. The screen projection control method of claim 5, wherein the step of converting the image to be projected into at least one target screen projection image according to a preset image conversion rule, wherein each target screen projection image corresponds to each first electronic device one by one comprises:
acquiring display specification information of at least one first electronic device;
and stretching and adjusting the image to be projected according to the image specification information corresponding to the image to be projected and the display specification information to obtain at least one target screen projection image, wherein each target screen projection image corresponds to each first electronic device one to one.
7. The screen projection control method as claimed in claim 1, wherein the step of acquiring the operation information transmitted by the first electronic device comprises:
when a screen projection reverse control instruction sent by second electronic equipment is received, screen projection reverse control connection between the first electronic equipment and the second electronic equipment is established according to the screen projection reverse control instruction;
and acquiring operation information sent by the first electronic equipment based on the screen projection inverse control connection.
8. A screen projection control device, comprising:
the device comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring operation information which is sent by first electronic equipment and is triggered by a user, and the operation information comprises an operation type and an operation position on the first electronic equipment;
the instruction generation module is used for generating a control instruction according to the operation type and the operation position;
and the instruction sending module is used for sending the control instruction to second electronic equipment so that the second electronic equipment can execute the control instruction.
9. A screen projector, comprising: the screen projector is used for connecting first electronic equipment, the screen projector receiver is used for connecting second electronic equipment, and the screen projector receiver carry out data transmission through a wireless network or a protocol; the screen projector receiver and/or screen projector transmitter further comprises: a memory, a processor and a screen projection control program stored on the memory and executable on the processor, which when executed by the processor implements the steps of the screen projection control method according to any one of claims 1 to 7.
10. A storage medium, characterized in that the storage medium is a computer-readable storage medium having stored thereon a program for implementing a screen projection control method, the program being executed by a processor to implement the steps of the screen projection control method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210189604.XA CN114564142A (en) | 2022-02-28 | 2022-02-28 | Screen projection control method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210189604.XA CN114564142A (en) | 2022-02-28 | 2022-02-28 | Screen projection control method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114564142A true CN114564142A (en) | 2022-05-31 |
Family
ID=81715648
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210189604.XA Pending CN114564142A (en) | 2022-02-28 | 2022-02-28 | Screen projection control method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114564142A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170131962A1 (en) * | 2015-11-11 | 2017-05-11 | Samsung Electronics Co., Ltd. | Method and device for providing application using external electronic device |
| US20190295498A1 (en) * | 2018-03-23 | 2019-09-26 | Samsung Electronics Co., Ltd. | Method for supporting user input and electronic device supporting the same |
| CN112000306A (en) * | 2020-10-28 | 2020-11-27 | 深圳乐播科技有限公司 | Reverse control method, device, equipment and storage medium for multi-terminal screen projection |
| CN113282262A (en) * | 2021-06-18 | 2021-08-20 | 深圳康佳电子科技有限公司 | Control method and device for screen projection display picture, mobile terminal and storage medium |
-
2022
- 2022-02-28 CN CN202210189604.XA patent/CN114564142A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170131962A1 (en) * | 2015-11-11 | 2017-05-11 | Samsung Electronics Co., Ltd. | Method and device for providing application using external electronic device |
| US20190295498A1 (en) * | 2018-03-23 | 2019-09-26 | Samsung Electronics Co., Ltd. | Method for supporting user input and electronic device supporting the same |
| CN112000306A (en) * | 2020-10-28 | 2020-11-27 | 深圳乐播科技有限公司 | Reverse control method, device, equipment and storage medium for multi-terminal screen projection |
| CN113282262A (en) * | 2021-06-18 | 2021-08-20 | 深圳康佳电子科技有限公司 | Control method and device for screen projection display picture, mobile terminal and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11856322B2 (en) | Display apparatus for image processing and image processing method | |
| US20180375987A1 (en) | Method, apparatus and mobile terminal for device control based on a mobile terminal | |
| CN110368689B (en) | Game interface display method, system, electronic equipment and storage medium | |
| CN108307109B (en) | High dynamic range image preview method and terminal equipment | |
| CN110996175A (en) | Method, device and storage medium for controlling horizontal and vertical screen operation of television | |
| WO2015192631A1 (en) | Video conferencing system and method | |
| KR20130043935A (en) | Method and apparatus for sharing contents between devices | |
| CN112866772B (en) | Display device and sound image character positioning and tracking method | |
| CN112527174B (en) | Information processing method and electronic equipment | |
| CN112527222A (en) | Information processing method and electronic equipment | |
| US11917329B2 (en) | Display device and video communication data processing method | |
| US9740294B2 (en) | Display apparatus and method for controlling display apparatus thereof | |
| CN108881721B (en) | Display method and terminal | |
| US20130169887A1 (en) | Projection Application Device Working Through a Wireless Video Output Device and Its Video Output Control Unit | |
| US20230333803A1 (en) | Enhanced Screen Sharing Method and System, and Electronic Device | |
| CN111338546A (en) | Method for controlling head-mounted display device, terminal and storage medium | |
| CN113963108A (en) | Medical image cooperation method and device based on mixed reality and electronic equipment | |
| KR100676366B1 (en) | Method and system for controlling computer using touchscrren of portable wireless terminal | |
| CN111447598B (en) | Interaction method and display device | |
| KR20070025138A (en) | The space projection presentation system and the same method | |
| CN109542218B (en) | Mobile terminal, human-computer interaction system and method | |
| WO2020134756A1 (en) | Call making method and related device | |
| CN114513689A (en) | Remote control method, electronic equipment and system | |
| CN114564142A (en) | Screen projection control method and device, electronic equipment and storage medium | |
| KR20090093220A (en) | Used the infrared ray camera the space projection presentation system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220531 |