CN114520806A - Screen application remote control interaction method and system, electronic equipment and storage medium - Google Patents
Screen application remote control interaction method and system, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114520806A CN114520806A CN202210073198.0A CN202210073198A CN114520806A CN 114520806 A CN114520806 A CN 114520806A CN 202210073198 A CN202210073198 A CN 202210073198A CN 114520806 A CN114520806 A CN 114520806A
- Authority
- CN
- China
- Prior art keywords
- screen
- client
- remote control
- server
- application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 107
- 238000000034 method Methods 0.000 title claims abstract description 80
- 230000002452 interceptive effect Effects 0.000 claims abstract description 18
- 238000013507 mapping Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 11
- 230000006870 function Effects 0.000 abstract description 14
- 230000008569 process Effects 0.000 abstract description 7
- 230000009286 beneficial effect Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 2
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
Abstract
The application relates to a screen application remote control interaction method, a screen application remote control interaction system, electronic equipment and a storage medium. Wherein the method comprises the following steps: receiving screen control operation information of a user through a service scene interactive interface; and sending the scene information and the screen control operation information corresponding to the service scene interaction interface to the server so that the server can send the screen control instruction corresponding to the screen control operation information to the screen client corresponding to the scene information. The remote control interaction process is not limited by distance and angle; the screen client can meet the requirements of different service display and complex remote control interaction functions.
Description
Technical Field
The invention relates to the technical field of screen application remote control interaction, in particular to a screen application remote control interaction method, a screen application remote control interaction system, electronic equipment and a storage medium.
Background
The large screen application refers to a software program installed in an operating system of a computer host with a television or connected with a screen, and is used for displaying information on the large screen and sometimes performing interactive operation. The large screen refers to a television screen or a spliced screen with a large size, and is generally arranged on a wall facade or other devices, and due to the size and the position of the large screen, a user or an operator usually has a certain distance from the large screen, and needs to remotely control the large screen, and in the prior art, the remote control interaction modes include the following two modes:
and (4) carrying out remote control interaction by using a television remote controller. The television remote controller generally uses an infrared technology to convert key operation into an infrared signal to be sent out, after an infrared receiver of a television screen receives the infrared signal, a driving program converts the infrared signal into a key event to be transmitted to an operating system, the television screen is developed by the operating system based on the television, and the key event of the television remote controller is monitored to respond; by using the remote control interaction mode, because the television systems of different brands or models support different key events of the television remote controller, the television remote controller needs to be developed aiming at different television systems, and the problems of high development difficulty and high cost are caused; the transmission is carried out through the infrared signals, the transmission distance is short, the infrared signals are seriously influenced by shielding, and strict requirements are imposed on the operation distance and the angle of the television remote controller; the television remote controller has fewer keys, so that the problems of limited screen application interactive function and complex operation are caused.
And (4) carrying out remote control interaction by using a keyboard and a mouse. The keyboard and mouse are generally connected with a television or an external computer host through a cable or a wireless receiver, a keyboard and mouse driver converts transmission signals into corresponding keys or mouse events and transmits the corresponding keys or mouse events to an operating system, the general operating system has standard keyboard and mouse events, and a screen application monitors the general keyboard and mouse events of the system to respond. The remote control interaction mode still has the problems of short effective distance, serious shielding influence on transmission signals, high cost and inconvenient use
The embodiment of the application provides a screen application remote control interaction method, a screen application remote control interaction system, electronic equipment and a storage medium. The remote control client-side carries out remote control interaction with the screen client-side through the server, the remote control interaction process is not limited by distance and angle, and the use is more convenient. The method comprises the steps of establishing a mapping relation between scene information corresponding to a service scene interaction interface of a remote control client and a client identifier of a screen client, so that the screen client can meet the requirements of different service displays and complex remote control interaction functions, the operation is convenient, and the cost can be reduced.
Disclosure of Invention
The embodiment of the application provides a screen application remote control interaction method, a screen application remote control interaction system, electronic equipment and a storage medium. The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosed embodiments. This summary is not an extensive overview and is intended to neither identify key/critical elements nor delineate the scope of such embodiments. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is presented later.
In a first aspect, an embodiment of the present application provides a screen application remote control interaction method, which is applied to a remote control client, and includes:
receiving screen control operation information of a user through a service scene interactive interface;
and sending the scene information and the screen control operation information corresponding to the service scene interaction interface to the server so that the server can send the screen control instruction corresponding to the screen control operation information to the screen client corresponding to the scene information.
Optionally, the method further includes:
and sending the client identification of the remote control client to the server so that the server establishes the control connection between the remote control client and the screen client according to the client identification of the remote control client and the client identification of the screen client.
In a second aspect, an embodiment of the present application provides a screen application remote control interaction method, which is applied to a server, and the method includes:
receiving scene information and screen control operation information sent by a remote control client;
inquiring a client identifier of a target screen client corresponding to the scene information;
converting the screen control operation information into a corresponding screen control instruction;
and sending the screen control instruction to the target screen client according to the client identification.
Optionally, the querying the client identifier of the target screen client corresponding to the scene information includes:
and mapping relation between the scene information and the client identification of the screen client.
Optionally, the server includes an application server and a message server; according to the client identification, the screen control instruction is sent to the target screen client, and the method comprises the following steps:
the screen control instruction is issued to a subscription theme corresponding to the client identification in the message server through the application server;
and if the target screen client is determined to subscribe the subscription theme through the message server, sending the screen control instruction in the subscription theme to the target screen client.
Optionally, the method further includes:
and receiving a client identifier sent by the remote control client and a client identifier sent by the screen client, and establishing control connection between the remote control client and the screen client according to the client identifier of the remote control client and the client identifier of the screen client.
In a third aspect, an embodiment of the present application provides a screen application remote control interaction method, which is applied to a screen client, and the method includes:
sending a subscription request message to a server;
receiving a screen control instruction in a subscription theme corresponding to the subscription request message sent by the server, wherein the screen control instruction is obtained by converting the server according to the screen control operation information of the remote control client;
and executing the control operation corresponding to the screen control instruction.
In a fourth aspect, the present application provides a screen application remote control interaction system, which includes a remote control client, a server and a screen client, wherein,
the remote control client is used for:
receiving screen control operation information of a user through a service scene interactive interface;
sending scene information and screen control operation information corresponding to the service scene interaction interface to a server so that the server can send a screen control instruction corresponding to the screen control operation information to a screen client corresponding to the scene information;
the server is used for:
receiving scene information and screen control operation information sent by a remote control client;
inquiring a client identifier of a target screen client corresponding to the scene information;
converting the screen control operation information into a corresponding screen control instruction;
sending a screen control instruction to a target screen client according to the client identification;
the screen client is used for:
sending a subscription request message to a server;
receiving a screen control instruction in a subscription theme corresponding to the subscription request message sent by the server, wherein the screen control instruction is obtained by converting the server according to the screen control operation information of the remote control client;
and executing the control operation corresponding to the screen control instruction.
In a fifth aspect, an embodiment of the present application provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the method of the first aspect, the second aspect, or the third aspect.
In a sixth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, the program being executed by a processor to implement the method of the first aspect or the second aspect.
The technical scheme provided by the embodiment of the application can have the following beneficial effects:
in the embodiment of the application, the screen application remote control interaction method receives screen control operation information of a user through a service scene interaction interface of a remote control client, and sends the scene information and the screen control operation information corresponding to the service scene interaction interface to a server; after inquiring the client identification of the target screen client corresponding to the scene information, the server converts the screen control operation into a corresponding screen control instruction, sends the screen control instruction to the target screen client through the subscription theme corresponding to the client identification of the target screen client in the server, and executes the control operation corresponding to the screen control instruction by the target screen client. According to the method, the remote control interaction is carried out between the remote control client and the screen client through the server, the remote control interaction process is not limited by distance and angle, and the use is more convenient; the method has the advantages that the mapping relation is established between the scene information corresponding to the service scene interaction interface of the remote control client and the client identification of the screen client, so that the screen client can meet the requirements of different service displays and complex remote control interaction functions, the operation is convenient, and the cost can be reduced.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a schematic structural diagram of a screen application remote control interaction system provided in an embodiment of the present application;
FIG. 2 is a flowchart illustrating a method for remote control interaction of a screen application according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating another screen application remote control interaction method according to an embodiment of the present application;
FIG. 4 is a flowchart illustrating a further method for remote control interaction of a screen application according to an embodiment of the present application;
FIG. 5 is a schematic diagram of an apparatus for remotely controlling an interaction apparatus by a screen application according to an embodiment of the present application;
FIG. 6 is a schematic diagram of an apparatus for remotely controlling an interactive device by using another screen application according to an embodiment of the present application;
FIG. 7 is a schematic diagram of an apparatus for remotely controlling an interaction apparatus by a screen application according to an embodiment of the present application;
fig. 8 is a schematic diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The following description and the drawings sufficiently illustrate specific embodiments of the invention to enable those skilled in the art to practice them.
It should be understood that the described embodiments are only some embodiments of the invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of systems and methods consistent with certain aspects of the invention, as detailed in the appended claims.
In the description of the present invention, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art. In addition, in the description of the present invention, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
The following describes a screen application remote control interaction method, a screen application remote control interaction system, an electronic device and a storage medium proposed in an embodiment of the present application with reference to the accompanying drawings.
In the embodiment of the Application, APP means Application, and generally refers to software installed on a terminal such as a smart phone or a tablet computer; MQTT means Message queue Telemetry Transport protocol Message Queuing Telemetry Transport, which is a client-server based Message publishing/subscribing Transport protocol; JSON means JavaScript Object Notation of the JS Object, is a lightweight data exchange format, and adopts a text format completely independent of a programming language to store and represent data; in the WebSocket API, a browser and a server only need to complete one handshake, and persistent connection can be directly established between the browser and the server to perform bidirectional data transmission; XML means the EXtensible Markup Language, which is a subset of standard generalized Markup languages, and is a Markup Language used to mark electronic documents to be structured.
As shown in fig. 1, the system includes a server, a screen client, and a remote control client, where the server includes an application server and a message server. The remote control client is used for receiving screen control operation information of a user on a service scene interaction interface, the application server is used for inquiring a client identifier of a target screen client corresponding to the scene information of the service scene interaction interface and converting the screen control operation information into a screen control instruction, and the message server is used for transmitting the screen control instruction to the screen client; the screen client is used for executing the control operation corresponding to the screen control instruction. The remote control client can be a mobile phone or a tablet computer and other terminal equipment of a user; the screen client can be a large screen display screen or a mobile phone display screen or other terminal display screens. In fig. 1, only one screen client and one remoting client are schematically shown, and in practical applications, there may be more screen clients and remoting clients.
Based on the system architecture, the remote control client sends scene information and screen control operation information corresponding to the service scene interaction interface to the application server, the application server inquires a target screen client corresponding to the scene information, converts the screen control operation into a screen control instruction, and sends the screen control instruction to the target screen client through the message server, and the target screen client executes the control operation corresponding to the screen control instruction; the remote control interaction process is not limited by distance and angle, and the screen client can meet the requirements of different service display and complex remote control interaction functions.
Before the interaction between the screen client and the remote control client is carried out by the method provided by the application, the application server establishes the control connection between the remote control client and the screen client and the mapping relation between the scene information and the client identification of the screen client, and the screen client acquires the subscription theme of the screen client through the message server.
Specifically, a client identifier is sent to an application server through a remote control client and a screen client, so that the application server establishes control connection between the remote control client and the screen client through the client identifier of the remote control client and the client identifier of the screen client, and a user can control a screen of the screen client through the remote control client; adding a mapping relation between scene information corresponding to a service interaction interface of a remote control client and a client identifier of a screen client in an application server, so that the application server can subsequently inquire a target screen client corresponding to the scene information according to the scene information; the screen client sends subscription request information to the message server, and the message server sends a subscription theme corresponding to the client identifier of the screen client to the screen client, so that the application server can conveniently send a screen control instruction to the target screen client through the subscription theme corresponding to the client identifier of the target screen client in the message server.
By the method, the control connection between the remote control client and the screen client and the mapping relation between the scene information and the client identifier of the screen client are established in the application server, and after the screen client acquires the subscription theme of the screen client through the message server, the target screen client executes the control operation corresponding to the screen control operation information of the user at the remote control client in the mode provided by the embodiment of the application.
The embodiment of the application provides a screen application remote control interaction method which is applied to a remote control client. As shown in fig. 2, the method of the embodiment of the present application may include: s110 and S120.
And S110, receiving screen control operation information of a user through a service scene interactive interface.
In the embodiment of the application, terminal remote control software used by a user, namely a remote control APP, is installed on a remote control client; different service scenes such as intelligent security, intelligent traffic, intelligent robots and the like are displayed on the remote control APP; the remote control APP can be an android version of remote control APP, an IOS version of remote control APP, a Windows version of remote control APP and the like. The remote control client can be a smart phone or a tablet computer and the like; the screen control operation information may be operation information such as button clicking, screen sliding, voice interaction and the like performed by a user on a service scene interaction interface of the remote control client.
And S120, sending the scene information and the screen control operation information corresponding to the service scene interaction interface to the server so that the server can send the screen control instruction corresponding to the screen control operation information to the screen client corresponding to the scene information. The server comprises an application server and a message server; the application server provides interface service for the remote control APP on the remote control client, and the remote control client transmits the scene information and the screen control operation information to the application server by calling the interface of the application server.
In the embodiment of the application, after receiving the scene information and the screen control operation information, the application server queries the client identifier of the target screen client corresponding to the scene information. A system administrator can allocate a client identifier for each screen client, and a mapping relation between the scene information of the service scene interaction interface and the client identifier of the screen client is added in the application server, so that the service scene of the remote control client is linked with the screen client.
In the embodiment of the application, after the client identifier of the target screen client corresponding to the scene information is inquired, the application server converts the screen control operation information into the corresponding screen control instruction. The application server sends the screen control instruction to the target screen client according to the client identifier of the target screen client, specifically, the screen control instruction is issued to a subscription theme corresponding to the client identifier of the target screen client in the message server through the application server, and the screen control instruction in the subscription theme is sent to the target screen client if the message server determines that the target screen client subscribes to the subscription theme. In the embodiment of the application, the client identification of the screen client is used for connecting with the message server, and the topic of the screen client is subscribed through the client identification of the screen client. And the screen client sends a subscription request message to the message server, and the message server sends a subscription theme corresponding to the client identifier of the screen client to the screen client after receiving the subscription request message sent by the screen client.
In the embodiment of the application, after receiving the screen control instruction in the subscription theme corresponding to the subscription request message sent by the application server, the target screen client analyzes the screen control instruction and executes the control operation corresponding to the screen control instruction. The screen client can provide display and interaction functions according to the scene information and the screen control operation information of the remote control client.
In the embodiment of the present application, the instruction message of the screen control instruction may be encoded by using a JSON format, or may also be encoded by using an XML format or a custom format. Encoding is performed using the JSON format, and the data format is defined as follows:
{
"clientId":"xxxx",
"type":"key",
"name":"home",
"code":13,
"service":"xxxx",
"data":""
}
the clientId represents a client identification ID of the screen client, and client identifications of different screen clients are different; type represents an instruction type such as an instruction type key of a key instruction or the like; name represents an instruction string, such as the instruction string home of the identified key; code denotes an instruction code such as an instruction code 13 that determines a key, or the like; service represents service identification and is used for expansion; the data represents data, and the data is defined according to different instruction messages for extension.
In an embodiment of the present application, the method further includes:
and sending the client identification of the remote control client to the server so that the server establishes the control connection between the remote control client and the screen client according to the client identification of the remote control client and the client identification of the screen client. The control connection between the remote control client and the screen client is established through the client identification of the remote control client and the client identification of the screen client, and the corresponding relation between the screen client and the remote control client is determined, so that a user can control a screen of a target screen client through the remote control client, and a server can conveniently inquire the target screen client in the screen client which is in control connection with the remote control client and corresponds to the scene information.
In the embodiment of the application, the remote control client controls the screen of the screen client through the server; the remote control client communicates with an application server in the server through an HTTP protocol, the screen client communicates with a message server in the server through an MQTT protocol, and the screen client can also communicate with the message server through a WebSocket protocol and the like; MQTT protocol message middleware can be selected as a message server, and the message server has the functions of publishing and subscribing the theme messages.
In the embodiment of the application, the remote control client receives screen control operation information of a user through the service scene interaction interface, and sends the scene information and the screen control operation information corresponding to the service scene interaction interface to the server, so that the server can send a screen control instruction corresponding to the screen control operation information to the screen client corresponding to the scene information. The remote control interaction process of the embodiment of the application is not limited by distance and angle; the screen client can meet the requirements of different service display and complex remote control interaction functions.
The embodiment of the application provides a screen application remote control interaction method which is applied to a server. As shown in fig. 3, the method of the embodiment of the present application may include: s210, S220, S230, and S240.
And S210, receiving scene information and screen control operation information sent by the remote control client.
In the embodiment of the application, terminal remote control software used by a user, namely a remote control APP, is installed on a remote control client; different service scenes such as intelligent security, intelligent traffic, intelligent robots and the like are displayed on the remote control APP; the remote control APP can be an android version of remote control APP, an IOS version of remote control APP, a Windows version of remote control APP and the like. The remote control client can be a smart phone or a tablet computer and the like; the screen control operation information may be operation information such as button clicking, screen sliding, voice interaction and the like performed by a user on a service scene interaction interface of the remote control client.
In the embodiment of the application, the remote control client receives the screen control operation information of the user through the service scene interactive interface, and sends the scene information and the screen control operation information corresponding to the service scene interactive interface to the server. The server comprises an application server and a message server; the application server provides interface service for the remote control APP on the remote control client, and the remote control client transmits the scene information and the screen control operation information to the application server by calling an interface of the application server.
And S220, inquiring the client identification of the target screen client corresponding to the scene information. S220 comprises: and mapping relation between the scene information and the client identification of the screen client. In the embodiment of the application, a system administrator allocates a client identifier to each screen client, and adds a mapping relationship between the scene information of the service scene interaction interface and the client identifier of the screen client in the application server, so that the service scene of the remote control client is associated with the screen client.
And S230, after the application server obtains the client identifier of the target screen client, converting the screen control operation information into a corresponding screen control instruction.
And S240, sending the screen control instruction to the target screen client according to the client identifier. Specifically, S240 includes:
and issuing the screen control instruction to a subscription theme corresponding to the client identification of the target screen client in the message server through the application server. And if the target screen client is determined to subscribe the subscription theme through the message server, sending the screen control instruction in the subscription theme to the target screen client. In the embodiment of the application, the client identification of the screen client is used for connecting with the message server, and the topic of the screen client is subscribed through the client identification of the screen client. And the screen client sends a subscription request message to the message server, and the message server sends a subscription theme corresponding to the client identifier of the screen client to the screen client after receiving the subscription request message sent by the screen client.
In the embodiment of the application, after receiving the screen control instruction, the target screen client analyzes the screen control instruction and executes the control operation corresponding to the screen control instruction. The screen client can provide display and interaction functions according to the scene information and the screen control operation information of the remote control client.
In the embodiment of the present application, the instruction message of the screen control instruction may be encoded by using a JSON format, or may also be encoded by using an XML format or a custom format. Encoding is performed using the JSON format, and the data format is defined as follows:
{
"clientId":"xxxx",
"type":"key",
"name":"home",
"code":13,
"service":"xxxx",
"data":""
}
the clientId represents a client identification ID of the screen client, and client identifications of different screen clients are different; type represents an instruction type such as an instruction type key of a key instruction or the like; name represents an instruction string, such as the instruction string home of the identified key; code represents an instruction code such as the instruction code 13 of the determination key or the like; service represents service identification and is used for expansion; the data represents data, and the data is defined according to different instruction messages for extension.
In an embodiment of the present application, the method further includes:
and receiving a client identifier sent by the remote control client and a client identifier sent by the screen client, and establishing control connection between the remote control client and the screen client according to the client identifier of the remote control client and the client identifier of the screen client. The control connection between the remote control client and the screen client is established through the client identification of the remote control client and the client identification of the screen client, and the corresponding relation between the screen client and the remote control client is determined, so that a user can control a screen of a target screen client through the remote control client, and a server can conveniently inquire the target screen client in the screen client which is in control connection with the remote control client and corresponds to the scene information.
In the embodiment of the application, the remote control client controls the screen of the screen client through the server; the remote control client communicates with an application server in the server through an HTTP protocol, the screen client communicates with a message server in the server through an MQTT protocol, and the screen client can also communicate with the message server through a WebSocket protocol and the like; MQTT protocol message middleware can be selected as a message server, and the message server has the functions of publishing and subscribing the theme messages.
In the embodiment of the application, a server receives scene information and screen control operation information sent by a remote control client; the server inquires a client identifier of a target screen client corresponding to the scene information; the server converts the screen control operation information into a corresponding screen control instruction; and the server sends the screen control instruction to the target screen client according to the client identifier of the target screen client. The remote control interaction process of the embodiment of the application is not limited by distance and angle; the screen client can meet the requirements of different service display and complex remote control interaction functions.
The embodiment of the application provides a screen application remote control interaction method which is applied to a screen client. As shown in fig. 4, the method of the embodiment of the present application may include: s310, S320, and S330.
In the embodiment of the application, terminal remote control software used by a user, namely a remote control APP, is installed on a remote control client; different service scenes such as intelligent security, intelligent traffic, intelligent robots and the like are displayed on the remote control APP; the remote control APP can be an android version of remote control APP, an IOS version of remote control APP, a Windows version of remote control APP and the like. The remote control client can be a smart phone or a tablet computer and the like; the screen control operation information may be operation information such as button clicking, screen sliding, voice interaction and the like performed by a user on a service scene interaction interface of the remote control client.
In the embodiment of the application, the remote control client receives the screen control operation information of the user through the service scene interactive interface, and sends the scene information and the screen control operation information corresponding to the service scene interactive interface to the server. The server comprises an application server and a message server; the application server provides interface service for the remote control APP on the remote control client, and the remote control client transmits the scene information and the screen control operation information to the application server by calling the interface of the application server.
In the embodiment of the application, the application server queries the client identifier of the target screen client corresponding to the scene information. A system administrator can allocate a client identifier for each screen client, and a mapping relation between the scene information of the service scene interaction interface and the client identifier of the screen client is added in the application server, so that the service scene of the remote control client is linked with the screen client.
And after the application server inquires the client identification of the target screen client corresponding to the scene information, converting the screen control operation information into a corresponding screen control instruction.
S310, sending a subscription request message to the server. And connecting the client identification of the screen client to a message server, and subscribing the theme of the screen client through the client identification of the screen client. And the screen client sends a subscription request message to the message server, and the message server sends a subscription theme corresponding to the client identifier of the screen client to the screen client after receiving the subscription request message sent by the screen client.
In the embodiment of the application, the application server sends the screen control instruction to the target screen client according to the client identifier of the target screen client. Specifically, the screen control instruction is issued to the subscription theme corresponding to the client identifier of the target screen client in the message server through the application server, and the screen control instruction in the subscription theme is sent to the target screen client when the message server determines that the target screen client subscribes to the subscription theme.
And S320, the target screen client receives a screen control instruction in the subscription theme corresponding to the subscription request message sent by the server, wherein the screen control instruction is obtained by converting the server according to the screen control operation information of the remote control client.
S330, the target screen client analyzes the screen control instruction and executes the control operation corresponding to the screen control instruction. The target screen client can provide display and interaction functions according to the scene information and the screen control operation information of the remote control client.
In the embodiment of the present application, the instruction message of the screen control instruction may be encoded by using a JSON format, or may also be encoded by using an XML format or a custom format. Encoding is performed using the JSON format, and the data format is defined as follows:
{
"clientId":"xxxx",
"type":"key",
"name":"home",
"code":13,
"service":"xxxx",
"data":""
}
the clientId represents a client identifier Id of the screen client, and client identifiers of different screen clients are different; type represents an instruction type such as an instruction type key of a key instruction or the like; name represents an instruction string, such as the instruction string home of the identified key; code denotes an instruction code such as an instruction code 13 that determines a key, or the like; service represents service identification and is used for expansion; data represents data, for extension, defined according to different command messages.
In an embodiment of the present application, the method further includes:
and sending the client identifier of the screen client to the server so that the server establishes the control connection between the remote control client and the screen client according to the client identifier of the remote control client and the client identifier of the screen client. The control connection between the remote control client and the screen client is established through the client identification of the remote control client and the client identification of the screen client, and the corresponding relation between the screen client and the remote control client is determined, so that a user can control a screen of a target screen client through the remote control client, and a server can conveniently inquire the target screen client in the screen client which is in control connection with the remote control client and corresponds to the scene information.
In the embodiment of the application, the remote control client controls the screen of the screen client through the server; the remote control client communicates with an application server in the server through an HTTP protocol, the screen client communicates with a message server in the server through an MQTT protocol, and the screen client can also communicate with the message server through a WebSocket protocol and the like; MQTT protocol message middleware can be selected as a message server, and the message server has the functions of publishing and subscribing the subject messages.
In the embodiment of the application, the screen client sends a subscription request message to the server; the target screen client receives a screen control instruction in a subscription theme corresponding to the subscription request message sent by the server, wherein the screen control instruction is obtained by converting the server according to screen control operation information of the remote control client; and the target screen client executes the control operation corresponding to the screen control instruction. The remote control interaction process is not limited by distance and angle; the screen client can meet the requirements of different service display and complex remote control interaction functions.
The embodiment of the application provides a screen application remote control interaction system. The system is used for executing the screen application remote control interaction provided by any one of the above embodiments. As shown in fig. 1, the system includes: the system comprises a remote control client, a server and a screen client.
The remote control client is used for: receiving screen control operation information of a user through a service scene interactive interface; sending scene information and screen control operation information corresponding to the service scene interaction interface to a server so that the server can send a screen control instruction corresponding to the screen control operation information to a screen client corresponding to the scene information;
the server is used for: receiving scene information and screen control operation information sent by a remote control client; inquiring a client identifier of a target screen client corresponding to the scene information; converting the screen control operation information into a corresponding screen control instruction; sending a screen control instruction to a target screen client according to the client identification;
the screen client is used for: sending a subscription request message to a server; receiving a screen control instruction in a subscription theme corresponding to the subscription request message sent by the server, wherein the screen control instruction is obtained by converting the server according to the screen control operation information of the remote control client; and executing the control operation corresponding to the screen control instruction.
The screen application remote control interaction system provided by the above embodiment of the application and the screen application remote control interaction method provided by the embodiment of the application have the same beneficial effects as the method adopted, operated or realized by the application program stored in the system.
The embodiment of the application provides a screen application remote control interaction device. The device is used for executing the screen application remote control interaction method provided by any one of the above embodiments. As shown in fig. 5, the apparatus includes: a control operation receiving module 410 and a control information transmitting module 420.
A control operation receiving module 410, configured to receive screen control operation information of a user through a service scene interaction interface;
the control information sending module 420 is configured to send the scene information and the screen control operation information corresponding to the service scene interaction interface to the server, so that the server sends the screen control instruction corresponding to the screen control operation information to the screen client corresponding to the scene information.
The screen application remote control interaction device provided by the above embodiment of the application and the screen application remote control interaction method provided by the embodiment of the application have the same beneficial effects as the method adopted, operated or realized by the application program stored in the device.
The embodiment of the application provides a screen application remote control interaction device. The device is used for executing the screen application remote control interaction method provided by any one of the above embodiments. As shown in fig. 6, the apparatus includes: a control information receiving module 510, a query module 520, a conversion module 530, and an instruction transmitting module 540.
A control information receiving module 510, configured to receive scene information and screen control operation information sent by a remote control client;
the query module 520 is configured to query a client identifier of a target screen client corresponding to the scene information;
a converting module 530, configured to convert the screen control operation information into a corresponding screen control instruction;
and the instruction sending module 540 is configured to send the screen control instruction to the target screen client according to the client identifier.
The query module 520 includes: and mapping relation between the scene information and the client identification of the screen client.
The instruction sending module 540 is configured to issue, through the application server, a screen control instruction to a subscription topic corresponding to the client identifier in the message server; determining that the target screen client subscribes to a subscription theme through the message server, and sending a screen control instruction in the subscription theme to the target screen client; the server comprises an application server and a message server.
The screen application remote control interaction device provided by the above embodiment of the application and the screen application remote control interaction method provided by the embodiment of the application have the same beneficial effects as the method adopted, operated or realized by the application program stored in the device.
The embodiment of the application provides a screen application remote control interaction device. The device is used for executing the interaction method provided by any one of the above embodiments. As shown in fig. 7, the apparatus includes: a subscription request sending module 610, an instruction receiving module 620 and an execution module 630.
A subscription request sending module 610, configured to send a subscription request message to a server;
the instruction receiving module 620 is configured to receive a screen control instruction in a subscription theme corresponding to the subscription request message sent by the server, where the screen control instruction is obtained by converting the server according to screen control operation information of the remote control client;
and the execution module 630 is configured to execute a control operation corresponding to the screen control instruction.
The screen application remote control interaction device provided by the above embodiment of the application and the screen application remote control interaction method provided by the embodiment of the application have the same beneficial effects as the method adopted, operated or realized by the application program stored in the device.
The embodiment of the application also provides electronic equipment for executing the screen application remote control interaction method. Please refer to fig. 8, which illustrates a schematic diagram of an electronic device according to some embodiments of the present application. As shown in fig. 8, the electronic apparatus includes: a processor 800, a memory 801, a bus 802 and a communication interface 803, the processor 800, the communication interface 803 and the memory 801 being connected by the bus 802; the memory 801 stores a computer program operable on the processor 800, and the processor 800 executes the screen application remote control interaction method provided by any one of the foregoing embodiments when executing the computer program.
The Memory 801 may include a Random Access Memory (RAM) and a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. The communication connection between the network element of the apparatus and at least one other network element is realized through at least one communication interface 803 (which may be wired or wireless), and the internet, a wide area network, a local network, a metropolitan area network, etc. may be used.
The processor 800 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 800. The Processor 800 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the memory 801, and the processor 800 reads the information in the memory 801 and completes the steps of the method in combination with the hardware thereof.
The electronic equipment provided by the embodiment of the application and the screen application remote control interaction method provided by the embodiment of the application have the same inventive concept and have the same beneficial effects as the method adopted, operated or realized by the electronic equipment.
The present application embodiment further provides a computer-readable storage medium corresponding to the screen application remote control interaction method provided in the foregoing embodiment, where the computer-readable storage medium is an optical disc, and a computer program (i.e., a program product) is stored on the optical disc, and when the computer program is executed by a processor, the computer program may execute the screen application remote control interaction method provided in any foregoing embodiment.
It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory, or other optical and magnetic storage media, which are not described in detail herein.
The computer-readable storage medium provided by the above-mentioned embodiment of the present application and the screen application remote control interaction method provided by the embodiment of the present application have the same beneficial effects as methods adopted, run or implemented by application programs stored in the computer-readable storage medium.
It should be noted that:
in the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the application may be practiced without these specific details. In some instances, well-known structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the application, various features of the application are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the application and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted to reflect the following schematic: this application is intended to cover such departures from the present disclosure as come within known or customary practice in the art to which this invention pertains. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this application.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the application and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
The above description is only for the preferred embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application should be covered within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A screen application remote control interaction method is applied to a remote control client, and comprises the following steps:
receiving screen control operation information of a user through a service scene interactive interface;
and sending the scene information corresponding to the service scene interactive interface and the screen control operation information to a server so that the server can send the screen control instruction corresponding to the screen control operation information to a screen client corresponding to the scene information.
2. The interactive method of claim 1, further comprising:
and sending a client identifier of a remote control client to the server so that the server establishes the control connection between the remote control client and the screen client according to the client identifier of the remote control client and the client identifier of the screen client.
3. A screen application remote control interaction method is applied to a server and comprises the following steps:
receiving scene information and screen control operation information sent by a remote control client;
inquiring a client identification of a target screen client corresponding to the scene information;
converting the screen control operation information into a corresponding screen control instruction;
and sending the screen control instruction to the target screen client according to the client identification.
4. The interaction method according to claim 3, wherein the querying the client identifier of the target screen client corresponding to the scene information includes:
and mapping relation between the scene information and the client identification of the screen client.
5. The interactive method of claim 3, wherein the servers comprise an application server and a message server; the sending the screen control instruction to the target screen client according to the client identifier comprises:
issuing the screen control instruction to a subscription theme corresponding to the client identifier in the message server through the application server;
and if the target screen client is determined to subscribe to the subscription topic through the message server, sending the screen control instruction in the subscription topic to the target screen client.
6. The interaction method of claim 3, wherein the method further comprises:
and receiving a client identifier sent by the remote control client and a client identifier sent by the screen client, and establishing control connection between the remote control client and the screen client according to the client identifier of the remote control client and the client identifier of the screen client.
7. A screen application remote control interaction method is applied to a screen client, and comprises the following steps:
sending a subscription request message to a server;
receiving a screen control instruction in a subscription theme corresponding to the subscription request message sent by the server, wherein the screen control instruction is obtained by converting the server according to screen control operation information of a remote control client;
and executing the control operation corresponding to the screen control instruction.
8. A screen application remote control interactive system is characterized by comprising a remote control client, a server and a screen client, wherein,
the remote control client is used for:
receiving screen control operation information of a user through a service scene interactive interface;
sending scene information corresponding to the service scene interaction interface and the screen control operation information to a server so that the server can send a screen control instruction corresponding to the screen control operation information to a screen client corresponding to the scene information;
the server is configured to:
receiving scene information and screen control operation information sent by a remote control client;
inquiring a client identification of a target screen client corresponding to the scene information;
converting the screen control operation information into a corresponding screen control instruction;
sending the screen control instruction to the target screen client according to the client identification;
the screen client is configured to:
sending a subscription request message to a server;
receiving a screen control instruction in a subscription theme corresponding to the subscription request message sent by the server, wherein the screen control instruction is obtained by converting the server according to screen control operation information of a remote control client;
and executing the control operation corresponding to the screen control instruction.
9. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the computer program to implement the method of any of claims 1-2, 3-6, or 7.
10. A computer-readable storage medium, on which a computer program is stored, characterized in that the program is executed by a processor to implement the method according to any of claims 1-2, 3-6 or 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210073198.0A CN114520806A (en) | 2022-01-21 | 2022-01-21 | Screen application remote control interaction method and system, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210073198.0A CN114520806A (en) | 2022-01-21 | 2022-01-21 | Screen application remote control interaction method and system, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114520806A true CN114520806A (en) | 2022-05-20 |
Family
ID=81596709
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210073198.0A Pending CN114520806A (en) | 2022-01-21 | 2022-01-21 | Screen application remote control interaction method and system, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114520806A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115665123A (en) * | 2022-11-14 | 2023-01-31 | 广东美的暖通设备有限公司 | Exhibition hall large screen control method and system, remote control equipment and server |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107273125A (en) * | 2017-06-13 | 2017-10-20 | 深圳市创维群欣安防科技股份有限公司 | A kind of method and system of long-range toggle screen modes |
| CN108965217A (en) * | 2017-05-17 | 2018-12-07 | 中国科学院软件研究所 | A kind of multi-screen digital video interactive based on C/S framework |
| CN113377318A (en) * | 2021-06-30 | 2021-09-10 | 苏州科达科技股份有限公司 | Display screen control method, device and system |
| CN113608812A (en) * | 2021-08-10 | 2021-11-05 | 湖北亿咖通科技有限公司 | Remote control method, device, system and storage medium |
-
2022
- 2022-01-21 CN CN202210073198.0A patent/CN114520806A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108965217A (en) * | 2017-05-17 | 2018-12-07 | 中国科学院软件研究所 | A kind of multi-screen digital video interactive based on C/S framework |
| CN107273125A (en) * | 2017-06-13 | 2017-10-20 | 深圳市创维群欣安防科技股份有限公司 | A kind of method and system of long-range toggle screen modes |
| CN113377318A (en) * | 2021-06-30 | 2021-09-10 | 苏州科达科技股份有限公司 | Display screen control method, device and system |
| CN113608812A (en) * | 2021-08-10 | 2021-11-05 | 湖北亿咖通科技有限公司 | Remote control method, device, system and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115665123A (en) * | 2022-11-14 | 2023-01-31 | 广东美的暖通设备有限公司 | Exhibition hall large screen control method and system, remote control equipment and server |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100772861B1 (en) | Apparatus and method for providing remote user interface | |
| JP4447318B2 (en) | Bidirectional remote control system | |
| US20050149850A1 (en) | Conversion apparatus and method, accounting method, and script conversion system and method | |
| US8559936B2 (en) | Remote control of a telephone | |
| CN103425494A (en) | Information interaction system of vehicle-mounted terminal and smart mobile terminal | |
| KR20130066069A (en) | Method and system for providing application based on cloud computing | |
| CN108027725B (en) | Method, device and equipment for guiding terminal equipment operation | |
| JP2016541034A (en) | Application execution method and apparatus in wireless communication system | |
| KR101814602B1 (en) | Apparatus for remote controlling and electronic apparatus controlled by thereof remotely | |
| CN104349177A (en) | Method for turning to play multimedia file under desktop cloud, virtual machine and system | |
| US20150056978A1 (en) | Information processing system, information processing method, mobile phone, server, and control methods and control programs thereof | |
| JP2018129747A (en) | Remote control device, controlled device, remote control system, remote control method, controlled method, and program | |
| CN114520806A (en) | Screen application remote control interaction method and system, electronic equipment and storage medium | |
| KR20230085389A (en) | Apparatus and method for providing digital twin service using computer graphics | |
| CN112653915A (en) | Television-based sensing enabling method and device, television and storage medium | |
| CN105812839A (en) | Video stream data acquisition method, page data transmission method, system and network server | |
| KR102612580B1 (en) | Media providing server, method of switching to other centent through a trigger area and computer program | |
| CN111654753B (en) | Application program starting method and display device | |
| CN114745412A (en) | Bidirectional remote procedure calling method, device, equipment and storage medium | |
| CN113316014A (en) | Display device, server and third-party data display control method | |
| US20230231821A1 (en) | Display apparatus and operating method thereof | |
| EP3687116B1 (en) | Monitoring facilities by sensors | |
| CN117596431A (en) | Cross-equipment control method and system based on wireless screen throwing and intelligent television | |
| CN101018230A (en) | Network system based on remote ui protocol and method thereof | |
| CN113747211A (en) | Intelligent remote controller information reading method based on cloud transmission |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |