CN115357162A - Method for remotely controlling government affair video consultation - Google Patents
Method for remotely controlling government affair video consultation Download PDFInfo
- Publication number
- CN115357162A CN115357162A CN202210925507.2A CN202210925507A CN115357162A CN 115357162 A CN115357162 A CN 115357162A CN 202210925507 A CN202210925507 A CN 202210925507A CN 115357162 A CN115357162 A CN 115357162A
- Authority
- CN
- China
- Prior art keywords
- control
- controlled
- video
- message
- mouse
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- Human Resources & Organizations (AREA)
- Software Systems (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Data Mining & Analysis (AREA)
- Economics (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a method for remotely controlling government affair video consultation, which relates to the technical field of video remote control; the method comprises the steps of initiating a control application through a control end, forwarding the control application to a controlled end through a server end, establishing a remote control link, intercepting a video picture through a C # service program of the controlled end, sending the video picture to the server end for recording through websocket connection, connecting and forwarding the video picture of the controlled end to the control end through the server end, finishing HTML presentation of the video picture through the control end, monitoring a mouse operation event of a display picture through HTML of the control end, converting the mouse operation event into a message, sending the message to the controlled end through the websocket connection and the server end, receiving the message through the controlled end, simulating the mouse operation event to perform mouse control, monitoring a keyboard operation event of the display picture through HTML of the control end, converting the keyboard operation event into the message, sending the message to the controlled end through the websocket connection and the server end, and receiving the message through the controlled end, simulating the keyboard operation event to perform keyboard control.
Description
Technical Field
The invention discloses a method, relates to the technical field of video remote control, and particularly relates to a method for remotely controlling government affair video consultation.
Background
The government affair service is promoted to be 'across provinces and universes' to be 'done in a combined mode'. For government affair service items needing to be handled by the applicant at different places on site, the handling procedures and running times of the applicant are reduced, the handling processes of the applicant are integrated, the application is handled by one place, the internal cooperation of government departments of various places is changed, the application materials and the archive materials are shared through a nationwide integrated government affair service platform, and the applicant can complete the handling by only one place. A multi-place cooperative transaction mechanism is established, and the transaction flow and the responsibility are clear. The remote communication can basically complete the transaction of the service through the video online, but the remote control is still incomplete due to the fact that the remote parties can only communicate through the video and the white board.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a method for remotely controlling government affair video consultation, and the working efficiency is improved.
The specific scheme provided by the invention is as follows:
the invention provides a method for remote control of government affair video consultation, which initiates a control application through a control end, forwards the control application to a controlled end through a server end, establishes a remote control link,
the video pictures are intercepted by the C # service program of the controlled end and are sent to the server end for recording by the websocket connection, the video pictures of the controlled end are forwarded to the control end by the websocket connection of the server end, the HTML presentation of the video pictures is completed by the control end,
the mouse operation event of the display picture is monitored through HTML of the control terminal, the mouse operation event is converted into a message, the message is transmitted to the controlled terminal through the server terminal through the websocket connection, the message is received by the controlled terminal to simulate the mouse operation event for mouse control,
and monitoring a keyboard operation event of a display picture through HTML of the control end, converting the keyboard operation event into a message, sending the message to the controlled end through the websocket connection and the server end, and receiving the message through the controlled end to simulate the keyboard operation event for keyboard control.
Further, in the method for remotely controlling government affair video consultation, the mouse operation events comprise a mouse pressing event, a mouse moving event and a mouse releasing event, the mouse operation events are converted into messages and sent to the controlled terminal, the messages are received through a C # service program of the controlled terminal, and the mouse operation events are simulated according to the messages.
Further, in the method for remotely controlling government affair video consultation, the keyboard operation events comprise keydown events and keyup events, the keyboard operation events are converted into messages and sent to the controlled end, the messages are received through a C # service program of the controlled end, and the keyboard operation events are simulated according to the messages.
Further, in the method for remotely controlling government affair video consultation, the initiating of the control application by the control terminal and the forwarding of the control application to the controlled terminal by the server terminal include:
and judging whether the control initiating authority exists or not through the server side according to the configuration, and if the control initiating authority exists, forwarding a control application to the controlled side.
Further, in the method for remotely controlling government affair video consultation, the method includes that a video picture captured by a C # service program of a controlled end is sent to a server end for recording by a websocket connection, and the method includes:
the video pictures are intercepted once at the timing of 200-300 milliseconds through the C # service program of the controlled end, and the video pictures are sent to the server end for recording through the websocket connection.
Further, in the method for remotely controlling government affair video consultation, the HTML presentation of the video picture is completed through the control terminal, and the method includes:
and finishing HTML presentation of the video picture by the control end according to 3-5 fps.
Further, in the method for remotely controlling government affair video consultation, the interactive data of the control end and the controlled end is stored through the server end, and the data is inquired according to the authority.
The invention also provides a device for remotely controlling government affair video consultation, which comprises: at least one memory and at least one processor;
the at least one memory to store a machine readable program;
the at least one processor is configured to invoke the machine readable program to perform the claimed method for remotely controlling a government video advisory.
The invention has the advantages that:
the invention provides a method for remotely controlling government affair video consultation, which does not need to independently deploy a server and a client installation package, only needs to update a server file, adds C # hardware simulation and screen capture sending functions to a controlled end, completes picture restoration and capture of mouse and keyboard events by a control end, can customize a special system, and greatly improves work handling efficiency.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic diagram of the application of the method of the present invention.
FIG. 2 is a schematic diagram of the interaction of parties in the method of the present invention.
Detailed Description
The present invention is further described below in conjunction with the following figures and specific examples so that those skilled in the art may better understand the present invention and practice it, but the examples are not intended to limit the present invention.
The invention provides a method for remote control of government affair video consultation, which initiates a control application through a control end, forwards the control application to a controlled end through a server end, establishes a remote control link,
the video picture is intercepted by the C # service program of the controlled end and is sent to the server end for recording by the websocket connection, the video picture of the controlled end is transmitted to the control end by the websocket connection of the server end, the HTML presentation of the video picture is completed by the control end,
the mouse operation event of the display picture is monitored through HTML of the control terminal, the mouse operation event is converted into a message, the message is transmitted to the controlled terminal through the server terminal through the websocket connection, the message is received by the controlled terminal to simulate the mouse operation event for mouse control,
and monitoring a keyboard operation event of a display picture through HTML of the control end, converting the keyboard operation event into a message, sending the message to the controlled end through the websocket connection and the server end, and receiving the message through the controlled end to simulate the keyboard operation event for keyboard control.
In particular applications, in some embodiments of the method of the present invention, reference may be made to the following remote control process:
the control application comprises: in the original video call process, the problem can not be solved through video communication, a remote control operating system can be defined, a control end initiates a control application, a server judges whether the right for initiating control exists or not according to configuration, if the right exists, the request is forwarded to the controlled end, if the controlled end agrees to be controlled, a remote control program is started, a remote control link is established,
and (3) controlling picture updating: after the remote control program is started, the C # service program of the controlled end can intercept a video picture at a fixed time of 200-300 milliseconds, the video picture is sent to the server for recording through the websocket connection, the video picture is forwarded to the control end through the server, the HTML (hypertext markup language) presentation of the picture is finished by the control end, a government affair handling service system does not require a high refresh rate like media playing and games, the HTML presentation of the picture can be finished according to 3-5fps,
carrying out mouse control: the method comprises the following steps that three events of mouse pressing, mouse moving and mouse loosening of a display picture are monitored by HTML of a control end, converted into a message, sent to the controlled end through a websocket, and referred to the following codes:
after receiving the above messages, the controlled end C # service program simulates hardware operation through various system APIs, such as win32API mouse _ event,
and (3) performing keyboard control: the HTML of the control end monitors two events of keydown keyup of a display picture, the two events are converted into messages and are sent to the controlled end through the websocket, and reference codes are as follows:
after receiving the above messages, the controlled end C # service program simulates hardware operation through various system APIs, such as win32API keybd _ event,
the server can be accessed into the actual project user authentication system, whether the control end has remote control setting or not is judged according to the user authority, the image transmission of the controlled end and the mouse and keyboard operation data of the control end are stored, and the complete operation of the control end can be checked afterwards.
In the remote control flow, the functions of the HTML page of the browser at the control end can be displayed by canvas when the JPG data of the video picture is received from the websocket, the operation events of capturing the mouse and the keyboard are sent to the controlled end by the websocket,
the websocket connection transmission data is expanded, the data transmission of the controlled end desktop display, the control end mouse and the keyboard operation is added on the websocket connection,
the controlled end C # service program is used for sending the video picture data of the controlled end to the control end from the websocket connection; after receiving mouse and keyboard operations of a control end from the websocket, hardware events of the mouse and the keyboard are simulated according to different platforms, and corresponding control operations of the mouse and the keyboard are carried out.
The invention also provides a device for remotely controlling government affair video consultation, which comprises: at least one memory and at least one processor;
the at least one memory to store a machine readable program;
the at least one processor is configured to invoke the machine readable program to perform the claimed method for remotely controlling a government video advisory.
The contents of information interaction, readable program process execution and the like of the processor in the device are based on the same concept as the method embodiment of the present invention, and specific contents can be referred to the description in the method embodiment of the present invention, and are not described herein again.
Similarly, the device of the invention does not need to deploy a server and a client installation package independently, only needs to update the files of the server, adds the functions of C # hardware simulation and screen capture sending to the controlled end, completes the picture restoration and the capture of mouse and keyboard events by the control end, can customize a special system, and greatly improves the working efficiency.
It should be noted that not all steps and modules in the above flows and device structures are necessary, and some steps or modules may be omitted according to actual needs. The execution order of the steps is not fixed and can be adjusted as required. The system structures described in the above embodiments may be physical structures or logical structures, that is, some modules may be implemented by the same physical entity, or some modules may be implemented by a plurality of physical entities separately, or some components may be implemented together in a plurality of independent devices.
The above-mentioned embodiments are merely preferred embodiments for fully illustrating the present invention, and the scope of the present invention is not limited thereto. The equivalent substitution or change made by the technical personnel in the technical field on the basis of the invention is all within the protection scope of the invention. The protection scope of the invention is subject to the claims.
Claims (8)
1. A method for remote control of government affair video consultation is characterized in that a control end initiates a control application, the control application is forwarded to a controlled end through a server end, a remote control link is established,
the video pictures are intercepted by the C # service program of the controlled end and are sent to the server end for recording by the websocket connection, the video pictures of the controlled end are forwarded to the control end by the websocket connection of the server end, the HTML presentation of the video pictures is completed by the control end,
the mouse operation event of the display picture is monitored through HTML of the control terminal, the mouse operation event is converted into a message, the message is transmitted to the controlled terminal through the server terminal through the websocket connection, the message is received by the controlled terminal to simulate the mouse operation event for mouse control,
and monitoring a keyboard operation event of a display picture through HTML of a control terminal, converting the keyboard operation event into a message, sending the message to a controlled terminal through a server terminal through websocket connection, and receiving the message through the controlled terminal to simulate the keyboard operation event to control a keyboard.
2. The method for remotely controlling government affair video consultation according to claim 1, wherein the mouse operation events comprise a mouse press event, a mouse moving event and a mouse release event, the mouse operation events are converted into messages and sent to the controlled terminal, and the messages are received through a C # service program of the controlled terminal and are simulated according to the messages.
3. The method as claimed in claim 1, wherein the key operation event includes a keydown event and a keyup event, the key operation event is converted into a message and transmitted to the controlled terminal, the message is received through a C # service program of the controlled terminal and the key operation event is simulated according to the message.
4. The method as claimed in claim 1, wherein the step of initiating the control application by the control end and forwarding the control application to the controlled end via the server end comprises:
and judging whether the control initiating authority exists or not through the server side according to the configuration, and forwarding the control application to the controlled side if the control initiating authority exists.
5. The method for remotely controlling government affair video consultation according to claim 1, wherein the video picture intercepted by the C # service program of the controlled end is sent to the server end for recording by using websocket connection, and the method comprises the following steps:
the video pictures are intercepted once at the timing of 200-300 milliseconds through the C # service program of the controlled end, and the video pictures are sent to the server end for recording through the websocket connection.
6. The method for remotely controlling government affair video consultation according to claim 1, wherein the HTML presentation of the video picture is completed through a control terminal, and the method comprises the following steps:
and finishing HTML presentation of the video picture by the control end according to 3-5 fps.
7. The method for remote control of government affair video consultation according to claim 1, wherein the server side stores the interactive data between the control side and the controlled side, and inquires the data according to the authority.
8. A device for remote control of government affair video consultation is characterized by comprising: at least one memory and at least one processor;
the at least one memory to store a machine readable program;
the at least one processor configured to invoke the machine readable program to perform a method for remotely controlling a video consultation for government affairs according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210925507.2A CN115357162A (en) | 2022-08-03 | 2022-08-03 | Method for remotely controlling government affair video consultation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210925507.2A CN115357162A (en) | 2022-08-03 | 2022-08-03 | Method for remotely controlling government affair video consultation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115357162A true CN115357162A (en) | 2022-11-18 |
Family
ID=84001530
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210925507.2A Pending CN115357162A (en) | 2022-08-03 | 2022-08-03 | Method for remotely controlling government affair video consultation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115357162A (en) |
-
2022
- 2022-08-03 CN CN202210925507.2A patent/CN115357162A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8285807B2 (en) | Method and system for remote industrial factory automation control of a local system | |
| US7092991B2 (en) | Method and system for changing a collaborating client behavior according to context | |
| US7574472B2 (en) | System and method of monitoring video and/or audio conferencing through a rapid-update website | |
| US6880010B1 (en) | Methods, systems, and computer program products that request updated host screen information from host systems in response to notification by servers | |
| JP2002091913A (en) | Remote maintenance system, and maintenance device and supporting device used for the same | |
| CN111444095A (en) | Test platform system and test method of mobile equipment | |
| CN112911320A (en) | Live broadcast method and device, computer equipment and storage medium | |
| CN108347452A (en) | The long-range method and device for obtaining screenshot capture | |
| CN117707702A (en) | Method and system for realizing online IDE | |
| CN115357162A (en) | Method for remotely controlling government affair video consultation | |
| JP3927246B2 (en) | Virtual space information processing device | |
| JPH03224037A (en) | Architecture for server expansion | |
| JP3721070B2 (en) | Internet terminal support method for existing online application and server device | |
| JP2002123785A (en) | Screen display processing method and business processing system | |
| JP4611584B2 (en) | Image data display method, image data display server, image data display program, and recording medium | |
| KR20020083121A (en) | Link display program | |
| JP2002009868A (en) | Information transmission system, information managing device and setting information distribution method | |
| JP6436704B2 (en) | Test execution device, test execution method, and computer program | |
| JP2002073585A (en) | Debugging support device, debugging support method, and recording medium | |
| JP2002095071A (en) | Network system and control method of apparatus | |
| JP2002032241A (en) | Debugging method and debugging device of contents for cellular telephone | |
| JP2907174B2 (en) | User interface system for supervisory control system | |
| JP2005107662A (en) | Www system processing method and system | |
| CN118488230A (en) | Webpage playing system, method and device, electronic equipment and storage medium | |
| JP3491889B2 (en) | Dialogue processing system, data processing device used therefor, dialogue processing method, recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |