CN113934392A - Isolated dual-computer same-screen control method and device, computer equipment and storage medium - Google Patents

Isolated dual-computer same-screen control method and device, computer equipment and storage medium Download PDF

Info

Publication number
CN113934392A
CN113934392A CN202111192079.9A CN202111192079A CN113934392A CN 113934392 A CN113934392 A CN 113934392A CN 202111192079 A CN202111192079 A CN 202111192079A CN 113934392 A CN113934392 A CN 113934392A
Authority
CN
China
Prior art keywords
intranet
extranet
display area
data
network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111192079.9A
Other languages
Chinese (zh)
Inventor
张庭远
吴加彬
陈晓晟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Raymon Technology Co ltd
Original Assignee
Guangdong Raymon Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Raymon Technology Co ltd filed Critical Guangdong Raymon Technology Co ltd
Priority to CN202111192079.9A priority Critical patent/CN113934392A/en
Publication of CN113934392A publication Critical patent/CN113934392A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces

Abstract

The invention relates to a method and a device for controlling the same screen of an isolated dual computer, a computer device and a storage medium, comprising the following steps: acquiring an internal network interface display area and an external network interface display area; acquiring intranet interface data in real time, displaying the intranet interface data in an intranet interface display area, capturing outer network interface video data in real time, and sending and displaying the outer network interface video data in an outer network interface display area; when an internal and external network switching instruction is acquired, generating an external input switching instruction; and acquiring external input data of the keyboard and the mouse, wherein the external input data comprises internal network external input data and external network external input data, and generating internal network external input data or external network external input data corresponding to control operation in an internal network interface display area or an external network interface display area according to an external input switching instruction. The method and the device have the effect of improving the operation convenience when service personnel need to operate two different hosts simultaneously to handle services for users.

Description

Isolated dual-computer same-screen control method and device, computer equipment and storage medium
Technical Field
The invention relates to the technical field of remote control, in particular to a method and a device for controlling isolated double computers on the same screen, computer equipment and a storage medium.
Background
At present, in an office hall, particularly an office hall relating to monetary business, such as a bank office hall and a tax office hall, for information security, an internal network is built to perform interaction and storage of business data such as monetary and user personal information.
At present, with the development of network informatization and related equipment for handling business, for the convenience of handling related business by a user, the equipment for handling related business can be built, and the equipment is installed in each place outside a business handling hall, so that the user can remotely handle related business on the equipment, and the user can handle business without going to the business handling hall, thereby improving the experience of the user. According to the characteristics of the transacted business, service personnel transacting the business need to communicate with the user through video and/or audio, and need to establish a corresponding external network for communication when communicating the video and the audio, and in order to support the service personnel to transact the business of the user simultaneously through the internal network and the external network, a host connected with the internal network and a host connected with the external network need to be carried.
The above prior art solutions have the following drawbacks:
there is room for improvement in that it is inconvenient for a service person in a service hall to operate a host of an internal network and an external network to handle a service for a user.
Disclosure of Invention
In order to improve the operation convenience when service personnel transact business to users, the application provides a method and a device for isolated double-computer same-screen control, computer equipment and a storage medium.
The above object of the present invention is achieved by the following technical solutions:
an isolated dual-computer same-screen control method comprises the following steps:
acquiring intranet display screen information, and performing split screen processing according to the intranet display screen information to obtain an intranet interface display area and an extranet interface display area;
acquiring intranet interface data in real time, displaying the intranet interface data in the intranet interface display area, capturing extranet interface video data in real time, and sending and displaying the extranet interface video data in the extranet interface display area;
when an internal and external network switching instruction is acquired, generating an external input switching instruction;
and acquiring external input data of a keyboard and a mouse, wherein the external input data comprises internal network external input data and external network external input data, and generating internal network external input data or external network external input data corresponding to control operation in the internal network interface display area or the external network interface display area according to the external input switching instruction.
By adopting the technical scheme, in order to realize that service personnel can handle services of users through the internal network and the external network, two hosts are required to be respectively connected with the internal network and the external network, so that two sets of keyboard and mouse and displays are also required to operate, the two displays are respectively connected with the two hosts to be respectively displayed, the space occupying the desktop of the service personnel is compared, and the service personnel need frequent switching operation in operation, so that the operation experience is influenced, therefore, when the application acquires the information of the display screen of the internal network, the video data of the interface of the external network is acquired in real time, the display screen is subjected to split screen processing, the information of the display screen of the internal network is displayed in the display area of the interface of the internal network, the interface of the host of the external network is displayed in the display area of the interface of the external network in a video mode through a screen projection mode, and the interface of the host of the external network can be displayed in the same display, the interface of the host of the internal network and the interface of the host of the external network are displayed simultaneously, so that the desktop space of service personnel can be saved; simultaneously, through being connected with a set of key mouse, and when the external input data of obtaining keyboard and mouse, with external input data position division intranet external input data and external network external input data, and at the external input switching instruction that keyboard and/or mouse triggered, thereby can control same set of key mouse switch control external network host computer or intranet host computer, and then realized same set of key mouse, according to actual need control different host computers, when further realizing reducing service personnel's desktop space, service personnel's convenience has been promoted.
The present application may be further configured in a preferred example to: the internal and external network switching instruction comprises an internal network external network switching instruction and an external network internal network switching instruction, and after the external input switching instruction is generated when the internal and external network switching instruction is acquired, the isolated dual-computer same-screen control method further comprises the following steps of:
acquiring intranet area frame data or extranet area frame data corresponding to the intranet interface display area or the extranet interface display area according to the intranet-extranet-cutting instruction or the extranet-cutting intranet instruction;
and generating corresponding operable area prompt information according to the acquired inner network area frame data or outer network area frame data.
Through adopting above-mentioned technical scheme, because the interface of intranet and extranet is shown simultaneously in same display, simultaneously can switch the control operation of intranet and extranet according to the demand, consequently at same time control intranet host computer or extranet host computer, and when the interface of intranet host computer and extranet host computer is shown simultaneously on same display screen, obtain regional frame data of intranet or extranet, and cut extranet instruction or extranet and cut the intranet instruction and carry out corresponding operational area suggestion information according to this intranet, can be when the service personnel frequently switch the operation of intranet and extranet, the current operational area of suggestion service personnel, thereby service personnel's operation convenience has further been promoted.
The present application may be further configured in a preferred example to: after the step of acquiring intranet interface data in real time and displaying the intranet interface data in the intranet interface display area, capturing extranet interface video data in real time, and sending and displaying the extranet interface video data in the extranet interface display area, the isolated dual-computer on-screen control method further includes:
acquiring an area boundary of the intranet interface display area and the extranet interface display area;
and when the mouse moving operation at the region junction is obtained, adjusting the sizes of the internal network interface display region and the external network interface display region according to the horizontal moving direction of the mouse moving operation.
By adopting the technical scheme, the mouse movement operation is obtained at the region junction, and the size of the region is adjusted according to the movement direction, so that the mouse movement operation can be conveniently checked by service personnel.
The present application may be further configured in a preferred example to: the acquiring of the internal and external network switching instruction comprises:
acquiring a face image of a service person, and acquiring focus data from the face image of the service person;
and generating inner network interface focus data and outer network interface focus data according to the inner network interface display area and the outer network interface display area after the focus data and the size of the area are adjusted, and generating the inner and outer network switching instruction according to the inner network interface focus data or the outer network interface focus data.
By adopting the technical scheme, the service personnel can operate more conveniently by acquiring the facial image of the service personnel, acquiring the view focal data from the facial image of the service personnel, judging whether the interface focused by the sight of the service personnel belongs to an internal network or an external network according to the view focal data and switching the interfaces in sequence; meanwhile, when switching is performed according to the focus data, judgment is performed according to the size of the interface adjusted by the service staff, and therefore switching reliability can be improved when switching is performed according to the focus data.
The present application may be further configured in a preferred example to: the internal and external network switching instruction comprises an internal network external network switching instruction and an external network internal network switching instruction, and the internal and external network switching instruction is generated according to the internal network interface view focal data or the external network interface view focal data and specifically comprises the following steps:
when the view focus data of the internal network interface is obtained, an external network internal network cutting instruction is generated;
when the outer network interface focus data is obtained, calculating the size ratio of an outer network interface according to the inner network interface display area and the outer network interface display area, if the size ratio of the outer network interface exceeds a preset size threshold value, generating an outer network inner network cutting instruction, otherwise, calculating the time for continuously obtaining the outer network interface focus data, and when the time exceeds a preset duration threshold value, generating an inner network outer network cutting instruction.
By adopting the technical scheme, when the service personnel actually transact business, the operation of the intranet is performed in most of time, so that when the switching is performed according to the focus data and the operation of the extranet is performed, the eyesight of the service personnel turns to an interface corresponding to the intranet, namely an extranet intranet switching instruction is generated, and the transaction efficiency can be improved; because a service person may look at an interface of an outer network when operating an inner network, in order to determine whether the service person carelessly looks at the interface of the outer network or needs to switch control of the outer network, whether the service person wants to control the outer network is judged according to the size proportion of the outer network interface, when the size proportion of the outer network interface is smaller than a size threshold, by combining the duration threshold, if the focus data of the outer network interface of the service person is larger than the duration threshold, the service person is judged to need to control the outer network, and an inner network outer network switching instruction is triggered, so that the operation experience of the service person is improved according to the practical application scene of the application.
The second objective of the present invention is achieved by the following technical solutions:
an isolated dual-machine co-screen control device, comprising:
the screen splitting processing module is used for acquiring intranet display screen information and performing screen splitting processing according to the intranet display screen information to obtain an intranet interface display area and an extranet interface display area;
the interface display module is used for acquiring intranet interface data in real time, displaying the intranet interface data in the intranet interface display area, capturing extranet interface video data in real time, and sending and displaying the extranet interface video data in the extranet interface display area;
the switching instruction acquisition module is used for generating an external input switching instruction when acquiring an internal and external network switching instruction;
and the external input switching module is used for acquiring external input data of the keyboard and the mouse, the external input data comprises internal network external input data and external network external input data, and according to the external input switching instruction, internal network external input data or external network external input data corresponding to the control operation of the internal network interface display area or the external network interface display area are generated.
By adopting the technical scheme, in order to realize that service personnel can handle services of users through the internal network and the external network, two hosts are required to be respectively connected with the internal network and the external network, so that two sets of keyboard and mouse and displays are also required to operate, the two displays are respectively connected with the two hosts to be respectively displayed, the space occupying the desktop of the service personnel is compared, and the service personnel need frequent switching operation in operation, so that the operation experience is influenced, therefore, when the application acquires the information of the display screen of the internal network, the video data of the interface of the external network is acquired in real time, the display screen is subjected to split screen processing, the information of the display screen of the internal network is displayed in the display area of the interface of the internal network, the interface of the host of the external network is displayed in the display area of the interface of the external network in a video mode through a screen projection mode, and the interface of the host of the external network can be displayed in the same display, the interface of the host of the internal network and the interface of the host of the external network are displayed simultaneously, so that the desktop space of service personnel can be saved; simultaneously, through being connected with a set of key mouse, and when the external input data of obtaining keyboard and mouse, with external input data position division intranet external input data and external network external input data, and at the external input switching instruction that keyboard and/or mouse triggered, thereby can control same set of key mouse switch control external network host computer or intranet host computer, and then realized same set of key mouse, according to actual need control different host computers, when further realizing reducing service personnel's desktop space, service personnel's convenience has been promoted.
The third purpose of the present application is achieved by the following technical solutions:
a computer device comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, wherein the processor realizes the steps of the isolated dual-computer on-screen control method when executing the computer program.
The fourth purpose of the present application is achieved by the following technical solutions:
a computer-readable storage medium, storing a computer program, which, when executed by a processor, implements the steps of the isolated dual-engine on-screen control method described above.
In summary, the present application includes at least one of the following beneficial technical effects:
1. according to the method and the device, when the intranet display screen information is obtained, the video data of the extranet interface is obtained in real time, and the display screen is subjected to split screen processing, so that the intranet display screen information is displayed in the intranet interface display area, the interface of the extranet host is displayed in the extranet interface display area in a screen projection mode, the interface of the intranet host and the interface of the extranet host can be displayed in the same display, and the desktop space of a service worker can be saved;
2. by connecting a set of key mice, when the external input data of the keyboard and the mouse are obtained, the external input data are separated into internal network external input data and external network external input data, and an external input switching instruction triggered by the keyboard and/or the mouse is input, so that the same set of key mice can be controlled to switch and control an external network host or an internal network host, the same set of key mice is realized, different hosts are controlled according to actual needs, and the convenience of service personnel is improved while the desktop space of the service personnel is further reduced;
3. because the service personnel perform the operation of the intranet most of the time when actually handling the business, when the switching is performed according to the focus data and the operation of the extranet, the eyes of the service personnel turn to an interface corresponding to the intranet, namely, an extranet intranet switching instruction is generated, so that the handling efficiency can be improved; because a service person may look at an interface of an outer network when operating an inner network, in order to determine whether the service person carelessly looks at the interface of the outer network or needs to switch control of the outer network, whether the service person wants to control the outer network is judged according to the size proportion of the outer network interface, when the size proportion of the outer network interface is smaller than a size threshold, by combining the duration threshold, if the focus data of the outer network interface of the service person is larger than the duration threshold, the service person is judged to need to control the outer network, and an inner network outer network switching instruction is triggered, so that the operation experience of the service person is improved according to the practical application scene of the application.
Drawings
Fig. 1 is a flowchart illustrating a method for isolating dual-computer on-screen control according to an embodiment of the present application;
fig. 2 is a flowchart of another implementation of the isolated dual-computer on-screen control method in an embodiment of the present application;
fig. 3 is a flowchart of another implementation of the isolated dual-computer on-screen control method in an embodiment of the present application;
fig. 4 is a flowchart illustrating an implementation of step S30 in the isolated dual-computer co-screen control method according to an embodiment of the present application;
fig. 5 is a flowchart illustrating an implementation of step S32 in the isolated dual-computer on-screen control method according to an embodiment of the present application;
FIG. 6 is a schematic block diagram of an isolated dual-engine on-screen control system according to an embodiment of the present application;
fig. 7 is a schematic diagram of an apparatus in an embodiment of the present application.
Detailed Description
The present application is described in further detail below with reference to the attached drawings.
In an embodiment, as shown in fig. 1, the present application discloses a method for controlling an isolated dual-computer on the same screen, which specifically includes the following steps:
s10: and acquiring intranet display screen information, and performing split screen processing according to the intranet display screen information to obtain an intranet interface display area and an extranet interface display area.
In this embodiment, the intranet display screen information refers to information of a display screen or a display connected to the intranet host. The intranet interface display area is an area used for displaying an interface of an intranet host on the same display screen. The external network interface display area is an area which is used for displaying an interface of an external network host on the same indication screen.
Specifically, pass through the HDMI interface with the display screen, VGA interface or DVI interface etc. connect in the intranet host computer, make the intranet host computer can acquire intranet display screen information, wherein, intranet display screen information can include information such as the size and the resolution ratio of display screen, thereby can transmit the content of intranet host computer show to the display screen through the data line that corresponds the interface, in this embodiment, because the interface that will show the intranet host computer simultaneously in same display screen and the interface of extranet host computer, consequently the display screen adopts the width to be 21: 9 or 32: 9, etc. wide screen. Furthermore, split screen processing is adopted in the display screen, and the display screen is divided into an internal network interface display area and an external network interface display area. And displaying the intranet display screen information transmitted to the display screen in the intranet interface display area.
S20: and acquiring intranet interface data in real time, displaying the intranet interface data in an intranet interface display area, capturing outer network interface video data in real time, and sending and displaying the outer network interface video data in an outer network interface display area.
In this embodiment, the intranet interface data refers to an interface displayed by a host that performs service processing on an internal network. The external network interface video data refers to video data of an interface displayed by a host for performing service handling on an internal network.
Specifically, intranet interface data can be acquired in real time through an intranet host and a display screen connected through an HDMI interface, a VGA interface or a DVI interface and the like, and the intranet interface data is displayed in an intranet interface display area; meanwhile, the video acquisition card is connected, namely the input end of the video acquisition card is connected with the external network host through an HDMI port to acquire an interface of the external network host, and the output end of the video acquisition card is connected with the internal network host through a USB port to form external network interface video data on the section of the acquired external network host and display the external network interface video data in an external network interface display area of a display screen, wherein the video acquisition card can adopt video acquisition cards of models LJN-CJQ002, LJN-CJQ003, LJN-CJQ004 or LJN-CJQ005 and the like, or other video acquisition cards with an HDMI input end and a USB output end.
S30: and when the internal and external network switching instruction is acquired, generating an external input switching instruction.
In this embodiment, the intranet/extranet switching instruction is an instruction for switching a switching request from operating the intranet host to operating the extranet host or from operating the extranet host to operating the intranet host. The external input switching instruction refers to an instruction for switching the external input device to the corresponding external network host or the internal network host for operation.
Specifically, when the service personnel actually operate, the intranet host needs to be switched to the extranet host, or the extranet host needs to be switched to the intranet host for operation, the service personnel triggers the intranet/extranet switching instruction. In this embodiment, the manner for the service person to trigger the internal and external network switching instruction may be to press an alt key of a keyboard, then move a cursor of a mouse to an internal network interface display area or an external network interface display area, and trigger the internal and external network switching instruction, or to integrate a switching button at an interface of an internal network host and an interface of an external network host, and the service person may click the button to trigger the internal and external network switching instruction.
Further, in the application, each pair of the intranet host and the extranet host is only connected with one set of the keyboard and the mouse, so that when the intranet host or the extranet host is operated, the intranet host or the extranet host acquires data of the keyboard and the mouse, and when an extranet switching instruction is acquired, according to specific content of the extranet switching instruction, namely, the intranet host is switched to the extranet host or the extranet host is switched to the intranet host, a corresponding external input switching instruction is generated, so that the intranet host or the extranet host can acquire input data of the keyboard and the mouse when the intranet host or the extranet host is switched.
S40: and acquiring external input data of the keyboard and the mouse, wherein the external input data comprises internal network external input data and external network external input data, and generating internal network external input data or external network external input data corresponding to control operation in an internal network interface display area or an external network interface display area according to an external input switching instruction.
In this embodiment, the external input data refers to data input by a keyboard and a mouse connected between the intranet host and the extranet host. The intranet external input data and the extranet external input data are respectively data of a keyboard and a mouse acquired by an intranet host or an extranet host.
Specifically, a KVM switch is connected between each pair of the intranet host and the extranet host in advance, that is, an RS232 serial module is added to the KVM switch, and the KVM switch is connected to the intranet host and the extranet host through the RS232 serial module to acquire an external input switching instruction, and meanwhile, a USB port of the KVM switch is connected to the intranet host and the extranet host through the KVM switch to acquire corresponding intranet external input data and corresponding extranet external input data.
Further, after the keyboard and the mouse are connected to the KVM switch device through the USB cable, the external input data is acquired, and when the intranet and intranet host or the extranet host triggers an intranet and extranet switching instruction, the internal and extranet switching instruction is sent to the KVM switch device through the RS232 serial port, and then the corresponding intranet and extranet external input data or extranet external input data is switched and acquired according to specific content of the intranet and extranet switching instruction.
In this embodiment, since two hosts are required to be connected to the intranet and the extranet respectively in order to enable the service personnel to handle the service of the user through the intranet and the extranet, two sets of keyboard and mouse and a display are also required to operate, the two displays are connected to the two hosts respectively for displaying respectively, and occupy the desktop space of the service personnel relatively, and the service personnel need frequent switching operation in operation, thereby affecting the operation experience, the application acquires the intranet display screen information, simultaneously acquires the extranet interface video data in real time, and performs split screen processing on the display screen, thereby displaying the intranet display screen information in the intranet interface display area, and displays the interface of the intranet host and the interface of the extranet host in the same display through video mode, thereby saving the space of the desktop of the service personnel; simultaneously, through being connected with a set of key mouse, and when the external input data of obtaining keyboard and mouse, with external input data position division intranet external input data and external network external input data, and at the external input switching instruction that keyboard and/or mouse triggered, thereby can control same set of key mouse switch control external network host computer or intranet host computer, and then realized same set of key mouse, according to actual need control different host computers, when further realizing reducing service personnel's desktop space, service personnel's convenience has been promoted.
In an embodiment, as shown in fig. 2, the intranet/extranet switching instruction includes an intranet-to-extranet instruction and an extranet-to-intranet instruction, and after step S30, the isolated dual-computer on-screen control method further includes:
s301: and acquiring intranet area frame data or extranet area frame data corresponding to the intranet interface display area or the extranet interface display area according to the intranet-to-extranet instruction or the extranet-to-extranet instruction.
In this embodiment, the intranet area frame data and the extranet area frame data refer to frames corresponding to the intranet interface display area and the extranet interface display area, respectively.
Specifically, after the intranet-extranet switching instruction is obtained, that is, the service person is currently operating the intranet host and wants to switch to operating the extranet host, the frame of the extranet interface display area is obtained and used as the extranet area frame data, and meanwhile, the logic and steps for obtaining the intranet area frame data according to the intranet-extranet switching instruction are the same as those for obtaining the extranet area frame data, and are not repeated here.
S302: and generating corresponding operable area prompt information according to the obtained internal network area frame data or external network area frame data.
Specifically, after acquiring the frame data of the internal network region or the frame data of the external network region, the frame is highlighted as the operable region prompt information to prompt the service person that the internal network host or the external network host is performing the operation. Understandably, when the service personnel actually operate, aiming at the intranet host or the extranet host which is actually operated by the service personnel, highlight prompt is carried out on corresponding intranet area frame data or extranet area frame data.
In an embodiment, as shown in fig. 3, after step S20, the method for isolating the dual-computer on-screen control further includes:
s201: and acquiring an area boundary of the internal network interface display area and the external network interface display area.
Specifically, the area boundary is obtained from the intersection of the intranet interface display area and the extranet interface display area, and when the display screen is subjected to split screen processing, the intranet interface display area and the extranet interface display area obtained after the split screen processing are set to be the interface size adjustable setting. Further, the intersection of the internal network interface display area and the external network interface display area is set as the area boundary.
S202: and when the mouse moving operation at the region junction is obtained, adjusting the size of the region of the internal network interface display region and the external network interface display region according to the horizontal moving direction of the mouse moving operation.
Specifically, after the operation of mouse clicking and dragging is acquired at the boundary of the area, the data of the mouse moving operation is triggered.
Further, after the mouse moving operation is obtained, namely, the service personnel clicks and drags the mouse at the region junction, and hopes to adjust the size of the intranet interface display region or the extranet interface display region, the horizontal moving direction of the mouse is obtained from the mouse moving operation, and then the size of the region is adjusted according to the horizontal moving direction. When the service person adjusts the area size of the intranet interface display area or the extranet interface display area, the direction in which the mouse is controlled to move is difficult to move strictly in the horizontal direction, and therefore, when the mouse is moved, the direction in which the mouse is moved may be separated from the direction in which the mouse is moved, and the area size may be adjusted.
In an embodiment, as shown in fig. 4, in step S30, the acquiring the intranet/extranet switching instruction includes:
s31: and acquiring a face image of the service person, and acquiring the focus data from the face image of the service person.
In this embodiment, the attendant face image refers to an image of the face of the attendant in front of the display screen, who is handling business. The angle-of-view data refers to data of a position at which the line of sight of the service person is focused.
Specifically, different from the step S30 in which the internal and external network switching instruction is triggered by clicking a keyboard or a mouse, the application may also determine that the service person is operating or desires to operate the host computer according to the focused position of the line of sight of the service person in the display screen and according to whether the focused position is in the internal network interface display area or the external network interface display area.
Furthermore, the distance between the head habit and the display of different service personnel during service handling can be counted in advance through an image recognition mode, the distance between the head habit and the display of the service personnel can be judged according to the size of the display screen, the different distances between the head habit and the display of the service personnel during service handling and the image of the face of the service personnel obtained through personnel focusing training, and the focusing recognition model of the specific position of the head habit and the display of the service personnel can be judged.
Furthermore, a camera device is installed above the display and connected to the external network host, so that on one hand, the camera device can perform remote video conversation on a user handling business remotely through the camera device, and on the other hand, the camera device can acquire facial images of service staff in real time.
Further, the face image of the service person is input into the focus identification model, so that the focus data of the service person is obtained.
S32: and generating the inner network interface focus data and the outer network interface focus data according to the inner network interface display area and the outer network interface display area after the focus data and the size of the area are adjusted, and generating an inner and outer network switching instruction according to the inner network interface focus data or the outer network interface focus data.
Specifically, according to the obtained view-focus data and the specific distance between the head of the service person and the display, the specific position of the service person for realizing focusing in the display is obtained.
Further, if the specific position is an intranet interface display area, generating intranet interface view focal data, and otherwise, generating extranet interface view focal data. It can be understood that, according to the description of the steps S201 to S202 in the present application, the intranet interface display area and the extranet interface display area can be adjusted according to the requirement of the service personnel, and therefore, when determining whether to trigger the intranet interface focus data, the corresponding replacement can be performed according to the interface size adjusted by the service personnel.
In an embodiment, as shown in fig. 5, in step S32, that is, the internal and external network switching instruction includes an internal network switching instruction and an external network switching instruction, and the generating the internal and external network switching instruction according to the internal network interface focus data or the external network interface focus data specifically includes:
s321: and when the view focus data of the intranet interface is obtained, generating an intranet cutting instruction of the extranet.
Specifically, when a service person is operating an external network host, if the internal network interface focus data is acquired, it is indicated that the sight of the service person shifts to the internal network interface display area, and in an actual application scene, the service person is mainly operating the content in the internal network host, and therefore when it is determined that the sight of the service person shifts from the external network interface display area to the internal network interface display area, the external network intranet switching instruction is generated.
S322: and when the outer network interface focus data is acquired, calculating the size ratio of the outer network interface according to the inner network interface display area and the outer network interface display area, if the size ratio of the outer network interface exceeds a preset size threshold value, generating an outer network inner network switching instruction, otherwise, calculating the time for continuously acquiring the outer network interface focus data, and if the time exceeds a preset time threshold value, generating an inner network outer network switching instruction.
Specifically, when a service person is operating an intranet host, if focus data of an extranet interface is acquired, it is described that the sight of the service person shifts to an extranet interface display area, and since in an actual application scenario, the extranet host is usually only to make the service person perform an audio-video call with a user, and mainly operates the intranet host, when focus data of the extranet interface is acquired, it is necessary to further confirm whether a triggered intranet-cut-extranet instruction is an intention that the service person really wants to express, it is possible to acquire a proportion of the entire interface occupied by the extranet interface display area, if the proportion is greater than a preset size threshold, such as 55%, 60%, or 65%, and since a person usually wants to operate an interface, if the initial size of the interface is small, the person may increase the size of the interface, therefore, if the proportion of the size of the display area of the external network interface exceeds a size threshold value, it can be shown that the service personnel may want to operate the external network host, and then the internal network switching instruction of the external network is triggered; if the size ratio is smaller than the size threshold, acquiring time for continuously acquiring the view focus data of the external network interface, namely time for the service personnel to look at the external network interface display area, and if the time is larger than the duration threshold, generating an internal network external network switching instruction.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
In an embodiment, an isolated dual-computer on-screen control device is provided, and the isolated dual-computer on-screen control device corresponds to the isolated dual-computer on-screen control method in the above embodiment one to one. As shown in fig. 6, the isolated dual-computer on-screen control device includes a split-screen processing module, an interface display module, a switching instruction obtaining module, and an external input switching module. The functional modules are explained in detail as follows:
the screen splitting processing module is used for acquiring intranet display screen information and performing screen splitting processing according to the intranet display screen information to obtain an intranet interface display area and an extranet interface display area;
the interface display module is used for acquiring intranet interface data in real time, displaying the intranet interface data in an intranet interface display area, capturing extranet interface video data in real time, and sending and displaying the extranet interface video data in the extranet interface display area;
the switching instruction acquisition module is used for generating an external input switching instruction when acquiring an internal and external network switching instruction;
and the external input switching module is used for acquiring external input data of the keyboard and the mouse, the external input data comprises internal network external input data and external network external input data, and internal network external input data or external network external input data corresponding to control operation in the internal network interface display area or the external network interface display area are generated according to an external input switching instruction.
Optionally, the intranet and extranet switching instruction includes that the intranet cuts the extranet instruction and the extranet cuts the intranet instruction, and keep apart double-computer and with screen controlling means still includes:
the frame acquisition module is used for acquiring intranet area frame data or extranet area frame data corresponding to the intranet interface display area or the extranet interface display area according to the intranet-extranet-cutting instruction or the extranet-cutting intranet instruction;
and the frame prompting module is used for generating corresponding operable area prompting information according to the obtained internal network area frame data or external network area frame data.
Optionally, the isolation dual-computer same-screen control device further includes:
the boundary acquisition module is used for acquiring an area boundary of an internal network interface display area and an external network interface display area;
and the area adjusting module is used for adjusting the sizes of the internal network interface display area and the external network interface display area according to the horizontal moving direction of the mouse moving operation when the mouse moving operation at the area junction is obtained.
Optionally, the switching instruction obtaining module includes:
the facial image acquisition sub-module is used for acquiring facial images of service personnel and acquiring focus data from the facial images of the service personnel;
and the view focus switching submodule is used for generating the view focus data of the internal network interface and the view focus data of the external network interface according to the view focus data and the internal network interface display area and the external network interface display area after the size of the area is adjusted, and generating an internal and external network switching instruction according to the view focus data of the internal network interface or the view focus data of the external network interface.
Optionally, the view-focus switching sub-module includes:
the intranet switching unit is used for generating an extranet intranet switching instruction when the intranet interface focus data is obtained;
and the outer network switching unit is used for calculating the size ratio of the outer network interface according to the inner network interface display area and the outer network interface display area when the outer network interface focus data is acquired, generating an outer network switching inner network instruction if the size ratio of the outer network interface exceeds a preset size threshold, otherwise calculating the time for continuously acquiring the outer network interface focus data, and generating an inner network switching outer network instruction if the time exceeds a preset time threshold.
For specific limitation of the isolated dual-computer on-screen control device, reference may be made to the above limitation on the isolated dual-computer on-screen control method, which is not described herein again. All modules in the isolated dual-computer same-screen control device can be completely or partially realized through software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 7. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing instructions for controlling switching between the internal network and the external network and a model for identifying switching between the view and the focus. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to realize an isolated dual-computer same-screen control method.
In one embodiment, a computer device is provided, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
acquiring intranet display screen information, and performing split screen processing according to the intranet display screen information to obtain an intranet interface display area and an extranet interface display area;
acquiring intranet interface data in real time, displaying the intranet interface data in an intranet interface display area, capturing outer network interface video data in real time, and sending and displaying the outer network interface video data in an outer network interface display area;
when an internal and external network switching instruction is acquired, generating an external input switching instruction;
and acquiring external input data of the keyboard and the mouse, wherein the external input data comprises internal network external input data and external network external input data, and generating internal network external input data or external network external input data corresponding to control operation in an internal network interface display area or an external network interface display area according to an external input switching instruction.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
acquiring intranet display screen information, and performing split screen processing according to the intranet display screen information to obtain an intranet interface display area and an extranet interface display area;
acquiring intranet interface data in real time, displaying the intranet interface data in an intranet interface display area, capturing outer network interface video data in real time, and sending and displaying the outer network interface video data in an outer network interface display area;
when an internal and external network switching instruction is acquired, generating an external input switching instruction;
and acquiring external input data of the keyboard and the mouse, wherein the external input data comprises internal network external input data and external network external input data, and generating internal network external input data or external network external input data corresponding to control operation in an internal network interface display area or an external network interface display area according to an external input switching instruction.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.

Claims (10)

1. An isolated dual-computer same-screen control method is characterized by comprising the following steps:
acquiring intranet display screen information, and performing split screen processing according to the intranet display screen information to obtain an intranet interface display area and an extranet interface display area;
acquiring intranet interface data in real time, displaying the intranet interface data in the intranet interface display area, capturing extranet interface video data in real time, and sending and displaying the extranet interface video data in the extranet interface display area;
when an internal and external network switching instruction is acquired, generating an external input switching instruction;
and acquiring external input data of a keyboard and a mouse, wherein the external input data comprises internal network external input data and external network external input data, and generating internal network external input data or external network external input data corresponding to control operation in the internal network interface display area or the external network interface display area according to the external input switching instruction.
2. The isolated dual-computer on-screen control method according to claim 1, wherein the intranet and extranet switching instruction comprises an intranet-to-extranet instruction and an extranet-to-intranet instruction, and after the external input switching instruction is generated when the intranet and extranet switching instruction is obtained, the isolated dual-computer on-screen control method further comprises:
acquiring intranet area frame data or extranet area frame data corresponding to the intranet interface display area or the extranet interface display area according to the intranet-extranet-cutting instruction or the extranet-cutting intranet instruction;
and generating corresponding operable area prompt information according to the acquired inner network area frame data or outer network area frame data.
3. The isolated dual-computer on-screen control method according to claim 1, wherein after the step of acquiring intranet interface data in real time and displaying the intranet interface data in the intranet interface display area, and capturing extranet interface video data in real time and sending and displaying the extranet interface video data in the extranet interface display area, the isolated dual-computer on-screen control method further comprises:
acquiring an area boundary of the intranet interface display area and the extranet interface display area;
and when the mouse moving operation at the region junction is obtained, adjusting the sizes of the internal network interface display region and the external network interface display region according to the horizontal moving direction of the mouse moving operation.
4. The isolated dual-computer on-screen control method according to claim 3, wherein the acquiring the internal and external network switching instruction comprises:
acquiring a face image of a service person, and acquiring focus data from the face image of the service person;
and generating inner network interface focus data and outer network interface focus data according to the inner network interface display area and the outer network interface display area after the focus data and the size of the area are adjusted, and generating the inner and outer network switching instruction according to the inner network interface focus data or the outer network interface focus data.
5. The isolated dual-computer on-screen control method according to claim 4, wherein the internal and external network switching instruction includes an internal network switching instruction and an external network switching instruction, and the generating the internal and external network switching instruction according to the internal network interface view focus data or the external network interface view focus data specifically includes:
when the view focus data of the internal network interface is obtained, an external network internal network cutting instruction is generated;
when the outer network interface focus data is obtained, calculating the size ratio of an outer network interface according to the inner network interface display area and the outer network interface display area, if the size ratio of the outer network interface exceeds a preset size threshold value, generating an outer network inner network cutting instruction, otherwise, calculating the time for continuously obtaining the outer network interface focus data, and when the time exceeds a preset duration threshold value, generating an inner network outer network cutting instruction.
6. The utility model provides an keep apart double-computer with screen controlling means which characterized in that, keep apart double-computer with screen controlling means includes:
the screen splitting processing module is used for acquiring intranet display screen information and performing screen splitting processing according to the intranet display screen information to obtain an intranet interface display area and an extranet interface display area;
the interface display module is used for acquiring intranet interface data in real time, displaying the intranet interface data in the intranet interface display area, capturing extranet interface video data in real time, and sending and displaying the extranet interface video data in the extranet interface display area;
the switching instruction acquisition module is used for generating an external input switching instruction when acquiring an internal and external network switching instruction;
and the external input switching module is used for acquiring external input data of the keyboard and the mouse, the external input data comprises internal network external input data and external network external input data, and according to the external input switching instruction, internal network external input data or external network external input data corresponding to the control operation of the internal network interface display area or the external network interface display area are generated.
7. The isolated dual-computer on-screen control device according to claim 6, wherein the intranet and extranet switching instruction comprises an intranet-to-extranet instruction and an extranet-to-intranet instruction, and the isolated dual-computer on-screen control device further comprises:
a frame obtaining module, configured to obtain intranet area frame data or extranet area frame data corresponding to the intranet interface display area or the extranet interface display area according to the intranet-extranet-cutting instruction or extranet-cutting instruction;
and the frame prompting module is used for generating corresponding operable area prompting information according to the acquired internal network area frame data or external network area frame data.
8. The isolated dual-computer on-screen control device of claim 6, further comprising:
the boundary acquisition module is used for acquiring the area boundary of the internal network interface display area and the external network interface display area;
and the area adjusting module is used for adjusting the area sizes of the intranet interface display area and the extranet interface display area according to the horizontal moving direction of the mouse moving operation when the mouse moving operation at the area junction is obtained.
9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the isolated dual on-screen control method according to any one of claims 1 to 5 when executing the computer program.
10. A computer-readable storage medium, storing a computer program, wherein the computer program, when executed by a processor, implements the steps of the isolated dual-computer on-screen control method according to any one of claims 1 to 5.
CN202111192079.9A 2021-10-13 2021-10-13 Isolated dual-computer same-screen control method and device, computer equipment and storage medium Pending CN113934392A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111192079.9A CN113934392A (en) 2021-10-13 2021-10-13 Isolated dual-computer same-screen control method and device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111192079.9A CN113934392A (en) 2021-10-13 2021-10-13 Isolated dual-computer same-screen control method and device, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
CN113934392A true CN113934392A (en) 2022-01-14

Family

ID=79278883

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111192079.9A Pending CN113934392A (en) 2021-10-13 2021-10-13 Isolated dual-computer same-screen control method and device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113934392A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101140496A (en) * 2007-10-23 2008-03-12 深圳市迅雷网络技术有限公司 Method and device for regulating column frame
CN105005427A (en) * 2014-04-23 2015-10-28 中兴通讯股份有限公司 Window management method and apparatus
WO2017179889A1 (en) * 2016-04-11 2017-10-19 (주)테크온비젼 Screen partitioning monitor
CN107479799A (en) * 2016-11-09 2017-12-15 广州酷狗计算机科技有限公司 A kind of method and apparatus of display window
CN108681677A (en) * 2018-05-14 2018-10-19 深圳市永达电子信息股份有限公司 Based on the double net computer methods of USB interface security isolation, apparatus and system
CN108932052A (en) * 2018-03-29 2018-12-04 北京硬壳科技有限公司 It shows equipment and shows the exchange method of equipment
CN108958587A (en) * 2018-07-06 2018-12-07 Oppo广东移动通信有限公司 split screen processing method, device, storage medium and electronic equipment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101140496A (en) * 2007-10-23 2008-03-12 深圳市迅雷网络技术有限公司 Method and device for regulating column frame
CN105005427A (en) * 2014-04-23 2015-10-28 中兴通讯股份有限公司 Window management method and apparatus
WO2017179889A1 (en) * 2016-04-11 2017-10-19 (주)테크온비젼 Screen partitioning monitor
CN107479799A (en) * 2016-11-09 2017-12-15 广州酷狗计算机科技有限公司 A kind of method and apparatus of display window
CN108932052A (en) * 2018-03-29 2018-12-04 北京硬壳科技有限公司 It shows equipment and shows the exchange method of equipment
CN108681677A (en) * 2018-05-14 2018-10-19 深圳市永达电子信息股份有限公司 Based on the double net computer methods of USB interface security isolation, apparatus and system
CN108958587A (en) * 2018-07-06 2018-12-07 Oppo广东移动通信有限公司 split screen processing method, device, storage medium and electronic equipment

Similar Documents

Publication Publication Date Title
CN112230758B (en) Frame rate adjustment method, device, equipment and computer readable storage medium
US10802581B2 (en) Eye-tracking-based methods and systems of managing multi-screen view on a single display screen
US10521872B2 (en) Watermark adjustment method and device
US9965039B2 (en) Device and method for displaying user interface of virtual input device based on motion recognition
EP3342160B1 (en) Display apparatus and control methods thereof
US9195345B2 (en) Position aware gestures with visual feedback as input method
US10516830B2 (en) Guided image composition on mobile devices
US11416068B2 (en) Method and apparatus for human-computer interaction in display device, and computer device and storage medium
JP5344651B2 (en) Information processing apparatus, control method, program, and information processing system
CN107229409A (en) The operating method and device of remote virtual desktop system
US10719660B1 (en) Collaborative document creation
CN106648398B (en) Display control method and device
CN113010136B (en) Method and system for intelligently amplifying shared desktop and readable storage medium
US20210117048A1 (en) Adaptive assistive technology techniques for computing devices
WO2023273138A1 (en) Display interface selection method and apparatus, device, storage medium, and program product
US20140298205A1 (en) Program, Communication Apparatus and Control Method
US10831338B2 (en) Hiding regions of a shared document displayed on a screen
CN113282262B (en) Control method and device for projection display picture, mobile terminal and storage medium
US11348264B1 (en) Capturing content on writing surfaces using depth and image sensing
CN113918070A (en) Synchronous display method and device, readable storage medium and electronic equipment
CN113934392A (en) Isolated dual-computer same-screen control method and device, computer equipment and storage medium
CN112860212A (en) Volume adjusting method and display device
CN112835506B (en) Display device and control method thereof
US11226681B2 (en) Gaze-based human interface controls
CN114879872A (en) Display method, display device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination