CN111880759A - Control method and device for multi-split screen display picture, display and storage medium - Google Patents

Control method and device for multi-split screen display picture, display and storage medium Download PDF

Info

Publication number
CN111880759A
CN111880759A CN202010782268.0A CN202010782268A CN111880759A CN 111880759 A CN111880759 A CN 111880759A CN 202010782268 A CN202010782268 A CN 202010782268A CN 111880759 A CN111880759 A CN 111880759A
Authority
CN
China
Prior art keywords
display
split screen
split
picture
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010782268.0A
Other languages
Chinese (zh)
Inventor
杨俊辉
杨信
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Jiarun Original Xinxian Technology Co ltd
Original Assignee
Shenzhen Jiarun Original Xinxian Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Jiarun Original Xinxian Technology Co ltd filed Critical Shenzhen Jiarun Original Xinxian Technology Co ltd
Priority to CN202010782268.0A priority Critical patent/CN111880759A/en
Publication of CN111880759A publication Critical patent/CN111880759A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

The invention discloses a control method and a control device for a multi-split screen display picture, a display and a computer readable storage medium, wherein a control cursor in the display picture output by the display is monitored through the display, wherein the display picture is composed of a plurality of split screen pictures; if the fact that the control cursor continuously touches the separation edges of the split screen pictures reaches a preset touch frequency is detected, determining a target split screen picture from the split screen pictures; and switching the control cursor to the target split screen picture to control the target signal equipment corresponding to the target split screen picture. According to the invention, the peripheral control authority of the signal equipment of each multi-split screen display picture of the display is centralized to the display end, so that multi-screen cooperation of one display is achieved, the use cost of a user is effectively saved, and the use experience of the user is improved.

Description

Control method and device for multi-split screen display picture, display and storage medium
Technical Field
The invention relates to the technical field of displays, in particular to a method and a device for controlling a multi-split display picture, a display and a computer readable storage medium.
Background
Display developments in the display field are becoming increasingly diverse and specialized over time. The diversified development of the display is generally shown in that the display has more and more functions and can support wireless screen projection, wireless charging, Bluetooth inverse control and the like; the specialized display development shows that the display can support various specific use scenes, such as mobile office, industrial control equipment display terminals and the like, and can also support customized use requirements, such as peripheral interfaces for providing keyboards, mice and the like.
However, although the existing display can provide various signal interfaces to the outside, even support multi-split display (simultaneously display multiple window interfaces), there still exists a very complicated limitation that peripheral operations can be performed on the images displayed by the Windows of the display, that is, when multiple Windows of the display respectively display images of different systems such as Windows, Android, IOS, etc., if a user wants to control the Windows system image displayed by the display, a separate peripheral needs to be connected to a device outputting the Windows system image, and similarly, if a user wants to control the IOS system interface, a separate peripheral needs to be connected to a device controlling the output IOS system image, and furthermore, even if multiple Windows of the display are images of the same system displayed (all images under the Windows system), if the user wants to control the system images of different Windows, peripheral devices must also be individually connected for the output device of each window system screen.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a method and a device for controlling multi-split display pictures, a display and a computer readable storage medium, aiming at avoiding the limitation of peripheral operation on pictures displayed by each window of the display in the prior art, realizing cross-window and cross-system control under multi-split screens of the display, and saving the use cost.
The embodiment of the invention provides a control method of a multi-split display picture, which is applied to a display and comprises the following steps:
monitoring a control cursor which is connected with the display and is arranged in a display picture output by the display, wherein the display picture consists of a plurality of split screen pictures;
if the fact that the control cursor continuously touches the separation edges of the split screen pictures reaches a preset touch frequency is detected, determining a target split screen picture from the split screen pictures;
and switching the control cursor to the target split screen picture to control the target signal equipment corresponding to the target split screen picture.
Optionally, the step of monitoring a manipulation cursor of a peripheral device connected to the display in a display screen output by the display includes:
acquiring the real-time position of the control cursor in the display picture;
and determining a moving path of the control cursor in the display picture according to the real-time position, and monitoring the moving path.
Optionally, before the step of determining a target split screen image from the split screen images if it is detected that the control cursor continuously touches the separation edges of the split screen images for a preset number of times, the method further includes:
when the separation edges of the multiple split screens are detected to intercept the moving path, determining that the control cursor touches the separation edges.
Optionally, the preset number of touches is greater than or equal to two,
if the fact that the control cursor continuously touches the separation edges of the split screen pictures reaches the preset touch frequency is detected, the step of determining a target split screen picture from the split screen pictures comprises the following steps:
when the separation edge is detected to be continuously intercepted to the moving path within a preset time length, determining that the control cursor continuously touches the separation edge for a preset touch frequency;
and detecting the moving direction of the moving path, and determining the split screen image appointed by the moving direction as a target split screen image in the plurality of split screen images.
Optionally, the step of determining a target split screen picture from the plurality of split screen pictures further includes:
detecting a first split screen picture where the control cursor continuously touches the separation edge;
detecting a second split screen picture adjacent to the first split screen picture by the separation edge among the plurality of split screen pictures;
and determining the second split screen picture as the target split screen picture.
Optionally, the step of switching the control cursor to the target split-screen includes:
and switching the control cursor to the target split screen image from the split screen image where the separation edge is continuously touched for outputting.
Optionally, the step of controlling the target signal device corresponding to the target split-screen picture includes:
when receiving a control instruction of a target signal device corresponding to the appointed target split screen picture, calling an instruction analysis mode of the target signal device;
and analyzing the control instruction according to the instruction analysis mode to obtain operation content, and controlling the target signal equipment according to the control content.
In addition, to achieve the above object, the present invention further provides a multi-split display control device, where the multi-split display control device is applied to a display, and the multi-split display control device is applied to the display, and the multi-split display control device includes:
the monitoring module is used for monitoring a control cursor which is connected with the display and is arranged in a display picture output by the display, wherein the display picture consists of a plurality of split screen pictures;
the determining module is used for determining a target split screen picture from the split screen pictures if the control cursor is detected to continuously touch the separation edges of the split screen pictures for a preset number of times;
and the control module is used for switching the control cursor to the target split screen picture so as to control the target signal equipment corresponding to the target split screen picture.
And when the functional modules of the control device of the multi-split display screen operate, the control method of the multi-split display screen is realized.
Further, to achieve the above object, the present invention also provides a display comprising: the control method comprises the steps of realizing the control method of the multi-split display screen when the control program of the multi-split display screen is executed by the processor.
In addition, to achieve the above object, the present invention further provides a computer readable storage medium, on which a manipulation program of a multi-split display is stored, and when the manipulation program of the multi-split display is executed by a processor, the steps of the method for manipulating the multi-split display are implemented.
The embodiment of the invention provides a method and a device for controlling a multi-split-screen display picture, a display and a computer readable storage medium, wherein a control cursor of an external device connected with the display in the display picture output by the display is monitored through the display, wherein the display picture consists of a plurality of split-screen pictures; if the fact that the control cursor continuously touches the separation edges of the split screen pictures reaches a preset touch frequency is detected, determining a target split screen picture from the split screen pictures; and switching the control cursor to the target split screen picture to control the target signal equipment corresponding to the target split screen picture.
The invention realizes that the peripheral control authority of the respective signal equipment of the multi-split screen display picture of the display is centralized to the display end, and no matter the multiple windows of the display the pictures of the same system or the pictures of different systems displayed simultaneously, the signal equipment for providing the display picture connected with the display can be easily accessed and controlled only according to the peripheral connected with the display end, thereby achieving the multi-screen cooperation of one display, effectively saving the use cost of a user and improving the use experience of the user.
Drawings
Fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a method for controlling a multi-split display according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a method for controlling a multi-split display according to another embodiment of the present invention;
FIG. 4 is a schematic view of an application scenario according to an embodiment of a multi-split display control method of the present invention;
fig. 5 is a functional block diagram of an embodiment of an apparatus for controlling a multi-split display according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: monitoring a control cursor in a display picture output by a display through the display, wherein the display picture is connected with the display and is formed by a plurality of split screen pictures; if the fact that the control cursor continuously touches the separation edges of the split screen pictures reaches a preset touch frequency is detected, determining a target split screen picture from the split screen pictures; and switching the control cursor to the target split screen picture to control the target signal equipment corresponding to the target split screen picture.
At present, there is still a very complicated limitation in performing peripheral operations on the images displayed by each window of the display, that is, when a plurality of Windows of the display respectively display images of different systems such as Windows, Android, IOS, and the like, if a user wants to control the Windows system image displayed by the display, it is necessary to connect a separate peripheral to the device outputting the Windows system image, and similarly, if a user wants to control the IOS system interface, it is necessary to connect a separate peripheral to the device controlling the output of the IOS system image.
The invention provides a solution, which centralizes the peripheral control authority of each signal device of the multi-split screen display image of the display to the display end, so that no matter the multiple windows of the display the image of the same system or the images of different systems displayed simultaneously, the signal devices connected with the display to provide the display image can be easily accessed and controlled only according to the peripheral connected with the display end, thereby achieving the multi-screen cooperation of one display, effectively saving the use cost of users and improving the use experience of users.
As shown in fig. 1, fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention.
The display in the embodiment of the invention can be displays on various network terminal devices with display functions, such as displays on terminal servers and PCs, and can also be mobile terminal devices such as smart phones and tablet computers or non-mobile terminal devices.
As shown in fig. 1, the display may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 does not constitute a limitation of the display and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a manipulation program of a multi-divided screen display.
In the display shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and communicating with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to call a manipulation program of the multi-split display screen stored in the memory 1005, and perform the following operations:
monitoring a control cursor which is connected with the display and is arranged in a display picture output by the display, wherein the display picture consists of a plurality of split screen pictures;
if the fact that the control cursor continuously touches the separation edges of the split screen pictures reaches a preset touch frequency is detected, determining a target split screen picture from the split screen pictures;
and switching the control cursor to the target split screen picture to control the target signal equipment corresponding to the target split screen picture.
Further, the processor 1001 may be configured to call a manipulation program of the multi-split display screen stored in the memory 1005, and further perform the following operations:
acquiring the real-time position of the control cursor in the display picture;
and determining a moving path of the control cursor in the display picture according to the real-time position, and monitoring the moving path.
Further, the processor 1001 may be configured to invoke a manipulation program of a multi-split display stored in the memory 1005, and before determining a target split screen from the plurality of split screens if it is detected that the manipulation cursor continuously touches a separation edge of the plurality of split screens for a preset number of times, perform the following operations:
when the separation edges of the multiple split screens are detected to intercept the moving path, determining that the control cursor touches the separation edges.
Further, the preset number of touches is greater than or equal to two, and the processor 1001 may be configured to invoke a control program of the multi-split display screen stored in the memory 1005, and further perform the following operations:
when the separation edge is detected to be continuously intercepted to the moving path within a preset time length, determining that the control cursor continuously touches the separation edge for a preset touch frequency;
and detecting the moving direction of the moving path, and determining the split screen image appointed by the moving direction as a target split screen image in the plurality of split screen images.
Further, the processor 1001 may be configured to call a manipulation program of the multi-split display screen stored in the memory 1005, and further perform the following operations:
detecting a first split screen picture where the control cursor continuously touches the separation edge;
detecting a second split screen picture adjacent to the first split screen picture by the separation edge among the plurality of split screen pictures;
and determining the second split screen picture as the target split screen picture.
Further, the processor 1001 may be configured to call a manipulation program of the multi-split display screen stored in the memory 1005, and further perform the following operations:
and switching the control cursor to the target split screen image from the split screen image where the separation edge is continuously touched for outputting.
Further, the processor 1001 may be configured to call a manipulation program of the multi-split display screen stored in the memory 1005, and further perform the following operations:
when receiving a control instruction of a target signal device corresponding to the appointed target split screen picture, calling an instruction analysis mode of the target signal device;
and analyzing the control instruction according to the instruction analysis mode to obtain operation content, and controlling the target signal equipment according to the control content.
Based on the hardware structure, embodiments of the method for controlling a multi-split display screen according to the present invention are provided.
It should be noted that, currently, a display capable of supporting multiple split screens cannot implement cross-window use of peripheral devices, for example, when multiple Windows of the display respectively display images of different systems such as a Windows system, an Android system, and an IOS system, a user cannot use one peripheral device to control signal devices corresponding to the different systems, if the user wants to control an image of the Windows system displayed in one window of the display, a separate peripheral device needs to be connected to the signal device that outputs the image of the Windows system, and similarly, if the user wants to display an image of the IOS system displayed in another window of the display, a separate peripheral device needs to be connected to the signal device that outputs the image of the IOS system, and the same also applies to other systems. In addition, even if a plurality of Windows of the display the same system of pictures, for example, each window displays a picture of the Windows system, if a user wants to control an information device outputting the picture displayed by each window, an independent peripheral device must be connected to each Windows device.
In summary, when the current display uses the split-screen function, the peripheral operations of the images displayed by the multiple windows are very complicated, the information devices corresponding to the respective images cannot be operated and controlled by the same peripheral, and when a user wants to operate and control the information devices based on the images displayed by the different windows of the display, the peripheral connected with the respective devices needs to be used, so that the user is very inconvenient to use, and the experience effect is poor.
In view of the above, the following embodiments are proposed in the method for manipulating a multi-split display screen according to the present invention, and in the embodiments, the method for manipulating a multi-split display screen according to the present invention is applied to the display device.
Referring to fig. 2, fig. 2 is a flowchart illustrating a method for controlling a multi-split display according to a first embodiment of the present invention, wherein the method for controlling a multi-split display includes:
step S10, monitoring a control cursor of an external device connected with the display in a display picture output by the display, wherein the display picture consists of a plurality of split screens;
the current display utilizes a plurality of windows to carry out split-screen display on video signals uploaded by a plurality of connected signal devices, so that after a multi-split-screen display picture is formed on a front-end screen of the current display, the current display monitors input type peripheral equipment in the plurality of signal devices in real time, and the real-time coordinate position of a control cursor in the multi-split-screen display picture formed on the front-end screen of the current display.
It should be noted that, in this embodiment, the display provides a plurality of signal interfaces to the outside, such as VGA (video graphics Array, VGA Interface, which is an Interface for outputting analog signals on the display card), DVI (Digital visual Interface, Digital video Interface), HDMI (High Definition Multimedia Interface ), DP (display port, Digital video Interface), Type C (USB Type-C, also called USB-C or Type-C, which is a brand new form of universal serial bus hardware Interface), and so on, so that the signal device can stably project pictures onto the display through each signal Interface.
In addition, based on the development and application of technologies such as wireless screen projection and Wifi inverse control, the multi-split screen display image of the display is not limited to the input signals of the fixed signal ports (the signal interfaces), and the use of the peripheral is not limited to the operation peripheral of the fixed peripheral interface, even not limited to the input peripheral, and the output peripheral such as a bluetooth sound box.
Specifically, for example, please refer to the application scenario shown in fig. 4, a signal processing module, a display module, a power system, a peripheral conversion module, a plurality of signal ports (signal port 1, signal port 2 to signal port N, each signal port being connected to a signal device for inputting a video signal to the current display, respectively, the video signals input by the signal devices through the signal ports are Source1, Source2 to Source N, respectively, and a plurality of interfaces (interface 1, interface 2 to interface N, each interface being connected to a peripheral 1, a peripheral 2 to peripheral N, respectively, which trigger and input a control instruction to the current display), are integrated inside the current display.
The power supply system provides the display module, the signal processing module and the peripheral conversion module with the electric energy required by the operation of the display module, the signal ports are respectively connected with the signal processing module of the current display to process the video signals from Source1, Source2 and Source N input by the signal devices connected with the signal processing module and then transmit the processed video signals to the display module connected with the signal processing module for output display, in addition, the signal processing module and the display module of the current display can be combined together to form the main control module of the display, the main control module can communicate with the peripheral conversion module, the peripheral conversion module is connected with each interface, so as to analyze the control instructions triggered by the peripheral 1, the peripheral 2 and the peripheral N connected with each interface respectively, and obtain the control content of the target signal device in the signal devices connected with the signal processing module through each signal port in the main control module of the current display, then the peripheral conversion module forwards the control content to the main control module, and the main control module can send the control content to the target signal equipment through the corresponding signal port, so that the control of the target signal equipment is realized.
The current display receives video signals input by connected signal devices through signal ports: source1, Source2, through Source n, and convert the video signal: after the Source1 and the Source2 are processed by the signal processing module and output and displayed by the display module to obtain a multi-split screen display picture, the current display starts to monitor the peripherals 1 and 2 connected to each interface in real time to the peripherals N based on the existing mature acquisition mode of peripheral control indexes (such as an arrow formed on the display interface outside a mouse or a character input position cursor output and displayed when a keyboard is arranged on the display interface for outputting and editing a document) and output and display are real-time coordinate positions of the control cursor generated and displayed in the multi-split screen display picture on the current display.
It should be noted that, in another possible embodiment, a wireless screen projection module, a bluetooth module, an NFC (Near Field Communication) module, a Wifi module, and the like may be integrated on the display, so that different signal sources may be displayed in each split-screen window of the current display in a wireless transmission manner, audio information of various signal devices may be quickly decoded and switched, matching between audio and video is ensured, and meanwhile, operation actions and instructions of various wireless peripherals may be respectively analyzed and fed back. Based on wireless transmission technology, can effectively optimize the structure of display, greatly increased connected device's quantity and kind to mould the function of display more powerful, user experience is more excellent.
Step S20, if the control cursor is detected to continuously touch the separation edges of the split screens to reach the preset touch times, determining a target split screen from the split screens;
the current display is in real-time to the input type peripheral hardware that connects, the in-process that the real-time coordinate position of controlling the cursor in the many split screen display picture that forms on the current display front end screen monitors, if the current display detects the real-time coordinate position of should controlling the cursor, touch the mutual separation edge of a plurality of split screen pictures in succession, and the number of times of continuous touching has reached and has predetermine the touching number of times, then the current display is from among these a plurality of split screen pictures promptly, determine the target split screen picture that should control the cursor and need switch output.
Specifically, for example, referring to the application scenario shown in fig. 4, in the process that the current display monitors the peripheral 1, the peripheral 2, and the peripheral N connected to each interface in real time, and the output display of the current display is the real-time coordinate position of the control cursor generated and displayed in the multi-split display screen, if the real-time coordinate position of the control cursor generated and displayed by the peripheral 1-mouse in the multi-split display screen is detected, and the real-time coordinate position falls into the multi-split display screen two times continuously within a short time (e.g. 0.5 second) before and after the real-time coordinate position falls into the coordinate range of the separation edge between two adjacent split screens, it is determined that the control cursor of the peripheral 1-mouse continuously touches the separation edge, so that the current display determines that the user currently controlling the peripheral 1-mouse needs to switch the control cursor to the other split screens of the current terminals of the plurality of split screens for output display, and the current display determines a target split screen picture from two split screen pictures separated by the separation edge continuously touched by the control cursor.
Step S30, the control cursor is switched to the target split screen image to control a target signal device corresponding to the target split screen image.
The current display determines a target split screen picture which is required to be switched and output by a control cursor from a plurality of split screen pictures, then immediately switches the control cursor to the target split screen picture for output and display, then receives a control instruction which is triggered in the target split screen picture by an input type peripheral device corresponding to the control cursor, and controls a target signal device corresponding to the target split screen picture according to the control instruction.
Further, in a possible embodiment, in step S30, the "switching the manipulation cursor to the target split screen" may include:
step S301, switching the control cursor from the split screen image where the separation edge is continuously touched to the target split screen image for output.
Specifically, for example, the display determines, from two split screens separated by the separation edge continuously touched by the control cursor, that the target split screen is a split screen, which is opposite to the first split screen where the control cursor continuously touches the separation edge, of the two split screens, and if the current display outputs two split screens in the front-end screen: and the current display determines the picture B opposite to the picture A as a target split screen picture which is required to be output and displayed by the user through switching the control cursor.
It should be noted that, in this embodiment, when the current display switches the control cursor to the target split screen for output display, the control cursor may be output and displayed in the target split screen from the separation edge of the split screen touched by the control cursor.
Further, in a possible embodiment, in step S30, the step of "performing a manipulation on a target signal device corresponding to the target split screen picture" may include:
step S302, when receiving a control instruction of a target signal device corresponding to the specified target split screen picture, calling an instruction analysis mode of the target signal device;
after the current display switches and displays the control cursor in the target split-screen picture, if an input type peripheral device corresponding to the control cursor is received, aiming at a control instruction triggered by target signal equipment corresponding to the target split-screen picture, the current display immediately calls an instruction analysis mode of the target signal equipment.
It should be noted that, in this embodiment, please refer to the application scenario shown in fig. 4, if the video signals displayed by the target split screen image in the multi-split screen display image formed by the multiple split screen windows of the current display are: the Source1 can determine that the signal device connected to the current display through the signal port 1 and outputting the video signal-Source 1 is the target signal device that needs to be manipulated and designated by the manipulation instruction triggered by the input-type peripheral.
Specifically, for example, after the current display switches and displays the control cursor of the peripheral 1-mouse peripheral to the target split-screen-screen B, if a control instruction that the user triggers "click" for a certain instruction button output and displayed in the screen B based on the mouse peripheral is received, the current display immediately detects the operating system of the target signal device outputting the video signal displayed in the screen B through the peripheral conversion module, and then calls an instruction analysis mode associated with the operating system.
It should be noted that, in this embodiment, each signal device connected to the current display may be based on the same or different operating systems, and each signal device associates its instruction parsing manner with its operating system. For example, if the multi-split display images formed by the current display through the multiple split Windows are all images of a Windows system, it can be determined that each signal device inputting the video signals displayed by the multi-split display images has the same operating system and is a Windows system, and at this time, the display can call the instruction analysis mode associated with the Windows system through the peripheral conversion module; or if the peripheral conversion module of the current display detects that the first window display screen is a screen of a Windows system and the second window display screen is a screen of an iOS system in a multi-split display screen formed by the current display through a plurality of split Windows, determining that each signal device inputting the video signal displayed by the multi-split display screen has different operating systems, and thus when the peripheral conversion module determines that a target signal device pointed by a control instruction triggered by the mouse peripheral received through the interface is a signal device inputting the video signal of the first window display screen, immediately acquiring a communication protocol according to which the signal device establishes connection with the current display through the signal interface, and calling an instruction analysis mode related to the communication protocol.
Step S303, analyzing the control instruction according to the instruction analysis mode to obtain operation content, and controlling the target signal equipment according to the control content.
The current display analyzes the acquired control instruction by calling the acquired instruction analysis mode of the target signal equipment to acquire control content, and then sends the control content to the target signal equipment, so that the target signal equipment executes corresponding operation according to the control content to realize control on the target signal equipment.
Specifically, for example, referring to the application scenario shown in fig. 4, after the peripheral conversion module calls the signal processing module in the current display main control module, and analyzes the control instruction triggered by the user based on the peripheral 1-mouse peripheral connected through the instruction analysis mode corresponding to the target signal device in the signal devices connected to each signal port, so as to obtain the control content for the target signal device, the current display further forwards the control content to the main control module through the peripheral conversion module, and the main control module can send the control content to the target signal device through the corresponding signal port, thereby implementing the control for the target signal device.
In this embodiment, after a multi-split display picture is formed on a front-end screen of the current display by performing split-screen display on video signals uploaded by a plurality of connected signal devices through the current display by using a plurality of windows, the current display monitors input-type peripherals in the plurality of signal devices in real time, and controls a real-time coordinate position of a cursor in the multi-split display picture formed on the front-end screen of the current display; if the current display detects the real-time coordinate position of the control cursor, the separation edges among the multiple split screen pictures are touched continuously, and the continuous touch frequency reaches the preset touch frequency, the current display determines a target split screen picture which is required to be switched and output by the control cursor from the multiple split screen pictures; the current display determines a target split screen picture which is required to be switched and output by a control cursor from a plurality of split screen pictures, then immediately switches the control cursor to the target split screen picture for output and display, then receives a control instruction which is triggered in the target split screen picture by an input type peripheral device corresponding to the control cursor, and controls a target signal device corresponding to the target split screen picture according to the control instruction.
The method comprises the steps that a current display monitors a control cursor in a display picture formed by a plurality of split screen pictures output on the display by a connected peripheral; when the fact that the control cursor continuously touches the separation edges of the split screen images reaches a preset touch frequency is detected, determining a target split screen image needing to be switched and displayed by the control cursor from the split screen images; and then switching the control cursor to a target split screen picture for display and controlling the target signal equipment corresponding to the target split screen picture. The realization, the peripheral hardware of the respective signal device of the multi-split screen display picture of the display controls the authority to concentrate on the display end, no matter a plurality of windows of the display the picture of the same system, or the picture of different systems displayed simultaneously, only need according to the peripheral hardware that the display end connects just can easily visit and control the signal device that the display connects and provides the display picture, the multi-screen cooperation of a display has been reached, effectively save user's use cost, user's use experience has been promoted.
Further, based on the first embodiment, a second embodiment of the method for manipulating a multi-split display according to the present invention is provided, and in the second embodiment of the method for manipulating a multi-split display according to the present invention, the step S10 of monitoring a manipulation cursor in a display outputted by the display from an external device connected to the display may include:
step S101, acquiring the real-time position of the control cursor in the display picture;
step S102, determining a moving path of the control cursor in the display picture according to the real-time position, and monitoring the moving path.
The current display acquires an input type peripheral connected with the current display through a mature coordinate system of a display interface and an acquisition mode of a real-time coordinate position of a peripheral cursor in the coordinate system, outputs a real-time position of a displayed control cursor in a display picture formed by a plurality of split-screen pictures, calculates a moving path formed by the control cursor in the display picture based on a mature algorithm according to the change of the real-time position, and monitors the moving direction, the moving track and the like of the moving path in real time.
Further, referring to fig. 3, in a possible embodiment, in step S20, before determining a target split screen from the plurality of split screen images if the control cursor is detected to continuously touch the separation edges of the plurality of split screen images for a preset number of times, the method for controlling a multi-split screen display according to the present invention may further include:
step S40, when it is detected that a separation edge of the multiple split screens intercepts the moving path, determining that the control cursor touches the separation edge.
In the process that the current display monitors a moving path formed by the control cursor in the display picture in real time, if the moving path is detected to be intercepted by separation edges among a plurality of split screens forming the display picture, the current display immediately determines that the control cursor is currently touching the separation edges.
Specifically, for example, if the current display detects that the control cursor continuously increases the abscissa based on the movement track formed by keeping the ordinate unchanged, the real-time changing abscissa of the control cursor immediately stops continuously increasing when the real-time changing abscissa continuously increases to the range of the abscissa area where the separation edge between the multiple split screens is located, so that the current display immediately determines that the real-time movement path currently formed by the control cursor is intercepted by the separation edge, and thus determines that the user controls the control cursor output in the display screen by the external device at the current moment, and the user is touching the separation edge.
Further, in an embodiment, the step S20, where the preset number of touches is greater than or equal to two, the step S20 may include:
step S201, when the separation edge is detected to continuously intercept the moving path within a preset time, determining that the control cursor continuously touches the separation edge for a preset touch frequency;
it should be noted that, in this embodiment, in order to ensure the accuracy of determining whether the user needs to switch the control cursor to another split-screen display for output by the current display, the number of times that the current display continuously touches the separation edge by detecting the control cursor is at least two, it should be understood that, based on different actual design requirements, in other feasible embodiments, the preset touch number may also be set to other specific numbers of times, and the control method of the multi-split-screen display of the present invention is not limited to the specific number of the preset touch number. In addition, in consideration of the speed at which the user actually operates the mouse to move the operation cursor in the display screen, the preset time duration in this embodiment may be specifically set to 0.5 second, or, based on different design requirements in actual applications, in other feasible embodiments, the preset time duration may also be set to other time durations, and the operation method of the multi-split display screen of the present invention is not limited to a specific numerical value of the preset time duration.
Specifically, for example, when the current display detects a separation edge between multiple split screens, a moving path of the control cursor is intercepted twice continuously within 0.5 second, that is, the control cursor has a moving track formed by continuously increasing the abscissa while keeping the ordinate unchanged, and the abscissa of the control cursor changes in real time is within 0.5 second, and a change condition that the continuously increasing abscissa is stopped in a range of an abscissa area where the separation edge is located is continuously increased in the abscissa occurs twice continuously, and the current display determines that the number of times that the control cursor continuously touches the separation edge reaches a preset number for determining that the user needs to switch the control cursor to other split screens for output.
Step S202, detecting the moving direction of the moving path, and determining the split screen image appointed by the moving direction as a target split screen image in a plurality of split screen images.
The current display determines the moving direction of the moving path based on the obtained coordinate system of the output display picture and the change conditions of the horizontal coordinate and the vertical coordinate in the moving path of the control cursor, and then determines the split screen picture pointed by the moving path in the multiple split screen pictures as a target split screen picture which needs to be switched and is output and displayed in the split screen pictures.
Specifically, for example, in a display picture composed of a plurality of split screens obtained by the current display, a coordinate system is constructed with the leftmost lower corner as the origin of coordinates, so that when the control cursor continuously increases to form a movement track based on keeping the ordinate unchanged and the abscissa, the movement direction of the movement track is horizontal to the right, and thus, when the current display can touch the control cursor on the separation edges between the plurality of split screens based on the mouse peripheral device, the split screens where the control cursor is located are adjacent to each other, and the split screen located on the horizontal right direction of the current split screen is determined as a target split screen picture which the user needs to switch the control cursor to be output and displayed in other split screens.
Further, in another possible embodiment, in the step S20, the "determining a target split screen from the plurality of split screens" may further include:
step S203, detecting a first split screen picture where the control cursor continuously touches the separation edge;
step S204, detecting a second split screen picture adjacent to the first split screen picture through the separation edge in the plurality of split screen pictures;
step S205, determining the second split screen image as the target split screen image.
Specifically, for example, the current display will constitute, among a plurality of split screens of the display screen displayed by the front-end screen output, when the user moves the control cursor based on the mouse peripheral to continuously touch the separation edge between the two split screens of the plurality of split screens, the split screen image where the control cursor is positioned is marked as a first split screen image, then, the current display is in the plurality of split screen images, detecting the adjacent split screen picture of the first split screen picture by controlling the separation edge touched by the cursor, and marking the adjacent split screen picture as a second split screen picture, thereby, when the current display detects that the user moves the control cursor based on the mouse peripheral to continuously touch the separation edge between the first split screen and the second split screen for two times, namely, the second split screen picture is determined as a target split screen picture which is required to be switched to other split screen pictures by the user for output display.
In this embodiment, an input-type peripheral connected to a current display is obtained through a coordinate system of a mature display interface and an obtaining manner of a real-time coordinate position of a peripheral cursor in the coordinate system by the current display, the real-time position of a displayed control cursor is output in a display frame composed of a plurality of split-screen frames, then a moving path formed by the control cursor in the display frame is calculated according to the change of the real-time position based on a mature algorithm, and a moving direction, a moving track and the like of the moving path are monitored in real time; if the moving path is detected to be intercepted by separation edges among a plurality of split screen pictures forming a display picture, the current display immediately determines that the control cursor is currently touching the separation edges; when the separation edge is detected to be continuously intercepted to the moving path within the preset time, determining that the control cursor continuously touches the separation edge to reach the preset touch frequency; then, the current display detects the moving direction of the moving path, and determines the split screen image appointed by the moving direction as a target split screen image which is required to be switched by the control cursor and is output and displayed in the split screen images; or, the current display may further detect a first split screen where the control cursor is located when the control cursor continuously touches the separation edge, and detect a second split screen adjacent to the first split screen through the separation edge in the multiple split screens, and then the current display determines the second split screen as a target split screen that needs to be switched and displayed in the second split screen.
The method and the device have the advantages that based on the real-time coordinate position of the control cursor in the display picture formed by the split-screen pictures, when the condition that the control cursor continuously touches the separation edges among the split-screen pictures to reach the preset touch times is met based on the change of the real-time coordinate position, the target split-screen pictures needing to be switched and output and displayed by the control cursor are determined, the peripheral control authority of the peripheral control equipment of the signal equipment of the split-screen display pictures is concentrated to the display end of the display to be switched by the display, the realization that the peripheral control equipment spans a window and a system and controls the signal equipment of the split-screen display pictures is guaranteed, the use cost of a user can be effectively saved, and the use experience of the user is improved.
In addition, an embodiment of the present invention further provides a multi-split display screen manipulation device, which is applied to the display, and please refer to fig. 5, where fig. 5 shows functional modules of the multi-split display screen manipulation device of the present invention, the multi-split display screen manipulation device includes:
the monitoring module 10 is configured to monitor a control cursor, which is connected to the display and is externally arranged in a display picture output by the display, where the display picture is composed of multiple split-screen pictures;
a determining module 20, configured to determine a target split screen image from the multiple split screen images if it is detected that the control cursor continuously touches separation edges of the multiple split screen images for a preset number of times;
and the control module 30 is configured to switch the control cursor to the target split-screen picture to control a target signal device corresponding to the target split-screen picture.
Preferably, the monitoring module 10 comprises:
the acquisition unit is used for acquiring the real-time position of the control cursor in the display picture;
and the monitoring unit is used for determining the moving path of the control cursor in the display picture according to the real-time position and monitoring the moving path.
Preferably, the determining module 20 of the device for controlling a multi-split display according to the present invention is further configured to determine that the control cursor touches a separation edge of a plurality of split displays when the separation edge is detected to intercept the moving path.
Preferably, the determining module 20 includes:
the first determining unit is used for determining that the control cursor continuously touches the separation edge for a preset touch frequency when the separation edge is detected to continuously intercept the moving path within a preset time length;
and the second determining unit is used for detecting the moving direction of the moving path and determining the split screen image appointed by the moving direction as a target split screen image in the plurality of split screen images.
Preferably, the determining module 20 further includes:
the first detection unit is used for detecting a first split screen picture where the control cursor continuously touches the separation edge;
a second detection unit configured to detect, among the plurality of split screens, a second split screen adjacent to the first split screen by the separation edge;
and the third determining unit is used for determining the second split screen picture as the target split screen picture.
Preferably, the manipulation module 30 includes:
and the switching unit is used for switching the control cursor to the target split screen image from the split screen image where the separation edge is continuously touched for outputting.
Preferably, the manipulation module 30 includes:
the analysis calling unit is used for calling an instruction analysis mode of the target signal equipment when receiving a control instruction of the target signal equipment corresponding to the specified target split screen picture;
and the control unit is used for analyzing the control instruction according to the instruction analysis mode to obtain operation content and controlling the target signal equipment according to the control content.
The specific implementation of each functional module of the device for controlling a multi-split display screen according to the present invention may refer to each embodiment of the method for controlling a multi-split display screen, and will not be described herein again.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, where a control program of a multi-split display is stored on the computer-readable storage medium, and when the control program of the multi-split display is executed by a processor, the steps of the control method of the multi-split display are implemented.
The specific implementation of the computer-readable storage medium of the present invention may refer to each embodiment of the above-mentioned multi-split display screen manipulation method, which is not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (10)

1. The method for controlling the multi-split display picture is applied to a display, and comprises the following steps:
monitoring a control cursor which is connected with the display and is arranged in a display picture output by the display, wherein the display picture consists of a plurality of split screen pictures;
if the fact that the control cursor continuously touches the separation edges of the split screen pictures reaches a preset touch frequency is detected, determining a target split screen picture from the split screen pictures;
and switching the control cursor to the target split screen picture to control the target signal equipment corresponding to the target split screen picture.
2. The method for controlling a multi-split display screen according to claim 1, wherein the step of monitoring a control cursor of an external device connected to the display in the display screen output by the display comprises:
acquiring the real-time position of the control cursor in the display picture;
and determining a moving path of the control cursor in the display picture according to the real-time position, and monitoring the moving path.
3. The method as claimed in claim 2, further comprising, before the step of determining a target split screen from the plurality of split screens if the control cursor is detected to continuously touch the separation edge of the plurality of split screens for a predetermined number of times, the method further comprising:
when the separation edges of the multiple split screens are detected to intercept the moving path, determining that the control cursor touches the separation edges.
4. The method as claimed in claim 2, wherein the predetermined number of touches is greater than or equal to two,
if the fact that the control cursor continuously touches the separation edges of the split screen pictures reaches the preset touch frequency is detected, the step of determining a target split screen picture from the split screen pictures comprises the following steps:
when the separation edge is detected to be continuously intercepted to the moving path within a preset time length, determining that the control cursor continuously touches the separation edge for a preset touch frequency;
and detecting the moving direction of the moving path, and determining the split screen image appointed by the moving direction as a target split screen image in the plurality of split screen images.
5. The method for manipulating a multi-divided screen display according to claim 1, wherein the step of determining a target divided screen from among the plurality of divided screens further comprises:
detecting a first split screen picture where the control cursor continuously touches the separation edge;
detecting a second split screen picture adjacent to the first split screen picture by the separation edge among the plurality of split screen pictures;
and determining the second split screen picture as the target split screen picture.
6. The method for manipulating a multi-split display screen according to claim 1, wherein the step of switching the manipulation cursor to the target split screen comprises:
and switching the control cursor to the target split screen image from the split screen image where the separation edge is continuously touched for outputting.
7. The method for controlling a multi-split display screen according to claim 1, wherein the step of controlling the target signal device corresponding to the target split screen comprises:
when receiving a control instruction of a target signal device corresponding to the appointed target split screen picture, calling an instruction analysis mode of the target signal device;
and analyzing the control instruction according to the instruction analysis mode to obtain operation content, and controlling the target signal equipment according to the control content.
8. The control device for multi-split screen display is applied to a display, and comprises:
the monitoring module is used for monitoring a control cursor which is connected with the display and is arranged in a display picture output by the display, wherein the display picture consists of a plurality of split screen pictures;
the determining module is used for determining a target split screen picture from the split screen pictures if the control cursor is detected to continuously touch the separation edges of the split screen pictures for a preset number of times;
and the control module is used for switching the control cursor to the target split screen picture so as to control the target signal equipment corresponding to the target split screen picture.
9. A display, characterized in that the terminal device comprises: a memory, a processor and a multi-split display control program stored in the memory and executable on the processor, wherein the multi-split display control program, when executed by the processor, implements the steps of the multi-split display control method according to any one of claims 1 to 7.
10. A computer-readable storage medium, wherein the storage medium stores thereon a manipulation program for a multi-split display, and the manipulation program for a multi-split display, when executed by a processor, implements the steps of the method for manipulating a multi-split display according to any one of claims 1 to 7.
CN202010782268.0A 2020-08-05 2020-08-05 Control method and device for multi-split screen display picture, display and storage medium Pending CN111880759A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010782268.0A CN111880759A (en) 2020-08-05 2020-08-05 Control method and device for multi-split screen display picture, display and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010782268.0A CN111880759A (en) 2020-08-05 2020-08-05 Control method and device for multi-split screen display picture, display and storage medium

Publications (1)

Publication Number Publication Date
CN111880759A true CN111880759A (en) 2020-11-03

Family

ID=73210275

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010782268.0A Pending CN111880759A (en) 2020-08-05 2020-08-05 Control method and device for multi-split screen display picture, display and storage medium

Country Status (1)

Country Link
CN (1) CN111880759A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112631538A (en) * 2020-12-30 2021-04-09 安徽鸿程光电有限公司 Display method, device, equipment and computer storage medium
CN113064575A (en) * 2021-04-15 2021-07-02 深圳市诺金系统集成有限公司 Combined ultra-narrow frame touch control all-in-one machine, control method thereof and storage medium
CN114296587A (en) * 2021-12-20 2022-04-08 北京小米移动软件有限公司 Cursor control method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102073375A (en) * 2009-11-24 2011-05-25 联想(北京)有限公司 Portable terminal and display output method thereof
CN107122148A (en) * 2017-03-17 2017-09-01 广州视源电子科技股份有限公司 Remote collaboration method and system
CN107340967A (en) * 2017-07-10 2017-11-10 广州视源电子科技股份有限公司 A kind of smart machine and its operating method and device and computer-readable storage medium
JP2018155985A (en) * 2017-03-21 2018-10-04 株式会社 日立産業制御ソリューションズ Multi Display System
CN110347317A (en) * 2019-06-11 2019-10-18 广州视源电子科技股份有限公司 A kind of windows switching method, device, storage medium and interactive intelligent tablet computer

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102073375A (en) * 2009-11-24 2011-05-25 联想(北京)有限公司 Portable terminal and display output method thereof
CN107122148A (en) * 2017-03-17 2017-09-01 广州视源电子科技股份有限公司 Remote collaboration method and system
JP2018155985A (en) * 2017-03-21 2018-10-04 株式会社 日立産業制御ソリューションズ Multi Display System
CN107340967A (en) * 2017-07-10 2017-11-10 广州视源电子科技股份有限公司 A kind of smart machine and its operating method and device and computer-readable storage medium
CN110347317A (en) * 2019-06-11 2019-10-18 广州视源电子科技股份有限公司 A kind of windows switching method, device, storage medium and interactive intelligent tablet computer

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112631538A (en) * 2020-12-30 2021-04-09 安徽鸿程光电有限公司 Display method, device, equipment and computer storage medium
CN113064575A (en) * 2021-04-15 2021-07-02 深圳市诺金系统集成有限公司 Combined ultra-narrow frame touch control all-in-one machine, control method thereof and storage medium
CN114296587A (en) * 2021-12-20 2022-04-08 北京小米移动软件有限公司 Cursor control method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN111880759A (en) Control method and device for multi-split screen display picture, display and storage medium
US8612641B1 (en) Portable computing device as control mechanism
CN109144396B (en) Touch information processing method, device, equipment and storage medium
US20190129681A1 (en) Wireless Screen Transmission Method, Extension Device, and Wireless Screen Transmission System
CN102662498B (en) A kind of wireless control method of projection demonstration and system
US20130106700A1 (en) Electronic apparatus and input method
US9377901B2 (en) Display method, a display control method and electric device
CN102207748B (en) Electronic equipment and input method
CN109085968B (en) Screen capturing method and terminal equipment
WO2017084470A1 (en) Mobile terminal, input processing method and user equipment, and computer storage medium
CN109407949B (en) Display control method and terminal
CN112099707A (en) Display method and device and electronic equipment
CN108595070B (en) Icon display control method and terminal
CN110768804A (en) Group creation method and terminal device
US20140215347A1 (en) Portable device and control method thereof
CN111414097A (en) Interaction method, interaction system and display equipment
US8738941B2 (en) Computer integral device system and method for integrating a tablet personal computer and a computer host
US10181309B2 (en) Electronic device control method and electronic device
WO2021104285A1 (en) Application control method and electronic device
CN105631059B (en) Data processing method, data processing device and data processing system
CN108196754B (en) Method, terminal and server for displaying object
US10540136B2 (en) Faster frame buffer rendering over a network
US9185448B2 (en) Remote control method, and system, receiving device, mobile internet device and recording medium for implementing the same
CN109976854B (en) Application processing method and terminal equipment
JP2018159984A (en) Screen data relay server, screen data relay program and screen data relay method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination