CN113064567A - Multi-screen-based control method and device - Google Patents

Multi-screen-based control method and device Download PDF

Info

Publication number
CN113064567A
CN113064567A CN202110337660.9A CN202110337660A CN113064567A CN 113064567 A CN113064567 A CN 113064567A CN 202110337660 A CN202110337660 A CN 202110337660A CN 113064567 A CN113064567 A CN 113064567A
Authority
CN
China
Prior art keywords
screen
split screen
split
display
mouse
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110337660.9A
Other languages
Chinese (zh)
Inventor
郑炎坤
吕金华
董正勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Rockchip Electronics Co Ltd
Original Assignee
Rockchip Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rockchip Electronics Co Ltd filed Critical Rockchip Electronics Co Ltd
Priority to CN202110337660.9A priority Critical patent/CN113064567A/en
Publication of CN113064567A publication Critical patent/CN113064567A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a multi-screen-based control method and a multi-screen-based control device, wherein the method comprises the following steps: acquiring a screen rotation trigger signal in equipment where a first split screen is located; and modifying the display direction and the width and the height of the display interface of the second split screen according to the direction of the screen rotation trigger signal, and redrawing the display interface of the second split screen. According to the scheme, after the signal of the sensor in the first sub-screen is controlled, the display directions of other screens can be flexibly controlled, the actual angles of the other screens are not required to be adjusted, the operation flexibility is enhanced, and the user experience is improved.

Description

Multi-screen-based control method and device
Technical Field
The invention relates to the field of software control, in particular to a multi-screen-based control method and device.
Background
At present, most of single-system multi-screen products only support main screen response Gsense (Gravity sensor) rotation, when the Gsense rotates, the interface direction of a main screen rotates along with the main screen, and the directions of other screens are fixed. On some multi-screen conference display equipment, because other secondary screens are larger displays, if the displayed picture direction does not correspond to the secondary screen direction, the picture direction can be adjusted only by adjusting the angle of the screen, so that the operation is troublesome, and the user experience is poor.
Disclosure of Invention
Therefore, it is desirable to provide a multi-screen-based control method and apparatus, which solve the problem of adjusting the sub-screen display screen.
In order to achieve the above object, the present invention provides a multi-screen based control method, which comprises the following steps:
acquiring a screen rotation trigger signal in equipment where a first split screen is located;
and modifying the display direction and the width and the height of the display interface of the second split screen according to the direction of the screen rotation trigger signal, and redrawing the display interface of the second split screen.
Further, the step of modifying the width and height of the display interface of the second split screen comprises the following steps:
and taking the width of the display interface before modification as the height after modification.
Further, the method also comprises the following steps: and keeping the display direction of the display interface of the second split screen unchanged.
Further, the method also comprises the following steps:
acquiring an offset value of the mouse associated with the second split screen in the X direction and an offset value of the mouse associated with the second split screen in the Y direction;
judging whether the display direction of the display interface of the second split screen is a preset rotation direction or not;
if the direction is the preset rotation direction, the deviation value in the X direction and the deviation value in the Y direction are converted, and the mouse pointer of the second split screen responds to the converted deviation value;
otherwise, the mouse pointer of the second split screen directly responds to the offset value of the mouse.
Further, the first split screen and the second split screen are a main screen and an auxiliary screen of the android system.
Further, the screen rotation trigger signal is a gravity sensor signal, a gesture signal or a key signal.
The invention provides a multi-screen-based control system, which comprises a first split-screen device and a second split-screen device, wherein the first split-screen device comprises a memory and a processor, a computer program is stored in the memory, and the computer program realizes the steps of the method according to any embodiment of the invention when being executed by the processor.
Different from the prior art, after the signal of the sensor in the first sub-screen is controlled, the display directions of other screens can be flexibly controlled, the actual angles of the other screens do not need to be adjusted, the operation flexibility is enhanced, and the user experience is improved.
Drawings
FIG. 1 is a flow chart of a method according to an embodiment;
FIG. 2 is a system framework diagram according to an embodiment;
FIG. 3 is a diagram illustrating screen rotation and mouse movement according to an embodiment.
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
Referring to fig. 1 to 3, the present embodiment provides a multi-screen based control method for a device having a first split screen and a second split screen. The first screen splitting device comprises a main processor and an operating system and can acquire the operation of a user. The first screen splitting device also comprises a first split screen, i.e. a first screen, for displaying image content. The second split screen may be a display screen connected to the hardware display interface of the first split screen device (including wired or wireless connections). The method of the invention comprises the following steps: step S101, a screen rotation trigger signal in equipment where the first split screen is located is obtained. The screen rotation trigger signal is a signal indicating that screen rotation is to be performed, and may be set to perform rotation trigger only for the second split screen or to perform rotation trigger for both the first split screen and the second split screen. And S102, modifying the display direction and width and height of the display interface of the second split screen according to the direction of the screen rotation trigger signal, and redrawing the display interface of the second split screen. The display direction of the second split screen may be the same as the direction of the rotation trigger signal, and if the rotation trigger signal is a horizontal signal, the display interface of the second split screen is modified to be in the horizontal direction. The width and height of the display interface can be determined according to the size of the second split screen display. Therefore, the modification of the display interface of the second split screen can be completed through the first split screen device, and the fact that the rotation angle of the second split screen needs to be actually adjusted is avoided. The number of the second sub-screens can be multiple, so that the display directions of other multiple screens can be flexibly controlled, the actual angles of other screens do not need to be adjusted, the operation flexibility is enhanced, and the user experience is improved.
In the present invention, the width and height of the second split screen may be determined by the device of the first split screen. In some embodiments, since the second split screen is horizontally disposed, when the displayed interface is an interface with a narrower width, the width of the display interface before modification can be used as the modified height, and for a place on the display screen where no picture is displayed, a black border can be used for filling.
In some embodiments, if the screen rotation trigger signal is for only the first split screen, the present invention further comprises the steps of: and keeping the display direction of the display interface of the second split screen unchanged. Namely, the display interface condition of the second split screen is not changed.
When the mouse is applied, the first split screen is generally fixed and different, the display direction of the first split screen can be changed, and the mouse can be changed along with the modification of the display direction. If the original horizontal display is performed, the mouse operation is up-down movement, the mouse also moves up-down on the display screen, and after the display direction is changed to be vertical, the mouse moves up-down, the mouse moves left-right on the display screen, so that the user operation is influenced. In order to solve the problem, the invention further comprises the steps of: acquiring an offset value of the mouse associated with the second split screen in the X direction and an offset value of the mouse associated with the second split screen in the Y direction; judging whether the display direction of the display interface of the second split screen is a preset rotation direction or not; if the direction is the preset rotation direction, the deviation value in the X direction and the deviation value in the Y direction are converted, and the mouse pointer of the second split screen responds to the converted deviation value; otherwise, the mouse pointer of the second split screen directly responds to the offset value of the mouse. The conversion is to exchange the X direction (left-right direction) and the Y direction (up-down direction) so that the pointer on the mouse moves in the same way as the original operation mode before rotation after the screen rotates the display direction, thereby not affecting the actual operation and correspondence of the mouse. In some embodiments, the display direction of the mouse pointer may also be kept unchanged when the screen is rotated, that is, the display direction of the mouse pointer is unchanged relative to the hardware screen (non-display screen) of the display screen, as shown in fig. 3, so that the display effect is more friendly.
The split screen of the invention can be different parts corresponding to one system screen, such as the extended display of the existing windows system. Or the system of the present invention may be an android system. The first split screen and the second split screen can be a main screen and an auxiliary screen of the android system respectively. The main screen and the auxiliary screen are connected with different LCD controllers of the android system, and the android system respectively controls the display of the different LCD controllers. The main screen and the auxiliary screen of the android system are two independent screens, correspond to different LCD controllers, can perform independent display and independent operation, and the applications in different screens can only be displayed on the corresponding screens when being created. Therefore, independent display of different split screens can be performed, and independent operation and display of different applications can be realized.
In some embodiments with multiple mice, the invention can further realize the control of different mice with different split screens. For the android system, after a first mouse is inserted, when a second mouse is inserted, the system needs to acquire the device ID of the second mouse; and reserving the first mouse device service and newly creating a second mouse device service, and binding the device ID of the second mouse to the second mouse device service, wherein the second mouse device service comprises a corresponding second mouse pointer, and the second mouse device service acquires corresponding second mouse operation information from the second mouse device ID and responds. Binding the first mouse equipment service with a first split screen, and limiting first mouse operation information responded by the first mouse equipment service in the first split screen; when the second mouse device service is created, the second mouse device service is bound with the second split screen, and second mouse operation information responded by the second mouse device service is limited in the second split screen. Therefore, different split screens can correspond to different mice, the movement and operation of the mice are in the split screens, and different operations of a plurality of split screens and a plurality of mice in one system can be realized. Under the condition of the android main and auxiliary screens, the system is equivalent to a system (namely a single system), but two sets of independent mouse control and display are provided, so that two independent operations of one system are realized, different operation requirements are met, and the hardware investment cost can be reduced. When the number of the split screens is more than two, more hardware cost can be reduced.
The invention does not limit the type of the screen rotation trigger signal, and can be a gravity sensor signal, a gesture signal or a key signal, as shown in fig. 2. Wherein the gravity sensor signal may be a signal of a change in gravity direction; the gesture signal can be a gesture signal analyzed after the camera acquires the gesture image, and can also be a sliding signal touched by the touch screen; the key signal may be a physical key or a screen virtual key signal.
The invention provides a multi-screen-based control system, which comprises a first split-screen device and a second split-screen device, wherein the first split-screen device comprises a memory and a processor, a computer program is stored in the memory, and the computer program realizes the steps of the method according to any embodiment of the invention when being executed by the processor. After the signal of the sensor in the first sub-screen is controlled, the display directions of other screens can be flexibly controlled, the actual angles of the other screens do not need to be adjusted, the operation flexibility is enhanced, and the user experience is improved.
It should be noted that, although the above embodiments have been described herein, the invention is not limited thereto. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present invention.

Claims (7)

1. A multi-screen-based control method is characterized by comprising the following steps:
acquiring a screen rotation trigger signal in equipment where a first split screen is located;
and modifying the display direction and the width and the height of the display interface of the second split screen according to the direction of the screen rotation trigger signal, and redrawing the display interface of the second split screen.
2. A multi-screen-based control method according to claim 1, wherein modifying the width and height of the display interface of the second split screen comprises:
and taking the width of the display interface before modification as the height after modification.
3. The multi-screen-based control method according to claim 1, further comprising the steps of: and keeping the display direction of the display interface of the second split screen unchanged.
4. The multi-screen-based control method according to claim 1, further comprising the steps of:
acquiring an offset value of the mouse associated with the second split screen in the X direction and an offset value of the mouse associated with the second split screen in the Y direction;
judging whether the display direction of the display interface of the second split screen is a preset rotation direction or not;
if the direction is the preset rotation direction, the deviation value in the X direction and the deviation value in the Y direction are converted, and the mouse pointer of the second split screen responds to the converted deviation value;
otherwise, the mouse pointer of the second split screen directly responds to the offset value of the mouse.
5. The multi-screen-based control method according to claim 1, wherein: and the first split screen and the second split screen are a main screen and an auxiliary screen of the android system.
6. The multi-screen-based control method according to claim 1, wherein: the screen rotation trigger signal is a gravity sensor signal, a gesture signal or a key signal.
7. A control system based on many screens which characterized in that: comprising a first screen splitting device and a second screen splitting device, the first screen splitting device comprising a memory, a processor, said memory having stored thereon a computer program which, when executed by the processor, carries out the steps of the method according to any one of claims 1 to 6.
CN202110337660.9A 2021-03-30 2021-03-30 Multi-screen-based control method and device Pending CN113064567A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110337660.9A CN113064567A (en) 2021-03-30 2021-03-30 Multi-screen-based control method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110337660.9A CN113064567A (en) 2021-03-30 2021-03-30 Multi-screen-based control method and device

Publications (1)

Publication Number Publication Date
CN113064567A true CN113064567A (en) 2021-07-02

Family

ID=76564610

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110337660.9A Pending CN113064567A (en) 2021-03-30 2021-03-30 Multi-screen-based control method and device

Country Status (1)

Country Link
CN (1) CN113064567A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113760212A (en) * 2021-09-06 2021-12-07 西安超越申泰信息科技有限公司 Method and device for realizing self-adaptive turning of screen based on win7

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102799370A (en) * 2012-06-29 2012-11-28 珠海金山办公软件有限公司 Method and system for controlling rotation of screen of touch terminal
CN103049235A (en) * 2012-12-04 2013-04-17 深圳市爱渡飞科技有限公司 Method, terminal and system for synchronously displaying multiple-screen images
CN105389111A (en) * 2015-10-28 2016-03-09 维沃移动通信有限公司 Operation method for split-screen display and electronic device
WO2018191900A1 (en) * 2017-04-20 2018-10-25 华为技术有限公司 Display control method and apparatus
CN111240546A (en) * 2019-12-20 2020-06-05 青岛海信移动通信技术股份有限公司 Split screen processing method and communication terminal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102799370A (en) * 2012-06-29 2012-11-28 珠海金山办公软件有限公司 Method and system for controlling rotation of screen of touch terminal
CN103049235A (en) * 2012-12-04 2013-04-17 深圳市爱渡飞科技有限公司 Method, terminal and system for synchronously displaying multiple-screen images
WO2014086117A1 (en) * 2012-12-04 2014-06-12 深圳市同洲电子股份有限公司 Multi-screen synchronous image display method, terminal and system
CN105389111A (en) * 2015-10-28 2016-03-09 维沃移动通信有限公司 Operation method for split-screen display and electronic device
WO2018191900A1 (en) * 2017-04-20 2018-10-25 华为技术有限公司 Display control method and apparatus
CN110462556A (en) * 2017-04-20 2019-11-15 华为技术有限公司 Display control method and device
CN111240546A (en) * 2019-12-20 2020-06-05 青岛海信移动通信技术股份有限公司 Split screen processing method and communication terminal

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113760212A (en) * 2021-09-06 2021-12-07 西安超越申泰信息科技有限公司 Method and device for realizing self-adaptive turning of screen based on win7
CN113760212B (en) * 2021-09-06 2024-03-15 超越科技股份有限公司 Method and device for realizing self-adaptive overturning of screen based on win7

Similar Documents

Publication Publication Date Title
JP6790651B2 (en) Computing device, graph display method of computing device, and program
US20140223490A1 (en) Apparatus and method for intuitive user interaction between multiple devices
JPWO2018198703A1 (en) Display device
JP5384706B2 (en) Multi-touch operation method and system
CN103631551A (en) Local display method for remote desktop in medical consultation system
JP2005148450A (en) Display controller and program
JP5728588B2 (en) Display control method, computer program, display control apparatus, and image display system
CN113064567A (en) Multi-screen-based control method and device
JP2002244635A (en) Picture display device
US20020044156A1 (en) Computer apparatus, display apparatus, display control apparatus, storage medium, program transmission apparatus, and display control method
CN110865718A (en) Method and device for supporting application of input method to multi-screen switching
US20170192673A1 (en) Information processing apparatus, information processing method, and information processing program
CN104285199B (en) Cursor movement control method, computer program, cursor movement control device, and image display system
CN112799526B (en) Method and system for simultaneously displaying and operating multiple mice in single system
JP4089490B2 (en) Image display device, image display method, and image display system
CN102473042B (en) System, method and computer program for operating a plurality of computing devices
JP2004029046A (en) Multi-display control system
JP2014146233A (en) Material sharing program, terminal device, material sharing method
JP5213033B2 (en) Software input key display method, program, and information processing terminal
CN110851066B (en) Method and device for supporting touch control of multiple display screens
JP4681932B2 (en) Touch panel calibration control method, control program, and control apparatus
JP7310980B2 (en) Information processing device, graph display method and program
JP7088260B2 (en) Graph information generator, graph information generation method, graph drawing device, graph drawing method, and program
CN112486330B (en) Display control method, device and equipment
JP2004152034A (en) Window display control device and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210702

RJ01 Rejection of invention patent application after publication