CN109101173B - Screen layout control method, device, equipment and computer readable storage medium - Google Patents
Screen layout control method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN109101173B CN109101173B CN201810150446.0A CN201810150446A CN109101173B CN 109101173 B CN109101173 B CN 109101173B CN 201810150446 A CN201810150446 A CN 201810150446A CN 109101173 B CN109101173 B CN 109101173B
- Authority
- CN
- China
- Prior art keywords
- touch input
- screen
- sub
- screen layout
- touch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a screen layout control method, a device, equipment and a computer readable storage medium, wherein the method comprises the following steps: receiving and recognizing a first touch input on any sub-screen; when the first touch input meets a first preset condition, executing a screen layout adjusting instruction so as to place the screen layout of a signal source operated by the first touch input on a screen into an adjustable mode; receiving and identifying a second touch input on the sub-screen where the first touch input is positioned, and adjusting the screen layout of a signal source operated by the first touch input on the screen according to the identification result of the second touch input; receiving and identifying a third touch input on other sub-screens except the sub-screen where the first touch input is located; and when the third touch input meets a second preset condition, executing a screen layout recovery instruction to recover the screen layout of the signal source operated by the first touch input on the screen or recover the screen layout of the whole screen.
Description
Technical Field
The invention relates to the technical field of human-computer interaction, in particular to a screen layout control method, a device and equipment and a calculation and readable storage medium.
Background
With the advent of the information age, human-information interaction technology plays an increasingly important role, wherein a multi-screen display system is one of the most modern video tools nowadays, and has been widely applied to various fields due to the intuitiveness of the multi-screen display system.
When a multi-screen display system is implemented, a human-computer interaction technology is indispensable, which directly affects the use efficiency, the operation difficulty and intuitiveness of the multi-screen display system and the applicability of different occasions. In the prior art, when a multi-screen display system is implemented, often one screen needs to be provided with one mouse and one keyboard, and a user can only operate and control the display content on the corresponding screen through the mouse or the keyboard, but cannot operate and control other screens, so that the use efficiency is low, the operation is complicated, and the interaction among a plurality of screens is inconvenient and quick.
Disclosure of Invention
In view of the above, the invention provides a screen layout control method, device, equipment and computer readable storage medium.
In one aspect, an embodiment of the present invention provides a screen layout control method, where a screen is formed by splicing at least two sub-screens, and is used for receiving touch input and displaying, and the method includes:
receiving and recognizing a first touch input on any sub-screen;
when the first touch input meets a first preset condition, executing a screen layout adjusting instruction so as to place the screen layout of a signal source operated by the first touch input on a screen into an adjustable mode;
receiving and identifying a second touch input on a sub-screen where the first touch input is positioned, and adjusting the screen layout of a signal source operated by the first touch input on the screen according to the identification result of the second touch input;
receiving and identifying a third touch input on other sub-screens except the sub-screen where the first touch input is located;
and when the third touch input meets a second preset condition, executing a screen layout recovery instruction to recover the screen layout of the signal source operated by the first touch input on the screen or recover the screen layout of the whole screen.
In some examples, the receiving and identifying a third touch input on a sub-screen other than the sub-screen on which the first touch input is located includes receiving and identifying a third touch input on a single sub-screen other than the sub-screen on which the first touch input is located; or, the receiving and recognizing the third touch input on the other sub-screen except the sub-screen where the first touch input is located includes receiving and recognizing a third touch input formed by the first partial touch input and the second partial touch input on the first sub-screen and the second sub-screen of the other two adjacent sub-screens except the sub-screen where the first touch input is located.
In some examples, including:
acquiring the first part of touch input and the second part of touch input through at least two sensors corresponding to the first sub-screen and the second sub-screen respectively;
storing the first part of touch input and the second part of touch input, and the identification of the first sub-screen and the identification of the second sub-screen corresponding to the first part of touch input and the second part of touch input and the touch time into a hash table;
traversing the hash table to search all second part touch input which do not belong to the identification of the first sub-screen;
judging whether the time interval between the touch time of the first part of touch input and the touch time of the second part of touch input is smaller than a preset time threshold value or not;
if so, adding the searched first part of touch input and the second part of touch input together;
judging whether the hash table is traversed or not;
if so, taking the touch input added together as a third touch input;
identifying the third touch input.
In some examples, the correspondence between the first preset condition and the screen layout adjustment instruction is stored in advance, and the correspondence between the second preset condition and the screen layout restoration instruction is stored in advance.
In some examples, when the trajectory or shape of the first touch input satisfies a first preset condition, executing a screen layout adjustment instruction;
and executing a screen layout recovery instruction when the track or the shape of the third touch input meets a second preset condition.
In some examples, the first preset condition includes that a trajectory or shape of the first touch input corresponds to W; the second preset condition includes that the track or the shape of the third touch input corresponds to M.
In some examples, the screen surface is covered with an infrared light curtain, and the first touch input, the second touch input or the third touch input is realized by acting on the infrared light curtain through a finger or a pointer, and is captured by an infrared camera attached to the screen; or the laser remote controller emits laser beams with different characteristics to the screen to realize the first touch input, the second touch input or the third touch input, and the first touch input, the second touch input or the third touch input is captured by a camera attached to the screen.
In a second aspect, an embodiment of the present invention provides a screen layout control device, where a screen is formed by splicing at least two sub-screens, and is used for receiving touch input and displaying, and the device includes:
the first identification unit is used for receiving and identifying a first touch input on any sub-screen;
the first execution unit is used for executing a screen layout adjustment instruction when the first touch input meets a first preset condition so as to place the screen layout of a signal source operated by the first touch input on a screen into an adjustable mode;
the second identification unit is used for receiving and identifying a second touch input on the sub-screen where the first touch input is located;
the second execution unit is used for adjusting the screen layout of the signal source operated by the first touch input on the screen according to the identification result of the second touch input;
the third identification unit is used for receiving and identifying third touch input on other sub-screens except the sub-screen where the first touch input is positioned;
and the third execution unit is used for executing a screen layout recovery instruction when the third touch input meets a second preset condition so as to recover the screen layout of the signal source operated by the first touch input on the screen or recover the screen layout of the whole screen.
In a third aspect, an embodiment of the present invention provides an apparatus for screen layout control, including a memory and a processor;
the processor is configured to read executable program code stored in the memory to execute the screen layout control method of the first aspect.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, which includes instructions that, when executed on a computer, cause the computer to execute the screen layout control method according to the first aspect.
By the screen layout recovery method, the screen layout recovery device, the screen layout recovery equipment and the computer readable storage medium, the use efficiency of each screen is fully improved, the operation flow is simplified, and the interaction convenience among a plurality of screens is improved.
Drawings
Fig. 1 is a partial flow chart of a screen layout control method according to an embodiment of the present invention.
FIG. 2 is a partial flowchart illustrating a process of receiving and recognizing a third touch input on two other adjacent sub-screens according to an embodiment of the present invention.
Fig. 3 is a schematic structural diagram of a screen layout control apparatus according to another embodiment of the present invention.
Fig. 4 is a schematic structural diagram of an apparatus for screen layout control according to still another embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
As shown in fig. 1, fig. 1 is a partial schematic flow chart of a screen layout control method according to an embodiment of the present invention, where the method includes:
s11: and receiving and recognizing a first touch input on any sub-screen.
In the embodiment of the present invention, the screen is formed by splicing at least two sub-screens, for example, the sub-screens are spliced together by an image splicing control unit (or called a large-screen splicer, a multi-screen splicing controller, or the like), and the sub-screens spliced together may be disposed adjacent to each other in space, or may be disposed separately in space, for example, may be disposed at a certain distance apart. Here, the image stitching control unit may also enable the at least two sub-screens to respectively display different signal source contents, or may also enable the at least two sub-screens to display different pictures, where the different pictures are stitched into a complete signal source content or picture content; the image stitching control unit may be implemented in a hardware manner, or may be implemented in a software manner in the server.
The at least two sub-screens may include, for example, an infrared light curtain touch screen. Other types of touchscreens may also be included, and accordingly, the touches may be captured by corresponding sensors in other types of manners, such as those shown in vector pressure sensing, capacitive, resistive, infrared bezel, near field imaging, electromagnetic induction, and surface acoustic wave touchscreens.
Taking the infrared light curtain type touch screen as an example, the infrared light curtain can be formed on the surface of the screen by an infrared laser or a laser array above the screen, and when acting on the screen on which the infrared light curtain is arranged by a finger or the like, the touch input of the user in the screen is captured by the infrared camera. For example, when touch input is performed on any one of the sub-screens, the light distribution of the infrared light curtain at the touch input position changes due to touch behavior, for example, part of infrared light at the touch input position is diffusely reflected off the screen by a touch finger and is further captured by an infrared camera positioned in front of the screen or the sub-screen; or partial infrared light at the touch input position penetrates through the screen due to the action of the touch finger and is shot by the infrared camera positioned behind the screen or the sub-screen, then the infrared camera sends infrared images including the touch input to the server in an electric signal form, and the server processes and analyzes the received electric signals to obtain touch information of a user when the user touches any sub-screen. The touch information may include touch position information and/or touch trajectory information and/or shape information (e.g., a touch shape is formed when a hand is spread and pressed on the screen). The touch position may change over time or have some distribution characteristic.
For example: when a gesture W (or other gestures planned in advance) is captured by the infrared camera, the infrared camera sends the acquired signal to the server; the server will analyze the signal and recognize whether the signal corresponds to a gesture W.
The touch input can also be generated by performing touch on a screen through a laser remote controller, an infrared laser generation glove and the like, and an infrared light curtain does not need to be arranged at the moment. For example, the touch input may be implemented by a laser remote controller emitting laser beams with different characteristics onto a screen, the touch input being captured by a camera attached to the screen, the laser beams with different characteristics including laser beams with different shapes, different on-off durations, different movement tracks, and different wavelengths.
S12: judging whether the first touch input meets a first preset condition, if so, executing a step S13 to execute a screen layout adjustment instruction so as to set the screen layout of a signal source operated by the first touch input on a screen in an adjustable mode; in the present application, as mentioned above, the image stitching control unit may be implemented by hardware, or may be implemented by software in the server, and the screen layout is set in an adjustable mode, which also means that the image stitching control unit may accept input, so that the screen layout of the signal source content output via the image stitching control unit (i.e. the display distribution manner of the signal source content on the screen) changes, for example, assuming that the original three signal source contents output via the image stitching control unit respectively occupy three sub-screens from left to right in sequence (initial layout), after the image stitching control unit accepts adjustment, the screen layout of the signal source operated by the first touch input on the screen may change to occupy 2 sub-screens, or occupy the sub-screens in other new distribution manners, as will be further mentioned below; if the first touch input is determined not to satisfy the first preset condition, step S18 is executed to prompt the user to re-input or end the operation.
In this step, for example, after the server recognizes the sliding gesture of the user, the sliding gesture may be matched with a preset gesture, and if the matching is successful, the screen layout adjustment instruction may be executed according to a correspondence relationship between the preset gesture and the screen layout adjustment instruction stored in advance, so as to place the screen layout of the signal source operated by the first touch input on the screen in an adjustable mode; if the matching is unsuccessful, it indicates that the first sliding gesture input by the user does not meet the first preset condition, and at this time, the user may be prompted to re-input or end the operation.
S13: and executing the screen layout adjusting instruction to place the screen layout of the signal source operated by the first touch input on the screen into an adjustable mode.
In this step, when the shape or trajectory of the first touch input of the user meets a first preset condition, executing a screen layout adjustment instruction to place a screen layout of a signal source operated by the first touch input on a screen in an adjustable mode; the screen layout is adjusted, so that the display mode of the signal source content operated by the first touch input on the at least two sub-screens can be changed, for example: the signal source content is displayed in a full screen or occupies a part of the sub-screen, that is, in the screen layout adjustment mode, the display mode of the signal source content on the screen can be arbitrarily adjusted according to the second touch input subsequently performed by the user, as explained further below.
S14: and receiving and identifying a second touch input of the user on the sub-screen where the first touch is positioned, and adjusting the screen layout of the signal source operated by the first touch input on the screen according to the identification result of the second touch input.
In this step, after entering the screen layout adjustment mode, the user may continue to perform gesture operations (>, <, move left, move right, and the like), and after the gesture operations are collected as touch inputs and recognized by the server, the server adjusts the image stitching control unit, so as to adjust the display of the signal source content operated by the first touch input on the screen; in some embodiments, the gesture operation may be collected by an infrared camera attached to the screen and sent to the server, and the server may control the image stitching control unit according to the gesture recognized by the server (>, <, left shift, right shift, or the like), so that the screen layout of the signal source content operated by the first touch input on the at least two sub-screens is changed, for example, the display area is enlarged, reduced, left shift, right shift, up shift, down shift, or disappeared, and the like.
S15: and receiving and identifying a third touch input of the user on other sub-screens except the sub-screen where the first touch input is located.
In this step, in some examples of the present invention, after the sub-screen on which the first touch input is located on the screen enters the screen layout adjustment mode, the user may continue to perform gesture operations on another single sub-screen, for example: when a gesture M (or other gestures planned in advance) is captured by one infrared camera, the infrared camera sends the acquired signal to a server; the server will analyze the signal and recognize that the gesture is M.
In other examples of the present invention, after the sub-screen on which the first touch input is located enters the screen layout adjustment mode, the user may continue to perform the third touch input on two other adjacent sub-screens. In some examples, the third touch input is acquired by at least two or one sensor in one-to-one correspondence with the at least two sub-screens, for example, an infrared camera; as shown in fig. 2, fig. 2 is a partial flowchart of a third touch input on two other adjacent sub-screens except the sub-screen where the first touch input is located, which is received and recognized according to an embodiment of the present invention, and for convenience of description, inputs of the third touch input on the first sub-screen and the second sub-screen of the two adjacent sub-screens are described as the first partial touch input and the second partial touch input, in this case, step S15 may be implemented by:
s151: acquiring the first part of touch input and the second part of touch input through at least two sensors corresponding to the first sub-screen and the second sub-screen respectively; and storing the first part of touch input and the second part of touch input, and the identification of the first sub-screen and the identification of the second sub-screen corresponding to the first part of touch input and the second part of touch input, and the touch time into a hash table.
In this step, the user performs simultaneous touch on different sub-screens, and accordingly, the third touch input is also acquired by different sensors, so that the third touch input of the user on different sub-screens within the preset time needs to be fused and then sent to the server for recognition.
In this step, a first part of touch input of the user on the first sub-screen, a second touch input on the second sub-screen, an identifier of the first sub-screen, an identifier of the second sub-screen, and a touch time are stored in the hash table, where the first part of touch input is, for example, touch position information, i.e., touch coordinates, and a first sub-screen identifier corresponding to the first part of touch input refers to a source of the touch information, and is, for example, an ID (e.g., a character string including numbers and/or letters) or an identity identifier such as an IP of the first sub-screen. And storing the touch information, the screen identification and the touch time of each frame of image of the user on different sub-screens, which are acquired by each infrared camera, into a hash table.
S152: and traversing the hash table to look up all second part touch input which does not belong to the identification of the first sub-screen.
In this step, after the first part of touch input, the first sub-screen identifier and the touch time corresponding to the first part of touch input are stored in the hash table, the whole hash table is traversed to find the second part of touch input which does not belong to the first sub-screen identifier.
S153: judging whether the time interval between the touch time of the first part of touch input and the touch time of the second part of touch input is smaller than a preset time threshold value or not; if yes, step S154 is executed, and if no, step S155 is executed.
In this step, the time interval between the touch time corresponding to the second part of touch input and the touch time corresponding to the first part of touch input in the hash table is compared with the preset time interval, if the time interval is smaller than the preset time interval, the second part of touch input not belonging to the first sub-screen identifier is added together with the first part of touch input, and if the time interval is larger than the preset time interval, the second part of touch input not belonging to the first sub-screen identifier is cleaned out of the hash table.
S154: and adding the searched second part of touch input which does not belong to the first sub-screen identification and the first part of touch input together.
In this step, if the time interval between the touch time corresponding to the second part of touch input not belonging to the first sub-screen identifier and the touch time corresponding to the first part of touch input is less than the preset time interval, adding the found second part of touch input not belonging to the first sub-screen identifier and the found first part of touch input together.
S155: and clearing the found second part of touch input which does not belong to the first sub-screen identification.
In this step, when a time interval between the second part of touch input not belonging to the first sub-screen identifier and the first part of touch input is greater than a preset time interval, the second part of touch input not belonging to the first sub-screen identifier may be cleared.
S156: and judging whether the traversal of the hash table is completed, if so, executing the step S157, and if not, returning to execute the step S152.
In this step, it is determined whether the traversal of the whole hash table is completed, and when the traversal is completed, the fused third touch input is output to the server, and when the traversal is not completed, the process needs to return to step S152 to continue traversing the hash table until the traversal is completed.
S157: the added touch inputs are taken as third touch inputs.
In this step, after the hash table is traversed, packing the current third touch input and the added second touch input which does not belong to the first sub-screen identifier and corresponds to the first touch input with a touch time interval smaller than a preset time interval into one touch input, and obtaining the third touch input.
S158: identifying the third touch input.
In this step, the first part of touch input and the second part of touch input from the first sub-screen and the second sub-screen are fused to obtain a fused third touch input, and the server analyzes and identifies the fused third touch input to participate in subsequent judgment and processing.
S16: and judging whether the third touch input meets a second preset condition, if so, executing a step S17, executing a screen layout recovery instruction, responding to the screen layout recovery instruction to recover the screen layout, and if not, executing a step S18, and prompting a user to re-input or finish the operation.
In this step, after the server recognizes a sliding gesture (for example, M) of the user, the sliding gesture may be matched with a preset gesture, and if the matching is successful, a screen layout recovery instruction may be executed according to a mapping relationship between the preset gesture and the screen layout recovery instruction stored in advance, so that the screen layout of the signal source operated by the first touch input on the screen is recovered; if the matching is unsuccessful, it indicates that the third touch input by the user does not meet the second preset condition, and at this time, the user may be prompted to re-input or end the operation.
S17: and executing a screen layout recovery instruction to recover the screen layout of the signal source operated by the first touch input on the screen or recover the screen layout of the whole screen.
In this step, when the shape or trajectory of the third touch input meets a second preset condition, a screen layout recovery instruction is generated, where the screen layout recovery instruction is used to instruct the screen layout to recover the original state.
In some examples, the screen layout restoration instruction is executed when the server recognizes the third touch input of the user, so that the image stitching control unit restores the screen layout of the signal source operated by the first touch input on the screen.
It should be noted that, in the embodiment of the present invention, the screen layout recovery of only one signal source operated by the first touch input is described, in other embodiments of the present invention, when the screen layout of the signal source operated on a plurality of (more than 2) sub-screens of at least two sub-screens changes, a third touch input may still be input on the other sub-screens by the above method, and the server receives and recognizes the third touch input and controls the screen layouts of all sub-screens (i.e., the entire screen) to recover.
S18: prompting the user to re-input or the operation is finished.
In this step, when the first touch input or the third touch input of the user does not satisfy the preset condition, the user may be prompted to re-input or end the operation.
When the screen layout recovery method provided by the embodiment of the invention is utilized, when the screen layout on any sub-screen is changed, the touch input on other sub-screens is received and recognized, so that the screen layout recovery of the sub-screen with the changed screen layout is controlled, the use efficiency is improved, the operation process is simplified, and the interaction convenience among a plurality of screens is improved.
In order to better implement the screen layout recovery method provided by the embodiment of the invention, the embodiment of the invention also provides a screen layout control device. The meaning of the noun is the same as that of the screen layout recovery method, and the specific implementation details can refer to the description in the method embodiment.
As shown in fig. 3, fig. 3 is a schematic structural diagram of a screen layout control apparatus according to another embodiment of the present invention, where the apparatus includes a first identifying unit 31, a first executing unit 32, a second identifying unit 33, a second executing unit 34, a third identifying unit 35, and a third executing unit 36.
The first identification unit 31 is configured to receive and identify a first touch input of a user on any sub-screen; the first executing unit 32 is configured to execute a screen layout adjusting instruction to set a screen layout of a signal source operated by the first touch input on a screen in an adjustable mode when the first touch input identified by the first identifying unit 31 meets a first preset condition; the second identification unit 33 is configured to receive and identify a second touch input of the user on any sub-screen; the second execution unit 34 is configured to adjust a screen layout of a signal source operated by the first touch input on the screen according to the recognition result of the second touch input; the third identifying unit 35 is configured to receive and identify a third touch input on a sub-screen other than the sub-screen on which the first touch input is located; the third execution unit 36 is configured to execute the screen layout recovery instruction when the third touch input meets a second preset condition, so as to recover the screen layout of the signal source operated by the first touch input on the screen or recover the screen layout of the entire screen, that is, restore the screen layout to a preset default state; or the whole screen layout is restored, namely, the preset default state of the whole screen is restored.
In some examples of the present invention, the third recognition unit 35 is configured to receive and recognize a third touch input of the user on another single sub-screen.
In some examples, the third recognition unit 35 is configured to receive and recognize a third touch input on a sub-screen other than the sub-screen on which the first touch input is located.
In some examples, the third recognition unit 35 may be configured to store the first partial touch input and the second partial touch input, and the identifier of the first sub-screen and the identifier of the second sub-screen corresponding to the first partial touch input and the second partial touch input, and the touch time into a hash table; traversing the hash table to search all second part touch input which do not belong to the identification of the first sub-screen; judging whether the time interval between the touch time of the first part of touch input and the touch time of the second part of touch input is smaller than a preset time threshold value or not; if so, adding the searched first part of touch input and the second part of touch input together; judging whether the hash table is traversed or not; and if so, taking the touch input added together as a third touch input.
In some examples, the correspondence between the first preset condition and the screen layout adjustment instruction may be stored in advance, and the correspondence between the second preset condition and the screen layout restoration instruction may be stored in advance.
In some examples, the first touch input, the second touch input, and the third touch input are performed on the screen by a laser remote controller, an infrared laser generating glove.
In some examples, the first execution unit 32 generates a screen layout adjustment instruction when the trajectory or shape of the first touch input satisfies a first preset condition, and the second execution unit 34 generates a screen layout recovery instruction when the trajectory or shape of the third touch input satisfies a second preset condition.
The screen layout control device and the screen layout recovery method belong to the same concept, any one of the methods provided in the screen layout recovery method embodiments can be run on the screen layout control device, and the specific implementation process is detailed in the screen layout recovery method embodiments, and is not described herein again.
When the screen layout control device provided by the embodiment of the invention is utilized, when the display layout on any sub-screen is changed, the touch input on other sub-screens is received and identified, so that the screen layout recovery of the sub-screen with the changed screen layout is controlled, the use efficiency is improved, the operation process is simplified, and the interaction convenience among a plurality of screens is improved.
Fig. 4 is a schematic structural diagram of an apparatus for screen layout recovery according to still another embodiment of the present invention. As shown in fig. 4, at least a part of the screen layout restoration method and the screen layout control apparatus described above in connection therewith may be implemented by an apparatus 400 for screen layout restoration, including a processor 403, a memory 404, and a bus 410.
In some instances, the computing device 400 may also include an input device 401, an input port 402, an output port 405, and an output device 406. The input port 402, the processor 403, the memory 404, and the output port 405 are connected to each other via a bus 410, and the input device 401 and the output device 406 are connected to the bus 410 via the input port 402 and the output port 405, respectively, and further connected to other components of the computing device 400. It should be noted that the output interface and the input interface can also be represented by I/O interfaces. Specifically, the input device 401 receives input information from the outside and transmits the input information to the processor 403 through the input port 402; processor 403 processes the input information based on computer-executable instructions stored in memory 404 to generate output information, stores the output information temporarily or permanently in memory 404, and then transmits the output information to output device 406 through output port 405; output device 406 outputs the output information to the exterior of device 400.
The memory 404 includes mass storage for data or instructions. By way of example, and not limitation, memory 404 may include an HDD, floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or a Universal Serial Bus (USB) drive or a combination of two or more of these. Memory 404 may include removable or non-removable (or fixed) media, where appropriate. Memory 404 may be internal or external to device 400, where appropriate. In a particular embodiment, the memory 404 is a non-volatile solid-state memory. In a particular embodiment, the memory 404 includes Read Only Memory (ROM).
Bus 410 includes hardware, software, or both to couple the components of device 400 to one another.
When the screen layout control apparatus described in connection with fig. 3 is implemented by the device 400 shown in fig. 4, the input device 401 receives a first touch input by a user on any of the sub-screens, receives a second touch input on the sub-screen on which the first touch input is located, and receives a third touch input on the other sub-screen, and in particular embodiments, the I/O interface connected to the output device may comprise hardware, software, or both, providing one or more interfaces for communication between the device 400 and one or more I/O devices. Device 400 may include one or more of these I/O devices, where appropriate. One or more of these I/O devices may allow communication between a person and device 400. By way of example and not limitation, the I/O devices may include a tablet, a touch screen, a video camera, or a combination of two or more of these. The I/O device may include one or more sensors. Embodiments of the present invention contemplate any suitable I/O devices and any suitable I/O interfaces for use therewith. The I/O interface may comprise one or more devices or software drivers capable of allowing the processing unit 403 to drive one or more of these I/O devices, where appropriate. The I/O interface may include one or more I/O interfaces, where appropriate. Although embodiments of the present invention describe and illustrate particular I/O interfaces, embodiments of the present invention contemplate any suitable I/O interfaces. The processing unit 403 receives and recognizes a first touch input on any sub-screen based on computer-executable instructions stored in the memory 404; when the first touch input meets a first preset condition, executing a screen layout adjusting instruction so as to place the screen layout of a signal source operated by the first touch input on a screen into an adjustable mode; receiving and identifying a second touch input on a sub-screen where the first touch input is positioned, and adjusting the screen layout of a signal source operated by the first touch input on the screen according to the identification result of the second touch input; receiving and identifying a third touch input on other sub-screens except the sub-screen where the first touch input is located; and when the third touch input meets a second preset condition, executing a screen layout recovery instruction to recover the screen layout of the signal source operated by the first touch input on the screen. .
According to some embodiments, there is provided a computer-readable storage medium, which may include instructions that, when executed on a computer, may cause the computer to perform the screen layout restoration method described above.
In some examples, a computer program product containing instructions is provided which, when run on a computer, causes the computer to perform the screen layout control method described above.
In some examples, there is provided a computer program which, when run on a computer, causes the computer to perform the screen layout control method described above.
In the above examples, the implementation may be in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (7)
1. A screen layout control method is provided, wherein a screen is formed by splicing at least two sub-screens and is used for receiving touch input and displaying, and the method comprises the following steps:
receiving and recognizing a first touch input on any sub-screen;
when the first touch input meets a first preset condition, executing a screen layout adjusting instruction so as to place the screen layout of a signal source operated by the first touch input on a screen into an adjustable mode;
receiving and identifying a second touch input on a sub-screen where the first touch input is positioned, and adjusting the screen layout of a signal source operated by the first touch input on the screen according to the identification result of the second touch input;
receiving and identifying a third touch input on other sub-screens except the sub-screen where the first touch input is located;
when the third touch input meets a second preset condition, executing a screen layout recovery instruction to recover the screen layout of the signal source operated by the first touch input on the screen or recover the screen layout of the whole screen;
the receiving and recognizing of the third touch input on the other sub-screen than the sub-screen on which the first touch input is located includes receiving and recognizing the third touch input on a single sub-screen except the sub-screen on which the first touch input is located, or includes receiving and recognizing the third touch input on the other sub-screen except the sub-screen on which the first touch input is located, and the receiving and recognizing of the third touch input on the other sub-screen except the sub-screen on which the first touch input is located includes receiving and recognizing the third touch input formed by the first partial touch input and the second partial touch input on the first sub-screen and the second sub-screen of the other two adjacent sub-screens except the sub-screen on which the first touch input is located;
the method further comprises the following steps:
acquiring the first part of touch input and the second part of touch input through at least two sensors corresponding to the first sub-screen and the second sub-screen respectively;
storing the first part of touch input and the second part of touch input, and the identification of the first sub-screen and the identification of the second sub-screen corresponding to the first part of touch input and the second part of touch input and the touch time into a hash table;
traversing the hash table to search all second part touch input which do not belong to the identification of the first sub-screen;
judging whether the time interval between the touch time of the first part of touch input and the touch time of the second part of touch input is smaller than a preset time threshold value or not;
if so, adding the searched first part of touch input and the second part of touch input together;
judging whether the hash table is traversed or not;
if so, taking the touch input added together as a third touch input;
identifying the third touch input.
2. The screen layout control method according to claim 1, wherein a correspondence between the first preset condition and the screen layout adjustment instruction is stored in advance, and a correspondence between the second preset condition and the screen layout restoration instruction is stored in advance.
3. The screen layout control method of claim 2, wherein when the trajectory or shape of the first touch input satisfies a first preset condition, executing a screen layout adjustment instruction;
and executing a screen layout recovery instruction when the track or the shape of the third touch input meets a second preset condition.
4. The screen layout control method according to any one of claims 1 to 3, wherein the first preset condition includes that a trajectory or a shape of the first touch input corresponds to W; the second preset condition includes that the track or the shape of the third touch input corresponds to M.
5. The screen layout control method according to any one of claims 1 to 3, wherein the screen surface is covered with an infrared light curtain, and the first touch input, the second touch input or the third touch input is realized by acting on the infrared light curtain through a finger or a pointer, and the first touch input, the second touch input or the third touch input is captured by an infrared camera attached to the screen; or the laser remote controller emits laser beams with different characteristics to the screen to realize the first touch input, the second touch input or the third touch input, and the first touch input, the second touch input or the third touch input is captured by a camera attached to the screen.
6. An apparatus for screen layout control, comprising a memory and a processor;
the processor is configured to read executable program code stored in the memory to perform the screen layout control method of any one of claims 1 to 5.
7. A computer-readable storage medium characterized by comprising instructions that, when executed on a computer, cause the computer to execute the screen layout control method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810150446.0A CN109101173B (en) | 2018-02-13 | 2018-02-13 | Screen layout control method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810150446.0A CN109101173B (en) | 2018-02-13 | 2018-02-13 | Screen layout control method, device, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109101173A CN109101173A (en) | 2018-12-28 |
| CN109101173B true CN109101173B (en) | 2020-10-30 |
Family
ID=64796630
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810150446.0A Active CN109101173B (en) | 2018-02-13 | 2018-02-13 | Screen layout control method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109101173B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109745699A (en) * | 2018-12-29 | 2019-05-14 | 维沃移动通信有限公司 | A kind of method and terminal device responding touch control operation |
| CN112904993A (en) * | 2021-03-16 | 2021-06-04 | 北京小米移动软件有限公司 | Screen control method, device and storage medium |
| CN114356264B (en) * | 2021-12-30 | 2023-12-05 | 威创集团股份有限公司 | Signal generation method, device, equipment and readable storage medium |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104020939A (en) * | 2013-03-01 | 2014-09-03 | 联想(北京)有限公司 | Control method and electronic device |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9557876B2 (en) * | 2012-02-01 | 2017-01-31 | Facebook, Inc. | Hierarchical user interface |
| KR20130142310A (en) * | 2012-06-19 | 2013-12-30 | 삼성전자주식회사 | Method and apparatus for image change in electronic device |
| CN107526517A (en) * | 2017-06-15 | 2017-12-29 | 北京仁光科技有限公司 | A kind of method for adjusting touch-control giant-screen window size |
| CN107589930A (en) * | 2017-09-05 | 2018-01-16 | 北京仁光科技有限公司 | Multi-screen control system and method |
| CN107643884B (en) * | 2017-09-05 | 2021-02-23 | 北京仁光科技有限公司 | Method and system for interaction between at least two computers and a screen |
-
2018
- 2018-02-13 CN CN201810150446.0A patent/CN109101173B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104020939A (en) * | 2013-03-01 | 2014-09-03 | 联想(北京)有限公司 | Control method and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109101173A (en) | 2018-12-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10761610B2 (en) | Vehicle systems and methods for interaction detection | |
| CN105814522B (en) | Device and method for displaying user interface of virtual input device based on motion recognition | |
| US8452057B2 (en) | Projector and projection control method | |
| JP2020052991A (en) | Gesture recognition-based interactive display method and device | |
| EP2703949B1 (en) | Information processing device, information processing method, and recording medium | |
| US10318152B2 (en) | Modifying key size on a touch screen based on fingertip location | |
| CN109101173B (en) | Screen layout control method, device, equipment and computer readable storage medium | |
| KR101631011B1 (en) | Gesture recognition apparatus and control method of gesture recognition apparatus | |
| CN109101172B (en) | Multi-screen linkage system and interactive display method thereof | |
| US20170285932A1 (en) | Ink Input for Browser Navigation | |
| WO2017029749A1 (en) | Information processing device, control method therefor, program, and storage medium | |
| US20170315793A1 (en) | Image processing device and electronic whiteboard | |
| CN106031163A (en) | Method and apparatus for controlling projection display | |
| KR20150031986A (en) | Display apparatus and control method thereof | |
| US20150261385A1 (en) | Picture signal output apparatus, picture signal output method, program, and display system | |
| CN109697042A (en) | Multisignal source dispatching method, device, equipment and computer readable storage medium | |
| JP6187547B2 (en) | Information processing apparatus, control method and program thereof, and information processing system, control method and program thereof | |
| US11557065B2 (en) | Automatic segmentation for screen-based tutorials using AR image anchors | |
| JP5999236B2 (en) | INFORMATION PROCESSING SYSTEM, ITS CONTROL METHOD, AND PROGRAM, AND INFORMATION PROCESSING DEVICE, ITS CONTROL METHOD, AND PROGRAM | |
| CN110162233B (en) | Screen icon adjusting method, device and equipment and computer readable storage medium | |
| CN111221482A (en) | Interface layout adjusting method based on command console | |
| JP2022134370A (en) | Display device, display method, and program | |
| JP2017059125A (en) | Information processing device, control method thereof, and program | |
| JP2019125024A (en) | Electronic device, information processing method, program, and storage medium | |
| JP2017111205A (en) | Image processing device, image processing system and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |