CN114579013B - Touch double-screen device based on windows system - Google Patents
Touch double-screen device based on windows system Download PDFInfo
- Publication number
- CN114579013B CN114579013B CN202210247480.6A CN202210247480A CN114579013B CN 114579013 B CN114579013 B CN 114579013B CN 202210247480 A CN202210247480 A CN 202210247480A CN 114579013 B CN114579013 B CN 114579013B
- Authority
- CN
- China
- Prior art keywords
- screen
- thumbnail
- module
- picture
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to a touch double-screen device based on a windows system, belongs to the technical field of teaching, and solves the problems of complex and unintuitive man-machine interaction operation in the prior art. The device includes: the system comprises a main screen, an auxiliary screen and a processing unit, wherein the main screen is a computer touch display screen with a conventional size; the auxiliary screen is a strip-shaped touch display screen; the processing unit comprises a display module, a progress scanning module, a thumbnail module and a control module, wherein the display module is used for displaying thumbnails in a thumbnail area, displaying menu information in a shortcut menu area and displaying general operation buttons in a tool button area; the process scanning module is used for scanning a process, calling the thumbnail module and generating a thumbnail list; the thumbnail module is used for generating a thumbnail; the control module is used for sending a corresponding instruction and executing an instruction action according to the touch area of the auxiliary screen, and acquiring menu information according to the application program displayed by the main screen. Tentacles and better interactive experience are achieved.
Description
Technical Field
The invention relates to the technical field of teaching, in particular to a touch double-screen device based on a windows system.
Background
With the popularization of touch displays, many windows systems in teaching and speech scenes are equipped with touch displays, but in actual use scenes, the operation experience of the touch displays is not intuitive and inconvenient, and users still mainly use keyboards and mice. Touch displays do not take their real advantage. For example, a user runs a plurality of programs, such as PPT, video, pictures, web pages, and the like, and needs to switch among a plurality of program windows during speech, most users still use a keyboard and a mouse to operate habitually, and few users can directly slide and call the multi-program running window from the leftmost side of a touch screen to the right to realize quick switching of the current window. In addition, the lecture may need to annotate and highlight the lecture content, and in many cases, the lecture needs to be implemented by opening the related program, which is inconvenient to operate.
In the prior art, some dual systems are used for realizing part of common function calling, two system interfaces are mutually nested on the same screen, and the interaction modes between the dual systems mainly comprise modes of a fixed menu, a floating window, a physical key and the like; some methods realize function calling by adding a fixed program menu, a floating window and the like on a WINDOWS system window. The program window is usually displayed on a display screen or called out by triggering a specific position; and the computer is connected with the two display screens, the interface of an operator and the interface of a speaker are asynchronously displayed, the content to be demonstrated is operated on the screen of the operator, and then the content is pushed to the screen of the speaker.
In the scheme, when the same display is used, the calling and switching modes of the functions are not visual, the floating window is always displayed on the screen or called out in a specific mode, the design of each manufacturer is different, the universality is poor, the floating window can shield the display content sometimes, and a lot of inconvenience exists in the use process. Moreover, these tools are not available on the user's personal windows system and require specialized training, and many times, the user cannot go to specialized training, so most users will not use them because of poor experience; when the computer expansion screen is used, various software needs to be opened in the software (container), the display content of the expansion screen is still based on the display under the container, many software do not support or support the software, such as PPT, two displays with conventional sizes need to be equipped, the occupied area of equipment arrangement is large, most importantly, the basic use habit of a user is changed, and a lot of inconvenience is brought to a speaker.
Disclosure of Invention
In view of the foregoing analysis, embodiments of the present invention provide a touch dual-screen device based on a windows system, so as to solve the problem that the existing human-computer interaction operation is complex and unintuitive.
The embodiment of the invention provides a touch double-screen device based on a windows system, which comprises: main screen, supplementary screen and processing unit, wherein:
the main screen is a computer touch display screen with a conventional size, and an application program is operated through touch;
the auxiliary screen is a strip touch display screen and comprises a thumbnail area, a shortcut menu area and a tool button area;
the processing unit comprises a display module, a process scanning module, a thumbnail module and a control module, wherein the display module is used for displaying thumbnails in a thumbnail area according to a thumbnail list acquired from the process scanning module, displaying menu information acquired from the control module in a shortcut menu area, and displaying a general operation button in a tool button area; the process scanning module is used for scanning a process, calling the thumbnail module to acquire the thumbnail and generating a thumbnail list; the thumbnail module is used for generating a thumbnail according to the received process information; the control module is used for sending a corresponding instruction and executing an instruction action according to the touch area of the auxiliary screen, and acquiring menu information according to an application program displayed by the main screen.
Based on the further improvement of the device, the thumbnail module generates the thumbnail according to the received process information, and the thumbnail generation method comprises the following steps:
acquiring a program window handle according to the process ID in the process information;
copying a window image to a memory DC according to the program window handle, if the window image is successfully copied, storing the window image into a bitmap, and generating a thumbnail according to the bitmap; and if the copying is unsuccessful, the corresponding image is intercepted according to the position and the size of the program window in the program window handle by copying the windows window image, the image is stored as a bitmap, and a thumbnail is generated according to the bitmap.
Based on the further improvement of the device, the process scanning module scans the process, calls the thumbnail module to acquire the thumbnail and generates a thumbnail list, and the process scanning module comprises the following steps:
the process scanning module regularly scans the application process operated by the computer to acquire process information comprising a process ID and a process name;
calling a thumbnail module, and transmitting a process ID to obtain a thumbnail;
and forming a piece of thumbnail information by each process ID, each process name and the corresponding thumbnail, and putting the thumbnail information into a thumbnail list.
Based on further improvement of the device, the display module displays the thumbnails in the thumbnail area according to the thumbnail list acquired from the progress scanning module, and comprises:
the method comprises the steps of regularly acquiring a thumbnail list displayed by a display module as a list to be updated, and taking the thumbnail list acquired from a process scanning module as a process list;
comparing the list to be updated with the process list according to the process ID, and updating the list to be updated by using the process list to obtain a latest list;
and sequentially overlapping icon identifications in the fixed area of each thumbnail in the latest list by a double-buffer picture overlapping method to integrate into a picture, and displaying the integrated thumbnail picture in the thumbnail area of the auxiliary screen.
Based on the further improvement of the device, the control module sends out a corresponding instruction and executes an instruction action according to the touch area of the auxiliary screen, and the method comprises the following steps:
when the touch area is located in the area of the icon identifier in the thumbnail area, acquiring the thumbnail to which the current icon identifier belongs, and sending out an instruction corresponding to the icon identifier, and triggering an application program corresponding to the thumbnail to execute an instruction action;
when the touch control area is located in other areas except the icon identification area in the thumbnail area, sending a switching instruction to trigger switching action of an application program corresponding to the thumbnail;
when the touch area is located in the shortcut menu area or the tool button area, a command corresponding to the menu or the button is sent out, and the current application program is triggered to execute the command action or the application program corresponding to the command is called.
Based on the further improvement of the device, the icon identification comprises closing and minimizing; and sending an instruction corresponding to the icon identifier, and triggering an application program corresponding to the thumbnail to execute the instruction action, wherein the action comprises the following steps:
sending a windows message corresponding to the instruction to an application program corresponding to the thumbnail;
and rechecking whether the application program is executed after delaying according to preset delay time, and if not, calling a process command to execute the instruction action according to the process ID of the application program.
Based on the further improvement of the device, the switching command is sent to trigger the switching action of the application program corresponding to the thumbnail, and the switching action comprises the following steps:
the control module acquires a program window handle according to the process ID of the application program and acquires the position of the program window according to the program window handle; identifying whether the position of the program window is in the main screen or not according to the resolution of the main screen, if not, moving the program window to the resolution of the main screen, and simultaneously calling a windows API function to set the program window to be set to the top and maximize the window;
the control module acquires menu information of the current application program according to a preset configuration file;
and the control module informs the display module, the display module sets the touch thumbnail to be highlighted, and menu information is displayed in the shortcut menu area.
Based on the further improvement of the device, the device is connected with a computer, the processing unit of the device further comprises a screen capturing module, the screen capturing module is further used for generating a two-dimensional code according to the place number where the current touch double-screen device is located and the computer number, capturing a main screen at regular time, caching a screen capturing picture, and acquiring a corresponding screen capturing picture according to received screen capturing information and uploading the screen capturing picture to the cloud management module.
Based on the further improvement of above-mentioned device, the main screen is regularly intercepted to the screenshot module, and the buffer memory screenshot picture includes:
acquiring the number of the images which can be cached according to a preset caching time range and an intercepting interval time;
according to the preset intercepting interval time, a screenshot picture is obtained by copying a windows window image to obtain a main screen, and is used as a picture to be cached, and the name of the picture to be cached is provided with a timestamp;
acquiring the number of cached screen capture pictures, and directly storing the pictures to be cached to a computer if the number of the cached screen capture pictures is less than the number of the pictures which can be cached; and otherwise, deleting the screenshot picture with the minimum timestamp in the cached screenshot pictures, and then storing the picture to be cached.
Based on the further improvement of above-mentioned device, the screen capture module is according to the screen capture information that receives, acquires corresponding screen capture picture and uploads to high in the clouds management module, includes:
matching the screen capturing timestamp in the screen capturing information with the timestamp in the cached screen capturing picture name, if the matching is successful, acquiring the cached screen capturing picture which is matched as the picture to be uploaded, and if the matching is failed, acquiring the cached screen capturing picture which is closest to the screen capturing timestamp as the picture to be uploaded;
and calling a picture uploading interface of the cloud management module, and sending the picture to be uploaded, the user identification, the course identification and the matching state.
Compared with the prior art, the invention can realize at least one of the following beneficial effects:
1. the man-machine interaction operation of the touch screen under the teaching and speech environment is realized through the double screens, and the speech efficiency is improved; the opened applications are quickly switched, so that the operation steps are reduced, and the operation fluency and the watching experience are improved;
2. the display content of the main screen is controlled through the thumbnail of the auxiliary screen, and meanwhile, a quick operation menu for each display content is provided on the auxiliary screen according to the display content of the main screen, so that convenience is provided for the control of the main screen, the integrated device is visual and convenient, and the integrated device conforms to the use habit of a user and is quick to use;
3. by adopting the strip-shaped touch screen with the unconventional size as the auxiliary screen, the occupied area is small, and the operation experience is better brought by touching hands.
In the invention, the technical schemes can be combined with each other to realize more preferable combination schemes. Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and drawings.
Drawings
The drawings are only for purposes of illustrating particular embodiments and are not to be construed as limiting the invention, wherein like reference numerals are used to designate like parts throughout.
Fig. 1 is a structural diagram of a windows system-based touch dual-screen device in embodiment 1 of the present invention.
Detailed Description
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate preferred embodiments of the invention and together with the description, serve to explain the principles of the invention and not to limit the scope of the invention.
Example 1:
a specific embodiment of the present invention discloses a dual-touch device based on a windows system, and as shown in fig. 1, the device includes: main screen, supplementary screen and processing unit, wherein:
the main screen is a computer touch display screen with a conventional size and operates an application program through touch;
the auxiliary screen is a strip-type touch display screen and comprises a thumbnail region, a shortcut menu region and a tool button region;
the processing unit comprises a display module, a process scanning module, a thumbnail module and a control module, wherein the display module is used for displaying thumbnails in a thumbnail area according to a thumbnail list acquired from the process scanning module, displaying menu information acquired from the control module in a shortcut menu area, and displaying a general operation button in a tool button area; the process scanning module is used for scanning a process, calling the thumbnail module to acquire the thumbnail and generating a thumbnail list; the thumbnail module is used for generating a thumbnail according to the received process information; the control module is used for sending a corresponding instruction and executing an instruction action according to the touch area of the auxiliary screen, and acquiring menu information according to an application program displayed by the main screen.
It should be noted that the conventional size of the main screen is the same as the size of a general computer display screen, and exemplarily, there are 13.3 inches, 13.4 inches, 14 inches, 15.6 inches, 17 inches, 19 inches, 21.5 inches, 22.1 inches, 23.6 inches, 23.8 inches and 24 inches, which can be selected according to actual situations; the strip structure of the auxiliary screen means that the width of the auxiliary screen is less than or equal to half of the length. The connection mode and the position relation of the auxiliary screen and the main screen are not limited in this embodiment, the auxiliary screen and the main screen can be presented in an integrated mode or in a movable connection mode, the auxiliary screen can be arranged on the upper side, the lower side, the left side and the right side of the main screen, preferably, the auxiliary screen is arranged above the main screen, the elevation angle is 25 degrees, the auxiliary screen has a 1920 × 360 resolution, and the main screen has a 1920 × 1080 resolution.
By adopting the strip-shaped touch screen with the unconventional size as the auxiliary screen, the occupied area is small, and the operation experience is better brought by touching hands.
When the touch double-screen device is used, the application program of the computer is opened or closed through the touch main screen, and all the operations of the computer through the mouse are realized; after the application program is opened, the thumbnail of the application program in the main screen and the shortcut menu of the current display program of the main screen are synchronized on the auxiliary screen through the processing unit, and meanwhile, a universal operation button is provided, so that the operation of a user is facilitated, and the man-machine interaction is realized.
It should be noted that the processing unit includes a display module, a process scanning module, a thumbnail module, and a control module, and the processing unit may be software, hardware, or a combination of software and hardware, and may select an implementation manner to be adopted according to an actual situation.
Next, the interaction process between the modules will be described in detail with reference to the implementation of the functions F1 to F4 of the touch dual-screen device.
F1: displaying a thumbnail of an application program in the main screen in a thumbnail area of the auxiliary screen;
1) After a computer and a touch double-screen device are started, a process scanning module starts to monitor an application program, a process is scanned regularly, and when the application program is opened in a main screen, the process scanning module calls a thumbnail module to acquire a thumbnail and generate a thumbnail list, wherein the process scanning module comprises the following steps:
(1) the process scanning module regularly scans the application process operated by the computer to acquire process information comprising a process ID and a process name;
illustratively, the course scan module performs 1 course scan every 1 second.
(2) Calling a thumbnail module, and transmitting a process ID to obtain a thumbnail;
specifically, the thumbnail generation module generates the thumbnail according to the received process information, and the thumbnail generation module includes:
acquiring a program window handle according to the process ID in the process information;
copying a window image to a memory DC according to the program window handle, if the window image is successfully copied, storing the window image into a bitmap, and generating a thumbnail according to the bitmap; and if the copying is unsuccessful, the corresponding image is intercepted according to the position and the size of the program window in the program window handle by copying the windows window image, the image is stored as a bitmap, and a thumbnail is generated according to the bitmap.
(3) And forming a piece of thumbnail information by each process ID, each process name and the corresponding thumbnail, and putting the thumbnail information into a thumbnail list.
2) The display module displays the thumbnail in the thumbnail area according to the thumbnail list acquired from the process scanning module, and comprises the following steps:
(1) the display module regularly acquires a thumbnail list displayed by the display module as a list to be updated, and the thumbnail list acquired from the process scanning module is used as a process list;
preferably, the interval time of the process module scanning the process is the same, and the display module acquires the list to be updated and the process list every 1 second, and performs subsequent comparison and update.
(2) Comparing the list to be updated with the process list according to the process ID, and updating the list to be updated by using the process list to obtain a latest list;
specifically, during comparison, if a process ID which does not exist in the list to be updated but exists in the process list exists, thumbnail information corresponding to the process ID is added to the list to be updated; if the process ID exists in the list to be updated and the process list, updating the thumbnail information corresponding to the process ID in the list to be updated; and if the process ID which exists in the list to be updated but does not exist in the process list exists, deleting the thumbnail information corresponding to the process ID in the list to be updated.
(3) And sequentially overlapping icon identifications in the fixed area of each thumbnail in the latest list by a double-buffer picture overlapping method to integrate into a picture, and displaying the integrated thumbnail picture in the thumbnail area of the auxiliary screen.
It should be noted that, in this embodiment, clicking on the thumbnail automatically maximizes the corresponding application displayed in the main screen, and therefore, the icon identification includes closing and minimizing. Other icon identifications can be added according to actual conditions.
Thumbnails in the thumbnail list are sequentially arranged in a thumbnail area along the long edge of the auxiliary screen in sequence, buttons are respectively provided on two sides of the thumbnail area, and the thumbnails are checked and selected through touch buttons or finger touch sliding.
According to the touch area of the auxiliary screen, sending a corresponding instruction and executing an instruction action, wherein the method comprises the following steps:
f2: when the touch area is located in the area of the icon identifier in the thumbnail area, acquiring the thumbnail to which the current icon identifier belongs, and sending out an instruction corresponding to the icon identifier, and triggering an application program corresponding to the thumbnail to execute an instruction action;
specifically, according to the instruction corresponding to the icon identifier, firstly, a windows message corresponding to the instruction is sent to an application program corresponding to the thumbnail; namely: acquiring a program window handle according to the process ID of the application program, and sending a closed or minimized windows message to the program window handle; and then rechecking whether the application program is executed after delaying according to preset delay time, and if not, calling a process command to execute an instruction action according to the process ID of the application program.
Illustratively, if the icon identifier is clicked to close, the application program is closed by sending a closing message of windows, whether the program window is closed is checked after 1 second, and if the program window is not closed, the taskkill command is called to close the application program corresponding to the process according to the process ID of the application program.
After the application program is closed, the process module scans the process at regular time, the display module compares and updates the thumbnail at regular time, and the thumbnail list of the thumbnail area is updated in time. If the thumbnail area of the closed program window is arranged to be non-last on the auxiliary screen, after the thumbnail area is cleared, the rear thumbnails move forward in sequence, the ordered arrangement of the thumbnail icons is kept, and the interface is regular and attractive.
F3: when the touch control area is located in other areas except the icon identification area in the thumbnail area, sending a switching instruction to trigger switching action of an application program corresponding to the thumbnail;
specifically, the control module acquires a program window handle according to the process ID of the application program and acquires the position of the program window according to the program window handle; identifying whether the position of the program window is in the main screen or not according to the resolution of the main screen, if not, moving the program window to the resolution of the main screen, and simultaneously calling a windows API function to set the program window to be set to the top and maximize the window;
it should be noted that the application program of the main screen can be moved to the auxiliary screen through touch dragging, and here, by clicking the thumbnail, the window of the application program can be automatically moved back to the main screen, so that the problem that the position of the program window is incorrect due to misoperation is solved.
The control module acquires menu information of the current application program according to a preset configuration file;
and the control module informs the display module, the display module sets the touch thumbnail to be highlighted, and menu information is displayed in the shortcut menu area.
Specifically, the menu information corresponding to each application program may be different, and the shortcut operation menu corresponding to the application program is displayed in the shortcut menu area of the auxiliary screen according to the application program currently displayed on the main screen.
Illustratively, if the home screen displays PPT, the shortcut menu area displays: playing, next page, previous page and exiting; if the main screen is playing video, the shortcut menu area displays and displays the commonly used shortcut operation menus of playing, stopping, pausing, fast forwarding and fast rewinding.
The display content of the main screen is controlled through the thumbnail of the auxiliary screen, meanwhile, a quick operation menu for each display content is provided on the auxiliary screen according to the display content of the main screen, great convenience is provided for a user, particularly, an application occasion that a touch display screen does not provide a keyboard and a mouse is provided in the existing scene, convenience is provided for the control of the main screen, the integrated device is visual and convenient, and the integrated device accords with the use habit of a user and is quick to use.
F4: when the touch area is located in the shortcut menu area or the tool button area, a command corresponding to the menu or the button is sent out, and the current application program is triggered to execute the command action or the application program corresponding to the command is called.
It should be noted that the tool button area displays general operation buttons, including but not limited to: tablet, mark, back to desktop, and power off button.
Clicking a shortcut menu area and a tool button area, wherein the two execution modes are available, one mode is to trigger a current application program to execute an instruction action, and the method comprises the following steps: the menu of the shortcut menu area and the return-to-desktop and shutdown buttons of the tool button area respectively correspond to the key value codes of the windows keyboard, and when the key value codes are clicked, the key value codes are sent to the windows system to simulate the keyboard buttons, so that the effect of controlling the main screen application program is achieved.
Illustratively, the previous page of the shortcut menu region is set to the key value code of PgUp on the keyboard.
The other is an application program corresponding to the calling instruction, and comprises the following steps: a tablet and a marking button.
Specifically, when the writing board is clicked, the Ink technology is combined with flexible interface application of WPF, the writing board interface is displayed on the main screen, and the writing board background, the pen color, the pen thickness and the pen type selection are provided. Identifying places with low pen-feeding speed and heavy pen-feeding force of the electromagnetic pen according to the 3D Touch, wherein the lines are thick and the line color is dark; the lines are narrow and the color of the lines is light in places with high pen-writing speed and light pen-writing force.
Compared with the prior art, the writing brush type is added in the pen type, the writing brush tip is processed when the writing brush is used, and the writing brush effect is embodied by adopting random bifurcation and fuzzy processing modes at the beginning and the end of one stroke, particularly horizontal and vertical strokes.
When the mark is clicked, a transparent display layer is superposed on the main screen, so that the effect of random drawing and annotation on the main screen is realized, and when the video is played in the main screen, the drawing and annotation can be performed on the video picture.
Compared with the prior art, the touch control double-screen device based on the windows system provided by the embodiment realizes man-machine interaction operation of the touch control screen under teaching and speech environments through double screens, and improves speech efficiency; and the opened applications are quickly switched, so that the operation steps are reduced, and the operation fluency and the watching experience are improved.
Example 2:
another specific embodiment 2 of the present invention is further optimized on the basis of the touch-control dual-screen device of embodiment 1, and the processing unit of the device further includes: the screen capturing module is further used for generating a two-dimensional code according to the place number where the current touch double-screen device is located and the computer number, capturing the main screen at regular time, caching the screen capturing picture, and acquiring the corresponding screen capturing picture according to the received screen capturing information and uploading the screen capturing picture to the cloud management module;
still include in the supplementary screen: the display module is further used for displaying the current time in the basic information display area and displaying the current course information acquired from the control module; the control module acquires current course information according to the schedule information by calling a place management module of a place where the touch double-screen device is located;
the tool button area of the auxiliary screen further includes: and viewing the two-dimension code button. And when the two-dimension code is clicked and viewed, displaying the two-dimension code generated by the screen capture module in a main screen interface.
It should be noted that, the screen capture module captures the main screen at regular time, and caching the screen capture picture includes:
(1) acquiring the number of the images which can be cached according to a preset caching time range and an interception interval time;
(2) according to preset intercepting interval time, obtaining a main screen by copying a windows window image to obtain a screenshot picture as a picture to be cached, wherein the name of the picture to be cached has a time stamp;
(3) acquiring the number of cached screen capture pictures, and directly storing the pictures to be cached to a computer if the number of the cached screen capture pictures is less than the number of the pictures which can be cached; and otherwise, deleting the screenshot picture with the minimum timestamp in the cached screenshot pictures, and then storing the picture to be cached.
Illustratively, the buffering time range is set to be 5 seconds, the intercepting interval time is set to be 200 milliseconds, namely one computer screen picture is intercepted every 200 milliseconds, the number of the cacheable pictures in 5 seconds is 25, namely 1 picture at the current moment and 24 pictures at the previous moment are always scrolled and buffered.
The screen capture module acquires corresponding screen capture pictures according to the received screen capture information and uploads the screen capture pictures to the cloud management module, and the screen capture module comprises:
matching the screen capturing timestamp in the screen capturing information with the timestamp in the cached screen capturing picture name, if the matching is successful, acquiring the cached screen capturing picture which is matched as the picture to be uploaded, and if the matching is failed, acquiring the cached screen capturing picture which is closest to the screen capturing timestamp as the picture to be uploaded;
and calling a picture uploading interface of the cloud management module, and sending the picture to be uploaded, the user identification, the course identification and the matching state.
Compared with the prior art, the method has the advantages that the screenshot pictures in a certain time range are automatically cached, the screenshot pictures are obtained through direct matching according to the timestamp, the video or the file played in the computer does not need to be processed, the screenshot pictures are obtained according to the timestamp positioning position or the page, resource occupation is reduced, and the screenshot efficiency is improved.
Preferably, in consideration of the possible network delay or fault condition, the screen capture module further comprises a timing monitoring method, specifically, in the screen capture picture matching method, if matching fails, the number of matching failures is counted in the memory, the timing monitoring method monitors the number of matching failures at regular time, and when the obtained number of matching failures is greater than a preset minimum threshold, the preset caching time range is incremented by 1 second, the number of cacheable pictures is refreshed, and the number of matching failures in the memory is cleared; and when the preset caching time range reaches a preset maximum threshold value, sending alarm information.
By the mode, the screen capture module automatically increases the number of the cached pictures and improves the self-adaptive capacity of the screen capture module by adjusting the self-adaptive caching time range within a certain abnormal controllable range. When the screen capture module cannot meet the screen capture requirement through self-adaptive adjustment, alarm information is sent again to inform relevant monitoring personnel, and timely positioning and problem solving are facilitated.
Preferably, the touch-control double-screen device is used as a component in a computer screen capture method and applied to scenes needing screen capture, such as lectures, speeches, meetings and the like. Specifically, the method comprises the following steps:
s110: the touch double-screen device acquires current course information through the place management module, and generates a two-dimensional code according to the place number and the computer number of the touch double-screen device;
the place management modules are independently deployed in various places, are not influenced mutually and are used for managing computer information and class schedule information of users in the various places, wherein the computer information comprises computer numbers, computer IP addresses and computer names; the user's schedule information includes user identification, course name, course date, course start time, course end time, classroom and computer number.
After the touch double-screen device is started, the control module acquires current course information according to the schedule information by calling a place management module of a place where the touch double-screen device is located; the display module displays the current time in the basic information display area and displays the current course information acquired from the control module; the screen capturing module generates a two-dimensional code according to the place number and the computer number; students or listeners join the current course by scanning the two-dimensional code.
S111: detecting the click operation of a screen capture button on the Bluetooth screen capture device, and sending a screen capture instruction to the mobile terminal application software by the Bluetooth screen capture device;
specifically, the bluetooth screen capture includes: the BLE Bluetooth module, the MCU, the screen capture button, the lithium battery and the lithium battery charging and discharging circuit; after the Bluetooth screen capture device is started, the BLE Bluetooth module is in a searchable connectable state, each user is provided with 1 Bluetooth screen capture device before screen capture, and the mobile terminal of each user is connected with the corresponding Bluetooth screen capture device through Bluetooth search, namely the BLE Bluetooth module connected to the Bluetooth screen capture device.
According to the actual scene, the bluetooth screen capture ware can fix portable, for example, under the teaching scene, can install the bluetooth screen capture ware at every table in fixed training classroom, under the meeting scene, can send a bluetooth screen capture ware for every people of participant, perhaps possesses fixed and portable two kinds simultaneously.
And after the MCU detects the click operation of the screen capture button, the BLE Bluetooth module data channel sends a screen capture instruction to the mobile terminal application software of the user.
It should be noted that the screen capture instruction is used to notify the mobile terminal application software to send out screen capture information, and may be a command code, and the specific form is not limited.
Compared with the prior art, the screen capturing request is sent in time through the external screen capturing hardware component, the mobile phone does not need to be opened, the screen capturing opportunity cannot be missed due to complex mobile phone operation, and the lecture listening quality and the screen capturing timeliness rate are improved.
S112: receiving a screen capturing instruction, and sending screen capturing information to a cloud management module by mobile terminal application software;
it should be noted that, the mobile terminal application software, namely the mobile terminal APP, is required to be downloaded and installed by the mobile terminal of each user, and the mobile terminal application software is logged in before screen capture, and is used for receiving screen capture instructions sent by respective corresponding bluetooth screen captures, and performing data interaction with the cloud management module through network communication, so that user login, class schedule information acquisition, and screen capture picture viewing are realized. The mobile terminal in this embodiment includes but is not limited to: the smart phone and the smart interactive tablet do not limit the development mode of application software of the mobile terminal, can be installed and operated on the corresponding mobile terminal, and have the technical characteristics in the embodiment.
After a user logs in the application software of the mobile terminal, the user course information is generated according to the schedule information or the two-dimensional code generated by scanning the touch double-screen device, and the method comprises the following steps: user identification, course identification, place number, computer number, and course date.
After receiving a screen capture instruction of the Bluetooth screen capture device, the mobile terminal application software forms screen capture information to the cloud management module, wherein the screen capture information comprises: user identification, course identification, place number, computer number and screen capture timestamp; the screen capturing timestamp is obtained according to the time when the mobile terminal application software receives the screen capturing instruction, and other information is obtained according to the generated user course information.
S113: according to the place number in the screen capturing information, the cloud management module sends the screen capturing information to the corresponding place management module;
it should be noted that the cloud management module is used as a unified management module and is used for managing user basic information, user course information and place information; the user basic information comprises a user identifier, a user password and a user name; the place information includes a place number, a place name, a place address, and a place service call address.
In a screen capture triggering interface of the cloud, a corresponding site service calling address is obtained according to a site number in screen capture information, a screen capture picture obtaining interface in a site management module is called according to the site service calling address, and screen capture information is transmitted.
S114: according to the computer number in the screen capture information, the site management module is connected with the corresponding screen capture module of the touch control double-screen device and sends the screen capture information;
specifically, the place management module acquires the computer IP address and the connection port according to the computer number, and is connected with the screen capture module of the touch double-screen device through Socket. And transmitting the user identifier, the course identifier and the timestamp in the screen capturing information into the screen capturing module, so that the matched screen capturing picture can be conveniently acquired according to the timestamp.
S115: according to the screen capture information, a screen capture module of the touch dual-screen device acquires a corresponding screen capture picture from the cached screen capture pictures and uploads the screen capture picture to a cloud management module;
s116: the cloud end receives picture information uploaded by a screen capture module in the touch double-screen device and stores the screen capture picture;
specifically, the picture information uploaded by the screen capture module comprises: the picture to be uploaded, the user identification, the course identification and the matching state; and in the picture uploading interface, the received user identification and course identification are used as classified storage directories to store the received pictures to be uploaded, and if the matching state is matching failure, a matching failure mark is added in the picture name.
Illustratively, the user identification is used as a first-level directory of the picture classification storage, and the course identification is used as a second-level directory.
S117: and the mobile terminal application software acquires and displays the screen capture picture from the cloud management module.
Specifically, the mobile terminal application software receives a request of a user for checking screen shot pictures of course information and sends the request for checking the pictures to the cloud management module, wherein the request for checking the pictures comprises a user identifier and a course identifier, and the cloud management module acquires all screen shot pictures from a corresponding classified storage directory according to the received user identifier and the received course identifier and returns the screen shot pictures to the mobile terminal application software;
and the mobile terminal application software sequentially identifies whether matching failure marks exist in the picture names of all the acquired screen shot pictures, displays the screen shot pictures if the matching failure marks do not exist, and displays the screen shot pictures and prompt information if the matching failure marks exist.
It should be noted that the picture with the matching failure flag is the picture closest to the user screen capture time, and may not be required by the user. Illustratively, the prompt message is: closest to the picture.
Preferably, the screen capture pictures in the display interface are displayed in a thumbnail form according to the screen capture time sequence, the thumbnails are clicked, the pictures are amplified, and the pictures can be downloaded and stored in the mobile terminal.
The method has the advantages that classification is automatically concluded according to users and courses, retrieval and checking are facilitated, screen capture pictures can be conveniently downloaded by the users according to needs, and storage and permission of the mobile terminals of the users are not forcibly occupied.
Through the steps S110 to S117, the method for capturing the screen by using the touch dual-screen device is realized, compared with the prior art, the method is a systematic method combining software and hardware, is suitable for teaching and meeting scenes, and meets the requirement of simultaneously capturing the screen by multiple people. Through an external screen capturing hardware component, a screen capturing request is sent in time, a mobile phone does not need to be opened, and the lecture listening quality and the screen capturing timeliness rate are improved; through interaction of the cloud and the place management module, places are not affected by each other, and through the screen capture module on the touch dual-screen device, screen capture pictures are cached at regular time, so that the resolution is high, and the influence of external factors is avoided; and the screen capture picture is matched according to the timestamp, so that the resource occupation is reduced, and the screen capture efficiency is improved.
Those skilled in the art will appreciate that all or part of the processes for implementing the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, for instructing the relevant hardware. The computer readable storage medium is a magnetic disk, an optical disk, a read-only memory or a random access memory.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention.
Claims (9)
1. A touch control double-screen device based on a windows system is characterized by comprising: the system comprises a main screen, an auxiliary screen and a processing unit, wherein the main screen and the auxiliary screen are integrated or movably connected; wherein the content of the first and second substances,
the main screen is a computer touch display screen with a conventional size and operates an application program through touch;
the auxiliary screen is a strip-type touch display screen and comprises a thumbnail region, a shortcut menu region and a tool button region;
the processing unit comprises a display module, a process scanning module, a thumbnail module and a control module, wherein the display module is used for displaying thumbnails in the thumbnail area according to a thumbnail list acquired from the process scanning module, displaying menu information acquired from the control module in the shortcut menu area, and displaying a general operation button in the tool button area; the process scanning module is used for scanning a process, calling the thumbnail module to acquire the thumbnail and generating a thumbnail list; the thumbnail module is used for generating a thumbnail according to the received process information; the control module is used for sending a corresponding instruction and executing an instruction action according to the touch area of the auxiliary screen, and acquiring menu information according to an application program displayed by the main screen; the display module displays the thumbnail in the thumbnail area according to the thumbnail list acquired from the process scanning module, and the display module comprises:
the method comprises the steps that a thumbnail list displayed by a display module is obtained at regular time and serves as a list to be updated, and the thumbnail list obtained from a process scanning module serves as a process list;
comparing the list to be updated with the process list according to the process ID, and updating the list to be updated by using the process list to obtain an updated list;
sequentially overlapping icon identifications in a fixed area of each thumbnail in the latest list by a double-buffer picture overlapping method to integrate into a picture, and displaying the integrated thumbnail picture in a thumbnail area of an auxiliary screen; the integrated thumbnail pictures are sequentially arranged in the thumbnail area along the long edge of the auxiliary screen.
2. The windows-system-based touch dual-screen device according to claim 1, wherein the thumbnail module generates a thumbnail according to the received progress information, and the thumbnail generation process comprises:
acquiring a program window handle according to the process ID in the process information;
copying a window image to a memory DC according to the program window handle, if the window image is successfully copied, storing the window image into a bitmap, and generating a thumbnail according to the bitmap; and if the copying is unsuccessful, the corresponding image is intercepted according to the position and the size of the program window in the program window handle by copying the windows window image, the image is stored as a bitmap, and a thumbnail is generated according to the bitmap.
3. The windows-system-based touch dual-screen device according to claim 2, wherein the process scanning module scans a process, calls the thumbnail module to obtain a thumbnail, and generates the thumbnail list, including:
the process scanning module regularly scans the application process operated by the computer to acquire process information including a process ID and a process name;
calling a thumbnail module, and transmitting a process ID to obtain a thumbnail;
and forming a piece of thumbnail information by each process ID, each process name and the corresponding thumbnail, and putting the thumbnail information into a thumbnail list.
4. The windows-system-based touch dual-screen device according to claim 3, wherein the control module issues a corresponding command and executes a command action according to the touch area of the auxiliary screen, and the command action includes:
when the touch area is located in the area of the icon identifier in the thumbnail area, acquiring the thumbnail to which the current icon identifier belongs, and sending out an instruction corresponding to the icon identifier, and triggering an application program corresponding to the thumbnail to execute an instruction action;
when the touch control area is located in other areas except the icon identification area in the thumbnail area, sending a switching instruction to trigger switching action of an application program corresponding to the thumbnail;
when the touch area is located in the shortcut menu area or the tool button area, a command corresponding to the menu or the button is sent out, and the current application program is triggered to execute the command action or the application program corresponding to the command is called.
5. The windows-system-based touch sensitive dual-screen device of claim 4, wherein the icon identification comprises close and minimize; the sending of the instruction corresponding to the icon identifier triggers the application program corresponding to the thumbnail to execute the instruction action, and the method comprises the following steps:
sending a windows message corresponding to the instruction to an application program corresponding to the thumbnail;
and rechecking whether the application program is executed after delaying according to preset delay time, and if not, calling a process command to execute the instruction action according to the process ID of the application program.
6. The windows-system-based touch dual-screen device according to claim 4, wherein the issuing of the switching instruction to trigger a switching action of the application program corresponding to the thumbnail includes:
the control module acquires a program window handle according to the process ID of the application program and acquires the position of the program window according to the program window handle; identifying whether the position of the program window is in the main screen or not according to the resolution of the main screen, if not, moving the program window to the resolution of the main screen, and simultaneously calling a windows API function to set the program window to be set to the top and maximize the window;
the control module acquires menu information of the current application program according to a preset configuration file;
and the control module informs the display module, the display module sets the touch thumbnail to be highlighted, and the menu information is displayed in the shortcut menu area.
7. The dual-screen touch device based on the windows system according to claim 1, 5 or 6, wherein the device is connected to a computer, the processing unit of the device further includes a screen capture module, and the screen capture module is further configured to generate a two-dimensional code according to a place number where the current dual-screen touch device is located and the computer number, capture a main screen at regular time, cache a screen capture picture, and acquire a corresponding screen capture picture according to received screen capture information and upload the screen capture picture to the cloud management module.
8. The windows-system-based touch control dual-screen device according to claim 7, wherein the screen capture module captures a main screen at regular time, and the caching of the screen capture picture comprises:
acquiring the number of the images which can be cached according to a preset caching time range and an interception interval time;
according to preset intercepting interval time, obtaining a main screen by copying a windows window image to obtain a screenshot picture as a picture to be cached, wherein the name of the picture to be cached has a time stamp;
acquiring the number of cached screen capture pictures, and directly storing the pictures to be cached to a computer if the number of the cached screen capture pictures is less than the number of the pictures which can be cached; and if not, deleting the screenshot picture with the minimum timestamp in the cached screenshot pictures, and then storing the picture to be cached.
9. The windows-system-based touch dual-screen device according to claim 8, wherein the screen capture module obtains a corresponding screen capture picture according to the received screen capture information and uploads the screen capture picture to the cloud management module, and the method includes:
matching the screen capturing timestamp in the screen capturing information with the timestamp in the cached screen capturing picture name, if the matching is successful, acquiring the cached screen capturing picture which is matched as the picture to be uploaded, and if the matching is failed, acquiring the cached screen capturing picture which is closest to the screen capturing timestamp as the picture to be uploaded;
and calling a picture uploading interface of the cloud management module, and sending the picture to be uploaded, the user identification, the course identification and the matching state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210247480.6A CN114579013B (en) | 2022-03-14 | 2022-03-14 | Touch double-screen device based on windows system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210247480.6A CN114579013B (en) | 2022-03-14 | 2022-03-14 | Touch double-screen device based on windows system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114579013A CN114579013A (en) | 2022-06-03 |
| CN114579013B true CN114579013B (en) | 2022-12-20 |
Family
ID=81775399
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210247480.6A Active CN114579013B (en) | 2022-03-14 | 2022-03-14 | Touch double-screen device based on windows system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114579013B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102197362A (en) * | 2008-10-27 | 2011-09-21 | 微软公司 | Surfacing and management of window-specific controls |
| CN104331243A (en) * | 2014-10-22 | 2015-02-04 | 积成电子股份有限公司 | Mobile terminal and large screen display interaction control method based on thumbnail reconstruction |
| CN104714720A (en) * | 2014-12-30 | 2015-06-17 | 上海孩子国科教设备有限公司 | Method for achieving self scanning and client terminal |
| CN107621872A (en) * | 2016-07-13 | 2018-01-23 | 鹦鹉无人机股份有限公司 | The method for showing thumbnail on a display screen, related computer program, electronic installation and electronic display system |
| CN110290326A (en) * | 2019-07-01 | 2019-09-27 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN114157889A (en) * | 2020-08-18 | 2022-03-08 | 海信视像科技股份有限公司 | Display device and touch-control assistance interaction method |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7613383B2 (en) * | 2004-12-02 | 2009-11-03 | Hitachi, Ltd. | Editing method and recording and reproducing device |
| CN105912831B (en) * | 2015-02-19 | 2021-08-20 | 松下知识产权经营株式会社 | Control method of information terminal |
| KR20180027917A (en) * | 2016-09-07 | 2018-03-15 | 삼성전자주식회사 | Display apparatus and control method thereof |
| CN107132975A (en) * | 2017-05-26 | 2017-09-05 | 努比亚技术有限公司 | A kind of control editing and processing method, mobile terminal and computer-readable recording medium |
| CN110881080B (en) * | 2018-09-06 | 2023-10-13 | 上海有偶咨询策划有限公司 | Electronic device relying primarily on physical key interactions with programs |
-
2022
- 2022-03-14 CN CN202210247480.6A patent/CN114579013B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102197362A (en) * | 2008-10-27 | 2011-09-21 | 微软公司 | Surfacing and management of window-specific controls |
| CN104331243A (en) * | 2014-10-22 | 2015-02-04 | 积成电子股份有限公司 | Mobile terminal and large screen display interaction control method based on thumbnail reconstruction |
| CN104714720A (en) * | 2014-12-30 | 2015-06-17 | 上海孩子国科教设备有限公司 | Method for achieving self scanning and client terminal |
| CN107621872A (en) * | 2016-07-13 | 2018-01-23 | 鹦鹉无人机股份有限公司 | The method for showing thumbnail on a display screen, related computer program, electronic installation and electronic display system |
| CN110290326A (en) * | 2019-07-01 | 2019-09-27 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN114157889A (en) * | 2020-08-18 | 2022-03-08 | 海信视像科技股份有限公司 | Display device and touch-control assistance interaction method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114579013A (en) | 2022-06-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2571263B1 (en) | Conference system, event management server, and program | |
| US9335860B2 (en) | Information processing apparatus and information processing system | |
| US8593502B2 (en) | Controlling videoconference with touch screen interface | |
| CN109032485A (en) | Display methods, device, electronic equipment, Intelligent flat and storage medium | |
| US9582903B2 (en) | Display terminal device connectable to external display device and method therefor | |
| EP2284675A2 (en) | Method for displaying data and mobile terminal thereof | |
| WO2019206036A1 (en) | Message management method and terminal | |
| WO2013104053A1 (en) | Method of displaying input during a collaboration session and interactive board employing same | |
| JP6885416B2 (en) | Electronic blackboards, image processing methods for electronic blackboards, and programs | |
| JP2008118301A (en) | Electronic blackboard system | |
| CN106020796A (en) | Interface display method and device | |
| US9509733B2 (en) | Program, communication apparatus and control method | |
| CN109918001B (en) | Interface display method, device and storage medium | |
| CN111770368A (en) | Control method and device for large-screen display equipment, storage medium and electronic equipment | |
| CN102111485A (en) | Mobile terminal and method for projecting by utilizing the same | |
| EP2950503A1 (en) | Communication system, transfer control device, communication method, and computer program product | |
| JP2015060592A (en) | Image processing system, and information processor | |
| JP2015056030A (en) | Image processing apparatus and image processing system | |
| JP2017076207A (en) | Image processing device and image processing system | |
| US20160077551A1 (en) | Portable apparatus and method for controlling portable apparatus | |
| KR20230061519A (en) | Screen capture methods, devices and electronics | |
| CN114579013B (en) | Touch double-screen device based on windows system | |
| KR20220154825A (en) | How to create notes and electronic devices | |
| KR20150012945A (en) | Mobile terminal and method for controlling the same | |
| US20200301645A1 (en) | Display apparatus and display method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |