CN111813302B - Screen projection display method and device, terminal equipment and storage medium - Google Patents
Screen projection display method and device, terminal equipment and storage medium Download PDFInfo
- Publication number
- CN111813302B CN111813302B CN202010514405.2A CN202010514405A CN111813302B CN 111813302 B CN111813302 B CN 111813302B CN 202010514405 A CN202010514405 A CN 202010514405A CN 111813302 B CN111813302 B CN 111813302B
- Authority
- CN
- China
- Prior art keywords
- window
- display
- screen projection
- screen
- sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Abstract
The embodiment of the invention discloses a screen projection display method, a screen projection display device, terminal equipment and a storage medium. The method comprises the following steps: determining that a screen projection request is received when a whiteboard application runs; displaying a screen projection window on a whiteboard application interface corresponding to the whiteboard application, wherein the screen projection window comprises a bearing child window, a display child window and an operation child window which are sequentially displayed from bottom to top, the bearing child window is used for bearing the display child window and is used as a parent window of the operation child window, and the operation child window is loaded with an operation control; displaying screen projection data corresponding to the screen projection request in the display sub-window; and when the triggering operation is detected by the operation control, executing display screen change corresponding to the operation control on the whiteboard application interface. Different picture contents are presented in different hierarchical windows, and each hierarchical window selects a window standard which is suitable for the picture contents, so that the picture rendering delay is reduced, and the video playing fluency is improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of intelligent interactive panels, in particular to a screen projection display method, a screen projection display device, terminal equipment and a storage medium.
Background
Along with the development of intelligent technology, the types of electronic products contacted by people in daily life are increasingly rich, wherein the interactive electronic products realized based on the touch technology have a more comprehensive function integration trend due to good human-computer interaction experience. The intelligent interactive flat panel is representative integrated equipment, is suitable for group interaction occasions such as conferences, teaching, commercial exhibition and the like, and integrates multiple functions such as a projector, a video conference and the like.
The method comprises the steps that based on various rich application designs of an intelligent interactive panel under different application scenes, the screen projection of display pictures of other terminal equipment into the intelligent interactive panel is a common function in multi-user interactive scenes such as teaching and meetings, when the screen projection of the existing intelligent interactive panel is realized, a full-screen transparent window is created after screen transmission content is obtained, and then a window frame, an operation control and screen transmission content are drawn in the full-screen transparent window. When the inventor reappears the screen projection process, the inventor finds that a large rendering delay can occur in the picture drawing process of a full-screen transparent window, and rendering pause is easy to occur in the video playing process.
Disclosure of Invention
The invention provides a screen projection display method, a screen projection display device, terminal equipment and a storage medium, and aims to solve the technical problems of rendering delay and pause during screen projection of a whiteboard application process window in the prior art.
In a first aspect, an embodiment of the present invention provides a screen projection display method, including:
determining that a screen projection request is received when a whiteboard application runs;
displaying a screen projection window on a whiteboard application interface corresponding to the whiteboard application, wherein the screen projection window comprises a bearing child window, a display child window and an operation child window which are sequentially displayed from bottom to top, the bearing child window is used for bearing the display child window and is used as a parent window of the operation child window, and the operation child window is loaded with an operation control;
displaying screen projection data corresponding to the screen projection request in the display sub-window;
and when the triggering operation is detected by the operation control, executing display screen change corresponding to the operation control on the whiteboard application interface.
In a second aspect, an embodiment of the present invention further provides a screen projection display device, including:
the request receiving unit is used for determining that a screen projection request is received when the whiteboard application runs;
the window display unit is used for displaying a screen projection window on a whiteboard application interface corresponding to the whiteboard application, wherein the screen projection window comprises a bearing child window, a display child window and an operation child window which are sequentially displayed from bottom to top, the bearing child window is used for bearing the display child window and is used as a parent window of the operation child window, and the operation child window is loaded with an operation control;
the data display unit is used for displaying the screen projection data corresponding to the screen projection request in the display sub-window;
and the operation response unit is used for executing display screen change corresponding to the operation control on the whiteboard application interface when receiving that the trigger operation is detected by the operation control.
In a third aspect, an embodiment of the present invention further provides a terminal device, including:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the screen projection display method according to any one of the first aspects.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the screen projection display method according to any one of the first aspect.
The screen projection display method, the screen projection display device, the terminal equipment and the storage medium determine that a screen projection request is received when the whiteboard application runs; displaying a screen projection window on a whiteboard application interface corresponding to the whiteboard application, wherein the screen projection window comprises a bearing child window, a display child window and an operation child window which are sequentially displayed from bottom to top, the bearing child window is used for bearing the display child window and is used as a parent window of the operation child window, and the operation child window is loaded with an operation control; displaying screen projection data corresponding to the screen projection request in the display sub-window; and when the triggering operation is detected by the operation control, executing display screen change corresponding to the operation control on the whiteboard application interface. Different picture contents are presented in different level windows, and each level window selects a window standard suitable for the picture contents, so that the delay of picture rendering is reduced, the fluency of video playing corresponding to screen projection is improved, and further the user experience is optimized.
Drawings
Fig. 1 is a flowchart of a screen projection display method according to an embodiment of the present invention;
fig. 2 is an interface schematic diagram of an intelligent interactive tablet according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a screen projection window according to an embodiment of the present invention;
fig. 4 is a schematic diagram of an architecture of a carrier sub-window and a display sub-window according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of an architecture of a display sub-window and an operation sub-window according to an embodiment of the present invention;
fig. 6 is a schematic diagram of instruction and data interaction between a whiteboard process and a window process according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a projection display device according to a second embodiment of the present invention;
fig. 8 is a schematic structural diagram of a terminal device according to a third embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are for purposes of illustration and not limitation. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
It should be noted that, for the sake of brevity, this description does not exhaust all alternative embodiments, and it should be understood by those skilled in the art after reading this description that any combination of features may constitute an alternative embodiment as long as the features are not mutually inconsistent.
For example, in one embodiment of the first embodiment, one technical feature is described: the screen projection picture is displayed on one layer of three layers of screen projection windows which are independently added in the whiteboard application interface, and related interaction is carried out on the other layer, and in another implementation manner of the first embodiment, another technical characteristic is described: the running of the whiteboard application interface is realized through a whiteboard process, and the running of the screen projection window is realized through a window process; data transmission between the whiteboard process and the window process is realized through interprocess communication. Since the above two technical features are not contradictory to each other, after reading the present specification, it should be understood by those skilled in the art that an implementation mode having both of these two features is also an optional implementation mode, that is, the whiteboard application interface and the screen projection window each perform an independent task, and when there is data interaction between processes, after completing corresponding data transmission through inter-process communication, each performs processing based on the transmitted data.
It should be noted that the embodiment of the present disclosure is not a set of all the technical features described in the first embodiment, some of the technical features are described for the optimal implementation of the disclosure, and the combination of several technical features described in the first embodiment may be used as an independent embodiment if the design of the present disclosure is designed originally, and may of course be used as a specific product form.
The following examples are described in detail.
Example one
Fig. 1 is a flowchart of a screen projection display method according to an embodiment of the present invention. The screen projection display method provided in the embodiment may be executed by an operating device of the smart interaction tablet, the operating device of the smart interaction tablet may be implemented in a software and/or hardware manner, and the operating device of the smart interaction tablet may be formed by two or more physical entities or may be formed by one physical entity. For example, the operating device of the smart interactive tablet may be a cell phone, an industrial control computer, or the like.
For the convenience of understanding, in the embodiment, the intelligent interactive tablet is taken as an actual carrier, and a detailed process of adjusting target selection, association and adjusting response when the screen projection display method is implemented is exemplarily described. The intelligent interactive panel can be an integrated device which controls the content displayed on the display panel and realizes man-machine interaction operation through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound box, a television, a video conference terminal and the like.
Generally, as shown in fig. 2, the smart interactive tablet 1 includes at least one display screen. For example, the smart interactive tablet 1 is configured with a display screen with touch function, and the display screen may be a capacitive screen, a resistive screen or an electromagnetic screen. In this embodiment, an intelligent interactive tablet is provided, and further, a user may implement a touch operation by touching a display screen with a finger or a stylus, and accordingly, the intelligent interactive tablet detects a touch position and responds according to the touch position to implement a touch function. Typically, the smart interactive tablet is installed with at least one operating system, wherein the operating system includes, but is not limited to, an android system, a Linux system, and a Windows system. Further, the smart interactive tablet may install at least one application having a writing function. The application program may be an application program carried by an operating system, and an application program downloaded from a third-party device or a server is also installed. Optionally, the application program has other editing functions besides the writing function, such as inserting tables, inserting pictures, inserting graphics, drawing tables, drawing graphics, and the like. And the drawn table or graph is a standard element drawn by the computer. Computer drawn standard elements may be understood as print standard elements drawn by an intelligent interactive tablet, which are distinguished from elements written by a user.
A touch screen configured by intelligent handwriting equipment such as an electronic whiteboard, an electronic blackboard, a digitizer, an intelligent conference tablet and the like is provided with a writing area for responding to the writing operation of a user to display input content, when writing is performed in the writing area, for example, a touch pen or a finger is used to touch the touch screen, the touch screen can sense the change of current, the change of voltage or the change of magnetic flux (corresponding to the specific setting type of the capacitive touch screen, the resistive touch screen or the electromagnetic touch screen), so as to obtain a touch signal containing the coordinates of the touch position and the trigger time of the touch signal, according to the coordinates of the touch position and the trigger time of the touch signal, track data of a writing track input in the process of writing to lifting and stopping writing by a stylus or a finger of a user can be obtained, and the writing track input by the user is displayed in a writing area of the touch screen in real time according to the track data. Of course, the writing process is not limited to writing, and any entry process implemented on the touch screen of the intelligent handwriting device for displaying the operation track can be regarded as the writing process. In addition, the touch operation may respond to operations such as clicking, dragging, and the like of the user according to the difference of the display element of the occurrence position of the touch operation. The way in which these different responses are processed at the bottom level is the same. Generally, the area where the touch writing occurs coincides with the area where the display is located, i.e., the display area 2 shown in fig. 2. Based on the hardware realization of basic functions such as touch and display, the function of whiteboard application can be further realized on the intelligent interactive flat plate, and each embodiment of the scheme is the scheme realization of the whiteboard application.
Specifically, referring to fig. 1, the screen projection display method specifically includes:
and S101, determining that a screen projection request is received when the whiteboard application runs.
The whiteboard application can be used mainly by a certain function in an adaptive manner according to actual use requirements in different application scenes. For example, in a brainstorming scenario, the whiteboard application is primarily used to record the mind of the participant, while the whiteboard application is primarily used for user handwriting input, display, and recording of corresponding input content. In a conventional teaching scenario centered in the classroom, the whiteboard application is mainly used to display the courseware and to operate the change of the presentation page of the courseware according to the advancement of the teaching activities. In a group discussion scene, a plurality of people may carry a personal computer, in which data prepared by the people in advance are stored, the plurality of data prepared by the people need to be sequentially displayed to participants in the group discussion, the data are limited by a short board of the personal computer in the display aspect, and the prepared data need to be displayed in an intelligent interactive tablet. In the third application scenario, the data of multiple personal computers can be copied to the intelligent interactive tablet for display, or can be directly opened in the personal computers, and then the content displayed in the personal computers is projected to the intelligent interactive tablet for display. In the actual display process, in order to reduce the preliminary preparation work and improve the convenience of switching different display personnel, the content displayed in the selected personal computer is generally projected to the intelligent interactive panel for displaying, and the screen projected and displayed picture is selected to be displayed in the whiteboard application in order to improve the interactive effect in the display process.
When the personal computer needs to screen, a screen-casting request is initiated through a connected public network or a special screen-casting peripheral, and the whiteboard application can enter a screen-casting state after receiving the screen-casting request during running. If the screen projection is initiated through the public network, the screen projection instruction is generated and transmitted through a corresponding program application installed in the personal computer, and if the screen projection is initiated through the special screen projection peripheral, the screen projection instruction is generated and sent through a control module in the special screen projection peripheral.
The screen projection instruction may be a separate data packet, which may include a screen projection establishment request, parameters of a screen projection screen, and the like. The screen projection instruction can also be encoded screen projection data, and after the received data type is determined to be the screen projection data, the screen projection instruction is determined to be received, and the parameters of the screen projection picture can be obtained from the screen projection data.
And S102, displaying a screen projection window on a whiteboard application interface corresponding to the whiteboard application, wherein the screen projection window comprises a bearing child window, a display child window and an operation child window which are sequentially displayed from bottom to top, the bearing child window is used for bearing the display child window and serves as a parent window of the operation child window, and the operation child window is loaded with an operation control.
The application interface refers to an interactive interface used for receiving and/or displaying information, such as an application of a video playing class, and the interactive interface is mainly used for displaying a changed video picture; the real-time communication type application, wherein the interactive interface is mainly used for receiving the content input by a near-end user and displaying the content input by a far-end user; the interactive interface of the file editing application is mainly used for receiving and displaying the content input by the user; the interactive interface of the browser-type application is mainly used for receiving keywords input by a user and displaying webpage content obtained based on the keywords.
In this embodiment, the application interface specifically targeted refers to a user interface presented in the whiteboard application use process, that is, a whiteboard application interface. As described above, the whiteboard application refers to an application for a user to perform operations such as writing and displaying, and may be used to generate writing traces according to a writing track of the user on the whiteboard application interface, and may also be used to insert other multimedia elements such as graphics, pictures, forms, and the like on the whiteboard application interface. In the whiteboard application interface, a user can realize writing, drawing, erasing and other operations similar to those of an entity blackboard, and further has better digital functions of moving, storing, zooming, inserting pictures, adjusting colors, setting stroke weights and the like. Writing-based operations in whiteboard applications are a mature realization of the prior art and are not described in detail in this solution. In practical applications, the whiteboard application may also be named as a writing application, an electronic whiteboard application, a collaborative whiteboard application, and the like, and the application for realizing the above functions is equivalent to the whiteboard application of the present application regardless of changes in the name.
During use of the whiteboard application, the whiteboard application is typically displayed in full screen, i.e. the whiteboard application fills up the display area 2 of the intelligent interactive tablet 1 in fig. 2, which is equivalent to the whiteboard application interface filling up the display area 2 in fig. 2. And corresponding to the full-screen display of the whiteboard application interface, the screen projection window is displayed in the middle of the whiteboard application interface in a top-mounted manner, and whether the screen projection window is displayed in the full-screen manner is set by a user according to requirements. If supplementary explanation needs to be carried out on the display content or the opinions of discussion participants are recorded in the current display process, the screen projection window displays in a local area of the whiteboard application interface, and then temporary content is recorded in an area outside the screen projection window in the whiteboard application interface. If only the displayed data need to be watched in the current display process, the screen projection window can be displayed in a full screen mode, and the largest information display interface is obtained.
In the scheme, the problem to be solved firstly is how to realize smooth display of the data stream corresponding to the screen projection in the screen projection window when the screen projection window is displayed in the whiteboard application interface. Firstly, for a screen projection window, while the screen projection window is integrally set on the whiteboard application interface for display, as shown in fig. 3, the inside of the screen projection window further includes a carrier sub-window 10, a display sub-window 20, and an operation sub-window 30 which are sequentially displayed from bottom to top, where the carrier sub-window 10 is used for carrying the display sub-window 20 and is used as a parent window of the operation sub-window 30, and the operation sub-window 30 is further loaded with an operation control. In terms of overall design, the playing process of the screen projection data in the whiteboard application interface is further subdivided into a display task and an interaction task, and a proper window standard is selected for the display task and the interaction task respectively to achieve a better display effect and interaction experience.
In a specific implementation, the carrier sub-window 10 and the operation sub-window 30 are both WPF (Windows Presentation Foundation) Windows, and the display sub-window 20 is a Win32 window. The carrying sub-window 10 is only used for carrying some other windows (i.e. the display sub-window 20 and the operation sub-window 30), so that a full-screen transparent window can be created in the present scheme, so that the other windows can be movably displayed at any position in the whiteboard application interface, and of course, the carrying sub-window 10 may also be set as a transparent window locally existing with respect to the whiteboard application interface, so that the other windows are correspondingly limited to be moved and displayed locally on the whiteboard application interface, specifically according to the specific design or current use setting of the product. In order to allow the Win32 window (i.e., the display sub-window 20) to serve as a sub-window for carrying the Win32 window, and to facilitate adjustment of the position and width of the Win32 window, as shown in fig. 4, an HwndHost control is further adopted in the present embodiment to carry a Win32 window, and adjustment of the Win32 window can be indirectly achieved by adjusting the position and width of the control (the HwndHost control is a bottom-layer control for solving the window hierarchical relationship in WPF, and the Win32 window needs to be created in the form of a sub-window). The initial size or length-width ratio of the display sub-window 20 is set according to the parameters of the screen projection.
In the scheme, the related processes of window creation and screen projection display can be specifically realized through the following processes: upon receipt of the screen-cast request, the Win2 window (i.e., display sub-window 20) is first created in a sub-window style and the window handle is passed to the whiteboard application so that the screen-cast content is properly presented in the designated window. And then adding the created Win32 window into the HwndHost control, and adding the control into a full-screen transparent window (namely the carrier sub-window 10), wherein the Win32 window automatically becomes a sub-window of the full-screen transparent window. Further calling the Show () method presents a full screen shot window and starts the decoding operation of the pass screen. After the content of the first frame of the screen is received after decoding, a full-screen transparent window (i.e., the operation sub-window 30) of the operation layer and the operation control inside the full-screen transparent window are created and displayed, and the full-screen transparent window (i.e., the operation sub-window 30) is set as the sub-window of the full-screen transparent window (i.e., the carrying sub-window 10) described above. And after the window control is successfully established, generating a corresponding window control according to the aspect ratio of the content of the first frame of the screen transmission, and setting the position size of the HwndHost (the position size of the HwndHost is controlled by the user-defined window control).
In order to facilitate interactive control in the screen projection process, a certain position association relationship may be set for operation controls related to screen projection content and interactive control, in the present solution, the structural design implemented in different windows is adapted to display tasks and interactive tasks, and further definition is performed on the display relationship of the corresponding sub-windows, specifically, as shown in fig. 5, the operation sub-window 30 includes a content display area related to the operation controls, and the display sub-window 20 overlaps with the content display area (so the content display area is not separately marked). The visual association of the operation control and the display sub-window on the display effect is realized by setting the associated content display area for the operation control and then setting the overlap of the content display area and the display sub-window.
In addition, in order to make the user clearly distinguish the different operation areas, a frame 31 of the screen projection window is also displayed in the operation sub-window, and generally, the frame 31 of the screen projection window surrounds an area where the sub-window 20 is displayed (i.e., an area of the content display area) and a display area where the control is operated.
Step S103: and displaying screen projection data corresponding to the screen projection request in the display sub-window.
And after the screen projection is confirmed to be started, the personal computer continuously sends screen projection data, the screen projection data are coded continuous frame image data, the intelligent interactive panel starts to decode after receiving the screen projection data, and the decoded image data are displayed to the display sub-window.
Step S104: and when the triggering operation is detected by the operation control, executing display screen change corresponding to the operation control on the whiteboard application interface.
In the screen projection process, when the contents are mainly viewed or discussed, the screen can be operated, and certainly, the screen projection method is suitable for the use requirements in the screen projection scene, and only relatively simple operation requirements such as screen capture, page turning up and down, full screen and the like exist in a screen projection window, and the change of a single display screen per se belongs to the conventional implementation of human-computer interaction, and is not further described herein.
In addition, on the basis of the aforementioned overlapping arrangement of the display sub-window and the content display area, the screen-projection display method further includes:
and S105, receiving a screen projection window moving instruction.
For the touch-based intelligent interactive tablet, the screen projection window movement instruction may be triggered by a touch operation, specifically, for example, by pressing a set area (usually a frame) of the touch display sub-window for a long time, or, for example, by pressing any position of the touch display sub-window for a long time. Of course, the screen projection window movement command may be generated by confirming the click of the mouse on the set position.
And step S106, screenshot is carried out on the display content in the display sub-window to obtain a temporary window picture, the temporary window picture is displayed in the content display area, and the display state of the display sub-window is switched to be invisible.
Compared with the bottom layer processing mechanism of the existing window moving scheme, the method and the device have the advantages that screenshot is carried out on the current display content, the temporary window picture is displayed in the content display area, and the display state of the display sub-window is switched to be invisible. The specific switching process may be that the size of the display sub-window is temporarily set to 1 × 1 through the HwndHost control, and at this time, the display sub-window completes corresponding display through one pixel, and a screen-casting picture cannot be really displayed in the display sub-window. At this time, in terms of visual effect, the screen projection related display elements such as the operation control, the screen projection picture and the like are all in a display state, but actually, the currently displayed screen projection picture is not obtained by real-time decoding, and is only a static screenshot in the screen projection picture, which is equivalent to that while the screen projection effect is basically kept, background decoding and rendering related data processing are greatly reduced, and the display of a static picture is maintained.
And S107, updating the display positions of the operation control and the content display area according to the movement track corresponding to the screen projection window movement instruction.
In the moving process, the display position of the operation control and the position of the content display area are continuously updated corresponding to the moving track corresponding to the screen projecting window moving instruction (confirmed by detecting the moving track of the touch point or the moving track of the mouse), because the temporary window picture is displayed in the content display area, the display position of the operation control and the display position of the temporary window picture are continuously updated visually, and finally, the visual effect that all visible elements in the screen projecting window move along with the moving track is formed. In fact, the screen projection data are not really displayed in the process, and the screen projection data are not required to be continuously rendered according to the change of the moving track, so that video blocking caused by screen projection rendering in the moving process is avoided.
And S108, at the end point of the moving track, restoring the display of the display sub-window corresponding to the display position of the content display area, and finishing the display of the temporary window picture.
After the movement is finished, the new display position continues to be displayed according to the child window framework in the scheme. Namely, the display of the display sub-window is resumed, the decoded screen projection picture display is continued, and the display of the temporary serial port picture is finished.
In a whole, by setting the display sub-window, the area which is necessary to be rendered is rendered in a targeted manner based on the display sub-window, and a part of area in the full-screen transparent window is set as the rendering area, so that the rendering content actually occupied by the screen transmission serial port is effectively reduced.
When the scheme is specifically realized, the running of the whiteboard application interface is realized through a whiteboard process, and the running of the screen projection window is realized through a window process; meanwhile, data transmission between the whiteboard process and the window process is realized through inter-process communication. The screen projection window is drawn into a process independent of the whiteboard, and specific interaction (such as opening/storing/screenshot and the like) with the whiteboard is realized through interprocess communication, so that the whiteboard process is not influenced by the windowed process, the memory occupation is reduced, and the functions of writing and the like are not influenced.
In general, the data transmitted between the whiteboard process and the window process includes: a request instruction and feedback data responsive to the request instruction. Corresponding to the specific operations of opening, containing, storing and screenshot, corresponding data transmission is carried out respectively. Specifically, reference may be made to fig. 6, which respectively corresponds to the instruction and data transmission processes of the whiteboard process and the window process in the entire display period of the screen projection window, which exist due to each possible related operation. For example, after the whiteboard process receives a screen projection instruction, the corresponding parameters of the screen projection picture are correspondingly received, the parameters of the screen projection picture are used as process parameters, a window process is started, the parameters of the screen projection picture are sent, and the window process confirms the creation details of the screen projection window according to the parameters of the screen projection picture. For another example, the whiteboard process requests the window process for the storage content of the currently-projected window according to the trigger of the save button, and the window process sends the acquired storage content to the whiteboard process according to the request. And the screenshot is that after the window process detects that the screenshot control is triggered, the generated screenshot data is sent to the whiteboard process for subsequent processing (for example, inserting a whiteboard application interface and performing subsequent editing).
By means of the relatively independent operation of the whiteboard process and the window process, the coupling degree of the windowed screen projection and whiteboard application is reduced, and the memory occupation of the whiteboard process is reduced. And the whiteboard process and the window process which run relatively independently do not influence the running of the whiteboard process even if the window process is abnormal or crashed, thereby effectively reducing the abnormal probability of the whiteboard.
Determining that a screen projection request is received when the whiteboard application runs; displaying a screen projection window on a whiteboard application interface corresponding to the whiteboard application, wherein the screen projection window comprises a bearing child window, a display child window and an operation child window which are sequentially displayed from bottom to top, the bearing child window is used for bearing the display child window and is used as a parent window of the operation child window, and the operation child window is loaded with an operation control; displaying screen projection data corresponding to the screen projection request in the display sub-window; and when the triggering operation is detected by the operation control, executing display screen change corresponding to the operation control on the whiteboard application interface. Different picture contents are presented in different level windows, and each level window selects a window standard suitable for the picture contents, so that the delay of picture rendering is reduced, the fluency of video playing corresponding to screen projection is improved, and further the user experience is optimized.
Example two
Fig. 7 is a schematic structural diagram of a projection display device according to a second embodiment of the present invention. Referring to fig. 7, the screen projection display apparatus includes: a request receiving unit 201, a window display unit 202, a data display unit 203, and an operation response unit 204.
The request receiving unit 201 is configured to determine that a screen projection request is received when a whiteboard application runs; a window display unit 202, configured to display a screen projection window on a whiteboard application interface corresponding to the whiteboard application, where the screen projection window includes a bearing sub-window, a display sub-window, and an operation sub-window, which are sequentially displayed from bottom to top, the bearing sub-window is used to bear the display sub-window and serve as a parent window of the operation sub-window, and the operation sub-window is loaded with an operation control; a data display unit 203, configured to display screen projection data corresponding to the screen projection request in the display sub-window; and the operation response unit 204 is configured to execute, on the whiteboard application interface, a display screen change corresponding to the operation control when the operation control detects a trigger operation.
On the basis of the above embodiment, the operation sub-window includes a content display area associated with the operation control, and the display sub-window overlaps with the content display area.
On the basis of the above embodiment, the screen projection display device further includes:
the mobile instruction receiving unit is used for receiving a screen projection window mobile instruction;
the display preprocessing unit is used for carrying out screenshot on the display content in the display sub-window to obtain a temporary window picture, displaying the temporary window picture in the content display area and switching the display state of the display sub-window to be invisible;
the position updating unit is used for updating the display positions of the operation control and the content display area according to the movement track corresponding to the screen projection window movement instruction;
and the display updating unit is used for restoring the display of the display sub-window corresponding to the display position of the content display area at the end point of the moving track and finishing the display of the temporary window picture.
On the basis of the embodiment, the running of the whiteboard application interface is realized through a whiteboard process, and the running of the screen projection window is realized through a window process;
and the data transmission between the whiteboard process and the window process is realized through interprocess communication.
On the basis of the above embodiment, the data transmitted between the whiteboard process and the window process includes: a request instruction and feedback data responsive to the request instruction.
On the basis of the above embodiment, the carrier sub-window and the operation sub-window are both WPF windows, and the display sub-window is a Win32 window.
On the basis of the above embodiment, the operation sub-window further displays a frame of the screen projection window.
The screen projection display device provided by the embodiment of the invention is included in the operating equipment of the intelligent interactive tablet, can be used for executing any screen projection display method provided by the first embodiment, and has corresponding functions and beneficial effects.
EXAMPLE III
Fig. 8 is a schematic structural diagram of a terminal device according to a third embodiment of the present invention, where the terminal device is a specific hardware presentation scheme of the operation device of the intelligent interactive tablet. As shown in fig. 8, the terminal device includes a processor 310, a memory 320, an input means 330, an output means 340, and a communication means 350; the number of the processors 310 in the terminal device may be one or more, and one processor 310 is taken as an example in fig. 8; the processor 310, the memory 320, the input device 330, the output device 340 and the communication device 350 in the terminal equipment may be connected by a bus or other means, and fig. 8 illustrates the connection by the bus as an example.
The memory 320 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the screen projection display method in the embodiment of the present invention (for example, the request receiving unit 201, the window display unit 202, the data display unit 203, and the operation response unit 204 in the screen projection display device). The processor 310 executes various functional applications and data processing of the terminal device by executing software programs, instructions and modules stored in the memory 320, so as to implement the above-mentioned screen-projection display method.
The memory 320 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal device, and the like. Further, the memory 320 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, memory 320 may further include memory located remotely from processor 310, which may be connected to the terminal device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 330 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the terminal apparatus. The output device 340 may include a display device such as a display screen.
The terminal equipment comprises the screen projection display device, can be used for executing any screen projection display method, and has corresponding functions and beneficial effects.
Example four
The embodiment of the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform operations related to the screen projection display method provided in any embodiment of the present application, and have corresponding functions and advantages.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product.
Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein. The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory. The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (9)
1. A screen projection display method is characterized by comprising the following steps:
determining that a screen projection request is received when a whiteboard application runs;
displaying a screen projection window on a whiteboard application interface corresponding to the whiteboard application, wherein the screen projection window comprises a bearing child window, a display child window and an operation child window which are sequentially displayed from bottom to top, the bearing child window is used for bearing the display child window and is used as a parent window of the operation child window, and the operation child window is loaded with an operation control;
displaying screen projection data corresponding to the screen projection request in the display sub-window;
when the triggering operation is detected by the operation control, executing display image change corresponding to the operation control on the whiteboard application interface;
wherein the operation sub-window comprises a content display area associated with the operation control, and the display sub-window overlaps with the content display area.
2. The screen projection display method according to claim 1, further comprising:
receiving a screen projection window moving instruction;
screenshot is carried out on the display content in the display sub-window to obtain a temporary window picture, the temporary window picture is displayed in the content display area, and the display state of the display sub-window is switched to be invisible;
updating the display positions of the operation control and the content display area according to the movement track corresponding to the screen projection window movement instruction;
and at the end point of the moving track, restoring the display of the display sub-window corresponding to the display position of the content display area, and finishing the display of the temporary window picture.
3. The screen projection display method according to claim 1, wherein the running of the whiteboard application interface is realized by a whiteboard process, and the running of the screen projection window is realized by a window process;
and the data transmission between the whiteboard process and the window process is realized through interprocess communication.
4. The screen projection display method according to claim 3, wherein the data transmitted between the whiteboard process and the window process comprises: a request instruction and feedback data responsive to the request instruction.
5. The screen projection display method according to claim 1, wherein the carrier sub-window and the operation sub-window are WPF windows, and the display sub-window is a Win32 window.
6. The screen-projection display method of claim 1, wherein the operation sub-window further displays a border of the screen-projection window.
7. A screen projection display device, comprising:
the request receiving unit is used for determining that a screen projection request is received when the whiteboard application runs;
the window display unit is used for displaying a screen projection window on a whiteboard application interface corresponding to the whiteboard application, wherein the screen projection window comprises a bearing child window, a display child window and an operation child window which are sequentially displayed from bottom to top, the bearing child window is used for bearing the display child window and is used as a parent window of the operation child window, and the operation child window is loaded with an operation control;
the data display unit is used for displaying the screen projection data corresponding to the screen projection request in the display sub-window;
the operation response unit is used for executing display screen change corresponding to the operation control on the whiteboard application interface when receiving the triggering operation detected by the operation control;
wherein the operation sub-window comprises a content display area associated with the operation control, and the display sub-window overlaps with the content display area.
8. A terminal device, comprising:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the screen projection display method of any of claims 1-6.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a screen projection display method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010514405.2A CN111813302B (en) | 2020-06-08 | 2020-06-08 | Screen projection display method and device, terminal equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010514405.2A CN111813302B (en) | 2020-06-08 | 2020-06-08 | Screen projection display method and device, terminal equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111813302A CN111813302A (en) | 2020-10-23 |
| CN111813302B true CN111813302B (en) | 2022-02-08 |
Family
ID=72844773
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010514405.2A Active CN111813302B (en) | 2020-06-08 | 2020-06-08 | Screen projection display method and device, terminal equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111813302B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114756158A (en) * | 2020-12-29 | 2022-07-15 | 广州视源电子科技股份有限公司 | Application window screen-projection switching method, device, system, medium and electronic equipment |
| CN115686279A (en) * | 2021-07-23 | 2023-02-03 | 华为技术有限公司 | Content display method, electronic equipment and system |
| CN115016697A (en) * | 2021-09-08 | 2022-09-06 | 荣耀终端有限公司 | Screen projection method, computer device, readable storage medium, and program product |
| WO2023097612A1 (en) * | 2021-12-02 | 2023-06-08 | 广州视臻信息科技有限公司 | Interaction implementation method and apparatus, interaction tablet and storage medium |
| CN114296671A (en) * | 2021-12-23 | 2022-04-08 | 深圳市宝视达光电有限公司 | Multi-screen conference interaction method, equipment, device and storage medium |
| CN114510205B (en) * | 2021-12-30 | 2024-03-15 | 京东方科技集团股份有限公司 | Display interaction method, display device, electronic device and storage medium |
| CN114020233B (en) * | 2022-01-06 | 2022-04-08 | 广州朗国电子科技股份有限公司 | Meeting whiteboard window mode writing adaptation method, system, device and medium |
| CN117156205A (en) * | 2022-05-24 | 2023-12-01 | 北京字节跳动网络技术有限公司 | Image display method and device and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102298491A (en) * | 2011-06-16 | 2011-12-28 | 珠海全志科技有限公司 | Embedded graphical interface system and image generation method thereof |
| CN103581754A (en) * | 2012-07-20 | 2014-02-12 | 腾讯科技（深圳）有限公司 | Data display method and intelligent equipment |
| CN108958608A (en) * | 2018-07-10 | 2018-12-07 | 广州视源电子科技股份有限公司 | Interface element operating method, device and the interactive intelligence equipment of electronic whiteboard |
| WO2019001347A1 (en) * | 2017-06-30 | 2019-01-03 | 腾讯科技（深圳）有限公司 | Screen projection method for mobile device, storage medium, terminal and screen projection system |
| CN109725967A (en) * | 2018-12-18 | 2019-05-07 | 努比亚技术有限公司 | The method of adjustment and device, mobile terminal and storage medium of horizontal/vertical screen display mistake |
| CN110381195A (en) * | 2019-06-05 | 2019-10-25 | 华为技术有限公司 | A kind of throwing screen display methods and electronic equipment |
-
2020
- 2020-06-08 CN CN202010514405.2A patent/CN111813302B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102298491A (en) * | 2011-06-16 | 2011-12-28 | 珠海全志科技有限公司 | Embedded graphical interface system and image generation method thereof |
| CN103581754A (en) * | 2012-07-20 | 2014-02-12 | 腾讯科技（深圳）有限公司 | Data display method and intelligent equipment |
| WO2019001347A1 (en) * | 2017-06-30 | 2019-01-03 | 腾讯科技（深圳）有限公司 | Screen projection method for mobile device, storage medium, terminal and screen projection system |
| CN108958608A (en) * | 2018-07-10 | 2018-12-07 | 广州视源电子科技股份有限公司 | Interface element operating method, device and the interactive intelligence equipment of electronic whiteboard |
| CN109725967A (en) * | 2018-12-18 | 2019-05-07 | 努比亚技术有限公司 | The method of adjustment and device, mobile terminal and storage medium of horizontal/vertical screen display mistake |
| CN110381195A (en) * | 2019-06-05 | 2019-10-25 | 华为技术有限公司 | A kind of throwing screen display methods and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111813302A (en) | 2020-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111813302B (en) | Screen projection display method and device, terminal equipment and storage medium | |
| CN110928468B (en) | Page display method, device, equipment and storage medium of intelligent interactive tablet | |
| CN110928459B (en) | Writing operation method, device, equipment and storage medium of intelligent interactive tablet | |
| WO2019140976A1 (en) | Method and device for operating smart interactive tablet, and smart interactive tablet | |
| US11620047B2 (en) | Method, apparatus, terminal device, and storage medium for operating interactive white board | |
| WO2020211368A1 (en) | Presentation file interaction method and apparatus, terminal device and storage medium | |
| CN110928475B (en) | Page interaction method, device, equipment and storage medium of intelligent interaction panel | |
| CN110941373B (en) | Interaction method and device for intelligent interaction panel, terminal equipment and storage medium | |
| CN110941382B (en) | Display operation method, device, equipment and storage medium of intelligent interactive panel | |
| WO2019223280A1 (en) | Method and device for operating intelligent interactive tablet and intelligent interactive tablet | |
| WO2021258917A1 (en) | Intelligent interaction method and device, and storage medium | |
| CN111580903B (en) | Real-time voting method, device, terminal equipment and storage medium | |
| CN111338538A (en) | Page operation method, device, equipment and storage medium of intelligent interactive tablet | |
| CN110471611B (en) | Keyboard starting method and device, terminal equipment and storage medium | |
| CN111580713B (en) | Display interaction system | |
| WO2021196527A1 (en) | Image processing method and apparatus for touch display product, and storage medium and electronic device | |
| CN112462989A (en) | Operation method and device of intelligent interaction panel, intelligent interaction panel and medium | |
| TWI485616B (en) | Method for recording trajectory and electronic apparatus | |
| CN109144397B (en) | Erasing method and device and intelligent interactive panel | |
| WO2021068405A1 (en) | Element transfer method, apparatus and device, and storage medium | |
| CN112462972A (en) | White board page new method and device, interactive panel and storage medium | |
| WO2023217177A1 (en) | Method for processing application window, and storage medium and intelligent interaction tablet computer | |
| CN116185269A (en) | Element selection method, element selection device, storage medium and electronic equipment | |
| CN116108307A (en) | Method and device for displaying local native program window content in browser |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |