CN111601120A - Wireless screen transmission display system and display method - Google Patents
Wireless screen transmission display system and display method Download PDFInfo
- Publication number
- CN111601120A CN111601120A CN202010317003.3A CN202010317003A CN111601120A CN 111601120 A CN111601120 A CN 111601120A CN 202010317003 A CN202010317003 A CN 202010317003A CN 111601120 A CN111601120 A CN 111601120A
- Authority
- CN
- China
- Prior art keywords
- screen
- display
- module
- receiving end
- screen projection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43632—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wired protocol, e.g. IEEE 1394
- H04N21/43635—HDMI
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N21/4438—Window management, e.g. event handling following interaction with the user interface
Abstract
The invention discloses a wireless screen transmission display system and a display method. The screen transmission source end mainly completes the collection and coding of screen projection data; the sending end is connected with the screen transmitting source end through the USB interface, communicates with the screen transmitting source end through the HID protocol, and communicates with the receiving end through a wireless communication mode. The receiving terminal is a screen projection display terminal and decodes and displays screen projection data obtained through wireless communication transmission. The wireless transmission screen display scheme mainly comprises suspension display, split screen display, overlapping display, expansion display and the like, and the receiving end can perform automatic split screen display according to the number of transmission screen source end equipment connected currently. The invention realizes the diversification of the screen transmission display forms, improves the utilization rate of the screen, and enables the user to operate more efficiently and quickly during multi-screen projection.
Description
Technical Field
The invention relates to the field of display application, in particular to a wireless screen transmission display system and a display method.
Background
With the progress of wireless communication technology, wireless transmission screens are paid more and more attention and favored by people. The wireless screen transmission technology enables a user to project contents to be displayed of equipment such as a notebook computer, a smart phone and a tablet personal computer to an interactive large screen for demonstration, and compared with wired connection, the method can avoid a complicated process of physical connection.
The wireless screen transmission technology has wide application occasions, for example, in conference rooms of many large enterprises, conference personnel need to display conference contents on a computer to a conference screen; in teaching, a teacher needs to project courseware on a computer to a large screen, so that students can watch the courseware conveniently.
With the increasingly wide application of wireless screen transmission in scenes such as conferences and education, the requirements for interactive experience are also higher and higher. Most of the display schemes of the wireless screen projection only support basic display modes such as two screens and the like, and the display mode of the projection screen is single, so that the display effect of the projection screen is poor; and when the conference needs a plurality of devices to transmit screens, the switching of a plurality of screen projection interfaces is unfriendly, so that the demonstration efficiency is low.
Disclosure of Invention
In order to solve the problem that the existing wireless screen transmission equipment does not support rich display styles and friendly interactive display, the invention aims to solve the technical problem of providing a wireless screen transmission display system and a display method, so that the wireless screen transmission equipment supports the functions of suspension display, split screen display, overlapped display, extended display and the like, the display is more diversified, the screen projection display effect of the wireless screen transmission equipment is enhanced, the utilization rate of a screen is improved for multi-screen transmission, and the interactivity and the demonstration efficiency are improved.
In order to solve the technical problems and achieve the technical effects, the invention provides a wireless screen transmission display system and a display method. The wireless screen transmission display system comprises a screen transmission source end, a sending end and a receiving end.
The screen transmitting source end comprises a screen projection data acquisition module, a screen projection data coding module and a first HID communication module, the screen projection data acquisition module is used for acquiring screen data to be projected, the screen projection data coding module is used for coding the screen projection data, and the first HID communication module is used for transmitting the coded screen projection data to the transmitting end.
The sending end mainly comprises a pairing module, a second HID communication module and a first wireless communication module, wherein the pairing module is used for completing pairing of wireless screen transmission equipment, the second HID communication module is used for receiving screen projection data from a screen transmission source end, and the first wireless communication module is used for sending the screen projection data to a receiving end; the wireless screen transmission equipment needs to be paired before screen projection display, and the pairing steps are as follows:
the method comprises the following steps: a user inserts a sending end into a receiving end through a USB interface;
step two: the receiving terminal transmits the wireless hotspot information to the transmitting terminal through a USB interface;
step three: and the sending end forwards the screen projection data to the corresponding receiving end according to the no-hot-spot information.
The wireless hotspot information comprises a hotspot name, a hotspot password, an IP address, a port number and the like of a receiving end.
The receiving end display related module mainly comprises: the receiving end mainly completes the task of decoding and displaying the screen projection data through the display control module. The display control module is used as a control center for displaying screen projection data at a receiving end and is responsible for coordinating and controlling each module to finish the display work of the screen projection data; the second wireless communication module receives screen projection data forwarded by the sending end; the screen projection data decoding module decodes the screen projection data; the audio and video playing module is a final executor for displaying by the display control module and can realize external connection of a display by reserving an HDMI interface; the touch screen monitoring module monitors whether a user touches or clicks a mouse, and when the touch screen monitoring module detects that the mouse of the user clicks or touches a designated operation button, the touch screen monitoring module generates a corresponding operation instruction and sends the operation instruction to the display control module, and then the display control module controls the audio and video playing module to execute corresponding display operation; and the split screen operation module calculates the split screen display proportion through a split screen algorithm.
The screen splitting algorithm calculates the occupied resolution value of each screen projecting display window and the screen projecting display window which needs to be generated according to the resolution value of the display equipment connected with the screen projecting number variable and the receiving end audio and video playing module.
According to the system, the screen projection display steps of the wireless screen transmission display method are as follows:
the method comprises the following steps: the screen projection source end collects screen projection data and encodes the screen projection data;
step two: the screen transmitting source end transmits the encoded screen projection data to the transmitting end through the USB interface;
step three: the sending end sends the received screen projection data to the receiving end through the first wireless communication module according to the wireless hotspot information obtained during pairing;
step four: the receiving end receives screen projection data forwarded by the sending end through a second wireless communication module, and a screen division operation module accumulates 1 screen projection number variable;
step five: the receiving end split screen operation module judges the value of the variable of the number of the screen projected, if the value is not more than the maximum number of the screen projected, a screen projected display window is generated, and the number of the screen required to be split is calculated through the split screen operation module, and the ratio of the number of the screen required to be split to the split screen display is calculated;
step six: and the receiving end display control module controls the audio and video playing module to display in a screen-divided mode according to the proportion.
The screen projection data comprises audio, video, system information and the like of a screen transmission source end.
And the projected screen number variable represents the number of the screen transmitting source ends currently connected to the receiving end.
The screen transmitting source end is a tablet computer, a desktop computer, a personal notebook computer and the like.
The receiving end can be an android intelligent interactive all-in-one machine, an android interactive large screen, a screen transmission box and the like.
When the receiving end is a screen transmission box, the audio and video display module of the receiving end needs to be externally connected with the touch screen display through the reserved HDMI transmission line.
The wireless communication mode comprises transmission modes such as Bluetooth, wifi and the like.
The screen projection display window of the receiving end comprises a display operation area and a data display area, and the data display area mainly completes display of video data in the screen projection data. The display operation area comprises a minimization display area, a split screen display area, a suspension display area, a full screen display area, a screen projection button closing area and a screen projection number display area. And the screen projection number display area displays that the current screen projection display window is the first screen projection equipment, namely, the current screen projection number variable is displayed.
As a preferred scheme, the screen projection number display area can display numbers according to the screen projection time sequence, and can display user name information of the screen source end according to local computer system information acquired by the screen source end.
The wireless screen transmission display method supports: split screen display, suspension display, overlapping display and expansion display.
The receiving end split screen display comprises automatic split screen display and manual split screen display, and when one transmission screen source end is connected to the receiving end to perform screen projection display, firstly, a split screen operation module of the receiving end firstly accumulates a current projected screen number variable by one; then, the split screen operation module automatically calculates the display proportion of a screen projection display window according to the projected screen number and the resolution of an audio and video display module at the current receiving end; and finally, completing split screen display through the display control module, and when the receiving end split screen operation module detects that the number of the projected screens is greater than the maximum number of the projected screens, calling an error display window through the display control module by the receiving end for display: the maximum screen projection number is full, and screen projection cannot be finished. And prompting the user that the maximum screen projection quantity is reached and the screen projection cannot be performed. And the manual split-screen display is that when the display state of the receiving end is not split-screen display, a mouse clicks or touches a split-screen display button of any screen projection display window to complete the manual split-screen display function of the receiving end.
The screen splitting operation algorithm of the screen splitting operation module comprises the following steps:
the method comprises the following steps: judging the value of the projected screen number variable and the total number of the display screens;
step two: if the variable value m of the number of the projected screens is equal to the total number n of the display screens, each display displays one screen projection display window; if the variable value m of the number of the projected screens is smaller than the total number n of the display screens, each display screen displays a screen projection display window, and the rest display screens do not display screen projection data; if the variable value m of the number of the projected screens is larger than the total number n of the display screens, calculating the value of m/n, and obtaining a quotient a and a remainder b;
step three: if the remainder b is 0, displaying a screen projection windows on each display screen, if the remainder is not 0, displaying a screen projection display windows on each display screen, distributing the screen projection display windows on the remainder b to b display screens, distributing one screen projection display window on each display screen, and normally displaying a screen projection display windows on the rest n-b display screens.
The split-screen display method comprises the following steps of single-screen display layout: each display screen only displays 3 projection screen display windows per line.
When only one screen transmitting source end of the receiving end projects the screen, the full-screen operation is executed by default when the screen splitting operation is carried out.
The receiving terminal display supports the suspension display function, a user clicks a suspension display button of a display operation area of a projection screen display window, the projection screen display window is reduced to be an icon, the icon is suspended and stopped at the right side of the receiving terminal display screen, and the user can drag the suspension icon to change the stopping position. When the user needs to call the display window for displaying the source end of the transmission screen, the display state can be recovered by double clicking the floating icon. When a plurality of devices are subjected to screen projection display, different screen transmission source ends are switched to display more conveniently and quickly.
The screen projection display window is used as an independent application window, so that operations such as dragging, zooming, shrinking and the like can be realized by a program window similar to a normal program window, and different display windows can be displayed in an overlapping and covering mode.
When the receiving end needs to be expanded, the reserved interface of the audio and video playing module of the receiving end can be connected with the plurality of expanded display screens through the HDMI line, so that the expanded display function of the wireless screen transmission display system can be realized.
As a preferred technical solution, in the screen-projecting mode, when a user clicks a full-screen button of a screen-projecting display window, the window enters a full-screen display state, and the user wants to exit the full-screen state of the current screen-projecting display window, a five-finger screen-grabbing operation may be performed, and the touch screen monitoring module at the receiving end detects and processes the five-finger screen-grabbing operation of the user by using a touch algorithm, and then exits the full-screen display state of the current screen-projecting display window.
The processing flow of the touch algorithm of the touch screen monitoring module for the five-finger screen grabbing operation is as follows:
the method comprises the following steps: initializing a touch screen algorithm;
step two: the touch screen scans user input;
step three: judging the distance between adjacent finger contacts, and if the distance is greater than a set threshold value, abandoning the five-finger screen grabbing operation;
step four: judging whether the shaking distance of each finger exceeds a given threshold value;
step five: if the condition of the fourth step is met, storing the touch data for generating a full screen command for exiting the current screen projection display window once, and transmitting the full screen command to the display control module for controlling display.
The invention has the beneficial effects that:
1. the invention solves the problem that the display mode of the existing wireless screen transmission equipment is single, and particularly the problem that friendly and convenient interactive display is not supported when a plurality of pieces of equipment simultaneously project screens.
2. The split screen display proportion and the layout are calculated through the split screen algorithm of the split screen operation module, so that a good display layout effect is achieved during multi-screen display, and the utilization rate of the screen is improved.
3. The expansion of a plurality of displays can be completed through the reserved HDMI interface of the audio and video playing module, and the expansion of screen projection display is more convenient and faster under some application scenes needing temporary expansion display.
4. The operation buttons which can be realized by the user are displayed in the display operation area of the screen projection display window, and when the user realizes screen transmission of multiple devices, the operation buttons have better identification degree and operation effect. And the system information in the screen projection data is displayed in the display operation area, so that the identification efficiency of the user to the screen source end is improved, and the effect is better especially when the screen projection quantity is large.
5. By the aid of the suspension display method, the current screen-projecting display window which does not need to be displayed is zoomed into a small icon which is suspended in the data display area, the screen-projecting serial number is displayed in the small icon, and when multi-screen switching display is carried out, the recognition and switching speed can be remarkably improved, so that the screen-projecting display effect is improved.
6. When the screen-projecting display window is displayed in a full screen mode, the five-finger operation of a user is detected through the touch algorithm of the touch screen monitoring module, the efficiency of exiting the full screen mode is improved, and the screen-projecting display is smoother.
7. The wireless display system stores the wireless hotspot information of the common receiving end through the introduced pairing module, so that repeated pairing operation is avoided, and screen projection efficiency is improved.
Drawings
Fig. 1 is a screen projection display flow chart of the wireless screen transmission device of the invention;
FIG. 2 is a diagram of the components of the wireless screen display system of the present invention;
FIG. 3 is a composition diagram of a screen projection display window of the wireless screen transmission system according to the present invention;
fig. 4 is a diagram of a system for performing extended display when a receiving end is an android intelligent interactive all-in-one machine according to an embodiment of the present invention.
Fig. 5 is a diagram of a multi-screen expansion display system performed when the receiving end is a screen transmission box according to a second embodiment of the present invention.
FIG. 6 is a functional block diagram of a wireless transmission screen display system according to the present invention
Detailed Description
The invention provides a wireless screen transmission display system and a display method. The screen transmission source end mainly completes the collection and coding of screen projection data; the sending end is connected with the screen transmitting source end through the USB interface, communicates with the screen transmitting source end through the HID protocol, and communicates with the receiving end through a wireless communication mode. The receiving terminal is a screen projection display terminal and decodes and displays screen projection data obtained through wireless communication transmission. The wireless transmission screen display scheme mainly comprises suspension display, split screen display, overlapping display, expansion display and the like, and the receiving end can perform automatic split screen display according to the number of transmission screen source end equipment connected currently. The invention realizes the diversification of the screen transmission display forms, improves the utilization rate of the screen, and enables the user to operate more efficiently and quickly during multi-screen projection.
The invention is further illustrated by the following figures and examples.
The first embodiment is as follows:
as shown in fig. 2, the wireless screen display system includes a screen source 10, a transmitting terminal 20, and a receiving terminal 30. As shown in fig. 4, the receiving end is an android intelligent interactive all-in-one machine 1, the screen transmitting source ends are personal notebook computers 3 and 4, and the transmitting ends are Dongle transmitting ends 2 and 6.
As shown in fig. 3, the projection display window is divided into a display operation area 100 and a data display area 200. The display operation area 100 comprises a screen-casting sequence number display window 101, a user name display window 102, a floating button 103, a full-screen display button 104, a split-screen button 105, a minimize button 106 and a screen-closing button 107; the data display area 200 is used for projection video data display. The screen-casting sequence number display window 101 and the user name display window 102 respectively display the serial number and the user name information of the currently connected personal notebook computer, so that the identification during multi-screen switching is facilitated.
The source terminal 10 of the transmission screen shown in fig. 6 mainly includes three modules: the system comprises a screen projection data acquisition module 11, a screen projection data coding module 12 and a first HID communication module 13. The screen projection data acquisition module 11 finishes screen projection data acquisition work on screen display data, audio, system information and the like; the screen projection data coding module 12 completes the coding of the original screen projection data; the encoded data is transmitted to the transmitting end through the first HID communication module 13.
The transmitting end 20 can be divided into three modules: a pairing module 21, a second HID communication module 22, a first wireless communication module 23. The user connects the sending end 20 with the receiving end 30 through a USB interface, and the pairing module 21 obtains the wireless hotspot information from the receiving end 20 through HID communication to complete pairing; the second HID communication module 22 is configured to complete receiving the projected screen data.
The display related modules of the receiving end 30 mainly include: the display control module 31, the second wireless communication module 34, the split screen operation module 32, the screen projection data decoding module 35, the touch screen monitoring module 36, and the audio/video playing module 33. The display control module 31 coordinates and controls each module to complete the display work of the screen projection data; the second wireless communication module 34 receives the screen projection data forwarded by the sending terminal 20; the screen projection data decoding module 35 decodes the screen projection data; the audio and video playing module 33 is a final executor for displaying by the display control module; the touch screen monitoring module 36 monitors whether the user performs a touch operation or a mouse click operation.
As shown in the flowchart of fig. 1, when the personal notebook computer 3 is used as a first screen source end for screen projection, the display flow of the wireless screen display scheme is as follows:
the method comprises the following steps: the personal notebook computer 3 collects screen projection data and encodes the screen projection data;
step two: transmitting the encoded screen projection data to a Dongle sending end 2 through an HID communication protocol;
step three: the Dongle sending end 2 sends the received data to the android intelligent interactive all-in-one machine 1 in a wireless communication mode;
step four: the android intelligent interactive all-in-one machine 1 receives data transmitted by the Dongle sending end 2 through the wireless communication module, and decodes the screen projection data by using the screen projection data decoding module 35; meanwhile, the split screen operation module 32 accumulates the projected screen number variables;
step five: the split screen operation module 32 of the android intelligent interactive all-in-one machine 1 automatically operates according to the screen projection number variable and displays the screen in a split screen mode according to the proportion.
As shown in fig. 4 and 6, when the second personal notebook computer 4 projects screen data and transmits the screen data to the intelligent interactive all-in-one machine 1, the second wireless communication module of the intelligent interactive all-in-one machine 1 is responsible for receiving the screen data, the screen data is decoded by the screen data decoding module 35, and meanwhile, the screen splitting operation module 32 of the intelligent interactive all-in-one machine 1 accumulates the screen-projected variable by one, as shown in fig. 4, the audio/video playing module 33 of the intelligent interactive all-in-one machine 1 is additionally connected with the extended display screen 5, for example: the resolution ratios of the personal notebook computers 3 and 4, the extended display screen 5 and the android intelligent interactive all-in-one machine 1 are 1980 x 1080, the projected screen number variable of the split screen operation module 32 is 2, and the number of the display screens is 2; that is, the number of the projected screens is equal to the number of the display screens, so that one display screen displays one projection screen display window, and the split screen display effect is as shown in fig. 4. If there is not extension display screen 5, the quantity variable of throwing the screen promptly is greater than the display screen number, calculates the quantity variable of throwing the screen and the ratio of display screen number, and 2/1 is 2, so 2 display windows of throwing the screen all show on the interactive all-in-one of android intelligence 1 is from taking the touch display screen, and throw the screen display window value and be less than 3, so 2 display windows of throwing the screen are horizontal display on the interactive all-in-one of android intelligence 1 is from taking the touch display screen. The horizontal pixel values and the vertical pixel values of the display screen occupied by the two projection screen display windows are the same, and are 1320 and 540 pixel values respectively.
As a preferable technical scheme, when the resolution of the display screen of the personal notebook computer is inconsistent with that of the android intelligent interactive all-in-one machine 1, in order to keep the original picture proportion, the equal proportion display is carried out by taking a smaller proportion value of the horizontal resolution and the vertical resolution as a reference. Such as: the resolution ratio of the personal notebook computer 3 is 1980 x 1080, the resolution ratio of the personal notebook computer 4 is 1368 x 768, the resolution ratios of the extended display screen 5 and the android intelligent interactive all-in-one machine 1 with the touch display screen are 1980 x 1080, the projected screen number variable is 2, the number of the display screens is 2, so that one display screen displays one projected screen display window, and the resolution ratios of the personal notebook computer 3 and the android intelligent interactive all-in-one machine 1 with the touch display screen are 1980 x 1080, so that the projected screen display windows can be displayed in a normal proportion; for the resolution of the personal notebook computer 4 being 1368 × 768 and the resolution of the extended screen being 1980 × 1080, in order to realize the equal-scale display, since 1980/1368>1080/768, the ratio of the vertical resolution occupied by the screen projection display window displaying the personal notebook computer 4 is taken as the scale reference, and the personal notebook computer 4 is displayed in the split screen mode until the extended display screen 5 only occupies 1080/768 × 1368 × 1924 horizontal pixel values and 1080 vertical pixel values.
The wireless screen transmission display scheme mainly comprises the following steps: suspension display, split screen display, overlapping display and expansion display. The screen-projecting display window is used as an independent screen-projecting display terminal, so that dragging can be realized by a normal application window, and folding display can be realized by different display windows. As shown in fig. 4, when the audio/video playing module 33 of the android intelligent interactive all-in-one machine 1 is limited in screen size and needs to be extended, the interface reserved by the audio/video playing module 33 of the main android intelligent interactive all-in-one machine 1 can be connected with a plurality of extended display screens through HDMI cables, so that extended display can be realized.
As a preferable scheme, the embodiment uses wifi for wireless communication.
As an optimal technical scheme, the phenomenon that a personal notebook computer 3 occupies a higher CPU in the process of collection and coding due to low configuration and other reasons is avoided, screen projection data collected by the personal notebook computer 3 can be transmitted to a Dongle sending end 2, the Dongle sending end 2 completes the coding of the data, and the coded screen projection data is sent to an android intelligent interactive all-in-one machine 1 through a wireless network;
as a special processing condition, when only one personal notebook computer 3 is used for screen projection, the android intelligent interactive all-in-one machine 1 executes full-screen operation by default during screen splitting operation.
Example two:
as shown in fig. 5, the screen transmission source end is a personal notebook computer 1, 2, 3, 4, the transmitting end is a Dongle transmitting end 5, 9, 10, 11, the receiving end is a screen transmission box 6, and an audio/video playing module 33 of the screen transmission box 6 is connected with the touch screen display 7, 8 through an HDMI cable.
The screen projection display steps of the wireless screen transmission display scheme are as follows:
step one; the personal notebook computer 1 collects screen projection data and encodes the screen projection data;
step two: transmitting the encoded screen projection data to a Dongle sending end 5 through an HID communication protocol;
step three: the Dongle sending end 5 sends the received screen projection data to the screen transmission box 6 in a wireless communication mode;
step four: the screen transmission box 6 receives data transmitted by the Dongle sending end 5 through the second wireless communication module;
step five: the screen projection data decoding module 35 of the screen transmission box 4 decodes the screen projection data, the screen division operation module 32 simultaneously accumulates the variation of the number of projected screens, if the variation of the number of projected screens is less than or equal to the maximum number of projected screens, the display control module 31 controls to generate a screen projection display window, and meanwhile, the screen division operation module 32 calculates the screen division ratio according to the variation of the number of projected screens and performs screen division display on the touch screen displays 7 and 8 through the control of the display control module 31.
When only one personal notebook computer 1 is used for screen projection, screen projection display is performed on only one extended display 7 by default. As shown in fig. 5, when one touch screen display 7 cannot meet the display requirement and needs to be expanded, the expanded touch screen 8 may be connected to the reserved interface of the screen transmission box 6 through the HDMI, so that expanded display may be implemented. The screen-projecting display window is used as an independent screen-projecting display application, so that dragging can be realized by the application window similar to a normal window, and folding display can be realized by different screen-projecting display windows.
The screen transmission box 6 comprises automatic screen division display and manual screen division display. The automatic screen splitting is realized by that when a new personal notebook computer is projected to the screen transmission box 6, the screen transmission box 6 defaults to automatically calculate the screen splitting ratio through the screen splitting operation module to complete screen splitting; and manual split-screen display, namely when the display state of the screen transmission box 6 is not split-screen display, clicking a split-screen button of a screen projection display window of the touch screen display by a mouse or completing the manual split-screen display function. As shown in fig. 5, the current display state is a non-default split-screen display state, and if the split-screen display state is to be restored, the split-screen display buttons of the two projection- screen display windows 1 and 2 in the non-floating state are optionally clicked, so that four split screens can be realized.
The wireless screen transmission display scheme supports a suspension display function, and the suspension display implementation methods are two. One is a floating button for clicking the display operation area of the display window, as shown in fig. 5, the display window is automatically reduced to an icon which floats and stops at the right side of the touch display screen 7 and the extended display screen 8, and the icon can be dragged to move the position where the floating icon stops.
The above-listed series of detailed descriptions are merely specific illustrations of possible embodiments of the present invention, and they are not intended to limit the scope of the present invention, and all equivalent means or modifications that do not depart from the technical spirit of the present invention are intended to be included within the scope of the present invention.
Claims (9)
1. A wireless screen-display system, comprising: a screen transmitting source end, a transmitting end and a receiving end;
the screen transmitting source end comprises a screen projection data acquisition module, a screen projection data coding module and a first HID communication module, the screen projection data acquisition module is used for acquiring screen data to be projected, the screen projection data coding module is used for coding the screen projection data, and the first HID communication module is used for transmitting the coded screen projection data to the transmitting end.
The sending end mainly comprises a pairing module, a second HID communication module and a first wireless communication module, wherein the pairing module is used for completing pairing of wireless screen transmission equipment, the second HID communication module is used for receiving screen projection data from a screen transmission source end, and the first wireless communication module is used for sending the screen projection data to a receiving end;
the receiving end mainly comprises: the display control module, the second wireless communication module, the split screen operation module, the screen projection data decoding module, the touch screen monitoring module and the audio and video playing module; the receiving end completes the decoding and display tasks of the screen projection data through the display control module; the display control module is used as a control center for displaying screen projection data at a receiving end and is responsible for coordinating and controlling each module to finish the display work of the screen projection data; the second wireless communication module receives screen projection data forwarded by the sending end; the screen projection data decoding module decodes the screen projection data; the audio and video playing module is a final executor for displaying by the display control module and can realize external connection of a display by reserving an HDMI interface; the touch screen monitoring module monitors whether a user touches or clicks a mouse, and when the touch screen monitoring module detects that the mouse of the user clicks or touches a designated operation button, the touch screen monitoring module generates a corresponding operation instruction and sends the operation instruction to the display control module, and then the display control module controls the audio and video playing module to execute corresponding display operation; and the split screen operation module calculates the split screen display proportion through a split screen algorithm.
2. The wireless screen-transfer display system of claim 1, wherein the pairing method of the wireless screen-transfer devices is as follows:
the method comprises the following steps: a user inserts a sending end into a receiving end through a USB interface;
step two: the receiving terminal transmits the wireless hotspot information to the transmitting terminal through a USB interface;
step three: the sending end forwards the screen projection data to a corresponding receiving end according to the no-hot-spot information;
the wireless hotspot information includes a hotspot name, a hotspot password, an IP address, a port number and the like of the receiving end.
3. The wireless screen-transmission display system according to claim 1, wherein the screen-splitting algorithm in the screen-splitting operation module calculates a resolution value occupied by each screen-casting display window and a screen-casting display window to be generated according to a screen-casting number variable and a resolution value of a display device connected to the receiving-end audio/video playing module.
4. A wireless screen transmission display method is characterized by comprising the following steps:
the method comprises the following steps: the screen projection source end collects screen projection data and encodes the screen projection data;
step two: the screen transmitting source end transmits the encoded screen projection data to the transmitting end through the USB interface;
step three: the sending end sends the received screen projection data to the receiving end through the first wireless communication module according to the wireless hotspot information obtained during pairing;
step four: the receiving end receives screen projection data forwarded by the sending end through a second wireless communication module, and a screen division operation module is used for accumulating the screen projection number variable by 1;
step five: a split screen operation module at the receiving end judges the value of a variable of the number of projected screens, if the value is not more than the maximum number of projected screens, a screen projection display window is generated, and the number of the required split screens and the split screen display proportion are calculated through the split screen operation module;
step six: and the display control module at the receiving end controls the audio and video playing module to perform proportional split screen display.
5. The wireless screen-transmission display method according to claim 4, wherein the screen-projection display window of the receiving end includes a display operation area and a data display area, and the display operation area includes a minimize, split screen, float, full screen, close screen-projection button and screen-projection number display area; the screen projection number display area displays that the current screen projection display window is the number of the screen projection equipment, namely, the number variable of the currently projected screen is displayed, and the screen projection number display area not only can display serial numbers according to the screen projection time sequence, but also can display user name information of the transmission screen source end according to local computer system information acquired by the screen source end.
6. The wireless screen-transfer display method of claim 4, wherein the wireless screen-transfer display method supports: split screen display, suspension display, overlapping display and expansion display;
the split screen display function comprises automatic split screen display and manual split screen display; when a screen transmitting source end is connected to a receiving end for screen projection display, firstly, a screen splitting operation module of the receiving end firstly accumulates a current screen projection number variable by one; then, the split screen operation module automatically calculates the display proportion of a screen projection display window according to the projected screen number and the resolution of an audio and video display module at the current receiving end; finally, the split-screen display is completed through the display control module;
when the receiving end split screen operation module detects that the number of the projected screens is larger than the maximum number of the projected screens, the receiving end calls an error display window through a display control module to display: the maximum screen projection number is full, and screen projection cannot be finished. And prompting the user that the maximum screen projection quantity is reached and the screen projection cannot be performed.
The manual split-screen display is that when the display state of the receiving end is not split-screen display, a mouse clicks or touches a split-screen display button of any screen projection display window to complete the manual split-screen display function of the receiving end;
the floating display function includes: a user clicks a suspension display button of a display operation area of a screen projection display window, the screen projection display window is reduced to an icon, the icon is suspended and stopped at the right side of a display screen of a receiving end, and the user can drag the suspended icon to change the stopping position; when a user needs to call a display window for displaying the transmission screen source end, the display state can be recovered by double clicking the suspension icon, so that when a plurality of devices perform screen projection display, different transmission screen source ends are switched to display more conveniently and quickly;
the functions of the overlay display include: the screen projection display window is used as an independent application window, the window can realize operations such as dragging, amplifying, reducing and the like similar to a normal program window, and different display windows can realize overlapping and covering display;
the functions of the extended display include: when the receiving end needs to be expanded, the reserved interface of the audio and video playing module of the receiving end is connected with the plurality of expanded display screens through the HDMI line, and the expanded display function of the wireless screen transmission display system is achieved.
7. The wireless screen-transmitting display method according to claim 4, wherein the screen-splitting algorithm of the screen-splitting operation module comprises the following steps:
the method comprises the following steps: judging the value of the projected screen number variable and the total number of the display screens;
step two: if the variable value m of the number of the projected screens is equal to the total number n of the display screens, each display displays one screen projection display window; if the variable value m of the number of the projected screens is smaller than the total number n of the display screens, each display screen displays a screen projection display window, and the rest display screens do not display screen projection data; if the variable value m of the number of the projected screens is larger than the total number n of the display screens, calculating the value of m/n, and obtaining a quotient a and a remainder b;
step three: if the remainder b is 0, displaying a screen projection windows on each display screen, if the remainder is not 0, displaying a screen projection display windows on each display screen, distributing the screen projection display windows on the remainder b to b display screens, distributing one screen projection display window on each display screen, and normally displaying a screen projection display windows on the rest n-b display screens.
8. The method according to claim 4, wherein in the screen-casting mode, when a user clicks a full-screen button of a screen-casting display window, the window enters a full-screen display state, the user wants to exit the full-screen state of the current screen-casting display window, and can perform a five-finger screen-grabbing operation, the touch screen monitoring module at the receiving end detects and processes the five-finger screen-grabbing operation of the user by using a touch algorithm, and then exits the full-screen display state of the current screen-casting display window;
the processing flow of the touch algorithm of the touch screen monitoring module for the five-finger screen grabbing operation is as follows:
the method comprises the following steps: initializing a touch screen algorithm;
step two: the touch screen scans user input;
step three: judging the distance between adjacent finger contacts, and if the distance is greater than a set threshold value, abandoning the five-finger screen grabbing operation;
step four: judging whether the shaking distance of each finger exceeds a given threshold value;
step five: if the condition of the fourth step is met, storing the touch data for generating a full screen command for exiting the current screen projection display window once, and transmitting the full screen command to the display control module for controlling display.
9. The wireless screen-projection display method of claim 4, wherein the number-of-projected-screen variable represents the number of screen-projection sources currently connected to the receiving end;
the screen transmission source end can be a tablet computer, a desktop computer and a personal notebook computer;
the receiving end can be an android intelligent interactive all-in-one machine, an android interactive large screen and a screen transmission box.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010317003.3A CN111601120A (en) | 2020-04-21 | 2020-04-21 | Wireless screen transmission display system and display method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010317003.3A CN111601120A (en) | 2020-04-21 | 2020-04-21 | Wireless screen transmission display system and display method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111601120A true CN111601120A (en) | 2020-08-28 |
Family
ID=72190308
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010317003.3A Pending CN111601120A (en) | 2020-04-21 | 2020-04-21 | Wireless screen transmission display system and display method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111601120A (en) |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112866769A (en) * | 2021-02-09 | 2021-05-28 | 苏州无双医疗设备有限公司 | Screen projection touch control method for program control system |
| CN113056031A (en) * | 2021-02-01 | 2021-06-29 | 广州朗国电子科技有限公司 | Method for establishing wireless screen projection connection |
| CN113099552A (en) * | 2021-04-13 | 2021-07-09 | 广州视源电子科技股份有限公司 | Pluggable equipment and screen transmission method |
| CN113382293A (en) * | 2021-06-11 | 2021-09-10 | 北京字节跳动网络技术有限公司 | Content display method, device, equipment and computer readable storage medium |
| CN113504884A (en) * | 2021-07-22 | 2021-10-15 | 广州朗国电子科技股份有限公司 | Connection method for wireless screen transmission equipment |
| CN113515250A (en) * | 2021-06-10 | 2021-10-19 | 澳柯玛股份有限公司 | Wireless screen transmission system and method for large screen and android of refrigerator |
| CN113608710A (en) * | 2021-07-19 | 2021-11-05 | 深圳市炬力北方微电子有限公司 | Screen projection method and related equipment |
| CN113905271A (en) * | 2021-09-28 | 2022-01-07 | 上海明我信息技术有限公司 | One-screen transmission system |
| CN113992958A (en) * | 2021-10-18 | 2022-01-28 | 深圳康佳电子科技有限公司 | Multi-window same-screen interaction method, terminal and storage medium |
| CN114125539A (en) * | 2022-01-28 | 2022-03-01 | 广州长嘉电子有限公司 | Intelligent large-screen device high-definition playing control method and system based on wireless transmission |
| CN114302204A (en) * | 2021-05-21 | 2022-04-08 | 海信视像科技股份有限公司 | Split-screen playing method and display device |
| CN114422845A (en) * | 2021-12-20 | 2022-04-29 | 瑞芯微电子股份有限公司 | Method for transceiving audio and video data and transfer equipment |
| WO2022089215A1 (en) * | 2020-10-31 | 2022-05-05 | 华为技术有限公司 | Screen projection method and electronic device |
| WO2022151863A1 (en) * | 2021-01-18 | 2022-07-21 | Oppo广东移动通信有限公司 | Screen-projection content display method and apparatus, and terminal and storage medium |
| CN115052279A (en) * | 2021-03-08 | 2022-09-13 | 广州视源电子科技股份有限公司 | Pairing method and device of wireless screen transmission device |
| WO2022222924A1 (en) * | 2021-04-22 | 2022-10-27 | 华为技术有限公司 | Method for adjusting screen projection display parameters |
| WO2023273992A1 (en) * | 2021-06-30 | 2023-01-05 | 华为技术有限公司 | Wireless transmission system, method and apparatus |
| CN115695898A (en) * | 2022-10-13 | 2023-02-03 | 深圳市拔超科技股份有限公司 | Wireless screen projection method, system, electronic device and storage medium |
| WO2023011058A1 (en) * | 2021-08-02 | 2023-02-09 | 海信视像科技股份有限公司 | Display device, communication terminal, and projected-screen image dynamic display method |
| WO2023030548A1 (en) * | 2021-09-01 | 2023-03-09 | 广州视源电子科技股份有限公司 | Screen projection method and apparatus, device and storage medium |
| WO2024067385A1 (en) * | 2022-09-27 | 2024-04-04 | 比亚迪股份有限公司 | Local area network communication method, electronic device, vehicle, system, and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150341598A1 (en) * | 2013-01-10 | 2015-11-26 | Hangzhou Hikvision Digital Technology Co., Ltd. | Method of multi-screen pagination playing |
| CN105955689A (en) * | 2016-05-19 | 2016-09-21 | 乐视控股（北京）有限公司 | Screen adaption method and device during multi-screen interaction |
| CN107450871A (en) * | 2017-06-22 | 2017-12-08 | 广州视源电子科技股份有限公司 | Methods of exhibiting, device and the storage medium of wireless screen transmission |
| CN107493484A (en) * | 2017-08-18 | 2017-12-19 | 三星电子（中国）研发中心 | System, method and apparatus for projection screen |
| CN109379549A (en) * | 2018-09-18 | 2019-02-22 | 湖州佳格电子科技股份有限公司 | A kind of wireless screen transmission method, equipment and system |
-
2020
- 2020-04-21 CN CN202010317003.3A patent/CN111601120A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150341598A1 (en) * | 2013-01-10 | 2015-11-26 | Hangzhou Hikvision Digital Technology Co., Ltd. | Method of multi-screen pagination playing |
| CN105955689A (en) * | 2016-05-19 | 2016-09-21 | 乐视控股（北京）有限公司 | Screen adaption method and device during multi-screen interaction |
| CN107450871A (en) * | 2017-06-22 | 2017-12-08 | 广州视源电子科技股份有限公司 | Methods of exhibiting, device and the storage medium of wireless screen transmission |
| CN107493484A (en) * | 2017-08-18 | 2017-12-19 | 三星电子（中国）研发中心 | System, method and apparatus for projection screen |
| CN109379549A (en) * | 2018-09-18 | 2019-02-22 | 湖州佳格电子科技股份有限公司 | A kind of wireless screen transmission method, equipment and system |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022089215A1 (en) * | 2020-10-31 | 2022-05-05 | 华为技术有限公司 | Screen projection method and electronic device |
| EP4220378A4 (en) * | 2020-10-31 | 2024-03-13 | Huawei Tech Co Ltd | Screen projection method and electronic device |
| CN114442972A (en) * | 2020-10-31 | 2022-05-06 | 华为技术有限公司 | Screen projection method and electronic equipment |
| WO2022151863A1 (en) * | 2021-01-18 | 2022-07-21 | Oppo广东移动通信有限公司 | Screen-projection content display method and apparatus, and terminal and storage medium |
| CN113056031A (en) * | 2021-02-01 | 2021-06-29 | 广州朗国电子科技有限公司 | Method for establishing wireless screen projection connection |
| CN112866769B (en) * | 2021-02-09 | 2023-01-24 | 苏州无双医疗设备有限公司 | Screen projection touch control method for program control system of implantable medical device |
| CN112866769A (en) * | 2021-02-09 | 2021-05-28 | 苏州无双医疗设备有限公司 | Screen projection touch control method for program control system |
| CN115052279A (en) * | 2021-03-08 | 2022-09-13 | 广州视源电子科技股份有限公司 | Pairing method and device of wireless screen transmission device |
| CN115052279B (en) * | 2021-03-08 | 2023-10-31 | 广州视源电子科技股份有限公司 | Pairing method and device of wireless screen transmitter |
| CN113099552A (en) * | 2021-04-13 | 2021-07-09 | 广州视源电子科技股份有限公司 | Pluggable equipment and screen transmission method |
| WO2022222924A1 (en) * | 2021-04-22 | 2022-10-27 | 华为技术有限公司 | Method for adjusting screen projection display parameters |
| CN114302204A (en) * | 2021-05-21 | 2022-04-08 | 海信视像科技股份有限公司 | Split-screen playing method and display device |
| CN113515250A (en) * | 2021-06-10 | 2021-10-19 | 澳柯玛股份有限公司 | Wireless screen transmission system and method for large screen and android of refrigerator |
| CN113382293A (en) * | 2021-06-11 | 2021-09-10 | 北京字节跳动网络技术有限公司 | Content display method, device, equipment and computer readable storage medium |
| WO2023273992A1 (en) * | 2021-06-30 | 2023-01-05 | 华为技术有限公司 | Wireless transmission system, method and apparatus |
| CN113608710A (en) * | 2021-07-19 | 2021-11-05 | 深圳市炬力北方微电子有限公司 | Screen projection method and related equipment |
| CN113504884A (en) * | 2021-07-22 | 2021-10-15 | 广州朗国电子科技股份有限公司 | Connection method for wireless screen transmission equipment |
| CN113504884B (en) * | 2021-07-22 | 2023-05-09 | 广州朗国电子科技股份有限公司 | Connection method for wireless screen transmission equipment |
| WO2023011058A1 (en) * | 2021-08-02 | 2023-02-09 | 海信视像科技股份有限公司 | Display device, communication terminal, and projected-screen image dynamic display method |
| WO2023030548A1 (en) * | 2021-09-01 | 2023-03-09 | 广州视源电子科技股份有限公司 | Screen projection method and apparatus, device and storage medium |
| CN113905271A (en) * | 2021-09-28 | 2022-01-07 | 上海明我信息技术有限公司 | One-screen transmission system |
| CN113992958B (en) * | 2021-10-18 | 2023-07-18 | 深圳康佳电子科技有限公司 | Multi-window same-screen interaction method, terminal and storage medium |
| CN113992958A (en) * | 2021-10-18 | 2022-01-28 | 深圳康佳电子科技有限公司 | Multi-window same-screen interaction method, terminal and storage medium |
| CN114422845A (en) * | 2021-12-20 | 2022-04-29 | 瑞芯微电子股份有限公司 | Method for transceiving audio and video data and transfer equipment |
| CN114125539A (en) * | 2022-01-28 | 2022-03-01 | 广州长嘉电子有限公司 | Intelligent large-screen device high-definition playing control method and system based on wireless transmission |
| WO2024067385A1 (en) * | 2022-09-27 | 2024-04-04 | 比亚迪股份有限公司 | Local area network communication method, electronic device, vehicle, system, and medium |
| CN115695898A (en) * | 2022-10-13 | 2023-02-03 | 深圳市拔超科技股份有限公司 | Wireless screen projection method, system, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111601120A (en) | Wireless screen transmission display system and display method | |
| CN103150132A (en) | Screen transmission method and electronic equipment | |
| CN108255454B (en) | Splicing processor and visual interaction method of splicing processor | |
| CN103873813A (en) | Method and system for conference television multi-screen switching | |
| CN103491409A (en) | Multi-screen control system, realizing method of multi-screen control system and remote controllers | |
| CN107452119A (en) | virtual reality real-time navigation method and system | |
| CN114296670B (en) | Display device and control method for same-screen display of multi-device screen throwing | |
| CN106896920B (en) | Virtual reality system, virtual reality equipment, virtual reality control device and method | |
| CN105718111A (en) | Interactive smart tablet and interaction method, way and system thereof | |
| TWI497400B (en) | Method of auto-recognizing for cursor in monitors | |
| WO2023155529A1 (en) | Display device, smart home system, and multi-screen control method for display device | |
| CN104811780A (en) | Electronic equipment control method and electronic equipment control device | |
| CN104539872A (en) | Conference terminal | |
| CN104777899A (en) | Method for video stream redirection among networked computer devices | |
| CN105120327B (en) | Input method between a kind of electronic equipment and corresponding electronic equipment | |
| CN116980554A (en) | Display equipment and video conference interface display method | |
| CN209980227U (en) | Intelligent display system and device | |
| CN114007129A (en) | Display device and network distribution method | |
| CN114007128A (en) | Display device and network distribution method | |
| US9141443B2 (en) | Method and system for integrating visual controls with legacy applications | |
| CN110692036A (en) | Presentation server, data relay method, and method for generating virtual pointer | |
| CN110611711A (en) | Teaching system, teaching system communication method and device and storage medium | |
| KR20070062148A (en) | Display apparatus and method thereof, and information processing apparatus and method thereof for providing pip function | |
| CN116347143A (en) | Display equipment and double-application same-screen display method | |
| CN117813579A (en) | Model control method, device, equipment, system and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200828 |