CN113934396A - On-screen display method, device and system - Google Patents

On-screen display method, device and system Download PDF

Info

Publication number
CN113934396A
CN113934396A CN202111295943.8A CN202111295943A CN113934396A CN 113934396 A CN113934396 A CN 113934396A CN 202111295943 A CN202111295943 A CN 202111295943A CN 113934396 A CN113934396 A CN 113934396A
Authority
CN
China
Prior art keywords
screen
equipment
auxiliary
resolution
identification code
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111295943.8A
Other languages
Chinese (zh)
Inventor
樊宏斌
林喆
崔建平
方梦宇
陈桂鸿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Sunmi Technology Group Co Ltd
Citaq Co Ltd
Original Assignee
Shanghai Sunmi Technology Group Co Ltd
Citaq Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Sunmi Technology Group Co Ltd, Citaq Co Ltd filed Critical Shanghai Sunmi Technology Group Co Ltd
Priority to CN202111295943.8A priority Critical patent/CN113934396A/en
Publication of CN113934396A publication Critical patent/CN113934396A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Abstract

The invention belongs to the field of electronic Internet of things, and provides a method, a device and a system for displaying on the same screen, which comprise the following steps: acquiring a unique identification code of a wired communication module in equipment establishing wired communication with main screen equipment; when the unique identification code of the wired communication module is a preset identification code, determining that the equipment is auxiliary screen equipment; acquiring the resolution and the frame rate of the auxiliary screen device, setting the resolution of the screen recording service of the main screen device based on the resolution of the auxiliary screen device, and setting the frame rate of the screen recording service of the main screen device based on the frame rate of the auxiliary screen device so as to record the screen; and when the screen recording of one frame is finished, screen recording data is sent to the auxiliary screen equipment, so that the auxiliary screen equipment performs on-screen display. The screen recording service is installed on the main device and connected with the USB auxiliary screen, so that the same screen from the display end of the main device to the auxiliary screen can be realized.

Description

On-screen display method, device and system
Technical Field
The invention relates to the field of electronic internet of things, in particular to a method, a device and a system for on-screen display.
Background
With the development of the internet of things in recent years, interconnection among devices is more and more widely used, and more use scenes are provided or synchronized from one device to another device, so that a convenient on-screen method and a convenient on-screen device are particularly necessary.
The current common screen sharing method or the screen sharing device transmits and projects the screen through the existing screen sharing protocol, and the generated time delay is relatively large due to the universality of the target screen needing to be adapted, and the transmission and processing data volume is large. It is therefore desirable to provide a method of on-screen reducing delay.
Disclosure of Invention
The invention provides a method, a device and a system for on-screen display, which solve the problems.
The technical scheme provided by the invention is as follows:
an on-screen display method, comprising:
acquiring a unique identification code of a wired communication module in equipment establishing wired communication with main screen equipment;
when the unique identification code of the wired communication module is a preset identification code, determining that the equipment is auxiliary screen equipment;
calling the resolution and the frame rate of the auxiliary screen device, setting the resolution of the screen recording service of the main screen device based on the resolution of the auxiliary screen device, and setting the frame rate of the screen recording service of the main screen device based on the frame rate of the auxiliary screen device so as to record the screen;
and when the screen recording of the preset time is finished, screen recording data are sent to the auxiliary screen equipment, so that the auxiliary screen equipment performs on-screen display.
Further preferably, before the acquiring the unique identification code of the wired communication module in the device for establishing wired communication with the home screen device, the method further includes:
and setting the USB service module of the main screen device as a VCP virtual serial port, and setting the identification code of the VCP virtual serial port as a preset identification code.
Further preferably, the screen recording based on the resolution and the frame rate of the secondary screen device includes:
and calling a MediaCodeC library at the main screen equipment based on the resolution and the frame rate, and grabbing the image of the area with the resolution at the current main screen of the main screen equipment by taking the reciprocal of the frame rate as interval time.
Further preferably, before the acquiring the unique identification code of the wired communication module in the device for establishing wired communication with the home screen device, the method further includes:
and judging whether the equipment is the auxiliary screen equipment or not based on the unique identification code of the wired communication module and the preset identification code.
An on-screen display device comprising:
the USB service module is used for acquiring a unique identification code of a wired communication module in equipment establishing wired communication with the main screen equipment;
the USB service module is used for determining the equipment as auxiliary screen equipment when the unique identification code of the wired communication module is a preset identification code;
the screen recording service module is used for calling the resolution and the frame rate of the auxiliary screen equipment, setting the resolution of the screen recording service of the main screen equipment based on the resolution of the auxiliary screen equipment, and setting the frame rate of the screen recording service of the main screen equipment based on the frame rate of the auxiliary screen equipment so as to record the screen;
and the USB service module is used for sending screen recording data to the auxiliary screen equipment when the screen recording of preset time is finished, so that the auxiliary screen equipment can display the screen on the same screen.
Further preferably, the method further comprises the following steps:
and the setting module is used for setting the USB service module of the main screen device into a VCP virtual serial port and setting the identification code of the VCP virtual serial port into a preset identification code.
Further preferably, the USB service module is further configured to:
sending the screen recording data to the auxiliary screen device through the main screen device;
decompressing and restoring the screen recording data by using the auxiliary screen device to obtain image frame data;
and converting the image frame data into a corresponding format based on the resolution and the frame rate through the auxiliary screen equipment, and performing on-screen display.
An on-screen display system comprising: a primary screen device and a secondary screen device;
the home screen apparatus includes: the USB service module is used for detecting a unique identification code of a wired communication module in equipment which is connected with the USB service module; when the unique identification code of the wired communication module in the equipment is a preset identification code, marking the equipment as the auxiliary screen equipment;
the home screen device further includes: the screen recording service module is used for calling the resolution and the frame rate of the auxiliary screen equipment and recording the screen according to the resolution and the frame rate of the auxiliary screen equipment;
the USB service module is used for transmitting screen recording data to the wired communication module after screen recording for a preset time is finished;
the sub-screen device includes: and the on-screen display module is used for receiving the screen recording data, converting the screen recording data into a target format which accords with the resolution and the frame rate of the auxiliary screen equipment, and then displaying the screen on the same screen.
Further preferably:
the sub-screen device includes: the data decoding module is used for decompressing and restoring the screen recording data to obtain image frame data;
the sub-screen device further includes: and the data conversion and display module is used for converting the image frame data into a corresponding format based on the resolution and the frame rate and performing on-screen display.
Further preferably:
and the data conversion display module is further used for converting the image frame data into a corresponding format based on the resolution and the frame rate after receiving the screen recording data, and pushing the image frame data to an external port for an external device to use.
The on-screen display method, the device and the system provided by the invention at least have the following beneficial effects:
1) the screen recording service is installed on the main device and connected with the USB auxiliary screen, so that the same screen from the display end of the main device to the auxiliary screen can be realized.
2) As the screen recording is carried out according to the requirements of the resolution ratio and the frame rate of the auxiliary screen in the screen recording service, the generated data is not wasted and is the minimum useful data, and the data is compressed and transmitted, so that the minimum processing amount of the USB auxiliary screen on the data can be realized, the screen can be refreshed in time, and the problem of delay caused by excessive data processing in the same screen is solved.
Drawings
The invention is described in further detail below with reference to the following figures and detailed description:
FIG. 1 is a schematic flow chart diagram illustrating an embodiment of an on-screen display method of the present invention;
FIG. 2 is a schematic view of an on-screen display device according to the present invention;
FIG. 3 is a schematic diagram of an embodiment of an on-screen display method of the present invention;
FIG. 4 is a schematic view of an embodiment of an on-screen display device according to the present invention;
FIG. 5 is a schematic block diagram of a USB secondary screen device of the present invention;
FIG. 6 is a diagram of the USB sub-screen connection in the desktop cashier system of the present invention.
Detailed Description
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
For the sake of simplicity, the drawings only schematically show the parts relevant to the present invention, and they do not represent the actual structure as a product. In addition, in order to make the drawings concise and understandable, components having the same structure or function in some of the drawings are only schematically illustrated or only labeled. In this document, "one" means not only "only one" but also a case of "more than one".
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
In this context, it is to be understood that, unless otherwise explicitly stated or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
In addition, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not intended to indicate or imply relative importance.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following description will be made with reference to the accompanying drawings. It is obvious that the drawings in the following description are only some examples of the invention, and that for a person skilled in the art, other drawings and embodiments can be derived from them without inventive effort.
The invention provides an embodiment of a same-screen display method, as shown in fig. 1, specifically including:
s100, a unique identification code of a wired communication module in a device establishing wired communication with a main screen device is acquired.
S200, when the unique identification code of the wired communication module is a preset identification code, determining that the equipment is the auxiliary screen equipment.
Specifically, the main screen device includes a mobile device, a terminal device and the like based on the android system. In the field of cash register devices, devices connected with a main screen device through a wired communication module are not necessarily auxiliary screen devices, and if the devices are not the auxiliary screen devices, the security problem of confidential information leakage exists.
Therefore, the unique identification code is stored in the wired communication module of the auxiliary screen device, and when the main screen device is connected with the main screen device, whether the device is the auxiliary screen device or not is directly and quickly distinguished by identifying the unique identification code.
Because the screen projection of the existing same-screen protocol transmission needs to adapt to the universality of a target screen, the transmission and processing data volume is large, and the generated time delay is relatively large. The application provides and establishes the safety communication of two equipment through wired communication module, and two equipment of relative ratio throw the screen through current protocol transmission with the screen, reduce delay and then transmission speed is faster, has compromise the security simultaneously.
S300, the resolution ratio and the frame rate of the auxiliary screen device are called, the resolution ratio of the screen recording service of the main screen device is set based on the resolution ratio of the auxiliary screen device, and the reading frequency of the screen recording service of the main screen device is set based on the frame rate of the auxiliary screen device, so that screen recording is carried out.
In this embodiment, the wired communication module, i.e., the USB data transmission module, implements data transmission and storage of the resolution and frame rate of the sub-screen.
The method comprises the following steps of obtaining the resolution ratio of an auxiliary screen and frame rate parameters through main screen equipment, wherein the method for obtaining the resolution ratio of the auxiliary screen comprises the following steps: and reading the resolution and frame rate supported by the auxiliary screen stored in the specific memory position of the auxiliary screen module through the USB serial port, writing the parameters into the auxiliary screen module according to the hardware parameters of the auxiliary screen during factory production, and starting screen recording according to the parameters.
The specific scheme of recording the screen comprises the following steps: when the acquired resolution parameter is AxB and the frame rate is Z, calling a MediaCodeC library on the Andorid main screen to capture a JPG picture of the current screen AxB area, and recording the screen at the interval of 1/Z second.
And S400, when the screen recording within the preset time is finished, screen recording data are sent to the auxiliary screen device, so that the auxiliary screen device can display the screen on the same screen.
Specifically, after the main screen device finishes screen recording, screen recording data are compressed and transmitted to the auxiliary screen device through the USB data line. The image frames are decompressed and restored by the data decoding module of the auxiliary screen device, and then are cached according to each frame of image, and are converted into a display target format by the data conversion and display module of the auxiliary screen device, and then are pushed to a corresponding external port or a display screen for display, so that the synchronization of the display content of the main device to the auxiliary screen is realized.
Wherein, the display target format is as follows: and the auxiliary screen equipment takes the data stream, needs to restore the picture by taking the resolution A and B as the size of the target image, decodes the picture into RGB data, and sends the RGB data to a buffer FramBuffer corresponding to the auxiliary screen to realize display.
The preset time is about 6mS, and is about 0.006 second.
In this embodiment, the insertion of the USB slave device is detected through a service deployed on the Android master device, the resolution and frame rate parameters of the secondary screen are obtained, the master device service is started to record the screen according to the parameters, the data stream is compressed and then transmitted to the secondary screen, the secondary screen decodes the data and pushes the data to the screen and an external interface, and the same-screen function is achieved.
Based on the foregoing embodiments, parts in this embodiment that are the same as the foregoing embodiments are not repeated, and this embodiment provides another embodiment of a method for displaying on a screen, as shown in fig. 2 and 3, specifically including:
before acquiring the unique identification code of the wired communication module in the device for establishing wired communication with the home screen device in step S100, the method further includes:
and setting the USB service module of the main screen device as a VCP virtual serial port, and setting the identification code of the VCP virtual serial port as a preset identification code.
In a preferred embodiment, before acquiring the unique identification code of the wired communication module in the device for establishing wired communication with the home screen device, the method further comprises:
and judging whether the equipment is the auxiliary screen equipment or not based on the unique identification code of the wired communication module and the preset identification code.
Specifically, whether to start recording the screen is confirmed by detecting whether the screen is the auxiliary screen device; whether the device is a sub-screen device is confirmed based on idVendor (manufacturer ID) and idProduct (product ID) of the USB. The frame rate and the resolution are the size and the frequency of the captured main screen image data after the screen recording is started, so as to form a data stream.
In a preferred embodiment, the step S300 of performing screen recording based on the resolution and the frame rate of the secondary screen device includes:
and calling a MediaCodeC library at the main screen equipment based on the resolution and the frame rate, and grabbing the image of the area with the resolution at the current main screen of the main screen equipment by taking the reciprocal of the frame rate as interval time.
Exemplarily, as shown in fig. 2 and 3, a method for the same screen in the USB mode of the Android device includes: installing a screen recording service module on the Android main device; deploying a USB data transmission module in embedded software of the auxiliary screen equipment; deploying a data decoding module in embedded software of the auxiliary screen equipment; a data conversion display module is deployed in embedded software of the auxiliary screen equipment;
the screen recording service module detects USB insertion of the auxiliary screen device, and the screen recording, data compression and data transmission functions of the main device are achieved.
The auxiliary screen is embedded into software, and the USB data transmission module realizes data transmission and storage of the resolution and the frame rate of the auxiliary screen; the data decoding module is used for decompressing compressed data transmitted by the main screen and restoring and buffering image frames; and the data conversion display module is used for converting the image frames in the buffer storage into a format to be displayed and controlling the auxiliary screen to display or push the image frames to a corresponding interface.
In the method, the screen recording service module is arranged on the main screen device and is connected with the USB data transmission module on the auxiliary screen through a USB data line; the USB data transmission module on the auxiliary screen is connected with the data decoding module; and the data decoding module on the secondary screen is connected with the data conversion display module.
In summary, the screen recording service module on the main device detects the insertion of the secondary screen USB data transmission module through the USB service module.
The method for detecting the USB insertion comprises the following steps: the USB Dev end is set to VCP virtual serial port function in USB CDC class and the manufacturer ID is set to specific unique identification.
For example, idVendor is 0x7799 and idProduct is 0x 2011. When the USB port of the main screen detects that the USB slave device is inserted and the idVendor is 0x7799, the device is determined to be the device of the manufacturer, and when the idProduct is 0x2011, the device is determined to be the device of the auxiliary screen of the manufacturer.
Therefore, in this embodiment, two aspects of verification need to be performed, one is verification by a manufacturer of the device, and the device that is not the manufacturer can be excluded from the first verification, thereby improving the security of detection. And the second verification is to verify the specific identification code of the equipment and verify whether the auxiliary screen equipment on the same screen can be performed.
And the main screen equipment acquires the resolution and the frame rate parameter of the auxiliary screen. The method for acquiring the resolution of the auxiliary screen comprises the following steps: and reading the resolution and frame rate supported by the auxiliary screen stored in the specific memory position of the auxiliary screen module through the serial port, wherein the parameter is written in according to the hardware parameter of the auxiliary screen during factory production.
The main screen device starts a screen recording according to the parameters, data are compressed and transmitted to the main screen device through a USB data line, the data are decompressed by the data decoding module and restored by image frames, the image frames are cached according to each frame of image, the image frames are converted into a display target format through the data conversion display module and then are pushed to a corresponding external port or a display screen for display, and therefore synchronization of display content of the main screen device to the auxiliary screen is achieved.
The specific scheme of recording the screen comprises the following steps: and when the acquired resolution parameters are A & ltB & gt and the frame rate is Z, calling a MediaCodeC library on the Android main screen to capture the JPG picture of the region where the resolution parameters are A & ltB & gt in the current screen, and taking 1/Z second as an interval.
For example, in the prior art, the same-screen protocol DLNA is generally used for screen sharing, and this embodiment specifically has a screen recording module for displaying contents from a main screen to an auxiliary screen.
The existing original double-screen mode needs to realize double-screen driving in a ROM, and when a single screen is changed into double-split mode, bottom firmware needs to be modified, so that the modification difficulty is high.
In this embodiment, if a single-screen double-spelling mode is performed, only one screen recording service module apk needs to be installed under the main screen system, and an ordinary user can install and operate the screen recording service module apk without intervention of professionals. Typically from large to small.
Based on the foregoing embodiments, parts of the present embodiment that are the same as the foregoing embodiments are not repeated, and this embodiment provides an embodiment of a display device on a same screen, as shown in fig. 4, which specifically includes:
and the USB service module 401 is used for acquiring the unique identification code of the wired communication module in the device which establishes wired communication with the main screen device.
And the USB service module is used for determining the equipment as the auxiliary screen equipment when the unique identification code of the wired communication module is a preset identification code.
A screen recording service module 402, configured to retrieve the resolution and the frame rate of the secondary screen device, set the resolution of the screen recording service of the primary screen device based on the resolution of the secondary screen device, and set the reading frequency of the screen recording service of the primary screen device based on the frame rate of the secondary screen device, so as to perform screen recording.
And the USB service module is used for sending screen recording data to the auxiliary screen equipment when the screen recording of preset time is finished, so that the auxiliary screen equipment can display the screen on the same screen.
In another preferred embodiment, the method further comprises:
and the setting module is used for setting the USB service module of the main screen device into a VCP virtual serial port and setting the identification code of the VCP virtual serial port into a preset identification code.
In another preferred embodiment, the USB service module is configured to:
sending the screen recording data to the auxiliary screen device through the main screen device; decompressing and restoring the screen recording data by using the auxiliary screen device to obtain image frame data; and converting the image frame data into a corresponding format based on the resolution and the frame rate through the auxiliary screen equipment, and performing on-screen display.
Based on the foregoing embodiments, the same parts as those in the foregoing embodiments are not repeated in detail in this embodiment, and this embodiment provides a display system on a same screen, as shown in fig. 4 to 6, including: a primary screen device and a secondary screen device.
The home screen apparatus includes: the USB service module is used for detecting a unique identification code of a wired communication module in equipment which is connected with the USB service module; and when the unique identification code of the wired communication module in the equipment is a preset identification code, marking the equipment as the auxiliary screen equipment.
The home screen device further includes: and the screen recording service module is used for calling the resolution and the frame rate of the auxiliary screen equipment and recording the screen according to the resolution and the frame rate of the auxiliary screen equipment.
And the USB service module is used for transmitting screen recording data to the wired communication module after screen recording for preset time is finished.
The sub-screen device includes: and the on-screen display module is used for receiving the screen recording data, converting the screen recording data into a target format which accords with the resolution and the frame rate of the auxiliary screen equipment, and then displaying the screen on the same screen.
In another preferred embodiment, the sub-screen device includes: and the data decoding module is used for decompressing and restoring the screen recording data to obtain image frame data.
The sub-screen device further includes: and the data conversion and display module is used for converting the image frame data into a corresponding format based on the resolution and the frame rate and performing on-screen display.
In another preferred embodiment, the data conversion and display module is further configured to convert the image frame data into a corresponding format based on the resolution and the frame rate after receiving the screen recording data, and push the image frame data to an external port for use by an external device.
Illustratively, an implementation device of a same-screen method applied to an Android device in a USB mode includes: in the vice screen device of USB in the desk-top cashier's system, include:
1) a Linux operating system is deployed on the RK3036 CPU;
2) realizing a USB device function, and marking the device type as an auxiliary screen device;
3) the storage of the resolution and frame rate parameters of the auxiliary screen is realized;
4) decompression of data from the USB is achieved;
5) the decompressed data is combined and restored according to the image frames and is cached to the designated position;
6) after reading according to the image frames from the cache and converting the target format, the display screen is controlled to display frame by frame according to the image frames.
In summary, through the implementation of the functions in the above steps, the display function of the USB secondary screen device for receiving data to the secondary screen is realized together.
Illustratively, as shown in fig. 6, the applications displayed on the same screen from the main screen to the sub-screen in the corresponding desktop cashier system:
1) installing the screen recording application service in the method in the Android equipment of the main screen;
2) the USB auxiliary screen is connected with the main screen through a USB data line;
3) after detecting that the USB auxiliary screen device is inserted, a screen recording service in the main screen Android device reads the resolution S1 and the frame rate parameter F1 of the auxiliary screen device;
4) the screen recording service sets the screen recording resolution according to the secondary screen resolution S1, sets the screen recording reading frequency according to the secondary screen frame rate F1, and starts the screen recording function;
5) the data after screen recording is compressed by a specific A format and then sent to a USB port;
6) the USB secondary screen receives the data transmitted from the USB port, and the data is decompressed and restored and finally displayed on the secondary screen;
to sum up, the same screen process from the display screen of the main device to the USB auxiliary screen is realized in the desktop cashier system.
Through the application of the USB auxiliary screen in the desktop cashier system, the following effects are achieved:
1) the screen recording service is installed on the main device and connected with the USB auxiliary screen, so that the same screen from the display end of the main device to the auxiliary screen can be realized, the method is convenient and simple to implement, and no special requirements are required on the main Android device.
2) As the screen recording is carried out according to the requirements of the resolution ratio and the frame rate of the auxiliary screen in the screen recording service, the generated data is not wasted and is the minimum useful data, and the data is compressed and transmitted, so that the minimum processing amount of the USB auxiliary screen on the data can be realized, the screen can be refreshed in time, and the problem of delay caused by excessive data processing in the same screen is solved.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or recited in detail in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed system and method may be implemented in other ways. The above-described system embodiments are merely exemplary, and it is exemplary that the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, and it is exemplary that a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units may be stored in a storage medium if they are implemented in the form of software functional units and sold or used as separate products. It should be noted that the storage medium may contain contents that are appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction, and for example, in some jurisdictions, the computer-readable storage medium does not include electrical carrier signals and telecommunication signals according to legislation and patent practice.
It should be noted that the above embodiments can be freely combined as necessary. The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims (10)

1. An on-screen display method, comprising:
acquiring a unique identification code of a wired communication module in equipment establishing wired communication with main screen equipment;
when the unique identification code of the wired communication module is a preset identification code, determining that the equipment is auxiliary screen equipment;
calling the resolution and the frame rate of the auxiliary screen device, setting the resolution of the screen recording service of the main screen device based on the resolution of the auxiliary screen device, and setting the frame rate of the screen recording service of the main screen device based on the frame rate of the auxiliary screen device so as to record the screen;
and when the screen recording of the preset time is finished, screen recording data are sent to the auxiliary screen equipment, so that the auxiliary screen equipment performs on-screen display.
2. The on-screen display method of claim 1, wherein before the acquiring the unique identification code of the wired communication module in the device that establishes the wired communication with the main screen device, further comprising:
and setting the USB service module of the main screen device as a VCP virtual serial port, and setting the identification code of the device to be accessed of the VCP virtual serial port as a preset identification code.
3. The on-screen display method of claim 1, wherein the recording based on the resolution and the frame rate of the secondary screen device comprises:
and calling a MediaCodeC library at the main screen equipment based on the resolution and the frame rate, and grabbing the image of the area with the resolution at the current main screen of the main screen equipment by taking the reciprocal of the frame rate as interval time.
4. The on-screen display method according to any one of claims 1 to 3, wherein before acquiring the unique identification code of the wired communication module in the device which establishes wired communication with the main screen device, the method further comprises:
and judging whether the equipment is the auxiliary screen equipment or not based on the unique identification code of the wired communication module and the preset identification code.
5. An on-screen display device, comprising:
the USB service module is used for acquiring a unique identification code of a wired communication module in equipment establishing wired communication with the main screen equipment;
the USB service module is used for determining the equipment as auxiliary screen equipment when the unique identification code of the wired communication module is a preset identification code;
the screen recording service module is used for calling the resolution and the frame rate of the auxiliary screen equipment, setting the resolution of the screen recording service of the main screen equipment based on the resolution of the auxiliary screen equipment, and setting the reading frequency of the screen recording service of the main screen equipment based on the frame rate of the auxiliary screen equipment so as to record the screen;
and the USB service module is used for sending screen recording data to the auxiliary screen equipment when the screen recording of preset time is finished, so that the auxiliary screen equipment can display the screen on the same screen.
6. The on-screen display device of claim 5, further comprising:
and the setting module is used for setting the USB service module of the main screen device into a VCP virtual serial port and setting an identification code of a device to be accessed of the VCP virtual serial port into a preset identification code.
7. The on-screen display device of any one of claims 5-6, wherein the USB service module is further configured to:
sending the screen recording data to the auxiliary screen device through the main screen device;
decompressing and restoring the screen recording data by using the auxiliary screen device to obtain image frame data;
and converting the image frame data into a corresponding format based on the resolution and the frame rate through the auxiliary screen equipment, and performing on-screen display.
8. An on-screen display system, comprising: a primary screen device and a secondary screen device;
the home screen apparatus includes: the USB service module is used for detecting a unique identification code of a wired communication module in equipment which is connected with the USB service module; when the unique identification code of the wired communication module in the equipment is a preset identification code, marking the equipment as the auxiliary screen equipment;
the home screen device further includes: the screen recording service module is used for calling the resolution and the frame rate of the auxiliary screen equipment and recording the screen according to the resolution and the frame rate of the auxiliary screen equipment;
the USB service module is used for transmitting screen recording data to the wired communication module after screen recording for a preset time is finished;
the sub-screen device includes: and the on-screen display module is used for receiving the screen recording data, converting the screen recording data into a target format which accords with the resolution and the frame rate of the auxiliary screen equipment, and then displaying the screen on the same screen.
9. The on-screen display system of claim 8, wherein:
the sub-screen device includes: the data decoding module is used for decompressing and restoring the screen recording data to obtain image frame data;
the sub-screen device further includes: and the data conversion and display module is used for converting the image frame data into a corresponding format based on the resolution and the frame rate and performing on-screen display.
10. The on-screen display system of claim 8, wherein:
and the data conversion display module is further used for converting the image frame data into a corresponding format based on the resolution and the frame rate after receiving the screen recording data, and pushing the image frame data to an external port for an external device to use.
CN202111295943.8A 2021-11-03 2021-11-03 On-screen display method, device and system Pending CN113934396A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111295943.8A CN113934396A (en) 2021-11-03 2021-11-03 On-screen display method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111295943.8A CN113934396A (en) 2021-11-03 2021-11-03 On-screen display method, device and system

Publications (1)

Publication Number Publication Date
CN113934396A true CN113934396A (en) 2022-01-14

Family

ID=79285425

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111295943.8A Pending CN113934396A (en) 2021-11-03 2021-11-03 On-screen display method, device and system

Country Status (1)

Country Link
CN (1) CN113934396A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114489547A (en) * 2022-01-30 2022-05-13 深圳创维-Rgb电子有限公司 Screen projection method and device, electronic equipment and readable storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108073225A (en) * 2016-11-15 2018-05-25 中兴通讯股份有限公司 Double screen terminal, screen display method and device
CN109308175A (en) * 2018-11-02 2019-02-05 盛子望 The electronic device and method of Display on the same screen are carried out using mobile device and display equipment
CN109327728A (en) * 2018-11-23 2019-02-12 深圳市鹰硕技术有限公司 One kind is one-to-many to shield together methods, devices and systems, with screen equipment and storage medium
CN109669659A (en) * 2019-01-15 2019-04-23 盛子望 The electronic equipment of data processing is carried out for connecting mobile terminal
CN110138738A (en) * 2019-04-15 2019-08-16 深圳价值在线信息科技股份有限公司 The intelligentized method, apparatus of office meeting, system, storage medium and server
CN110874959A (en) * 2018-09-03 2020-03-10 深圳市鹰硕技术有限公司 Multi-terminal same-screen teaching system and teaching method
WO2020168499A1 (en) * 2019-02-20 2020-08-27 深圳市鹰硕技术有限公司 Screen-sharing teaching method, apparatus and system, and smart device and storage medium
CN112860208A (en) * 2021-04-25 2021-05-28 深圳乐播科技有限公司 Screen-projection-based software sharing method, device, equipment and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108073225A (en) * 2016-11-15 2018-05-25 中兴通讯股份有限公司 Double screen terminal, screen display method and device
CN110874959A (en) * 2018-09-03 2020-03-10 深圳市鹰硕技术有限公司 Multi-terminal same-screen teaching system and teaching method
CN109308175A (en) * 2018-11-02 2019-02-05 盛子望 The electronic device and method of Display on the same screen are carried out using mobile device and display equipment
CN109327728A (en) * 2018-11-23 2019-02-12 深圳市鹰硕技术有限公司 One kind is one-to-many to shield together methods, devices and systems, with screen equipment and storage medium
CN109669659A (en) * 2019-01-15 2019-04-23 盛子望 The electronic equipment of data processing is carried out for connecting mobile terminal
WO2020168499A1 (en) * 2019-02-20 2020-08-27 深圳市鹰硕技术有限公司 Screen-sharing teaching method, apparatus and system, and smart device and storage medium
CN110138738A (en) * 2019-04-15 2019-08-16 深圳价值在线信息科技股份有限公司 The intelligentized method, apparatus of office meeting, system, storage medium and server
CN112860208A (en) * 2021-04-25 2021-05-28 深圳乐播科技有限公司 Screen-projection-based software sharing method, device, equipment and storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
席瑶: "翻转课堂教学模式下大学英语专题式微课的设计", 《现代教育技术》, no. 41, 31 October 2018 (2018-10-31), pages 313 *
朱玉燕: "浅谈微课制作的流程与技巧", 《现代职业教育》, 10 January 2020 (2020-01-10), pages 101 *
郭旭 等: "基于MOOC的在线教学实验平台的设计与实现", 说明书第[0087]-[0088]段, vol. 37, no. 2, 29 February 2016 (2016-02-29), pages 550 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114489547A (en) * 2022-01-30 2022-05-13 深圳创维-Rgb电子有限公司 Screen projection method and device, electronic equipment and readable storage medium

Similar Documents

Publication Publication Date Title
US10366669B2 (en) Electronic device and method for driving display thereof
US8036469B2 (en) Imaging apparatus including a separable monitor, and method for controlling the imaging apparatus
US7956921B2 (en) Imaging apparatus including a separable monitor and capable of wireless communication, and method for controlling the imaging apparatus
US20030017846A1 (en) Wireless display
EP1903431A2 (en) Display system with plural displays, display apparatus and display method thereof
US8648843B2 (en) USB image transmission system and device
CN110231924B (en) Video conference system and transmitting terminal device thereof
US8033469B2 (en) Apparatus for performing multimedia-based data transmission and associated method
EP1668640B1 (en) Dvd player that sets optimal display environment and operating method thereof
CN109712691B (en) System and method for converting a mobile device display into a medical image display
CN111625211A (en) Screen projection method and device, android device and display device
CN113934396A (en) On-screen display method, device and system
US10877914B2 (en) Electronic apparatus device and control method including a host communicating with a plurality of connectors in a lump through a bus line
CN110460795B (en) Sharing device and sharing method for combined television MIPI camera
CN113094015A (en) Holographic multi-screen display implementation method and system, computer equipment and storage medium
CN112351234A (en) Intelligent near-eye display device, system and extended display method
US7215367B2 (en) Image data control system and method for capturing and displaying an original image of an object
CN215871617U (en) Signal interface, control chip and video processing equipment
US20060230178A1 (en) Method and apparatus for data transfer device
CN116320248B (en) Memory chip sharing system, method, related device and storage medium
CN217932706U (en) Data display system and data acquisition equipment
CN113596554B (en) Display method and display equipment
CN109951676B (en) Picture transmission method and camera device
TWI672672B (en) Image display system and method of transforming display panels of mobile devices into being compatible with medical images display standard
TW488154B (en) Digital moving and static picture capturing adapter of moving picture camera

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination