CN111831374A - Remote display method and related device for BMC display interface - Google Patents

Remote display method and related device for BMC display interface Download PDF

Info

Publication number
CN111831374A
CN111831374A CN202010538123.6A CN202010538123A CN111831374A CN 111831374 A CN111831374 A CN 111831374A CN 202010538123 A CN202010538123 A CN 202010538123A CN 111831374 A CN111831374 A CN 111831374A
Authority
CN
China
Prior art keywords
image
sub
active
display interface
window
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202010538123.6A
Other languages
Chinese (zh)
Inventor
满宏涛
李拓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Beijing Electronic Information Industry Co Ltd
Original Assignee
Inspur Beijing Electronic Information Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Beijing Electronic Information Industry Co Ltd filed Critical Inspur Beijing Electronic Information Industry Co Ltd
Priority to CN202010538123.6A priority Critical patent/CN111831374A/en
Publication of CN111831374A publication Critical patent/CN111831374A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/452Remote windowing, e.g. X-Window System, desktop virtualisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20021Dividing image into blocks, subimages or windows

Abstract

The application discloses a remote display method of a BMC display interface, which comprises the following steps: identifying the display interface image according to an image activity identification algorithm to obtain identification results of an active window and an inactive window; dividing the display interface image into a plurality of sub-images corresponding to different active levels according to the identification results of the active window and the inactive window; and sending corresponding sub-images to the remote equipment according to the transmission frequencies corresponding to the different activity levels, so that the remote equipment can display the display interface according to the sub-images received at different frequencies. By dividing the display interface image and sending the display interface image to the remote equipment according to different grades, the data transmission amount is effectively reduced, the data transmission efficiency is improved under the limited bandwidth, the transmission delay is reduced, and the blocking condition is avoided. The application also discloses a BMC device, a computing device and a computer readable storage medium, which have the beneficial effects.

Description

Remote display method and related device for BMC display interface
Technical Field
The application relates to the technical field of BMC management, in particular to a remote display method of a BMC display interface, a BMC device, a computing device and a computer readable storage medium.
Background
In the field of computer Management technology, a BMC (Baseboard Management Controller) chip is a key component of a server system architecture, and remote control, configuration, monitoring, diagnosis, and the like of a server can be completed through the BMC chip. The BMC chip belongs to a server platform management module, is matched with an intelligent platform management interface and is used for monitoring the physical state of a server. The chip takes system hardware as an operation object, and can realize local and remote control, hardware configuration management, hardware diagnosis, fault removal and the like of the server. In the server architecture, the BMC chip belongs to an independent system, and does not depend on other hardware such as a CPU, a memory, and the like, and also does not depend on software programs such as a BIOS and an OS. Essentially, the BMC chip is an SoC chip located on the server motherboard, and plays an important role as a security manager in the operation and maintenance control of the server system
In the prior art, a remote monitoring system is generally used for performing remote monitoring through a BMC chip and an ethernet, and an administrator can perform remote management on a server through the ethernet. In the system, the BMC chip can map a local display interface, a USB mouse, a USB keyboard and other devices of the server to a display, a mouse and a keyboard used by a remote administrator, so that the remote operation of the administrator on the server is realized. The BMC chip has image original data to be displayed by a CPU of the server, reduces the data volume of the image data through JPEG image compression, transmits the image original data to a remote administrator computer through an EMAC (Ethernet Media Access Control Ethernet transmission controller), extracts the image data by matching with specific software, and displays the image data on a display of the remote administrator computer. In the above way, the administrator can see the display interface of the server remotely.
However, the display efficiency of the prior art is low, the data volume of the displayed image is very large, and the image is refreshed continuously. For example, under the current relatively common display specification of 1920x1080@60Hz, the transmission amount per second reaches 355MB/s calculated by 3 bytes per pixel point, and compared with the common ethernet, the bandwidth of the ethernet is far from the tolerance. The delay is large, the interface is unsmooth, the operation cannot be effectively performed, and the use experience is poor due to the fact that the interface is embodied on a remote interface. Even if the interface is delayed or stuck, misoperation occurs, and irreparable loss is caused.
Therefore, how to reduce the display delay in BMC remote monitoring is a key issue of attention for those skilled in the art.
Disclosure of Invention
The purpose of the application is to provide a remote display method of a BMC display interface, a BMC device, a computing device and a computer readable storage medium, by dividing a display interface image and then sending the display interface image to the remote device according to different levels, the data volume of transmission is effectively reduced, the data transmission efficiency is improved under limited bandwidth, the transmission delay is reduced, and the occurrence of a jam condition is avoided.
In order to solve the technical problem, the present application provides a remote display method for a BMC display interface, including:
identifying the display interface image according to an image activity identification algorithm to obtain identification results of an active window and an inactive window;
dividing the display interface image into a plurality of sub-images corresponding to different active levels according to the identification results of the active window and the inactive window;
and sending corresponding sub-images to the remote equipment according to the transmission frequencies corresponding to the different activity levels, so that the remote equipment can display the display interface according to the sub-images received at different frequencies.
Optionally, identifying the display interface image according to an image activity identification algorithm to obtain identification results of an active window and an inactive window, including:
identifying the display interface image according to an image activity identification algorithm to obtain an active window and an inactive window;
and respectively acquiring the position data and the size data of the active window and the inactive window, and taking the position data and the size data as the identification result.
Optionally, segmenting the display interface image into a plurality of sub-images corresponding to different active levels according to the recognition results of the active window and the inactive window, including:
taking the active window in the identification results of the active window and the inactive window as a segmentation center;
dividing the display interface image into a plurality of rectangular blocks according to the division center;
taking the rectangular block where the active window is located as a sub-image corresponding to a first active level;
and taking other rectangular blocks as sub-images corresponding to the second active level.
Optionally, segmenting the display interface image into a plurality of sub-images corresponding to different active levels according to the recognition results of the active window and the inactive window, including:
taking the image corresponding to the active window in the identification results of the active window and the inactive window as a sub-image corresponding to a first active level;
and taking the residual image of the sub-image corresponding to the first active level in the display interface image as the sub-image corresponding to the second active level.
Optionally, segmenting the display interface image into a plurality of sub-images corresponding to different active levels according to the recognition results of the active window and the inactive window, including:
dividing the display interface image into an active window image, an inactive window image and a desktop image according to the identification results of the active window and the inactive window;
taking the active window image as a sub-image corresponding to a first active level;
taking the non-active window image as a sub-image corresponding to a second active level;
and taking the desktop image as a sub-image corresponding to the third level.
Optionally, the method further includes:
and sending the segmentation description information of the plurality of sub-images to the remote equipment so that the remote equipment combines the received sub-images according to the segmentation description information to obtain a display interface image.
Optionally, the sending, by the remote device, the corresponding sub-image to the remote device according to the transmission frequencies corresponding to the different activity levels, so that the remote device displays the display interface according to the sub-images received at different frequencies, includes:
compressing the plurality of sub-images to obtain a plurality of compressed sub-images;
and sending the corresponding compressed sub-images to the remote equipment according to the transmission frequencies corresponding to the different activity levels, so that the remote equipment can display the display interface according to the compressed sub-images received at different frequencies.
The present application further provides a BMC device, including:
the image activity recognition module is used for recognizing the display interface image according to an image activity recognition algorithm to obtain recognition results of an active window and an inactive window;
the image segmentation module is used for segmenting the display interface image into a plurality of sub-images corresponding to different active levels according to the identification results of the active window and the inactive window;
and the image sending and displaying module is used for sending corresponding sub-images to the remote equipment according to the transmission frequencies corresponding to the different activity levels, so that the remote equipment can display the display interface according to the sub-images received at different frequencies.
The present application further provides a computing device comprising:
a memory for storing a computer program;
a processor for implementing the steps of the remote display method as described above when executing the computer program.
The present application also provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, carries out the steps of the remote display method as described above.
The application provides a remote display method of a BMC display interface, which comprises the following steps: identifying the display interface image according to an image activity identification algorithm to obtain identification results of an active window and an inactive window; dividing the display interface image into a plurality of sub-images corresponding to different active levels according to the identification results of the active window and the inactive window; and sending corresponding sub-images to the remote equipment according to the transmission frequencies corresponding to the different activity levels, so that the remote equipment can display the display interface according to the sub-images received at different frequencies.
The method comprises the steps of identifying a display interface image to be displayed, determining identification results of an active window and an inactive window, dividing the display interface image into a plurality of sub-images corresponding to different active levels on the basis, and finally sending the sub-images to remote equipment according to transmission frequencies corresponding to the different active levels, wherein the transmission frequency of the image of the active part is higher, the real-time performance is higher, the book output frequency of the image of the inactive part is lower, and the transmitted data volume is reduced, instead of sending the complete display interface image integrally, the transmitted data volume is effectively reduced, the data transmission efficiency is improved under limited bandwidth, the transmission delay is reduced, and the blocking condition is avoided.
The application also provides a BMC device, a computing device and a computer readable storage medium, which have the above beneficial effects and are not described herein again.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a remote display method of a BMC display interface according to an embodiment of the present disclosure;
fig. 2 is a schematic structural diagram of a BMC device according to an embodiment of the present disclosure.
Detailed Description
The core of the application is to provide a remote display method of a BMC display interface, a BMC device, a computing device and a computer readable storage medium, the display interface image is divided and then sent to the remote device according to different levels, so that the data volume of transmission is effectively reduced, the data transmission efficiency is improved under limited bandwidth, the transmission delay is reduced, and the situation of blocking is avoided.
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The display efficiency of the prior art is low, the data volume of the displayed image is very large, and the image is refreshed continuously. For example, under the current relatively common display specification of 1920x1080@60Hz, the transmission amount per second reaches 355MB/s calculated by 3 bytes per pixel point, and compared with the common ethernet, the bandwidth of the ethernet is far from the tolerance. The delay is large, the interface is unsmooth, the operation cannot be effectively performed, and the use experience is poor due to the fact that the interface is embodied on a remote interface. Even if the interface is delayed or stuck, misoperation occurs, and irreparable loss is caused.
Therefore, the application provides a remote display method of a BMC display interface, which identifies a display interface image to be displayed, determines identification results of an active window and an inactive window, divides the display interface image into a plurality of sub-images corresponding to different active levels on the basis, and finally sends the plurality of sub-images to remote equipment according to transmission frequencies corresponding to different active levels, namely, the image transmission frequency of an active part is higher, the real-time performance is higher, the image book output frequency of the inactive part is lower, the transmitted data volume is reduced, instead of sending the whole display interface image, the transmitted data volume is effectively reduced, the data transmission efficiency is improved under limited bandwidth, the transmission delay is reduced, and the situation of blocking is avoided.
The following describes a remote display method of a BMC display interface according to an embodiment.
Referring to fig. 1, fig. 1 is a flowchart illustrating a remote display method of a BMC display interface according to an embodiment of the present disclosure.
In this embodiment, the method may include:
s101, identifying a display interface image according to an image activity identification algorithm to obtain identification results of an active window and an inactive window;
the method comprises the steps of identifying a display interface image according to an image activity identification algorithm to obtain identification results of an active window and an inactive window. Namely, the display interface image is identified according to an active identification algorithm so as to judge which window is an active window and which window is an inactive window, and further, the identification results of the active window and the inactive window are obtained. Wherein the recognition result includes, but is not limited to, the size and position of the window.
The image activity identification algorithm mainly identifies active parts in a display interface image. The window corresponding to the region in which the change in the image is recognized may be the window corresponding to the region in which the mouse operation is recognized in the image, or the window corresponding to the region in which the change in the image is recognized and the mouse operation is performed may be the window. As can be seen, the identification manner of the active image identification algorithm is not unique, and is not limited in particular here.
Optionally, this step may include:
step 1, identifying a display interface image according to an image activity identification algorithm to obtain an active window and an inactive window;
and 2, respectively acquiring position data and size data of the active window and the inactive window, and taking the position data and the size data as a recognition result.
It can be seen that the alternative scheme mainly explains how to recognize the recognition result. The alternative scheme mainly comprises the steps of firstly identifying a display interface image according to an image activity identification algorithm to obtain an active window and an inactive window, and then respectively acquiring position data and size data of the active window and the inactive window as identification results.
S102, dividing the display interface image into a plurality of sub-images corresponding to different active levels according to the identification results of the active window and the inactive window;
on the basis of S101, this step is intended to segment the display interface image into a plurality of sub-images corresponding to different active levels according to the recognition results of the active window and the inactive window. The display interface image is divided into a plurality of sub-images with different activity levels according to the identification result so as to be sent according to different images.
Specifically, the display interface image may be divided into sub-images of different shapes by performing different dividing methods in this step. For example, the image may be segmented into regular images including, but not limited to, rectangles, triangles, and circles. And also can be divided into irregular images including irregular polygons. Therefore, different recognition results select proper segmentation modes. The recognition result may include, but is not limited to, a single active window, a plurality of scattered active windows, and a plurality of consecutive active windows, among others. For a dispersed plurality of active windows, the active windows can be segmented into a plurality of regular images, and a continuous plurality of active windows can be segmented into a single irregular image. On one hand, the segmentation efficiency can be improved, on the other hand, the performance of consumption of the sub-images can be reduced, and the calculation process is reduced.
The specific active level may be two active levels, may be multiple active levels, and is not particularly limited. The first active level is the level with the highest activity, and corresponds to higher transmission efficiency.
In particular, there are different segmentation operations for different segmentation modes and different activity levels, and the following alternatives may be referred to.
Optionally, this step may include:
step 1, taking an active window in the recognition results of the active window and the inactive window as a segmentation center;
step 2, dividing the display interface image into a plurality of rectangular blocks according to the division center;
step 3, taking the rectangular block where the active window is located as a sub-image corresponding to the first active level;
and 4, taking other rectangular blocks as sub-images corresponding to the second active level.
Therefore, in the alternative scheme, the display interface image is mainly divided into a plurality of regular rectangular blocks. Namely, the image is divided into a plurality of rectangles directly according to the active window as the style center, the rectangular block where the active window is located is used as the sub-image corresponding to the first active level, and then the remaining rectangular blocks are used as the sub-images corresponding to the second active level.
Optionally, this step may include:
step 1, taking an image corresponding to an active window in the identification results of the active window and an inactive window as a sub-image corresponding to a first active level;
and 2, taking the residual image of the sub-image corresponding to the first active level in the display interface image as the sub-image corresponding to the second active level.
Therefore, in the alternative scheme, the display interface image is mainly divided into a plurality of irregular images. Directly taking the image corresponding to the active window as a sub-image corresponding to the first active level, cutting the sub-image from the whole display interface image, and directly taking the rest image as the sub-image corresponding to the second active level. At this time, the sub-image corresponding to the second active level may be a regular image or an irregular image.
Optionally, this step may include:
step 1, dividing a display interface image into an active window image, an inactive window image and a desktop image according to the identification results of the active window and the inactive window;
step 2, taking the active window image as a sub-image corresponding to the first active level;
step 3, taking the non-active window image as a sub-image corresponding to the second active level;
and 4, taking the desktop image as a sub-image corresponding to the third level.
Therefore, in the alternative, the display interface image is mainly divided into a plurality of images with three active levels, wherein the image corresponding to each active level may be regular or irregular, or a mixture of regular and irregular images.
S103, sending corresponding sub-images to the remote equipment according to the transmission frequencies corresponding to the different activity levels, so that the remote equipment displays the display interface according to the sub-images received at different frequencies.
On the basis of S102, this step is intended to send corresponding sub-images to the remote device according to the transmission frequencies corresponding to the different activity levels. In short, the sub-images are transmitted at different transmission frequencies.
In the prior art, a display interface image is generally generated at a speed of 60 frames, and if the display interface image is transmitted at a speed of 60 frames per second under the condition of unlimited bandwidth, the best monitoring experience can be obtained, and the situation of blocking cannot occur. However, in the prior art, the network bandwidth is limited, and the bandwidth resource is extremely limited, so that the experience cannot be normally monitored. Therefore, in the present embodiment, different sub-images are transmitted at different transmission frequencies by this step, which effectively reduces the data amount of image transmission.
For example, the sub-image of the first active level is sent at a rate of 30 frames per second, and the sub-image of the second active level is sent at a rate of 15 frames per second, so that the transmission data volume and the transmission delay can be effectively reduced.
Optionally, this step may include:
step 1, compressing a plurality of sub-images to obtain a plurality of compressed sub-images;
and 2, sending the corresponding compressed sub-images to the remote equipment according to the transmission frequencies corresponding to the different activity levels, so that the remote equipment can display the display interface according to the compressed sub-images received at different frequencies.
It can be seen that the present alternative is mainly illustrative of the process of transmitting images. In the alternative, the image to be transmitted is compressed mainly, so as to further reduce the data amount of image transmission and improve the transmission efficiency of image data. The adopted image compression algorithm may adopt any one of compression algorithms provided in the prior art, and is not specifically limited herein.
Optionally, this embodiment may further include:
and sending the segmentation description information of the plurality of sub-images to the remote equipment so that the remote equipment combines the received sub-images according to the segmentation description information to obtain a display interface image.
Therefore, in the alternative, the segmentation description information for segmenting the plurality of sub-images is mainly sent to the remote device, so that the remote device can perform corresponding combination to obtain the display interface image. The segmentation specification information includes, but is not limited to, position coordinates and size data of the sub-image.
In summary, in the embodiment, the display interface image to be displayed is identified, the identification results of the active window and the inactive window are determined, on this basis, the display interface image is divided into a plurality of sub-images corresponding to different active levels, and finally the plurality of sub-images are sent to the remote device according to the transmission frequencies corresponding to the different active levels, that is, the image transmission frequency of the active portion is high, the real-time performance is high, the image book output frequency of the inactive portion is low, and the transmitted data volume is reduced, instead of sending the complete display interface image as a whole, so that the transmitted data volume is effectively reduced, the data transmission efficiency is improved under the limited bandwidth, the transmission delay is reduced, and the occurrence of the jam condition is avoided.
The following further describes a remote display method of the BMC display interface provided in the present application by using a specific embodiment.
In this embodiment, an active image intelligent identification process and an image segmentation process are added to the existing BMC chip to reduce the transmitted data stream. The method can comprise the following steps:
step 1, identifying an active window at the forefront end in a display interface and data such as the position, the size and the like of the window in the whole interface through an intelligent algorithm;
step 2, recognizing all other inactive windows in the interface and data such as the position, the size and the like of the window in the whole interface through an intelligent algorithm;
step 3, identifying the size of the desktop background;
and 4, dividing the whole interface image into different parts according to the identification results identified in the steps 1 to 3, and extracting the sub-image where the active window is located. For example, the image may be divided into different rectangular blocks, the whole interface has 2 windows, window 1 is a front active window, and the dotted line is a division auxiliary line, and the whole interface may be divided into 5 rectangular portions, each portion being numbered separately.
And 5, the image intelligent identification and segmentation engine assigns different priority levels to the segmented images, the image block where the active window is located is of a high level, and the other parts of the image block are of a low level.
And 6, because the display interface is continuously refreshed, such as the common frequency of 60Hz, namely 60 times of updating every second, the image intelligent identification and segmentation engine can also complete the steps 1 to 5 according to the frequency.
And 7, the image intelligent identification and segmentation engine can transmit the image blocks to a subsequent JPEG compression module according to the set proportion, transmit the image blocks with the active windows at a higher frequency and transmit other image blocks at a lower frequency. For example, an active tile is transmitted every 2 frames and an inactive tile is transmitted every 5 frames, and the ratio can be flexibly changed to adapt to different network conditions.
And 8, when the image intelligent identification and segmentation engine transmits the image blocks to a subsequent image compression module, corresponding description information needs to be transmitted to the EMAC module in advance, and the description information can guide remote supporting software to identify the meaning and content of the transmitted image blocks and help to restore the whole image.
Therefore, in actual use, not all contents of the display interface are changed all the time, the same interface is transmitted repeatedly, network bandwidth is wasted, and delay and jamming are caused. The method of the embodiment can effectively identify the window with higher possibility of change, divide the whole interface into different parts, adopt different priorities to transmit separately, and design matched software at the remote management end to recover the whole interface. The method comprises the steps of identifying a display interface image to be displayed, determining identification results of an active window and an inactive window, dividing the display interface image into a plurality of sub-images corresponding to different active levels on the basis, and finally sending the sub-images to remote equipment according to transmission frequencies corresponding to the different active levels, wherein the transmission frequency of the image of the active part is high, the real-time performance is high, the book output frequency of the image of the inactive part is low, and the transmitted data volume is reduced, instead of sending the whole display interface image, so that the transmitted data volume is effectively reduced, the data transmission efficiency is improved under the limited bandwidth, the transmission time delay is reduced, and the blocking condition is avoided.
In the following, a BMC device provided in an embodiment of the present application is introduced, and a BMC device described below and a remote display method of a BMC display interface described above may be referred to correspondingly.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a BMC device according to an embodiment of the present disclosure.
In this embodiment, the apparatus may include:
the image activity recognition module 100 is configured to recognize a display interface image according to an image activity recognition algorithm to obtain recognition results of an active window and an inactive window;
the image segmentation module 200 is configured to segment the display interface image into a plurality of sub-images corresponding to different active levels according to the recognition results of the active window and the inactive window;
the image sending and displaying module 300 is configured to send corresponding sub-images to the remote device according to the transmission frequencies corresponding to the different activity levels, so that the remote device displays the display interface according to the sub-images received at different frequencies.
The present application further provides a computing device comprising:
a memory for storing a computer program;
a processor for implementing the steps of the remote display method as described in the above embodiments when executing the computer program.
The present application also provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the remote display method as described in the above embodiments.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The remote display method of the BMC display interface, the BMC device, the computing device, and the computer-readable storage medium provided by the present application are described in detail above. The principles and embodiments of the present application are explained herein using specific examples, which are provided only to help understand the method and the core idea of the present application. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.

Claims (10)

1. A remote display method of a BMC display interface is characterized by comprising the following steps:
identifying the display interface image according to an image activity identification algorithm to obtain identification results of an active window and an inactive window;
dividing the display interface image into a plurality of sub-images corresponding to different active levels according to the identification results of the active window and the inactive window;
and sending corresponding sub-images to the remote equipment according to the transmission frequencies corresponding to the different activity levels, so that the remote equipment can display the display interface according to the sub-images received at different frequencies.
2. The remote display method of claim 1, wherein recognizing the display interface image according to an image activity recognition algorithm to obtain recognition results of an active window and an inactive window, comprises:
identifying the display interface image according to an image activity identification algorithm to obtain an active window and an inactive window;
and respectively acquiring the position data and the size data of the active window and the inactive window, and taking the position data and the size data as the identification result.
3. The remote display method of claim 1, wherein segmenting the display interface image into a plurality of sub-images corresponding to different active levels according to the recognition results of the active window and the inactive window comprises:
taking the active window in the identification results of the active window and the inactive window as a segmentation center;
dividing the display interface image into a plurality of rectangular blocks according to the division center;
taking the rectangular block where the active window is located as a sub-image corresponding to a first active level;
and taking other rectangular blocks as sub-images corresponding to the second active level.
4. The remote display method of claim 1, wherein segmenting the display interface image into a plurality of sub-images corresponding to different active levels according to the recognition results of the active window and the inactive window comprises:
taking the image corresponding to the active window in the identification results of the active window and the inactive window as a sub-image corresponding to a first active level;
and taking the residual image of the sub-image corresponding to the first active level in the display interface image as the sub-image corresponding to the second active level.
5. The remote display method of claim 1, wherein segmenting the display interface image into a plurality of sub-images corresponding to different active levels according to the recognition results of the active window and the inactive window comprises:
dividing the display interface image into an active window image, an inactive window image and a desktop image according to the identification results of the active window and the inactive window;
taking the active window image as a sub-image corresponding to a first active level;
taking the non-active window image as a sub-image corresponding to a second active level;
and taking the desktop image as a sub-image corresponding to the third level.
6. The remote display method according to claim 1, further comprising:
and sending the segmentation description information of the plurality of sub-images to the remote equipment so that the remote equipment combines the received sub-images according to the segmentation description information to obtain a display interface image.
7. The remote display method according to claim 1, wherein sending the corresponding sub-images to the remote device according to the transmission frequencies corresponding to the different activity levels, so that the remote device displays the display interface according to the sub-images received at different frequencies, comprises:
compressing the plurality of sub-images to obtain a plurality of compressed sub-images;
and sending the corresponding compressed sub-images to the remote equipment according to the transmission frequencies corresponding to the different activity levels, so that the remote equipment can display the display interface according to the compressed sub-images received at different frequencies.
8. A BMC device, comprising:
the image activity recognition module is used for recognizing the display interface image according to an image activity recognition algorithm to obtain recognition results of an active window and an inactive window;
the image segmentation module is used for segmenting the display interface image into a plurality of sub-images corresponding to different active levels according to the identification results of the active window and the inactive window;
and the image sending and displaying module is used for sending corresponding sub-images to the remote equipment according to the transmission frequencies corresponding to the different activity levels, so that the remote equipment can display the display interface according to the sub-images received at different frequencies.
9. A computing device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the remote display method according to any one of claims 1 to 7 when executing said computer program.
10. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, carries out the steps of the remote display method according to any one of claims 1 to 7.
CN202010538123.6A 2020-06-12 2020-06-12 Remote display method and related device for BMC display interface Withdrawn CN111831374A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010538123.6A CN111831374A (en) 2020-06-12 2020-06-12 Remote display method and related device for BMC display interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010538123.6A CN111831374A (en) 2020-06-12 2020-06-12 Remote display method and related device for BMC display interface

Publications (1)

Publication Number Publication Date
CN111831374A true CN111831374A (en) 2020-10-27

Family

ID=72899311

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010538123.6A Withdrawn CN111831374A (en) 2020-06-12 2020-06-12 Remote display method and related device for BMC display interface

Country Status (1)

Country Link
CN (1) CN111831374A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104137050A (en) * 2012-02-22 2014-11-05 西里克斯系统公司 Remote display with hierarchical updating
WO2015177952A1 (en) * 2014-05-22 2015-11-26 ソニー株式会社 Image display apparatus, information processing apparatus, and image display system
CN109120847A (en) * 2018-08-16 2019-01-01 北京七鑫易维信息技术有限公司 A kind of control method and device of image acquisition equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104137050A (en) * 2012-02-22 2014-11-05 西里克斯系统公司 Remote display with hierarchical updating
WO2015177952A1 (en) * 2014-05-22 2015-11-26 ソニー株式会社 Image display apparatus, information processing apparatus, and image display system
CN109120847A (en) * 2018-08-16 2019-01-01 北京七鑫易维信息技术有限公司 A kind of control method and device of image acquisition equipment

Similar Documents

Publication Publication Date Title
JP7325584B2 (en) ALARM LOG COMPRESSION METHOD, APPARATUS AND SYSTEM, AND STORAGE MEDIUM
US9674265B2 (en) Filtering unnecessary display updates for a networked client
EP3410302A1 (en) Graphic instruction data processing method, apparatus and system
KR20210156243A (en) Training methods of deep-running frameworks, devices and storage media
US11366670B2 (en) Predictive queue control and allocation
CN113468025A (en) Data warning method, system, device and storage medium
JP2023525283A (en) Image detection method, device, computer program and computer equipment
CN113742174B (en) Cloud mobile phone application monitoring method and device, electronic equipment and storage medium
CN113608765A (en) Data processing method, device, equipment and storage medium
CN111831374A (en) Remote display method and related device for BMC display interface
CN112737835A (en) Cloud host business management method and related device
CN109831673B (en) Live broadcast room data processing method, device, equipment and storage medium
CN112799623A (en) BMC-based server interface remote display method, system and related equipment
CN114253710A (en) Processing method of computing request, intelligent terminal, cloud server, equipment and medium
CN114285838A (en) File uploading method, device, system, storage medium and electronic equipment
CN113312238A (en) Resource pool monitoring method and related equipment thereof
CN108664369B (en) Typesetting software monitoring method and device
CN109189746B (en) Method, device, equipment and storage medium for realizing universal stream type Shuffle engine
CN112165622A (en) Single-Pod multi-protocol video file transcoding method and system
CN113038261A (en) Video generation method, device, equipment, system and storage medium
CN110519558A (en) The processing method and its Baseboard Management Controller of video data
CN114500255B (en) Log data reporting method, device, equipment and storage medium
CN112738626B (en) Target detection method and device for video file, electronic equipment and storage medium
CN115904667A (en) Data processing method, device, equipment and storage medium
US20040205122A1 (en) Method and system for real-time monitoring image transmission

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20201027

WW01 Invention patent application withdrawn after publication