CN112948151A - Program interface image transmission method, substrate management controller and remote control equipment - Google Patents

Program interface image transmission method, substrate management controller and remote control equipment Download PDF

Info

Publication number
CN112948151A
CN112948151A CN202110394552.5A CN202110394552A CN112948151A CN 112948151 A CN112948151 A CN 112948151A CN 202110394552 A CN202110394552 A CN 202110394552A CN 112948151 A CN112948151 A CN 112948151A
Authority
CN
China
Prior art keywords
compressed image
image frame
historical
current
program interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110394552.5A
Other languages
Chinese (zh)
Inventor
魏红杨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Yunhai Guochuang Cloud Computing Equipment Industry Innovation Center Co Ltd
Original Assignee
Shandong Yunhai Guochuang Cloud Computing Equipment Industry Innovation Center Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Yunhai Guochuang Cloud Computing Equipment Industry Innovation Center Co Ltd filed Critical Shandong Yunhai Guochuang Cloud Computing Equipment Industry Innovation Center Co Ltd
Priority to CN202110394552.5A priority Critical patent/CN112948151A/en
Publication of CN112948151A publication Critical patent/CN112948151A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/543User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/547Remote procedure calls [RPC]; Web services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/54Indexing scheme relating to G06F9/54
    • G06F2209/544Remote

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention discloses a program interface image transmission method, which is applied to a substrate management controller and comprises the following steps: acquiring a current compressed image frame and a historical compressed image frame; comparing the current compressed image frame with the historical compressed image frame; when the current compressed image frame is the same as the historical compressed image frame, sending preset identification information; presetting identification information to indicate that the current compressed image frame is unchanged; when the current compressed image frame is different from the historical compressed image frame, updating the historical compressed image frame by using the current compressed image frame, and sending the updated historical compressed image frame; when the current compressed image frame is the same as the historical compressed image frame, the method only sends the preset identification information indicating that the current compressed image frame is unchanged, so that the sending of the same current compressed image frame can be effectively avoided, and the consumption of computing resources is reduced. The invention also provides a substrate management controller, a remote control device, an electronic device and a computer readable storage medium, which have the beneficial effects.

Description

Program interface image transmission method, substrate management controller and remote control equipment
Technical Field
The present invention relates to the field of servers, and in particular, to a program interface image transmission method, a baseboard management controller, a remote control device, an electronic device, and a computer-readable storage medium.
Background
In order to improve the management efficiency of the server, many manufacturers add a KVM over IP function to the baseboard management controller of the server. The KVM over IP provides a program interface of the remote control server, and at the same time, the program interface may be transmitted to the remote control device through the baseboard management controller, so as to achieve an effect of controlling and managing the server using the remote control device.
In the related technology, the substrate management controller can temporarily store each compressed program interface image frame and send the temporarily stored image frame to the remote control device, and due to the fact that the data volume of the image frame is large, the repeated reading and sending of the temporarily stored program interface image frame can occupy computing resources of the substrate management controller, the problem of large image transmission delay can occur, and finally the problem of display delay or blockage of the program interface of the remote control device can be caused.
Disclosure of Invention
The invention aims to provide a program interface image transmission method, a baseboard management controller, a remote control device, an electronic device and a computer readable storage medium, which can send preset identification information indicating that a current compressed image frame is unchanged when the current compressed image frame is the same as a temporarily stored historical compressed image frame, thereby reducing the consumption of repeatedly sending the same compressed image frame on the computing resources of the baseboard management controller.
In order to solve the above technical problem, the present invention provides a program interface image transmission method, which is applied to a baseboard management controller, and the method includes:
acquiring a current compressed image frame and a historical compressed image frame;
comparing the current compressed image frame with the historical compressed image frame;
when the current compressed image frame is the same as the historical compressed image frame, sending preset identification information; the preset identification information represents that the current compressed image frame is unchanged;
and when the current compressed image frame is different from the historical compressed image frame, updating the historical compressed image frame by using the current compressed image frame, and sending the updated historical compressed image frame.
Optionally, the obtaining the current compressed image frame includes:
acquiring a current original image frame;
and dividing the current original image frame into a preset number of image blocks, and compressing each image block to obtain a current compressed image frame consisting of compressed image blocks.
Optionally, the comparing with the current compressed image frame and the historical compressed image frame includes:
comparing the compressed image blocks with corresponding historical image blocks in the historical compressed image frames;
when all the compressed image blocks are the same as the corresponding historical image blocks, determining that the current compressed image frame is the same as the historical compressed image frame;
and when the compressed image block is different from the corresponding historical image block, determining that the current compressed image frame is different from the historical compressed image frame.
Optionally, the updating the historical compressed image frame with the current compressed image frame includes:
and updating the historical image blocks corresponding to the compressed image blocks by using the compressed image blocks different from the corresponding historical image blocks.
Optionally, the sending the preset identification information includes:
and generating the preset identification information, and only packaging the preset identification information into an IP data packet for transmission.
The invention also provides a program interface image transmission method, which is applied to remote control equipment and comprises the following steps:
when receiving preset identification information sent by a substrate management controller, reading and outputting a stored program interface image frame;
when the historical compressed image frames sent by the baseboard management controller are received, the historical compressed image frames are decompressed and output, and the stored program interface image frames are updated by the decompressed historical compressed image frames.
The present invention also provides a baseboard management controller, comprising:
the acquisition module is used for acquiring a current compressed image frame and a historical compressed image frame;
a comparison module for comparing the current compressed image frame with the historical compressed image frame;
the first sending module is used for sending preset identification information when the current compressed image frame is the same as the historical compressed image frame; the preset identification information represents that the current compressed image frame is unchanged;
and the second sending module is used for updating the historical compressed image frame by using the current compressed image frame and sending the updated historical compressed image frame when the current compressed image frame is different from the historical compressed image frame.
The present invention also provides a remote control apparatus comprising:
the first output module is used for reading and outputting the stored program interface image frame when receiving the preset identification information sent by the substrate management controller;
and the second output module is used for decompressing and outputting the historical compressed image frames when receiving the updated historical compressed image frames sent by the baseboard management controller, and updating the stored program interface image frames by using the decompressed historical compressed image frames.
The present invention also provides an electronic device comprising:
a memory for storing a computer program;
and the processor is used for realizing the program interface image transmission method when executing the computer program.
The invention also provides a computer-readable storage medium, wherein computer-executable instructions are stored in the computer-readable storage medium, and when the computer-executable instructions are loaded and executed by a processor, the program interface image transmission method is realized.
The invention provides a program interface image transmission method, which is applied to a substrate management controller and comprises the following steps: acquiring a current compressed image frame and a historical compressed image frame; comparing the current compressed image frame with the historical compressed image frame; when the current compressed image frame is the same as the historical compressed image frame, sending preset identification information; the preset identification information represents that the current compressed image frame is unchanged; and when the current compressed image frame is different from the historical compressed image frame, updating the historical compressed image frame by using the current compressed image frame, and sending the updated historical compressed image frame.
Therefore, after the current compressed image frame of the program interface is obtained, the historical compressed image frame is compared with the current compressed image frame, if the current compressed image frame is the same as the historical compressed image frame, only the preset identification information indicating that the current compressed image frame is unchanged is sent, but the current compressed image frame is not sent, and the occupation of the same current compressed image frame on the calculation resources of the substrate management controller can be effectively avoided; meanwhile, the updated historical compressed image is used for sending only when the current compressed image frame is different from the historical compressed image frame, so that the occupation of computing resources by repeatedly reading and sending each temporarily stored program interface image frame in the related technology can be effectively avoided, the efficiency of transmitting the program interface image by the substrate management controller can be improved, and finally, the condition that the program interface display delay or blockage of the remote control equipment is caused by the slow image transmission of the substrate management controller in the related technology is relieved. The invention also provides a substrate management controller, a remote control device, an electronic device and a computer readable storage medium, which have the beneficial effects.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a program interface image transmission method according to an embodiment of the present invention;
fig. 2 is a block diagram illustrating a video compression control module in a bmc according to an embodiment of the present invention;
FIG. 3 is a flowchart of another method for transmitting an image of a program interface according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating a method for transmitting a program interface image according to another embodiment of the present invention;
fig. 5 is a block diagram of a baseboard management controller according to an embodiment of the present invention;
fig. 6 is a block diagram of a remote control device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the related technology, the substrate management controller can temporarily store each compressed program interface image frame and send the temporarily stored image frame to the remote control device, and due to the fact that the data volume of the image frame is large, the repeated reading and sending of the temporarily stored program interface image frame can occupy computing resources of the substrate management controller, the problem of large image transmission delay can occur, and finally the problem of display delay or blockage of the program interface of the remote control device can be caused. For example, when the remote control device performs a control operation in the program interface, such as inputting a text or moving a cursor, because the image transmission delay of the bmc is long, the changed program interface image cannot be displayed in the remote control device in time, and the control operation is not matched with the program interface image. In view of this, an embodiment of the present invention provides a program interface image transmission method, which may send preset identification information indicating that a current compressed image frame is unchanged when the current compressed image frame is the same as a historical compressed image frame, so as to reduce consumption of computing resources of a baseboard management controller by repeatedly sending the same current compressed image frame. Referring to fig. 1, fig. 1 is a flowchart of a program interface image transmission method according to an embodiment of the present invention, where the method is applied to a baseboard management controller, and the method may include:
s101, obtaining a current compressed image frame and a historical compressed image frame.
It should be noted that the current compressed image frame is an image frame obtained by compressing the program interface image at the moment, and the historical compressed image frame is a compressed image frame corresponding to the program interface image which has been stored by the baseboard management controller and has undergone the last screen change. In the embodiment of the present invention, a current compressed image frame at this moment is compared with a historical compressed image frame with a last picture change to determine whether the current compressed image frame has a picture change, and when the current compressed image frame has no picture change, preset identification information indicating that the current compressed image frame has not changed is used to replace the current compressed image frame. According to the embodiment of the invention, when the current compressed image frame is not changed, only the preset identification information is sent, so that the consumption of the same current compressed image frame to the computing resource of the baseboard management controller can be effectively avoided, the efficiency of sending the program interface image by the baseboard management controller can be further improved, and finally, the problems of display delay and blockage of the remote control equipment caused by low efficiency of transmitting the program interface image by the baseboard management controller can be reduced.
It will be appreciated that for image comparison purposes, the current compressed image frame and the historical compressed image frame should be compressed in the same manner. The embodiment of the present invention does not limit the compression manner of the current compressed image frame and the historical compressed image frame, and for example, the current original image frame and the historical original image frame may be completely compressed to obtain the current compressed image frame and the historical compressed image frame, or the current original image frame and the historical original image frame may be divided into a preset number of image blocks, and the image blocks are compressed to obtain the current compressed image frame and the historical compressed image frame composed of the compressed image blocks. In the embodiment of the invention, considering that the compression efficiency can be further improved by a block compression mode, the block compression mode can be adopted, namely, the current original image frame and the historical original image frame are divided into a preset number of image blocks, and the image blocks are compressed to obtain the current compressed image frame and the historical compressed image frame which are composed of the compressed image blocks. The present invention also does not limit the specific compression steps, for example, color space conversion, JEPG image format compression, etc. can be performed on the current original image frame and the historical compressed image frame, and the user can refer to the related technologies of image compression. The embodiment of the present invention also does not limit the specific way of blocking the current original image frame and the historical original image frame, for example, the image frames may be divided into a preset number of image blocks in a horizontal direction, or divided into a preset number of image blocks in a vertical direction, or divided into a preset number of image blocks in a grid-like manner. The invention does not limit the specific numerical value of the preset quantity, and the user can set the numerical value according to the actual application requirement.
In one possible case, the process of obtaining the current compressed image frame may include:
step 11: acquiring a current original image frame;
step 12: dividing the current original image frame into a preset number of image blocks, and compressing each image block to obtain a current compressed image frame consisting of compressed image blocks.
Further, it should be noted that the embodiment of the present invention does not limit whether the function of compressing the current original image frame is performed by software or by a separate image compression hardware structure. When the software compression can meet the application requirements, the current original image can be compressed by adopting software; when the compression efficiency needs to be improved, the method can also be completed by adopting an independent image compression hardware structure. In the embodiment of the invention, the independent image compression hardware structure can be adopted to compress the current original image in consideration of the fact that the independent image compression hardware result can independently complete image compression without occupying the operation resource of the baseboard management controller. The implementation of the present invention is not limited to a specific image compression hardware structure, and a user may refer to a related art that performs image compression using hardware.
And S102, comparing the current compressed image frame with the historical compressed image frame.
This step is intended to determine whether a picture change has occurred in the current compressed picture frame. Since the historical compressed image frame is the program interface image with the last picture change, whether the current compressed image frame has the picture change or not can be determined by comparing the current compressed image frame with the historical compressed image frame, and different data can be sent according to the comparison result.
It should be noted that the embodiment of the present invention does not limit the specific way of comparing the current compressed image frame with the historical compressed image frame, for example, the image similarity between the current compressed image frame and the historical compressed image frame can be calculated, and the image similarity and the preset threshold are used to determine whether the two are the same; of course, the image data of the current compressed image frame can be directly compared with the image data of the historical compressed image frame, and whether the image data of the current compressed image frame and the image data of the historical compressed image frame are the same or not can be determined according to the comparison result. Because the image change of the program interface is small, the application requirements are difficult to meet by using the image similarity, and the difference between the current compressed image frame and the historical compressed image frame can be found more quickly by directly using the image data for comparison, the image comparison can be carried out by adopting a second mode in the embodiment of the invention.
It should be noted that, in the embodiments of the present invention, it is not limited to whether to compare a complete current compressed image frame with a complete historical compressed image block, or to compare a compressed image block of the current compressed image frame with a corresponding historical image block in the historical compressed image frame. When the complete current compressed image frame is used for comparing with the complete historical compressed image block, higher contrast efficiency can be ensured, the complete current compressed image frame can be used for comparing with the complete historical compressed image block, and when the contrast efficiency needs to be improved, the compressed image block of the current compressed image frame can be used for comparing with the corresponding historical image block in the historical compressed image frame. In the embodiment of the present invention, it is considered that the current compressed image frame and the historical compressed image frame may be determined to be different as long as a certain compressed image block is found to be different from the corresponding historical image block, and the comparison efficiency may be effectively improved, so that the compressed image block of the current compressed image frame may be used for comparison with the corresponding historical image block in the historical compressed image frame.
In one possible scenario, the process of comparing the current compressed image frame with the historical compressed image frame may include:
step 21: comparing historical image blocks corresponding to the compressed image blocks in historical compressed image frames;
step 22: when all the compressed image blocks are the same as the corresponding historical image blocks, determining that the current compressed image frame is the same as the historical compressed image frame;
step 23: and when the compressed image block is different from the corresponding historical image block, determining that the current compressed image frame is different from the historical compressed image frame.
It should be noted that, the embodiment of the present invention does not limit the matching manner of the correspondence relationship between the compressed image block and the historical image block, for example, when the compressed data corresponding to the compressed image block has a data frame header or a data frame tail, the correspondence relationship between the compressed image block and the historical image block can be determined by using the data frame header, the data frame tail or the combination of the data frame header and the data frame tail; when the compression of the image block is performed according to the blocking sequence of the current original image frame and the historical original image frame, the historical image block corresponding to the compressed image block in the historical compressed image block can be determined according to the blocking sequence of the compressed image block in the current compressed image frame. It will be appreciated that the compressed image blocks are compared to the corresponding historical image blocks in the same manner as the comparison using the complete current compressed image frame to the complete historical compressed image blocks.
Further, it should be noted that the embodiment of the present invention does not limit whether the function of comparing the current compressed image frame and the historical compressed image frame is performed by software or by a separate image comparison hardware structure. When the software compression can meet the application requirement, the current compressed image frame and the historical compressed image frame can be compared by adopting software; when the contrast efficiency needs to be improved, the method can also be completed by adopting an independent hardware structure. Considering that the independent image comparison hardware structure can quickly complete the code comparison of the compressed data corresponding to the current compressed image frame and the historical compressed image frame, the operation resource of the baseboard management controller is not occupied, and the image comparison efficiency can be improved, so that the independent image comparison hardware structure can be adopted to compare the current compressed image frame and the historical compressed image frame. The implementation of the present invention is not limited to a specific image comparison hardware structure as long as image data comparison can be completed.
Furthermore, if the image compression and the image comparison are both completed by independent hardware structures, and the compression mode of the current compressed image frame is block compression, in order to improve the calculation efficiency, the image compression hardware structure can send each compressed image block to the image comparison hardware structure after obtaining the compressed image block.
S103, when the current compressed image frame is the same as the historical compressed image frame, sending preset identification information; the preset identification information indicates that the current compressed image frame is unchanged.
In the embodiment of the present invention, if it is determined that the current compressed image frame is the same as the historical compressed image frame, that is, the current compressed image frame has no picture change, the current compressed image frame is replaced by the preset identification information indicating that the current compressed image frame has no picture change, and only the preset identification information is sent. In the related art, since the sending of the buffered program interface image frame is performed by the server management software running on the bmc, and the reading and sending of the buffered software interface image frame by the server management software will consume the computing resource of the bmc, the bmc may send the program interface image slowly. In the embodiment of the invention, because the program interface image frames with the same picture are not repeatedly sent, but the same program interface image frames are replaced by only using the preset identification information, the repeated temporary storage and sending of the program interface image frames with the same picture can be effectively avoided; meanwhile, in practical application, a user has less operation on the server management software, and the server management software can generate a large number of same program interface image frames, so that the method replaces the same program interface image frames by using the preset identification information, the occupation of the same program interface image frames in sending pictures on the computing resources of the substrate management controller can be effectively avoided, the efficiency of the substrate management controller for transmitting the program interface images is effectively improved, and the problem of display delay or blockage of the remote control equipment caused by the slow transmission of the program interface images by the substrate management controller is finally reduced.
It should be noted that the embodiment of the present invention does not limit the specific form of the preset identification information, and for example, the preset identification information may be an identifier, a string of preset code segments, or a preset information packet, as long as it can indicate that the current compressed image frame is not changed. Further, the embodiment of the present invention does not limit the sending manner of sending the preset identification information, for example, the preset identification information may be used for direct data transmission, or the preset identification information may be encapsulated in an IP data packet for sending. In consideration of the fact that the preset identification information is packaged into the IP data packet to be sent, the IP data packet can be transmitted by using a network, and the setting convenience of the remote control equipment can be further improved, therefore, in the embodiment of the invention, the preset identification information can be packaged into the IP data packet to be sent. The embodiment of the present invention does not limit the specific process of sending the preset identification information, for example, the preset identification information may be stored in a memory, and when it is determined that the current compressed image frame is the same as the historical compressed image frame, the stored preset identification information is read, and only the preset identification information is encapsulated in an IP data packet to be sent; or the preset identification information can be directly generated according to the comparison result that the current compressed image frame is the same as the historical compressed image frame, and only the preset identification information is packaged into an IP data packet to be sent. In view of the high execution efficiency of directly generating the preset identification information, in the embodiment of the present invention, the preset identification information may be directly generated according to the same comparison result between the current compressed image frame and the historical compressed image frame, and only the preset identification information is encapsulated in the IP data packet for transmission.
In one possible case, the sending the preset identification information includes:
step 31: and generating preset identification information, and only packaging the preset identification information into the IP data packet for transmission.
And S104, when the current compressed image frame is different from the historical compressed image frame, updating the historical compressed image frame by using the current compressed image frame, and sending the updated historical compressed image frame.
If the current compressed image frame is different from the historical compressed image frame, the current compressed image frame is subjected to picture change, so that the historical compressed image frame needs to be updated by the current compressed image frame to record the picture change information at the moment, and the next current compressed image frame is compared by the updated historical compressed image frame; meanwhile, since the current compressed image frame at this moment has a picture change, it is necessary to transmit the updated historical compressed image frame to provide the changed program interface image to the remote control device. Because the updated historical compressed image frame is sent only when the current compressed image frame is different from the historical compressed image frame, the embodiment of the invention can effectively avoid the occupation of computing resources caused by repeatedly reading and sending each program interface image frame in the related technology, thereby effectively improving the efficiency of the substrate management controller for transmitting the program interface image.
It should be noted that, the embodiment of the present invention does not limit the way of updating the history compressed image frame by using the current compressed image frame, for example, the current compressed image frame can be directly used to completely update the history compressed image frame already stored in the memory; of course, if the current compressed image frame and the historical compressed image frame are both compressed in a block compression manner, the historical image block corresponding to the memory may also be updated by using a compressed image block different from the historical image block of the historical compressed image frame. In view of the fact that the execution efficiency of updating the corresponding historical image block in the memory is higher by using the compressed image block different from the historical image block of the historical compressed image frame, in the embodiment of the present invention, the historical compressed image frame may be updated by using the current compressed image frame in the second manner.
In one possible case, the process of updating the historical compressed image frame with the current compressed image frame may include:
step 41: and updating the historical image blocks corresponding to the compressed image blocks by using the compressed image blocks different from the corresponding historical image blocks.
Further, the embodiment of the present invention is not limited to the transmission method for transmitting the updated historical compressed image frame, and for example, the updated historical compressed image frame may be used to perform direct data transmission, or the updated historical compressed image frame may be encapsulated in an IP data packet for transmission. In consideration of the fact that the historical compressed image frames are packaged into the IP data packet to be sent, the historical compressed image frames can be transmitted by using a network, and the setting convenience of the remote control equipment can be further improved.
Further, it should be noted that the sending rate for mixedly sending the preset identification information and the updated historical compressed image is not limited in the present invention, and the user may set the sending rate according to the actual application requirement, for example, the sending rate may be 60 frames per second. It can be understood that, when the current compressed image frame is the same as the historical compressed image frame, the corresponding data position of the current compressed image frame in the transmission data at this moment is the preset identification information.
Finally, it should be noted that, when the comparison operation between the current compressed image frame and the historical compressed image frame is completed by an independent image comparison hardware structure, in order to transmit the comparison result to the server management software that sends the updated historical compressed image frame and the preset identification information, the image comparison hardware structure may store the comparison result in the memory, so that the server management software reads the comparison result, and then determines whether to send the updated historical compressed image or the preset identification information; of course, the hardware structure may also directly send the comparison result to the server management software, so that the server management software receives the comparison result and determines whether to send the updated historical compressed image or the preset identification information according to the comparison result.
Based on the embodiment, after the current compressed image frame of the program interface is obtained, the historical compressed image frame is compared with the current compressed image frame, if the current compressed image frame is the same as the historical compressed image frame, only the preset identification information indicating that the current compressed image frame is not changed is sent, but the current compressed image frame is not sent, so that the occupation of the same current compressed image frame on the calculation resources of the substrate management controller can be effectively avoided; meanwhile, the updated historical compressed image is used for sending only when the current compressed image frame is different from the historical compressed image frame, so that the occupation of computing resources by repeatedly reading and sending each temporarily stored program interface image frame in the related technology can be effectively avoided, the efficiency of transmitting the program interface image by the substrate management controller can be improved, and finally, the condition that the program interface display delay or blockage of the remote control equipment is caused by the slow image transmission of the substrate management controller in the related technology is relieved.
The program interface image transmission method is described below with reference to a specific hardware structure. Referring to fig. 2, fig. 2 is a block diagram of a video compression control module in a baseboard management controller according to an embodiment of the present invention, wherein the video compression control module 210 is disposed in the baseboard management controller and is specifically used for compressing and comparing image frames of a program interface. The video compression control module 210 includes a separate image compression hardware structure, i.e., an image compression module 211, and a separate image comparison hardware structure, i.e., a compressed image comparison module 212, the image compression module 211 and the compressed image comparison module 212 being interconnected and commonly connected to the DDR controller 220. The DDR control 220 is connected to the DDR memory 230, and configured to receive the image obtaining request and the image writing request from the image compression module 211 and the compressed image comparison module 212, and query or write related image data into the DDR memory 230 according to the type of the request. The DDR memory is used for storing the current original image frame and the historical compressed image frame. It should be noted that, the embodiment of the present invention is not limited to other hardware structures of the bmc, and the user may refer to the related technology of the bmc, and may also include hardware structures such as a CPU, a USB controller, an ethernet controller, a PCIe controller, a VGA IP, and a DAC. The embodiment of the invention also does not limit the specific connection mode of the hardware structure in the baseboard management controller, and a user can refer to the related technology of the baseboard management controller. Based on the above hardware description, please refer to fig. 3, and fig. 3 is a flowchart of another program interface image transmission method according to an embodiment of the present invention. In one possible scenario, the method may comprise:
s301, acquiring a current original image frame and a historical compressed image frame;
the current raw image frame is acquired by the image compression module 211 for compressing the current raw image frame, and the historical compressed image frames are acquired by the compressed image comparison module 212 for image comparing the current compressed image frame.
S302, dividing the current original image frame into a preset number of image blocks, and compressing each image block to obtain a current compressed image frame consisting of compressed image blocks;
it should be noted that the image compression module 211 may obtain a complete current original image frame, divide the complete current original image frame, and certainly may also obtain blocks, that is, the current original image frame is divided into a preset number of original image blocks in the DDR memory for storage, and the image compression module 211 directly obtains the original image blocks of the current original image frame. If the current original image frame is divided into a preset number of original image blocks in the DDR memory for storage, it can be understood that image comparison is performed, and historical compressed image blocks should also be divided in the same dividing manner.
S303, comparing the compressed image block with a corresponding historical image block in a historical compressed image frame;
the image compression module 211 may send the compressed image blocks to the compressed image comparison module 212 for comparison when each compressed image block is obtained, and the compressed image comparison module 212 may search for corresponding historical image blocks by compressing the data frame header, the data frame tail, or the combination of the data frame header and the data frame tail of the image block, or may search for corresponding historical image blocks according to the sequence of the compressed image blocks sent by the image compression module 211.
S304, when the compressed image block is different from the corresponding historical image block, determining that the current compressed image frame is different from the historical compressed image frame, and entering the step S306;
s305, when all the compressed image blocks are the same as the corresponding historical image blocks, determining that the current compressed image frame is the same as the historical compressed image frame, and entering the step S307;
s306, updating the historical image blocks corresponding to the compressed image blocks by using the compressed image blocks different from the corresponding historical image blocks, and packaging the updated historical compressed image frames into an IP data packet and sending the IP data packet;
and S307, generating preset identification information, and only packaging the preset identification information into an IP data packet for transmission.
When the current compressed image frame is the same as the historical compressed image frame, the compressed image comparison module may store the comparison result in the DDR memory in order to send the comparison result to the server management program, or may send the comparison result to the server management program by sending the comparison result to the CPU.
Based on the foregoing embodiment, the following describes a program interface image transmission method applied to a remote control device, please refer to fig. 4, where fig. 4 is a flowchart of another program interface image transmission method provided in an embodiment of the present invention, where the method may include:
s401, when receiving the preset identification information sent by the baseboard management controller, reading and outputting the stored program interface image frame.
When the preset identification information is received, it indicates that the current compressed image frame is not changed. In the embodiment of the invention, the remote control device can output the image by using the stored program interface image frame, wherein the program interface image frame is the last updated historical compressed image frame sent by the baseboard management controller. Because the updated historical compressed image frame has the change information of the last picture change, the remote control device of the embodiment of the invention utilizes the program interface image frame to output, and can maintain the program interface image information when the picture changes last time.
S402, when the updated historical compressed image frame sent by the baseboard management controller is received, decompressing and outputting the historical compressed image frame, and updating the stored program interface image frame by using the decompressed historical compressed image frame.
When receiving the updated historical compressed image frame, it indicates that the current compressed image frame has changed pictures, and at this time, it needs to decompress and output the historical compressed image frame; meanwhile, the embodiment of the invention also needs to update the program interface image frame by using the decompressed historical compressed image frame so as to update the image change information.
It should be noted that the embodiment of the present invention does not limit the specific way of decompressing the historical compressed image frames, and it can be understood that the decompression is related to the compression, and the user may refer to the related art according to the specifically set image compression way.
Based on the above embodiment, when receiving the preset identification information, the remote control device of the method outputs the image frame by using the locally stored program interface. Because the preset identification information indicates that the current compressed image frame is unchanged, and the program interface image frame is updated from the previous history compressed image frame and has the image change information of the previous history compressed image, the remote control device of the method can replace the program interface image frame when receiving the preset identification information, thereby avoiding the situation that the same program interface image frame is repeatedly sent by the substrate management control device, improving the efficiency of the substrate management controller for transmitting the program interface image and the display efficiency of the remote control device, and finally relieving the situation of program interface display delay or blockage of the remote control device caused by the slower image transmission of the substrate management controller in the related technology.
The following describes a baseboard management controller, a remote control device, an electronic device, and a computer-readable storage medium according to embodiments of the present invention, and the baseboard management controller, the remote control device, the electronic device, and the computer-readable storage medium described below may be referred to in correspondence with the above-described program interface image transmission method.
Referring to fig. 5, fig. 5 is a block diagram of a baseboard management controller according to an embodiment of the present invention, where the baseboard management controller includes:
an obtaining module 501, configured to obtain a current compressed image frame and a historical compressed image frame;
a comparison module 502 for comparing the current compressed image frame with the historical compressed image frame;
a first sending module 503, configured to send preset identification information when the current compressed image frame is the same as the historical compressed image frame; presetting identification information to indicate that the current compressed image frame is unchanged;
a second sending module 504, configured to update the historical compressed image frame with the current compressed image frame and send the updated historical compressed image frame when the current compressed image frame is different from the historical compressed image frame.
Optionally, obtaining the current compressed image frame may include:
the acquisition submodule is used for acquiring a current original image frame and a historical compressed image frame;
and the compression sub-module is used for dividing the current original image frame into a preset number of image blocks and compressing each image block to obtain the current compressed image frame consisting of the compressed image blocks.
Optionally, the comparing module 502 may include:
the comparison sub-module is used for comparing the compressed image blocks with corresponding historical image blocks in historical compressed image frames;
the first judgment sub-module is used for determining that the current compressed image frame is the same as the historical compressed image frame when all the compressed image blocks are the same as the corresponding historical image blocks;
and the second judgment submodule is used for determining that the current compressed image frame is different from the historical compressed image frame when the compressed image block is different from the corresponding historical image block.
Optionally, the second sending module 504 includes:
the updating sub-module is used for updating the historical image blocks corresponding to the compressed image blocks by using the compressed image blocks different from the corresponding historical image blocks;
and the second sending submodule is used for sending the updated historical compressed image frame.
Optionally, the first sending module 503 includes:
and the first sending submodule is used for generating preset identification information and only packaging the preset identification information into the IP data packet for sending.
Referring to fig. 6, fig. 6 is a block diagram of a remote control device according to an embodiment of the present invention, where the remote control device includes:
the first output module 601 is configured to read and output a stored program interface image frame when receiving preset identification information sent by a baseboard management controller;
and a second output module 602, configured to decompress and output the historical compressed image frame when receiving the updated historical compressed image frame sent by the baseboard management controller, and update the stored program interface image frame with the decompressed historical compressed image frame.
An embodiment of the present invention further provides an electronic device, including:
a memory for storing a computer program;
and the processor is used for realizing the steps of the program interface image transmission method when executing the computer program.
Since the embodiment of the electronic device portion corresponds to the embodiment of the program interface image transmission method portion, please refer to the description of the embodiment of the program interface image transmission method portion for the embodiment of the electronic device portion, which is not repeated here.
The embodiment of the invention also provides a storage medium, wherein a computer program is stored on the storage medium, and when being executed by a processor, the steps of the program interface image transmission method of any embodiment are realized.
Since the embodiment of the storage medium portion corresponds to the embodiment of the program interface image transmission method portion, please refer to the description of the embodiment of the program interface image transmission method portion for the embodiment of the storage medium portion, which is not repeated here.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The above details are provided for a program interface image transmission method, a baseboard management controller, a remote control device, an electronic device, and a computer-readable storage medium according to the present invention. The principles and embodiments of the present invention are explained herein using specific examples, which are presented only to assist in understanding the method and its core concepts. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.

Claims (10)

1. A program interface image transmission method is applied to a baseboard management controller, and comprises the following steps:
acquiring a current compressed image frame and a historical compressed image frame;
comparing the current compressed image frame with the historical compressed image frame;
when the current compressed image frame is the same as the historical compressed image frame, sending preset identification information; the preset identification information represents that the current compressed image frame is unchanged;
and when the current compressed image frame is different from the historical compressed image frame, updating the historical compressed image frame by using the current compressed image frame, and sending the updated historical compressed image frame.
2. The program interface image transmission method according to claim 1, wherein said obtaining a current compressed image frame comprises:
acquiring a current original image frame;
and dividing the current original image frame into a preset number of image blocks, and compressing each image block to obtain a current compressed image frame consisting of compressed image blocks.
3. The program interface image transmission method according to claim 2, wherein said comparing with said current compressed image frame and said historical compressed image frame comprises:
comparing the compressed image blocks with corresponding historical image blocks in the historical compressed image frames;
when all the compressed image blocks are the same as the corresponding historical image blocks, determining that the current compressed image frame is the same as the historical compressed image frame;
and when the compressed image block is different from the corresponding historical image block, determining that the current compressed image frame is different from the historical compressed image frame.
4. The program interface image transmission method according to claim 3, wherein said updating the historical compressed image frame with the current compressed image frame comprises:
and updating the historical image blocks corresponding to the compressed image blocks by using the compressed image blocks different from the corresponding historical image blocks.
5. The program interface image transmission method according to any one of claims 1 to 4, wherein the sending of the preset identification information includes:
and generating the preset identification information, and only packaging the preset identification information into an IP data packet for transmission.
6. A program interface image transmission method is applied to a remote control device, and comprises the following steps:
when receiving preset identification information sent by a substrate management controller, reading and outputting a stored program interface image frame;
and when receiving the updated historical compressed image frame sent by the baseboard management controller, decompressing and outputting the historical compressed image frame, and updating the stored program interface image frame by using the decompressed historical compressed image frame.
7. A baseboard management controller, comprising:
the acquisition module is used for acquiring a current compressed image frame and a historical compressed image frame;
a comparison module for comparing the current compressed image frame with the historical compressed image frame;
the first sending module is used for sending preset identification information when the current compressed image frame is the same as the historical compressed image frame; the preset identification information represents that the current compressed image frame is unchanged;
and the second sending module is used for updating the historical compressed image frame by using the current compressed image frame and sending the updated historical compressed image frame when the current compressed image frame is different from the historical compressed image frame.
8. A remote control apparatus, comprising:
the first output module is used for reading and outputting the stored program interface image frame when receiving the preset identification information sent by the substrate management controller;
and the second output module is used for decompressing and outputting the historical compressed image frames when receiving the updated historical compressed image frames sent by the baseboard management controller, and updating the stored program interface image frames by using the decompressed historical compressed image frames.
9. An electronic device, comprising:
a memory for storing a computer program;
a processor for implementing the program interface image transmission method of any one of claims 1 to 5 and/or 6 when executing the computer program.
10. A computer-readable storage medium having stored thereon computer-executable instructions which, when loaded and executed by a processor, carry out a method of program interface image transmission according to any one of claims 1 to 5 and/or 6.
CN202110394552.5A 2021-04-13 2021-04-13 Program interface image transmission method, substrate management controller and remote control equipment Pending CN112948151A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110394552.5A CN112948151A (en) 2021-04-13 2021-04-13 Program interface image transmission method, substrate management controller and remote control equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110394552.5A CN112948151A (en) 2021-04-13 2021-04-13 Program interface image transmission method, substrate management controller and remote control equipment

Publications (1)

Publication Number Publication Date
CN112948151A true CN112948151A (en) 2021-06-11

Family

ID=76232443

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110394552.5A Pending CN112948151A (en) 2021-04-13 2021-04-13 Program interface image transmission method, substrate management controller and remote control equipment

Country Status (1)

Country Link
CN (1) CN112948151A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113453070A (en) * 2021-06-18 2021-09-28 北京灵汐科技有限公司 Video key frame compression method and device, storage medium and electronic equipment
CN113824962A (en) * 2021-08-29 2021-12-21 山东云海国创云计算装备产业创新中心有限公司 Method, system, equipment and storage medium for transmitting cursor information
CN114422807A (en) * 2022-03-28 2022-04-29 麒麟软件有限公司 Transmission optimization method based on Spice protocol
CN118093331A (en) * 2024-04-29 2024-05-28 山东云海国创云计算装备产业创新中心有限公司 Data processing method, device and system based on hardware design and computer equipment

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1066086A (en) * 1996-08-19 1998-03-06 Nec Off Syst Ltd Moving image processing system
CN1630371A (en) * 2003-12-19 2005-06-22 联想(北京)有限公司 A method of lossless image compression applied to real time transmission
US20070022217A1 (en) * 2005-07-19 2007-01-25 Ayres Kenneth J Jr Systems, methods, and media for managing an interactive streaming image system
US20070132771A1 (en) * 2005-12-14 2007-06-14 Winbond Israel Ltd. Efficient video frame capturing
JP2009037248A (en) * 2008-09-05 2009-02-19 Necディスプレイソリューションズ株式会社 Image transmission system and image transmission apparatus
CN102821278A (en) * 2012-07-27 2012-12-12 深信服网络科技(深圳)有限公司 Remote desktop image transmission method and remote desktop image transmission system
US20150304663A1 (en) * 2013-04-29 2015-10-22 Atlas Gaming Technologies Pty. Ltd. Gaming machine and method employing video compression
KR101685384B1 (en) * 2015-06-29 2016-12-12 홍익대학교 산학협력단 The motion estimation method using the compressed memory data using only the upper bit
CN112153388A (en) * 2020-09-18 2020-12-29 山东云海国创云计算装备产业创新中心有限公司 Image compression method, device and related equipment
CN112330618A (en) * 2020-10-29 2021-02-05 浙江大华技术股份有限公司 Image offset detection method, device and storage medium

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1066086A (en) * 1996-08-19 1998-03-06 Nec Off Syst Ltd Moving image processing system
CN1630371A (en) * 2003-12-19 2005-06-22 联想(北京)有限公司 A method of lossless image compression applied to real time transmission
US20070022217A1 (en) * 2005-07-19 2007-01-25 Ayres Kenneth J Jr Systems, methods, and media for managing an interactive streaming image system
US20070132771A1 (en) * 2005-12-14 2007-06-14 Winbond Israel Ltd. Efficient video frame capturing
JP2009037248A (en) * 2008-09-05 2009-02-19 Necディスプレイソリューションズ株式会社 Image transmission system and image transmission apparatus
CN102821278A (en) * 2012-07-27 2012-12-12 深信服网络科技(深圳)有限公司 Remote desktop image transmission method and remote desktop image transmission system
US20150304663A1 (en) * 2013-04-29 2015-10-22 Atlas Gaming Technologies Pty. Ltd. Gaming machine and method employing video compression
KR101685384B1 (en) * 2015-06-29 2016-12-12 홍익대학교 산학협력단 The motion estimation method using the compressed memory data using only the upper bit
CN112153388A (en) * 2020-09-18 2020-12-29 山东云海国创云计算装备产业创新中心有限公司 Image compression method, device and related equipment
CN112330618A (en) * 2020-10-29 2021-02-05 浙江大华技术股份有限公司 Image offset detection method, device and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
肖道举等: "面向远端屏幕监控的一种图像压缩传输方法", 《计算机工程与设计》 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113453070A (en) * 2021-06-18 2021-09-28 北京灵汐科技有限公司 Video key frame compression method and device, storage medium and electronic equipment
CN113453070B (en) * 2021-06-18 2023-01-03 北京灵汐科技有限公司 Video key frame compression method and device, storage medium and electronic equipment
CN113824962A (en) * 2021-08-29 2021-12-21 山东云海国创云计算装备产业创新中心有限公司 Method, system, equipment and storage medium for transmitting cursor information
CN113824962B (en) * 2021-08-29 2024-05-14 山东云海国创云计算装备产业创新中心有限公司 Method, system, equipment and storage medium for transmitting cursor information
CN114422807A (en) * 2022-03-28 2022-04-29 麒麟软件有限公司 Transmission optimization method based on Spice protocol
CN114422807B (en) * 2022-03-28 2022-10-21 麒麟软件有限公司 Transmission optimization method based on Spice protocol
CN118093331A (en) * 2024-04-29 2024-05-28 山东云海国创云计算装备产业创新中心有限公司 Data processing method, device and system based on hardware design and computer equipment

Similar Documents

Publication Publication Date Title
CN112948151A (en) Program interface image transmission method, substrate management controller and remote control equipment
US12003743B2 (en) Video stream decoding method and apparatus, terminal device, and storage medium
US12108065B2 (en) Encoding method and apparatus for screen sharing, storage medium, and electronic device
CN113079379A (en) Video compression method, device, equipment and computer readable storage medium
US7633641B2 (en) Image transmission apparatus using information on rendered range
WO2022252488A1 (en) Image compression method and apparatus, electronic device, and readable storage medium
CN107404654B (en) JPEG image decompression method, device and platform
US20240104780A1 (en) Image compression method and apparatus, and intelligent terminal and computer-readable storage medium
CN108650460B (en) Server, panoramic video storage and transmission method and computer storage medium
CN113873255B (en) Video data transmission method, video data decoding method and related devices
US11949853B2 (en) Data decoding method and apparatus, and data coding method and apparatus
US9332277B2 (en) Transform space difference compression
CN106412473A (en) Image processing device, movie subsystem and movie processing circuit
CN111294600A (en) Compression method, decompression method and device for video sequence frame
WO2016016607A1 (en) Managing display data for display
CN113573072B (en) Image processing method and device and related components
CN106412588A (en) Image frame processing method
CN113521729A (en) Cloud game delay detection method, server, client, system and medium
CN108668170B (en) Image information processing method and device, and storage medium
CN108668169B (en) Image information processing method and device, and storage medium
US20240267544A1 (en) Video data transmission method, video data decoding method, and related apparatuses
JP5036666B2 (en) Method used in image transmission device
US6829390B2 (en) Method and apparatus for transmitting image updates employing high compression encoding
CN117061789B (en) Video transmission frame, method, device and storage medium
CN113126869B (en) Method and system for realizing KVM image high-speed redirection based on domestic BMC chip

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210611