CN113824962B - Method, system, equipment and storage medium for transmitting cursor information - Google Patents
Method, system, equipment and storage medium for transmitting cursor information Download PDFInfo
- Publication number
- CN113824962B CN113824962B CN202110999563.6A CN202110999563A CN113824962B CN 113824962 B CN113824962 B CN 113824962B CN 202110999563 A CN202110999563 A CN 202110999563A CN 113824962 B CN113824962 B CN 113824962B
- Authority
- CN
- China
- Prior art keywords
- cursor
- cursor image
- information
- image
- image data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 96
- 230000008569 process Effects 0.000 claims abstract description 59
- 238000012545 processing Methods 0.000 claims abstract description 11
- 230000005540 biological transmission Effects 0.000 claims description 17
- 230000004044 response Effects 0.000 claims description 14
- 238000012544 monitoring process Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 7
- 230000006835 compression Effects 0.000 claims description 3
- 238000007906 compression Methods 0.000 claims description 3
- 238000001514 detection method Methods 0.000 claims description 3
- 238000007781 pre-processing Methods 0.000 claims description 3
- 239000005043 ethylene-methyl acrylate Substances 0.000 claims 8
- 238000010586 diagram Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/436—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a method, a system, equipment and a storage medium for transmitting cursor information, wherein the method comprises the following steps: acquiring a video image, and processing the video image to obtain cursor image data and cursor position data; creating a first process and a second process which are parallel, sequentially acquiring the image data of each frame of cursor by using the first process, and sequentially acquiring the position data of each frame of cursor by using the second process; comparing the cursor image data of the current frame with the cursor image data of the previous frame, and determining the reset value of the cursor image according to the comparison result; and transmitting corresponding cursor information to a remote terminal according to the reset value of the cursor image. The invention reduces the network bandwidth required by video image information by reducing the cursor image data transmitted by the network, thereby realizing low delay and high fluency of video images in the KVM system.
Description
Technical Field
The present invention relates to the field of servers, and more particularly, to a method, system, device, and storage medium for transmitting cursor information.
Background
With the rapid development of network and digital technologies, the number of servers is increasing, and the requirements on the servers are also increasing. Various industries desire improved machine room and server management for enterprises. In most cases, the server is more than one and is fixed in function, usually not requiring frequent operations, but requiring real-time monitoring. Therefore, a KVM (Keyboard, video, mouse, keyboard, display, and mouse) server switching system is necessary.
The KVM server switch system, i.e., KVM switch, implements the functionality of a remote terminal user using a set of keyboard, mouse, and display to access and operate more than one local server. The remote terminal realizes real-time monitoring of the local server through the KVM server switching system, and video image information of the local server is transmitted to the remote terminal through a network. In the remote management application, local video image information is transmitted to a remote terminal through a network, the video image information comprises picture image data and cursor information, the transmission of the picture data occupies a large amount of network bandwidth, due to the limited network bandwidth, the transmission bandwidth is insufficient, the transmission of corresponding video images cannot be completed within a preset time, picture loss is caused, and if the picture loss is excessive, the picture jump and picture blocking phenomenon are caused.
Disclosure of Invention
Accordingly, an object of the embodiments of the present invention is to provide a method, a system, a computer device and a computer readable storage medium for transmitting cursor information, which detect whether the cursor image information is repeated, indicate the characteristics of the cursor image information through the repeated bits of the register cursor image, reduce the cursor image data transmitted by a network in the same scene of the cursor image information, greatly reduce the network transmission data, reduce the network bandwidth required by video image transmission, and realize low delay and high fluency of video images in a KVM system.
Based on the above objects, an aspect of the embodiments of the present invention provides a method for transmitting cursor information, including the following steps: acquiring a video image, and processing the video image to obtain cursor image data and cursor position data; creating a first process and a second process which are parallel, sequentially acquiring the image data of each frame of cursor by using the first process, and sequentially acquiring the position data of each frame of cursor by using the second process; comparing the cursor image data of the current frame with the cursor image data of the previous frame, and determining the reset value of the cursor image according to the comparison result; and transmitting corresponding cursor information to a remote terminal according to the reset value of the cursor image.
In some embodiments, the determining the value of the cursor image reset according to the comparison result includes: judging whether the cursor image data of the current frame is equal to the cursor image data of the previous frame or not; setting the cursor image reset to a first value in response to the cursor image data of the current frame being equal to the cursor image data of the previous frame; and responsive to the current frame of cursor image data being unequal to the previous frame of cursor image data, resetting the cursor image to a second value.
In some embodiments, the transmitting the corresponding cursor information to the remote terminal according to the value of the cursor image reset includes: responsive to the cursor image resetting to a first value, transmitting current frame cursor position data to a remote terminal; and responsive to the cursor image resetting to a second value, transmitting current frame cursor image data and current frame cursor position data to a remote terminal.
In some embodiments, the method further comprises: monitoring the cursor image reset and judging whether the time length of the cursor image reset to the first value exceeds a threshold value; and detecting whether the first process works normally or not in response to the fact that the duration of resetting the cursor image to the first value exceeds a threshold value.
In another aspect of the embodiment of the present invention, there is provided a system for transmitting cursor information, including: the preprocessing module is configured to acquire a video image and process the video image to obtain cursor image data and cursor position data; the acquisition module is configured to create a first process and a second process which are parallel, acquire the cursor image data of each frame sequentially by using the first process, and acquire the cursor position data of each frame sequentially by using the second process; the comparison module is configured to compare the cursor image data of the current frame with the cursor image data of the previous frame, and determine the reset value of the cursor image according to the comparison result; and the transmission module is configured to transmit corresponding cursor information to a remote terminal according to the reset value of the cursor image.
In some embodiments, the comparison module is configured to: judging whether the cursor image data of the current frame is equal to the cursor image data of the previous frame or not; setting the cursor image reset to a first value in response to the cursor image data of the current frame being equal to the cursor image data of the previous frame; and responsive to the current frame of cursor image data being unequal to the previous frame of cursor image data, resetting the cursor image to a second value.
In some embodiments, the transmission module is configured to: responsive to the cursor image resetting to a first value, transmitting current frame cursor position data to a remote terminal; and responsive to the cursor image resetting to a second value, transmitting current frame cursor image data and current frame cursor position data to a remote terminal.
In some embodiments, the system further comprises a detection module configured to: monitoring the cursor image reset and judging whether the time length of the cursor image reset to the first value exceeds a threshold value; and detecting whether the first process works normally or not in response to the fact that the duration of resetting the cursor image to the first value exceeds a threshold value.
In yet another aspect of the embodiment of the present invention, there is also provided a computer apparatus, including: at least one processor; and a memory storing computer instructions executable on the processor, which when executed by the processor, perform the steps of the method as above.
In yet another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium storing a computer program which, when executed by a processor, implements the method steps as described above.
The invention has the following beneficial technical effects: by detecting whether the cursor image information is repeated or not, the characteristics of the cursor image information are indicated through the register cursor image repetition bit, the cursor image data transmitted by a network are reduced under the same cursor image information scene, the network transmission data are greatly reduced, the network bandwidth required by video image transmission is reduced, and the low delay and high fluency of video images in a KVM system are realized.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are necessary for the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention and that other embodiments may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of an embodiment of a method for transmitting cursor information according to the present invention;
FIG. 2 is a schematic diagram of a structure for transmitting cursor information;
FIG. 3 is a schematic diagram of an embodiment of a system for transmitting cursor information according to the present invention;
FIG. 4 is a schematic diagram of a hardware structure of an embodiment of a computer device for transmitting cursor information according to the present invention;
fig. 5 is a schematic diagram of an embodiment of a computer storage medium for transmitting cursor information according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention will be described in further detail with reference to the accompanying drawings.
It should be noted that, in the embodiments of the present invention, all the expressions "first" and "second" are used to distinguish two entities with the same name but different entities or different parameters, and it is noted that the "first" and "second" are only used for convenience of expression, and should not be construed as limiting the embodiments of the present invention, and the following embodiments are not described one by one.
In a first aspect of the embodiment of the present invention, an embodiment of a method for transmitting cursor information is provided. Fig. 1 is a schematic diagram of an embodiment of a method for transmitting cursor information according to the present invention. As shown in fig. 1, the embodiment of the present invention includes the following steps:
s1, acquiring a video image, and processing the video image to obtain cursor image data and cursor position data;
S2, creating a first process and a second process which are parallel, sequentially acquiring the cursor image data of each frame by using the first process, and sequentially acquiring the cursor position data of each frame by using the second process;
s3, comparing the cursor image data of the current frame with the cursor image data of the previous frame, and determining a value of resetting the cursor image according to the comparison result; and
And S4, transmitting corresponding cursor information to the remote terminal according to the reset numerical value of the cursor image.
In server remote management applications, both the mouse and the display are connected to the server via the internet, and video images of the local server are transmitted to the remote terminal via the network. When the mouse moves, the cursor moves along with the mouse at the remote terminal, and the local cursor information must keep the greatest synchronization with the mouse information, so as to keep the real-time accuracy of the video picture. The cursor information includes cursor image and cursor position information, fig. 2 shows a transmission block diagram of the cursor information, and the embodiment of the invention is mainly used for improving the content in the dashed line box in the figure.
VGA (Video GRAPHICS ARRAY ) is used for Video image processing. Video images are transmitted to the VGA through PCIE (PERIPHERAL COMPONENT INTERFACE EXPRESS, bus and interface standard) interfaces, the VGA processes (e.g., 2D accelerates, rotates, etc.) the video data, the VGA stores the video images and cursor image information in DDR (the DDR is a memory space unique to VGA display) respectively, and cursor position information is transmitted to JPEG (Joint Photographic Experts Group ) through the interfaces.
JPEG is mainly responsible for DCT (Discrete Cosine Transform ) based image compression of video images, and AXI master in JPG captures cursor image information in DDR, compares cursor image information of two adjacent frames, if the cursor image information of two adjacent frames is the same, the cursor image repetition position in a register is 1, and if the cursor image information of two adjacent frames is different, the cursor image repetition position in the register is 0.
The CPU reads the cursor position information and cursor image reset in the register, and decides the cursor information sent by the EMAC (Ethernet media access controller). The EMAC transmits the cursor information in the DDR to the remote terminal through the network, if the cursor image reset is 1, the EMAC only transmits the cursor position information in the DDR to the remote terminal through the network, and if the cursor image reset is 0, the EMAC transmits the cursor image information and the cursor position information in the DDR to the remote terminal through the network.
In the application process of remote management, the cursor image information is unchanged in most of time, namely, the cursor image information is repeatedly transmitted through the network, and the embodiment of the invention reduces the cursor image data transmitted by the network, greatly reduces the network transmission data, reduces the network bandwidth required by video image transmission, and realizes low delay and high fluency of video images in a KVM system by detecting whether the cursor image information is repeated or not and indicating the characteristics of the cursor image information through the repeated bits of the register cursor image.
The specific implementation manner of the embodiment of the invention can be as follows:
And acquiring a video image, and processing the video image to obtain cursor image data and cursor position data.
Creating a first process and a second process which are parallel, sequentially acquiring the cursor image data of each frame by using the first process, and sequentially acquiring the cursor position data of each frame by using the second process. Two parallel processes are created, and an AXI master in JPEG captures the first frame cursor image data in DDR, and simultaneously the AXI master captures the first frame cursor position data in DDR.
And comparing the cursor image data of the current frame with the cursor image data of the previous frame, and determining the reset value of the cursor image according to the comparison result. And the AXI master captures the cursor image data of the next frame in the DDR, and simultaneously, the AXI master captures the cursor position data of the next frame in the DDR in parallel. And comparing the captured cursor image data of two adjacent frames, and storing the cursor position data of parallel processes into a register.
In some embodiments, the determining the value of the cursor image reset according to the comparison result includes: judging whether the cursor image data of the current frame is equal to the cursor image data of the previous frame or not; setting the cursor image reset to a first value in response to the cursor image data of the current frame being equal to the cursor image data of the previous frame; and responsive to the current frame of cursor image data being unequal to the previous frame of cursor image data, resetting the cursor image to a second value. If the cursor image data of two adjacent frames are equal, i.e., the cursor image data is repeated, the cursor image data in the register is repeated at position 1. If the cursor image data of two adjacent frames are not equal, i.e., the cursor image data is repeated, the cursor image data in the register is reset to 0.
And transmitting corresponding cursor information to a remote terminal according to the reset value of the cursor image.
In some embodiments, the transmitting the corresponding cursor information to the remote terminal according to the value of the cursor image reset includes: responsive to the cursor image resetting to a first value, transmitting current frame cursor position data to a remote terminal; and responsive to the cursor image resetting to a second value, transmitting current frame cursor image data and current frame cursor position data to a remote terminal. If the cursor image data in the register is reset to 1, the CPU reads the cursor image reset and the cursor position register, and the EMAC only sends the cursor position information in DDR to the remote terminal through the network. If the cursor image data in the register is reset to 0, the CPU reads the cursor image reset and cursor position register, and the EMAC sends the cursor position information and the cursor image information in DDR to the remote terminal through the network.
In some embodiments, the method further comprises: monitoring the cursor image reset and judging whether the time length of the cursor image reset to the first value exceeds a threshold value; and detecting whether the first process works normally or not in response to the fact that the duration of resetting the cursor image to the first value exceeds a threshold value. In order to avoid the cursor image reset caused by the first process fault to be at the first value for a long time, therefore, when the duration that the cursor image repetition bit is at the first value exceeds the threshold value, whether the first process works normally needs to be detected.
According to the embodiment of the invention, whether the cursor image information is repeated or not is detected, the characteristics of the cursor image information are indicated through the register cursor image repetition bit, and the cursor image data transmitted by a network is reduced under the same cursor image information scene, so that the network transmission data is greatly reduced, the network bandwidth required by video image transmission is reduced, and the low delay and high fluency of video images in a KVM system are realized.
It should be noted that, in the embodiments of the method for transmitting cursor information, the steps may be intersected, replaced, added and subtracted, so that the method for transmitting cursor information by reasonable permutation and combination should also belong to the protection scope of the present invention, and the protection scope of the present invention should not be limited to the embodiments.
Based on the above object, a second aspect of the embodiments of the present invention provides a system for transmitting cursor information. As shown in fig. 3, the system 200 includes the following modules: the preprocessing module is configured to acquire a video image and process the video image to obtain cursor image data and cursor position data; the acquisition module is configured to create a first process and a second process which are parallel, acquire the cursor image data of each frame sequentially by using the first process, and acquire the cursor position data of each frame sequentially by using the second process; the comparison module is configured to compare the cursor image data of the current frame with the cursor image data of the previous frame, and determine the reset value of the cursor image according to the comparison result; and the transmission module is configured to transmit corresponding cursor information to a remote terminal according to the reset value of the cursor image.
In some embodiments, the comparison module is configured to: judging whether the cursor image data of the current frame is equal to the cursor image data of the previous frame or not; setting the cursor image reset to a first value in response to the cursor image data of the current frame being equal to the cursor image data of the previous frame; and responsive to the current frame of cursor image data being unequal to the previous frame of cursor image data, resetting the cursor image to a second value.
In some embodiments, the transmission module is configured to: responsive to the cursor image resetting to a first value, transmitting current frame cursor position data to a remote terminal; and responsive to the cursor image resetting to a second value, transmitting current frame cursor image data and current frame cursor position data to a remote terminal.
In some embodiments, the system further comprises a detection module configured to: monitoring the cursor image reset and judging whether the time length of the cursor image reset to the first value exceeds a threshold value; and detecting whether the first process works normally or not in response to the fact that the duration of resetting the cursor image to the first value exceeds a threshold value.
In view of the above object, a third aspect of the embodiments of the present invention provides a computer device, including: at least one processor; and a memory storing computer instructions executable on the processor, the instructions being executable by the processor to perform the steps of: s1, acquiring a video image, and processing the video image to obtain cursor image data and cursor position data; s2, creating a first process and a second process which are parallel, sequentially acquiring the cursor image data of each frame by using the first process, and sequentially acquiring the cursor position data of each frame by using the second process; s3, comparing the cursor image data of the current frame with the cursor image data of the previous frame, and determining a value of resetting the cursor image according to the comparison result; and S4, transmitting corresponding cursor information to a remote terminal according to the reset value of the cursor image.
In some embodiments, the determining the value of the cursor image reset according to the comparison result includes: judging whether the cursor image data of the current frame is equal to the cursor image data of the previous frame or not; setting the cursor image reset to a first value in response to the cursor image data of the current frame being equal to the cursor image data of the previous frame; and responsive to the current frame of cursor image data being unequal to the previous frame of cursor image data, resetting the cursor image to a second value.
In some embodiments, the transmitting the corresponding cursor information to the remote terminal according to the value of the cursor image reset includes: responsive to the cursor image resetting to a first value, transmitting current frame cursor position data to a remote terminal; and responsive to the cursor image resetting to a second value, transmitting current frame cursor image data and current frame cursor position data to a remote terminal.
In some embodiments, the steps further comprise: monitoring the cursor image reset and judging whether the time length of the cursor image reset to the first value exceeds a threshold value; and detecting whether the first process works normally or not in response to the fact that the duration of resetting the cursor image to the first value exceeds a threshold value.
Fig. 4 is a schematic hardware structure of an embodiment of the above-mentioned computer device for transmitting cursor information according to the present invention.
Taking the example of the apparatus shown in fig. 4, a processor 301 and a memory 302 are included in the apparatus.
The processor 301 and the memory 302 may be connected by a bus or otherwise, for example in fig. 4.
The memory 302 is used as a non-volatile computer readable storage medium for storing non-volatile software programs, non-volatile computer executable programs and modules, such as program instructions/modules corresponding to the method for transmitting cursor information in the embodiments of the present application. The processor 301 executes various functional applications of the server and data processing, i.e., implements a method of transmitting cursor information, by running nonvolatile software programs, instructions, and modules stored in the memory 302.
The method for transmitting the cursor information comprises the following steps: acquiring a video image, and processing the video image to obtain cursor image data and cursor position data; creating a first process and a second process which are parallel, sequentially acquiring the image data of each frame of cursor by using the first process, and sequentially acquiring the position data of each frame of cursor by using the second process; comparing the cursor image data of the current frame with the cursor image data of the previous frame, and determining the reset value of the cursor image according to the comparison result; and transmitting corresponding cursor information to a remote terminal according to the reset value of the cursor image.
In some embodiments, the determining the value of the cursor image reset according to the comparison result includes: judging whether the cursor image data of the current frame is equal to the cursor image data of the previous frame or not; setting the cursor image reset to a first value in response to the cursor image data of the current frame being equal to the cursor image data of the previous frame; and responsive to the current frame of cursor image data being unequal to the previous frame of cursor image data, resetting the cursor image to a second value.
In some embodiments, the transmitting the corresponding cursor information to the remote terminal according to the value of the cursor image reset includes: responsive to the cursor image resetting to a first value, transmitting current frame cursor position data to a remote terminal; and responsive to the cursor image resetting to a second value, transmitting current frame cursor image data and current frame cursor position data to a remote terminal.
In some embodiments, the method further comprises: monitoring the cursor image reset and judging whether the time length of the cursor image reset to the first value exceeds a threshold value; and detecting whether the first process works normally or not in response to the fact that the duration of resetting the cursor image to the first value exceeds a threshold value.
Memory 302 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store data created according to the use of a method of transmitting cursor information, and the like. In addition, memory 302 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 302 may optionally include memory located remotely from processor 301, which may be connected to the local module via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
Computer instructions 303 corresponding to one or more methods of transmitting cursor information are stored in memory 302 that, when executed by processor 301, perform the method of transmitting cursor information in any of the method embodiments described above.
Any one embodiment of a computer device that performs the above method for transmitting cursor information may achieve the same or similar effects as any one of the foregoing method embodiments corresponding thereto.
The present invention also provides a computer readable storage medium storing a computer program which when executed by a processor performs a method of transmitting cursor information.
Fig. 5 is a schematic diagram of an embodiment of the above-mentioned computer storage medium for transmitting cursor information according to the present invention. Taking a computer storage medium as shown in fig. 5 as an example, the computer readable storage medium 401 stores a computer program 402 that when executed by a processor performs the above method.
Finally, it should be noted that, as will be understood by those skilled in the art, all or part of the processes in the methods of the embodiments described above may be implemented by a computer program to instruct related hardware, and the program of the method for transmitting cursor information may be stored in a computer readable storage medium, where the program may include processes in the embodiments of the methods described above when executed. The storage medium of the program may be a magnetic disk, an optical disk, a read-only memory (ROM), a random-access memory (RAM), or the like. The computer program embodiments described above may achieve the same or similar effects as any of the method embodiments described above.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that as used herein, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
The foregoing embodiment of the present invention has been disclosed with reference to the number of embodiments for the purpose of description only, and does not represent the advantages or disadvantages of the embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program for instructing relevant hardware, and the program may be stored in a computer readable storage medium, where the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
Those of ordinary skill in the art will appreciate that: the above discussion of any embodiment is merely exemplary and is not intended to imply that the scope of the disclosure of embodiments of the invention, including the claims, is limited to such examples; combinations of features of the above embodiments or in different embodiments are also possible within the idea of an embodiment of the invention, and many other variations of the different aspects of the embodiments of the invention as described above exist, which are not provided in detail for the sake of brevity. Therefore, any omission, modification, equivalent replacement, improvement, etc. of the embodiments should be included in the protection scope of the embodiments of the present invention.
Claims (4)
1. A method of transmitting cursor information, comprising the steps of:
Acquiring a video image, and processing the video image to obtain cursor image data and cursor position data;
creating a first process and a second process which are parallel, sequentially acquiring the image data of each frame of cursor by using the first process, and sequentially acquiring the position data of each frame of cursor by using the second process;
comparing the cursor image data of the current frame with the cursor image data of the previous frame, and determining the reset value of the cursor image according to the comparison result; and
Transmitting corresponding cursor information to a remote terminal according to the reset value of the cursor image,
Wherein:
comparing the cursor image data of the current frame with the cursor image data of the previous frame, determining a value of the cursor image resetting according to the comparison result, and transmitting corresponding cursor information to a remote terminal according to the value of the cursor image resetting comprises:
Video image processing is carried out by adopting a video graphic array VGA, video images are transmitted to the VGA through a PCIE interface, video data are processed by the VGA, video images and cursor image information are respectively stored in the DDR through a DDR controller, and cursor position information is transmitted to JPEG through the interface;
JPEG is responsible for DCT-based image compression of video images, and AXI master in JPG captures cursor image information in DDR, compares cursor image information of two adjacent frames, if the cursor image information of two adjacent frames is the same, the cursor image repetition position in a register is 1, and if the cursor image information of two adjacent frames is different, the cursor image repetition position in the register is 0;
CPU reads the cursor position information and cursor image reset in the register, decides the cursor information sent by EMAC, the EMAC transmits the cursor information in DDR to the remote terminal through network, if the cursor image reset is 1, the EMAC only transmits the cursor position information in DDR to the remote terminal through network, if the cursor image reset is 0, the EMAC transmits the cursor image information and cursor position information in DDR to the remote terminal through network;
The method further comprises the steps of:
monitoring the cursor image reset and judging whether the time length of the cursor image reset to 1 exceeds a threshold value; and
And detecting whether the first process works normally or not in response to the fact that the time length of resetting the cursor image to 1 exceeds a threshold value.
2. A system for transmitting cursor information, comprising:
The preprocessing module is configured to acquire a video image and process the video image to obtain cursor image data and cursor position data;
The acquisition module is configured to create a first process and a second process which are parallel, acquire the cursor image data of each frame sequentially by using the first process, and acquire the cursor position data of each frame sequentially by using the second process;
The comparison module is configured to compare the cursor image data of the current frame with the cursor image data of the previous frame, and determine the reset value of the cursor image according to the comparison result; and
A transmission module configured to transmit corresponding cursor information to a remote terminal according to the value of the cursor image reset,
Wherein:
comparing the cursor image data of the current frame with the cursor image data of the previous frame, determining a value of the cursor image resetting according to the comparison result, and transmitting corresponding cursor information to a remote terminal according to the value of the cursor image resetting comprises:
Video image processing is carried out by adopting a video graphic array VGA, video images are transmitted to the VGA through a PCIE interface, video data are processed by the VGA, video images and cursor image information are respectively stored in the DDR through a DDR controller, and cursor position information is transmitted to JPEG through the interface;
JPEG is responsible for DCT-based image compression of video images, and AXI master in JPG captures cursor image information in DDR, compares cursor image information of two adjacent frames, if the cursor image information of two adjacent frames is the same, the cursor image repetition position in a register is 1, and if the cursor image information of two adjacent frames is different, the cursor image repetition position in the register is 0;
CPU reads the cursor position information and cursor image reset in the register, decides the cursor information sent by EMAC, the EMAC transmits the cursor information in DDR to the remote terminal through network, if the cursor image reset is 1, the EMAC only transmits the cursor position information in DDR to the remote terminal through network, if the cursor image reset is 0, the EMAC transmits the cursor image information and cursor position information in DDR to the remote terminal through network;
The system further comprises:
The detection module is configured to monitor the cursor image reset and judge whether the time length of the cursor image reset to 1 exceeds a threshold value; and detecting whether the first process works normally or not in response to the fact that the time length of resetting the cursor image to 1 exceeds a threshold value.
3. A computer device, comprising:
at least one processor; and
A memory storing computer instructions executable on the processor, which when executed by the processor, perform the steps of the method of claim 1.
4. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method of claim 1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110999563.6A CN113824962B (en) | 2021-08-29 | 2021-08-29 | Method, system, equipment and storage medium for transmitting cursor information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110999563.6A CN113824962B (en) | 2021-08-29 | 2021-08-29 | Method, system, equipment and storage medium for transmitting cursor information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113824962A CN113824962A (en) | 2021-12-21 |
| CN113824962B true CN113824962B (en) | 2024-05-14 |
Family
ID=78923220
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110999563.6A Active CN113824962B (en) | 2021-08-29 | 2021-08-29 | Method, system, equipment and storage medium for transmitting cursor information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113824962B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1901676A (en) * | 2005-07-19 | 2007-01-24 | 国际商业机器公司 | Streaming image system and method |
| JP2009116886A (en) * | 2008-12-01 | 2009-05-28 | Fujitsu Component Ltd | Image display method and image display program |
| CN102193738A (en) * | 2011-05-23 | 2011-09-21 | 广东欧珀电子工业有限公司 | Method for displaying virtual keyboard input of blue-ray player |
| CN102662500A (en) * | 2012-05-11 | 2012-09-12 | 重庆大学 | Method for controlling mouse pointer position based on multimedia projection system |
| JP2014137431A (en) * | 2013-01-16 | 2014-07-28 | Mitsubishi Electric Corp | Image display system |
| CN111143099A (en) * | 2019-11-09 | 2020-05-12 | 苏州浪潮智能科技有限公司 | BMC process monitoring method and device |
| CN111831135A (en) * | 2019-04-23 | 2020-10-27 | 凌华科技股份有限公司 | Mouse cursor image detection comparison and feedback state judgment method |
| CN112511839A (en) * | 2020-11-26 | 2021-03-16 | 山东云海国创云计算装备产业创新中心有限公司 | Video transmission control method, device, equipment and readable storage medium |
| CN112804532A (en) * | 2021-01-07 | 2021-05-14 | 苏州浪潮智能科技有限公司 | Image data acquisition method, system and related device |
| CN112948151A (en) * | 2021-04-13 | 2021-06-11 | 山东云海国创云计算装备产业创新中心有限公司 | Program interface image transmission method, substrate management controller and remote control equipment |
| CN113079379A (en) * | 2021-03-26 | 2021-07-06 | 山东英信计算机技术有限公司 | Video compression method, device, equipment and computer readable storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7683881B2 (en) * | 2004-05-24 | 2010-03-23 | Keytec, Inc. | Visual input pointing device for interactive display system |
| US8295617B2 (en) * | 2008-05-19 | 2012-10-23 | Citrix Systems, Inc. | Systems and methods for enhanced image encoding |
| US11114060B2 (en) * | 2019-08-08 | 2021-09-07 | Adlink Technology Inc. | Cursor image detection comparison and feedback status determination method |
-
2021
- 2021-08-29 CN CN202110999563.6A patent/CN113824962B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1901676A (en) * | 2005-07-19 | 2007-01-24 | 国际商业机器公司 | Streaming image system and method |
| JP2009116886A (en) * | 2008-12-01 | 2009-05-28 | Fujitsu Component Ltd | Image display method and image display program |
| CN102193738A (en) * | 2011-05-23 | 2011-09-21 | 广东欧珀电子工业有限公司 | Method for displaying virtual keyboard input of blue-ray player |
| CN102662500A (en) * | 2012-05-11 | 2012-09-12 | 重庆大学 | Method for controlling mouse pointer position based on multimedia projection system |
| JP2014137431A (en) * | 2013-01-16 | 2014-07-28 | Mitsubishi Electric Corp | Image display system |
| CN111831135A (en) * | 2019-04-23 | 2020-10-27 | 凌华科技股份有限公司 | Mouse cursor image detection comparison and feedback state judgment method |
| CN111143099A (en) * | 2019-11-09 | 2020-05-12 | 苏州浪潮智能科技有限公司 | BMC process monitoring method and device |
| CN112511839A (en) * | 2020-11-26 | 2021-03-16 | 山东云海国创云计算装备产业创新中心有限公司 | Video transmission control method, device, equipment and readable storage medium |
| CN112804532A (en) * | 2021-01-07 | 2021-05-14 | 苏州浪潮智能科技有限公司 | Image data acquisition method, system and related device |
| CN113079379A (en) * | 2021-03-26 | 2021-07-06 | 山东英信计算机技术有限公司 | Video compression method, device, equipment and computer readable storage medium |
| CN112948151A (en) * | 2021-04-13 | 2021-06-11 | 山东云海国创云计算装备产业创新中心有限公司 | Program interface image transmission method, substrate management controller and remote control equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113824962A (en) | 2021-12-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10957358B2 (en) | Reference and non-reference video quality evaluation | |
| CN111163345B (en) | Image rendering method and device | |
| CN110620959A (en) | Data processing method, device, electronic equipment, system and storage medium | |
| EP4054190A1 (en) | Video data encoding method and device, apparatus, and storage medium | |
| EP3410302B1 (en) | Graphic instruction data processing method, apparatus | |
| JP7186877B2 (en) | Video decoding control method, device, electronic device and storage medium | |
| CN113068040A (en) | Image compression method and device, electronic equipment and readable storage medium | |
| CN110166765B (en) | Screen-patterned detection method, electronic device and readable storage medium | |
| GB2560548A (en) | Video data processing system | |
| US20140314139A1 (en) | System and Method for Adaptive Bandwidth Management | |
| CN108600675B (en) | Channel path number expansion method, device, network video recorder and storage medium | |
| CN111091146B (en) | Picture similarity obtaining method and device, computer equipment and storage medium | |
| US20200120342A1 (en) | Motion adaptive encoding of video | |
| US20190103071A1 (en) | Frame drop processing method and system for played ppt | |
| CN113824962B (en) | Method, system, equipment and storage medium for transmitting cursor information | |
| TWI551149B (en) | Analytics assisted encoding | |
| CN107423187B (en) | Screen monitoring method, device and system | |
| CN111263113B (en) | Data packet sending method and device and data packet processing method and device | |
| US20200065979A1 (en) | Imaging system and method with motion detection | |
| WO2023024832A1 (en) | Data processing method and apparatus, computer device and storage medium | |
| CN116567246A (en) | AVC coding method and device | |
| CN108668166B (en) | Coding method, device and terminal equipment | |
| CN115643408A (en) | Image compression method, device, equipment and storage medium | |
| CN108574814B (en) | Data processing method and device | |
| CN112911299B (en) | Video code rate control method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |