CN113254388B - Human-computer interaction system and method, equipment and computer readable medium - Google Patents
Human-computer interaction system and method, equipment and computer readable medium Download PDFInfo
- Publication number
- CN113254388B CN113254388B CN202110602908.XA CN202110602908A CN113254388B CN 113254388 B CN113254388 B CN 113254388B CN 202110602908 A CN202110602908 A CN 202110602908A CN 113254388 B CN113254388 B CN 113254388B
- Authority
- CN
- China
- Prior art keywords
- menu
- human
- computer interaction
- dot matrix
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 64
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000012545 processing Methods 0.000 claims abstract description 34
- 238000003860 storage Methods 0.000 claims abstract description 28
- 239000011159 matrix material Substances 0.000 claims description 36
- 230000006870 function Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 6
- 230000004927 fusion Effects 0.000 claims description 5
- 230000003139 buffering effect Effects 0.000 claims description 2
- 238000012544 monitoring process Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 17
- 238000013461 design Methods 0.000 description 4
- 230000002093 peripheral effect Effects 0.000 description 4
- 230000010287 polarization Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000003068 static effect Effects 0.000 description 3
- 239000003086 colorant Substances 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000002349 favourable effect Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 238000005096 rolling process Methods 0.000 description 2
- 101001106432 Homo sapiens Rod outer segment membrane protein 1 Proteins 0.000 description 1
- 102100021424 Rod outer segment membrane protein 1 Human genes 0.000 description 1
- 101100524639 Toxoplasma gondii ROM3 gene Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F15/00—Digital computers in general; Data processing equipment in general
- G06F15/76—Architectures of general purpose stored program computers
- G06F15/78—Architectures of general purpose stored program computers comprising a single central processing unit
- G06F15/7807—System on chip, i.e. computer system on a single chip; System in package, i.e. computer system on one or more chips in a single package
- G06F15/781—On-chip cache; Off-chip memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
- G06F1/3265—Power saving in display device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
Abstract
The invention provides a human-computer interaction system, comprising: the system comprises an FPGA processor, a display subsystem and a sensing subsystem, wherein the sensing subsystem is used for observing the specific direction and position of an acquired target, and the information acquired by observation is processed by the FPGA processor and then presented on the display subsystem. The FPGA processor comprises a programmable logic unit and a CPU processing unit, and the sensing subsystem comprises a sensor detector; the CPU processing unit is used for configuring an IIC register of the sensor detector; and the programmable logic unit is used for acquiring the data stream output by the sensor detector and processing image information. The invention also provides a man-machine interaction method, equipment and a medium. According to the invention, the Menu IP module is arranged in the programmable logic unit, so that parameters can be flexibly configured, the storage space is saved, and the refresh display frame rate can be flexibly adjusted.
Description
Technical Field
The invention relates to the technical field of human-computer interaction, in particular to a human-computer interaction system, a human-computer interaction method, human-computer interaction equipment and a computer readable medium.
Background
With the great popularization of thermal infrared imagers, the temperature measuring device is widely applied to various industries, especially consumer-grade markets such as handheld temperature measuring, sightseeing instruments, head-wearing infrared temperature measuring, night sightseeing instruments and the like. These sightseeing instruments require portability, miniaturization, low power consumption, low cost, high performance, excellent user experience, and the like. A User Interface (UI) is important under such a precondition.
At present, there are two mainstream methods for implementing UI design, one is to implement interface communication through a peripheral interface of a computer, such as a USB, a serial port, etc., and then send or receive a control command through upper software; the other method is to realize human-computer interaction by expanding integrated chips, such as ARM, 51 and other series of single-chip microcomputers, in the system and calling interface and interface library functions. However, the first mode carries more peripherals, which is not favorable for working for a long time in an environment without a lasting and stable power supply condition, and the second mode needs to expand resources on a system circuit board, increases the complexity of system design, is not favorable for system reliability, and increases the research and development cost and power consumption.
Therefore, the method for realizing human and interaction inside the existing FPGA chip is a good choice, but the algorithm is very tense after the bottom layer image algorithm is laid out by the existing FPGA hardware resources, and is difficult to finish excellent user experience.
Through retrieval, patent document CN109271077A discloses a thermal infrared imager man-machine interaction method based on FPGA, which adopts low-gray-value pixels to construct a graph, stores the graph in ROM of FPGA, controls reading according to a time sequence signal, replaces part of pixel values of an acquired image, further forms gray difference with a peripheral high-gray-level image, and completes the manufacturing of a graphical interface. The prior art has the following defects: firstly, parameters cannot be flexibly configured, characters can only be printed in a fixed position area, the types of the characters or icons cannot be flexibly switched at random positions, gray level adjustment and pseudo color mixing cannot be performed on the characters or the icons, and man-machine interaction control is inconvenient. Secondly, the storage space cannot be saved, and under the condition of limited on-chip storage resources of the FPGA, the storage and display of the circular dial icons such as the level, the pitch angle and the rolling angle of the electronic compass are difficult. Thirdly, the frame rate of the refreshed display cannot be flexibly adjusted, and the refreshed display frame rate can only be completely synchronized with the time sequence signal of the acquired image, and the frame rate of the time sequence signal of the image data is usually higher, so that the display frame rate of the image interface is higher. When the refresh characters of the whole image area are many, character refresh is difficult.
Patent document CN109815784A discloses an intelligent classification method, system and storage medium based on thermal infrared imager, which includes: a second polarization processing step, namely acquiring infrared original bare data, counting a contour pixel point set of each target object, and obtaining the polarization data corresponding to the dynamic target object and the polarization data corresponding to the static target object through mapping and polarization operation; comparing the template library, namely comparing the polarized data corresponding to the dynamic target object with the dynamic detection template library and judging the type of the target object; and comparing the polarized data corresponding to the static target object with the static detection template library to judge the type of the target object. This prior art has the disadvantage of solving only the problem of recognition and classification, but still does not solve the problem of improving human-computer interaction as a whole.
Therefore, it is necessary to develop and design a method and a system capable of improving the human-computer interaction performance of the existing FPGA chip.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide a human-computer interaction system, a human-computer interaction method, human-computer interaction equipment and a computer readable medium, which can improve the human-computer interaction performance of the traditional application FPGA chip.
The invention provides a man-machine interaction system, which comprises: the system comprises an FPGA processor, a display subsystem and a sensing subsystem, wherein the sensing subsystem is used for observing the specific direction and position of an acquired target, and the information acquired by observation is processed by the FPGA processor and then displayed on the display subsystem.
Preferably, the FPGA processor comprises a programmable logic unit and a CPU processing unit, and the sensing subsystem comprises a sensor detector; the CPU processing unit is used for configuring an IIC register of the sensor detector; the programmable logic unit is used for collecting data flow output by the sensor detector and processing image information.
Preferably, the CPU processing unit includes an SDRAM memory for buffering the image information after processing; the display subsystem comprises an OLED display, and the OLED display is used for displaying the cached image information according to the time sequence of the OLED display.
Preferably, the programmable logic unit comprises a Menu IP module, and the Menu dot matrix is printed in an SDRAM memory of the CPU processing unit by using the Menu IP module and displayed on the OLED display according to the timing sequence of the OLED display.
Preferably, the CPU processing unit receives key information of the matrix key, decodes the key information to generate a key instruction, and calls different menu dot matrix printing functions according to different key instructions.
Preferably, the menu lattice comprises a character lattice set and an icon lattice set, wherein the character lattice set comprises English capital and small case letters, numbers and punctuation marks; each icon in the icon dot matrix set is a dot matrix set represented by 1 bit, 0 represents that the pixel point has no value and is a background, and 1 represents that the pixel point has a value and is a foreground.
Preferably, the Menu IP module includes a controller module, and the controller module is configured to monitor the index range and the specific index value, perform character dot matrix printing when the index value is smaller than a set threshold, and perform icon dot matrix printing when the index value is larger than the set threshold and is within the index range.
According to the human-computer interaction method provided by the invention, the human-computer interaction system is used for human-computer interaction.
According to the present invention, a computer-readable storage medium is provided, in which a computer program is stored, which, when being executed by a processor, carries out the above-mentioned method steps.
According to the invention, the human-computer interaction device comprises the human-computer interaction system or the computer-readable storage medium storing the computer program.
Compared with the prior art, the invention has the following beneficial effects:
1. according to the invention, the human-computer interaction performance of the existing FPGA chip can be improved by improving the FPGA processor.
2. According to the invention, under the condition of limited on-chip storage resources of the FPGA processor, the menu pixel points represent the menu icons by using the 1-bit bitmap, a large amount of on-chip storage space is saved in a back-end pseudo-color toning display mode, the types and the number of the stored icons and the menu elements are maximized under the condition of least storage space consumption, and the display of man-machine interaction information content is enriched.
3. The invention further optimizes the storage space and improves the performance of the effect for storing and displaying the circular-arc dial icons and the cross division line scale icons of the electronic compass course, the pitch angle, the rolling angle and the like, and provides higher and more effective performance for realizing the whole system on the FPGA processor hardware platform.
4. The invention is configured to print menu elements such as characters, icons and the like in any position area on the image, can switch the types of the characters or the icons, and can adjust the gray level and perform pseudo-color toning on the characters or the icons so as to achieve flexible configuration parameters and facilitate the human-computer interaction control.
5. Compared with a CPU (central processing unit) processing unit, the method for printing the tracing points directly by utilizing the logic of the FPGA processor has the advantages that the speed is higher, more characters or icons are printed and refreshed in the same time interval, the display content is richer, and the human-computer interaction experience is better.
6. The invention reduces the refreshing display speed of the Menu layer as much as possible while meeting the real-time refreshing effect, thus reducing the read-write times of the Menu IP module to the SDRAM, further reducing the power consumption of the infrared sighting device, flexibly adjusting the refreshing display frame rate and effectively improving the efficiency of the whole system.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
FIG. 1 is a block diagram of a human-computer interaction system of the present invention;
FIG. 2 is a configuration block diagram of a Menu IP module in the human-computer interaction system of the present invention;
FIG. 3 is a schematic diagram of a character lattice storage format in the human-computer interaction system of the present invention;
FIG. 4 is a schematic diagram of a storage format of an icon lattice in the human-computer interaction system of the present invention;
FIG. 5 is a schematic diagram illustrating the packaging of IOWR functions in the human-computer interaction system of the present invention;
FIG. 6 is a configuration block diagram of a controller module in the human-computer interaction system of the present invention;
FIG. 7 is a schematic diagram of a method for representing pitch angle and roll angle in the human-computer interaction system of the present invention;
FIG. 8 is a schematic diagram of a method for identifying a course angle in a human-computer interaction system according to the present invention;
FIG. 9 is a schematic diagram illustrating a storage management manner conversion of a cross-shaped division line in the human-computer interaction system according to the present invention;
FIG. 10 is a schematic diagram of pseudo-color toning of a menu in the human-computer interaction system according to the present invention;
FIG. 11 is a schematic diagram illustrating a first layer fusion in the human-computer interaction system according to the present invention;
fig. 12 is a schematic diagram illustrating fusion of a second layer in the human-computer interaction system according to the present invention.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will aid those skilled in the art in further understanding the present invention, but are not intended to limit the invention in any manner. It should be noted that it would be obvious to those skilled in the art that various changes and modifications can be made without departing from the spirit of the invention. All falling within the scope of the present invention.
As shown in fig. 1, the present invention provides a human-computer interaction system, comprising: the system comprises an FPGA processor, a display subsystem and a sensing subsystem, wherein the sensing subsystem is used for observing the specific direction and position of an acquired target, and the information acquired by observation is processed by the FPGA processor and then displayed on the display subsystem. The invention is designed based on a miniaturized, low-power-consumption and low-cost FPGA processor platform.
The FPGA processor comprises a programmable logic unit and a CPU processing unit, wherein the CPU processing unit adopts an embedded NIOSII CPU processing unit. The sensing subsystem comprises a sensor detector; the CPU processing unit is used for configuring an IIC register of the sensor detector; the programmable logic unit is used for collecting data streams output by the sensor detector and processing image information. The CPU processing unit comprises an SDRAM memory, the SDRAM memory is used for caching the processed image information and completing the corresponding ISP image processing algorithm, and the processed image data is written into the SDRAM memory for caching; the display subsystem comprises an OLED display, and the OLED display is used for displaying the cached image information according to the time sequence of the OLED display. Meanwhile, the CPU processor unit receives the key information of the input interface of the user, converts the received key information into a control instruction, and controls the state of the human-computer interaction system and the updating and adjustment of the user interface display information on the OLED display.
The user interface information on the OLED display in the man-machine interaction system comprises the heading angle, the pitch angle, the roll angle, various cross division lines, time, battery icons, laser ranging icons, WIFI icons, image modes, main menus, submenus, prompt messages and other display information of an electronic compass, characters, character strings, icons, cross division lines and the like which are suspended on an image layer are collectively called menu layers, and menu data which is the same as the image data is called menu lattices by one pixel point to depict specific characters or icon shapes. When each frame of image is output, the menu data is output at the same time, the menu content lattices are many, the external state information such as the heading angle, the pitch angle and the roll angle of a compass is updated in real time according to the spatial position of the human-computer interaction system, and the updating speed is high. According to the traditional method, the menu dot matrix is printed and updated in the single chip microcomputer or the low-end CPU processing unit, so that the requirement on real-time performance is difficult to meet, the number of peripheral devices is large, and the updating speed is high, so that the menu dot matrix is difficult to refresh.
As shown in fig. 2, the programmable logic unit in the man-machine interaction system of the present invention includes a Menu IP module, and the Menu IP module is used to complete the Menu dot matrix printing in the SDRAM memory and display on the OLED display according to the timing sequence of the OLED display. And the CPU processing unit receives the key information of the matrix keys, decodes the key information to generate a key instruction, and calls different menu dot matrix printing functions according to different key instructions. The menu lattice comprises a character lattice set and an icon lattice set, wherein the character lattice set adopts a character lattice printing function WriteStr (x, y, str, length, mode), the character lattice set is ASCII codes such as English capital letters, numbers, punctuation marks and the like, the width and the height of each character lattice are initially set, the width is 16 multiplied by the height, the storage space occupied by 96 ASCII codes can be displayed and is 96 multiplied by 2 multiplied by 20 which is 3840 bytes, and the ASCII code character lattice set is stored in a memory in a ROM1 chip. The icon lattice set adopts an icon lattice printing function WriteIC (x, y, index, mode), is in a graphic shape with specific meanings, such as a heading angle, a pitch angle, a roll angle, various cross division lines, time, a battery icon, a laser ranging icon, a WIFI icon and the like of an electronic compass, and the icons are different in size, different in position and different in color under different states.
As shown in fig. 3 and 4, the storage format schematic diagrams of the character dot matrix and the icon dot matrix are shown, in the icon dot matrix set of the present invention, each icon is a dot matrix set represented by 1 bit, 0 represents that the pixel point has no value and is a background, and 1 represents that the pixel point has a value and is a foreground. So that the storage space occupied by each icon is also minimal. Meanwhile, the icon dot matrix set is divided into 2 parts for storage, the first part stores all icon dot matrix set data in a ROM3, and the second part stores an index table of each icon, including an address pointing to the storage of each icon and width and height information, and stores the index table in a ROM 2. The character dot matrix printing function WriteStr (x, y, str, length, mode) inputs coordinates x, y, the content, length, and display color mode of the character. The coordinates x, y indicate that it is possible to print at an arbitrary position of the image, the character content is arbitrary ASCII code characters, and foreground color, background color, and the like can be set according to the color mode. The icon dot matrix printing function WriteIC (x, y, index, mode) can input x, y coordinates and an icon index, load corresponding icons according to the index, and set the values of foreground colors and background colors of the icons according to the color mode.
As shown in the packaging diagram of the IOWR function in fig. 5, loading the IOWR function in the two print functions encapsulates and transmits information such as x, y coordinates, characters, icon indexes, color modes and the like of the design input to the dual-port RAM of the Menu IP module for storage. As shown in a schematic structural diagram of a controller module in fig. 6, packaged information is referred to as instruction information, the instruction information is stored in a dual-port RAM of a Menu IP module, after the controller module in the Menu IP module monitors the instruction information in the dual-port RAM, the instruction value is read out according to an index range (in the present invention, 8 bits represent 0 to 255) and a specific index value, a specific Menu dot matrix printing process is started, if the index value is less than 96, character dot matrix printing is performed, if the index value is greater than 96 and less than 255, a Menu dot matrix data stream is sequentially output in a row and column direction, the data stream is a clock domain of a CPU processing unit, a bridge of a mm clock cross bridge is externally hung, the Menu data stream of the clock domain of the CPU processing unit is transferred to a Menu data stream of a clock domain of an SDRAM memory, and is written into the SDRAM memory.
The electronic compass is an important sensor in a man-machine interaction system, is used for observing and aiming at a relatively local heading angle yaw, pitch angle pitch and roll angle of a target, and can accurately know the specific direction and position of the target by assisting laser ranging. The three angles are updated in real time according to the position posture of the human-computer interaction system, the corresponding menu icon is updated once each time, the range of the course angle yaw is 0-360 degrees, the range of the pitch angle pitch is 0-180 degrees, and the range of the roll angle is 0-180 degrees, if one icon and scale number are updated correspondingly according to the change of each degree, the number of the needed icons is huge, the storage space of the icons needing to be stored is also huge, and the method is difficult to realize on the FPGA processor with the advantages of miniaturization, low power consumption and low cost. In order to save storage space, icons corresponding to angles of three dimensions of an electronic compass are simplified, the characteristics of a compass angle scale are combined, every ten small scales are circularly represented by one large scale, and only corresponding numerical values on the scale are different. Therefore, 10 icons are designed for the pitch angle icon and the roll angle icon respectively, and the 10 icons correspond to the 0-9 scale states respectively.
As shown in FIG. 7, the pitch angle and roll angle representation method calls an icon corresponding to 0-9 scales for each update of the pitch angle or roll angle, and the numerical value of the scale is calculated, updated and displayed in the software code according to the position of the coordinate. And a complete compass dial is formed continuously. As shown in fig. 8, the heading angle represents the schematic azimuth of south, east, west and north, and the specific azimuth of the heading angle can be represented by switching an icon every 15 degrees and then printing the numerical value of the specific heading angle below the icon. The cross division line is also an aiming scale mark necessary in the observing and aiming equipment, and the division lines stored in the equipment are more in types and larger in size. In combination with the characteristics of the cross dividing line, in order to save space in the invention, for example, as shown in fig. 9, the storage management method of the cross dividing line converts a large cross dividing line into two horizontal and vertical effective scale lines, and then calls the two effective scale lines for 2 times in the CPU processing unit to respectively print and display the horizontal and vertical scale lines.
The more humanized and rich menu needs different color mode representation, different color representation or color mode setting is carried out in different states, and better user experience can be brought. In the scheme, in order to save storage space, color information of a Menu dot matrix is not stored in advance, when the Menu dot matrix is displayed at the rear end, Menu data streams printed with different gray values are subjected to table lookup according to a set color mode to obtain corresponding Menu data containing chroma information, and then rear-end layer data fusion is performed, as shown in fig. 10, a Menu pseudo-color toning schematic diagram is shown, a pseudo-color toning process of a Menu is similar to a pseudo-color toning process of an image, a lookup table with different color components is deployed in a module, an input address of the lookup table is the gray value of the Menu printed and output by a Menu IP module, different gray values correspond to different entry addresses, and a data stream YUV format of the corresponding color component is found. As shown in fig. 11 and fig. 12, which are schematic diagrams of layer fusion, an image data stream Y8 forms two data stream layers after pseudo color toning with a menu data stream, and then the layers are fused and finally output and displayed on an OLED display, which shows a visual effect that a menu interface is suspended on a video image.
According to the human-computer interaction method provided by the invention, the human-computer interaction system is used for human-computer interaction.
According to the present invention, a computer-readable storage medium is provided, in which a computer program is stored, which, when being executed by a processor, carries out the above-mentioned method steps.
According to the invention, the human-computer interaction device comprises the human-computer interaction system or the computer-readable storage medium storing the computer program.
In the invention, the display refreshing speed of the Menu layer can be set in the CPU code, and the display refreshing speed of the Menu layer is reduced as much as possible while the real-time refreshing effect is satisfied, so that the read-write times of the Menu IP module to the SDRAM can be reduced, the power consumption of the man-machine interaction equipment is reduced, and the working time of the battery of the man-machine interaction equipment is prolonged. The method comprises the steps of setting a code of a CPU (Central processing Unit) according to a multiple of a frame period at regular time, such as 40ms,80ms,120ms and the like, calling WriteSt and WritePic functions once or for multiple times to print and output a frame of Menu layer, designing and arranging any position, pre-stored icons and color modes on the Menu layer of each frame, and sequentially printing and pseudo-color-toning dot matrix information by a Menu _ ip module at the bottom layer according to received instruction information and outputting the dot matrix information on an OLED display screen to achieve rich Menu interface information display and good man-machine interaction operation experience.
Those skilled in the art will appreciate that, in addition to implementing the system and its various devices, modules, units provided by the present invention as pure computer readable program code, the system and its various devices, modules, units provided by the present invention can be fully implemented by logically programming method steps in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Therefore, the system and various devices, modules and units thereof provided by the invention can be regarded as a hardware component, and the devices, modules and units included in the system for realizing various functions can also be regarded as structures in the hardware component; means, modules, units for performing the various functions may also be regarded as structures within both software modules and hardware components for performing the method.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes or modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention. The embodiments and features of the embodiments of the present application may be combined with each other arbitrarily without conflict.
Claims (7)
1. A human-computer interaction system, comprising: the system comprises an FPGA processor, a display subsystem and a sensing subsystem, wherein the sensing subsystem is used for observing and acquiring the specific direction and position of a target, and the FPGA processor is used for processing the information acquired by observation and then displaying the information in the display subsystem;
the FPGA processor comprises a programmable logic unit and a CPU processing unit, and the sensing subsystem comprises a sensor detector;
the CPU processing unit is used for configuring an IIC register of the sensor detector;
the programmable logic unit is used for acquiring data streams output by the sensor detector and processing image information;
the programmable logic unit comprises a Menu IP module, the Menu IP module is used for completing Menu dot matrix printing in an SDRAM memory of the CPU processing unit, and the Menu dot matrix is displayed on the OLED display according to the time sequence of the OLED display;
the color information of the dot matrix is not stored in advance, when the color information is displayed at the rear end, the menu data streams printed with different gray values are subjected to table lookup according to a set color mode to obtain corresponding menu data containing the chromaticity information, and then the rear-end layer data fusion is carried out to output the menu data on an OLED display screen;
the Menu IP module comprises a controller module, wherein the controller module is used for monitoring an index range and a specific index value, performing character dot matrix printing when the index value is smaller than a set threshold value, and performing icon dot matrix printing when the index value is larger than the set threshold value and is within the index range.
2. The human-computer interaction system of claim 1, wherein the CPU processing unit comprises an SDRAM memory for buffering image information after processing;
the display subsystem comprises an OLED display, and the OLED display is used for displaying the cached image information according to the time sequence of the OLED display.
3. The human-computer interaction system of claim 1, wherein the CPU processing unit receives key information of the matrix keys, decodes the key information to generate a key instruction, and calls different menu dot matrix printing functions according to different key instructions.
4. A human-computer interaction system according to any one of claims 1 or 3, wherein the menu lattice comprises a character lattice set and an icon lattice set, wherein the character lattice set comprises upper and lower case letters, numbers and punctuation marks in English; each icon in the icon dot matrix set is a dot matrix set represented by 1 bit, 0 represents that the pixel point has no value and is a background, and 1 represents that the pixel point has a value and is a foreground.
5. A human-computer interaction method, characterized in that, the human-computer interaction system of any one of claims 1-4 is used for human-computer interaction.
6. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method as claimed in claim 5.
7. A human-computer interaction device, characterized by comprising a human-computer interaction system as claimed in any one of claims 1 to 4 or a computer-readable storage medium as claimed in claim 6 having a computer program stored thereon.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110602908.XA CN113254388B (en) | 2021-05-31 | 2021-05-31 | Human-computer interaction system and method, equipment and computer readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110602908.XA CN113254388B (en) | 2021-05-31 | 2021-05-31 | Human-computer interaction system and method, equipment and computer readable medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113254388A CN113254388A (en) | 2021-08-13 |
| CN113254388B true CN113254388B (en) | 2022-09-30 |
Family
ID=77185540
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110602908.XA Active CN113254388B (en) | 2021-05-31 | 2021-05-31 | Human-computer interaction system and method, equipment and computer readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113254388B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1713264A (en) * | 2005-07-15 | 2005-12-28 | 合肥工业大学 | Digital OSD controller based on FRGA |
| CN107155074A (en) * | 2017-05-17 | 2017-09-12 | 威创集团股份有限公司 | Video Character Superpose method and system |
| CN108259797A (en) * | 2018-01-09 | 2018-07-06 | 武汉精测电子集团股份有限公司 | A kind of method and device that character adding is carried out to image |
| CN110413173A (en) * | 2018-04-28 | 2019-11-05 | 中国科学院沈阳自动化研究所 | A kind of human-computer interaction device of Infrared Imaging Track Systems |
| CN110798632A (en) * | 2019-11-28 | 2020-02-14 | 苏州长风航空电子有限公司 | OSD menu realization method based on FPGA |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111435978A (en) * | 2018-12-26 | 2020-07-21 | 杭州海康威视数字技术股份有限公司 | OSD (on screen display) superposing method and device and electronic equipment |
-
2021
- 2021-05-31 CN CN202110602908.XA patent/CN113254388B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1713264A (en) * | 2005-07-15 | 2005-12-28 | 合肥工业大学 | Digital OSD controller based on FRGA |
| CN107155074A (en) * | 2017-05-17 | 2017-09-12 | 威创集团股份有限公司 | Video Character Superpose method and system |
| CN108259797A (en) * | 2018-01-09 | 2018-07-06 | 武汉精测电子集团股份有限公司 | A kind of method and device that character adding is carried out to image |
| CN110413173A (en) * | 2018-04-28 | 2019-11-05 | 中国科学院沈阳自动化研究所 | A kind of human-computer interaction device of Infrared Imaging Track Systems |
| CN110798632A (en) * | 2019-11-28 | 2020-02-14 | 苏州长风航空电子有限公司 | OSD menu realization method based on FPGA |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113254388A (en) | 2021-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10915070B2 (en) | Image display apparatus, image display method and storage medium | |
| CN111476780B (en) | Image detection method and device, electronic equipment and storage medium | |
| CN108053381B (en) | Dynamic tone mapping method, mobile terminal and computer-readable storage medium | |
| JP6730325B2 (en) | Terminal switching display method and terminal | |
| CN110689862B (en) | Screen brightness adjusting method and mobile terminal | |
| US8471870B2 (en) | Vector-based magnified pointer | |
| CN113254388B (en) | Human-computer interaction system and method, equipment and computer readable medium | |
| CN112114919A (en) | Screen rotation display optimization method and device | |
| JP4175234B2 (en) | Display control apparatus, portable information terminal, and display control method | |
| JP2005114958A5 (en) | ||
| CN111580728B (en) | Method and device for dynamically plotting multiple military standard types based on state mode | |
| CN104142415B (en) | The oscillograph of displaying picture | |
| US10580111B2 (en) | Display ink rendering during system sleep | |
| CN112882561A (en) | Display control method, storage medium, and electronic device | |
| US20150123974A1 (en) | Visualization Method Of Entire Grid Data Of Numerical Weather Prediction Model Having Ultra-High Grid Resolution By Magnification Mode And Hardware Device Performing The Same | |
| CN113744122B (en) | Multi-layer display coprocessor for SVDU of nuclear power plant | |
| CN113051084B (en) | Display control method and device, storage medium and electronic equipment | |
| CN109143628B (en) | Device and method for displaying flicker and Vcom values in real time on liquid crystal module | |
| CN115576513A (en) | Target image display method, display device, electronic device, and storage medium | |
| CN117710185A (en) | Image processing device, method, chip, electronic device, and readable storage medium | |
| CN117666814A (en) | Character display method and device for single-color screen, electronic equipment and storage medium | |
| CN112612564A (en) | Interface display method, device, equipment and medium | |
| KR100768852B1 (en) | Display apparatus for graphic data in mobile communication terminal | |
| CN117251081A (en) | Method, apparatus, computer device and storage medium for detecting picked-up object | |
| CN111068321A (en) | Block generation method and device applied to Russian block game |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Human-computer interaction systems and methods, equipment, and computer-readable media Effective date of registration: 20230320 Granted publication date: 20220930 Pledgee: Zhejiang Tailong Commercial Bank Co.,Ltd. Shanghai Zhabei sub branch Pledgor: Shanghai hot core vision technology Co.,Ltd. Registration number: Y2023310000074 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Granted publication date: 20220930 Pledgee: Zhejiang Tailong Commercial Bank Co.,Ltd. Shanghai Zhabei sub branch Pledgor: Shanghai hot core vision technology Co.,Ltd. Registration number: Y2023310000074 |