CN109271077B - Thermal infrared imager man-machine interaction method based on FPGA - Google Patents
Thermal infrared imager man-machine interaction method based on FPGA Download PDFInfo
- Publication number
- CN109271077B CN109271077B CN201811075744.4A CN201811075744A CN109271077B CN 109271077 B CN109271077 B CN 109271077B CN 201811075744 A CN201811075744 A CN 201811075744A CN 109271077 B CN109271077 B CN 109271077B
- Authority
- CN
- China
- Prior art keywords
- menu
- coe
- key
- file
- generating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Abstract
The invention discloses a thermal infrared imager man-machine interaction method based on an FPGA (field programmable gate array). A low-gray-value pixel is adopted to construct a graph, the graph is stored in a ROM (read only memory) of the FPGA, the reading is controlled according to a time sequence signal, a part of pixel values of an acquired image are replaced, and then a gray difference is formed between the graph and a peripheral high-gray-value image, so that the manufacturing of a graphical interface is completed. The generation of a matrix of a complex character interface is simply completed, the matrix is solidified in a ROM, after a product is electrified, the matrix is output along with an image data stream, interactive interface display is realized by utilizing image and interface gray scale display, human eyes can visually read character information, and opening, closing, switching and determining of a thermal imager command menu are realized through seven keys.
Description
Technical Field
The invention relates to a thermal infrared imager man-machine interaction method, in particular to a thermal infrared imager man-machine interaction method based on an FPGA.
Background
The infrared refrigeration thermal imager is called a thermal imager for short, and the detector is stable in working state in a low-temperature environment, so that control instructions such as correction and the like need to be sent to the thermal imager before normal working. In addition, according to different use environments and targets, the thermal imager adopts gain parameters, brightness, internal and external synchronization, focal length and a plurality of application functions which need to be manually changed in real time. Therefore, the UI, User Interface, is an integral part of the thermal imager system.
Currently, there are two main methods for implementing UI design: one is to realize interface communication through peripheral interfaces of the computer, such as USB, serial ports and the like, and then send or receive control commands through upper computer software; the second is to realize human-computer interaction by expanding integrated chips, such as ARM, 51 and other series of single-chip microcomputers, in the system and calling interface and interface library functions. Because the first mode carries peripheral hardware more, be unfavorable for working for a long time in the environment that does not have lasting stable power supply condition, the second mode needs to expand resources on the system circuit board, increases system design complexity, is unfavorable for system reliability to increase research and development cost and consumption. The coe file is a common file that can be read by the FPGA.
Disclosure of Invention
The invention aims to provide a human-computer interaction method for a thermal infrared imager based on an FPGA (field programmable gate array), which solves the problems that the traditional method has more carried peripherals, is not favorable for working for a long time in an environment without lasting and stable power supply conditions, needs to expand resources on a system circuit board, increases the complexity of system design, is not favorable for system reliability, and increases the research and development cost and power consumption.
According to a first aspect of the invention, a thermal infrared imager man-machine interaction method based on an FPGA is provided, which comprises the following specific steps:
first step of building a human-computer interaction system
The human-computer interaction system comprises: the device comprises a key control module, a character module generating module and an coe file generating module.
The key control module has the functions as follows: and the movement of the highlight button of the interface is controlled through an external key, so that the man-machine interaction is realized.
The matrix generation module has the functions of: and generating a character font required by the highlighted interface button, and generating a txt file.
coe the file generation module functions as: the. coe file is generated for each line of text using matlab.
The second step is that the key control module controls the movement of the interface keys on the display interface
The key control module has seven key functions, and the key functions are as follows: open menu, close menu, confirm, move up, move down, move left, and move right. After the menu is opened, a corresponding input command is obtained through the key function, and then the selection of menu options is controlled, and the key function confirms that the corresponding control command is sent to the front end. After closing the menu, only the open menu responds. The direction key includes: moving up, moving down, moving left and moving right, and placing the highlight at the menu function key position corresponding to the control menu through the direction key.
Thirdly, generating a matrix file by a matrix generation module
The size of the whole frame image of the control menu is M x N pixels, the number of pixels occupied by a single word is a x b pixels, one frame image is divided into x y areas, each area displays one word, and the word module generation module generates 1 txt file from 1 area word.
M, N are the row and column of the whole frame image of the control menu; a. b is the row and column of the pixel occupied by the single word; x and y are the row number and column number of the region respectively. a x M, b y N.
The fourth step coe File Generation Module generates coe files
The. coe file for each line of text of the control menu is generated using matlab. The coe file generation module keeps the header format of the first coe file, concatenates all the district characters in a coe file, and finally generates a coe file for reading by the FPGA. The coe file is stored in the ROM, and the FPGA calls the data in the ROM after being electrified.
Therefore, the man-machine interaction of the thermal infrared imager based on the FPGA is completed.
Preferably, the size of the whole frame image of the control menu is: 640 x 512, 640 x 320, 512 x 240 or 512 x 512.
Preferably, when the size of the whole frame image of the control menu is 640 × 512 pixels, the number of pixels occupied by a single word is 16 × 32 pixels, and one frame image is divided into 40 × 16 zones.
According to a second aspect of the present invention, there is provided a human-computer interaction system comprising: the device comprises a key control module, a character module generating module and an coe file generating module.
The key control module has the functions as follows: and the movement of the highlight button of the interface is controlled through an external key, so that the man-machine interaction is realized.
The matrix generation module has the functions of: and generating a character font required by the highlighted interface button, and generating a txt file.
coe the file generation module functions as: the. coe file is generated for each line of text using matlab.
Because the real-time requirement of the thermal imager is high, the acquired image data is subjected to FPGA image preprocessing, then is transmitted to the communication interface in real time, is transmitted to the display or the upper computer, and is further processed according to subsequent requirements. Therefore, the creation of the human-computer interface is added to the data stream. The invention adopts the low-gray-scale value pixels to construct the graph, the graph is stored in the ROM of the FPGA, the reading is controlled according to the time sequence signal, the partial pixel values of the collected image are replaced, and then the gray difference is formed between the collected image and the peripheral high-gray-scale image, thereby completing the manufacture of the graphical interface. The invention utilizes the existing FPGA chip of the thermal imager system, writes the selectable operation interface on the output gray level image, utilizes 7 buttons to realize man-machine interaction, saves cost, reduces power consumption and does not increase the peripheral equipment of the system. The problem that more peripherals are needed or resources on a system circuit board are increased when the thermal imager is controlled is successfully solved. The verification proves that the method has the advantages of stable work, concise interface and convenient operation.
Detailed Description
Example 1
The thermal infrared imager man-machine interaction method based on the FPGA comprises the following specific steps:
first step of building a human-computer interaction system
The human-computer interaction system comprises: the device comprises a key control module, a character module generating module and an coe file generating module.
The key control module has the functions as follows: and the movement of the highlight button of the interface is controlled through an external key, so that the man-machine interaction is realized.
The matrix generation module has the functions of: and generating a character font required by the highlighted interface button, and generating a txt file.
coe the file generation module functions as: the. coe file is generated for each line of text using matlab.
The second step is that the key control module controls the movement of the interface keys on the display interface
The key control module has seven key functions, and the key functions are as follows: open menu, close menu, confirm, move up, move down, move left, and move right. After the menu is opened, a corresponding input command is obtained through the key function, and then the selection of menu options is controlled, and the key function confirms that the corresponding control command is sent to the front end. After closing the menu, only the open menu responds. The direction key includes: moving up, moving down, moving left and moving right, and placing the highlight at the menu function key position corresponding to the control menu through the direction key.
Thirdly, generating a matrix file by a matrix generation module
The size of the whole frame image of the control menu is M x N pixels, the number of pixels occupied by a single word is a x b pixels, one frame image is divided into x y areas, each area displays one word, and the word module generation module generates 1 txt file from 1 area word.
M, N are the row and column of the whole frame image of the control menu; a. b is the row and column of the pixel occupied by the single word; x and y are the row number and column number of the region respectively. a x M, b y N.
The size of the whole frame image of the control menu is as follows: 640 x 512, 640 x 320, 512 x 240 or 512 x 512.
When the size of the whole frame image of the control menu is 640 × 512 pixels, the number of pixels occupied by a single word is 16 × 32 pixels, and one frame image is divided into 40 × 16 areas.
The fourth step coe File Generation Module generates coe files
The. coe file for each line of text of the control menu is generated using matlab. The coe file generation module keeps the header format of the first coe file, concatenates all the district characters in a coe file, and finally generates a coe file for reading by the FPGA. The coe file is stored in the ROM, and the FPGA calls the data in the ROM after being electrified.
Therefore, the man-machine interaction of the thermal infrared imager based on the FPGA is completed.
Example 2
A human-computer interaction system includes: the device comprises a key control module, a character module generating module and an coe file generating module.
The key control module has the functions as follows: and the movement of the highlight button of the interface is controlled through an external key, so that the man-machine interaction is realized.
The matrix generation module has the functions of: and generating a character font required by the highlighted interface button, and generating a txt file.
coe the file generation module functions as: the matlab software was used to generate the coe file for each line of text.
Claims (2)
1. A thermal infrared imager man-machine interaction method based on FPGA is characterized by comprising the following specific steps:
first step of building a human-computer interaction system
The human-computer interaction system comprises: the device comprises a key control module, a character module generating module and an coe file generating module;
the key control module has the functions as follows: the movement of a highlight button of an interface is controlled through an external key to realize man-machine interaction;
the matrix generation module has the functions of: generating a character matrix required by a highlight button of an interface, and generating a txt file;
coe the file generation module functions as: generating coe files of each line of characters by matlab;
the second step is that the key control module controls the movement of the interface keys on the display interface
The key control module has seven key functions, and the key functions are as follows: open menu, close menu, confirm, move up, move down, move left and move right; after the menu is opened, a corresponding input command is obtained through a key function, so that the selection of menu options is controlled, and the key function confirms that the corresponding control command is sent to the front end; after closing the menu, only opening the menu response; the direction key includes: moving upwards, moving downwards, moving leftwards and rightwards, and placing the highlight at the position of the menu function key corresponding to the control menu through a direction key;
the size of the whole frame image of the control menu is as follows: 640 x 512, 640 x 320, 512 x 240 or 512 x 512; when the size of the whole frame image of the control menu is 640 × 512 pixels, the number of the pixels occupied by a single word is 16 × 32 pixels, and one frame image is divided into 40 × 16 areas;
thirdly, generating a matrix file by a matrix generation module
The size of the whole frame image of the control menu is M x N pixels, the number of pixels occupied by a single word is a x b pixels, one frame image is divided into x y areas, each area displays one word, and the word model generating module generates 1 txt file from 1 area word;
m, N are the row and column of the whole frame image of the control menu; a. b is the row and column of the pixel occupied by the single word; x and y are respectively the row number and the column number of the area; a x M, b y N;
the fourth step coe File Generation Module generates coe files
Coe files for generating each line of characters of the control menu by matlab; the coe file generating module reserves the head format of the first coe file, connects all the characters in a coe file, and finally generates a coe file for reading by the FPGA; the coe file is stored in the ROM, and the FPGA calls the data in the ROM after being electrified.
2. A human-computer interaction system, comprising: the device comprises a key control module, a character module generating module and an coe file generating module;
the key control module has the functions as follows: the movement of a highlight button of an interface is controlled through an external key to realize man-machine interaction;
the matrix generation module has the functions of: generating a character matrix required by a highlight button of an interface, and generating a txt file;
coe the file generation module functions as: generating coe files of each line of characters by matlab;
the key control module controls the movement of the interface keys on the display interface:
the key control module has seven key functions, and the key functions are as follows: open menu, close menu, confirm, move up, move down, move left and move right; after the menu is opened, a corresponding input command is obtained through a key function, so that the selection of menu options is controlled, and the key function confirms that the corresponding control command is sent to the front end; after closing the menu, only opening the menu response; the direction key includes: moving upwards, moving downwards, moving leftwards and rightwards, and placing the highlight at the position of the menu function key corresponding to the control menu through a direction key;
the size of the whole frame image of the control menu is as follows: 640 x 512, 640 x 320, 512 x 240 or 512 x 512; when the size of the whole frame image of the control menu is 640 × 512 pixels, the number of the pixels occupied by a single word is 16 × 32 pixels, and one frame image is divided into 40 × 16 areas;
the font generation module generates a font file:
the size of the whole frame image of the control menu is M x N pixels, the number of pixels occupied by a single word is a x b pixels, one frame image is divided into x y areas, each area displays one word, and the word model generating module generates 1 txt file from 1 area word;
m, N are the row and column of the whole frame image of the control menu; a. b is the row and column of the pixel occupied by the single word; x and y are respectively the row number and the column number of the area; a x M, b y N;
coe File Generation Module generates coe File:
coe files for generating each line of characters of the control menu by matlab; the coe file generating module reserves the head format of the first coe file, connects all the characters in a coe file, and finally generates a coe file for reading by the FPGA; the coe file is stored in the ROM, and the FPGA calls the data in the ROM after being electrified.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811075744.4A CN109271077B (en) | 2018-09-14 | 2018-09-14 | Thermal infrared imager man-machine interaction method based on FPGA |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811075744.4A CN109271077B (en) | 2018-09-14 | 2018-09-14 | Thermal infrared imager man-machine interaction method based on FPGA |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109271077A CN109271077A (en) | 2019-01-25 |
| CN109271077B true CN109271077B (en) | 2021-08-13 |
Family
ID=65188375
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811075744.4A Active CN109271077B (en) | 2018-09-14 | 2018-09-14 | Thermal infrared imager man-machine interaction method based on FPGA |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109271077B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202956192U (en) * | 2012-03-16 | 2013-05-29 | 东莞华仪仪表科技有限公司 | Device and system of intelligent thermal infrared imager |
| CN103747191A (en) * | 2014-01-27 | 2014-04-23 | 大连科迪视频技术有限公司 | Network interaction high-definition character superimposition system |
| CN105761233A (en) * | 2014-12-15 | 2016-07-13 | 南京理工大学 | FPGA-based real-time panoramic image mosaic method |
| CN205748663U (en) * | 2016-06-14 | 2016-11-30 | 上海集成电路研发中心有限公司 | A kind of Multifunction infrared thermal imagery instrument |
| US9843742B2 (en) * | 2009-03-02 | 2017-12-12 | Flir Systems, Inc. | Thermal image frame capture using de-aligned sensor array |
| CN107888848A (en) * | 2017-11-07 | 2018-04-06 | 哈尔滨工程大学 | The device and method of artistic font is superimposed on image based on FPGA |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8519979B1 (en) * | 2006-12-29 | 2013-08-27 | The Mathworks, Inc. | Multi-point interface for a graphical modeling environment |
| CN105187745A (en) * | 2015-08-30 | 2015-12-23 | 深圳市特力科信息技术有限公司 | High definition video OSD menu superposition module based on FPGA and method |
-
2018
- 2018-09-14 CN CN201811075744.4A patent/CN109271077B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9843742B2 (en) * | 2009-03-02 | 2017-12-12 | Flir Systems, Inc. | Thermal image frame capture using de-aligned sensor array |
| CN202956192U (en) * | 2012-03-16 | 2013-05-29 | 东莞华仪仪表科技有限公司 | Device and system of intelligent thermal infrared imager |
| CN103747191A (en) * | 2014-01-27 | 2014-04-23 | 大连科迪视频技术有限公司 | Network interaction high-definition character superimposition system |
| CN105761233A (en) * | 2014-12-15 | 2016-07-13 | 南京理工大学 | FPGA-based real-time panoramic image mosaic method |
| CN205748663U (en) * | 2016-06-14 | 2016-11-30 | 上海集成电路研发中心有限公司 | A kind of Multifunction infrared thermal imagery instrument |
| CN107888848A (en) * | 2017-11-07 | 2018-04-06 | 哈尔滨工程大学 | The device and method of artistic font is superimposed on image based on FPGA |
Non-Patent Citations (2)
| Title |
|---|
| A fast HW/SW FPGA-based thermal emulation framework for multi-processor system-on-chip;D. Atienza et al.;《2006 43rd ACM/IEEE Design Automation Conference》;20060911;618-623 * |
| 基于MATLAB GUI的非制冷红外热像仪串口通信设计;冯浩 等;《平顶山学院学报》;20151031;第30卷(第5期);37-40 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109271077A (en) | 2019-01-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106687889B (en) | Display portable text entry and editing | |
| KR20090014803A (en) | Method and apparatus for using osk by input device | |
| CN101276568A (en) | Control system and control method for display of display screen | |
| JP2012502344A (en) | Method system and software for providing an image sensor based human machine interface | |
| CN104615362A (en) | Touch device capable of realizing on the basis of sliding gesture switching program and method thereof | |
| CN111770369A (en) | Remote control method, device, storage medium and terminal | |
| CN109271077B (en) | Thermal infrared imager man-machine interaction method based on FPGA | |
| CN104123062A (en) | Information processing method and electronic device | |
| CN105630443B (en) | A kind of OSD display methods of kvm system | |
| US20150121284A1 (en) | Method for information processing and electronic apparatus thereof | |
| TW201627820A (en) | Multi-key input method and input device thereof | |
| CN102194402A (en) | Programmable device for graph control of light-emitting diode (LED) display screen | |
| CN108874037B (en) | Domestic notebook three-screen display system and method | |
| US6753927B2 (en) | Television interface for handheld calculator for enhanced television display | |
| CN115756161A (en) | Multi-modal interactive structure mechanics analysis method, system, computer equipment and medium | |
| JPH06102997A (en) | Pointing device | |
| CN112470103A (en) | Intelligent watch and interface control method thereof | |
| JP2009223532A (en) | Operation control method for icon interface | |
| CN102902534A (en) | Transparent OSD (Optical Scanning Device) software realization method | |
| JP2576091B2 (en) | Window organization display method | |
| CN104317475A (en) | Information processing method and electronic equipment | |
| CN113419640B (en) | Pressure sensing channel opening method and device and electronic equipment | |
| CN220553212U (en) | Port bridge simulation control platform | |
| CN103593057B (en) | Electronic device with input control program | |
| CN113759806B (en) | Control system of writing robot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |