CN109271077B - A Human-Computer Interaction Method of Infrared Thermal Imager Based on FPGA - Google Patents
A Human-Computer Interaction Method of Infrared Thermal Imager Based on FPGA Download PDFInfo
- Publication number
- CN109271077B CN109271077B CN201811075744.4A CN201811075744A CN109271077B CN 109271077 B CN109271077 B CN 109271077B CN 201811075744 A CN201811075744 A CN 201811075744A CN 109271077 B CN109271077 B CN 109271077B
- Authority
- CN
- China
- Prior art keywords
- menu
- coe
- key
- file
- generating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 28
- 238000000034 method Methods 0.000 title claims abstract description 12
- 239000011159 matrix material Substances 0.000 claims description 14
- 238000004519 manufacturing process Methods 0.000 abstract description 2
- 238000012790 confirmation Methods 0.000 abstract 1
- 230000002452 interceptive effect Effects 0.000 abstract 1
- 230000002093 peripheral effect Effects 0.000 description 6
- 238000013461 design Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000002349 favourable effect Effects 0.000 description 2
- 230000002045 lasting effect Effects 0.000 description 2
- 238000012827 research and development Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000005057 refrigeration Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Input From Keyboards Or The Like (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本发明公开了一种基于FPGA的红外热像仪人机交互方法，采用低灰度值像素构造图形，存在FPGA的ROM中，根据时序信号控制读取，取代采集到的图像的部分像素值，进而与周边高灰度图像形成灰度差，完成图形界面的制作。非常简洁的完成了复杂文字界面的字模生成，并固化在ROM里面，产品上电后，随图像数据流输出，利用图像和界面的差灰度显示，实现交互界面显示，供人眼直观读取文字信息，并通过七个按键实现热像仪命令菜单的开启、关闭、切换以及确定。The invention discloses a human-computer interaction method for an infrared thermal imager based on an FPGA, which adopts low gray value pixels to construct a graphic, which is stored in a ROM of the FPGA, and is controlled to read according to a timing signal to replace part of the pixel values of the collected image. Then, a grayscale difference is formed with the surrounding high-grayscale images, and the production of the graphic interface is completed. The font generation of the complex text interface is very concisely completed, and it is solidified in the ROM. After the product is powered on, it is output with the image data stream, and the difference grayscale display between the image and the interface is used to realize the interactive interface display, which is intuitively read by the human eye. Text information, and realize the opening, closing, switching and confirmation of the thermal imager command menu through seven buttons.
Description
Technical Field
The invention relates to a thermal infrared imager man-machine interaction method, in particular to a thermal infrared imager man-machine interaction method based on an FPGA.
Background
The infrared refrigeration thermal imager is called a thermal imager for short, and the detector is stable in working state in a low-temperature environment, so that control instructions such as correction and the like need to be sent to the thermal imager before normal working. In addition, according to different use environments and targets, the thermal imager adopts gain parameters, brightness, internal and external synchronization, focal length and a plurality of application functions which need to be manually changed in real time. Therefore, the UI, User Interface, is an integral part of the thermal imager system.
Currently, there are two main methods for implementing UI design: one is to realize interface communication through peripheral interfaces of the computer, such as USB, serial ports and the like, and then send or receive control commands through upper computer software; the second is to realize human-computer interaction by expanding integrated chips, such as ARM, 51 and other series of single-chip microcomputers, in the system and calling interface and interface library functions. Because the first mode carries peripheral hardware more, be unfavorable for working for a long time in the environment that does not have lasting stable power supply condition, the second mode needs to expand resources on the system circuit board, increases system design complexity, is unfavorable for system reliability to increase research and development cost and consumption. The coe file is a common file that can be read by the FPGA.
Disclosure of Invention
The invention aims to provide a human-computer interaction method for a thermal infrared imager based on an FPGA (field programmable gate array), which solves the problems that the traditional method has more carried peripherals, is not favorable for working for a long time in an environment without lasting and stable power supply conditions, needs to expand resources on a system circuit board, increases the complexity of system design, is not favorable for system reliability, and increases the research and development cost and power consumption.
According to a first aspect of the invention, a thermal infrared imager man-machine interaction method based on an FPGA is provided, which comprises the following specific steps:
first step of building a human-computer interaction system
The human-computer interaction system comprises: the device comprises a key control module, a character module generating module and an coe file generating module.
The key control module has the functions as follows: and the movement of the highlight button of the interface is controlled through an external key, so that the man-machine interaction is realized.
The matrix generation module has the functions of: and generating a character font required by the highlighted interface button, and generating a txt file.
coe the file generation module functions as: the. coe file is generated for each line of text using matlab.
The second step is that the key control module controls the movement of the interface keys on the display interface
The key control module has seven key functions, and the key functions are as follows: open menu, close menu, confirm, move up, move down, move left, and move right. After the menu is opened, a corresponding input command is obtained through the key function, and then the selection of menu options is controlled, and the key function confirms that the corresponding control command is sent to the front end. After closing the menu, only the open menu responds. The direction key includes: moving up, moving down, moving left and moving right, and placing the highlight at the menu function key position corresponding to the control menu through the direction key.
Thirdly, generating a matrix file by a matrix generation module
The size of the whole frame image of the control menu is M x N pixels, the number of pixels occupied by a single word is a x b pixels, one frame image is divided into x y areas, each area displays one word, and the word module generation module generates 1 txt file from 1 area word.
M, N are the row and column of the whole frame image of the control menu; a. b is the row and column of the pixel occupied by the single word; x and y are the row number and column number of the region respectively. a x M, b y N.
The fourth step coe File Generation Module generates coe files
The. coe file for each line of text of the control menu is generated using matlab. The coe file generation module keeps the header format of the first coe file, concatenates all the district characters in a coe file, and finally generates a coe file for reading by the FPGA. The coe file is stored in the ROM, and the FPGA calls the data in the ROM after being electrified.
Therefore, the man-machine interaction of the thermal infrared imager based on the FPGA is completed.
Preferably, the size of the whole frame image of the control menu is: 640 x 512, 640 x 320, 512 x 240 or 512 x 512.
Preferably, when the size of the whole frame image of the control menu is 640 × 512 pixels, the number of pixels occupied by a single word is 16 × 32 pixels, and one frame image is divided into 40 × 16 zones.
According to a second aspect of the present invention, there is provided a human-computer interaction system comprising: the device comprises a key control module, a character module generating module and an coe file generating module.
The key control module has the functions as follows: and the movement of the highlight button of the interface is controlled through an external key, so that the man-machine interaction is realized.
The matrix generation module has the functions of: and generating a character font required by the highlighted interface button, and generating a txt file.
coe the file generation module functions as: the. coe file is generated for each line of text using matlab.
Because the real-time requirement of the thermal imager is high, the acquired image data is subjected to FPGA image preprocessing, then is transmitted to the communication interface in real time, is transmitted to the display or the upper computer, and is further processed according to subsequent requirements. Therefore, the creation of the human-computer interface is added to the data stream. The invention adopts the low-gray-scale value pixels to construct the graph, the graph is stored in the ROM of the FPGA, the reading is controlled according to the time sequence signal, the partial pixel values of the collected image are replaced, and then the gray difference is formed between the collected image and the peripheral high-gray-scale image, thereby completing the manufacture of the graphical interface. The invention utilizes the existing FPGA chip of the thermal imager system, writes the selectable operation interface on the output gray level image, utilizes 7 buttons to realize man-machine interaction, saves cost, reduces power consumption and does not increase the peripheral equipment of the system. The problem that more peripherals are needed or resources on a system circuit board are increased when the thermal imager is controlled is successfully solved. The verification proves that the method has the advantages of stable work, concise interface and convenient operation.
Detailed Description
Example 1
The thermal infrared imager man-machine interaction method based on the FPGA comprises the following specific steps:
first step of building a human-computer interaction system
The human-computer interaction system comprises: the device comprises a key control module, a character module generating module and an coe file generating module.
The key control module has the functions as follows: and the movement of the highlight button of the interface is controlled through an external key, so that the man-machine interaction is realized.
The matrix generation module has the functions of: and generating a character font required by the highlighted interface button, and generating a txt file.
coe the file generation module functions as: the. coe file is generated for each line of text using matlab.
The second step is that the key control module controls the movement of the interface keys on the display interface
The key control module has seven key functions, and the key functions are as follows: open menu, close menu, confirm, move up, move down, move left, and move right. After the menu is opened, a corresponding input command is obtained through the key function, and then the selection of menu options is controlled, and the key function confirms that the corresponding control command is sent to the front end. After closing the menu, only the open menu responds. The direction key includes: moving up, moving down, moving left and moving right, and placing the highlight at the menu function key position corresponding to the control menu through the direction key.
Thirdly, generating a matrix file by a matrix generation module
The size of the whole frame image of the control menu is M x N pixels, the number of pixels occupied by a single word is a x b pixels, one frame image is divided into x y areas, each area displays one word, and the word module generation module generates 1 txt file from 1 area word.
M, N are the row and column of the whole frame image of the control menu; a. b is the row and column of the pixel occupied by the single word; x and y are the row number and column number of the region respectively. a x M, b y N.
The size of the whole frame image of the control menu is as follows: 640 x 512, 640 x 320, 512 x 240 or 512 x 512.
When the size of the whole frame image of the control menu is 640 × 512 pixels, the number of pixels occupied by a single word is 16 × 32 pixels, and one frame image is divided into 40 × 16 areas.
The fourth step coe File Generation Module generates coe files
The. coe file for each line of text of the control menu is generated using matlab. The coe file generation module keeps the header format of the first coe file, concatenates all the district characters in a coe file, and finally generates a coe file for reading by the FPGA. The coe file is stored in the ROM, and the FPGA calls the data in the ROM after being electrified.
Therefore, the man-machine interaction of the thermal infrared imager based on the FPGA is completed.
Example 2
A human-computer interaction system includes: the device comprises a key control module, a character module generating module and an coe file generating module.
The key control module has the functions as follows: and the movement of the highlight button of the interface is controlled through an external key, so that the man-machine interaction is realized.
The matrix generation module has the functions of: and generating a character font required by the highlighted interface button, and generating a txt file.
coe the file generation module functions as: the matlab software was used to generate the coe file for each line of text.
Claims (2)
1. A thermal infrared imager man-machine interaction method based on FPGA is characterized by comprising the following specific steps:
first step of building a human-computer interaction system
The human-computer interaction system comprises: the device comprises a key control module, a character module generating module and an coe file generating module;
the key control module has the functions as follows: the movement of a highlight button of an interface is controlled through an external key to realize man-machine interaction;
the matrix generation module has the functions of: generating a character matrix required by a highlight button of an interface, and generating a txt file;
coe the file generation module functions as: generating coe files of each line of characters by matlab;
the second step is that the key control module controls the movement of the interface keys on the display interface
The key control module has seven key functions, and the key functions are as follows: open menu, close menu, confirm, move up, move down, move left and move right; after the menu is opened, a corresponding input command is obtained through a key function, so that the selection of menu options is controlled, and the key function confirms that the corresponding control command is sent to the front end; after closing the menu, only opening the menu response; the direction key includes: moving upwards, moving downwards, moving leftwards and rightwards, and placing the highlight at the position of the menu function key corresponding to the control menu through a direction key;
the size of the whole frame image of the control menu is as follows: 640 x 512, 640 x 320, 512 x 240 or 512 x 512; when the size of the whole frame image of the control menu is 640 × 512 pixels, the number of the pixels occupied by a single word is 16 × 32 pixels, and one frame image is divided into 40 × 16 areas;
thirdly, generating a matrix file by a matrix generation module
The size of the whole frame image of the control menu is M x N pixels, the number of pixels occupied by a single word is a x b pixels, one frame image is divided into x y areas, each area displays one word, and the word model generating module generates 1 txt file from 1 area word;
m, N are the row and column of the whole frame image of the control menu; a. b is the row and column of the pixel occupied by the single word; x and y are respectively the row number and the column number of the area; a x M, b y N;
the fourth step coe File Generation Module generates coe files
Coe files for generating each line of characters of the control menu by matlab; the coe file generating module reserves the head format of the first coe file, connects all the characters in a coe file, and finally generates a coe file for reading by the FPGA; the coe file is stored in the ROM, and the FPGA calls the data in the ROM after being electrified.
2. A human-computer interaction system, comprising: the device comprises a key control module, a character module generating module and an coe file generating module;
the key control module has the functions as follows: the movement of a highlight button of an interface is controlled through an external key to realize man-machine interaction;
the matrix generation module has the functions of: generating a character matrix required by a highlight button of an interface, and generating a txt file;
coe the file generation module functions as: generating coe files of each line of characters by matlab;
the key control module controls the movement of the interface keys on the display interface:
the key control module has seven key functions, and the key functions are as follows: open menu, close menu, confirm, move up, move down, move left and move right; after the menu is opened, a corresponding input command is obtained through a key function, so that the selection of menu options is controlled, and the key function confirms that the corresponding control command is sent to the front end; after closing the menu, only opening the menu response; the direction key includes: moving upwards, moving downwards, moving leftwards and rightwards, and placing the highlight at the position of the menu function key corresponding to the control menu through a direction key;
the size of the whole frame image of the control menu is as follows: 640 x 512, 640 x 320, 512 x 240 or 512 x 512; when the size of the whole frame image of the control menu is 640 × 512 pixels, the number of the pixels occupied by a single word is 16 × 32 pixels, and one frame image is divided into 40 × 16 areas;
the font generation module generates a font file:
the size of the whole frame image of the control menu is M x N pixels, the number of pixels occupied by a single word is a x b pixels, one frame image is divided into x y areas, each area displays one word, and the word model generating module generates 1 txt file from 1 area word;
m, N are the row and column of the whole frame image of the control menu; a. b is the row and column of the pixel occupied by the single word; x and y are respectively the row number and the column number of the area; a x M, b y N;
coe File Generation Module generates coe File:
coe files for generating each line of characters of the control menu by matlab; the coe file generating module reserves the head format of the first coe file, connects all the characters in a coe file, and finally generates a coe file for reading by the FPGA; the coe file is stored in the ROM, and the FPGA calls the data in the ROM after being electrified.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811075744.4A CN109271077B (en) | 2018-09-14 | 2018-09-14 | A Human-Computer Interaction Method of Infrared Thermal Imager Based on FPGA |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811075744.4A CN109271077B (en) | 2018-09-14 | 2018-09-14 | A Human-Computer Interaction Method of Infrared Thermal Imager Based on FPGA |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109271077A CN109271077A (en) | 2019-01-25 |
| CN109271077B true CN109271077B (en) | 2021-08-13 |
Family
ID=65188375
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811075744.4A Active CN109271077B (en) | 2018-09-14 | 2018-09-14 | A Human-Computer Interaction Method of Infrared Thermal Imager Based on FPGA |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109271077B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202956192U (en) * | 2012-03-16 | 2013-05-29 | 东莞华仪仪表科技有限公司 | Device and system of intelligent thermal imaging camera |
| CN103747191A (en) * | 2014-01-27 | 2014-04-23 | 大连科迪视频技术有限公司 | Network interaction high-definition character superimposition system |
| CN105761233A (en) * | 2014-12-15 | 2016-07-13 | 南京理工大学 | FPGA-based real-time panoramic image mosaic method |
| CN205748663U (en) * | 2016-06-14 | 2016-11-30 | 上海集成电路研发中心有限公司 | A kind of Multifunction infrared thermal imagery instrument |
| US9843742B2 (en) * | 2009-03-02 | 2017-12-12 | Flir Systems, Inc. | Thermal image frame capture using de-aligned sensor array |
| CN107888848A (en) * | 2017-11-07 | 2018-04-06 | 哈尔滨工程大学 | The device and method of artistic font is superimposed on image based on FPGA |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8519979B1 (en) * | 2006-12-29 | 2013-08-27 | The Mathworks, Inc. | Multi-point interface for a graphical modeling environment |
| CN105187745A (en) * | 2015-08-30 | 2015-12-23 | 深圳市特力科信息技术有限公司 | High definition video OSD menu superposition module based on FPGA and method |
-
2018
- 2018-09-14 CN CN201811075744.4A patent/CN109271077B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9843742B2 (en) * | 2009-03-02 | 2017-12-12 | Flir Systems, Inc. | Thermal image frame capture using de-aligned sensor array |
| CN202956192U (en) * | 2012-03-16 | 2013-05-29 | 东莞华仪仪表科技有限公司 | Device and system of intelligent thermal imaging camera |
| CN103747191A (en) * | 2014-01-27 | 2014-04-23 | 大连科迪视频技术有限公司 | Network interaction high-definition character superimposition system |
| CN105761233A (en) * | 2014-12-15 | 2016-07-13 | 南京理工大学 | FPGA-based real-time panoramic image mosaic method |
| CN205748663U (en) * | 2016-06-14 | 2016-11-30 | 上海集成电路研发中心有限公司 | A kind of Multifunction infrared thermal imagery instrument |
| CN107888848A (en) * | 2017-11-07 | 2018-04-06 | 哈尔滨工程大学 | The device and method of artistic font is superimposed on image based on FPGA |
Non-Patent Citations (2)
| Title |
|---|
| A fast HW/SW FPGA-based thermal emulation framework for multi-processor system-on-chip;D. Atienza et al.;《2006 43rd ACM/IEEE Design Automation Conference》;20060911;618-623 * |
| 基于MATLAB GUI的非制冷红外热像仪串口通信设计;冯浩 等;《平顶山学院学报》;20151031;第30卷(第5期);37-40 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109271077A (en) | 2019-01-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106687889B (en) | Display portable text entry and editing | |
| CN107272879B (en) | Display apparatus, system and method for controlling external device | |
| CN109561271B (en) | Method for guiding terminal operation, first terminal and second terminal | |
| EP2908231A1 (en) | Object suspension realizing method and device | |
| US20200218356A1 (en) | Systems and methods for providing dynamic haptic playback for an augmented or virtual reality environments | |
| JP2012502344A (en) | Method system and software for providing an image sensor based human machine interface | |
| CN101140487A (en) | Shuttle control system for controlling keyboard-video-mouse switch and control method thereof | |
| CN104750498A (en) | Method for controlling mouse module and electronic device | |
| CN108737888A (en) | Display equipment, display system and the method for controlling display equipment | |
| CN103870193A (en) | Information processing method and electronic equipment | |
| CN105183269B (en) | Method for automatically identifying screen where cursor is located | |
| CN105280204B (en) | Method for broadcasting multimedia file, apparatus and system | |
| CN109271077B (en) | A Human-Computer Interaction Method of Infrared Thermal Imager Based on FPGA | |
| US20150121284A1 (en) | Method for information processing and electronic apparatus thereof | |
| EP3683659A1 (en) | Method and device and system with dual mouse support | |
| CN104123062A (en) | Information processing method and electronic device | |
| US9158452B2 (en) | Early drawing system and method to improve touch screen response | |
| CN105630443B (en) | A kind of OSD display methods of kvm system | |
| TW201627820A (en) | Multi-key input method and input device thereof | |
| CN102194402A (en) | Programmable device for graph control of light-emitting diode (LED) display screen | |
| CN114489310A (en) | Virtual reality device and handle positioning method | |
| CN108874037B (en) | Domestic notebook three-screen display system and method | |
| US20010035913A1 (en) | Television interface for handheld calculator for enhanced television display | |
| JP2009223532A (en) | Operation control method for icon interface | |
| CN114694326B (en) | Expansion display device of face payment device and face payment system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |