CN111367401A - Man-machine interface board and control method, monitoring unit and storage medium thereof - Google Patents
Man-machine interface board and control method, monitoring unit and storage medium thereof Download PDFInfo
- Publication number
- CN111367401A CN111367401A CN201811603732.4A CN201811603732A CN111367401A CN 111367401 A CN111367401 A CN 111367401A CN 201811603732 A CN201811603732 A CN 201811603732A CN 111367401 A CN111367401 A CN 111367401A
- Authority
- CN
- China
- Prior art keywords
- gesture
- user gesture
- interface board
- machine interface
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 47
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000001514 detection method Methods 0.000 claims abstract description 40
- 238000004891 communication Methods 0.000 claims abstract description 39
- 238000012545 processing Methods 0.000 claims description 22
- 230000004044 response Effects 0.000 claims description 9
- 230000008030 elimination Effects 0.000 claims description 7
- 238000003379 elimination reaction Methods 0.000 claims description 7
- 230000003993 interaction Effects 0.000 abstract description 26
- 230000009471 action Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 8
- 230000033001 locomotion Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 5
- 238000013459 approach Methods 0.000 description 4
- 238000012790 confirmation Methods 0.000 description 4
- 230000002045 lasting effect Effects 0.000 description 4
- 238000012423 maintenance Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 238000003825 pressing Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 239000004163 Spermaceti wax Substances 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000011247 coating layer Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 238000007789 sealing Methods 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
Abstract
The embodiment of the application discloses a man-machine interface board, a control method thereof, a monitoring unit of a communication power supply and a storage medium, wherein the man-machine interface board comprises a display screen, a gesture recognition sensor and a microprocessor; the gesture recognition sensor acquires a gesture detection instruction issued by the microprocessor; detecting a user gesture above the display screen and generating user gesture information according to the gesture detection instruction; generating an interrupt signal according to the gesture information of the user; the microprocessor sends a gesture detection instruction to the gesture recognition sensor; acquiring user gesture information according to the interrupt signal; and recognizing the user gesture information and outputting the recognized user gesture information. According to the embodiment of the application, the non-contact interaction of power supply monitoring is realized through the gesture recognition sensor and the microprocessor; the problems that a display area and a key interaction area are small and user experience is poor in an existing monitoring unit of the communication power supply are solved; the user experience is improved.
Description
Technical Field
The embodiment of the application relates to the technical field of communication, in particular to a human-machine interface board, a control method thereof, a monitoring unit of a communication power supply and a storage medium.
Background
With the rapid development of information technologies such as the Internet, the Internet of things, the industry 4.0 and the like, the rapid progress of the modern society is promoted. More and more electronic products such as industrial control, medical treatment, communication, consumption and the like are increasingly intelligentized, embedded systems with microprocessors as cores are increasingly widely applied, and users can realize remote and intelligent services anytime and anywhere through intelligent interfaces and ubiquitous networks provided by equipment. Mobile communication systems, which support one of the cornerstones of these information technologies, have also evolved rapidly from 2G, 3G, 4G, to 5G in the last two decades. 4G and 5G networks, a very important feature is that base station equipment is increasing, network coverage is becoming dense, and user requirements for network services are also increasing.
As an essential important component of a mobile communication system, a communication power supply needs to provide energy to communication equipment safely, reliably, efficiently, stably and uninterruptedly, has functions of intelligent monitoring, unattended operation, automatic battery management and the like, and meets the requirements of the network era. Meanwhile, the deep coverage of the mobile communication network also puts forward the requirements of higher miniaturization and easy maintenance for the communication power supply: the rectifier has higher and higher power density, smaller and smaller volume and lighter weight; the whole power supply system is also developed from a standard cabinet to the forms of embedded type, wall-mounted type, pole-holding integrated installation and the like. For example, a 200A capacity dc power system, which may be a 1.6 meter floor cabinet, is now sufficient to implement a standard 3U box. These changes in demand have also promoted the rapid development of communication power supply monitoring units toward miniaturization and front maintenance.
Due to the industrial characteristics of the communication power supply and the use habits of users, the monitoring unit always keeps the functions of liquid crystal display and key interaction, and is convenient for project release and field maintenance. However, as monitoring units become smaller, this function becomes more difficult to implement. For example, a latest embedded power monitoring unit of a company is designed with high density, and RJ45 net ports, USB (Universal Serial Bus) interfaces, 27mm × 27mm visual field LCD (Liquid Crystal Display), up/down/confirm/return 4 buttons, and fixed latches are densely arranged on a front panel with a size of 84mm × 40 mm. Because the space height is limited, the size of four keys is as small as 3mm by 3 mm; the key pitch is also 3 mm. It is conceivable that, due to the small size, multiple pressing and wrong pressing are easily caused, the operation of the combined key (multiple keys are pressed simultaneously) is basically not realized, and the key is easily damaged; the sensitivity and reliability of interaction are not good, and the operation experience is very poor.
Disclosure of Invention
In view of this, an object of the embodiments of the present application is to provide a human-machine interface board, a control method thereof, a monitoring unit of a communication power supply, and a storage medium, so as to solve the problems of a display area and a key interaction area of an existing monitoring unit of a communication power supply being small and poor in user experience.
The technical scheme adopted by the embodiment of the application for solving the technical problems is as follows:
according to an aspect of the embodiments of the present application, there is provided a human-machine interface board, including a display screen, a gesture recognition sensor, and a microprocessor;
the gesture recognition sensor is used for acquiring a gesture detection instruction issued by the microprocessor; detecting a user gesture above the display screen according to the gesture detection instruction and generating user gesture information; generating an interrupt signal according to the user gesture information;
the microprocessor is used for issuing a gesture detection instruction to the gesture recognition sensor; acquiring the user gesture information according to the interrupt signal; and identifying the user gesture information and outputting the identified user gesture information.
According to another aspect of the embodiments of the present application, there is provided a monitoring unit of a communication power supply, the monitoring unit of the communication power supply includes a main controller and the above-mentioned human-machine interface board;
and the main controller is used for acquiring the recognized user gesture information output by the human-computer interface board and returning user gesture response information to the human-computer interface board.
According to another aspect of the embodiments of the present application, there is provided a control method of a human-machine interface board, the method including:
issuing a gesture detection instruction to a gesture recognition sensor; the gesture recognition sensor acquires a issued gesture detection instruction; detecting a user gesture above the display screen according to the gesture detection instruction and generating user gesture information; generating an interrupt signal according to the user gesture information;
acquiring the user gesture information according to the interrupt signal;
and identifying the user gesture information and outputting the identified user gesture information.
According to another aspect of the embodiments of the present application, there is provided a storage medium, on which a control program of a human-machine interface board is stored, wherein the control program of the human-machine interface board realizes the steps of the control method of the human-machine interface board when being executed by a processor.
The man-machine interface board, the control method thereof, the monitoring unit of the communication power supply and the storage medium realize non-contact interaction of power supply monitoring through the gesture recognition sensor and the microprocessor; the problems that a display area and a key interaction area are small and user experience is poor in an existing monitoring unit of the communication power supply are solved; the user experience is improved.
Drawings
FIG. 1 is a schematic illustration of a human-machine interface board structure according to a first embodiment of the present application;
fig. 2 is a flowchart illustrating a control method of a human-machine interface board according to a second embodiment of the present application.
The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.
Detailed Description
In order to make the technical problems, technical solutions and advantageous effects to be solved by the present application clearer and clearer, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
First embodiment
For a better understanding of the present embodiment, the following describes the gesture recognition and the improvement process of the existing human interface board:
a conventional communication power supply system generally includes the following units: alternating current distribution, direct current distribution, a battery pack, a rectifier, and a monitoring unit as a system core. The monitoring unit is composed of a core mainboard, an HMI (Human Machine Interface) board, a power supply conversion board, a signal acquisition board, a network communication board and the like. The core motherboard is generally a minimum application system of MCU (MicroControl Unit)/ARM, bears and runs monitored main service software, and also includes a GUI (Graphical User Interface) window menu. The HMI board is relatively simple and mainly comprises hardware circuits such as an LCD, an input keyboard, a status indication LED and the like. Due to space limitation, the input keyboard is few and is mostly four keys of up, down, confirmation and return; some monitoring units also have keys such as 'left' and 'right'. Human-computer interaction is realized through the keys and a display interface presented by the LCD. However, as the monitoring unit becomes more and more miniaturized, the monitoring unit of the existing communication power supply system has the problems of smaller display area and key interaction area and poor user experience. Therefore, the monitoring unit is improved, and non-contact interaction is realized through gesture recognition.
First, an appropriate gesture recognition technique and sensor scheme is selected.
Although the gesture recognition technology has not been applied to the communication power supply industry, the gesture recognition technology is used more in wearable equipment and consumer electronics at present; there are also many schemes that can be referenced. Gesture recognition techniques can be roughly divided into three levels: two-dimensional hand shape recognition, two-dimensional gesture recognition and three-dimensional gesture recognition.
Two-dimensional hand type recognition, also called static two-dimensional gesture recognition, recognizes several static gestures, such as a fist making or five fingers opening. A typical application is as a hand-type control player: lifting the palm of the user and placing the palm in front of the camera, and starting playing the video; then the palm of the hand is placed in front of the camera, and the video is paused.
Two-dimensional gesture recognition has dynamic characteristics, can track the motion of gestures, and then discerns the complex action that gesture and hand motion combine together. The range of gesture recognition is really expanded to a two-dimensional plane.
Three-dimensional gesture recognition needs space depth information compared with the former two, needs a three-dimensional imaging technology on hardware, is more complex in software recognition algorithm, can recognize various hand types, gestures and actions, and is applied to game playing or VR (virtual reality).
According to the practical application scene and the cost requirement of power supply monitoring, a relatively uncomplicated two-dimensional gesture recognition technology can be selected, and an infrared gesture recognition sensor is used as a main scheme for realization. Generally, an LED (Light Emitting Diode) Emitting Light source and a photodiode sensing infrared energy reflected back from four directions, i.e., up, down, left, and right, are integrated in the gesture recognition sensor. Meanwhile, if it is desired to improve the friendliness of the power supply monitoring unit and automatically adjust the LCD backlight according to the ambient light intensity, the selected sensor should have a photodiode for sensing the ambient light intensity independently. In addition, the selected sensors have standard I2C communication and interrupt interfaces to enable real-time information acquisition and processing.
Secondly, the existing man-machine interaction board is optimized, and a gesture recognition function circuit is added.
Specifically, a gesture recognition sensor, an MCU (MicroControl Unit) for implementing a gesture recognition algorithm, and a peripheral device are added to the existing HMI board. The MCU is connected with the sensor through an I2C communication Interface and an external interrupt signal Interface, and outputs a gesture recognition result to the core mainboard through a UART (Universal Asynchronous Receiver/Transmitter) Interface, an SPI (Serial Peripheral Interface) Interface or an I2C (Inter-Integrated Circuit bus) Interface and the like; meanwhile, the MCU provides level output ports with no less than the number of keys, and can simulate and output levels before and after the action of the corresponding keys; the level output port is subjected to phase comparison with the key input end of the key circuit and jitter elimination, and then output to the core single board to ensure interface compatibility between the single boards; that is to say, only hardware such as the HMI single board is replaced, so that the upgrading of the field monitoring unit can be completed, and the realization of gesture interaction is supported.
Accordingly, the front panel of the monitoring unit also needs to be adjusted in structure. For example, a plastic or glass transmission window (light transmission screen) recommended by a manufacturer is added above the position of the sensor, and the transmission window with a dark coating layer is commonly used to achieve the aesthetic effect; besides the diameters of an LED emission source and a photosensitive diode, rubber isolation is added, and crosstalk is reduced through optical sealing, so that a better effect is achieved.
Based on the above improvement, as shown in fig. 1, the first embodiment of the present application provides a human-machine interface board, and the human-machine interface board 10 includes a display screen 13, a gesture recognition sensor 11 and a microprocessor 12.
In this embodiment, the gesture recognition sensor 11 may be an infrared gesture recognition sensor;
the infrared gesture recognition sensor is internally integrated with a transmitting light source, a first photodiode for sensing infrared energy reflected in different directions and a second photodiode for sensing the light intensity of the environment.
In the present embodiment, the gesture recognition sensor 11 and the microprocessor 12 are connected through an I2C (Inter-Integrated Circuit) communication interface and an interrupt interface.
The gesture recognition sensor 11 is configured to obtain a gesture detection instruction issued by the microprocessor 12; detecting a user gesture above the display screen 13 according to the gesture detection instruction and generating user gesture information; generating an interrupt signal according to the user gesture information;
the microprocessor 12 is configured to issue a gesture detection instruction to the gesture recognition sensor 11; acquiring the user gesture information according to the interrupt signal; and identifying the user gesture information and outputting the identified user gesture information.
In this embodiment, the microprocessor 12 may issue an instruction to the gesture recognition sensor 11 through an I2C protocol, drive the gesture recognition sensor 11 to perform short-distance detection, gesture detection, and ambient light detection, and read the detected data in time through the I2C communication interface and the interrupt interface, and determine, identify, and convert the detected data, thereby analyzing and obtaining a plurality of gesture actions such as approaching, flapping, and fast waving.
As an example, the recognition of different gestures is explained below:
1. proximity gesture recognition
The upper limit, the lower limit and the continuous times (filtering parameters) of the close-distance light intensity threshold are firstly set, and the threshold is allowed to exceed the limit to generate interruption.
After the microprocessor 12 issues a proximity detection instruction to the gesture recognition sensor 11 and generates an interrupt signal, the microprocessor 12 reads the proximity detection data. This data is the intensity of light reflected from an object (e.g., a hand) received by the second photodiode, which senses the intensity of ambient light. The magnitude of the light intensity value corresponds to the distance between the object: for example, this value is below a lower limit, indicating a "far" motion gesture; above the upper limit, a "close" motion gesture is indicated.
And converting the motion gesture into a man-machine interaction input action. Such as a "close" gesture that lasts for a period of time (e.g., 1 second), equivalent to a "confirm" button; a "away" gesture lasting for a period of time is equivalent to a "back" button; the fast alternate repetition of "close" and "far" is equivalent to "double click".
Attention needs to be paid to the processing of the duration. For example, a "close" gesture lasting a long period of time (e.g., 2 seconds) is not equivalent to a continuous pressing of multiple "confirm" buttons, with a "far" action in between; longer duration "close" and "far away" (e.g., 30 seconds or more) indicate the meaning of the user or operator "going off the field". In an actual application scenario, it may happen that the front panel of the monitoring unit is covered or shielded by an object (for example, a cabinet door where the embedded power supply is located is closed), and this situation may also be equivalent to "field-off" of an operator.
2. Gesture detection recognition
Firstly, parameters such as gesture entering and exiting thresholds, FIFO (First in First out) depth of data storage and the like are set, and gesture detection interruption is allowed.
After the microprocessor 12 issues a gesture detection instruction to the gesture recognition sensor 11 and generates an interrupt signal, the microprocessor 12 continuously reads data from the FIFO. These data are a set of all reflected light intensity data received by the first photodiode (for example, four sets of direction sensing LEDs, which will be described below as an example) that senses infrared energy reflected in different directions during the entire movement of the gesture. The movement direction and the distance of the gesture can be judged by analyzing and positioning the light intensity data in the upper direction, the lower direction, the left direction and the right direction.
1) And recognizing the waving gesture. And judging the gesture action according to the time change characteristics (time-light intensity curve graphs) of the four groups of reflected light intensity data. Obviously, when the hand approaches the sensing LED, the light intensity is reflected; far from the sensing LED, the reflected light is weak. Therefore, it can be determined that in the waving process of the gesture, the four groups of sensing LED time-light intensity characteristic curves are similar to a normal distribution curve, the reflected light is strongest when the hand is in the middle position, and the light intensity is smaller toward the edge portions on both sides. For example, when the hands are swung left and right, the time-light intensity characteristic curves of the upper sensing LED and the lower sensing LED are basically overlapped; and the time-light intensity graphs of the left perception LED and the right perception LED have similar curve envelopes but have time deviation, namely, the time-axis direction translation characteristic is presented. Similarly, when the left and right sensing LEDs are swung up and down, the time-light intensity characteristic curves of the left and right sensing LEDs are basically overlapped; the time-intensity curve graphs of the upper and lower sensing LEDs have time axis deviation, and the typical translation time of the light intensity peak point is tens to hundreds of milliseconds, which is related to the waving speed.
2) The basic principle is similar to the swing recognition algorithm of the up-down, left-right and hand gestures, the time-light intensity curve graph of the multipoint sensing LED is analyzed, and the peak point track of the light intensity is fitted and judged, for example, the peak point track of the light intensity is judged to be approximate to a circle, the gesture is recognized to be an English letter O and the like, and for example, the peak point track of the light intensity is judged to be approximate to a mountain peak, for example, "Λ", the gesture is recognized to be a letter A and the like.
3. Ambient light intensity identification
The upper limit, the lower limit and the continuous times (filtering parameters) of the ambient light intensity threshold are set, and the threshold is allowed to exceed the limit to generate an interrupt.
After the microprocessor 12 issues an ambient light intensity detection instruction to the gesture recognition sensor 11 and generates an interrupt signal, the microprocessor 12 reads data. This data is the ambient light intensity data received by the second photodiode sensing the ambient light intensity.
Referring to fig. 1 again, in one embodiment, the man-machine interface board 10 further includes a key circuit 14, a logic processing circuit 15 and a jitter elimination circuit 16;
the microprocessor 12 comprises a level output port (shown as P1, P2, P3 and P4), and the key circuit 14 comprises a key input (shown as K1, K2, K3 and K4); the level output port and the key input end are connected to the input end of the logic processing circuit 15, and the output end of the logic processing circuit 15 is connected to the input end of the jitter elimination circuit 16;
the microprocessor 12 is further configured to output a corresponding level signal through the level output port according to the recognized user gesture information;
the logic processing circuit 15 is configured to perform logic processing on the level signal output by the level output port and the signal at the key input end;
in this embodiment, the logic processing circuit 15 may be a logic and processing circuit, and the logic and processing circuit may include a plurality of logic and processing units (shown as L1, L2, L3, and L4 in the figure), and each input of the logic and processing unit is connected to one level output port and one key input, for example: the input terminal of the and logic processing unit L1 is connected to the level output port P1 and the key input terminal K1.
The jitter cancellation circuit 16 is configured to perform jitter cancellation on the signal logically processed by the logic processing circuit 15, and output the signal after jitter cancellation.
In this embodiment, the jitter cancellation circuit 16 may be a schmitt circuit, such as 74HC 7001. Through the jitter elimination circuit 16, the output of the keys on the man-machine interface board is subjected to jitter elimination, and the signal quality is improved; the detection of each key input by the monitoring unit can be changed from a polling mode to an interruption mode, so that the real-time performance of response is improved.
The man-machine interface board of the embodiment of the application realizes non-contact interaction of power supply monitoring through the gesture recognition sensor and the microprocessor; the problems that a display area and a key interaction area are small and user experience is poor in an existing monitoring unit of the communication power supply are solved; the user experience is improved.
Second embodiment
As shown in fig. 2, a second embodiment of the present application provides a method for controlling a human-machine interface board, which can refer to the first embodiment and will not be described herein again. The method comprises the following steps:
step S21: issuing a gesture detection instruction to a gesture recognition sensor; the gesture recognition sensor acquires a issued gesture detection instruction; detecting a user gesture above the display screen according to the gesture detection instruction and generating user gesture information; and generating an interrupt signal according to the user gesture information.
In this embodiment, the generating an interrupt signal according to the user gesture information includes:
comparing the parameter value in the user gesture information with the upper limit or the lower limit of a preset threshold;
and generating an interrupt signal under the condition that the parameter value in the user gesture information exceeds the upper limit or the lower limit of the preset threshold.
Step S22: and acquiring the user gesture information according to the interrupt signal.
Step S23: and identifying the user gesture information and outputting the identified user gesture information.
In one embodiment, the recognizing the user gesture information and outputting the recognized user gesture information further includes:
and acquiring user gesture response information.
According to the control method of the man-machine interface board, the non-contact interaction of power monitoring is realized through the gesture recognition sensor and the microprocessor; the problems that a display area and a key interaction area are small and user experience is poor in an existing monitoring unit of the communication power supply are solved; the user experience is improved.
Third embodiment
A third embodiment of the present application provides a storage medium, where a control method program of a human-machine interface board is stored on the storage medium, and the control method program of the human-machine interface board is executed by a processor to implement the steps of the control method of the human-machine interface board according to the second embodiment.
It should be noted that the storage medium of this embodiment and the method of the second embodiment belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments, and technical features in the method embodiments are correspondingly applicable in this embodiment, which is not described herein again.
The storage medium of the embodiment of the application realizes non-contact interaction of power supply monitoring through the gesture recognition sensor and the microprocessor; the problems that a display area and a key interaction area are small and user experience is poor in an existing monitoring unit of the communication power supply are solved; the user experience is improved.
Fourth embodiment
A fourth embodiment of the present application provides a monitoring unit of a communication power supply, where the monitoring unit of the communication power supply includes a main controller and the human-machine interface board of the first embodiment;
and the main controller is used for acquiring the recognized user gesture information output by the human-computer interface board and returning user gesture response information to the human-computer interface board.
In this embodiment, the man-machine Interface board and the main controller are connected through any one of a UART (universal asynchronous Receiver/Transmitter) Interface, an SPI (serial peripheral Interface), and an I2C communication Interface.
In this embodiment, the returning of the user gesture response information to the human interface board includes, but is not limited to, the following situations:
1. when the user starts to operate (any non-off-field information is received), the display backlight of the LCD display screen is automatically adjusted according to the intensity of the ambient light.
2. And after the operator leaves the field, the backlight source of the LCD display screen is controlled to be closed, and the menu in the operation of the user exits to the screen saver state. The situation is beneficial to saving energy and prolonging the service life of the LCD.
3. If complex gesture detection and recognition such as English letters and numbers are supported, interactive response window interfaces such as input and editing menus of password input, parameter setting and the like can be improved, and faster and convenient information input and action control are realized.
To better illustrate the present embodiment, the following description is made in conjunction with a modification case of the monitoring unit:
a company provides a latest type of embedded communication power supply device, the embedded communication power supply device is miniaturized and designed in a high density, and the system capacity of 200A only needs a space with the height of 3U and the width of 19 inches; the power supply device can be widely applied to power supply of telecommunication equipment such as base stations, outdoor cabinets, wall hanging and the like. The equipment consists of an alternating current distribution unit, a direct current distribution unit, 4 rectifiers, an environment detection unit and a monitoring unit. The monitoring unit is designed for high density and front maintenance, the physical size is only 84mm (length) × 40mm (width) × 270mm (depth), and less than 1U × 2U front panel space, a USB interface, an RJ45 Ethernet port, a 27mm × 27mm visible area LCD, 4 keys such as up, down, confirmation and return, 3 LED indicator lights for indicating power supply, operation and alarm, and a fixed lock and the like are distributed. Because the space of the front panel is extremely limited, 4 keys are very small and have the size of 3mm by 3 mm; the distance between the keys is only 3mm, so that the keys are easy to be pressed more and mistakenly; the operability of human-computer interaction is very poor. In order to improve the human-computer interaction experience, a gesture recognition function is added, a simple and convenient operation gesture is used for realizing a completely new user interface, and brand new control experience is brought to a power supply monitoring unit.
First, referring to fig. 1, the circuit of the human-computer interaction interface board is optimized. The gesture recognition sensor may be selected from APDS-9960 available from AVAGO, which has been successfully used in products such as Samsung Galaxy S5, and similar sensors include Si1153 available from Silicon labs, E909 available from Elmos, TMG399x available from AMS, and the like. APDS-9960 has the advantages of high integration and low cost.
The APDS-9960 optical sensor integrates the functions of Gesture Detection (Gesture Detection), Proximity Detection (Proximity Detection), Ambient Light Detection (ALS, Ambient Light Sensing), color Sensing (ColorSense, RGBC) and the like inside, uses a double-photodiode to approximate 0.01lux illumination and the visual response of human eyes, and can operate flexibly even after dark glass; ultraviolet and infrared blocking filters are arranged in the LED, and four independent diodes realize sensitivity in different directions; there is another I2C compatible interface to connect to the microprocessor.
In the aspect of a microprocessor, STM32F030 of a Cortex-M0 kernel is selected, the chip integrates FLASH, RAM, GPIO, TIMER, I2C, USART and other resources, and the hardware cost of the whole solution is very low. In fact, any other low cost microprocessor with similar resources would be suitable. The STM32F030 and the APDS-9960 are connected through an I2C and interrupt interface; 4 output ports of the STM32F030 are respectively in AND connection with the key input phase, and are output to the core processing single board after the jitter is eliminated through a Schmitt circuit (such as 74HC 7001); after the software recognizes the gesture actions of upward waving, downward waving, approaching and far away, the microprocessor software outputs low-level pulses corresponding to the four ports, the pulse width is about 0.5 second, the output of the 'up', 'down', 'confirm' and 'return' keys is simulated, and the compatibility with the original menu interface can be completely ensured.
In software, the STM32F030 is implemented based on the C language. The basic functions are to acquire and recognize a plurality of gestures such as approach, flapping, quick waving and the like from the APDS-9960 through an I2C interface, convert the gestures into corresponding key actions, output low-level pulses to corresponding four ports and send gesture information to a core mainboard through a UART port. Within the valid detection range, the following gestures are recognized:
1. basic 2D gestures: four swing gestures of up, down, left and right. After recognition, the P1, P2, P1& P3 and P2& P3 ports are respectively driven to output low-level pulses, and the pulse width is 0.5 second; corresponding to the simulation of the output of the keys of 'up', 'down', 'left (up + confirm)' and 'right (down + confirm)';
2. basic proximity gesture: an "approach" gesture lasting for 1 second, and a "away" gesture lasting for 1 second. After the identification, the P3 and the P4 ports are respectively driven to output low-level pulses, and the pulse width is 0.5 second; the output of the 'confirm' and 'return' keys is simulated;
3. and (3) combining gestures: the three gestures of rapid left-right hand swinging, up-down hand swinging and rapid alternate ' approach/' far away ' are respectively driven to ports P1& P2& P3, P1& P2 and P3& P4, low-level pulses are output, and the pulse width is 0.5 second; the output of the "fast increase (up + down + confirm)", "fast decrease (up + down)", "help (confirm + return)", etc. keys may be simulated. Of course, the functions of these combined keys can be defined into other meanings according to the service requirement, such as "return to main menu", "lock screen", etc.
In addition, the microprocessor outputs the detected ambient light intensity value (including the simulation key information if necessary) to the core mainboard through the UART interface.
The software of the core mainboard receives the ambient light intensity value through the UART interface, and adjusts the backlight size of the LCD according to the value, thereby providing a comfortable display effect for an operator. And obtaining virtual key information corresponding to gesture recognition through a UART port or a key detection input port, and carrying out interaction of a user interface. Obviously, the original physical keyboards are only 4, and only can represent up, down, confirmation and return four kinds of information; and gesture recognition can finish the effect of the combined key which is difficult to realize physically, and at least 9 kinds of information such as up, down, confirmation, return, left, right, help, fast increase, fast decrease and the like are output, so that the interaction efficiency and the friendliness are greatly improved.
The monitoring unit of the communication power supply realizes non-contact interaction of power supply monitoring through the gesture recognition sensor and the microprocessor; the problems that a display area and a key interaction area are small and user experience is poor in an existing monitoring unit of the communication power supply are solved; the user experience is improved.
It will be understood by those of ordinary skill in the art that all or some of the steps of the methods, systems, functional modules/units in the devices disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.
The preferred embodiments of the present application have been described above with reference to the accompanying drawings, and are not intended to limit the scope of the claims of the application accordingly. Any modifications, equivalents and improvements which may occur to those skilled in the art without departing from the scope and spirit of the present application are intended to be within the scope of the claims of the present application.
Claims (10)
1. A man-machine interface board is characterized in that the man-machine interface board comprises a display screen, a gesture recognition sensor and a microprocessor;
the gesture recognition sensor is used for acquiring a gesture detection instruction issued by the microprocessor; detecting a user gesture above the display screen according to the gesture detection instruction and generating user gesture information; generating an interrupt signal according to the user gesture information;
the microprocessor is used for issuing a gesture detection instruction to the gesture recognition sensor; acquiring the user gesture information according to the interrupt signal; and identifying the user gesture information and outputting the identified user gesture information.
2. The human-machine interface board of claim 1, further comprising a keying circuit, a logic processing circuit and a jitter removal circuit;
the microprocessor comprises a level output port, and the key circuit comprises a key input end; the level output port and the key input end are connected to the input end of the logic processing circuit, and the output end of the logic processing circuit is connected to the input end of the jitter elimination circuit;
the microprocessor is also used for outputting a corresponding level signal through the level output port according to the recognized user gesture information;
the logic processing circuit is used for carrying out logic processing on the level signal output by the level output port and the signal of the key input end;
and the jitter elimination circuit is used for eliminating jitter of the signal logically processed by the logic processing circuit and outputting the signal after eliminating the jitter.
3. The human-machine interface board of claim 1, wherein the gesture recognition sensor is an infrared gesture recognition sensor;
the infrared gesture recognition sensor is internally integrated with a transmitting light source, a first photodiode for sensing infrared energy reflected in different directions and a second photodiode for sensing the light intensity of the environment.
4. The human-machine interface board of claim 1, wherein the gesture recognition sensor and the microprocessor are connected via an integrated circuit bus I2C communication interface and an interrupt interface.
5. A monitoring unit of a communication power supply, which is characterized by comprising a main controller and a man-machine interface board according to any one of claims 1 to 4;
and the main controller is used for acquiring the recognized user gesture information output by the human-computer interface board and returning user gesture response information to the human-computer interface board.
6. The monitoring unit of claim 5, wherein the human-machine interface board is connected to the main controller via any one of a UART interface, a SPI interface, and an I2C communication interface.
7. A method of controlling a human-machine interface board, the method comprising:
issuing a gesture detection instruction to a gesture recognition sensor; the gesture recognition sensor acquires a issued gesture detection instruction; detecting a user gesture above the display screen according to the gesture detection instruction and generating user gesture information; generating an interrupt signal according to the user gesture information;
acquiring the user gesture information according to the interrupt signal;
and identifying the user gesture information and outputting the identified user gesture information.
8. The method of claim 7, wherein generating an interrupt signal according to the user gesture information comprises:
comparing the parameter value in the user gesture information with the upper limit or the lower limit of a preset threshold;
and generating an interrupt signal under the condition that the parameter value in the user gesture information exceeds the upper limit or the lower limit of the preset threshold.
9. The method of claim 7, wherein recognizing the user gesture information and outputting the recognized user gesture information further comprises:
and acquiring user gesture response information.
10. A storage medium, characterized in that the storage medium stores thereon a control program of a human-machine interface board, the control program of the human-machine interface board realizing the steps of the control method of the human-machine interface board according to any one of claims 7 to 9 when executed by the processor.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811603732.4A CN111367401A (en) | 2018-12-26 | 2018-12-26 | Man-machine interface board and control method, monitoring unit and storage medium thereof |
| PCT/CN2019/126750 WO2020135231A1 (en) | 2018-12-26 | 2019-12-19 | Human-computer interface panel and control method therefor, monitoring unit, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811603732.4A CN111367401A (en) | 2018-12-26 | 2018-12-26 | Man-machine interface board and control method, monitoring unit and storage medium thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111367401A true CN111367401A (en) | 2020-07-03 |
Family
ID=71126117
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811603732.4A Pending CN111367401A (en) | 2018-12-26 | 2018-12-26 | Man-machine interface board and control method, monitoring unit and storage medium thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111367401A (en) |
| WO (1) | WO2020135231A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112215195A (en) * | 2020-10-25 | 2021-01-12 | 蒋芳 | Method and system for monitoring and recording access of articles in cabinet |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN2503527Y (en) * | 2001-08-03 | 2002-07-31 | 爱浪科技(中山)有限公司 | Contact key device with interpretting function |
| CN101849241A (en) * | 2007-10-17 | 2010-09-29 | 智能技术Ulc公司 | Interactive input system, controller therefor and method of controlling an appliance |
| CN104460987A (en) * | 2014-11-07 | 2015-03-25 | 惠州Tcl移动通信有限公司 | Electronic equipment capable of being controlled by non-contact gestures |
| US20150193011A1 (en) * | 2014-01-08 | 2015-07-09 | Microsoft Corporation | Determining Input Associated With One-to-Many Key Mappings |
| CN106776081A (en) * | 2017-01-10 | 2017-05-31 | 北京风行在线技术有限公司 | Button intelligent control system and method are realized in terminal |
| US20170209337A1 (en) * | 2016-01-22 | 2017-07-27 | Sundance Spas, Inc. | Gesturing Proximity Sensor for Spa Operation |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8661339B2 (en) * | 2011-05-31 | 2014-02-25 | Apple Inc. | Devices, methods, and graphical user interfaces for document manipulation |
| CN103576861A (en) * | 2013-11-18 | 2014-02-12 | 谢元澄 | Non-touch gesture control system |
| CN104866097B (en) * | 2015-05-22 | 2017-10-24 | 厦门日辰科技有限公司 | The method of hand-held signal output apparatus and hand-held device output signal |
| CN107122053A (en) * | 2017-04-27 | 2017-09-01 | 奥英光电（苏州）有限公司 | A kind of control method of display, device and display |
-
2018
- 2018-12-26 CN CN201811603732.4A patent/CN111367401A/en active Pending
-
2019
- 2019-12-19 WO PCT/CN2019/126750 patent/WO2020135231A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN2503527Y (en) * | 2001-08-03 | 2002-07-31 | 爱浪科技(中山)有限公司 | Contact key device with interpretting function |
| CN101849241A (en) * | 2007-10-17 | 2010-09-29 | 智能技术Ulc公司 | Interactive input system, controller therefor and method of controlling an appliance |
| US20150193011A1 (en) * | 2014-01-08 | 2015-07-09 | Microsoft Corporation | Determining Input Associated With One-to-Many Key Mappings |
| CN104460987A (en) * | 2014-11-07 | 2015-03-25 | 惠州Tcl移动通信有限公司 | Electronic equipment capable of being controlled by non-contact gestures |
| US20170209337A1 (en) * | 2016-01-22 | 2017-07-27 | Sundance Spas, Inc. | Gesturing Proximity Sensor for Spa Operation |
| CN106776081A (en) * | 2017-01-10 | 2017-05-31 | 北京风行在线技术有限公司 | Button intelligent control system and method are realized in terminal |
Non-Patent Citations (1)
| Title |
|---|
| 《AVAGO TECHNOLOGIES》: "APDS-9960 Digital Proximity,Ambient Light,RGB and Gesture Sensor", 《WWW.AVAGOTECH.COM》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112215195A (en) * | 2020-10-25 | 2021-01-12 | 蒋芳 | Method and system for monitoring and recording access of articles in cabinet |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020135231A1 (en) | 2020-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3693843B1 (en) | Method and apparatus for designating entire area using partial area touch in a portable equipment | |
| CN107181559B (en) | Processing method, device, storage medium and the terminal of radio frequency interference | |
| RU2632153C2 (en) | Method, device and terminal for displaying virtual keyboard | |
| CN102902476B (en) | A kind of method of touch terminal control electronic equipment and system thereof | |
| CN109164949A (en) | A kind of chat messages localization method and mobile terminal | |
| WO2013121807A1 (en) | Information processing device, information processing method, and computer program | |
| CN108920059A (en) | Message treatment method and mobile terminal | |
| JP7073122B2 (en) | Electronic devices, control methods and programs | |
| CN109446775A (en) | A kind of acoustic-controlled method and electronic equipment | |
| CN102226884A (en) | Touch screen control system and touch screen control method | |
| CN109634438A (en) | A kind of control method and terminal device of input method | |
| US20130127704A1 (en) | Spatial touch apparatus using single infrared camera | |
| CN111367401A (en) | Man-machine interface board and control method, monitoring unit and storage medium thereof | |
| US10423249B2 (en) | Information processing method and electronic device | |
| CN106033286A (en) | A projection display-based virtual touch control interaction method and device and a robot | |
| CN106293064A (en) | A kind of information processing method and equipment | |
| CN104850417B (en) | A kind of method and electronic equipment of information processing | |
| CN109032547A (en) | split screen processing method, device, storage medium and electronic equipment | |
| CN110647240A (en) | VR driving based multi-screen display and switching system and method | |
| CN103513762A (en) | Operating method using user gesture and digital device thereof | |
| CN110215686A (en) | Display control method and device, storage medium and electronic equipment in scene of game | |
| CN108062175B (en) | Screen operation control method and device and terminal | |
| CN204883661U (en) | Mobile terminal with light sense touch key | |
| CN108924345A (en) | Photographic method, camera arrangement and mobile terminal | |
| CN105843368B (en) | A kind of electronic device and response method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200703 |