WO2015109887A1

WO2015109887A1 - Apparatus and method for determining validation of operation and authentication information of head-mounted intelligent device

Info

Publication number: WO2015109887A1
Application number: PCT/CN2014/091701
Authority: WO
Inventors: 柳英丽
Original assignee: 北京奇虎科技有限公司; 奇智软件（北京）有限公司
Priority date: 2014-01-24
Filing date: 2014-11-19
Publication date: 2015-07-30

Abstract

Disclosed is an apparatus for determining the operation validation of a head-mounted intelligent device, comprising: a motion sensing module for sensing motion information of human eyes; a specified information acquisition module for acquiring temperature information of a human body; a motion validation determination module for determining the validation of the motion information on the basis of the temperature information, wherein the motion sensing module and the specified information acquisition module are both provided on the head-mounted intelligent device. On the basis of the technical solution of the present invention, real-time monitoring of specified information of a user of the head-mounted intelligent device may be realized, and real-time validation determination of eyes motion information received by the head-mounted intelligent device may be realized on the basis of the specified information monitored in real time.

Description

Apparatus and method for judging operation of headset smart device and validity of authentication information

Technical field

The present invention relates to a smart device, and more particularly to an apparatus and method for determining the operation of a smart device and the validity of authentication information.

Background technique

The head-mounted device can integrate a camera device and a control chip to form a head-mounted smart device (such as a smart glasses device), providing users with rich personalized functions and information. With the development of science and technology, the practicality and entertainment of head-mounted smart devices have been continuously enhanced, and are now being applied to various fields such as people's work and life.

A head-mounted smart device refers to a program that is provided by a software service provider such as a smart phone and has a separate operating system. The user can install software, games, and the like, and can add a schedule, map navigation, and interact with friends through voice or motion control. Take photos and videos, start a video call with friends, and access wireless networks via a mobile communication network.

At present, human-computer interaction mostly uses human body language to send command signals to the computer, such as sending signals to the computer through the mouse, controlling the game through the body, and using the finger to click on the touch screen, while the head-mounted smart device can View the calendar, time, temperature, and geographic location by voice control or visual control (for example, blinking, nodding, shaking, voice), perform voice search, video call, identify direction, music play, web search, send and receive SMS or e-mail, photo, video and other functions, in addition to the above functions, the head-mounted smart device can also interact with the environment to expand the reality, for example: if you see the subway out of service, the glasses will show the reason for the subway outage, and Provide alternative routes; if you see a book you like, you can check the book review and price; if you are waiting for a friend, the smart device will show the friend's location.

With the intelligentization of human-computer interaction, in the prior art, although some operations can be performed by controlling the head-mounted smart device through information such as human eye movements, there is no way to determine the motion information received by the device. The way of validity may cause the device to perform the received invalid action information or ignore the valid action information received. Inconvenience or loss to the user.

In addition, as people's privacy requirements for private information and the like are getting higher and higher, although the collection of biological features such as iris information and auricle information through the prior art can meet the requirements of identity authentication to a certain extent, it cannot Determining the validity of the authentication information in real time, so that the smart device may be used by others after the user identity authentication is passed, for example, others may perform some unauthorized operations through the smart device or Get user privacy information.

Therefore, it is necessary to improve the existing technical solutions, and provide an apparatus and method for judging the operation of the smart device and the validity of the authentication information.

Summary of the invention

In view of the above problems, the present invention has been made in order to provide an apparatus for judging the operation and authentication information validity of a head-mounted smart device that overcomes the above problems or at least partially solves or alleviates the above problems, and a corresponding judging smart device The operation and method of authenticating the validity of the information.

According to an aspect of the present invention, an apparatus for determining the operational effectiveness of a head-mounted smart device is provided, including a motion sensing module for sensing an action of a human eye, and a designated information acquisition module for acquiring a designation of at least one part of the human body. The action validity determining module is configured to determine the validity of the action according to the specified information, wherein the action sensing module and the specified information acquiring module are all disposed on the smart device. .

According to another aspect of the present invention, an apparatus for determining validity of authentication information of a head-mounted smart device is provided, including an identity identification information acquiring module, configured to acquire identity identification information, and an identity identification information authentication module, configured to And authenticating the identification information to obtain authentication information; the specified information acquiring module is configured to acquire the specified information of at least one part of the human body; and the authentication information validity determining module is configured to perform authentication on the identification information. In the case, it is determined whether the authentication information is valid according to the specified information.

According to another aspect of the present invention, a method for determining the operational effectiveness of a head-mounted smart device is provided, comprising the steps of: sensing motion information of a human eye, the motion information being related to an operation instruction of the head-mounted smart device Correspondingly, for manipulating the head-mounted smart device; acquiring specified information; determining validity of the action information according to the specified information.

According to another aspect of the present invention, there is provided a method for determining a headset smart device authentication letter The method for determining the validity of the information includes the steps of: obtaining identification information, the identification information is used to identify the identity of the user of the smart device; and authenticating the identification information to obtain authentication Information, the authentication information indicating whether the identification information passes the authentication; acquiring the specified information; and determining whether the authentication information is valid according to the specified information if the identification information is authenticated.

According to still another aspect of the present invention, there is provided a computer program comprising computer readable code, when said computer readable code is run on a server, causing said server to perform any of claims 22-23 The method for determining the operational effectiveness of the head-mounted smart device or the method for determining the validity of the authentication information of the smart device. .

According to still another aspect of the present invention, a computer readable medium storing the computer program according to claim 24 is provided.

The beneficial effects of the invention are:

According to the technical solution of the present invention, the determination of the operation effectiveness of the head-mounted smart device can be realized by detecting the body temperature information of the user of the head-mounted smart device.

According to the technical solution of the present invention, the validity of the authentication information of the head-mounted smart device can be verified.

The above description is only an overview of the technical solutions of the present invention, and the above-described and other objects, features and advantages of the present invention can be more clearly understood. Specific embodiments of the invention are set forth below.

DRAWINGS

Various other advantages and benefits will become apparent to those skilled in the art from a The drawings are only for the purpose of illustrating the preferred embodiments and are not to be construed as limiting. Throughout the drawings, the same reference numerals are used to refer to the same parts. In the drawing:

1 is a block diagram showing a first embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention;

2 is a block diagram showing a second embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention;

2a is a block diagram showing the structure of a second embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention;

FIG. 2b is a schematic structural diagram of a second embodiment of an apparatus for determining the operational effectiveness of a smart device according to an embodiment of the present invention;

FIG. 3 is a block diagram showing another apparatus structure of a second embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention; FIG.

FIG. 4 is a block diagram showing the structure of still another apparatus for determining the operational effectiveness of the smart device according to an embodiment of the present invention; FIG.

FIG. 5 is a block diagram showing a third embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention; FIG.

FIG. 5 is a block diagram showing the structure of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention;

FIG. 5b is a schematic structural diagram of a third embodiment of an apparatus for determining the operational effectiveness of a smart device according to an embodiment of the present invention;

FIG. 6 is a block diagram showing another structure of another apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention; FIG.

FIG. 6a is a block diagram showing another apparatus structure of a third embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention;

FIG. 6b is a schematic structural diagram of still another apparatus for determining the operational effectiveness of the smart device according to an embodiment of the present invention;

FIG. 7 is a block diagram showing still another structure of a third embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention; FIG.

FIG. 8 is a block diagram showing a fourth embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention; FIG.

FIG. 8a is a block diagram showing the structure of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention;

FIG. 8b is a schematic structural diagram of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention; FIG.

FIG. 9 is a block diagram showing another structure of another apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention; FIG.

Figure 9a is a schematic illustration of a headset smart in accordance with one embodiment of the present invention. A block diagram of another apparatus structure of the fourth embodiment of the device operation effectiveness;

FIG. 9b is a schematic structural diagram of still another apparatus for determining the operational effectiveness of the smart device according to an embodiment of the present invention;

FIG. 10 is a structural block diagram of Embodiment 5 of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention; FIG.

FIG. 10 is a block diagram showing the structure of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention; FIG.

FIG. 11 is a block diagram showing another structure of another apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention; FIG.

FIG. 12 is a schematic diagram showing RGB three colors obtained after processing a video with a duration of 30 pulse periods according to Embodiment 5 of the apparatus for determining the operational effectiveness of the head-mounted smart device according to an embodiment of the present invention. Schematic diagram of signal sequence data;

FIG. 13 is a schematic diagram showing the facial video acquisition data of a 30-pulse cycle of the fifth embodiment of the device for determining the operational effectiveness of the smart device according to an embodiment of the present invention, and then performing ICA processing, and then using arithmetic mean Schematic diagram of the effect after filtering and filtering;

FIG. 14 is a schematic structural diagram of a photosensor of a fifth embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the invention; FIG.

FIG. 15 is a block diagram showing the structure of a photoelectric intelligent pulse measurement system according to Embodiment 5 of the apparatus for determining the operational effectiveness of the smart device according to an embodiment of the present invention;

FIG. 16 is a block diagram showing the structure of still another apparatus for determining the operational effectiveness of the head-mounted smart device according to an embodiment of the present invention; FIG.

FIG. 17 is a flow chart showing the steps of a first embodiment of a method for determining the operational effectiveness of a smart device according to an embodiment of the invention;

FIG. 18 is a flow chart showing the steps of a second embodiment of a method for determining the operational effectiveness of a smart device according to an embodiment of the invention;

FIG. 19 is a flow chart showing the steps of a third embodiment of a method for determining the operational effectiveness of a smart device according to an embodiment of the present invention;

FIG. 20 is a flow chart showing the steps of a method for determining the operational effectiveness of the smart device according to an embodiment of the present invention;

FIG. 21 is a flow chart showing the steps of the fifth embodiment of the method for determining the operational effectiveness of the smart device according to an embodiment of the present invention;

FIG. 22 is a block diagram showing a first embodiment of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention;

FIG. 23 is a structural block diagram of Embodiment 2 of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention;

FIG. 24 is a block diagram showing the structure of an apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention;

FIG. 25 is a block diagram showing another structure of another apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention; FIG.

FIG. 26 is a block diagram showing another apparatus structure of a second embodiment of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention; FIG.

FIG. 27 is a block diagram showing the structure of still another apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention; FIG.

FIG. 28 is a structural block diagram of Embodiment 3 of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention;

FIG. 29 is a block diagram showing the structure of an apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention; FIG.

FIG. 30 is a block diagram showing another structure of another apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention;

FIG. 31 is a block diagram showing another apparatus structure of a third embodiment of apparatus for determining validity of authentication information of a head-mounted smart device according to an embodiment of the present invention; FIG.

FIG. 32 is a block diagram showing the structure of still another apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention; FIG.

FIG. 33 is a structural block diagram of Embodiment 4 of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention; FIG.

FIG. 34 is a block diagram showing the structure of an apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention; FIG.

FIG. 35 is a block diagram showing another structure of another apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention; FIG.

FIG. 36 is a block diagram showing another apparatus structure of a fourth embodiment of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention; FIG.

Figure 37 is a schematic illustration of a headset smart in accordance with one embodiment of the present invention. A structural block diagram of the fifth embodiment of the device for authenticating the authentication information of the device;

FIG. 38 is a block diagram showing the structure of an apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention;

FIG. 39 is a block diagram showing another structure of another apparatus for determining the validity of the authentication information of the smart device according to an embodiment of the present invention; FIG.

FIG. 40 is a block diagram showing another apparatus structure of a fifth embodiment of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention; FIG.

FIG. 41 is a flow chart showing the steps of a method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention;

FIG. 42 is a flow chart showing the steps of a second embodiment of a method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention;

FIG. 43 is a flow chart showing the steps of the third embodiment of the method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention;

FIG. 44 is a flow chart showing the steps of a method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention;

FIG. 45 is a flow chart showing the steps of the fifth embodiment of the method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention;

Figure 46 is a schematic block diagram showing a server for performing the method according to the present invention;

Figure 47 shows schematically a storage unit for holding or carrying program code implementing the method according to the invention.

Specific embodiment

The invention is further described below in conjunction with the drawings and specific embodiments.

As shown in FIG. 1 , FIG. 1 is a structural block diagram of a first embodiment of an apparatus for determining the operational effectiveness of a smart device according to an embodiment of the present invention, including a motion sensing module 10 for sensing an action of a human eye; The specified information obtaining module 20 is configured to acquire the specified information of the at least one part of the human body; the action validity determining module 30 is configured to determine the validity of the action according to the specified information, wherein the motion sensing module 10 specifies the information. The acquisition modules 20 are all disposed on the head mounted smart device.

According to the technical solution of the present invention, it can be used by a user of a head-mounted smart device. The detection of the specified information enables the determination of the operational effectiveness of the head-mounted smart device.

As shown in FIG. 2, FIG. 2 is a structural block diagram of a second embodiment of a device for determining the operational effectiveness of a smart device according to an embodiment of the present invention. The device includes a motion sensing module 110a for sensing human eyes. The action information; the temperature sensing module 120a is configured to acquire the body temperature information of the human body; the action validity determining module 130a is configured to determine the validity of the action according to the body temperature information, wherein the motion sensing module 110a and the temperature sensing module 120a are disposed on the head Wearable smart devices.

The temperature sensing module 120a acquires body temperature information of the human body including continuous body temperature information within a predetermined time length or a set action interval, or is acquired in a predetermined period between a certain time or a set action interval. The point value of the body temperature information.

In addition, in other embodiments, the time period in which the temperature sensing module 120a acquires the body temperature information of the human body is not limited to the above-mentioned certain time length or the set action interval, and the head-mounted smart device may perform some During the operation period, it may be within the total time allowed by the hardware environment such as power, and there is no special limitation.

In addition, in a specific embodiment, the temperature sensing module 120a may also acquire other temperature information according to actual conditions, and is not limited to the body temperature information of the human body described above.

For example, in the following specific embodiments, according to the technical solution of the present invention, a device for determining the operational effectiveness of the head-mounted smart device is provided, and the device determines the validity of the manipulation signal of the head-mounted smart device by detecting a change in the body temperature of the human body.

For example, FIG. 2a and FIG. 2b show a device 100a for determining the operational effectiveness of the head-mounted smart device, wherein FIG. 2a is a structural block diagram of the device, and FIG. 2b is a schematic structural view of the device, the device includes a wearing support device 10a, The body temperature measuring sensor 20a, the motion sensor 30a, and the motion effectiveness determining module 130a, the body temperature measuring sensor 20a and the motion sensor 30a are both connected to the motion effectiveness determining module 130a, and are disposed on the wearing support device 10a, wherein the body temperature measuring sensor The sensor 20a is configured to sense the body temperature information of the user of the head-mounted smart device for a predetermined period of time, and convert the sensed body temperature information into an electrical signal to the action validity determining module 130a, and the action sensor 30a is configured to sense the head. The human eye motion information of the user of the wearable smart device converts the sensed motion information into an electrical signal to the action validity determination module 130a, and the action validity determination module 130a receives the body temperature signal representing the person And an electrical signal of the interest rate, and calculating a difference between the real-time detected body temperature information and the pre-analyzed average body temperature information value, and performing an electrical signal indicating the difference between the electrical signal and the pre-stored allowable body temperature change difference range In comparison, in the case where the electrical signal indicating the difference falls within the range of allowable temperature change variation values stored in advance, it is determined that the human eye motion currently sensed by the motion sensor 30 is valid, and the action is allowed to be performed. The command information is indicated. Otherwise, it is considered that the human eye motion detected by the motion sensor 30a is invalid and ignored.

Moreover, in the present embodiment, the wearing support device 10a is worn on the user's head, the body temperature measuring sensor 20a is a non-contact body temperature measuring sensor, the head-mounted smart device is a glasses-type structure, and the body temperature measuring sensor 20a is disposed in the glasses. The front end portion of the bracket is electrically connected to the control system of the glasses to continuously detect the body temperature information of the user. Of course, in other embodiments, the body temperature measuring sensor may also be provided with a plurality of individual temperature measuring sensors. The average value of the body temperature value is taken as the body temperature information. Of course, in other embodiments, the head-mounted smart device may also be an earphone, a cap, a head cover, etc., as long as the temperature measuring sensor can be fixed to the detecting portion of the user. In addition, in other embodiments, the body temperature measuring sensor 20a may be a contact body temperature measuring sensor, which may be disposed on the nose pad of the glasses.

In addition, in another embodiment, the action validity determining module 130a may also compare the body temperature information received in real time with the preset body temperature information range, and the body temperature information received in real time is within the preset body temperature information range. In this case, it is determined that the motion information of the human eye sensed by the current motion sensing module is valid.

Further, the apparatus may further include a display screen as needed, and in the case of having a display screen, the body temperature measuring sensor 20a transmits the detected body temperature information to the display screen, and displays the user's body temperature information through the display screen.

As shown in FIG. 3, in another embodiment, a structural block diagram of a device for determining the operational effectiveness of a head-mounted smart device, wherein the temperature sensing module 120a includes an optical probe 121a, a photoelectric conversion module 122a, and a signal modulation module 123a, and The optical probe 121a, the photoelectric conversion module 122a, and the signal modulation module 123a are sequentially and electrically connected. The optical probe 121a corresponds to the detection site of the user, such as the ear, the forehead, and the bridge of the nose, to detect the body temperature information of the user, and to sense the body temperature of the user.

When the motion sensing module 110a senses the motion of the human eye, the temperature sensing module 120a starts to acquire the body temperature information of the current user of the smart device until the motion sensing module The temperature sensing module 120a stops sensing the body temperature information when the block 110a does not sense the human eye motion or receives the operation end command. In other embodiments, the time when the temperature sensing module 120a senses the human body temperature information may also be performed by a certain operation. In the time range, it can also be the total time allowed by the hardware environment such as the power. In short, as long as the motion sensing module 110a senses the human eye motion, the temperature sensing module 120a should be accompanied by the detection of the body temperature information, thereby implementing an operation. Monitoring of the effectiveness of actions.

The optical probe 121a transmits the detected body temperature signal to the photoelectric conversion module 122a, and the body temperature signal is converted into an electrical signal via the photoelectric conversion module 122a and transmitted to the signal modulation module 123a. The signal modulation module 123a amplifies and filters the electrical signal, and transmits the signal to the action. Validity determination module 130a.

In this embodiment, the action validity determining module 130a includes a signal analysis processing module 131a and a comparison module 132a. The signal analysis processing module 131a analyzes the average value of the body temperature within a predetermined period of time, and calculates the real-time temperature value and the average value. The difference, the comparison module 132a compares the difference with the preset allowable change difference, and determines that the action detected by the received motion sensing module 110a is valid within the allowed change difference, and the sending indicates that the action is allowed to be performed. The signal is considered to be invalid. In addition, in other embodiments, the comparison module 132a may also perform the body temperature value received in real time and the maximum and minimum values of the body temperature in a period of time obtained by the signal analysis processing module. In comparison, if the body temperature value received in real time is greater than the maximum value of the body temperature obtained in advance or less than the minimum value of the body temperature obtained in advance, it is determined that the eye motion sensed by the current motion sensing module 110a is invalid, and the Action, conversely, if the body temperature value received in real time is less than the body temperature obtained in advance Value and greater than a predetermined minimum temperature obtained in the analysis, the identified person is to receive the current motion sensing module 110a eyes effective operation, and the operation instruction allowed to execute the operation corresponding to the human eye.

Furthermore, in the present embodiment, the comparison module 132a may further include an adjustable resistor (not shown) and an adjustment member (not shown), wherein the adjustable resistor is used to adjust the threshold voltage signal, in this embodiment, The adjusting member changes the resistance value of the adjustable resistor to adjust the threshold voltage signal.

In addition, the comparison module 132a may further include a storage unit (not shown) for storing body temperature information, for storing the preset body temperature information allowing the change difference, or analyzing the obtained predetermined time. The maximum and minimum values of body temperature in the interval.

In addition, the comparison module 132a further includes an information collecting unit (not shown) connected to the storage unit for using the head mounted device for the first time, or the case where the smart device is to be replaced by the user The user identity information is collected, and when the information collection unit receives the information collection instruction, the user identity information needs to be read and saved for a certain period of time (for example, 3 minutes), during which time, The information collecting unit module continuously reads the body temperature information of the current user, records the overall change trend of the body temperature information in the time period, and determines the allowable change difference range of the body temperature information according to the change trend, and indicates the allowable change difference. The electrical signals of the range of values are stored in the storage unit. Under normal circumstances, it may happen that a person's body temperature information changes drastically at one or more time points beyond the fluctuation range, but as long as the drastic change duration is very short, or only a time point appears, and After the change is restored, the overall trend of the information has not changed, and the situation is still considered to be valid for action validity.

Moreover, in another embodiment, the means for determining the operational effectiveness of the head-mounted smart device may further comprise an alarm module (not shown). The alarm module and comparison module 132a are connected by a communication interface. The comparison module 132a controls the start or stop of the alarm module by comparing the body temperature signal with the threshold signal. Specifically, the comparison module 132a compares the difference between the body temperature value and the average body temperature value and the preset allowable change difference value in real time, and when the difference value detected in real time is less than the preset allowable change difference value, the comparison module 132a The alarm signal is output and transmitted to the alarm module, and the alarm module is controlled to start or stop accordingly.

It can be understood that the connection between the alarm module and the comparison module 132a can also be implemented by wire or wirelessly. In this embodiment, the communication module is connected to the comparison module 132a via the Internet.

It can be understood that the alarm module can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm. At the same time, the alarm module can be arranged either on the head mounted device or on a processing unit independent of the head mounted device.

The above device for determining the operational effectiveness of the head-mounted smart device has the following advantages: First, the wearer support device 10a worn on the user can realize long-term automatic continuous body temperature detection for the user; second, the device uses Safe, can avoid traditional mercury thermometers The use of hidden dangers; third, the device is easy to wear, can be remotely monitored, no manual measurement; Fourth, the scope of application is wide, according to the user's physical differences, the corresponding threshold signal can be adjusted accordingly, so that different individuals can be targeted Implement differentiated measurements.

In addition, in another embodiment, as shown in FIG. 4, the temperature sensing module 120a includes an integrated temperature sensor 124a, a signal conditioning circuit 125a, and the action validity determining module 130a includes a signal analysis processing module 131a and a comparison module 132a, and a signal conditioning circuit. 125a is connected to the signal analysis processing module 131a, and the output end of the body temperature sensor 124a is connected to the input end of the signal conditioning circuit 125a. The signal conditioning circuit 125a is configured to convert the body temperature information sensed by the body temperature sensor 124a into an identifiable by the analysis processing module 131a. The electrical signal, signal analysis processing module 131a receives the electrical signal representing the body temperature information from the signal conditioning circuit 125a, and analyzes the average value of the body temperature over a predetermined period of time, and calculates the difference between the real-time temperature value and the average value, and compares The module 132a compares the difference with the preset allowable change difference, determines that the action sensed by the motion sensing module 110a is valid within the allowed change difference, and sends a signal indicating that the instruction represented by the action is allowed to be executed. Otherwise, the action is considered invalid and the action is ignored.

In particular, signal conditioning circuit 125a is used to transform an analog signal into a digital signal for data acquisition, control processes, performing computational display readout, or other purposes. The body temperature sensor 124a measures the user's body temperature information, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current, or resistance change, and therefore must be amplified and buffered before being converted into a digital signal. Or scaling the analog signal, etc., that is, the conditioning process, making it suitable for the input of an analog-to-digital converter (ADC). Then, the ADC digitizes the analog signal and sends the digital signal to the MCU or other digital device for use. Data processing in the system.

In addition, in any of the above embodiments, the action validity determining module 130a may be disposed on the head-mounted smart device, or may be disposed on a processing unit other than the head-mounted smart device, and through the communication unit. And the corresponding communication interface and the head-mounted smart device to achieve a communication connection, wherein the connection mode includes wifi, Bluetooth, and the like.

In addition, in any of the above embodiments, the power saving device may further be added, and the device is configured to detect the body temperature information in the preset range within a certain time (for example, 5 minutes) of the temperature sensing module, The default is that the head-mounted device leaves the human body, or the use of an abnormality automatically enters a sleep state.

In addition, the above-mentioned head-mounted smart device may be glasses, a hat, a headphone, a head cover, and the like.

As shown in FIG. 5, FIG. 5 is a structural block diagram of a third embodiment of a device for determining the operational effectiveness of a smart device according to an embodiment of the present invention. The smart device includes a motion sensing module 110b for The action information acquiring module 120b is configured to acquire image information of at least one feature part of the human head or the face; the action validity determining module 130b is configured to compare the image information with the pre-stored standard image information. As a result, the validity of the action is determined, wherein the motion sensing module 110b and the feature information acquiring module 120b are all disposed on the head-mounted smart device.

The feature information acquiring module 120b acquires image information of at least one feature part of the human head or the face, and the image information includes image information between preset time periods or set action intervals.

Moreover, the action validity determining module 130b determines the operational validity of the head-mounted smart device based on the comparison result between the acquired image information and the pre-stored standard image information.

In addition, in other embodiments, the time period of the image information acquired by the feature information acquiring module 120b is not limited to the continuous image information between the certain time or the set action interval, and may be the head-mounted smart. The time period during which the device performs a certain operation process may also be within the total time allowed by the hardware environment such as the power amount, and there is no special limitation.

In addition, in the specific embodiment, the image information acquired by the feature information acquiring module 120b may also include other image information, and is not limited to the image information of at least one feature portion of the human head or the face.

For example, in the following specific embodiments, FIG. 5a and FIG. 5b show an apparatus 100b for determining the operational effectiveness of the head-mounted smart device, wherein FIG. 5a is a structural block diagram of the head-mounted smart device, and FIG. 5b is a smart device of the head-mounted smart device. The head-mounted smart device includes a wearing support device 10b, an image sensor 20b, a motion sensor 30b, and an action validity determining module 130b, wherein the image sensor 20b and the motion sensor 30b are both associated with the action validity determining module 130b. Connected to and disposed on the wearing support device 10b, and the image sensor 20b is configured to acquire image information of a designated portion of the face of the current user of the smart device, and convert the image information into an electrical signal for transmission to the action validity. Judgment module 130b, motion sensing The device 30b is configured to sense the human eye motion, convert the sensed motion information into an electrical signal, and transmit the motion signal to the motion validity determining module 130b, and the motion validity determining module 130b receives the electrical signal indicating the image information received in real time, and Comparing the electrical signal with a pre-stored electrical signal representing standard image information, and if the two match, determining that the human eye motion currently sensed by the motion sensor 30b is valid, and allowing the action to be performed The command information is indicated. Otherwise, it is considered that the human eye motion detected by the motion sensor 30b is invalid and ignored.

It should be noted that, when the motion sensing module 110b senses the human eye motion, the feature information acquiring module 120b starts acquiring the image information until the motion sensing module 110b does not sense the human eye motion or receives the operation end instruction. The information acquiring module 120b stops sensing the image information. In other embodiments, the time when the feature information acquiring module 120b senses the image information may be within a time range in which an operation is performed, or may be a time allowed by a hardware environment such as a power source. In summary, as long as the motion sensing module 110b senses the human eye motion, the feature information acquiring module 120b should be accompanied by the detection of the image information, thereby realizing the monitoring of the effectiveness of the ongoing operation of a certain operation.

It should be noted that the drawings shown in the drawings are schematic diagrams and do not represent real products. In practical applications, the shape, size, and position of each module can be set as needed.

The wearing support device 10b is worn on the user, and fixes the image sensor 20b to the detecting portion of the user to continuously detect at least two actions between the human eye movements of the at least one characteristic portion of the user or the set action. In the present embodiment, the wearing support device 10b is worn on the head of the subject, which is a glasses-type structure, and the image sensor 20b is disposed at the front end portion of the bracket of the glasses. Of course, in other embodiments The head-mounted smart device may also be an earphone, a hat, a head cover, etc., as long as the image sensor 20b and the user's detection portion are relatively fixed in position, and the head-mounted smart device is provided as needed. A display screen may also be included, in the case of having a display screen, the image sensor 20b transmits the detected image information to a display screen and displays the image information through the display screen.

In addition, in another specific embodiment, as shown in FIG. 6, a structural block diagram of an apparatus for determining the operational effectiveness of the head-mounted smart device, wherein the feature information acquiring module 120b includes an image sensing module 121b, a photoelectric conversion module 122b, and a signal The modulation module 123b, and the image sensing module 121b, the photoelectric conversion module 122b, and the signal modulation module 123b are sequentially electrically connected.

The image sensing module 121b is configured to sense an image signal of a target position. In this embodiment, the image sensing module 121b may be a camera.

The image sensing module 121b transmits the sensed image signal to the photoelectric conversion module 122b, and the image signal is converted into an electrical signal via the photoelectric conversion module 122b and transmitted to the signal modulation module 123b, and the signal modulation module 123b amplifies and filters the electrical signal, and transmits To the action validity determination module 130b.

The action validity judging module 130b includes a signal analysis processing module 131b and a comparison module 132b. The signal analysis processing module 131b analyzes the pixels, and/or size, and/or feature point positions of the received image information, and calculates real-time image information and Comparing the difference between the pixels of the pre-stored standard image information, and/or the size, and/or the average of the feature point positions, the comparison module 132b compares the difference with the preset allowable change difference, where allowed The change difference is determined to be effective, and the operation instruction corresponding to the human eye motion sensed by the current motion sensing module 110b is allowed to be executed. Otherwise, if the difference is outside the allowable change difference, the current motion sensing is determined. The eye movement information sensed by the module 110b is invalid, and the action is ignored.

Furthermore, in the present embodiment, the comparison module 132b further includes an adjustable resistor (not shown) and an adjustment member (not shown), wherein the adjustable resistor is used to adjust the threshold voltage signal, in this embodiment, by adjusting Piece to change the resistance value of the adjustable resistor to adjust the threshold voltage signal.

In addition, the comparison module 132b further includes a storage unit (not shown) that stores body temperature information for storing preset image information allowing variation differences.

In addition, the comparison module 132b further includes an information collecting unit (not shown) connected to the storage unit for using the head mounted device for the first time, or the case where the smart device is to be replaced by the user The user identity information is collected, and when the information collection unit receives the information collection instruction, the user identity information needs to be read and saved for a certain period of time (for example, 3 minutes), during which time, The information collecting unit module continuously reads the image information of a specified part of the current user's face, records the overall change trend of the image information in the time period, and determines the allowable change difference range of the image information according to the change trend, and An electrical signal indicating the range of allowable variation values is stored in the storage unit.

In addition, as shown in FIGS. 6a and 6b, another apparatus 200b for determining the operational effectiveness of the head-mounted smart device further includes an alarm module 40b. Alarm module 40b and action validity judgment The break modules 130b are connected. In the present embodiment, the alarm module 40b is connected to the action validity judgment module 130b via a communication interface (not shown), and the action validity judgment module includes a comparison module (not shown). The action validity judgment module 130b controls the start or stop of the alarm module 40b by the comparison result of the image signal and the threshold value signal. Specifically, the comparison module compares the difference between the real-time monitored image information and the pre-stored standard image information with the allowable variation difference range, between the real-time monitored image information and the pre-stored standard image information. When the difference exceeds the maximum threshold value of the allowable variation difference range, the output comparison result is an alarm signal, which is transmitted to the alarm module 40b, and controls the start or stop of the alarm module 40b accordingly.

In addition, in other embodiments, image pixels, and/or size, and/or feature point position coordinates received in real time may be combined with preset image pixels, and/or size, and/or feature point position coordinate ranges. For comparison, if the image pixels, and/or size, and/or feature point position coordinates received in real time exceed the preset range, it is determined that the currently received motion information is invalid.

It can be understood that the alarm module 40b can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm. Meanwhile, the alarm module 40b may be disposed on the head-mounted smart device or on a processing unit independent of the head-mounted smart device, if the alarm module 40b is disposed independently of the head-mounted smart device. On the processing unit, the alarm module 40b can communicate with the action validity determining module 130b via a wireless device such as Bluetooth or wifi.

In addition, in another embodiment, as shown in FIG. 7, the apparatus for determining the operational effectiveness of the head-mounted smart device, the feature information acquiring module 120b includes an image sensor 124b and a signal conditioning circuit 125b, and an output of the image sensor 124b. Connected to the input of the signal conditioning circuit 125b, the action validity determination module 130b includes a signal analysis processing module 131b and a comparison module 132b, the signal conditioning circuit 125b is coupled to the signal analysis processing module 131b, and the signal conditioning circuit 125b is used to image the sensor 121b The acquired image signal is converted into an electrical signal recognizable by the signal analysis processing module 131b.

The signal analysis processing module 131b analyzes the pixels, and/or size, and/or feature point locations of the received image information, and calculates the pixels, and/or size, and/or size of the real-time image information and the pre-stored standard image information. The difference between the average values of the feature point positions, comparison module 132b Comparing the difference with a preset allowable change difference, determining that the action is valid within the allowed change difference, allowing the action to be performed, and conversely, if the difference is outside the allowed change difference, If the action is invalid, the action information sensed by the motion sensing module 110b is ignored.

In particular, signal conditioning circuit 125b is used to transform an analog signal into a digital signal for data acquisition, control processes, performing computational display readouts, or other purposes. The image sensor 124b measures the image information of the user, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current or resistance change, and therefore must be amplified and buffered before being converted into a digital signal. Or scaling the analog signal, etc., that is, the conditioning process, making it suitable for the input of an analog-to-digital converter (ADC). Then, the ADC digitizes the analog signal and sends the digital signal to the MCU or other digital device for use. Data processing in the system.

In addition, in any of the above embodiments, the action validity determining module 130b may be disposed on the head-mounted smart device, or may be disposed on a processing unit independent of the head-mounted smart device, if the action validity determining module The 130b is disposed on a processing unit independent of the head-mounted smart device, and the action validity determining module 130b can implement a communication connection with the head-mounted smart device through a wireless device such as wifi or Bluetooth.

As shown in FIG. 8, FIG. 8 is a structural block diagram of a fourth embodiment of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention. The device includes a motion sensing module 110c for sensing human eyes. The action information obtaining module 120c is configured to obtain pressure information of the head-mounted smart device disposed on the weight-bearing portion of the human body; the action validity determining module 130c is configured to determine the validity of the action according to the pressure information, wherein the motion sensing module 110c The pressure information acquisition module 120c is disposed on the head-mounted smart device.

The pressure information acquiring module 120c acquires continuous pressure information between actions of the human eye at a certain time or at least two times, when the difference value of the pressure information or the pressure information changes within a corresponding set threshold value range. When it is determined, the action is valid and the action is performed.

In addition, in the specific embodiment, the pressure information acquired by the pressure information acquiring module 120c may also be the pressure information received by the module, and is not limited to the pressure information of the above-mentioned head-mounted smart device disposed on the weight bearing portion of the human body.

For example, in the following specific embodiments, the device 100c for determining the operational effectiveness of the head-mounted smart device is shown in FIG. 8a and FIG. 8b, wherein FIG. 8a is a structural block diagram of the device, and FIG. 8b is the device. The device 100c for determining the operational effectiveness of the head-mounted smart device includes a wearing support device 10c, a pressure sensor 20c, a motion sensor 30c, and an action validity determining module 130c, wherein the pressure sensor 20c is configured to acquire pressure information and The acquired pressure information is converted into an electrical signal, and the motion sensor 30c is configured to acquire an action of the human eye and convert the acquired eye motion into an electrical signal, and the pressure sensor 20c and the motion sensor 30c are both associated with the motion validity determining module 130c. Connected and disposed on the wearing support device 10c, the action validity determining module 130c receives the electrical signal indicating the pressure information transmitted by the pressure sensor 20c, and the electrical signal indicating the motion information of the human eye transmitted by the motion sensor 30c, and according to a predetermined schedule Whether the received electrical signal indicating the pressure information is continuous and whether the fluctuation is within a predetermined range determines whether the detected human eye motion information is valid during the time period, wherein the predetermined time period may be the wearing During the period of operation of a smart device, it can also be There are no special restrictions on the total time allowed in hardware environments such as power.

In addition, in other embodiments, the action validity determining module 130c may be disposed on a separate unit outside the wearing support device 10c and communicatively coupled to the head-mounted smart device.

The wearing support device 10c is worn on the user, and fixes the pressure sensor 20c to the detecting portion of the user to continuously detect the pressure information of the bearing portion of the user. In the embodiment, the wearing support device 10c is worn on the user. The head is in the eyeglass-type structure, and the pressure sensor 20c is disposed on the nose pad of the eyeglass. Of course, in other embodiments, the head-mounted smart device can also be a headset, a hat, a head cover, etc., as long as the pressure can be achieved. The sensor 20c may be fixed to the load bearing portion of the user. For example, the pressure sensor 20c may also be disposed at the ear rest portion of the earphone. In addition, the head mounted smart device may further include a display screen when the display screen is provided. Next, the pressure sensor 20c transmits the detected electrical signal indicating the pressure information to the display screen, and displays the detected pressure information through the display screen.

In addition, as shown in FIG. 9, in another embodiment, a structural block diagram of an apparatus for determining the operational effectiveness of the smart device includes: a pressure information acquiring module 120c, a motion sensor 30c, and an action validity detecting module. 130c, wherein the motion sensor 30c works in the same manner as the motion sensor 30c in the above embodiment, so the pressure information acquisition module 120c includes a pressure acquisition module 121c, a data processing module 122c, and a communication module 123c. among them,

The pressure collecting module 121c is designed to be placed in a mat shape into the head-mounted smart device for monitoring The pressure on the load bearing part of the user. Preferably, for example, in the embodiment, the head-mounted smart device is smart glasses, and the nose pads of the smart glasses are made of a thin plastic material, and two pressures are installed on a side thereof facing the nose of the user. Sensitive resistor FSR), one for each of the two nose pads.

The data processing module 122c collects the data information obtained from the pressure collection module 121c. The module consists of a microprocessor-based board that contains a low-power, high-performance 8-bit AVR microprocessor, the ATmega16L, peripheral components (resistors, capacitors, etc.) and power supplies. In this embodiment, four ADC input channels with 10-bit resolution are used to convert analog voltage information generated by the varistor into a digital signal (ie, a converter that converts the obtained pressure analog signal information into a digital signal) Function). The microprocessor has a clock frequency of 8MHz. All circuits operate at 5V and are supplied by the LM78L55 voltage divider and a 7.4V lithium battery. The module is simple and light, can be connected to the pressure collection module 121 through a line, and is easy to integrate with a head-mounted smart device.

The communication module 123c is configured to transmit the digital signal processed by the microprocessor-based data processing module 122c to the action validity determination module 130c in real time.

It will be readily understood that in the present embodiment, the digital signal referred to is a digital electrical signal.

In this embodiment, since the amount of digital information is small, a wireless transmission method with a high sampling rate can be employed. Therefore, a low power consumption radio communication module GW100B (having a size of 56 mm x 28 mm x 7 mm) is selected. The radio transmitter and receiver are respectively connected to the microprocessor based data processing module and the background. The transmission distance can reach 5m in the case of barrier-free conditions. The forward error correction processing of the GW 100B achieves a low error rate, making the entire system reliable, and in other embodiments, a wired transmission method can also be employed.

Preferably, in any of the above embodiments, the action validity determining module 130c includes a signal processing module 131c and a comparison module 132c, and the signal processing module 131c analyzes the acquired electrical signals converted into the pressure information acquired within a predetermined period of time. An average value is calculated, and an electrical signal representing a difference between the real-time pressure information value and the average value is calculated, and the comparison module 132c compares the difference signal with a preset allowable change difference value and determines within the allowable change difference value. For the action, the operation command corresponding to the action is allowed to be executed. Otherwise, the action information sensed by the action sensor 30c is invalid, and the action is ignored. In addition, in other embodiments, the comparison module 132c can also obtain the real-time acquisition. The electrical signal representing the pressure information value is compared with the maximum value and the minimum value of the electrical signal converted by the pressure information in a predetermined period of time acquired in advance When the electrical signal representing the pressure information value acquired in real time is greater than the maximum value of the electrical signal converted by the acquired pressure information or less than the minimum value of the electrical signal converted by the acquired pressure information, the motion sensor is considered to be the motion sensor. The action information sensed by 30c is invalid, and the action is ignored. In addition, in another embodiment, the comparison module may compare the real-time acquired electrical signal representing the pressure information value with an electrical signal of a preset allowable pressure threshold range, and determine that the action is valid within the threshold range, allowing the execution of the The operation command corresponding to the action is reversed, and the action information sensed by the motion sensor 30c is considered invalid, and the action is ignored.

In addition, the action validity determining module 130c may further include an adjustable resistor (not shown) and an adjusting member (not shown), wherein the adjustable resistor is used to adjust the threshold voltage signal that allows the variation difference range, the implementation In the example, the resistance value of the adjustable resistor is changed by the adjusting member to adjust the threshold voltage signal.

In addition, the action validity determining module 130c may further include a storage unit (not shown) for storing the preset allowable pressure information or the change difference of the pressure information, the maximum value of the pressure information within a predetermined time period, At least one of the minimum values of the pressure information within a predetermined period of time.

In addition, as shown in FIG. 9a and FIG. 9b, another device 200c for determining the operational effectiveness of the smart device is different from the above-described device 100c for determining the operational effectiveness of the smart device: determining the headset The device 200d for the effectiveness of the smart device operation further includes an alarm module 40d. The alarm module 40d is connected to the action validity determination module 130c. In the present embodiment, the alarm module 40c is connected to the action validity determination module 130c via a communication interface (not shown). The action validity determination module 130c controls the start or stop of the alarm module 40c by comparing the pressure signal with the threshold value signal. Specifically, the comparison module 132c compares the difference between the pressure information value and the average pressure value in real time and the allowable change difference. When the difference is greater than the preset allowable change difference, the comparison module 132c outputs an alarm signal. And transmitting the signal to the alarm module 40c and correspondingly controlling the alarm module 40c to start. The above comparison manner is only an example, and those skilled in the art may adopt other comparison methods and any other manners of the foregoing description of the present invention, and the present invention is not limited thereto.

It can be understood that the connection between the alarm module 40c and the action validity determining module 130c can also be implemented by wire or wirelessly. In this embodiment, the communication module 40c and the action validity determining module 130c are connected through the Internet. .

It can be understood that the alarm module 40c can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm. At the same time, the alarm module 40c can be disposed on the head-mounted smart device or on the processing unit independent of the head-mounted smart device.

In addition, in any of the above embodiments, the action validity determining module 130c may be disposed on the head-mounted smart device, or may be disposed on the processing unit independent of the head-mounted smart device and between the smart device and the head-mounted smart device. Communication connection, wherein the communication connection can include wifi, Bluetooth, and the like.

As shown in FIG. 10, FIG. 10 is a structural block diagram of Embodiment 5 of an apparatus for determining the operational effectiveness of a head-mounted smart device according to an embodiment of the present invention. The head-mounted smart device includes at least a motion sensing module 110d. The action of the human eye; the pulse information acquisition module 120d is configured to acquire pulse information; the action validity determination module 130d is configured to calculate a pulse interval, and determine the validity of the action according to the preset threshold, wherein the motion sensing module 110d, the pulse information acquisition module 120d is disposed on the head-mounted smart device.

The pulse information acquiring module 120d acquires pulse information embodied in a continuous human head or a part of the face between a certain time or a set of at least two action intervals, when the calculated pulse interval is at the set threshold. When the range is within, it is determined that the action is valid and the corresponding action is performed.

In addition, in other embodiments, the time period of the pulse information acquired by the pulse information acquiring module 120d is not limited to the above-mentioned certain time or the set at least two action intervals, and may also be performed by the head-mounted smart device. During the period of a certain operation process, it may be all the time allowed in the hardware environment such as power, and there is no special limitation.

For example, in the following specific embodiment, the apparatus 100d for determining the operational effectiveness of the head-mounted smart device is as shown in FIG. 10a, wherein FIG. 10a is a structural block diagram of the head-mounted smart device, and the head-mounted smart device 100d includes a wearing support device. 10d, a pulse measuring sensor 20d, a motion sensor 30d, and an action validity determining module 130d, wherein the pulse measuring sensor 20d and the motion sensor 30d are both connected to the action validity determining module 130d, and are disposed on the wearing support device 10d, the pulse The measurement sensor 20d is configured to acquire pulse information of a designated part of the face of the current user of the smart device, and convert the pulse information into an electrical signal, which is transmitted to the action validity detecting module 130d, and the motion sensor 30d is used to sense the human eye. Action, and Converting the sensed motion information into an electrical signal, which is transmitted to the motion validity detecting module 130d, and the motion validity detecting module 130d receives an electrical signal indicating the pulse information received in real time, and calculates a pulse interval value received in real time, and The interval value is compared with a pre-stored threshold value. When the interval value falls within a pre-stored threshold range, it is determined that the human eye motion currently sensed by the motion sensor 30d is valid, and is allowed to perform the action. The instruction information is otherwise invalid, and the human eye motion detected by the motion sensor 30d is considered invalid.

It should be noted that, when the motion sensing module 110d senses the human eye motion, the pulse information acquiring module 120d starts acquiring the pulse information until the motion sensing module 110d does not sense the human eye motion or receives the operation end command, and the pulse is pulsed. The information acquiring module 120d stops sensing the pulse information. In other embodiments, the time when the pulse information acquiring module 120d senses the pulse information may be within a time range in which an operation is performed, or may be a time allowed by a hardware environment such as a power source. In short, as long as the motion sensing module 110d senses the human eye motion pulse information acquisition module 120d, it should be accompanied by the detection of the pulse information, thereby realizing the monitoring of the effectiveness of the ongoing operation of a certain operation.

The wearing support device 10d is worn on the user, and fixes the pulse measuring sensor 20d at a position relative to the detecting portion for the user to continuously detect the pulse information of the user. In this embodiment, the wearing support The device 10d is worn on the head of the subject, which is a glasses-type structure, and the pulse measuring sensor 20d is a non-contact pulse measuring sensor, and includes a camera, which is disposed at the front end portion of the bracket of the glasses, and acquires a pulse by detecting a facial image. Information, of course, in other embodiments, the head-mounted smart device may also be a headset, a hat, a head cover, etc., as long as the pulse measurement sensor 20d can be fixed to the measured portion of the user, and the pulse information acquisition module The 120d may also be a contact pulse measuring sensor, such as a pulse for detecting the ear vein or the radial artery, and the touch sensor may be coupled to the bracket of the head-mounted smart device via a rotatable link.

In addition, the head-mounted smart device may further include a display screen. When the display screen is provided, the pulse measurement sensor 20d transmits the detected pulse information to the display screen, and displays the pulse of the user through the display screen. information.

For example, as shown in FIG. 11, in another specific embodiment, a structural block diagram of an apparatus for determining the operational effectiveness of a head-mounted smart device, wherein the pulse information acquiring module 120d includes a camera for acquiring the current state of the head-mounted smart device. a video or picture of a specified part of the user's face Like the information, and transmitting the video or image information to the action validity determining module 130d, the action validity determining module 130d includes a signal processing module 131d and a calculating module 132d, and the signal processing module 131d processes the video containing the colored face obtained by the camera. The obtained face region and face position coordinates, at least the skin color region, and/or the eye, and/or the eye region are divided and classified, and the classification is given different weights, and the face region in each frame of video is given three. The color channels are separated, and the spatial mean is taken for each channel. The calculation module 132d performs ICA processing on the sampled data to obtain pulse information, analyzes the pulse information, obtains an average value of the pulse interval, and calculates a real-time pulse interval value and an average value. Difference.

Moreover, the action validity determining module 130d further includes a comparing module 133d connected to the calculating module 132d, and the comparing module 133d calculates the difference between the real-time pulse interval value and the average value and the preset allowable change difference range by the calculating module 132d. For comparison, it is determined that the operation is valid within the allowable variation difference range, and the operation represented by the eye motion sensed by the motion sensing module 110d is allowed to be performed during this period, and if the real-time pulse interval value is between the average value and the average value. If the difference is not within the preset allowable change difference range, it is determined that the motion sensing module 110d thereafter, until the valid motion information is re-acquired, the sensed human eye motion is invalid, and the motion is ignored.

In this embodiment, the acquisition and analysis of the user's pulse information can be implemented by the following methods:

The method is based on photoelectric volume pulse wave tracing PPG and independent component analysis ICA model, and non-contact measurement pulse is realized by analyzing a face video. In a normal environment, a color video of a face is acquired by a camera, and after a three-primary light mode RGB channel separation and ICA processing is performed on the face region, a group of components closest to the human body pulse wave is found as a measurement result.

1. First introduce the basic principles of PPG and ICA, then introduce the measurement process based on the two video pulses, and finally give the experimental results and comparative data.

1.1 Introduction to PPG

PPG is a non-invasive method for detecting changes in blood volume in living tissue by means of optoelectronic means. When a beam of a certain wavelength is irradiated onto the surface of the skin, it will be transmitted by transmission or reflection. In the process, the intensity of the light is weakened due to the absorption of light by the skin, muscles, tissues and blood. The absorption of light by skin, muscle, tissue, etc. throughout the blood The circulation is kept constant, and the blood volume in the skin is pulsating and cyclically changing under the action of the heart: when the heart contracts, the peripheral blood volume is the largest, and the light absorption is also the largest, and the transmitted light intensity is also The smallest; conversely, when the heart is dilated, the intensity of the transmitted light is the highest. The intensity of the light thus received exhibits a pulsating periodic variation with the heartbeat.

The blood volume contains important physiological information of many cardiovascular systems such as heartbeat function and blood flow. It also contains abundant microcirculatory physiological and pathological information, and is an important source of information for studying the human circulatory system. This optoelectronic technology can provide information about the cardiovascular system, such as heart rate, blood pressure, blood flow, blood oxygen, respiratory volume, microcirculatory peripheral blood vessels, arterial oxygen saturation.

This embodiment is based on this bio-optical principle, but since in the normal case, the photoelectric volume requires the use of a dedicated beam as the light source, the objective of this experiment is to study the method of separating the source information containing the specific signal under the natural light source and feasibility. Assume that the illumination intensity of the experimental environment is constant, set to a constant a, and the absorption of the natural light intensity by the blood volume is x. The light intensity is f(x) observed by an instrument (such as a normal household camera), and you can get:

f(x)=a-x (1)

f(x) and x have the same period and frequency, so it is theoretically possible to detect the periodic variation of the light intensity of a specific wavelength in the face region by the camera to measure the pulse of the human body.

1.2 Introduction to ICA

ICA is a new signal processing and data analysis method developed in the signal processing field in the late 1990s. The purpose is to separate (or extract) mutually independent source signals from the mixed signals observed by unknown source signals. It has a wide range of applications in signal processing, data mining, feature extraction, neural networks and many other fields.

ICA assumes that there are n mutually independent statistical source signals s(t)=[s1(t), s2(t),...,sn(t)] ^T , and the observed signal x(t)=[x1(t), X2(t),...,xn(t)] ^T is a linear mixture of the components of the source signal (t is the time or sample label), ie

x(t)=As(t) (2)

Where A ∈ ^{R n × n} is an unknown non-singular mixed matrix. The purpose of I C A is to obtain an n × n demixing matrix W = [w1(t), w2(t), ..., wn(t)] ^T in the case where only the mixed signal x(t) is known.

y(t)=Wx(t) (3)

Where y(t) = [y1(t), y2(t), ..., yn(t)] ^T and such that the components in y(t) are statistically independent of each other as much as possible. Thus y(t) can be used as an estimate of the source independent component, ie

among them

An estimate of the independent component of the source. In this embodiment, the processing of the video is performed in the RGB three-color channel, which is equivalent to three sensor observation source signals, and the purpose is to find the period or frequency in the separated three-color independent component which is relatively close to the comparison test. A set of components.

2. Implementation process

2.1 Obtain sampling data

After the camera obtains a video containing colored faces, Opencv (open source computer vision library, which encapsulates library functions commonly used in digital image processing) is used to obtain face region and face position coordinates. This process is performed in the YCbCr color space and is completed by skin color area detection, eye detection, eye area detection, and face candidate area division hierarchical structure. In this cascading structure, different classifiers are given different weights, and all the detection processes mean that the video frame contains a face area. Then, the RGB three-color channel separation is performed on the face region in each frame of video, and the spatial mean is taken for each channel. Let the size of the face area be M×N. In the RGB color space model, each pixel is represented by a set of (R, G, B) data, and the components of the RGB channel are (R, 0, 0), (0 , G, 0), (0, 0, B). Mean value of any channel in each frame

Mathematical expression for

Where x _k is the effective value of the corresponding component. This gives the observed signal

Where t is the time series of the video frame. Figure 12 is an RGB three-color signal sequence data obtained by processing a video having a duration of 30 pulse periods, wherein (a) is a red channel; (b) is a green channel; and (c) is a blue channel.

2.2 ICA processing and results of sampled data

In the ICA process, since the mixing matrix A and the source signal s(t) are unknown, if there is no other available information, only the statistically independent conditions between the components of s(t) are used, from the received signal x(t). It is estimated that A and s(t) must be multi-solutions, so some assumptions and constraints must be made that are consistent with the application of the project. The two basic assumptions of ICA are: (1) the components of the source signal are statistically independent of each other; (2) there can be at most one Gaussian signal in the source signal. This article is using FastICA algorithm based on mutual information minimization. Specific steps are as follows:

(1) Centralizing and whitening the data to obtain z(t);

(2) selecting an initialization matrix W having a unit norm;

(3) For each i=1,...,n, let w _i ←E{Zg(w _i ^T z))}-E{g'(w _i ^T )z}w _i , the function g is based on Gaussianity of the data selected nonlinear function;

(4) Pair matrix

Perform symmetric orthogonalization:

(5) If it does not converge, return to step (3).

After the separation matrix W is obtained, the estimated source signal [5-9] can be obtained by taking the equation (2). FIG. 13 is an effect of performing ICA processing on a face video of a 30-pulse cycle and then filtering it by arithmetic mean filtering. Where B is the blue channel data, G is the green channel data, and R is the red channel data. After the ICA process, the estimated component I, the estimated component II, and the estimated component III are obtained, and then filtered by arithmetic mean filtering. After the component (1), the filtered component (2), and the filtered component (3), after the pulse information obtained by the user manually taking the pulse is compared, it is determined that the filtered component (3) is relative to The other two are more characteristic of the pulse wave, so the estimated component III is selected as the effective source signal, and the pulse interval value is used as the data of the pulse information of the present embodiment.

In addition, in another embodiment, the pulse information of the user may also be obtained by:

1. Photoelectric sensor working principle

When infrared light is projected into the capillaries, the changes in the transmittance of the infrared receiver tube are periodically changed due to the periodic pulsation changes of the arterial blood of the capillaries during the blood circulation, which reflects the arteries. The change of blood, thereby realizing the transition of the optical signal to the electrical signal, and then filtering, amplifying, shaping, A/D converting and further processing the photoelectric signal. The earphone type or the headgear type projection photoelectric sensor is shown in Fig. 14.

The light emitted from the infrared light-emitting tube 61d disposed on the holder 60d passes through the skin of the measured portion 62d into the deep tissue, and is absorbed by the skin, the pigment, the nail, the blood, etc., and is partially reflected back by the skin and blood, and the rest is projected. Come out, received by the infrared receiving tube 63d, this side The method can better indicate the time relationship of the heart rate and can be used for the measurement of the pulse waveform.

2. Measurement system design

The photoelectric intelligent pulse wave measurement system is based on the ATmega8 single-chip microcomputer. Because the ATmega8 is a low-power, high-performance, anti-interference ability, 8K can be erased multiple times, the AVR high-speed single-chip microcomputer with multiple password protection lock (LOCK) function, Therefore, data processing can be performed at high speed. The photoelectric sensor is used as an input, and the input signal is amplified, filtered, 16-bit A/D converted, and then transmitted to the single-chip microcomputer for processing, and the processed data is transmitted to the action validity judgment module 130, as shown in FIG.

2.1 Photoelectric sensor circuit design

The sensor circuit is the key to this design, and its performance directly affects the processing of the rear circuit and the display of the results. In the process of human breathing, the content of oxygen-carrying hemoglobin and the content of reduced hemoglobin in the blood are changed, so that the absorption coefficient of blood to light is changing, so the baseline of the pulse wave curve picked up often changes with the fluctuation of respiratory motion. Therefore, the use of an infrared light-emitting tube as a light source suppresses the drift of the pulse wave curve caused by respiratory motion.

The core component of the receiving circuit is a phototransistor. In order to obtain the best signal-to-noise ratio, the pre-circuit uses a low-noise amplifier to minimize input noise. Therefore, low-noise photosensitive devices and resistors are selected, and low-level power supply is used. According to the impedance characteristics of the sensor output source, low-noise operating points are determined and noise matching is performed to obtain a minimum noise figure.

2.2 Signal Conditioning Circuit Design

Arterial pulse waves are low-frequency, weak physiological signals that must be filtered and amplified to meet signal acquisition requirements. The frequency of the arterial pulse signal is basically limited to 0.1-20 Hz. In order to remove high frequency interference, especially the 50 Hz power frequency interference, a low-pass filter circuit with appropriate frequency band is adopted, so that the detected signal has the maximum fidelity. For the amplifying circuit, the op amp is required to have a high input impedance, a low input offset voltage, and a small drift, and the steps of signal amplification and filtering in FIG. 15 are realized.

2.3 signal processing system

The signal processing system is based on the ATmega8 microcontroller, with A/D conversion, program memory, data memory and keyboard, etc., used to complete the pulse signal A / D conversion, parameter calculation, storage and set various working methods.

The action validity judgment module 130d includes a signal analysis processing module (not shown) and comparison a module (not shown), the signal analysis processing module analyzes the pulse information received within a predetermined period of time, obtains a pulse interval average, and calculates a difference between the real-time pulse interval value and the average value, and the electricity indicating the difference is The signal is transmitted to the comparison module, and the comparison module compares the difference with the preset allowable change difference range, and determines that the operation is valid within the allowed change difference, and allows the eye sensed by the motion sensing module 110d during the period. The operation represented by the action is performed. Conversely, if the difference between the real-time pulse interval value and the average value is not within the preset allowable change difference value, it is determined that the human eye motion sensed by the motion sensing module 110d during this period is invalid. Ignore this action.

It should be noted that pulse wave measurement is a relatively complicated process and must be implemented by system software. The use of ATmega8 microcontroller makes the system's timing, counting and real-time display functions convenient. The MCU system software mainly includes main program, data acquisition subroutine, digital filtering subroutine, keyboard scanning subroutine, pulse rate calculation subroutine and RS232 communication subroutine. Each subroutine can be debugged separately, with clear structure, convenient calling and expansion.

The computer software system VB is written to receive data from the RS232 interface, curve the received data, and display the fitted pulse waveform.

As shown in FIG. 16, in another embodiment, a structural block diagram of a head-mounted smart device capable of identifying operational effectiveness, wherein the pulse information acquiring module 120d is a touch sensor, the touch sensor is rotatable The connecting rod is connected to the bracket of the head-mounted smart device for detecting the pulse of the ear vein or the radial artery, and includes a pulse collecting module 121d, a data processing module 122d, a communication module 123d, and a pulse collecting module 121d and a data processing module 122d. The communication module 123d is sequentially electrically connected, wherein

The pulse acquisition module 121d is designed in a cushion shape and is disposed on the head-mounted smart device, corresponding to the detection part of the user, such as around the ear or around the ear, to detect the pulse of the ear vein or the radial artery of the user. The information is used to sense the pulse of the user. The pulse acquisition module 121d may be provided only one, or one of the two ears or the ear.

The data processing module 122d reads the data information obtained from the pulse acquisition module 121d and processes the data information to monitor the pulse interval value in a predetermined time interval in real time. The module consists of a microprocessor-based board that contains a low-power, high-performance 8-bit AVR microprocessor, the ATmega16L, peripheral components (resistors, capacitors, etc.) and power supplies. This embodiment uses four ADC input channels with 10-bit resolution to generate the mode generated by the pulse acquisition module. The pseudo voltage information is converted into digital data. The microprocessor has a clock frequency of 8MHz. All circuits operate at 5V and are supplied by the LM78L05 voltage divider and a 7.4V lithium battery. The module is simple and light, can be connected to the pulse acquisition module 21 through a line, and is easy to integrate with a head-mounted smart device.

The communication module 123 is configured to wirelessly transmit the digital data processed by the microprocessor-based data processing module 122 to the action validity determination module 130 in real time.

In the embodiment, since the amount of digital information is small, a high sampling rate wireless transmission method can be employed. Therefore, a low power consumption radio communication module GW100B (having a size of 56 mm x 28 mm x 7 mm) is selected. The radio transmitter and receiver are respectively connected to the microprocessor based data processing module and the background. The transmission distance can reach 5m in the case of barrier-free conditions. The forward error correction processing of the GW100B achieves a low error rate, making the entire system reliable.

In addition, in other embodiments, if the action validity determining module 130 is disposed on the head-mounted smart device, the two can also be connected by wired communication.

The action validity judging module 130d includes a signal analysis processing module 134d and a comparison module 135d. The signal analysis processing module 134d analyzes the pulse information received within a predetermined period of time, obtains an average value of the pulse interval, and calculates a real-time pulse interval value and an average value. The difference between the electrical signals indicating the difference is transmitted to the comparison module 135d, and the comparison module 135d compares the difference with the preset allowable variation difference range, and determines that the operation is valid within the allowed variation difference. The operation represented by the eye motion sensed by the motion sensing module 110d is allowed to be performed during this period. Otherwise, if the difference between the real-time pulse interval value and the average value is not within the preset allowable variation difference range, the action is determined. The human eye motion sensed by the sensing module 110d during this period is invalid, and the motion is ignored.

Furthermore, in the present embodiment, the comparison module 135d further includes an adjustable resistor (not shown) and an adjustment member (not shown), wherein the adjustable resistor is used to adjust the threshold voltage signal, in this embodiment, by adjusting Piece to change the resistance value of the adjustable resistor to adjust the threshold voltage signal.

In addition, the comparison module 135d further includes a storage unit (not shown) that stores body temperature information for storing the preset image information allowable change difference.

In addition, the comparison module 135d further includes an information collecting unit (not shown) connected to the storage unit for using the head mounted device for the first time, or the case where the smart device is to be replaced by the user Next, collecting user identity information, in the When the information collecting unit receives the information collecting instruction, it needs a process of reading and saving the user identity information for a certain period of time (for example, 3 minutes), during which the information collecting unit module continuously reads the current user's face. Image information of a specified part, and recording an overall change trend of the image information during the time period, and determining an allowable change difference range of the distance information according to the change trend, and storing an electrical signal indicating the allowable change difference range In the storage unit.

In addition, in any of the above embodiments, the action validity determining module 130d may be disposed on the head-mounted smart device, or may be disposed on the processing unit independent of the head-mounted smart device and associated with the head-mounted smart device. Inter-communication connection, wherein the communication connection can include wifi, or Bluetooth.

As shown in FIG. 17, FIG. 17 is a flowchart of a first embodiment of a method for determining the operational effectiveness of a smart device according to an embodiment of the present invention, including the following steps:

Step S110, sensing action information of the human eye, the action information corresponding to an operation instruction of the head-mounted smart device, for manipulating the head-mounted smart device;

Step S120, acquiring specified information;

Step S130, determining validity of the action information according to the specified information.

As shown in FIG. 18, FIG. 18 is a flowchart of a second embodiment of a method for determining the operational effectiveness of a smart device according to an embodiment of the present invention, including the following steps:

Step S510a, sensing action information of the human eye, and the action information corresponds to an operation instruction of the head-mounted smart device, and is used for operating the head-mounted smart device;

Step S520a, acquiring temperature information;

In step S530a, the validity of the action information is determined based on the temperature information.

Wherein, obtaining temperature information includes:

The body temperature information of the continuous human body between the predetermined time length or the set action interval is acquired in real time, or the point value of the body temperature information acquired at a predetermined period between a certain time or a set action interval.

Moreover, in one embodiment, determining the validity of the action information based on the body temperature information includes:

Comparing the body temperature information received in real time with the preset body temperature information range, and determining the current sense when the body temperature information received in real time is within the preset body temperature information range The action information of the human eye that should be arrived is valid.

And, determining the validity of the action information according to the body temperature information includes:

Analyzing an average value of the body temperature within a predetermined time period, and calculating a difference between the body temperature value obtained in real time and the average value;

The difference is compared with the preset allowable change difference, and the action is determined to be valid within the allowable change difference.

In addition, the method further includes:

After receiving the body temperature information, the received body temperature information is converted into an electrical signal in real time.

In addition, in a specific embodiment, other temperature information may be acquired according to actual conditions, and is not limited to the body temperature information of the human body described above.

It can be understood that with the development of the information age, the technology for transmitting certain manipulations through human eye movement information and the like has been more and more perfect, and there are drawbacks in liberating people's hands, for example, in existing In the technology, there is no way to judge the validity of the action information received by the head-mounted smart device. If the invalid action information is executed, or the valid action information is ignored, the user will be unnecessary. Trouble or loss, so in the above manner, real-time monitoring of the body temperature information of the user of the head-mounted smart device can be realized, and the real-time understanding of the body temperature information and the pre-stored allowable temperature range can be achieved. The action information obtained is judged for validity, such as the following scenario:

(Scenario 1) For example, the user applies the head-mounted smart device to log in to a shopping website to purchase a plurality of items, and transmits the purchase information through the blink action command, and the temperature information detected by the action validity judgment module is continuous within a predetermined time. If the fluctuation range does not exceed the preset range, it is determined that the blinking action command received by the device is valid during this period, and the user can purchase multiple products during this period (if the blinking command indicates one purchase information), if the action validity judgment module If the detected temperature information is discontinuous or the fluctuation exceeds the predetermined range, it is judged that the operation instruction received before the re-receiving of the valid operation instruction is invalid, and the instruction cannot be used to transmit the purchase information, thereby smoothly smoothing the user. Complete the purchase task.

(Scenario 2) The user uses the head-mounted smart device to watch the video or consult the file, and the user controls the opening, closing, or fast-forward, fast-rewind, and up-and-down turning of the file by eye movements such as blinking or blinking. It is also possible to ensure whether the review action of the file reviewer is valid by the action validity judgment manner described above, for example, within a preset time (may be If the temperature information detected by the action validity judgment module is continuous and the fluctuation range does not exceed the preset range, the user may determine the blink action command received by the device during the period. Valid, the user can continuously watch the video or consult the file during this period. If the temperature information detected by the action validity judgment module is discontinuous or the fluctuation exceeds the predetermined range, it is judged thereafter until a valid operation is received again. The operation command received before the instruction is invalid, and the video or file currently being played is closed.

As shown in FIG. 19, FIG. 19 is a flow chart showing the steps of a method for determining the operational effectiveness of a smart device according to an embodiment of the present invention, including the following steps:

Step S510b, sensing action information of the human eye, and the action information and the manipulation instruction of the head-mounted smart device are corresponding to predetermined rules for operating the head-mounted smart device;

Step S520b, acquiring image information of at least one part of a human head or a face;

Step S530b, judging the validity of the action based on the comparison result of the image information and the pre-stored standard image information.

The image information includes image information between predetermined time intervals or set action intervals.

In one embodiment, determining the validity of the action based on the comparison of the image information with the pre-stored standard image information includes:

When the real-time image information coincides with the pre-stored standard image information, the action validity determination module determines that the action is valid to perform the operation corresponding to the action.

In addition, in another embodiment, the method further includes:

The pixel, and/or size, and/or feature point position of the analyzed image information, and the average of the pixel, and/or size, and/or feature point position of the real-time image information and the pre-stored standard image information is calculated. Difference between

In addition, in a specific embodiment, the acquired image information may also include other image information, and is not limited to the image information of at least one feature portion of the human head or the face described above.

As shown in FIG. 20, FIG. 20 is a diagram for judging head-mounted intelligence according to an embodiment of the present invention. Method for the effectiveness of the device operation The flow chart of the method of the fourth embodiment includes the following steps:

Step S510c, sensing action information of the human eye, and the action information and the manipulation instruction of the head-mounted smart device are corresponding to a predetermined rule for operating the head-mounted smart device;

Step S520c, acquiring pressure information of the head-mounted smart device disposed on the weight bearing portion of the human body;

In step S530c, the validity of the action information is determined based on the pressure information.

Wherein, the pressure information includes pressure information between the actions of the human eye at a certain time or at least twice, and when the difference between the pressure information or the pressure information changes within the corresponding set threshold range, the action is determined to be effective. And perform this action.

Moreover, in one embodiment, determining the validity of the action information based on the pressure information includes:

Analyzing an average value of the electrical signals converted into pressure information in a predetermined period of time obtained in advance, and calculating a difference between the real-time pressure information value and the average value;

In addition, in a specific embodiment, the acquired pressure information may also be pressure information received by the module, and is not limited to the pressure information of the above-mentioned head-mounted smart device disposed on the weight bearing portion of the human body.

As shown in FIG. 21, FIG. 21 is a flow chart showing the steps of the fifth embodiment of the method for determining the operational effectiveness of the smart device according to an embodiment of the present invention, including the following steps:

Step S510d, sensing action information of the human eye, and the action information and the operation instruction of the head-mounted smart device are corresponding to predetermined rules for operating the head-mounted smart device;

Step S520d, acquiring pulse information;

In step S530d, the interval of the pulse is calculated, and the validity of the action is determined according to the preset threshold.

In one embodiment, continuous pulse information is acquired between a certain time or a set of at least two action intervals, and when the calculated interval of the pulse is within the set threshold range, it is determined that the action is valid and Perform the appropriate action.

And, the pulse information includes pulse information embodied in a part of the human head or a part of the face.

In addition, obtaining pulse information includes:

The pulse information is acquired by detecting a facial image by the camera.

And, the face region and the face position coordinates obtained by processing the video containing the color face obtained by the camera are at least subjected to the skin color region, and/or the eye, and/or the eye region, and the classification is given different weights. The face area in each frame of video is separated by three color channels, the spatial mean is taken for each channel, and the sampled data is subjected to ICA processing to obtain pulse information.

And, analyzing the average of the pulse intervals, and calculating the difference between the real-time pulse interval value and the average value, the comparison module compares the difference with the preset allowable change difference within the allowable change difference It is considered to be effective.

As shown in FIG. 22, FIG. 22 is a structural block diagram of Embodiment 1 of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention, including an identity identification information acquiring module 100, configured to acquire The identification information authentication module 200 is configured to authenticate the identification information to obtain authentication information, and the specified information obtaining module 300 is configured to acquire specified information of at least one part of the human body; the authentication information is valid. The sex determination module 400 is configured to determine, according to the specified information, whether the authentication information is valid if the identity identification information is authenticated.

According to the technical solution of the present invention, the validity of the authentication information of the head-mounted smart device can be verified in real time.

As shown in FIG. 23, FIG. 23 is a structural block diagram of a second embodiment of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention. The device includes: an identity identification information acquiring module 110e. For identifying the identification information, the identification information authentication module 120e is configured to authenticate the identification information to obtain the authentication information, and the temperature sensing module 130e is configured to acquire the temperature information; the authentication information validity determining module 140e, For determining whether the authentication information is valid according to the temperature information if the identification information is authenticated.

Wherein, the identification information includes at least one of the following:

Iris information, auricle information, sound information, fingerprint information, password information.

It should be noted that the identity information authentication module 120e may authenticate the received identity information by comparing the received identity information with pre-stored standard identity information, for example, in an embodiment. The identity information is the iris information, and after the identity information obtaining module 110e obtains the iris information of the current user of the smart device, the iris information is transmitted to the identity information authentication module 120e. The identity information authentication module 120e compares the received iris information with the pre-stored standard iris information. If the two are consistent, the authentication information is obtained through authentication, and the authentication information is sent to the authentication. The right information validity determining module 140e determines the validity of the authentication information. In addition, in other embodiments, when the identification information is auricle information, voice information, or the like, or a combination of multiple identification information, the identity identification information may also be authenticated in the above manner, which is not one by one. Narration.

For example, in a specific embodiment, as shown in FIG. 24, the device 100e for determining the validity of the authentication information of the smart device includes the wearing support device 10e, the identification information acquiring module 110e, The identification information authentication module 120e, the body temperature measurement sensor 20e, and the authentication information validity determination module 140e, wherein in the embodiment, the body temperature measurement sensor 20e and the identity identification information authentication module 120e are both valid with the authentication information. The judging module 140e is connected to the wearing support device 10e, and the body temperature measuring sensor 20e is configured to acquire temperature information of the current user of the head-mounted smart device, and convert the temperature information into an electrical signal and send the information to the authentication information. The sexuality determining module 140e includes a signal processing module (not shown) and a comparison module (not shown), and the signal processing module analyzes the average value of the electrical signals converted into the obtained temperature information, and calculates The difference between the real-time body temperature value and the average value, and the comparison module compares the difference with the preset allowable change difference value, Within the authentication information is valid for the identified differential variation promise.

It should be noted that, when the identity information authentication module 120e receives the identity identification information, the body temperature measurement sensor 20e starts to acquire the temperature information until the identity identification information authentication module 120e does not receive the identity identification information or receives the operation end. When the command is given, the body temperature measuring sensor 20e stops sensing the temperature information. In other embodiments, the time during which the body temperature measuring sensor 20e senses the temperature information may be within a time range in which an operation is performed, or may be a full time allowed by a hardware environment such as a power source. In summary, as long as the identity information authentication module 120e receives the identity identification information, it should be accompanied by the detection of the temperature information, thereby realizing the monitoring of the validity of the authentication information.

The wearing support device 10e is worn on the user, and fixes the body temperature measuring sensor 20e to the detecting portion of the user to continuously detect the body temperature information of the user. In the embodiment, the wearing support device 10e is worn on the subject. a head, which is a glasses-type structure, and a body temperature measuring sensor 20e is a non-contact body temperature measuring sensor, which is disposed at a front end portion of the eyeglass holder. And being electrically connected to the control system of the head-mounted smart device. Of course, in other embodiments, the body temperature measuring sensor 20e may also be a contact body temperature measuring sensor, which may be disposed on the nose pad of the head-mounted smart device. The head-mounted smart device may also be an earphone, a hat, a head cover, a helmet, or the like, as long as the body temperature measuring sensor 20e can be relatively fixed in positional relationship with the measured portion of the user, and, if necessary, the head-mounted type The smart device may further include a display screen, and in the case of having a display screen, the body temperature measuring sensor 20e transmits the detected temperature information to the display screen, and displays the temperature information of the user through the display screen.

As shown in FIG. 25, in another specific embodiment, a structural block diagram of an apparatus for determining validity of a smart device authentication information, wherein the body temperature sensing module 130e includes an optical probe 131e, a photoelectric conversion module 132e, and signal modulation. The module 133e, and the optical probe 131e, the photoelectric conversion module 132e, and the signal modulation module 133e are sequentially electrically connected. The optical probe 131e corresponds to the detection portion of the user, and detects the body temperature information of the user, thereby realizing the sensing of the user's body temperature.

The optical probe 131e transmits the detected body temperature signal to the photoelectric conversion module 132e, and the body temperature signal is converted into an electrical signal via the photoelectric conversion module 132e and transmitted to the signal modulation module 133e, and the signal modulation module 133e amplifies and filters the electrical signal, and transmits the signal to the optical signal. The right information validity judgment module 140e.

In this embodiment, the authentication information validity determining module 140e includes a signal analysis processing module 141e and a comparison module 142e. The signal analysis processing module 141e analyzes the average value of the body temperature change, and calculates the difference between the real-time temperature value and the average value. The value, comparison module 142e compares the difference with a preset allowable change difference, and determines that the authentication information is valid within the allowed change difference.

In addition, in other embodiments, the comparison module 142e may also compare the temperature value acquired in real time with the body temperature range previously analyzed by the signal analysis processing module 141e, and the temperature value obtained in real time is in the case of the body temperature range obtained in advance. If the authentication information received before is valid, the operation currently performed by the smart device is allowed to continue, and if the temperature value obtained in real time does not fall within the temperature range previously analyzed by the signal analysis processing module 141e. If it is determined that the previously received authentication information is invalid, the current operation of the head-mounted smart device is stopped to ensure the operation security.

In addition, in this embodiment, the comparison module 142e further includes an adjustable resistor (not shown) And an adjusting member (not shown), wherein the adjustable resistor is used to adjust the threshold voltage signal. In the embodiment, the resistance value of the adjustable resistor is changed by the adjusting member to adjust the threshold voltage signal.

In addition, the comparison module 142e further includes a storage unit (not shown) that stores temperature information for storing the preset temperature information allowable change difference.

In addition, the comparison module 142e further includes an information collecting unit (not shown) connected to the storage unit for using the head mounted device for the first time, or the case where the smart device is to be replaced by the user The user identity information is collected, and when the information collection unit receives the information collection instruction, the user identity information needs to be read and saved for a certain period of time (for example, 3 minutes), during which time, The information collecting unit module continuously reads the current user temperature information, records the overall change trend of the temperature information in the time period, and determines the allowable change difference range of the temperature information according to the change trend, and indicates the allowable change difference. The electrical signals of the range of values are stored in the storage unit.

In addition, as shown in FIG. 26, in another embodiment, another apparatus 200e for determining the validity of the authentication information of the smart device is compared with the foregoing apparatus 100e for determining the validity of the authentication information of the smart device. The difference is that the means 200e for determining the validity of the smart device authentication information of the headset further includes an alarm module 40e. The alarm module 40e is connected to the authentication information validity determination module 140e. In the present embodiment, the alarm module 40e is connected to the authentication information validity determination module 140e via a communication interface (not shown). The authentication information validity determining module 140e compares the monitored body temperature value with the preset temperature range, and determines whether the received identity identification information that is authenticated is valid according to the comparison result, and controls the alarm module 40e according to the determination result. Start or stop. Specifically, the authentication information validity determining module 140e compares the monitored body temperature value with the maximum threshold value and the minimum critical value of the pre-stored temperature range, and when the real-time acquired temperature value is less than the maximum threshold value, The comparison result of the output is a high level; when the temperature value acquired in real time is less than the above minimum threshold value, the comparison result of the output is a low level. The comparison result of the high level or the low level indicates that the authentication information received during the period is invalid, and is transmitted to the alarm module 40e, and the alarm module 40e is controlled to start or stop accordingly.

In addition, in other embodiments, when the real-time monitored body temperature value does not fall within the preset temperature range, the authentication information validity determining module 140e may output any signal that can be recognized by the alarm module 40e, and is not limited to the above. High or low.

In addition, in another embodiment, as shown in FIG. 27, the temperature sensing module 130e includes an integrated temperature sensor 134e and a signal conditioning circuit 135e. The output of the body temperature sensor 134e is connected to the input of the signal conditioning circuit 132e, and the authentication information is provided. The validity judging module 140e includes a signal analysis processing module 141e and a comparison module 142e. The signal conditioning circuit 135e is connected to the signal analysis processing module 141e, and the signal conditioning circuit 135e is configured to convert the received body temperature signal into a signal analysis processing module 141e. Electrical signal.

Moreover, in the present embodiment, the signal analysis processing module 141e analyzes the average value of the body temperature, and calculates the difference between the real-time temperature value and the average value, and the comparison module 142e compares the difference value with the preset allowable change difference value. It is determined that the authentication information is valid within the allowed variation difference.

In particular, signal conditioning circuit 135e is used to transform an analog signal into a digital signal for data acquisition, control processes, performing computational display readouts, or other purposes. The body temperature sensor 134e measures the user's body temperature information, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current, or resistance change, and therefore must be amplified and buffered before being converted into a digital signal. Or scaling the analog signal, etc., that is, the conditioning process, making it suitable for the input of an analog-to-digital converter (ADC). Then, the ADC digitizes the analog signal and sends the digital signal to the MCU or other digital device for use. Data processing in the system.

In addition, in any of the above embodiments, the authentication information validity determining module 140e may be disposed on the head-mounted smart device, or may be disposed on a processing unit independent of the head-mounted smart device, and coupled with the head-mounted smart device. Communication connection between devices, wherein the communication connection manner may include wifi, Bluetooth, and the like.

As shown in FIG. 28, FIG. 28 is a structural block diagram of a third embodiment of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention. The device includes: an identity identification information acquiring module 110f, For obtaining the identification information, the identification information authentication module 120f is configured to authenticate the identification information, obtain and send the authentication information, and the image sensing module 130f is configured to acquire at least one part of the head or the face of the human body. The image information is sent, and the sensed image information is sent; the authentication information validity determining module 140f is configured to receive the image information sent by the image sensing module 130f, and receive the authentication sent by the identity information authentication module 120f. Information, and in the case that the identification information is authenticated, the comparison result is based on the comparison result of the image information received in real time and the standard image information stored in advance. Whether the right information is valid.

Wherein, the identification information includes at least one of the following:

It should be noted that the identity information authentication module 120f may authenticate the received identity information by comparing the received identity information with pre-stored standard identity information, for example, in an embodiment. The identity information is the iris information, and after the identity information obtaining module 110f obtains the iris information of the current user of the smart device, the iris information is transmitted to the identity information authentication module 120f, and the identity information is The authentication module 120f compares the received iris information with the pre-stored standard iris information. If the two are consistent, the authentication information is obtained through authentication, and the authentication information is sent to the authentication information. The sex determination module 140f determines the validity of the authentication information. In addition, in other embodiments, when the identification information is auricle information, voice information, or the like, or a combination of multiple identification information, the identity identification information may also be authenticated in the above manner, which is not one by one. Narration.

In one embodiment, in the case where the image information coincides with the pre-stored standard image information, it is determined that the authentication information is valid.

Wherein, the image information may include at least one of the following:

The pixel value of the image, the size of the image, and the position information of the feature points.

In addition, it should be noted that, in a specific embodiment, the image information acquired by the image sensing module 130f is not limited to the image information of at least one part of the head or the face of the human body, and may include other image information.

For example, in a specific embodiment, as shown in FIG. 29, the apparatus 100f for determining the validity of the authentication information of the head-mounted smart device includes the wearing support device 10f, the identification information acquiring module 110f, and the identification information. The weight module 120f, the image sensor 20f, and the authentication information validity determining module 140f, wherein the image sensor 20f and the identification information authentication module 120f are both connected to the authentication information validity determining module 140f, and are disposed on the wearing support device 10f. The image sensor 20f is configured to acquire image information of a specified part of the face of the current user of the smart device, and convert the image information into an electrical signal and send the information to the authentication information validity determining module 140f, and the authentication information is valid. The sexual judgment module 140f includes a comparison module (not shown), and the comparison module will receive an electric signal indicating the currently acquired image information in real time. Comparing with the pre-stored electrical signal representing the standard image information, if the two are consistent, it is determined that the authentication information is valid, and the operation currently being performed by the smart device is allowed to continue, and if If they are inconsistent, stop the current operation to ensure the operation is safe.

It should be noted that, when the identity information authentication module 120f receives the identity identification information, the image sensor 20f starts acquiring image information until the identity information authentication module 120f receives the identity identification information or receives an operation end instruction. The image sensor 20f stops sensing the image information. In other embodiments, the time during which the image sensor 20f senses the image information may be within a time range in which an operation is performed, or may be all time allowed by a hardware environment such as a power source. As long as the identity information authentication module 120f receives the identity identification information, it should be accompanied by the detection of the image information, thereby realizing real-time monitoring of the validity of the authentication information.

In this embodiment, the wearing support device 10f is worn on the user's head, which is a glasses-type structure, and the image sensor 20f is disposed at the front end of the bracket of the glasses, and is electrically connected to the authentication information validity determining module 140f. The image information of the user's head or a part of the face is continuously detected. Of course, in other embodiments, the head-mounted smart device may also be a headset, a hat, a headgear, a helmet, etc., and the position of the image sensor may also be determined according to specific conditions. The setting may be such that the image sensor can be fixed relative to the detection portion of the user. In addition, the head-mounted smart device can further include a display screen if necessary, and the image sensor 20f will detect when the display screen is provided. The image information is transmitted to the display and displayed through the display.

As shown in FIG. 30, in another specific embodiment, a structural block diagram of a head-mounted smart device that can determine the validity of the authentication information, where the image sensing module 130f includes an image obtaining unit 131f, a photoelectric conversion module 132f, and a signal The modulation module 133f, and the image acquisition unit 131f, the photoelectric conversion module 132f, and the signal modulation module 133f are sequentially electrically connected in sequence.

The image acquiring unit 131f is configured to sense an image signal of a target position. In this embodiment, the image acquiring unit 131f may be a camera.

The image acquisition unit 131f transmits the sensed image signal to the photoelectric conversion module 132f, and the image signal is converted into an electrical signal via the photoelectric conversion module 132f and transmitted to the signal modulation module 133f, and the signal modulation module 133f amplifies and filters the electrical signal, and transmits To the authentication letter The information validity determining module 140f compares the received electrical signal with a preset threshold electrical signal, and determines whether the detected image information is abnormal according to the comparison result, when received The electrical signal is consistent with the electrical signal corresponding to the pre-stored standard image information, or the received electrical signal is determined to be valid as the authentication information within the range of the electrical signal corresponding to the pre-stored standard image information.

In addition, in this embodiment, the authentication information validity determining module 140f includes a signal analysis processing module 141f and a comparison module 142f, and the signal analysis processing module 141f analyzes the information value of the acquired image, and calculates the real-time image information value and pre-stores The difference between the standard image information values, the comparison module 142f compares the difference with the preset allowable change difference range, and determines that the authentication information is valid within the allowed change difference, wherein the image information value includes At least one of the following: pixel value, size value, feature point position coordinate value.

In addition, in another embodiment, the signal analysis processing module 141f may also analyze the pixel value, and/or the size value, and/or the feature point position coordinate value of the image acquired in real time, and the comparison module 142f may at least one of the above information. Compared with the corresponding information of the standard image information stored in advance, if the comparison result is the same, it is determined that the authentication information is valid.

In addition, in this embodiment, the comparison module 142f may further include an adjustable resistor (not shown) and an adjusting member (not shown), wherein the adjustable resistor is used to adjust the threshold electrical signal, in this embodiment, The adjusting member changes the resistance value of the adjustable resistor to adjust the threshold electrical signal.

In addition, the comparison module 142f further includes a storage unit (not shown) that stores image information for storing preset image information allowable variation values.

In addition, the comparison module 142f further includes an information collecting unit (not shown) connected to the storage unit for using the head mounted device for the first time, or the case where the smart device is to be replaced by the user The user identity information is collected, and when the information collection unit receives the information collection instruction, the user identity information needs to be read and saved for a certain period of time (for example, 3 minutes), during which time, The information collecting unit module continuously reads a specified image information of the current user's face, records the overall change trend of the image information in the time period, and determines an allowable change difference range of the image information according to the change trend, and indicates The electrical signal allowing the range of variation differences is stored in the storage unit.

In addition, as shown in FIG. 31, the device 200f for determining the validity of the authentication information of the smart device in the other embodiment is different from the device 100f for determining the validity of the authentication information of the smart device. The means 200f for determining the validity of the smart device authentication information of the head-mounted smart device further includes an alarm module 40f. The alarm module 40f is connected to the authentication information validity determination module 140f. In the present embodiment, the alarm module 40f is connected to the authentication information validity determination module 140f via a communication interface (not shown). The authentication information validity judging module 140f controls the start or stop of the alarm module 40f by comparing the result of the real-time monitored image information with the preset standard image information. Specifically, if the real-time monitored image information is inconsistent with the preset standard image information, the authentication information validity determining module 140f sends an alarm signal, and transmits the alarm signal to the alarm module 40f, and controls the alarm accordingly. The module 40f is started or stopped. In addition, the output comparison result is in the form of a high level (or a low level). Of course, in other embodiments, the output manner of the comparison result is not limited thereto, and may indicate the comparison result. Any form of signal, here, will not be repeated.

It can be understood that the connection between the alarm module 40f and the authentication information validity determining module 140f can also be implemented by wire or wirelessly. In this embodiment, the alarm module 40f and the authentication information validity determining module 140f pass through. The Internet implements a communication connection.

It can be understood that the alarm module 40f can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm. At the same time, the alarm module 40f can be disposed on the head-mounted smart device or independently of the head-mounted smart device.

In addition, in another embodiment, the apparatus for determining the validity of the authentication information of the head-mounted smart device, as shown in FIG. 32, the image sensing module 130f includes an image sensor 134f and a signal conditioning circuit 135f, and the validity of the authentication information. The judging module 140f includes a signal analysis processing module 141f and a comparison module 142f. The signal conditioning circuit 135f is connected to the signal analysis processing module 141f, the output end of the image sensor 134f is connected to the input end of the signal conditioning circuit 135f, and the signal conditioning circuit 135f is used for The image signal acquired by the image sensor 134f is converted into an electrical signal recognizable by the signal analysis processing module 141f.

In this embodiment, the signal analysis processing module 141f analyzes the average value of the detected image information, and calculates a difference between the real-time image information value and the average value, and the comparison module 142f compares the difference with the preset allowable variation. Values are compared and within the allowable range of variation differences The authentication information is valid, otherwise the authentication information is invalid. The image information value includes at least one of the following: a pixel value, a size value, and a feature point position coordinate value.

In particular, signal conditioning circuit 135f is used to transform an analog signal into a digital signal for data acquisition, control processes, performing computational display readout, or other purposes. The image sensor 134f acquires image information, but since the sensor signal cannot be directly converted to digital data, the sensor output is a relatively small voltage, current, or resistance change, and therefore must be amplified, buffered, or scaled before being converted to a digital signal. The analog signal, etc., is the conditioning process that makes it suitable for the input of an analog-to-digital converter (ADC). The ADC then digitizes the analog signal and sends the digital signal to the MCU or other digital device for use in the system. data processing.

In addition, in any of the above embodiments, the authentication information validity determining module 140f may be disposed on the head-mounted smart device, or may be disposed on the processing unit independent of the head-mounted smart device and coupled with the head-mounted smart device. Communication connection, wherein the communication connection can include wifi, Bluetooth, and the like.

As shown in FIG. 33, FIG. 33 is a structural block diagram of Embodiment 4 of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention. The smart device includes: identification information. The acquiring module 110g is configured to obtain the identity identification information, the identity identification information authentication module 120g is configured to authenticate the identity identification information, and obtain the authentication information, and the pressure information acquiring module 130g is configured to acquire the headset smart device. The pressure information of the load-bearing part of the human body; the authentication information validity determining module 140g is configured to determine whether the authentication information is valid according to the pressure information if the identification information is authenticated, and, in the embodiment, the identification The information acquisition module 110g and the pressure information acquisition module 130g are both disposed on the head-mounted smart device.

Wherein, the identification information includes at least one of the following:

It should be noted that the identity information authentication module 120g may authenticate the received identity information by comparing the received identity information with pre-stored standard identity information, for example, in an embodiment. After the identity information is the iris information, after the identity information obtaining module 110g obtains the iris information of the current user of the smart device, the iris information is transmitted to the identity information authentication module 120g, and the identity information is The authentication module 120g will receive the iris information with a pre-stored standard iris The information is compared. If the two are consistent, the authentication information is obtained through authentication, and the authentication information is sent to the authentication information validity determining module 140g to determine the validity of the authentication information. . In addition, in other embodiments, when the identification information is auricle information, voice information, or the like, or a combination of multiple identification information, the identity identification information may also be authenticated in the above manner, which is not one by one. Narration.

And, the authentication information validity determining module 140g acquires continuous pressure information applied by the smart device between the smart device and the at least two times before acquiring the identification information, when the difference between the pressure information and the pressure information changes When the corresponding set threshold range is within, it is determined that the authentication information is valid.

In addition, in a specific embodiment, the pressure information acquiring module 130g may also acquire the pressure information received by the module according to the specific situation, and is not limited to the pressure information of the above-mentioned head-mounted smart device disposed on the weight bearing portion of the human body.

For example, in a specific embodiment, as shown in FIG. 34, the apparatus 100g for determining the validity of the authentication information of the head-mounted smart device includes the wearing support device 10g, the identification information acquiring module 110g, and the identification information. The weight module 120g, the pressure measuring sensor 20g, and the authentication information validity determining module 140g, wherein the pressure measuring sensor 20g and the identification information authentication module 120g are both connected to the authentication information validity determining module 140g, and are disposed on the wearing support On the device 10g, the pressure measuring sensor 20g is configured to acquire pressure information of the weight bearing portion of the current user of the head-mounted smart device, and convert the pressure information into an electrical signal and send the information to the authentication information validity determining module 140g, the authentication information. The validity determining module 140g includes a signal processing module (not shown) and a comparison module (not shown). The signal processing module analyzes the average value of the electrical signals converted into the pressure information acquired within a predetermined period of time, and calculates the real-time pressure information. The difference between the value and the average value, the comparison module compares the difference with the preset allowable change difference, The changes in the difference between the identified authentication information is valid.

It should be noted that, when the identity information authentication module 120g receives the identity identification information, the pressure measurement sensor 20g starts to acquire the pressure information until the identity identification information authentication module 120g receives the identity identification information or receives the operation end. When the command is made, the pressure measuring sensor 20g stops sensing the pressure information. In other embodiments, the time during which the pressure measuring sensor 20g senses the pressure information may be within a time range in which an operation is performed, or may be a full time allowed by a hardware environment such as a power source. In the end, as long as the identity identification information authentication module 120g receiving the identification information should be accompanied by the detection of the pressure information, thereby realizing the monitoring of the validity of the authentication information.

The wearing support device 10g is worn on the user, and fixes the pressure measuring sensor to the detecting portion of the user to continuously detect the pressure information of the user. In the embodiment, the wearing support device 10g is worn on the head of the subject. The portion is a spectacle-type structure, and the pressure measuring sensor 20g is disposed on a portion of the head mounted smart device that contacts the head or the face of the human body to obtain pressure information, preferably disposed on the nose pad portion of the bracket, of course, in other In an embodiment, the head-mounted smart device may also be an earphone, a cap, a head cover, a helmet, etc., as long as the pressure measuring sensor can be fixed to the detecting portion of the user, and further, the head-mounted smart device is further provided as needed. A display screen may be included, in the case of a display, the pressure measurement sensor transmits the detected pressure information to the display screen and displays the pressure information of the user through the display screen.

As shown in FIG. 35, in another specific embodiment, a structural block diagram of a head-mounted smart device capable of identifying operational validity, wherein the pressure information acquiring module 130g includes: a pressure collecting module 131g, a data processing module 132g, and a communication module 133g. among them,

The pressure collecting module 131g is designed to be placed in a mat shape into the head-mounted smart device for monitoring the pressure of the load bearing portion of the user. Preferably, for example, the head-mounted smart device is smart glasses, the nose pads of which are made of a thin plastic material, and two varistor (FSR) are mounted on a side thereof facing the nose of the user. One of the two nose pads, or if the head-mounted smart device is an earmuff, the pressure acquisition module can be placed at the ear rest.

The data processing module 132g collects the data information obtained from the pressure collection module 131g. The module consists of a microprocessor-based board that contains a low-power, high-performance 8-bit AVR microprocessor, the ATmega16L, peripheral components (resistors, capacitors, etc.) and power supplies. In this embodiment, four ADC input channels with 10-bit resolution are used to convert the analog voltage signal generated by the varistor into a digital signal (that is, a function of converting a obtained pressure analog signal information into a digital signal) ). The microprocessor has a clock frequency of 8MHz. All circuits operate at 5V and are supplied by the LM78L voltage divider and a 7.4V lithium battery. The module is simple and light, can be connected to the pressure acquisition module 131 through a line, and is easy to integrate with the head-mounted smart device.

The communication module 133g is for processing by the microprocessor based data processing module 132g The subsequent digital data is transmitted to the authentication information validity judgment module 140g in real time.

In addition, in this embodiment, the authentication information validity determining module 140g includes a signal processing module 141g and a comparison module 142g, and the signal processing module 141g analyzes the average value of the electrical signals converted into the pressure information acquired within a predetermined time, and calculates The difference between the real-time pressure information value and the average value, the comparison module 142g compares the difference with the preset allowable change difference value, and determines that the authentication information is valid within the allowed change difference value. In addition, in other embodiments, the authentication information validity determining module 140g may also convert the received real-time pressure value into an electrical signal and analyze the maximum value of the electrical signal converted into the pressure information acquired within a predetermined time period, Comparing with the minimum value, when the real-time received pressure value is converted into an electrical signal smaller than the maximum value of the electrical signal converted into the pressure information obtained by the analysis and greater than the minimum value, it is determined that the received authentication information is valid. The current operation of the head-mounted smart device is allowed to continue. Otherwise, it is determined that the received authentication information is invalid, and the operation currently being performed by the head-mounted smart device is stopped to ensure the operation security.

Furthermore, in the present embodiment, the comparison module 142g further includes an adjustable resistor (not shown) and an adjustment member (not shown), wherein the adjustable resistor is used to adjust the threshold voltage signal, in this embodiment, by adjusting Piece to change the resistance value of the adjustable resistor to adjust the threshold voltage signal.

In addition, the comparison module 142g further includes a storage unit (not shown) that stores body temperature information, and is configured to store a preset pressure information allowable change difference value, and/or a maximum value of the pressure information acquired within a preset time period, And / or minimum.

In addition, the comparison module 142g further includes an information collecting unit (not shown) connected to the storage unit for using the head mounted device for the first time, or the case where the smart device is to be replaced by the user The user identity information is collected, and when the information collection unit receives the information collection instruction, the user identity information needs to be read and saved for a certain period of time (for example, 3 minutes), during which time, The information collecting unit module continuously reads the pressure information of the current user load bearing part, and records the pressure information The overall change trend during the time period, and determining the allowable change difference range of the pressure information according to the change trend, and storing the electrical signal indicating the allowable change difference range in the storage unit.

In addition, as shown in FIG. 36, the head-mounted smart device 200g for authenticating the operational validity of the further embodiment is different from the above-described device 100g for determining the validity of the authentication information of the smart device: The device 200g for determining the validity of the authentication information of the head-mounted smart device further includes an alarm module 40g, and the alarm module 40g is connected to the authentication information validity determining module 140g through a communication interface (not shown). The authentication information validity judging module 140g controls the start or stop of the alarm module 40g by comparing the real-time pressure value with a preset pressure value range. When the real-time pressure value is greater than the maximum threshold value of the preset pressure value range, the comparison result output by the authentication information validity determining module 140g is a high level; when the real-time pressure value is less than a minimum critical value of the preset pressure value range The comparison result output by the authentication information validity judgment module 140g is a low level. The comparison result of the high level or the low level all indicates that the authentication information in this time period is invalid, and both signals are transmitted to the alarm module 40g, and the alarm module 40g is controlled to start or stop accordingly.

Moreover, in any of the above embodiments, the authentication information validity determining module 140g may be disposed on the head-mounted smart device, or may be independent of the head-mounted smart device and communicate with the head-mounted smart device. Connection, wherein the communication method may include wifi, Bluetooth, and the like.

As shown in FIG. 37, FIG. 37 is a structural block diagram of Embodiment 5 of an apparatus for determining validity of authentication information of a smart device according to an embodiment of the present invention. The device includes at least an identity identification information acquiring module 110h. The authentication information authentication module 120h is configured to authenticate the identification information to obtain the authentication information, and the pulse information acquiring module 130h is configured to acquire the pulse information; the authentication information validity determining module 140h And determining, according to the pulse information, whether the authentication information is valid within a predetermined period of time when the identification information is authenticated.

Wherein, the identification information includes at least one of the following:

It should be noted that the identity information authentication module 120h may authenticate the received identity information by comparing the received identity information with pre-stored standard identity information, for example, in an embodiment. In the identification information is the iris After the information is obtained, the identity information obtaining module 110h obtains the iris information of the current user of the smart device, and then transmits the iris information to the identity information authentication module 120h, and the identity information authentication module 120h receives the information. The iris information is compared with the pre-stored standard iris information. If the two are consistent, the authentication information is obtained through authentication, and the authentication information is sent to the authentication information validity determining module 140h, The validity of the authentication information is judged. In addition, in other embodiments, when the identification information is auricle information, voice information, or the like, or a combination of multiple identification information, the identity identification information may also be authenticated in the above manner, which is not one by one. Narration.

The pulse information acquiring module 130h acquires the pulse information embodied in a continuous human head or a part of the face in a certain period of time, and transmits the acquired pulse information to the authentication information validity determining module 140h, and the authentication information is valid. The sex determination module 140h determines whether the authentication information is valid based on the comparison result of the acquired pulse interval or the change amount of the pulse interval and the preset corresponding threshold value range.

For example, in the following specific embodiment, the apparatus 100h for determining the validity of the authentication information of the smart device shown in FIG. 38 includes the wearing support device 10h, the identification information acquiring module 110h, and the identity identification information authentication module 120h. The pulse measurement sensor 20h and the authentication information validity determination module 140h, wherein the pulse measurement sensor 20h and the identification information authentication module 120h are both connected to the authentication information validity determination module 140h, and are disposed on the wearing support device 10h. The pulse measurement sensor 20h is configured to acquire pulse information of a designated part of the face of the current user of the smart device, and convert the pulse information into an electrical signal, and transmit the information to the authentication information validity determining module 140h, the authentication information. The validity determining module 140h receives an electrical signal indicating the pulse information received in real time, and calculates a pulse interval value received in real time, and compares the interval value with a pre-stored threshold value, when the interval value falls within a pre-stored threshold value. When the range is within, the authentication information sent by the identity information authentication module 120h is valid. And to allow the headset to perform intelligent devices currently in progress, or that the received authentication information is invalid.

It should be noted that, in the case that the identity identification information authentication module 120h receives the identity identification information, the pulse measurement sensor 20h starts acquiring the pulse information until the identity identification information authentication module 120h does not receive the identity identification information or receives the operation. When the command is ended, the pulse measurement sensor 20h stops sensing the pulse information. In other embodiments, the pulse measurement sensor The time for sensing the pulse information by the device 20h may also be within a time range in which an operation is performed, or may be all time allowed by a hardware environment such as a power source. In short, as long as the identity identification information authentication module 120h receives the identification information, it should be accompanied. The detection of pulse information enables monitoring of the validity of authentication information.

The wearing support device 10h is worn on the user, and fixes the pulse measuring sensor 20h to the detecting portion of the user to continuously detect the pulse information of the user. In the embodiment, the wearing supporting device 10h is worn on the subject. The head is an earphone structure, and the pulse measuring sensor 20h is a contact sensor. The touch sensor is connected to the bracket of the head-mounted smart device through a rotatable link for detecting the pulse of the ear vein or the radial artery. In other embodiments, the head-mounted smart device may also be glasses, a hat, a headgear, a helmet, etc., as long as the pulse measuring sensor can be fixed relative to the detecting portion of the user, and, if necessary, the The head-mounted smart device may further include a display screen, and in the case of having a display screen, the pulse measurement sensor 20h transmits the detected pulse information to the display screen, and displays the pulse information of the user through the display screen.

In addition, as shown in FIG. 39, in another specific embodiment, a structural block diagram of a head-mounted smart device capable of determining the validity of the authentication information, wherein the pulse information acquiring module 130h includes a pulse acquisition module 131h and a data processing module 132h The communication module 133h, and the pulse acquisition module 131h, the data processing module 132h, and the communication module 133h are sequentially and electrically connected, wherein

The pulse acquisition module 131h is designed in a cushion shape and is disposed on the head-mounted smart device, and corresponds to the detection part of the user, such as around the ear or around the ear, to detect the pulse of the ear vein or the radial artery of the user. The information is used to sense the pulse of the user. The pulse acquisition module may be provided only one, or one of the two ears or the ear.

The data processing module 132h reads the data information obtained from the pulse acquisition module 131h and processes the data information to monitor the pulse interval value in a predetermined time interval in real time. The module consists of a microprocessor-based board. Includes a low power, high performance 8-bit AVR microprocessor ATmega16L, peripheral components (resistors, capacitors, etc.) and power supplies. In this embodiment, four ADC input channels with 10-bit resolution are used to convert analog voltage information generated by the pulse acquisition module into digital data. The microprocessor has a clock frequency of 8MHz. All circuits operate at 5V and are supplied by the LM78L05 voltage divider and a 7.4V lithium battery. The module is simple and light, and can be connected to the pulse acquisition module 131h through a line, and is convenient for wearing with a headset. Can device integration.

The communication module 133h is configured to wirelessly transmit the digital data processed by the microprocessor-based data processing module 132h to the authentication information validity determination module 140h in real time.

In this embodiment, since the amount of digital information is small, a wireless transmission method with a high sampling rate can be employed. Therefore, a low power consumption radio communication module GW100B (having a size of 56 mm x 28 mm x 7 mm) is selected. The radio transmitter and receiver are respectively connected to the microprocessor based data processing module and the background. The transmission distance can reach 5m in the case of barrier-free conditions. The forward error correction processing of the GW 100B achieves a low error rate, making the entire system reliable. Of course, in other embodiments, the communication module 133h can also be connected to the authentication information validity determining module 140h by means of wired communication.

The authentication information validity judging module 140h includes a signal analysis processing module 141h and a comparison module 142h. The signal analysis processing module 141h analyzes the average value of the pulse intervals acquired within a predetermined period of time, and calculates a real-time pulse information value and the average value. The difference module, the comparison module 142h compares the difference with the preset allowable change difference, and determines that the received authentication information is valid within the allowed change difference, and if the difference does not fall within the pre-determination When the allowable variation difference range is set, the received authentication information is considered invalid. In addition, in other embodiments, the comparison module may also compare the pulse interval value obtained in real time with the maximum value and the minimum value of the analyzed pulse interval, and when the real-time received pulse interval value is smaller than the maximum value of the analyzed pulse interval, When the minimum value of the analyzed pulse interval is greater than the minimum value of the analyzed pulse interval, the determination of the authentication information is valid, allowing the ongoing operation of the head-mounted smart device to continue, and vice versa if the pulse interval value received in real time does not fall within the maximum pulse interval of the analysis. Between the value and the minimum value, it is determined that the currently received authentication information is invalid, and the operation currently performed by the head-mounted smart device is stopped.

In addition, in another embodiment, as shown in FIG. 40, a structural block diagram of an apparatus for determining validity of authentication information of a head-mounted smart device, wherein the pulse information acquiring module 130h includes a camera, the head-mounted smart device For the glasses-type structure, the camera is disposed at the front end of the bracket of the glasses, and is configured to acquire video information of a specified part of the face of the current user of the smart device, and transmit the video information to the validity judgment module of the authentication information. 140h, the authentication information validity judging module 140h includes a signal analysis processing module 143h and a calculation module 144h, and the signal analysis processing module 143h processes the person obtained by the camera with the video containing the colored face. The face region and the face position coordinates, at least the skin color region, and/or the eye, and/or the eye region are divided and classified, and the classification is given different weights, and the face region in each frame of video is separated by three colors, Each channel takes a spatial mean value, and the calculation module 144h performs independent component analysis ICA processing on the sampled data to obtain a pulse interval value, analyzes the average value of the pulse interval value, and calculates a difference between the real-time pulse information value and the average value.

The authentication information validity determining module 140h further includes a comparing module 145h, configured to compare the difference with a preset allowable change difference range, and identify the smart device authentication within the allowed change difference range. The information is valid. In addition, in other embodiments, the real-time acquired pulse interval value may be compared with the maximum value and the minimum value of the analyzed pulse interval value, and the pulse interval value obtained in real time is greater than the maximum pulse interval value obtained by the analysis. If the value is less than the minimum value of the pulse interval value obtained by the analysis, it is determined that the received authentication information is invalid. Otherwise, if the pulse interval value obtained in real time is larger than the minimum value of the pulse interval value obtained by the analysis and is smaller than the analysis result In the case of the maximum value of the pulse interval value, it is determined that the received authentication information is valid.

In this embodiment, the acquisition of the user's pulse information can be implemented by the following methods:

In addition, in another specific embodiment, as shown in FIG. 41, a structural block diagram of a device for determining validity of authentication information of a head-mounted smart device can acquire pulse information through a photoelectric sensor and acquire pulse information obtained by the photoelectric sensor. The signal amplification, filtering, A/D conversion, and single chip processing are transmitted to the action validity judgment module 130h.

In addition, in any of the above embodiments, the authentication information validity determining module 140h may be disposed on the head-mounted smart device, or may be disposed on a processing unit other than the head-mounted smart device, and the headset The communication connection between the smart devices, wherein the communication connection may include: wifi, Bluetooth, and the like.

As shown in FIG. 41, FIG. 41 is a diagram for judging head-mounted intelligence according to an embodiment of the present invention. Method for verifying the validity of the device authentication information The flow chart of the first embodiment includes the following steps:

Step S210: Obtain identification information, where the identity identification information is used to identify an identity of a user of the smart device;

Step S220: Perform authentication on the identity identification information to obtain authentication information, where the authentication information indicates whether the identity identification information passes authentication;

Step S230, acquiring specified information;

Step S240: Determine, in the case that the identity identification information is authenticated, whether the authentication information is valid according to the specified information.

As shown in FIG. 42 , FIG. 42 is a flowchart of a second embodiment of a method for determining validity of authentication information of a smart device according to an embodiment of the present invention, including the following steps:

Step S610a, acquiring identity identification information, where the identity identification information is used to identify the identity of the user of the head-mounted smart device;

Step S620a: authenticating the identity identification information to obtain authentication information, where the authentication information indicates whether the identity identification information passes the authentication;

Step S630a, acquiring temperature information;

In step S640a, if the identification information is authenticated, it is determined whether the authentication information is valid according to the temperature information.

Wherein, the identification information includes at least one of the following:

And, the temperature information includes continuous temperature information for a predetermined period of time, or a point value of a plurality of temperature information for a certain period of time.

In addition, contact or non-contact temperature sensors are used to obtain temperature information.

In one embodiment, the head-mounted smart device includes smart glasses, the contact temperature sensor is disposed on the nose pad of the smart glasses, the non-contact temperature sensor is disposed at the front end of the head-mounted smart device bracket, and the sensor Electrically connected to the control system of the head-mounted smart device.

In one embodiment, the method comprises:

Analyzing the average of the temperature information and calculating the difference between the real-time temperature value and the average value;

Compare the difference with the preset allowable change difference and identify within the allowable change difference The authentication information is valid.

In another embodiment, the method comprises:

Analyze the temperature range;

The temperature information acquired in real time is compared with the temperature range, and when the temperature information acquired in real time is within the temperature range, it is determined that the authentication information of the head-mounted smart device is valid.

It can be understood that with the development of the information age, the technology for transmitting certain manipulations through human eye movement information and the like has been more and more perfect, and at the same time liberating the hands of the people, it also brings some drawbacks, for example, The validity of the authentication information that has passed the authentication cannot be guaranteed in real time. Therefore, in the above manner, real-time monitoring of the temperature information of the user of the smart device can be realized, and the temperature information and the user of the user can be learned in real time. The threshold value or the comparison of the preset body temperature interval ranges can be used to determine whether the authentication information received by the smart device is valid, thereby enhancing the security of the smart device, such as the following scenario:

The user views the video or the document with the user authority through the head-mounted smart device, and can verify the identity of the user by means of iris information identification, and ensure the identity of the file reader in real time through the above-mentioned authentication information validity judgment manner. Whether the smart glasses are smart glasses, the user wears the smart glasses to view the video or the document, and after passing the user identity authentication, after opening the file, if the smart glasses are taken down halfway Or being switched to another person's head, if the temperature information detected by the authentication information validity judging module is discontinuous, or the fluctuation exceeds the preset allowable variation range, then the video playback end or the open end of the document Sending a close command, closing the video being played, or the document being viewed, largely ensures the security of the file review and protects user privacy.

In addition, when the headset device is used for the first time, or if the headset smart device needs to be replaced, the user identity information needs to be collected, and the function may be implemented by the body temperature sensing module, or may add information collection. The module, in the case that the module receives the information collection instruction, requires a certain time (for example, 3 minutes) to read and save the user identity information, during which the module continuously reads the current user's body temperature. Information, and record the overall trend of body temperature information during that time period, and determine body temperature based on the trend Average value, under normal circumstances, it may happen that a person's body temperature value changes drastically at one or more time points beyond the fluctuation range, but as long as the drastic change duration is very short, or only a time point appears After the change is restored, the overall change trend of the information has not changed, and the situation is still considered to satisfy the validity verification of the authentication information.

In addition, in addition to the above signal manipulation techniques, the technical solution of the present invention can be further applied to other fields such as medicine, supervision, and the like.

In addition, the head-mounted smart device provided by the embodiment of the present invention has a power-saving protection device. If the temperature sensing module does not detect the temperature information within the preset range within a predetermined time, the head-mounted smart device leaves the human body by default. , then automatically enters the sleep state.

As shown in FIG. 43, FIG. 43 is a flow chart showing the steps of the third embodiment of the method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention, including the following steps:

Step S610b, acquiring identity identification information, where the identity identification information is used to identify the identity of the head-mounted smart device user;

Step S620b: authenticating the identity identification information to obtain authentication information, where the authentication information indicates whether the identity identification information passes the authentication;

Step S630b, acquiring image information of at least one part of the head or the face of the human body;

Step S640b, in the case where the identification information is authenticated, it is determined whether the authentication information is valid according to the comparison result of the image information and the pre-stored standard image information.

Wherein, the identification information includes at least one of the following:

And, the image information includes image information within a preset time range, and when the image information is consistent with the pre-stored standard image information, it is determined that the authentication information is valid.

In addition, an image sensor is applied to acquire image information.

And, the method further includes:

An image information value is analyzed, and a difference between the image information value and a pre-stored standard image information value is calculated;

The difference is compared with a preset allowable change difference, and the difference is determined to be valid for the authentication information within the allowed change difference, wherein the image information value includes at least one of the following: a pixel value, Dimension value, feature point position coordinate value.

In addition, it should be noted that, in a specific embodiment, the acquired image information is not limited to the image information of at least one part of the head or the face of the human body described above, and may include other image information.

As shown in FIG. 44, FIG. 44 is a flow chart showing the steps of a method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention, including the following steps:

Step S610c: Obtain identification information, where the identity identification information is used to identify the identity of the user of the smart device;

Step S620c: authenticating the identity identification information to obtain authentication information, where the authentication information indicates whether the identity identification information passes the authentication;

Step S630c, acquiring pressure information of the weight-bearing part of the human body on the human body;

Step S640c: In the case that the identification information is authenticated, it is determined whether the authentication information is valid according to the pressure information.

Wherein, the identification information includes at least one of the following:

And, the method further includes:

Obtaining pressure information between the identification information at a certain time or at least two times, and determining that the authentication information is valid when the change value of the pressure information or the pressure information is within a corresponding preset threshold range.

In addition, pressure information is applied to obtain pressure information, and the pressure sensor is disposed on a portion of the head mounted smart device that contacts the head or face of the human body to obtain pressure information, preferably disposed on the nose pad of the stent or in proximity to the ear tray.

And, the acquired pressure analog signal information is converted into a digital signal.

Moreover, in one embodiment, the method includes:

The average value of the electrical signals converted into the pressure information acquired in a predetermined period of time is analyzed, and the difference between the real-time pressure value and the average value is calculated, and the comparison module performs the difference with the preset allowable change difference. In comparison, it is determined that the authentication information is valid within the allowed variation difference.

In addition, in a specific embodiment, the pressure information received by the module may also be obtained according to a specific situation, and is not limited to the pressure of the weight-bearing portion of the human body on the human body. Information.

As shown in FIG. 45, FIG. 45 is a flow chart showing the steps of the fifth embodiment of the method for determining the validity of the authentication information of the smart device according to an embodiment of the present invention, including the following steps:

Step S610d, acquiring identity identification information, where the identity identification information is used to identify the identity of the head-mounted user;

Step S620d: authenticating the identity identification information to obtain authentication information, where the authentication information indicates whether the identity identification information passes the authentication;

Step S630d, acquiring pulse information;

In step S640d, if the identification information is authenticated, it is determined whether the authentication information is valid according to the pulse information.

Wherein, the identification information includes at least one of the following:

And, obtaining pulse information includes:

The pulse interval of the human body is acquired for a certain period of time, and when the amount of change of the pulse interval or the pulse interval is within the corresponding set threshold range, it is determined that the authentication information is valid.

In addition, obtaining pulse information includes:

Acquire pulse information embodied in at least a portion of the human head or face.

In one embodiment, obtaining pulse information includes:

There should be a touch sensor or a non-contact sensor to obtain pulse information, and a contact sensor for detecting the pulse of the ear vein or the radial artery; the non-contact sensor includes at least a camera for acquiring pulse information by detecting a facial image.

And, the face region and the face position coordinates obtained by processing the video containing the color face obtained by the camera are at least subjected to the skin color region, and/or the eye, and/or the eye region, and the classification is given different weights. The face area in each frame of video is separated by three color channels, and the spatial mean value is taken for each channel. The calculation module performs ICA processing on the sampled data to obtain pulse information.

In addition, determining whether the authentication information is valid according to the pulse information includes:

The average value of the pulse information is analyzed, and the difference between the real-time pulse information value and the average value is calculated, and the difference is compared with a preset allowable change difference value, and the authentication information is identified as the authentication information within the allowed change difference value. effective.

The various embodiments in the present specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same similar parts between the various embodiments can be referred to each other.

The various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or a digital signal processor (DSP) can be used in practice to implement the operation of determining the operation of the smart device and the validity of the authentication information according to an embodiment of the present invention. Some or all of the features of some or all of the components. The invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein. Such a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

For example, FIG. 46 illustrates a server, such as an application server, that can determine the operation of the headset smart device and the validity of the authentication information in accordance with the present invention. The server conventionally includes a processor 410 and a computer program product or computer readable medium in the form of a memory 420. The memory 420 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM. Memory 420 has a memory space 430 for program code 431 for performing any of the method steps described above. For example, storage space 430 for program code may include various program code 431 for implementing various steps in the above methods, respectively. The program code can be read from or written to one or more computer program products. These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such a computer program product is typically a portable or fixed storage unit as described with reference to FIG. The storage unit may have a storage section, a storage space, and the like arranged similarly to the storage 420 in the server of FIG. The program code can be compressed, for example, in an appropriate form. Typically, the storage unit includes computer readable code 431', code that can be read by a processor, such as 410, which, when executed by a server, causes the server to perform various steps in the methods described above.

"One embodiment", "embodiment" or "one or more implementations" as referred to herein The <RTI ID=0.0>> </ RTI> </ RTI> <RTIgt; </ RTI> </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; example.

In the description provided herein, numerous specific details are set forth. However, it is understood that the embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of the description.

It is to be noted that the above-described embodiments are illustrative of the invention and are not intended to be limiting, and that the invention may be devised without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as a limitation. The word "comprising" does not exclude the presence of the elements or steps that are not recited in the claims. The word "a" or "an" The invention can be implemented by means of hardware comprising several distinct elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means can be embodied by the same hardware item. The use of the words first, second, and third does not indicate any order. These words can be interpreted as names.

In addition, it should be noted that the language used in the specification has been selected for the purpose of readability and teaching, and is not intended to be construed or limited. Therefore, many modifications and changes will be apparent to those skilled in the art without departing from the scope of the invention. The disclosure of the present invention is intended to be illustrative, and not restrictive, and the scope of the invention is defined by the appended claims.

Claims

A device for determining the operational effectiveness of a head-mounted smart device, comprising a motion sensing module for sensing an action of a human eye; a designated information acquisition module for acquiring specified information of at least one part of the human body; Determining the validity of the action according to the specified information, wherein the action sensing module, the designated information acquiring module are all disposed on the head-mounted smart device.
The device of claim 1, wherein the specifying information comprises temperature information, and the specifying information acquiring module comprises a temperature sensing module for acquiring temperature information;

The acquisition temperature information includes continuous temperature information between a predetermined time length or a set action interval, or a point value of temperature information acquired in a predetermined period between a certain time or a set action interval;

The temperature sensing module is a contact type or non-contact temperature measuring sensor;

The head-mounted smart device includes smart glasses, the contact temperature measuring sensor is disposed on a nose pad of the smart glasses, and the non-contact temperature measuring sensor is disposed on the head mounted smart device bracket. The front end portion is electrically connected to the control system of the head-mounted smart device.
The device according to claim 2, wherein the action validity judging module compares the temperature information received in real time with a preset temperature information range, and the temperature information received in the real time is in the preset temperature information. In the case of the range, it is determined that the motion information of the human eye sensed by the current motion sensing module is valid;

and / or

The action validity judgment module includes a signal analysis processing module and a comparison module, and the signal analysis processing module analyzes an average value of the temperature within a predetermined time, and calculates a difference between the temperature value acquired in real time and the average value, The comparing module compares the difference with a preset allowable change difference, and determines that the action is valid within the allowed change difference;

The temperature sensing module includes a temperature sensor, a signal conditioning circuit, the signal conditioning circuit is coupled to the signal analysis processing module, and an output of the temperature sensor is coupled to an input of the signal conditioning circuit, the signal A conditioning circuit is operative to convert the temperature information sensed by the temperature sensor to an electrical signal identifiable by the analysis processing module.
The apparatus according to claim 1, wherein the specifying information includes image information, and the specifying information acquiring module includes a feature information acquiring module configured to acquire at least one of a human head or a face Image information of the part; wherein the image information acquired by the feature information acquiring module includes image information between predetermined time intervals or set action intervals;

When the real-time image information coincides with the pre-stored standard image information, the action validity determination module determines that the action is valid to perform the operation corresponding to the action.
The apparatus according to claim 4, wherein said action validity determining module comprises at least one image sensor, and said image sensor acquires image information of at least one portion of a human head portion;

The action validity determining module further includes a signal analysis processing module and a comparison module, wherein the signal analysis processing module analyzes pixels, and/or size, and/or feature point positions of the image information, and calculates real-time image information and a difference between a pixel of the stored standard image information, and/or a size, and/or an average of the position of the feature point, the comparison module comparing the difference to a preset allowable change difference, Within the allowed variation difference is determined to be effective;

The feature information acquiring module includes an image sensor, a signal conditioning circuit, and the signal conditioning circuit is connected to the signal analysis processing module, and an output end of the image sensor is connected to an input end of the signal conditioning circuit, and the signal conditioning The circuit is configured to convert an image signal acquired by the image sensor into an electrical signal recognizable by the signal analysis processing module.
The device of claim 1 , wherein the designation information includes pressure information, and the designation information acquisition module includes a pressure information acquisition module, configured to acquire pressure information of a head-mounted smart device disposed on a weight bearing portion of the human body;

The pressure information acquiring module includes at least one pressure sensor, and the pressure sensor is disposed on a portion of the head mounted smart device that contacts the head or the face of the human body to obtain pressure information;

The pressure information acquisition module acquires pressure information between actions of the human eye at a certain time or at least two times, when the change value of the pressure information or the pressure information is within a corresponding set threshold range, Determining that the action is valid and performing the action;

The pressure information acquisition module further includes a converter that converts the obtained pressure analog signal information into a digital signal.
The apparatus according to claim 6, wherein the action validity determining module comprises a signal processing module and a comparison module, wherein the signal processing module analyzes the average value of the electrical signals converted into the pressure information in a predetermined period of time and calculates the real-time. And a difference between the pressure information value and the average value, the comparison module compares the difference value with a preset allowable change difference value, and determines that the action is valid within the allowed change difference value.
The apparatus according to claim 1, wherein said specifying information includes pulse information, said designation The information acquisition module includes a pulse information acquisition module, configured to acquire pulse information embodied in a part of the human head or a face;

The pulse information acquisition module acquires continuous pulse information between a certain time or a set of at least two action intervals, and when the calculated interval of the pulse is within the set threshold range, it is determined that the action is valid and Perform the appropriate action.
The device according to claim 8, wherein said pulse information acquisition module comprises at least one contact or non-contact sensor for detecting a pulse of an ear vein or a radial artery; said non-contact sensor Included at least with a camera, the camera is disposed on a bracket of the head-mounted smart device, and acquires pulse information by detecting a facial image;

The touch sensor is connected to the bracket of the head-mounted smart device through a rotatable link;

The action validity judgment module includes a signal processing module and a calculation module, and the signal processing module processes the face region and the face position coordinates obtained by the camera with the color face-containing video, at least the skin color region, and/or the eyes, and / or the eye segmentation classification, assigning different weights to the classification, performing a three-color channel separation on the face region in each frame of video, taking a spatial mean for each channel, and the calculation module performs ICA on the sampled data. Processing to obtain pulse information;

The action validity determining module further includes a comparing module, wherein the calculating module analyzes an average value of the pulse intervals, and calculates a difference between a real-time pulse interval value and an average value, and the comparing module compares the difference with The preset allowable change difference is compared, and the operation is determined to be valid within the allowable change difference.
The apparatus of claim 1, the action validity determination module being disposed on the head mounted smart device.
The apparatus according to claim 1, wherein the action validity determining module is disposed on a processing unit independent of the head-mounted smart device and is in communication connection with the head-mounted smart device.
An apparatus for determining validity of authentication information of a head-mounted smart device, comprising: an identity identification information acquiring module, configured to obtain identity identification information; and an identity identification information authentication module, configured to authenticate the identity identification information, Obtaining authentication information; the specified information obtaining module is configured to acquire specified information of at least one part of the human body; and the authentication information validity determining module is configured to determine, according to the specified information, that the identification information is authenticated Whether the authentication information is valid.
The apparatus of claim 12, the identification information comprising at least one of:

Iris information, auricle information, sound information, fingerprint information, password information.
The apparatus according to claim 12 or 13, wherein said specifying information includes temperature information, The specified information acquisition module includes a temperature sensing module for acquiring temperature information;

The temperature sensing module acquires continuous temperature information within a predetermined time period, or a point value of a plurality of temperature information within a certain time period;

The temperature sensing module is a contact or non-contact temperature sensor;

The head-mounted smart device includes smart glasses, the contact temperature sensor is disposed on a nose pad of the smart glasses, and the non-contact temperature sensor is disposed at a front end portion of the head-mounted smart device bracket, and The sensor is electrically connected to the control system of the head-mounted smart device.
The apparatus according to claim 14, wherein said authentication information validity judging module comprises a signal analysis processing module and a comparison module, wherein the signal analysis processing module analyzes an average value of body temperature changes and calculates a difference between the real-time temperature value and the average value. a value, the comparison module compares the difference with a preset allowable change difference, and determines that the authentication information is valid within the allowed change difference;

and / or,

The authentication information validity judging module includes a signal analysis processing module and a comparison module, and the signal analysis processing module analyzes the temperature range, and the comparison module compares the temperature information acquired in real time with the temperature range, and obtains the real-time obtained in the real-time When the temperature information is within the temperature range, it is determined that the authentication information of the head-mounted smart device is valid;

The temperature sensing module comprises an integrated temperature sensor, a signal conditioning circuit, the signal conditioning circuit is connected to the signal analysis processing module, and an output end of the body temperature sensor is connected to an input end of the signal conditioning circuit, the signal The conditioning circuit is operative to convert the received body temperature signal into an electrical signal identifiable by the signal analysis processing module.
The apparatus according to claim 12 or 13, wherein the specifying information includes image information, and the specifying information acquiring module includes an image sensing module, configured to acquire image information of at least one part of a head or a face of the human body;

The image information includes image information in a preset time range, and when the image information is consistent with the pre-stored standard image information, it is determined that the authentication information is valid;

The image sensing module includes an image sensor that acquires the image information.
The apparatus according to claim 16, wherein the authentication information validity judging module comprises a signal analysis processing module and a comparison module, wherein the signal analysis processing module analyzes the image information value, and calculates the image information value and the pre-stored standard image. a difference between the information values, the comparison module comparing the difference with a preset allowable change difference, the difference being deemed to be valid for the authentication information within the allowed change difference, wherein The image information value includes at least one of the following: a pixel value, Dimension value, feature point position coordinate value;

The image sensing module includes an image sensor, a signal conditioning circuit, the signal conditioning circuit is coupled to the signal analysis processing module, and an output end of the image sensor is coupled to an input end of the signal conditioning circuit, the signal conditioning circuit And for converting an image signal acquired by the image sensor into an electrical signal recognizable by the signal analysis processing module.
The device according to claim 12 or 13, wherein the designation information includes pressure information, and the designation information acquisition module includes a pressure information acquisition module, configured to acquire pressure information of a head-mounted smart device disposed on a weight bearing portion of the human body;

The pressure information acquiring module acquires the pressure information between the identification information and the at least two adjacent acquisitions, when the pressure information or the change value of the pressure information is at a corresponding preset threshold. When the scope is within, it is determined that the authentication information is valid;

The pressure information acquiring module includes at least one pressure sensor, and the pressure sensor is disposed on a portion of the head mounted smart device that contacts the head or the face of the human body to obtain pressure information;

The pressure information acquisition module further includes a converter that converts the obtained pressure analog signal information into a digital signal.
The apparatus according to claim 18, wherein the authentication information validity judging module comprises a signal processing module and a comparison module, wherein the signal processing module analyzes an average value of the electrical signals converted into the pressure information acquired within a predetermined period of time, and Calculating a difference between the real-time pressure value and the average value, the comparing module compares the difference with a preset allowable change difference, and determines that the authentication information is valid within the allowed change difference value.
The apparatus according to claim 12 or 13, wherein the designation information includes pulse information, and the designation information acquisition module includes a pulse information acquisition module, configured to acquire pulse information embodied by at least a part of a human head or a face;

The pulse information acquisition module acquires a pulse interval of the human body within a certain time period, and when the change amount of the pulse interval or the pulse interval is within a corresponding set threshold value range, determining that the authentication information is valid;

The pulse information acquiring module includes at least one contact type or non-contact type sensor for detecting a pulse of an ear vein or a radial artery; the non-contact type sensor includes at least one camera, and the camera setting Acquiring pulse information by detecting a facial image on a bracket of the head-mounted smart device;

The touch sensor is connected to the bracket of the head-mounted smart device through a rotatable link Pick up.
The apparatus according to claim 20, wherein the authentication information validity judging module comprises a signal processing module and a calculation module, and the signal processing module processes the face region and the face position coordinates obtained by the camera with the color face-containing video obtained by the camera, Perform at least a skin color region, and/or an eye, and/or an eye segmentation classification, assign different weights to the classification, perform a three-color channel separation for the face region in each frame video, and take a space for each channel. Mean, the calculation module performs ICA processing on the sampled data to obtain pulse information;

The authentication information validity judging module further includes a comparison module, the signal processing module analyzes an average value of the pulse information, and calculates a difference between the real-time pulse information value and the average value, and the comparison module compares the difference The value is compared with the preset allowable change difference, and the authentication information is determined to be valid within the allowed change difference.
A method for determining the operational effectiveness of a head-mounted smart device includes the steps of:

Sensing action information of the human eye, the action information corresponding to an operation instruction of the head-mounted smart device, for manipulating the head-mounted smart device;

Obtain the specified information;

Determining the validity of the action information based on the specified information.
A method for determining validity of authentication information of a head-mounted smart device includes the following steps:

Obtaining identification information, the identification information is used to identify an identity of a user of the smart device;

And authenticating the identity identification information to obtain authentication information, where the authentication information indicates whether the identity identification information passes authentication;

Obtain the specified information;

In the case that the identification information is authenticated, it is determined whether the authentication information is valid according to the specified information.
A computer program comprising computer readable code, when said computer readable code is run on a server, causing said server to perform an operation of determining that said head mounted smart device is active according to any one of claims 22-23 The method of the sexuality or the method for determining the validity of the authentication information of the smart device.
A computer readable medium storing the computer program of claim 24.