WO2015109907A1

WO2015109907A1 - Device and method for detecting continuous attachment of head-mounted intelligent device

Info

Publication number: WO2015109907A1
Application number: PCT/CN2014/094297
Authority: WO
Inventors: 黄晶
Original assignee: 北京奇虎科技有限公司; 奇智软件（北京）有限公司
Priority date: 2014-01-24
Filing date: 2014-12-19
Publication date: 2015-07-30

Abstract

Disclosed are a device and method for detecting continuous attachment of a head-mounted intelligent device, the device at least comprising an identity consistency information acquisition module and an identity consistency information determination module. The identity consistency information acquisition module acquires information of the distance between at least one of the head and face and a corresponding part on the head-mounted intelligent device; the identity consistency information determination module uses computed distance information to determine whether the head-mounted intelligent device is continuously attached according to a preset threshold. The technical solution of the present invention determines whether the head-mounted intelligent device is continuously attached by acquiring the information of the distance between at least one of the head and face and a corresponding part on the head-mounted intelligent device based on the result of the comparison between the distance information and the preset threshold, thus significantly ensuring operational safety of the head-mounted intelligent device.

Description

Apparatus and method for detecting continuous attachment of a head-mounted smart device to a human body

Technical field

The present invention relates to the field of smart devices and, in particular, to an apparatus and method for detecting that a head mounted smart device is continuously attached to a human body.

Background technique

The head-mounted device can integrate a camera device and a control chip to form a head-mounted smart device (such as a smart glasses device), providing users with rich personalized functions and information. With the development of science and technology, the practicality and entertainment of head-mounted smart devices have been continuously enhanced, and are now being applied to various fields such as people's work and life.

Head-mounted smart devices, like smart phones, have an independent operating system, which can be installed by software, games, and other software service providers. It can be added by voice or action to add schedules, map navigation, interact with friends, and take photos. And video, video chat with friends and other functions, and wireless network access through the mobile communication network.

At present, human-computer interaction mostly uses human body language to send command signals to the computer, such as sending signals to the computer through the mouse, controlling the game through the body, and using the finger to click on the touch screen, while the head-mounted smart device can View calendar, time, temperature, geographic location, voice search, video call, identify direction, music play, web search, send and receive text messages by voice, or visual control (such as blinking, nodding, shaking your head, voice) Or e-mail, photo, video and other functions, in addition to the above functions, the head-mounted smart device can also interact with the environment to expand the reality, for example: if you see the subway out of service, the head-mounted smart device will display the subway outage The reason and provide an alternative route; if you see a book, you can view the book's book review and price; if you are waiting for a friend, the head-mounted smart device will show the friend's location.

In addition, with the intelligentization of human-computer interaction, in the prior art, the privacy requirements for private information and the like are becoming higher and higher, although the collection of biological features such as iris information and auricle information can be realized by the prior art. To meet the requirements of identity authentication to a certain extent, if there is no guarantee that the head-mounted smart device will continue to adhere to the human body, there is no guarantee that the identity of the user in the process of performing an operation is consistent, and thus, it may lead to others. Some unauthorized operations, causing loss to the user, or requiring frequent authentication, affecting the convenience of operation, although it is possible to manipulate the smart device through the eye movement of the person, but it is not necessary to determine whether the device is continuously attached to the human body. The above function will cause the previous operation to continue after the device leaves the human body, resulting in waste of power and leakage of user privacy. In this regard, no clear solution has been proposed in the prior art.

Therefore, it is necessary to improve the existing technical solutions to provide a detection head-mounted smart device. Devices and methods that continue to adhere to the human body.

The present invention has been made in view of this.

Summary of the invention

In view of the above problems, the present invention has been made in order to provide an apparatus, method, computer program, and computer readable medium for detecting that a head mounted smart device is continuously attached to a human body that overcomes the above problems or at least partially solves the above problems.

In order to achieve the object, the present invention adopts the following technical solutions:

According to an aspect of the present invention, a device for detecting that a head-mounted smart device is continuously attached to a human body is provided. The device includes at least an identity consistency information acquisition module and an identity consistency information determination module, and an identity consistency information acquisition module. Obtaining distance information between at least one part of the human head or the face and a corresponding part of the head-mounted smart device, the identity consistency information determining module calculates the distance information and determines whether the head-mounted smart device continues to adhere according to the preset threshold value. On the human body.

According to another aspect of the present invention, a method of detecting that a head-mounted smart device is continuously attached to a human body is provided, the method comprising:

Obtaining distance information between at least one part of the human head or the face to which the head-mounted smart device is currently attached and the corresponding part on the head-mounted smart device;

The distance information is calculated, and whether the head-mounted smart device is continuously attached to the human body is determined according to a preset threshold.

According to an aspect of the present invention, a device for detecting that a head-mounted smart device is continuously attached to a human body is provided. The device includes at least an identity consistency information acquiring module and an identity consistency information determining module, and the identity consistency information acquiring module obtains The body temperature information of the human body, the identity consistency information judging module judges whether the head-worn smart device is continuously attached to the human body according to the body temperature information.

The body temperature information of the acquired human body is continuous body temperature information within a predetermined time, or a point value of body temperature information acquired in a predetermined period within a predetermined time.

Obtaining body temperature information of a human body to which the head-mounted smart device is currently attached;

According to the acquired body temperature information, it is determined whether the head-mounted smart device is continuously attached to the human body.

The acquired body temperature information is continuous body temperature information within a predetermined time, or a point value of body temperature information acquired in a predetermined period within a predetermined time.

According to an aspect of the present invention, a device for detecting that a head-mounted smart device is continuously attached to a human body is provided. The device includes at least an identity consistency information acquisition module and an identity consistency information determination module, and an identity consistency information acquisition module. Acquiring the head-mounted smart device to be placed on the weight bearing part of the human body The pressure information, the identity consistency information determining module determines whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the pressure information and the preset threshold.

Obtaining pressure information of the head-mounted smart device disposed on the weight bearing portion of the human body;

Whether the head-mounted smart device is continuously attached to the human body is determined according to the comparison result of the pressure information and the preset threshold.

According to an aspect of the present invention, a device for detecting that a head-mounted smart device is continuously attached to a human body is provided. The device includes at least an identity consistency information acquisition module and an identity consistency information determination module, and an identity consistency information acquisition module. Obtaining image information of at least one part of the human head or the face, the identity consistency information determining module determines whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the image information and the pre-stored standard image information.

The acquiring module acquires image information of at least one part of a human head or a face to which the head-mounted smart device is attached;

Whether the head-mounted smart device is continuously attached to the human body is determined based on the comparison result of the image information and the pre-stored standard image information.

According to an aspect of the present invention, a device for detecting that a head-mounted smart device is continuously attached to a human body is provided. The device includes at least an identity consistency information acquisition module and an identity consistency information determination module, and an identity consistency information acquisition module. Acquiring the pulse information, the identity consistency information determining module calculates the interval of the pulse, and determines whether the head-mounted smart device is continuously attached to the human body according to the set threshold. At least the identity consistency information acquiring module is disposed on the head-mounted smart device.

Obtain pulse information;

Based on the pulse information, the interval of the pulse is calculated, and it is determined whether the head-mounted smart device is continuously attached to the human body according to the set threshold.

According to another aspect of the present invention, a computer program is provided, comprising computer readable code that, when executed by an electronic device, causes said detecting head mounted smart device to remain attached to a human body The method is executed.

According to still another aspect of the present invention, a computer readable medium storing a computer program as described above is provided.

After adopting the technical solution described in the present invention, the following beneficial effects are brought about:

According to the technical solution of the present invention, it is possible to verify whether the head-mounted smart device is continuously attached to the human body.

The above description is only an overview of the technical solutions of the present invention, and the above-described and other objects, features and advantages of the present invention can be more clearly understood. The specific embodiments of the present invention are described in further detail below with reference to the accompanying drawings.

DRAWINGS

Various other advantages and benefits will become apparent to those skilled in the art from a The drawings are only for the purpose of illustrating the preferred embodiments and are not to be construed as limiting. Throughout the drawings, the same reference numerals are used to refer to the same parts. In the drawing:

1 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention;

2a is a block diagram showing the structure of a detecting head-mounted smart device according to an embodiment of the present invention;

2b is a schematic structural diagram of a detecting head-mounted smart device according to an embodiment of the present invention;

FIG. 3a is a structural block diagram of a detecting head-mounted smart device according to still another embodiment of the present invention; FIG.

FIG. 3b is a block diagram showing the structure of a distance sensing module in a head-mounted smart device according to an embodiment of the invention; FIG.

FIG. 4a is a structural block diagram of a detecting head-mounted smart device according to still another embodiment of the present invention; FIG.

FIG. 4b is a schematic structural diagram of a detecting head-mounted smart device according to still another embodiment of the present invention; FIG.

Figure 5 is a flow chart showing the operation of an alarm module according to an embodiment of the present invention;

6 is a block diagram showing the structure of a detecting head-mounted smart device according to an embodiment of the present invention;

FIG. 8 is a structural block diagram of an apparatus 100 for detecting that a head mounted smart device is continuously attached to a human body according to another embodiment of the present invention; FIG.

9 is a structural block diagram of a device for detecting that a head-mounted smart device is continuously attached to a human body according to another embodiment of the present invention;

FIG. 10 is a structural block diagram of a device 200 for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention; FIG.

11 is a flow chart showing the operation of an alarm module in a device 200 for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention;

12 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention;

Figure 13: Method for detecting continuous attachment of a head-mounted smart device to a human body in accordance with an embodiment of the present invention flow chart;

FIG. 14 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention; FIG.

15 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to another embodiment of the present invention;

FIG. 16 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention; FIG.

17 is a flow chart showing the operation principle of an alarm module in a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention;

FIG. 18 is a schematic structural diagram of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention; FIG.

19 is a flow chart showing a method of detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention;

20 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention;

21 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to another embodiment of the present invention;

FIG. 22 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention; FIG.

23 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention;

24 is a flow chart showing a method of detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention;

25 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention;

26 is a schematic structural view of a device for detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention;

FIG. 27 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to another embodiment of the present invention; FIG.

28 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention;

29 is a schematic structural diagram of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention;

30 is a schematic diagram of RGB three-color signal sequence data obtained by processing a video having a duration of 30 pulse periods according to another embodiment of the present invention;

FIG. 31 is a schematic diagram showing an effect of performing ICA processing on a facial video of a period of 30 pulse periods, and then filtering by arithmetic mean filtering according to another embodiment of the present invention; FIG.

Figure 32 is a schematic diagram showing the principle of a photoelectric sensor in accordance with one embodiment of the present invention;

Figure 33 is a block diagram showing the structure of a photoelectric intelligent pulse measuring system according to an embodiment of the present invention;

FIG. 34 is a flowchart of a method for detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention; FIG.

Figure 35 shows a block diagram of an electronic device for performing the method of the present invention;

Figure 36 shows a schematic diagram of a memory unit for holding or carrying program code implementing a method in accordance with the present invention.

detailed description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While the embodiments of the present invention have been shown in the drawings, the embodiments Rather, these embodiments are provided so that this disclosure will be more fully understood and the scope of the disclosure will be fully disclosed.

According to an embodiment of the present invention, there is provided a device for detecting that a head-mounted smart device is continuously attached to a human body.

As shown in FIG. 1 , the device includes at least an identity consistency information acquiring module 110 and an identity consistency information determining module 120. The identity consistency information acquiring module 110 acquires at least one part of a human head or a face and a head-mounted smart device. The distance information between the corresponding parts, the identity consistency information determining module 120 calculates the distance information and determines whether the head-mounted smart device is continuously attached to the human body according to a preset threshold.

In addition, in a specific embodiment, the distance information acquired by the identity consistency information acquiring module 110 may also include other distance information, and is not limited to the above-mentioned at least one part of the human head or the face and the head-mounted smart. Distance information between corresponding parts on the device.

In a specific embodiment, for example, the apparatus 100 for detecting the head-mounted smart device continuously attached to the human body is shown in FIG. 2a and FIG. 2b, wherein FIG. 2a is a structural block diagram of the device, and FIG. 2b is a structural schematic diagram of the device. The device includes a wearing support device 10, a distance sensor 20, and an identity consistency information determining module 120. The distance sensor 20 and the identity consistency information determining module 120 are connected and disposed on the wearing support device 10, and the distance sensor 20 is used. Obtaining distance information between at least one part of the head or the face of the head-mounted smart device and the corresponding position of the head-mounted smart device, and transmitting the information to the identity consistency information determining module 120, the identity consistency information The determining module 120 compares the received distance information with a preset distance range, and the distance information is within a preset distance range, and then determines that the head-mounted smart device is continuously attached to the human body. In addition, in other embodiments, the identity consistency information determining module 120 may be disposed on a separate unit outside the wearing support device 10.

The wearing support device 10 is worn on the user, and fixes the distance sensor 20 to the detecting portion of the user to continuously detect the distance information between the smart device and the user. In this embodiment, the wearing device is worn. 10 is worn on the user's head, which is a glasses-type structure, and the distance sensor 20 is disposed at the front end of the bracket of the glasses. Of course, in other embodiments, the head-mounted smart device may also be a headset, a hat, a head cover, etc. As long as the distance sensor 20 can maintain a relatively static positional relationship with the measured portion of the user, and further, the head-mounted smart device can further include a display screen, if necessary, in the case of a display screen, the distance sensor 20 transmits the detected distance information to the display screen and displays the distance information through the display screen.

The distance information includes continuous distance information within a preset time range or a preset action interval, and may also be a time when the head-mounted smart device performs a certain operation process, or may be a hardware environment such as a power source. All of the time allowed, here, those skilled in the art can make settings according to specific conditions, and the present invention is not specifically limited.

In addition, in another specific embodiment, as shown in FIG. 3a, a structural block diagram of a device for detecting that the head mounted smart device is continuously attached to the human body, wherein the identity consistency information acquiring module 110 includes a distance sensing module 111 and a signal. The modulation module 112 and the communication module 113 are connected, and the distance sensing module 111, the signal modulation module 112, and the communication 113 are sequentially and electrically connected.

The distance sensing module 111 is configured to sense distance information between the module and the target. The distance sensing module 111 further includes a transmitting unit 114, a receiving unit 115, a calculating unit 116, and a transmitting unit, as shown in FIG. 3b. 114. The receiving unit 115 is electrically connected to the computing unit 116.

The transmitting unit 114 is configured to send a distance measurement signal, and the receiving unit 115 is configured to receive the The distance measurement signal reflected by the target is used by the calculation unit 116 to calculate the distance value of the distance sensing module 111 from the target according to the time taken by the distance measurement signal. In this embodiment, the transmitting unit 114 is preferably a laser emitter having a laser diode for emitting laser light as a distance measuring signal, but the invention is not limited thereto, and the transmitting unit 114 can also be an infrared emitter. The infrared ray is used as the distance measurement signal, or the transmitting unit 114 may be an ultrasonic transmitter for transmitting the ultrasonic wave as the distance measurement signal, or the distance measurement by other light waves or sound waves, and the calculation unit 116 measures the distance according to different properties. The difference in the propagation speed of the signal in the medium is taken to the corresponding calculation method.

The distance sensing module 111 transmits the sensed distance signal to the signal modulation module 112. The signal modulation module 112 amplifies and filters the distance signal and transmits the distance signal to the communication module 113. The communication module 113 will process the distance processed by the signal modulation module 112. The signal is sent to the identity consistency information determining module 120. The identity consistency information determining module 120 compares the received distance signal with a preset threshold distance signal, and determines whether the detected distance information is abnormal according to the comparison result.

In addition, in this embodiment, the identity consistency information determining module 120 further includes a comparator 121, an adjustable resistor 122, and an adjusting component 123, wherein the comparator 121 and the communication module 113 are electrically connected, and receive the distance transmitted by the communication module 113. a signal (ie, an electrical signal processed by the signal modulation module 113) and compared with a preset threshold voltage signal, and determining whether the head-mounted smart device is continuously attached to the human body based on the comparison result, for example, when the comparator If the received distance signal exceeds the preset maximum threshold voltage signal or is less than the preset minimum threshold voltage signal, the head-mounted smart device is considered not to be continuously attached to the human body, and if the detected distance is When the signal is continuous, and the distance signal does not exceed the preset maximum threshold voltage signal and is greater than the preset minimum threshold voltage signal, the head-mounted smart device is considered to be continuously attached to the human body. The adjustable resistor 122 is used to adjust the threshold voltage signal. In this embodiment, the resistance value of the adjustable resistor 122 is changed by the adjusting member 123 to adjust the threshold voltage signal.

Specifically, in this embodiment, the identity consistency information obtaining module 110 acquires the distance value between the at least one part of the head or the face of the user of the head-mounted smart device and the distance sensor 20 in real time, and the distance value is The preset distance range is compared, and if the distance value falls within the preset distance range, the head-mounted smart device is considered to be continuously attached to the human body because, if the head-mounted smart device is If it is removed, the detected distance value must change significantly, beyond the predetermined range. In addition, due to the difference in the shape of each person's head, when the wearing smart device is worn, the detected distance value may be different, so When the head-mounted smart device is used for the first time or the user of the smart device needs to be replaced, the allowed distance range needs to be set, which can be realized by information acquisition over a period of time, and is adjustable The resistor 122 and the adjustment member 123 are used to achieve a predetermined range of adjustment.

In addition, in another embodiment, as shown in FIG. 4a and FIG. 4b, another device 200 for detecting that the head-mounted smart device is continuously attached to the human body is continuously attached to the human body with the above-mentioned detecting head-mounted smart device. The device 100 differs in that the device 200 that detects that the head-mounted smart device is continuously attached to the human body further includes an alarm module 40. The alarm module 40 is connected to the identity consistency information determination module 120. In the present embodiment, the alarm module 40 is connected to the identity consistency information determination module 120 via a communication interface (not shown). The identity consistency information determining module 120 controls the start or stop of the alarm module 40 by comparing the distance signal with the threshold value signal. Specifically, in combination with FIG. 3a, the comparator 121 compares the distance signal with a preset threshold signal, and when the distance signal is greater than the preset maximum threshold signal, the comparison result output by the comparator 121 is a high level; When the distance signal is less than the preset minimum threshold value signal, the comparison result output by the comparator 121 is a low level. The comparison result of the high level or the low level is transmitted to the alarm module 40, and the alarm module 40 is controlled to start or stop accordingly, and regardless of the type of alarm generated by the alarm module 40, it is considered that the detected distance information is abnormal, possibly The head-mounted smart device leaves the human body, and the user of the head-mounted smart device may change, and in either case, it is unfavorable for the user to operate safely, so it needs to be avoided as much as possible.

As shown in FIG. 5, in this embodiment, the identity consistency information determining module 120 configures two 10-pins that receive the comparison result as a PA interrupt pin and a PB interrupt pin, wherein the PA is a falling edge causing an interrupt, and PB is A rising edge causes an interruption. When an interruption occurs, the identity consistency information determining module 120 first determines the source of the interruption. If it is derived from the PA and continuously monitors the low level for a certain period of time, the distance signal of the detected subject is considered to be lower than the preset. The minimum threshold, the identity consistency information judging module 120 issues a close-range reminder, and controls the alarm module 40 to issue a close-range alarm signal; if it returns to the high level during this time, the previous low level is regarded as an isolated value. It is not considered an abnormal situation. Similarly, if the interruption originates from the PB, and the high level is continuously monitored for a certain period of time, it is considered that the detected distance information rises above a preset maximum threshold value, and the identity consistency information determining module 120 issues a remote distance reminder. And controlling the alarm module 40 to issue a long-distance alarm signal; if it returns to a low level within this time, it is regarded as the isolated high level as an isolated value, and is not considered to be an abnormal situation.

Specifically, in the initialization phase, the PA and PB pins are configured as corresponding interrupt functions, and their module interrupts are enabled (implemented through configuration registers). After the configuration, when the PA and PB are interrupted, it indicates that the detected distance information is abnormal, that is, it is necessary to analyze whether the head-mounted smart device is continuously attached to the human body and decide whether to alarm.

Thereafter, the interrupt needs to be opened, that is, the identity consistency information determination module 120 is allowed to process the maskable interrupt (also implemented by the configuration register).

Then, waiting for the interrupt, in fact, the identity consistency information judging module 120 enters the low power mode, is in a state of waiting for the interrupt to wake up, and the specific implementation is also through the configuration register. Waiting for the interrupt, this state will remain until the interrupt request is generated, so after waiting for the interrupt, it will start processing the interrupt request. It is.

When processing an interrupt request, it is first necessary to mask the interrupt, because if the interrupt is not masked, a new interrupt request may be generated, thereby disrupting the processing of the current interrupt request.

Then, data monitoring is performed for a period of time to determine whether the detected distance information is abnormal.

After processing the interrupt, return i=0, then open the interrupt again and wait for the next interrupt request to arrive.

It can be understood that the identity consistency information determining module 120 simultaneously processes the distance information and can display it through the display screen.

It can be understood that the connection between the alarm module 40 and the identity consistency information determining module 120 can also be implemented by wire or wirelessly. In this embodiment, the alarm module 40 and the identity consistency information determining module 120 are implemented through the Internet. Communication connection.

It can be understood that the alarm module 40 can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm. At the same time, the alarm module 40 can be disposed on the head-mounted smart device or on the processing unit independent of the head-mounted smart device.

In addition, in another embodiment, the apparatus for detecting that the head mounted smart device is continuously attached to the human body is provided. As shown in FIG. 6, the identity consistency information acquiring module 110 includes a distance sensor 61 and a signal conditioning circuit 62. The output end of the distance sensor 61 is connected to the input end of the signal conditioning circuit 62. The identity consistency information determining module 120 includes a signal analysis processing module 71 and a comparison module 72. The signal conditioning circuit 62 is connected to the signal analysis processing module 71 for The distance signal acquired by the distance sensor 61 is converted into an electrical signal recognizable by the signal analysis processing module 71, and the signal analysis processing module 71 analyzes the average value of the distance information received within a predetermined period of time, and calculates the distance received in real time. The difference between the information and the average value, the signal indicating the difference is sent to a comparison module 72, and the comparison module 72 compares the difference with a preset allowable change difference within the allowed variation difference. It is determined that the head-mounted smart device is continuously attached to the human body, and conversely, the head-mounted smart device is not continuously attached to the human body.

In particular, signal conditioning circuit 62 is operative to transform the analog signal into a digital signal for data acquisition, control processes, performing computational display readout, or other purposes. The distance sensor 61 measures the distance information of the user, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current or resistance change, and therefore must be amplified and buffered before being converted into a digital signal. Or scaling the analog signal, etc., that is, the conditioning process, making it suitable for the input of an analog-to-digital converter (ADC). Then, the ADC digitizes the analog signal and sends the digital signal to the MCU or other digital device for use. Data processing in the system.

In addition, in any of the above embodiments, the identity consistency information determining module 120 may be disposed on the head mounted smart device, or may be disposed on a processing unit other than the head mounted smart device, and Headset smart devices are connected via wireless devices such as wifi and Bluetooth.

According to an embodiment of the present invention, there is also provided a method of detecting that a head-mounted smart device is continuously attached to a human body.

As shown in FIG. 7, the method includes:

Step S710: Obtain distance information between at least one part of the human head or the face to which the head-mounted smart device is currently attached and the corresponding part on the head-mounted smart device;

Step S720, calculating the distance information, and determining whether the head-mounted smart device is continuously attached to the human body according to the preset threshold.

The distance information includes distance information within a preset time range. When the distance information is within the set threshold range, it is determined that the head-mounted smart device is continuously attached to the human body.

In one embodiment, calculating the distance information and determining whether the head-mounted smart device is continuously attached to the human body according to the preset threshold includes:

Calculating a difference between the real-time detected distance information value and the pre-stored average distance information, and comparing the difference with a preset allowable change difference, wherein the difference is within a preset allowable change difference It is recognized that the head-mounted smart device is continuously attached to the human body.

In addition, in a specific embodiment, the acquired distance information may also include other distance information, and is not limited to the foregoing between the at least one part of the human head or the face and the corresponding part of the head-mounted smart device. Distance information.

And, the acquired distance signal is converted into an electrical signal, and the difference between the electrical signal and the pre-stored electrical signal representing the average distance information is calculated, and the difference is compared with a pre-stored electrical signal indicating the allowable change difference.

In addition, in any of the foregoing embodiments, the acquired distance information may be distance information within a preset time period, or may be distance information between predetermined actions. The purpose of acquiring the distance information is to ensure that the user is performing an operation. In the process of the present invention, the head-mounted smart device is continuously attached to the human body. Therefore, the distance information can be acquired along with the progress of an operation, and the information can be continuously obtained. The present invention is not specifically limited.

It can be understood that with the development of the information age, the technology for transmitting certain manipulations through human eye movement information and the like has been more and more perfect, and at the same time liberating the hands of the people, it also brings some drawbacks, for example, In the process of performing an operation, if the device does not continuously adhere to the human body, and there is no way to judge whether the device leaves the human body, it will cause the current operation to continue after the device leaves the human body, resulting in waste of power. Or the user's privacy leaks, etc., so, through the above method, real-time monitoring of the distance information between the head-mounted smart device and the user can be realized. The distance information that is learned in real time and the preset distance value or the preset distance range may be used to determine whether the head-mounted smart device is continuously attached to the human body, wherein the preset distance value or the preset distance range may be The information is collected and acquired in advance by the average distance between the smart device and the user, so as to determine whether the smart device is continuously attached to the human body, for example, the following scenario:

(Scenario 1) In the process of performing a game through the head-mounted smart device, if the head-mounted smart device is taken down in the middle, the distance information detected by the identity consistency information judging module will change significantly in an instant. Even if the device is switched from one person to another in a very short period of time, the distance information detected by the identity consistency information judging module will also change to some extent, by pre-pairing the distance information. The setting of the fluctuation range in a short time, if the change of the information exceeds the range, it is considered that the head-mounted smart device does not continuously adhere to the human body, then saves the current progress of the game and exits the game to enter the sleep. The state, in turn, not only saves power, but also facilitates the user to continue the game next time.

(Scenario 2) For some videos or documents that require user rights to view, the identity of the user can also be verified by means of iris information recognition, and the opening of the file can be controlled by eye movements such as blinking or blinking of the user. , closing, or fast forward, rewind, flipping up and down, etc. At this time, it is also possible to determine whether the device is continuously attached to the human body by the above method. For example, the smart device is smart glasses, and the user wears the glasses. View the video, or the document, after passing the user identity authentication, after opening the file, if the smart glasses are taken down or transferred to another person's head, it is detected by the identity consistency information judgment module. If the distance information is discontinuous or generates fluctuations beyond the predetermined range, a close command is sent to the play end of the video or the open end of the document, and the video being played, or the document being viewed is closed, thereby largely protecting User's privacy.

In addition, the above-mentioned head-mounted smart device may be glasses, a hat, a headphone, a head cover, and the like.

In addition, when the head-mounted smart device is used for the first time, or the smart device needs to be replaced, the user identity information needs to be collected, and the function may be implemented by the identity consistency information acquiring module, or The information acquisition module is newly added. When the module receives the information collection instruction, it needs a certain time (for example, 3 minutes) to read and save the user identity information. During this time, the module reads continuously. The distance information between the smart device and the user, and records the overall change trend of the distance information during the time period, and determines the fluctuation range of the distance information according to the change trend. Under normal circumstances, a human distance may occur. The information changes drastically at one or more time points beyond the fluctuation range, but as long as the duration of the dramatic change is very short, or only occurs at a point in time, and the change is restored, the overall trend of the information changes. Did not If there is a change, the situation is still considered to be the verification condition.

In addition, in addition to the above signal manipulation techniques, the technical solution of the present invention can be further applied to other fields such as medicine, supervision, and the like.

In addition, the smart device according to the embodiment of the present invention has a power saving protection device. If the identity consistency information acquiring module continuously monitors the distance information within a predetermined time (for example, 5 minutes), the default is When the head-mounted smart device leaves the human body, it automatically enters a sleep state.

Embodiments of the present invention also provide another means of detecting that a head-mounted smart device is continuously attached to a human body.

As shown in FIG. 1 , the device includes at least an identity consistency information acquiring module 110 and an identity consistency information determining module 120. The identity consistency information acquiring module 110 acquires body temperature information of the human body, and the identity consistency information determining module 120 obtains the The body temperature information determines whether the head-mounted smart device is continuously attached to the human body.

Optionally, the identity consistency information obtaining module 110 is a contact type or non-contact body temperature measuring sensor.

In addition, in a specific embodiment, the identity consistency information acquiring module 110 may also acquire other temperature information than the body temperature information of the human body, and is not limited to the body temperature information of the human body.

For example, in a specific embodiment, the identity consistency information obtaining module 110 is a non-contact body temperature measuring sensor, and the head-mounted smart device is a glasses-type structure, and the body temperature measuring sensor is disposed on the bracket of the glasses, and further, in other In the embodiment, the contact type body temperature measuring sensor may be provided on the nose pad of the smart glasses, and the mounting position of the sensor is not specifically limited.

As shown in FIG. 8 and FIG. 2b, the device 100 for detecting the continuous attachment of the head-mounted smart device to the human body is shown in FIG. 8 , which is a structural block diagram of the device, and FIG. 2 b is a schematic structural view of the device, and the device includes the wearing support device 10 . a body temperature measuring sensor 21 and an identity consistency information determining module 120, wherein the body temperature measuring sensor 21 and the identity consistency information determining module 120 are connected and disposed on the wearing support device 10, and the body temperature measuring sensor is used to acquire the head mounted smart device. The user's body temperature information is transmitted to the identity consistency information determining module 120. The identity consistency information determining module 120 determines whether the head-mounted smart device is continuously attached to the human body based on the received body temperature information. In addition, in other embodiments, the identity consistency information determining module 120 can be disposed on a separate unit other than the wearing support device.

Specifically, in this embodiment, the identity consistency information determining module 120 may include a signal analysis processing module (not shown) and a comparison module (not shown), and the signal analysis processing module analyzes a predetermined time. The average value of the temperature detected in the interval, and the difference between the temperature value obtained in real time and the average value is calculated, and the comparison module compares the difference with the preset allowable change difference range, and the difference is allowed to change. Within the difference range, it is determined that the head-mounted smart device is continuously attached to the human body.

The wearing support device 10 is worn on the user, and fixes the body temperature measuring sensor 21 to the detecting portion of the user to continuously detect the body temperature information of the user. In the embodiment, the wearing support device 10 is worn on the user's head. In other embodiments, the head-mounted smart device can also be an earphone, a hat, a head cover, etc., as long as the body temperature measuring sensor can be fixed in positional relationship with respect to the user's detecting portion. In addition, the head-mounted smart device may further include a display screen, and if there is a display screen, the body temperature measurement sensor 21 transmits the detected body temperature information to the display screen, and displays the use through the display screen. Body temperature information.

As shown in FIG. 9 , in another specific embodiment, a structural block diagram of a device for detecting that a head mounted smart device is continuously attached to a human body, wherein the identity consistency information acquiring module 110 includes an optical probe 117 , a photoelectric conversion module 118 , The signal modulation module 112, and the optical probe 117, the photoelectric conversion module 118, and the signal modulation module 112 are sequentially electrically connected. The optical probe 117 corresponds to the detection site of the user, such as the forehead, to detect the body temperature information of the user, and to sense the body temperature of the user.

The optical probe 117 transmits the detected body temperature signal to the photoelectric conversion module 118, and the body temperature signal is converted into an electrical signal via the photoelectric conversion module 118 and transmitted to the signal modulation module 112, and the signal modulation module 112 amplifies and filters the electrical signal to be transmitted to the identity. The consistency information judging module 120 compares the received electrical signal with a preset threshold voltage signal, and determines whether the detected temperature information is abnormal according to the comparison result.

In addition, in this embodiment, the identity consistency information determining module 120 further includes a calculating module 124, a comparator 121, an adjustable resistor 122, and an adjusting component 123. The computing module 124 and the signal modulation module 112 are electrically connected, and receive signals. The body temperature signal transmitted by the modulation module 112 (ie, the electrical signal processed by the photoelectric conversion module 22 and the signal modulation module 23), and calculates the difference between the body temperature signal received in real time and the average body temperature value, and transmits the difference signal to the comparison. The comparator 121 compares the difference with a preset threshold voltage signal range, and determines whether the head-mounted smart device is continuously attached to the human body according to the comparison result, for example, when the comparator 121 receives When the difference signal exceeds the maximum threshold value of the preset allowable change difference, it is considered that the head-mounted smart device does not continuously adhere to the human body. Conversely, if the detected body temperature signal is continuous, and the difference signal is smaller than the preset The maximum critical value of the allowable change difference is considered to be that the head-mounted smart device continues to adhere to the human body. In addition, in the embodiment, the adjustable resistor 122 is used to adjust the electrical signal corresponding to the maximum critical value of the preset allowable change difference. In this embodiment, the resistance of the adjustable resistor 32 is changed by the adjusting member 33. The electrical signal corresponding to the maximum critical value mentioned above may have different body temperature information due to different body qualities. Therefore, the first use of the smart device or the replacement of the smart device may be required. In the case of the user, the user's body temperature information is first collected, and an adjustable resistor is applied, and the maximum value of the user's body temperature allowable change difference is set according to the pre-acquired user's body temperature information, and/or Body temperature range.

In addition, in other embodiments, the identity consistency information determining module 120 may also compare the body temperature information received in real time with a preset body temperature range, and determine whether the head-mounted smart device is continuously attached to the human body according to the comparison result. on.

Moreover, in yet another embodiment, as shown in FIGS. 10 and 4b, the apparatus 200 for detecting that the head mounted smart device is continuously attached to the human body, the apparatus 200 further includes an alarm module 40. The alarm module 40 is connected to the identity consistency information determination module 120. In the present embodiment, the alarm module 40 is connected to the identity consistency information determination module 120 via a communication interface (not shown). The identity consistency information determining module 120 controls the start or stop of the alarm module 40 by the received comparison of the electrical signal representing the real-time body temperature information with the preset range of the electrical signal representing the body temperature range. Specifically, when the received electrical signal indicating the real-time body temperature information is greater than a preset maximum value in the range of the electrical signal indicating the body temperature range, the output comparison result is a high level; when the received real-time body temperature information is received When the electrical signal is less than the preset minimum threshold value in the range of the electrical signal indicating the body temperature range, the comparison result of the output is a low level, and the above two level signals control the alarm module 40 to start an alarm.

As shown in FIG. 11, in this embodiment, the identity consistency information determining module 120 configures two 10-pins that receive the comparison result as a PA interrupt pin and a PB interrupt pin, wherein the PA is a falling edge causing an interrupt, and PB is A rising edge causes an interruption. When an interruption occurs, the identity consistency information determining module 120 first determines the source of the interruption. If it is derived from the PA and continuously monitors the low level for a certain period of time, the electrical signal representing the real-time body temperature information is considered to be less than the preset body temperature. When the minimum critical value in the range of the electrical signal range, the identity consistency information determining module 120 issues a low temperature alarm and controls the alarm module 40 to issue a low temperature alarm signal; if it returns to the high level during this time, it is regarded as The previous low level is an isolated value and is not considered an abnormal condition. Similarly, if the interruption originates from PB and the high level is continuously monitored for a certain period of time, it is considered that the detected electrical signal representing the real-time body temperature information is greater than the maximum critical value in the range of the preset electrical signal indicating the body temperature range, The processing module 40 issues a high temperature alarm and controls the alarm module 40 to issue a high temperature alarm signal; if it returns to a low level during this time, it is considered that the previous high level is an isolated value and is not considered an abnormal condition.

Specifically, in the initialization phase, the PA and PB pins are configured as corresponding interrupt functions, and their module interrupts are enabled (implemented through configuration registers). After the configuration, when the PA and PB are interrupted, it indicates that the detected body temperature information is abnormal, that is, whether the head-mounted smart device is continuously attached to the human body, or whether the head-mounted smart device needs to be continuously attached. On the human body, and decide whether or not to call the police.

After that, the interrupt needs to be opened, that is, the identity consistency information judging module 120 is allowed to process the maskable Interrupts (also implemented through configuration registers).

Then, waiting for the interrupt, in fact, the identity consistency information judging module 120 enters the low power mode, is in a state of waiting for the interrupt to wake up, and the specific implementation is also through the configuration register. Waiting for an interrupt will continue until the interrupt request is generated, so wait for the interrupt and start processing the interrupt request.

Then, data monitoring is performed for a period of time to determine whether the detected body temperature information is abnormal.

It can be understood that the identity consistency information determining module 120 simultaneously processes the body temperature information and can display it through the display screen.

It can be understood that the alarm module 40 can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm. At the same time, the alarm module 40 can be disposed on the head-mounted smart device, or can be disposed on the processing unit independent of the head-mounted smart device, and is communicatively connected to the head-mounted smart device.

Moreover, the connection between the alarm module 40 and the identity consistency information determining module 120 can also be implemented by wire or wirelessly. In this embodiment, the alarm module 40 and the identity consistency information determining module 120 are connected through the Internet.

The above-mentioned device for detecting that the head-mounted smart device is continuously attached to the human body has the following advantages: First, by wearing the support device 10 worn on the subject, long-term automatic continuous body temperature detection of the subject can be realized; The device is safe to use, and can avoid the hidden dangers of the traditional mercury thermometer; third, the device is easy to wear, can be remotely monitored, and does not need manual measurement; fourth, the scope of application is wide, according to the user's physical difference, The threshold signal is adjusted accordingly so that different measurements can be made for different individuals.

In addition, in still another specific embodiment, a device for detecting that a head-mounted smart device is continuously attached to a human body is provided. As shown in FIG. 12, the identity consistency information acquiring module 110 includes an integrated temperature measuring sensor 63, and a signal. The conditioning circuit 62, the output of the body temperature measuring sensor 63 is connected to the input end of the signal conditioning circuit 62, and the identity consistency information determining module 120 includes a signal analysis processing module 71 and a comparison module 72, wherein the output and signal of the signal conditioning circuit 62 The input end of the analysis processing module 71 is electrically connected for converting the received body temperature signal into an electrical signal recognizable by the signal analysis processing module, and the signal analysis processing module 71 receives the electrical signal indicating the current temperature information sent by the signal conditioning circuit 62. And analyzing the current electrical signal representing the body temperature information and the electrical signal indicating the preset average body temperature information The difference between the difference module and the preset allowable change difference is determined to be that the head-mounted smart device is continuously attached to the human body within the allowable change difference, and vice versa. Smart devices are not continuously attached to the human body.

In particular, signal conditioning circuit 62 is operative to transform the analog signal into a digital signal for data acquisition, control processes, performing computational display readout, or other purposes. The body temperature measuring sensor 63 measures the user's body temperature information, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current, or resistance change, and therefore must be amplified before being converted into a digital signal. Buffering or scaling analog signals, etc., which is the conditioning process, making it suitable for the input of an analog-to-digital converter (ADC). The ADC then digitizes the analog signal and sends the digital signal to an MCU or other digital device. Used for data processing of the system.

In addition, in other embodiments, the identity consistency information determining module 120 may also allow the real-time acquired body temperature information and the preset body temperature information to be allowed when the head-mounted smart device is continuously attached to the human body according to the body temperature information. The fluctuation range is compared, and in the case that the currently received body temperature information falls within the preset allowable fluctuation range of the body temperature information, it is determined that the head-mounted smart device is continuously attached to the human body.

As shown in FIG. 13, the method includes:

Step S1310: Obtain body temperature information of the human body to which the head-mounted smart device is currently attached. In addition, in a specific embodiment, according to a specific situation, the step may also obtain other temperature information other than the body temperature information of the human body, and Limited to body temperature information of the human body.

Step S1320: Determine, according to the acquired body temperature information, whether the head-mounted smart device is continuously attached to the human body.

In an embodiment, determining whether the head-mounted smart device is continuously attached to the human body according to the acquired body temperature information includes:

Calculating the difference in the obtained body temperature change, and determining whether the head-mounted smart device is continuously attached to the human body according to the preset allowable change difference range.

In another embodiment, determining whether the head-mounted smart device is continuously attached to the human body according to the acquired body temperature information includes:

Analyzing an average value of the temperatures detected during a predetermined period of time, and calculating a difference between the temperature values obtained in real time and the average value;

The difference is compared with a preset allowable change difference range, and it is determined that the head-mounted smart device is continuously attached to the human body within the range of the allowable change difference.

And, the received body temperature information number is converted into an electrical signal, and the electrical signal is compared with a pre-stored range of electrical signals indicating a range of allowable change differences.

In still another embodiment, determining whether the head-mounted smart device is continuously attached to the human body according to the acquired body temperature information includes:

Whether the head-mounted smart device is continuously attached to the human body is determined according to the body temperature value of the human body between a certain time or the set action interval and the preset fluctuation range of the body temperature.

Specifically, the obtained body temperature value is compared with a preset fluctuation range of the body temperature, and in a case where the body temperature value is within a preset fluctuation range of the body temperature, it is determined that the head-mounted smart device is continuously attached to the human body.

In addition, in a specific embodiment, other temperature information than the body temperature information of the human body described above may be acquired according to a specific case, and is not limited to the body temperature information of the human body.

It can be understood that with the development of the information age, the technology for transmitting certain manipulations through human eye movement information and the like has been more and more perfect, and at the same time liberating the hands of the people, it also brings some drawbacks, for example, In the process of performing an operation, if the device does not continuously adhere to the human body, and there is no way to judge whether the device leaves the human body, it will cause the current operation to continue after the device leaves the human body, resulting in waste of power. Or the user's privacy leaks, etc., therefore, through the above manner, real-time monitoring of the body temperature information of the user of the head-mounted smart device can be realized, and the user's body temperature value or the body temperature change difference and the preset value can be realized through real-time understanding. The body temperature range or the comparison of the difference in body temperature variation can be used to determine whether the head-mounted smart device is continuously attached to the human body, such as the following scenario:

(Scenario 1) In the process of performing a game through the head-mounted smart device, if the head-mounted smart device is taken down in the middle, the distance information detected by the identity consistency information judging module will change significantly in an instant. Even if the device is switched from one person to another in a very short period of time, the temperature information detected by the identity consistency information judging module will also change to some extent, by pre-pairing the temperature information. The setting of the fluctuation range in a short time, if the change of the information exceeds the range, it is considered that the head-mounted smart device does not continuously adhere to the human body, then saves the current progress of the game and exits the game to enter the sleep. The state, in turn, not only saves power, but also facilitates the user to continue the game next time.

(Scenario 2) For some videos or documents that require user rights to view, the identity of the user can also be verified by means of iris information recognition, and the opening of the file can be controlled by eye movements such as blinking or blinking of the user. , close, or fast forward, rewind, page up and down, etc. In the above manner, whether the device is continuously attached to the human body can be determined. For example, the smart device is smart glasses, and the user wears the glasses to view the video or the document, and after passing the user identity authentication, the user opens. After the file, if the smart glasses are taken down or switched to another person's head, the user's body temperature information detected by the identity consistency information determining module is discontinuous or generates fluctuations exceeding a predetermined range. Sending a close command to the play end of the video or the open end of the document, closing the video being played, or the document being viewed, thus largely protecting the privacy of the user.

In addition, when the head-mounted smart device is used for the first time, or the smart device needs to be replaced, the user identity information needs to be collected, and the function may be implemented by the identity consistency information acquiring module, or The new information collection module, in the case that the module receives the information collection instruction, requires a certain time (for example, 3 minutes) to read and save the user identity information. During this time, the module continuously reads the current The body temperature information of the user, and records the overall trend of the body temperature information during the time period, and determines the fluctuation range of the body temperature information according to the change trend, and saves to the user identity information library corresponding to the current user identity. The identity consistency information judging module compares the difference between the body temperature information of the user of the head-mounted smart device received in real time and the average body temperature with the fluctuation range of the body temperature information stored in the user identity information database, and according to the comparison result Determining whether the head-mounted smart device is continuously attached to the human body. Under normal circumstances, the human body temperature information may change drastically at one or more time points beyond the fluctuation range, but as long as the drastic change continues The time is very short, or it is only a point in time, and after the change is restored, the overall change trend of the information has not changed, and the situation is still considered to be the verification that the head-mounted smart device is continuously attached to the human body. .

In addition, the head-mounted smart device provided by the embodiment of the present invention has a power-saving protection device. If the body temperature information is not continuously monitored within a predetermined time length (for example, 5 minutes), the head-mounted smart device leaves the human body by default. Automatically enters the sleep state.

As shown in FIG. 1 , the device includes at least an identity consistency information acquiring module 110 and an identity consistency information determining module 120. The identity consistency information acquiring module 110 obtains pressure information of a weight-bearing part of the human body on the human body. The identity consistency information determining module 120 determines whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the pressure information and the preset threshold.

The identity consistency information acquiring module 110 acquires the pressure information in a certain period of time in real time, and determines that the head-mounted smart device is continuously attached to the human body when the pressure information is within the set threshold range.

In addition, in other embodiments, the time period for obtaining the pressure information is not limited to the foregoing certain time, and may be within a time period during which the head-mounted smart device performs a certain operation process, or may be allowed in a hardware environment such as a power source. There are no special restrictions on the entire time.

In addition, in a specific embodiment, according to the actual situation, the pressure information acquired by the identity consistency information acquiring module is not limited to the pressure information of the above-mentioned head-mounted smart device disposed on the weight-bearing portion of the human body, and may also include the head-mounted type. Pressure information received by the pressure sensing module of the smart device, or other pressure information.

For example, in a specific embodiment, according to the technical solution of the present invention, a device for detecting that a head-mounted smart device is continuously attached to a human body is provided, and the device detects pressure information of a load-bearing portion of a human body by detecting a head-mounted smart device. And determining whether the head-mounted smart device is continuously attached to the human body.

For example, FIG. 14 and FIG. 2b show a device 100 for detecting that a head-mounted smart device is continuously attached to a human body, wherein FIG. 14 is a structural block diagram of the device, and FIG. 2b is a structural schematic view of the device, the device including a wearing support device. 10, the pressure sensor 22, the identity consistency information determining module 120, the pressure sensor 22 and the identity consistency information determining module 120 are connected and disposed on the wearing support device 10, wherein the pressure sensor 22 is used to acquire the head-mounted smart device The pressure information is set in the weight bearing portion of the human body, and the pressure information is converted into an electrical signal and transmitted to the identity consistency information determining module 120. The identity consistency information determining module 120 receives the electrical signal indicating the pressure information of the bearing portion and the prior The set representation indicates that the range of electrical signals within the pressure range is allowed to be compared, and in the case where the electrical signal representing the pressure information of the load-bearing portion falls within the range of the electrical signal indicating the allowable pressure range, it is determined that the head-mounted smart device is continuously attached to On the human body, otherwise, it is determined that the head-mounted smart device does not continuously adhere to the human body.

In this embodiment, the wearing support device 10 is worn on the user, and the pressure sensor 22 is fixed to the detecting portion of the user to continuously detect the pressure information of the head-mounted smart device disposed on the weight-bearing portion of the human body, for example, wearing The support device 10 is worn on the head of the subject, which is a glasses-type structure, and the pressure sensor 22 is disposed on a nose pad of the glasses. Of course, in other embodiments, one of the two nose pads can also be disposed, and the head-mounted smart device can also be an earphone, a cap, a head cover, etc., as long as the pressure sensor 22 can be fixed to the user's detection site. In addition, the head-mounted smart device may further include a display screen, and if there is a display screen, the pressure sensor 22 transmits the detected pressure information to the display screen, and displays the pressure information through the display screen. .

As shown in FIG. 15 , in another embodiment, a structural block diagram of a device for detecting that a head mounted smart device is continuously attached to a human body, wherein the identity consistency information acquiring module 110 includes: a pressure collecting module 1132 Data processing module 1131, communication module 113. among them,

The pressure collection module 1132 is designed to be placed in a cushion shape to the head-mounted smart device for monitoring the pressure of the load bearing portion of the user. Preferably, in this embodiment, the head-mounted smart device is smart glasses, and the nose pads of the smart glasses are made of a thin plastic material, and two pressure sensitive devices are mounted on a side thereof facing the nose of the user. Resistor FSR, one for each of the two nose pads.

The data processing module 1131 collects the data information obtained from the pressure acquisition module 1132. The module consists of a microprocessor-based board that contains a low-power, high-performance 8-bit AVR microprocessor, the ATmega16L, peripheral components (resistors, capacitors, etc.) and power supplies. In this embodiment, four ADC input channels with 10-bit resolution are used to convert analog voltage information generated by the varistor into a digital signal (ie, a converter that converts the obtained pressure analog signal information into a digital signal) Function). The microprocessor has a clock frequency of 8MHz. All circuits operate at 5V and are supplied by the LM78L55 voltage divider and a 7.4V lithium battery. The module is simple and lightweight, can be connected to the pressure acquisition module 1132 via a line, and is easy to integrate with a head-mounted smart device.

The communication module 113 is configured to transmit the digital signal processed by the microprocessor-based data processing module 1131 to the identity consistency information determining module 120 in real time.

It will be readily understood that in the present embodiment, the digital signal referred to is a digital electrical signal.

In this embodiment, since the amount of digital information is small, a wireless transmission method with a high sampling rate can be employed. Therefore, a low power consumption radio communication module GW100B (having a size of 56 mm x 28 mm x 7 mm) is selected. The radio transmitter and receiver are respectively connected to the microprocessor based data processing module and the background. The transmission distance can reach 5m in the case of barrier-free conditions. The forward error correction processing of the GW 100B achieves a low error rate, making the entire system reliable, and in other embodiments, a wired transmission method can also be employed.

The identity consistency information determining module 120 compares the voltage signal corresponding to the pressure change difference detected in real time with the voltage signal range corresponding to the preset critical change difference range, and determines the detected according to the comparison result. Whether the pressure information is abnormal.

Preferably, in any of the above embodiments, the identity consistency information determining module 120 includes a signal analysis processing module 71 and a comparison module 72. The signal analysis processing module 71 calculates an electrical signal converted into real-time acquired pressure information and a pre-stored representation. Comparing the difference between the electrical signals of the average of the pressure information acquired over a period of time, the comparison module 72 compares the difference with a preset allowable change difference, and within the allowable change difference, the head is determined to be the head The wearable smart device is continuously attached to the human body. On the contrary, the smart smart device is not continuously attached to the human body. In addition, in other embodiments, the comparison module 72 can also obtain the power information indicating the pressure information value in real time. The signal is compared with the maximum value and the minimum value of the electrical signal converted from the acquired pressure information, and the electrical signal representing the pressure information value acquired in real time is greater than the maximum value or smaller than the electrical signal converted by the acquired pressure information. In the case where the acquired pressure information is converted into the minimum value of the electrical signal, it is considered that the head-mounted smart device does not continuously adhere to On the human body.

In addition, in another embodiment, as shown in FIG. 16 and FIG. 4b, another device 200 for detecting that the head-mounted smart device is continuously attached to the human body is continuously attached to the human body with the above-mentioned detecting head-mounted smart device. The device 100 differs in that the device 200 that detects that the head-mounted smart device is continuously attached to the human body further includes an alarm module 40. The alarm module 40 is connected to the identity consistency information determination module 120. In the present embodiment, the alarm module 40 is connected to the identity consistency information determination module 120 via a communication interface (not shown). The identity consistency information determining module 120 controls the start or stop of the alarm module 40 by the received voltage signal representing the pressure information monitored in real time and the previously set voltage signal range corresponding to the allowable pressure range. Specifically, when the voltage signal indicating the value monitored in real time is greater than a maximum threshold value in the range of the voltage signal corresponding to the preset allowable pressure range, the comparison result output by the comparison module 72 is a high level signal, when real time is expressed. When the voltage signal of the monitored value is less than a preset minimum threshold value indicating a range of voltage signals corresponding to the allowable pressure range, the comparison result output by the comparison module 72 is a low level signal, the high level signal, or a low level The flat signal is transmitted to the alarm module 40 and the alarm module 40 is controlled to start or stop accordingly.

As shown in FIG. 17, in this embodiment, the alarm module 40 configures two 10-pins that receive the comparison result as a PA interrupt pin and a PB interrupt pin, wherein PA is a falling edge causing an interrupt, and PB is a rising edge causing an interrupt. . When an interruption occurs, the alarm module 40 first determines the source of the interruption. If it is derived from the PA and continuously monitors the low level for a certain period of time, the voltage signal representing the value monitored in real time is considered to be less than the preset allowable pressure range. The alarm module 40 issues a low pressure alarm signal for the minimum threshold value in the corresponding voltage signal range; if it returns to the high level during this time, it is regarded as the isolated low level as an isolated value, and is not considered to be an abnormal situation. . Similarly, if the interrupt originates from PB and the high level is continuously monitored for a certain period of time, it is considered that the detected voltage signal representing the value monitored in real time is greater than the preset voltage signal range corresponding to the allowable pressure range. The maximum threshold value, the alarm module 40 sends a high pressure alarm signal; if it returns to the low level within this time, it is regarded as the isolated high level as an isolated value, and is not considered to be an abnormal situation, in the above two cases Any occurrence occurs that the head-mounted smart device is not continuously attached to the human body.

Specifically, in the initialization phase, the PA and PB pins are configured as corresponding interrupt functions, and their module interrupts are enabled (implemented through configuration registers). After the configuration, when the PA and PB are interrupted, it indicates that the detected pressure information is abnormal, that is, it is necessary to analyze whether the head-mounted smart device is continuously attached to the human body and decide whether to alarm.

Then, waiting for the interrupt, actually the identity consistency information determining module 120 enters the low power mode, In the state of waiting for the interrupt to wake up, the specific implementation is also through the configuration register. Waiting for an interrupt will continue until the interrupt request is generated, so wait for the interrupt and start processing the interrupt request.

Then, data monitoring is performed for a period of time to determine whether the monitored pressure information is abnormal.

It can be understood that the identity consistency information determining module 120 simultaneously processes the pressure information and can display it through the display screen.

In addition, as shown in FIG. 18, in still another embodiment, the identity consistency information acquisition module 110 includes a pressure measurement sensor 64, a signal conditioning circuit 62, and an output of the pressure measurement sensor 64 and an input of the signal conditioning circuit 62. The identity consistency information judging module 120 includes a signal analysis processing module 71 and a comparison module 72. The signal conditioning circuit 62 is connected to the signal analysis processing module 71 for converting the received pressure information number into a signal analysis processing module 71. The electrical signal, the signal analysis processing module 71 analyzes the average value of the electrical signal converted into the pressure information acquired in a predetermined period of time, and calculates the difference between the electrical signal representing the real-time pressure information value and the average value, and the comparison module 72 comparing the difference with the preset allowable change difference, and determining that the head-mounted smart device is continuously attached to the human body within the allowable change difference; otherwise, the head-mounted smart device is not continuously attached. On the human body.

Specifically, in the present embodiment, signal conditioning circuit 62 is used to transform the analog signal into a digital signal for data acquisition, control processes, performing computational display readout or other purposes. The pressure measuring sensor 64 measures the pressure information, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current or resistance change, and therefore must be amplified, buffered or fixed before being converted into a digital signal. The analog signal, etc., is the conditioning process, making it suitable for the input of an analog-to-digital converter (ADC). The ADC then digitizes the analog signal and sends the digital signal to the MCU or other digital device for use in the system. Data processing.

In addition, in any of the above embodiments, the identity consistency information determining module 120 may be disposed on the head-mounted smart device, or may be disposed on a processing unit independent of the head-mounted smart device, and wirelessly through wifi, Bluetooth, and the like. The device is in communication with the head-mounted smart device.

As shown in FIG. 19, the method includes:

Step S1910: Obtain pressure information of the head-mounted smart device disposed on the weight bearing portion of the human body;

Step S1920, determining whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the pressure information and the preset threshold.

In addition, in one embodiment, the pressure information is acquired for a certain period of time, and when the pressure information is within the corresponding set threshold range, it is determined that the head-mounted smart device is continuously attached to the human body.

In addition, in one embodiment, determining whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the pressure information and the preset threshold includes:

The average value of the electrical signal converted into the pre-acquired pressure information is analyzed, and the difference between the real-time pressure information value and the average value is compared, and the difference is compared with the preset allowable change difference, and the allowable change difference is It is recognized that the head-mounted smart device is continuously attached to the human body.

And, the received pressure information is converted into an electrical signal in real time.

In addition, in a specific embodiment, according to the actual situation, the acquired pressure information is not limited to the pressure information of the head-mounted smart device disposed on the weight-bearing portion of the human body, and may also include the pressure sensing module of the head-mounted smart device. Pressure information received, or other pressure information.

It can be understood that with the development of the information age, the technology for transmitting certain manipulations through human eye movement information and the like has been more and more perfect, and at the same time liberating the hands of the people, it also brings some drawbacks, for example, In the process of performing an operation, if the device does not continuously adhere to the human body, and there is no way to judge whether the device leaves the human body, it will cause the current operation to continue after the device leaves the human body, resulting in waste of power. Or the user's privacy leaks, etc. Therefore, in the above manner, real-time monitoring of the pressure information of the load-bearing part of the user of the head-mounted smart device can be realized, and the pressure information or the pressure change of the load-bearing part of the user can be realized in real time. The difference between the difference and the preset allowable pressure range, or the allowable change difference, can determine whether the head-mounted smart device is continuously attached to the human body, thereby achieving identity consistency of the head-mounted smart device user. Judging, for example, the following scenario:

(Scenario 1) In the process of performing a game through the head-mounted smart device, if the head-mounted smart device is taken down in the middle, the pressure information detected by the identity consistency information judging module will change significantly in an instant. Even if the device is switched from one person to another in a very short period of time, the pressure information detected by the identity consistency information judgment module will also occur for a certain period of time. The change of degree, by setting the fluctuation range of the pressure information in a short time in advance, if the change of the information exceeds the range, it is considered that the head-mounted smart device does not continuously adhere to the human body, and the The current progress of the game and exit the game, enter the sleep state, thereby not only saving power, but also convenient for the user to continue the game next time.

(Scenario 2) For some videos or documents that require user rights to view, the identity of the user can also be verified by means of iris information recognition, and the opening of the file can be controlled by eye movements such as blinking or blinking of the user. , closing, or fast forward, rewind, flipping up and down, etc. At this time, it is also possible to determine whether the device is continuously attached to the human body by the above method. For example, the smart device is smart glasses, and the user wears the glasses. View the video, or the document, after passing the user identity authentication, after opening the file, if the smart glasses are taken down or transferred to another person's head, it is detected by the identity consistency information judgment module. If the pressure information is discontinuous or generates fluctuations beyond the predetermined range, a shutdown command is sent to the playing end of the video or the open end of the document, and the video being played, or the document being viewed is closed, thereby largely protecting User's privacy.

In addition, when the head-mounted smart device is used for the first time, or the smart device needs to be replaced, the user identity information needs to be collected, and the function may be implemented by the identity consistency information acquiring module, or The new information collection module, in the case that the module receives the information collection instruction, requires a certain time (for example, 3 minutes) to read and save the user identity information. During this time, the module continuously reads the current The pressure information of the load-bearing part of the user, and record the overall change trend of the pressure information during the time period, and determine the fluctuation range of the pressure information according to the change trend. Under normal circumstances, the pressure information of the person may appear in one, Or a sharp change occurs at a plurality of time points beyond the fluctuation range, but as long as the duration of the drastic change is very short, or is only a point in time, and the change is restored, the overall trend of the information does not change, It is still considered that the situation is to satisfy the verification that the head-mounted smart device is continuously attached to the human body. .

In addition, it should be noted that, in any of the above embodiments, the pressure information acquired by the pressure information acquiring module may be pressure information before or after an eye movement or for a period of time including the eye motion. It may also be pressure information within a time period between two or more eye movements. In short, the purpose of detecting the pressure information is to ensure that the user or the smart device is not replaced during the action instruction. Since it is not removed, as long as the eye movement of the user is detected, it is necessary to continuously detect the pressure information, and the time point and length of time for detecting the pressure information are not excessively limited.

In addition, in addition to the above signal manipulation techniques, the technical solution of the present invention can be further applied to His field, such as medicine, supervision, etc.

In addition, the smart device according to the embodiment of the present invention has a power saving protection device. If the identity consistency information acquiring module continuously detects the pressure information within a predetermined time (for example, 5 minutes), the headset is defaulted. The smart device leaves the human body and automatically goes to sleep.

As shown in FIG. 1 , the device includes at least an identity consistency information acquiring module 110 and an identity consistency information determining module 120. The identity consistency information acquiring module 110 acquires image information of at least one part of a human head or a face. The sex information judging module 120 judges whether the head-mounted smart device is continuously attached to the human body based on the comparison result of the image information and the pre-stored standard image information.

The image information includes image information acquired in real time within a preset time range.

In addition, in other embodiments, the time period in which the identity information acquisition module 110 acquires the image information is not limited to the image information in the certain time range described above, and may also be the time when the head-mounted smart device performs a certain operation process. In the segment, it can also be within the total time allowed by the hardware environment such as power, and there is no special restriction.

In addition, in a specific embodiment, the image information acquired by the identity consistency information acquiring module 110 is not limited to the image information of at least one part of the human head or the face, and may include other image information.

For example, in a specific embodiment, the device 100 for detecting the head-mounted smart device continuously attached to the human body is shown in FIG. 20 and FIG. 2b. FIG. 20 is a structural block diagram of the device, and FIG. 2b is a structural schematic diagram of the device. The device includes a wearing support device 10, an image sensor 23, and an identity consistency information determining module 120, wherein the image sensor 23 is configured to acquire image information of a certain part of the face, and convert the obtained image information into an electrical signal for transmission to the identity. The consistency information judging module 120, and the image sensor 23 and the identity consistency information judging module 120 are connected and disposed on the wearing support device 10. In addition, in other embodiments, the identity consistency information determining module 120 can be disposed on a separate unit outside the wearing support device 10 and communicatively coupled to the wearing support device 10.

The wearing support device 10 is worn on the user, and fixes the image sensor 23 to the detecting portion of the user to continuously detect image information of a certain part of the user's face of the head-mounted smart device and convert the detected image information. The electrical signal converted into the electrical signal and converted in real time is transmitted to the identity consistency information determining module 120, and the identity consistency information determining module 120 receives the image information transmitted by the image sensor 23 indicating a certain part of the current human face. The electrical signal is compared with the pre-stored electrical signal representing the standard image information. When the comparison result is the same, the head-mounted smart device is considered to be continuously attached to the human body.

It is easy to understand whether the head-mounted smart device is continuously attached to the human body in the above manner. Before, the image information of the part of the face of the user of the head-mounted smart device needs to be collected and stored, thereby acquiring the above-mentioned standard image information, and converting it into an electrical signal for storage, and further, for image information. The conversion and storage forms are not limited to the electrical signals mentioned in the present embodiment, and may be other forms of signals that can be implemented by those skilled in the art without any creative work, and are not described herein.

In addition, in the present embodiment, the wearing support device 10 is worn on the head of the user, which is a glasses-type structure, and the image sensor 23 is disposed at the front end portion of the bracket of the glasses. Of course, in other embodiments, the head-mounted type The smart device can also be an earphone, a hat, a head cover, etc., and the position of the image sensor can also be set according to a specific situation, and is not limited to the front end portion of the bracket, as long as the image sensor 23 can maintain a relatively static positional relationship with the measured portion of the user. In addition, the head-mounted smart device may further include a display screen, and if there is a display screen, the image sensor 23 transmits the detected image information to the display screen, and displays the image information through the display screen. .

As shown in FIG. 21, in another specific embodiment, a structural block diagram of a device for detecting that a head-mounted smart device is continuously attached to a human body, wherein the identity consistency information acquiring module 110 includes an image sensing module 119, and a photoelectric conversion module 118. The signal modulation module 112, and the image sensing module 119, the photoelectric conversion module 118, and the signal modulation module 112 are sequentially electrically connected.

The image sensing module 119 is configured to sense an image signal of a target location. In this embodiment, the image sensing module 119 may be a camera.

The image sensing module 119 transmits the sensed image signal to the photoelectric conversion module 118. The image signal is converted into an electrical signal via the photoelectric conversion module 118 and transmitted to the signal modulation module 112. The signal modulation module 112 amplifies and filters the electrical signal and transmits the signal. To the identity consistency information determining module 120, the identity consistency information determining module 120 compares the received electrical signal with a pre-stored standard electrical signal, and determines whether the detected image information is abnormal according to the comparison result.

In addition, in this embodiment, the identity consistency information determining module 120 further includes a comparator 121, an adjustable resistor 122, and an adjustment component 123. The comparator 121 and the signal modulation module 112 are electrically connected, and the received signal modulation module 112 transmits The image signal (ie, the electrical signal processed by the photoelectric conversion module 118 and the signal modulation module 112) is compared with a pre-stored standard electrical signal, and based on the comparison result, it is determined whether the head-mounted smart device is continuously attached to the human body. In addition, in this embodiment, the identity consistency information determining module 120 further includes an adjustable resistor 122 and an adjusting component 123, wherein the adjustable resistor 122 is used to adjust a pre-stored standard voltage signal. In this embodiment, the adjusting component 123 is passed through the adjusting component 123. The resistance value of the adjustable resistor 122 is changed to adjust the standard voltage signal.

Specifically, in an embodiment of the present invention, the identity consistency information acquiring module 110 acquires image information of a predetermined part of the face of the user of the head-mounted smart device in real time, and the image information may include the acquired image of the part. Pixel, and/or size, and/or location of feature points, identity The sex information judging module 120 compares the image information with the preset standard image information, and the standard image information may be a determined information value, or may be a predetermined information value range, and the image information and the pre-stored standard image information value. In the case of being consistent or within a range of preset image information values, the head-mounted smart device is considered to remain attached to the human body because, if the head-mounted smart device is removed, the detected image information Inevitably, a significant change occurs, which is beyond the predetermined range. In addition, due to the difference in the shape of each person's head, the detected image information may be different when the smart device is worn, so the first use of the smart device is used. Or when the user of the smart device needs to be replaced, the standard image information value or the range of the standard image information value needs to be set, which can be realized by information acquisition in a period of time, and through the adjustable resistor 122 and The adjustment member 123 is used to achieve adjustment of a predetermined value or a predetermined range.

In addition, as shown in FIG. 22 and FIG. 4b, another device 200 for detecting that the head-mounted smart device is continuously attached to the human body is different from the above-described device 100 for detecting that the head-mounted smart device is continuously attached to the human body: The apparatus 200 for detecting that the head mounted smart device is continuously attached to the human body further includes an alarm module 40. The alarm module 40 is connected to the identity consistency information determination module 120. In the present embodiment, the alarm module 40 is connected to the identity consistency information determination module 120 via a communication interface (not shown). The identity consistency information determining module 120 controls the start or stop of the alarm module 40 by comparing the image signal with the preset standard image information. Specifically, the identity consistency information determining module 120 compares the received real-time image signal with a pre-stored standard image signal, and when the image signal does not coincide with the pre-stored standard image signal, triggers the alarm module 40 to perform a reminder when the image signal The alarm module 40 stops the reminder when it coincides with the pre-stored standard image signal.

In addition, as shown in FIG. 23, in another embodiment, the identity consistency information acquiring module 110 includes an image sensor 65 and a signal conditioning circuit 62. The output of the image sensor 65 is connected to the input end of the signal conditioning circuit 62, and the identity is consistent. The information judging module 120 includes a signal analysis processing module 71 and a comparison module 72, wherein the signal conditioning circuit 62 is connected to the signal analysis processing module 71, and the signal conditioning circuit 62 is configured to convert the image signal acquired by the image sensor 65 into a signal analysis. The electrical signal recognizable by the processing module 71, the pixel, and/or the size, and/or the feature point position of the image information analyzed by the signal analysis processing module 71, and the pixel of the real-time image information and the pre-stored standard image information, and/or Or the difference between the size, and/or the average of the position of the feature points, the comparison module 72 compares the difference with a preset allowable change difference, and identifies the head-mounted smart within the allowed change difference. The device is continuously attached to the human body, and conversely, the head-mounted smart device is not continuously attached to the human body.

In particular, signal conditioning circuit 62 is operative to transform the analog signal into a digital signal for data acquisition, control processes, performing computational display readout, or other purposes. The image sensor 65 measures the image information of the user, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current or resistance change, and therefore must be amplified and slowed down before being converted into a digital signal. Rushing or scaling an analog signal, etc., which is a conditioning process that is suitable for the input of an analog-to-digital converter (ADC). The ADC then digitizes the analog signal and sends the digital signal to an MCU or other digital device. Used for data processing of the system.

In addition, in any of the above embodiments, the identity consistency information determining module 120 may be disposed on the head-mounted smart device, or may be disposed on a processing unit independent of the head-mounted smart device, and the headset The communication connection between the smart devices, wherein the communication connection may include: wifi, Bluetooth, and the like.

As shown in FIG. 24, the method includes:

Step S610: The acquiring module acquires image information of at least one part of a human head or a face to which the head-mounted smart device is attached;

Step S620: Determine whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the image information and the pre-stored standard image information.

The image information includes image information acquired in real time within a preset time range. When the image information is consistent with the pre-stored standard image information, it is determined that the head-mounted smart device is continuously attached to the human body.

In addition, in one embodiment, determining whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the image information and the pre-stored standard image information includes:

The pixel, and/or size, and/or feature point position of the analyzed image information, and calculate the difference between the real-time image information and the pixel, and/or size, and/or feature point position of the pre-stored standard image information. ;

The difference is compared with the preset allowable change difference, and it is determined that the head-mounted smart device is continuously attached to the human body within the allowable change difference.

In addition, in a specific embodiment, the image information acquired is not limited to the image information of at least one part of the human head or the face described above, and may include other image information.

It can be understood that with the development of the information age, the technology for transmitting certain manipulations through human eye movement information and the like has been more and more perfect, and at the same time liberating the hands of the people, it also brings some drawbacks, for example, In the process of performing an operation, if the device does not continuously adhere to the human body, and there is no way to judge whether the device leaves the human body, it will cause the current operation to continue after the device leaves the human body, resulting in waste of power. Or the problem of user privacy leakage, etc., therefore, in the above manner, real-time monitoring of image information of at least one part of the head or face of the user of the head-mounted smart device can be realized, and the image information and the preset image obtained through real-time understanding can be realized. Whether the information value or the preset image information value range is compared can determine whether the head-mounted smart device is continuously attached to the human body The preset image information value or the preset image information range may be obtained by acquiring image information of at least one part of the head or the face of the user of the head-mounted smart device in advance, thereby implementing Whether the head-mounted smart device is continuously attached to the human body for judgment, such as the following scenario:

(Scenario 1) In the process of performing a game through the head-mounted smart device, if the head-mounted smart device is taken down in the middle, the distance information detected by the identity consistency information judging module will change significantly in an instant. Even if the device is switched from one person to another in a very short period of time, the image information detected by the identity consistency information judging module will also change to some extent, by detecting the image. Comparing the information with the pre-stored standard image information, if the two are inconsistent, it is considered that the head-mounted smart device does not continuously adhere to the human body, then saves the current progress of the game and exits the game, and enters a dormant state, thereby Not only saves electricity, but also facilitates the user to continue the game next time.

(Scenario 2) For some videos or documents that require user rights to view, the identity of the user can also be verified by means of iris information recognition, and the opening of the file can be controlled by eye movements such as blinking or blinking of the user. , closing, or fast forward, rewind, flipping up and down, etc. At this time, it is also possible to determine whether the device is continuously attached to the human body by the above method. For example, the smart device is smart glasses, and the user wears the glasses. View the video, or the document, after passing the user identity authentication, after opening the file, if the smart glasses are taken down or transferred to another person's head, it is detected by the identity consistency information judgment module. If the image information is discontinuous or generates fluctuations beyond a predetermined range, a close command is sent to the play end of the video or the open end of the document, and the video being played, or the document being viewed is closed, thereby largely protecting User's privacy.

In addition, when the head-mounted smart device is used for the first time, or the smart device needs to be replaced, the user identity information needs to be collected, and the function may be implemented by the identity consistency information acquiring module, or The information acquisition module is newly added. When the module receives the information collection instruction, it needs a certain time (for example, 3 minutes) to read and save the user identity information. During this time, the module reads continuously. Image information of at least one part of the head or face of the user of the head-mounted smart device, and records the overall change trend of the image information during the time period, and determines the fluctuation range of the image information according to the change trend, under normal circumstances It may happen that the image information of the person changes drastically at one or more time points beyond the fluctuation range, but as long as the duration of the drastic change is very short, or only a time point appears, and the change is restored , the overall trend of the information has not changed, it is still considered that the situation is to meet the verification Item of.

In addition, the head-mounted smart device provided by the embodiment of the present invention has a power-saving protection device. If the identity consistency information acquisition module continuously fails to monitor image information for a predetermined period of time (for example, 5 minutes), the default is The head-mounted smart device leaves the human body and automatically goes to sleep.

As shown in FIG. 1 , the device includes at least an identity consistency information acquiring module 110 and an identity consistency information determining module 120. The identity consistency information acquiring module 110 acquires pulse information, and the identity consistency information determining module 120 calculates a pulse interval. And determining, according to the set threshold, whether the head-mounted smart device is continuously attached to the human body, and at least the identity consistency information acquiring module 110 is disposed on the head-mounted smart device.

The identity consistency information acquiring module 110 acquires the pulse information in a certain period of time in real time, and when the interval of the pulse is within the set threshold range, it is determined that the head-mounted smart device is continuously attached to the human body.

In addition, in other embodiments, the time period in which the identity consistency information acquiring module 110 acquires the pulse information is not limited to the foregoing certain time period, and may also be in the time period during which the head-mounted smart device performs a certain operation process. It can be all the time allowed in the hardware environment such as power, and there is no special restriction.

Moreover, the identity consistency information obtaining module 110 acquires pulse information embodied by a certain part of the human head or the face.

For example, in the following specific embodiment, as shown in FIG. 25 and FIG. 26, the device 100 for detecting that the head-mounted smart device is continuously attached to the human body is shown. FIG. 25 is a structural block diagram of the device, and FIG. 26 is a schematic structural view of the device. The device includes a wearing support device 10, a pulse sensor 24, and an identity consistency information judging module 120, wherein the pulse sensor 24 is configured to detect a sensitive characteristic of a change in blood volume generated by a specific wavelength of infrared rays to a blood microcirculation of a blood vessel at the end of the blood vessel, and is detected by the heart. Bounce, causing blood changes in the ear veins, undergoing circuit processing such as signal amplification, adjustment, and outputting a complete pulse wave voltage signal reflecting the blood volume change of the ear vein portion and transmitting it to the identity consistency information judging module 120. The pulse sensor 24 and the identity consistency information determination module 120 are connected and disposed on the wearing support device 10.

The wearing support device 10 is worn on the user, and fixes the pulse sensor 24 to the detecting portion of the user to continuously detect the pulse information of the user. In this embodiment, the wearing device is worn. 10 is worn on the head of the subject, which is an earphone type structure, and, in the embodiment, the pulse sensor 24 is a touch sensor, and the touch sensor passes through a rotatable link and a head-mounted smart device. The brackets are connected to detect the pulse of the ear veins. Of course, in other embodiments, the head-mounted smart device may also be glasses, a hat, a head cover, a helmet, etc., as long as the sensor can be fixed to the detecting portion of the user, and the head-mounted smart device is provided as needed. The device may also include a display screen with a pulse sensor 24 transmitting the detected pulse information to the display screen and displaying the user's pulse information through the display screen.

The identity consistency information obtaining module 120 acquires continuous pulse information between the pulse sensor 24 at a certain time or a set action interval and calculates a pulse interval. When the interval of the pulse is within the set threshold range, the determination is performed. The head-mounted smart device is continuously attached to the human body; otherwise, the head-mounted smart device is not continuously attached to the human body.

As shown in FIG. 27, in another specific embodiment, a structural block diagram of a device for detecting that a head-mounted smart device is continuously attached to a human body, wherein the identity consistency information acquiring module 110 includes a pulse acquisition module 1133 and a data processing module 1113, the communication module 113, and the pulse acquisition module 1133, the data processing module 1131, and the communication module 113 are sequentially and electrically connected, wherein

The pulse acquisition module 1133 is designed to be in the form of a pad, and is disposed on the head-mounted smart device, and corresponding to the detection part of the user, such as an ear vein, to detect the pulse information of the ear vein of the user, and implement the user Induction of the pulse, wherein the pulse acquisition module can be set only one, or one of the two ear veins can be set.

The data processing module 1131 reads the data information obtained from the pulse acquisition module 1133 and processes the data information to monitor the pulse information for a predetermined time interval in real time. The module consists of a microprocessor-based board that contains a low-power, high-performance 8-bit AVR microprocessor, the ATmega16L, peripheral components (resistors, capacitors, etc.) and power supplies. In this embodiment, four ADC input channels with 10-bit resolution are used to convert analog voltage information generated by the pulse acquisition module into digital data. The microprocessor has a clock frequency of 8MHz. All circuits operate at 5V and are supplied by the LM78L05 voltage divider and a 7.4V lithium battery. The module is simple and light, can be connected to the pulse acquisition module 21 through a line, and is easy to integrate with a head-mounted smart device.

The communication module 113 is configured to wirelessly transmit the digital data processed by the microprocessor-based data processing module 1131 to the identity consistency information determining module 120 in real time.

In the embodiment, since the amount of digital information is small, a high sampling rate wireless transmission method can be employed. Therefore, a low power consumption radio communication module GW100B (having a size of 56 mm x 28 mm x 7 mm) is selected. Radio transmission The transmitter and receiver are respectively connected to the microprocessor based data processing module and the background. The transmission distance can reach 5m in the case of barrier-free conditions. The forward error correction processing of the GW100B achieves a low error rate, making the entire system reliable.

In addition, if the identity consistency information determining module 120 is disposed on the head-mounted smart device, the two can also be connected by wired communication.

The identity consistency information judging module 120 includes a signal analysis processing module 71 and a judging module 122. The signal analysis processing module 71 calculates a pulse interval according to the voltage signal corresponding to the received pulse information, and the judging module 122 calculates the calculated pulse interval. The value is compared with a range of voltage signals corresponding to the preset critical pulse interval value range, and whether the detected pulse information is abnormal according to the comparison result, for example, if the detected pulse interval value is greater than a preset pulse interval maximum The threshold value, or less than the preset pulse interval threshold value, is considered that the head-mounted smart device does not continuously adhere to the human body; conversely, if the detected pulse interval value is between the preset pulse interval value range, then The head-mounted smart device is continuously attached to the human body.

Preferably, in another embodiment of the present invention, the identity consistency information determining module 120 includes a signal analysis processing module 71 and a comparison module 72, and the signal analysis processing module 71 analyzes the acquired pulse information within a predetermined time period and It is converted into an average value of the corresponding electrical signal, and an electrical signal representing the difference between the real-time pulse information value and the average value is calculated, and the comparison module 72 compares the difference signal with a preset allowable change difference value, where allowed. Within the difference of the difference, it is determined that the head-mounted smart device is continuously attached to the human body. Otherwise, the head-mounted smart device is not continuously attached to the human body. In addition, in other embodiments, the comparison module 72 can also Comparing the real-time obtained electrical signal representing the pulse interval value with the maximum value and the minimum value of the electrical signal converted into the pulse information, the real-time acquired electrical signal representing the pulse interval value is greater than the acquired pulse information conversion The head-mounted type is considered to be the maximum value of the electrical signal or the minimum value of the electrical signal converted into the obtained pulse information. The smart device does not remain attached to the human body.

In addition, in another embodiment, as shown in FIG. 28 and FIG. 29, FIG. 28 is a structural block diagram of the device, FIG. 29 is a schematic structural diagram of the device, and the identity consistency information acquiring module 110 is a non-contact sensor. The non-contact sensor includes at least one camera 41 for detecting pulse information of a specified part of the face of the user of the head-mounted smart device. In addition, in the embodiment, the head-mounted smart device is a glasses-type structure. The camera 41 is disposed at the front end of the bracket of the glasses, and the identity consistency information determining module 120 includes a signal processing module 42, a calculation module 43, and a comparison module 72. The signal processing module 42 processes the video containing the color face obtained by the camera 41. The obtained face area and face position coordinates, at least the skin color area, the eyes, and the eye area are divided and classified, and the classification is not given The same weight, the three-color channel separation is performed on the face region in each frame video, and the spatial mean value is taken for each channel, and the calculation module 43 performs independent component analysis ICA processing on the sampled data to obtain a pulse interval value, and analyzes the pulse interval value. The average value, and the difference between the real-time pulse information value and the average value, the comparison module 72 is configured to compare the difference value with a preset allowable change difference value, and determine the head within the allowed change difference value. The wearable smart device is continuously attached to the human body.

In this embodiment, the acquisition and analysis of the user's pulse information can also be implemented by the following methods:

The method is based on photoelectric volume pulse wave tracing PPG and independent component analysis ICA model, and non-contact measurement pulse is realized by analyzing a face video. In a normal environment, a color video of a face is acquired by a camera, and after a three-primary light mode RGB channel separation and ICA processing is performed on the face region, a group of components closest to the human body pulse wave is found as a measurement result.

1. First introduce the basic principles of PPG and ICA, then introduce the measurement process based on the two video pulses, and finally give the experimental results and comparative data.

1.1PPG Introduction

PPG is a non-invasive method for detecting changes in blood volume in living tissue by means of optoelectronic means. When a beam of a certain wavelength is irradiated onto the surface of the skin, it will be transmitted by transmission or reflection. In the process, the intensity of the light is weakened due to the absorption of light by the skin, muscles, tissues and blood. The absorption of light by skin, muscle, tissue, etc. is constant throughout the blood circulation, and the blood volume in the skin is pulsating and cyclically changing under the action of the heart: when the heart contracts, the peripheral blood volume is the most, The amount of light absorbed is also the largest, and the intensity of light transmitted is also minimal; conversely, when the heart is diastolic, the intensity of light transmitted is the greatest. The intensity of the light thus received exhibits a pulsating periodic variation with the heartbeat.

The blood volume contains important physiological information of many cardiovascular systems such as heartbeat function and blood flow. It also contains abundant microcirculatory physiological and pathological information, and is an important source of information for studying the human circulatory system. This optoelectronic technology can provide information about the cardiovascular system, such as heart rate, blood pressure, blood flow, blood oxygen, respiratory volume, microcirculatory peripheral blood vessels, arterial oxygen saturation.

This embodiment is based on this bio-optical principle, but since in the normal case, the photoelectric volume requires the use of a dedicated beam as the light source, the objective of this experiment is to study the method of separating the source information containing the specific signal under the natural light source and feasibility. Assume that the illumination intensity of the experimental environment is constant, set to a constant a, and the absorption of the natural light intensity by the blood volume is x. The light intensity is f(x) observed by an instrument (such as a normal household camera), and you can get:

f(x)=a-x (1)

f(x) and x have the same period and frequency, so it is theoretically possible to detect the periodic variation of the light intensity of a specific wavelength in the face region by the camera to measure the pulse of the human body.

1.2 ICA Introduction

ICA is a new signal processing and data analysis method developed in the signal processing field in the late 1990s. The purpose is to separate (or extract) mutually independent source signals from the mixed signals observed by unknown source signals. It has a wide range of applications in signal processing, data mining, feature extraction, neural networks and many other fields.

ICA assumes that there are n mutually independent statistical source signals s(t)=[s1(t), s2(t),...,sn(t)] ^T , and the observed signal x(t)=[x1(t), X2(t),...,xn(t)] ^T is a linear mixture of the components of the source signal (t is the time or sample label), ie

x(t)=As(t) (2)

Where A ∈ ^{R n × n} is an unknown non-singular mixed matrix. The purpose of ICA is to obtain an n × n demixing matrix w = [w1(t), w2(t), ..., wn(t)] ^T in the case where only the mixed signal x(t) is known.

y(t)=Wx(t) (3)

Where y(t) = [y1(t), y2(t), ..., yn(t)] ^T , and the components in y(t) are made statistically independent of each other as much as possible. Thus y(t) can be used as an estimate of the source independent component, ie

among them

An estimate of the independent component of the source. In this embodiment, the processing of the video is performed in the RGB three-color channel, which is equivalent to three sensor observation source signals, and the purpose is to find the period or frequency in the separated three-color independent component which is relatively close to the comparison test. A set of components.

2. Implementation process

2.1 Obtain sampling data

After the camera obtains a video containing colored faces, Opencv (open source computer vision library, which encapsulates library functions commonly used in digital image processing) is used to obtain face region and face position coordinates. This process is performed in the YCbCr color space and is completed by skin color area detection, eye detection, eye area detection, and face candidate area division hierarchical structure. In this cascading structure, different classifiers are given different weights, and all the detection processes mean that the video frame contains a face area. Then, the RGB three-color channel separation is performed on the face region in each frame of video, and the spatial mean is taken for each channel. Let the size of the face area be M×N. In the RGB color space model, each pixel is represented by a set of (R, G, B) data, and the components of the RGB channel are (R, 0, 0), (0 , G, 0), (0, 0, B). Mean value of any channel in each frame

Mathematical expression for

Where x _k is the effective value of the corresponding component. This gives the observed signal

Where t is the time series of the video frame. Figure 270 is an RGB three-color signal sequence data obtained by processing a video having a duration of 30 pulse periods, wherein (a) is a red channel; (b) is a green channel; and (c) is a blue channel.

2.2 ICA processing and results of sampled data

In the ICA process, since the mixing matrix A and the source signal s(t) are unknown, if there is no other available information, only the statistically independent conditions between the components of s(t) are used, from the received signal x(t). It is estimated that A and s(t) must be multi-solutions, so some assumptions and constraints must be made that are consistent with the application of the project. The two basic assumptions of ICA are: (1) the components of the source signal are statistically independent of each other; (2) there can be at most one Gaussian signal in the source signal. This paper uses the FastICA algorithm based on mutual information minimization. Specific steps are as follows:

(1) Centralizing and whitening the data to obtain z(t);

(2) selecting an initialization matrix W having a unit norm;

(3) for each i=1,...,n, now w _i ←E{Zg(w _i ^T z))}-E{g'(w _i ^T )z}w _i , the function g is based on the data Gaussian selected nonlinear function;

(4) Symmetric orthogonalization of the matrix W=(w1,...,wn)T:

W←(WW ^T ) ^-1/2 W

(5) If it does not converge, return to step (3).

After the separation matrix W is obtained, the estimated source signal [5-9] can be obtained by taking the equation (2). Figure 271 shows the effect of performing ICA processing on the face video of a 30-pulse cycle and then filtering it with arithmetic mean filtering. Where B is the blue channel data, G is the green channel data, and R is the red channel data. After the ICA process, the estimated component I, the estimated component II, and the estimated component III are obtained, and then filtered by arithmetic mean filtering. After the component (1), the filtered component (2), and the filtered component (3), after the pulse information obtained by the user manually taking the pulse is compared, it is determined that the filtered component (3) is relative to The other two are more characteristic of the pulse wave, so the estimated component III is selected as the effective source signal, and the pulse interval value is used as the data of the pulse information of the present embodiment.

In addition, in another embodiment, the pulse information of the user can also be obtained and analyzed by:

1. Photoelectric sensor working principle

When infrared light is projected into the capillaries, the changes in the transmittance of the infrared receiver tube are periodically changed due to the periodic pulsation changes of the arterial blood of the capillaries during the blood circulation, which reflects the arteries. The change of blood, thereby realizing the transition of the optical signal to the electrical signal, and then filtering, amplifying, shaping, A/D converting and further processing the photoelectric signal. Using the earmuff type, or the headgear type projection photoelectric sensor, the principle of the photoelectric sensor is shown in Figure 272.

The light emitted from the infrared light-emitting tube 71 disposed on the holder 70 passes through the skin of the site to be tested 72 into the deep tissue, is absorbed by the skin, pigment, nails, blood, etc., and is partially reflected back by the skin and blood, and the rest is projected. It is received by the infrared receiving tube 73. This method can better indicate the time relationship of the heart rate and can be used for the measurement of the pulse waveform.

2. Measurement system design

The photoelectric intelligent pulse wave measurement system is based on the ATmega8 single-chip microcomputer. Because the ATmega8 is a low-power, high-performance, anti-interference ability, 8K can be erased multiple times, the AVR high-speed single-chip microcomputer with multiple password protection lock (LOCK) function, Therefore, data processing can be performed at high speed. The photoelectric sensor is used as an input, and the input signal is amplified, filtered, 16-bit A/D converted, and then transmitted to the single-chip microcomputer for processing, and the processed data is transmitted to the identity consistency information determining module 120, as shown in FIG.

2.1 Photoelectric sensor circuit design

The sensor circuit is the key to this design, and its performance directly affects the processing of the rear circuit and the display of the results. In the process of human breathing, the content of oxygen-carrying hemoglobin and the content of reduced hemoglobin in the blood are changed, so that the absorption coefficient of blood to light is changing, so the baseline of the pulse wave curve picked up often changes with the fluctuation of respiratory motion. Therefore, the use of an infrared light-emitting tube as a light source suppresses the drift of the pulse wave curve caused by respiratory motion.

The core component of the receiving circuit is a phototransistor. In order to obtain the best signal-to-noise ratio, the pre-circuit uses a low-noise amplifier to minimize input noise. Therefore, low-noise photosensitive devices and resistors are selected, and low-level power supply is used. According to the impedance characteristics of the sensor output source, low-noise operating points are determined and noise matching is performed to obtain a minimum noise figure.

2.2 Signal Conditioning Circuit Design

Arterial pulse waves are low-frequency, weak physiological signals that must be filtered and amplified to meet signal acquisition requirements. The frequency of the arterial pulse signal is basically limited to 0.1-20 Hz. In order to remove high frequency interference, especially the 50 Hz power frequency interference, a low-pass filter circuit with appropriate frequency band is adopted, so that the detected signal has the maximum fidelity. For the amplifier circuit, the op amp is required to have a high input impedance and low input loss. Adjusting the voltage, small drift, the steps of signal amplification and filtering in Figure 273 are implemented.

2.3 signal processing system

The signal processing system is based on the ATmega8 microcontroller, with A/D conversion, program memory, data memory and keyboard, etc., used to complete the pulse signal A / D conversion, parameter calculation, storage and set various working methods.

The identity consistency information judging module 120 includes a signal analysis processing module (not shown) and a comparison module (not shown). The signal analysis processing module analyzes the pulse information received within a predetermined period of time, obtains an average pulse interval, and calculates the real-time. The difference between the pulse interval value and the average value, the electrical signal indicating the difference is transmitted to the comparison module, and the comparison module compares the difference with the preset allowable change difference range, and the allowed variation difference It is determined that the head-mounted smart device is continuously attached to the human body. Conversely, if the difference between the real-time pulse interval value and the average value is not within the preset allowable change difference value, it is determined as the head-mounted smart The device leaves the body.

It should be noted that pulse wave measurement is a relatively complicated process and must be implemented by system software. The use of ATmega8 microcontroller makes the system's timing, counting and real-time display functions convenient. The MCU system software mainly includes main program, data acquisition subroutine, digital filtering subroutine, keyboard scanning subroutine, pulse rate calculation subroutine and RS232 communication subroutine. Each subroutine can be debugged separately, with clear structure, convenient calling and expansion.

The computer software system VB is written to receive data from the RS232 interface, curve the received data, and display the fitted pulse waveform.

In addition, in any of the above implementations, the identity consistency information obtaining module 110 and the identity consistency information determining module 120 may be disposed on the same device or not on the same device, if the identity consistency information acquiring module 110 and the identity consistency. The information determining module 120 is not disposed on the same device, and the identity consistency information acquiring module 110 and the identity consistency information determining module 120 can implement electrical connection through wireless devices such as wifi and Bluetooth.

As shown in FIG. 274, the method includes:

Step S3410, acquiring pulse information;

Step S3420: Calculate the interval of the pulse according to the pulse information, and determine whether the head-mounted smart device is continuously attached to the human body according to the set threshold.

Wherein, the method further comprises:

The pulse information in a certain period of time is acquired in real time, and when the interval of the pulse is within the set threshold range, it is determined that the head-mounted smart device is continuously attached to the human body.

And, obtaining pulse information includes:

Get pulse information embodied in a part of the human head or face.

Moreover, in one embodiment, a contact or non-contact sensor is used to acquire the pulse of the ear vein or the radial artery;

The non-contact sensor includes at least one camera, and the camera is disposed on a bracket of the head-mounted smart device, and acquires pulse information by detecting a facial image.

And, the method further includes:

The face area and the face position coordinates obtained after processing the video containing the color face obtained by the camera, at least the skin color area, the eyes, and the eye area are divided and classified, and different weights are assigned to the classification, and the face in each frame of the video is given. The region performs three-color channel separation, takes the spatial mean value for each channel, and performs independent component analysis ICA processing on the sampled data to obtain pulse information.

Moreover, in one embodiment, the method includes:

The average of the analyzed pulse information, and calculate the difference between the real-time pulse information value and the average value;

It can be understood that with the development of the information age, the technology for transmitting certain manipulations through human eye movement information and the like has been more and more perfect, and at the same time liberating the hands of the people, it also brings some drawbacks, for example, In the process of performing an operation, if the device does not continuously adhere to the human body, and there is no way to judge whether the device leaves the human body, it will cause the current operation to continue after the device leaves the human body, resulting in waste of power. Or the user's privacy leakage, etc., so, through the above manner, the real-time monitoring of the pulse information of the user of the head-mounted smart device, through the real-time understanding of the user's pulse information and the preset threshold, or the preset pulse interval range In comparison, it can be determined whether the head-mounted smart device is continuously attached to the human body, for example, the following scenario:

(Scenario 2) For some videos or documents that require user rights to view, the identity of the user can also be verified by means of iris information recognition, and the opening of the file can be controlled by eye movements such as blinking or blinking of the user. , closing, or fast forward, rewind, flipping up and down, etc. At this time, it is also possible to determine whether the device is continuously attached to the human body by the above method, for example, the wearing The smart device is a smart glasses. The user wears the glasses to view the video or the document. After the user identity is authenticated and the file is opened, if the smart glasses are taken down or replaced by another person, If the pulse information of the user detected by the identity consistency information determining module is discontinuous or an interval exceeding a preset threshold is generated, a closing instruction is sent to the playing end of the video or the open end of the document, and the video being played is closed, or The document being viewed, and thus, largely protects the privacy of the user.

In addition, when the head-mounted smart device is used for the first time, or the smart device needs to be replaced, the user identity information needs to be collected, and the function may be implemented by the identity consistency information acquiring module, or The new information collection module, in the case that the module receives the information collection instruction, requires a certain time (for example, 3 minutes) to read and save the user identity information. During this time, the module continuously reads the current The pulse information of the user, and record the overall trend of the pulse information during the time period, and determine the average interval of the pulse according to the change trend. Under normal circumstances, the pulse interval of the person may occur at one or more times. The point changes drastically beyond the fluctuation range, but as long as the duration of the drastic change is very short, or only occurs at a point in time, and the overall trend of the information does not change after the change is restored, the The situation is to satisfy identity consistency verification.

In addition, the head-mounted smart device provided by the embodiment of the present invention has a power-saving protection device, and if the smart device is detected to leave the human body, it automatically enters a sleep state.

The algorithms and displays provided herein are not inherently related to any particular computer, virtual system, or other device. Various general purpose systems can also be used with the teaching based on the teachings herein. The structure required to construct such a system is apparent from the above description. Moreover, the invention is not directed to any particular programming language. It is to be understood that the invention may be embodied in a variety of programming language, and the description of the specific language has been described above in order to disclose the preferred embodiments of the invention.

In the description provided herein, numerous specific details are set forth. However, it is understood that the embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of the description.

Similarly, the various features of the invention are sometimes grouped together into a single embodiment, in the above description of the exemplary embodiments of the invention, Figure, or a description of it. However, the method of the disclosure should not be construed as reflecting the intention that the claimed invention is claimed in the claims The features described are more features. Rather, as the following claims reflect, inventive aspects reside in less than all features of the single embodiments disclosed herein. Therefore, the claims following the specific embodiments are hereby explicitly incorporated into the embodiments, and each of the claims as a separate embodiment of the invention.

Those skilled in the art will appreciate that the modules in the devices of the embodiments can be adaptively changed and placed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and further they may be divided into a plurality of sub-modules or sub-units or sub-components. In addition to such features and/or at least some of the processes or units being mutually exclusive, any combination of the features disclosed in the specification, including the accompanying claims, the abstract and the drawings, and any methods so disclosed, or All processes or units of the device are combined. Each feature disclosed in this specification (including the accompanying claims, the abstract and the drawings) may be replaced by alternative features that provide the same, equivalent or similar purpose.

In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features that are included in other embodiments and not in other features, combinations of features of different embodiments are intended to be within the scope of the present invention. Different embodiments are formed and formed. For example, in the following claims, any one of the claimed embodiments can be used in any combination.

The various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or digital signal processor (DSP) may be used in practice to implement some or all of the means for detecting that the head mounted smart device is continuously attached to the human body in accordance with an embodiment of the present invention. Some or all of the features of the part. The invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein. Such a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

For example, FIG. 35 illustrates an electronic device in which the method of detecting the head-mounted smart device of the present invention is continuously attached to a human body. The electronic device conventionally includes a processor 1210 and a computer program product or computer readable medium in the form of a memory 1220. The memory 1220 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM. Memory 1220 has a memory space 1230 for program code 1231 for performing any of the method steps described above. For example, storage space 1230 for program code may include various program codes 1231 for implementing various steps in the above methods, respectively. The program code can be read from or written to one or more computer program products. These computers The program product includes a program code carrier such as a hard disk, a compact disk (CD), a memory card, or a floppy disk. Such a computer program product is typically a portable or fixed storage unit as described with reference to FIG. The storage unit may have a storage section or a storage space or the like arranged similarly to the storage 1220 in the electronic device of FIG. The program code can be compressed, for example, in an appropriate form. In general, the storage unit comprises a program 1231' for performing the steps of the method according to the invention, ie a code readable by a processor such as 1210, which when executed by the electronic device causes the electronic device to perform the above Each step in the described method.

It is to be noted that the above-described embodiments are illustrative of the invention and are not intended to be limiting, and that the invention may be devised without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as a limitation. The word "comprising" does not exclude the presence of the elements or steps that are not recited in the claims. The word "a" or "an" The invention can be implemented by means of hardware comprising several distinct elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means can be embodied by the same hardware item. The use of the words first, second, and third does not indicate any order. These words can be interpreted as names.

According to the above technical solution of the present invention, the monitoring and analysis of the pulse information of the user can be performed, and the monitored pulse interval of the user, or the difference in pulse interval variation and the preset pulse interval, or the pulse allowable variation range can be performed. Comparing, and determining, according to the comparison result, a function of determining whether the head-mounted smart device is continuously attached to the human body, thereby ensuring consistency of the identity of the user in the operation of the head-mounted smart device. The operation security of the head-mounted smart device is improved, and the user of the device is not required to perform frequent identity authentication, thereby improving the convenience of operation.

The above is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present disclosure. All should be covered by the scope of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

A device for detecting that a head-mounted smart device is continuously attached to a human body, characterized in that at least an identity consistency information acquiring module and an identity consistency information determining module are obtained, and the identity consistency information acquiring module acquires a human head or Distance information between at least one part of the face and a corresponding part of the head-mounted smart device, the identity consistency information determining module calculates the distance information and determines the head-mounted smart device according to a preset threshold Whether it continues to adhere to the human body.
The device for detecting that a head-mounted smart device is continuously attached to a human body according to claim 1, wherein the identity consistency information acquiring module comprises at least one distance sensor, and the distance sensor acquires the distance information. .
The device for detecting that a head-mounted smart device is continuously attached to a human body according to claim 1 or 2, wherein the distance information comprises distance information within a preset time range, and when the distance information is in the When the threshold range is set, it is determined that the head-mounted smart device is continuously attached to the human body.
The apparatus for detecting that a head-mounted smart device is continuously attached to a human body according to claim 1 or 2, wherein the identity consistency information determining module comprises a signal analysis processing module and a comparison module, and the signal analysis processing module The analysis obtains a difference between the real-time detected distance information value and the pre-stored average distance information, and the comparing module compares the difference with a preset allowable change difference, where the difference is in the Within the preset allowable change difference, it is determined that the head-mounted smart device is continuously attached to the human body;
The apparatus for detecting that a head mounted smart device is continuously attached to a human body according to claim 4, wherein the identity consistency information acquiring module comprises a distance sensor, a signal conditioning circuit, the signal conditioning circuit, and the The signal analysis processing module is connected, the output end of the distance sensor is connected to the input end of the signal conditioning circuit, and the signal conditioning circuit is configured to convert the distance signal acquired by the distance sensor into the signal analysis processing module An identifiable electrical signal.
The apparatus for detecting that a head mounted smart device is continuously attached to a human body according to any one of claims 1 to 5, wherein the identity consistency information acquiring module is disposed on a bracket of the head-mounted smart device The front end portion is electrically connected to the identity consistency information determining module.
The apparatus for detecting that a head mounted smart device is continuously attached to a human body according to any one of claims 1 to 6, wherein the identity consistency information determining module is disposed on the head mounted smart device.
The apparatus for detecting that a head-mounted smart device is continuously attached to a human body according to any one of claims 1 to 6, wherein the identity consistency information judging module is disposed independently of the head-mounted smart And a processing unit outside the device, and is in communication with the head-mounted smart device.
A method for detecting that a head-mounted smart device is continuously attached to a human body, comprising:

Obtaining distance information between at least one part of the human head or face to which the head-mounted smart device is currently attached and a corresponding part on the head-mounted smart device;

Calculating the distance information, and determining whether the head-mounted smart device is continuously attached to the human body according to a preset threshold.
The method for detecting that a head mounted smart device is continuously attached to a human body according to claim 9, wherein the distance information comprises distance information within a preset time range, and when the distance information is set When the threshold is within the range, it is determined that the head-mounted smart device is continuously attached to the human body;

Preferably, calculating the distance information, and determining whether the head-mounted smart device is continuously attached to the human body according to the preset threshold includes:

Calculating a difference between the real-time detected distance information value and the pre-stored average distance information, and comparing the difference with a preset allowable change difference, wherein the difference is at the preset Within the allowed variation difference, it is determined that the head-mounted smart device is continuously attached to the human body;

Further preferably, the acquired distance signal is converted into an electrical signal, and the difference between the electrical signal and the pre-stored electrical signal representing the average distance information is calculated, and the difference is compared with a pre-stored electrical value indicating the allowable change difference. The signals are compared.
The device for detecting that the head-mounted smart device is continuously attached to the human body is characterized in that it includes at least an identity consistency information acquiring module and an identity consistency information determining module, and the identity consistency information acquiring module acquires body temperature information of the human body. The identity consistency information determining module determines, according to the body temperature information, whether the head-mounted smart device is continuously attached to the human body.
The device for detecting that a head-mounted smart device is continuously attached to a human body according to claim 11, wherein the acquired body temperature information of the human body is continuous body temperature information within a predetermined time, or predetermined in a predetermined time. The point value of the body temperature information acquired in the cycle;

Preferably, the identity consistency information acquiring module is a contact type or non-contact body temperature measuring sensor;

Further preferably, the head-mounted smart device comprises smart glasses, the contact body temperature measuring sensor is disposed on a nose pad of the smart glasses, and the non-contact body temperature measuring sensor is disposed on the headwear A front end portion of the bracket of the smart device, the body temperature measuring sensor being electrically connected to a control system of the smart glasses.
The apparatus for detecting that a head-mounted smart device is continuously attached to a human body according to claim 11 or 12, wherein the identity consistency information determining module is configured to calculate a difference value of the obtained body temperature change, and according to the advance Setting the allowable change difference to determine whether the head-mounted smart device is continuously attached to the human body;

Preferably, the identity consistency information determining module includes a signal analysis processing module and a comparison module Block, the signal analysis processing module analyzes an average value of temperatures detected within a predetermined time period, and calculates a difference between the temperature value obtained in real time and the average value, and the comparison module compares the difference Comparing the preset allowable change difference ranges, and determining that the head-mounted smart device is continuously attached to the human body within the range of the allowable change difference;

Further preferably, the identity consistency information acquisition module includes an integrated temperature measurement sensor, a signal conditioning circuit, and the signal conditioning circuit is electrically connected to the signal analysis processing module, and configured to convert the received body temperature information into the signal. An electrical signal recognizable by the processing module is analyzed, and an output of the temperature measuring sensor is coupled to an input of the signal conditioning circuit.
The device for detecting that a head-mounted smart device is continuously attached to a human body according to claim 11 or 12, wherein the identity consistency information determining module is configured to use a body temperature value obtained in real time and a preset body temperature. The range determines whether the head-mounted smart device is continuously attached to the human body;

Preferably, the identity consistency information determining module is configured to compare the acquired body temperature value with a preset body temperature range, and determine the headwear when the body temperature value is in the preset body temperature range. The smart device is continuously attached to the human body.
The apparatus for detecting that a head mounted smart device is continuously attached to a human body according to any one of claims 11 to 14, wherein the identity consistency information determining module is disposed on the head mounted smart device.
The apparatus for detecting that a head mounted smart device is continuously attached to a human body according to any one of claims 11 to 14, wherein the identity consistency information determining module is disposed independently of the head mounted smart device And a communication connection with the head-mounted smart device.
A method for detecting that a head-mounted smart device is continuously attached to a human body, comprising:

Obtaining body temperature information of a human body to which the head-mounted smart device is currently attached;

And determining, according to the obtained body temperature information, whether the head-mounted smart device is continuously attached to the human body.
The method for detecting that a head-mounted smart device is continuously attached to a human body according to claim 17, wherein the acquired body temperature information is continuous body temperature information within a predetermined time, or is acquired in a predetermined period within a predetermined time. Point value of body temperature information;

Preferably, calculating the difference value of the acquired body temperature, and determining whether the head-mounted smart device is continuously attached to the human body according to the preset allowable change difference range;

Further preferably, analyzing an average value of the temperatures detected within a predetermined period of time, and calculating a difference between the temperature value obtained in real time and the average value;

Comparing the difference with a preset allowable change difference range, and determining that the head-mounted smart device is continuously attached to the human body within the allowable change difference range.
The method for detecting that a head-mounted smart device is continuously attached to a human body according to claim 18, comprising:

The received body temperature information number is converted into an electrical signal, and the electrical signal is compared to a pre-stored range of electrical signals indicative of a range of allowable change differences.
The method for detecting that the head-mounted smart device is continuously attached to a human body according to the acquired body temperature information, according to claim 17, wherein the determining whether the head-mounted smart device is continuously attached to the human body comprises: :

Determining whether the head-mounted smart device is continuously attached to the human body according to the body temperature value of the human body obtained in real time and the preset body temperature range;

Preferably, comparing the body temperature value obtained in real time with a preset body temperature range, and determining that the head-mounted smart device is continuously attached to the human body when the real-time acquired body temperature value is in the preset body temperature range .
A device for detecting that a head-mounted smart device is continuously attached to a human body, characterized in that it comprises at least an identity consistency information acquiring module and an identity consistency information determining module, wherein the identity consistency information acquiring module acquires the headset The smart device sets the pressure information of the weight bearing portion on the human body, and the identity consistency information determining module determines whether the smart device is continuously attached to the human body according to the comparison result of the pressure information and the preset threshold.
The apparatus for detecting that a head-mounted smart device is continuously attached to a human body according to claim 21, wherein the identity consistency information acquisition module acquires pressure information in a certain time in real time, when the pressure information is corresponding When the threshold range is set, it is determined that the head-mounted smart device is continuously attached to the human body.
The apparatus for detecting that a head mounted smart device is continuously attached to a human body according to claim 21, wherein the identity consistency information determining module comprises a signal analysis processing module and a comparison module, and the signal analysis processing module analyzes the pre-acquired The average value of the electrical signal into which the pressure information is converted, and the difference between the real-time pressure information value and the average value, the comparison module comparing the difference with the preset allowable change difference, the allowable change difference Within the value, it is determined that the head-mounted smart device is continuously attached to the human body;

Preferably, the identity consistency information acquisition module includes a pressure measurement sensor, a signal conditioning circuit, and the signal conditioning circuit is coupled to the signal analysis processing module for converting the received pressure signal into the signal analysis processing module. An identifiable electrical signal, the output of the pressure measuring sensor being coupled to the input of the signal conditioning circuit.
The device for detecting that a head-mounted smart device is continuously attached to a human body according to claim 21 or 22, wherein the identity consistency information acquisition module comprises at least one pressure sensor, and the pressure sensor is disposed at the Obtain pressure information on the nose pads of the head-mounted smart device.
The apparatus for detecting that a head mounted smart device is continuously attached to a human body according to any one of claims 21 to 24, wherein the identity consistency information determining module is disposed on the head mounted smart device.
The apparatus for detecting that a head mounted smart device is continuously attached to a human body according to any one of claims 21 to 24, wherein the identity consistency information determining module is disposed independently of the head mounted smart device And a communication connection between the processing unit and the head-mounted smart device.
A method for detecting that a head-mounted smart device is continuously attached to a human body, comprising:

Obtaining pressure information of the head-mounted smart device disposed on a weight bearing portion of the human body;

Whether the head-mounted smart device is continuously attached to the human body is determined according to a comparison result of the pressure information and a preset threshold.
The method for detecting that a head-mounted smart device is continuously attached to a human body according to claim 27, comprising:

Obtaining pressure information for a certain period of time, when the pressure information is within a corresponding set threshold range, determining that the head-mounted smart device is continuously attached to the human body.
The method for detecting that a head-mounted smart device is continuously attached to a human body according to claim 27, wherein the judging whether the head-mounted smart device is based on a comparison result of the pressure information and a preset threshold Continued attachment to the human body includes:

Analyzing an average value of the electrical signals converted into the pre-acquired pressure information, and a difference between the real-time pressure information value and the average value, comparing the difference value with a preset allowable change difference value, and allowing the difference in variation Within the value, it is determined that the head-mounted smart device is continuously attached to the human body.
The method for detecting that a head-mounted smart device is continuously attached to a human body according to claim 29, further comprising:

The received pressure information is converted into an electrical signal.
A device for detecting that a head-mounted smart device is continuously attached to a human body, characterized in that at least an identity consistency information acquiring module and an identity consistency information determining module are obtained, and the identity consistency information acquiring module acquires a human head or Image information of at least one part of the face, the identity consistency information determining module determines whether the head-mounted smart device is continuously attached to the human body according to a comparison result of the image information and the pre-stored standard image information.
The apparatus for detecting that a head-mounted smart device is continuously attached to a human body according to claim 31, wherein the image information comprises image information acquired within a preset time range, when the image information is pre-stored In the case where the standard image information is consistent, it is determined that the head-mounted smart device is continuously attached to the human body.
The detecting head-mounted smart device according to claim 31 or 32 is continuously attached to the human body The device is characterized in that the identity consistency information acquiring module at least includes an image sensor, and the image sensor acquires the image information.
The apparatus for detecting that a head-mounted smart device is continuously attached to a human body according to claim 31, wherein the identity consistency information determining module comprises a signal analysis processing module and a comparison module, and the signal analysis processing module analyzes the The pixel, and/or size, and/or feature point location of the image information, and the difference between the pixel, and/or size, and/or feature point location of the real-time image information and the pre-stored standard image information, The comparing module compares the difference with a preset allowable change difference, and determines that the head-mounted smart device is continuously attached to the human body within the allowed change difference;

Preferably, the identity consistency information obtaining module comprises an image sensor, a signal conditioning circuit, the signal conditioning circuit is connected to the signal analysis processing module, and an output end of the image sensor is connected to an input end of the signal conditioning circuit. The signal conditioning circuit is configured to convert an image signal acquired by the image sensor into an electrical signal recognizable by the signal analysis processing module.
The apparatus for detecting that a head-mounted smart device is continuously attached to a human body according to any one of claims 31 to 34, wherein the identity consistency information acquisition module is disposed on a bracket of the head-mounted smart device The front end portion is electrically connected to the identity consistency information determining module.
The apparatus for detecting that a head mounted smart device is continuously attached to a human body according to any one of claims 31 to 35, wherein the identity consistency information determining module is disposed on the head mounted smart device.
The apparatus for detecting that a head mounted smart device is continuously attached to a human body according to any one of claims 31 to 35, wherein said identity consistency information determining module is disposed independently of said head mounted smart And a processing unit outside the device, and is in communication with the head-mounted smart device.
A method for detecting that a head-mounted smart device is continuously attached to a human body, comprising:

Obtaining, by the module, image information of at least one part of a human head or a face to which the head-mounted smart device is attached;

Whether the head-mounted smart device is continuously attached to the human body is determined according to a comparison result of the image information and the pre-stored standard image information.
The method for detecting that a head mounted smart device is continuously attached to a human body according to claim 38, wherein the image information comprises image information acquired within a preset time range, when the image information is pre-stored In the case where the standard image information is consistent, it is determined that the head-mounted smart device is continuously attached to the human body.
The method for detecting that a head-mounted smart device is continuously attached to a human body according to claim 38, wherein the result of comparing the image information with pre-stored standard image information is determined Whether the wearable smart device is continuously attached to the human body comprises:

Analyzing pixels, and/or size, and/or feature point locations of the image information, and calculating between the real-time image information and pixels, and/or size, and/or feature point locations of the pre-stored standard image information Difference

Comparing the difference with a preset allowable change difference, and determining that the head-mounted smart device is continuously attached to the human body within the allowed change difference.
A device for detecting that a head-mounted smart device is continuously attached to a human body, characterized in that at least an identity consistency information acquiring module and an identity consistency information determining module are obtained, and the identity consistency information acquiring module acquires pulse information. The identity consistency information determining module calculates a pulse interval, and determines whether the head-mounted smart device is continuously attached to the human body according to the set threshold, at least the identity consistency information acquiring module is disposed in the headset smart On the device.
The apparatus for detecting that a head-mounted smart device is continuously attached to a human body according to claim 41, wherein the identity consistency information acquisition module acquires pulse information in a certain time in real time, when the interval of the pulse is When the threshold range is set, it is determined that the head-mounted smart device is continuously attached to the human body;

Preferably, the identity consistency information obtaining module acquires pulse information embodied by a part of a human head or a face;

Preferably, the identity consistency information acquiring module comprises at least one contact type or non-contact sensor, wherein the touch sensor is used for detecting the pulse of the ear vein or the radial artery; the non-contact sensor includes at least one a camera, the camera is disposed on a bracket of the head-mounted smart device, and acquires pulse information by detecting a facial image; preferably, the touch sensor is coupled to the bracket of the head-mounted smart device through a rotatable link connection;

Preferably, the identity consistency information judging module comprises a signal processing module and a calculation module, and the signal processing module processes the face region and the face position coordinates obtained by the camera with the color face-containing video, at least the skin color region, the eye, The eye is divided into different categories, and the classification is given different weights. The face region in each frame of video is separated by three color channels, and the spatial mean is taken for each channel. The calculation module performs independent component analysis on the sampled data. The ICA process gets the pulse information.
The apparatus for detecting that a head-mounted smart device is continuously attached to a human body according to claim 41, further comprising a comparison module, wherein the identity consistency information determining module analyzes an average value of the pulse information and calculates a real-time pulse information value. Comparing the difference with the average value, the comparison module compares the difference value with a preset allowable change difference value, and determines that the head-mounted smart device is continuously attached to the human body within the allowed change difference value. .
The apparatus for detecting that a head mounted smart device is continuously attached to a human body according to any one of claims 41 to 43, wherein the identity consistency information determining module is disposed on the headset On smart devices.
The apparatus for detecting that a head mounted smart device is continuously attached to a human body according to any one of claims 41 to 43, wherein the identity consistency information judging module is disposed independently of the head mounted smart A processing unit other than the device and a communication connection with the head-mounted smart device.
A method for detecting that a head-mounted smart device is continuously attached to a human body, comprising:

Obtain pulse information;

Based on the pulse information, the interval of the pulse is calculated, and whether the head-mounted smart device is continuously attached to the human body is determined according to the set threshold.
The method for detecting that a head-mounted smart device is continuously attached to a human body according to claim 46, comprising:

Obtaining, in real time, the pulse information in a certain period of time, when the interval of the pulse is within the set threshold range, determining that the head-mounted smart device is continuously attached to the human body;

Preferably, the pulse information embodied by a part of the human head or the face is acquired.
A method for detecting continuous attachment of a head-mounted smart device to a human body according to claim 46 or 47, wherein a contact or non-contact sensor is used to acquire a pulse of an ear vein or a radial artery;

The non-contact sensor includes at least one camera, and the camera is disposed on a bracket of the head-mounted smart device, and acquires pulse information by detecting a facial image.
The method for detecting that a head-mounted smart device is continuously attached to a human body according to claim 48, comprising:

The face region and the face position coordinates obtained after processing the video containing the color face obtained by the camera are at least divided into the skin color region, the eye region, and the eye region, and the classification is given different weights for each frame of the video. The face area is separated by three color channels, and the spatial mean value is taken for each channel, and the sample data is subjected to independent component analysis ICA processing to obtain pulse information.
The method for detecting that a head-mounted smart device is continuously attached to a human body according to claim 49, further comprising:

An average of the pulse information is analyzed, and a difference between the real-time pulse information value and the average value is calculated;

Comparing the difference with a preset allowable change difference, and determining that the head-mounted smart device is continuously attached to the human body within the allowed change difference.
A computer program comprising computer readable code that, when executed by an electronic device, causes any of claims 9-10, 17-20, 27-29, 38-40, and 46-50 A method of detecting that a head-mounted smart device is continuously attached to a human body as recited in the claims is performed.
A computer readable medium storing the computer program of claim 51.