WO2015109907A1 - Dispositif et procédé de détection de fixation durable de visiocasque intelligent - Google Patents

Dispositif et procédé de détection de fixation durable de visiocasque intelligent Download PDF

Info

Publication number
WO2015109907A1
WO2015109907A1 PCT/CN2014/094297 CN2014094297W WO2015109907A1 WO 2015109907 A1 WO2015109907 A1 WO 2015109907A1 CN 2014094297 W CN2014094297 W CN 2014094297W WO 2015109907 A1 WO2015109907 A1 WO 2015109907A1
Authority
WO
WIPO (PCT)
Prior art keywords
head
smart device
information
human body
mounted smart
Prior art date
Application number
PCT/CN2014/094297
Other languages
English (en)
Chinese (zh)
Inventor
黄晶
Original Assignee
北京奇虎科技有限公司
奇智软件（北京）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201410035697.6A external-priority patent/CN104808771A/zh
Priority claimed from CN201410035786.0A external-priority patent/CN104808773A/zh
Priority claimed from CN201410036713.3A external-priority patent/CN104808779A/zh
Priority claimed from CN201410036298.1A external-priority patent/CN104808776A/zh
Priority claimed from CN201410035753.6A external-priority patent/CN104808772B/zh
Application filed by 北京奇虎科技有限公司, 奇智软件（北京）有限公司 filed Critical 北京奇虎科技有限公司
Publication of WO2015109907A1 publication Critical patent/WO2015109907A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0181—Adaptation to the pilot/driver
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements

Definitions

  • the present invention relates to the field of smart devices and, in particular, to an apparatus and method for detecting that a head mounted smart device is continuously attached to a human body.
  • the head-mounted device can integrate a camera device and a control chip to form a head-mounted smart device (such as a smart glasses device), providing users with rich personalized functions and information.
  • a head-mounted smart device such as a smart glasses device
  • Head-mounted smart devices like smart phones, have an independent operating system, which can be installed by software, games, and other software service providers. It can be added by voice or action to add schedules, map navigation, interact with friends, and take photos. And video, video chat with friends and other functions, and wireless network access through the mobile communication network.
  • human-computer interaction mostly uses human body language to send command signals to the computer, such as sending signals to the computer through the mouse, controlling the game through the body, and using the finger to click on the touch screen
  • the head-mounted smart device can View calendar, time, temperature, geographic location, voice search, video call, identify direction, music play, web search, send and receive text messages by voice, or visual control (such as blinking, nodding, shaking your head, voice) Or e-mail, photo, video and other functions, in addition to the above functions
  • the head-mounted smart device can also interact with the environment to expand the reality, for example: if you see the subway out of service, the head-mounted smart device will display the subway outage The reason and provide an alternative route; if you see a book, you can view the book's book review and price; if you are waiting for a friend, the head-mounted smart device will show the friend's location.
  • the present invention has been made in view of this.
  • the present invention has been made in order to provide an apparatus, method, computer program, and computer readable medium for detecting that a head mounted smart device is continuously attached to a human body that overcomes the above problems or at least partially solves the above problems.
  • a device for detecting that a head-mounted smart device is continuously attached to a human body includes at least an identity consistency information acquisition module and an identity consistency information determination module, and an identity consistency information acquisition module. Obtaining distance information between at least one part of the human head or the face and a corresponding part of the head-mounted smart device, the identity consistency information determining module calculates the distance information and determines whether the head-mounted smart device continues to adhere according to the preset threshold value. On the human body.
  • a method of detecting that a head-mounted smart device is continuously attached to a human body comprising:
  • the distance information is calculated, and whether the head-mounted smart device is continuously attached to the human body is determined according to a preset threshold.
  • a device for detecting that a head-mounted smart device is continuously attached to a human body includes at least an identity consistency information acquiring module and an identity consistency information determining module, and the identity consistency information acquiring module obtains The body temperature information of the human body, the identity consistency information judging module judges whether the head-worn smart device is continuously attached to the human body according to the body temperature information.
  • the body temperature information of the acquired human body is continuous body temperature information within a predetermined time, or a point value of body temperature information acquired in a predetermined period within a predetermined time.
  • a method of detecting that a head-mounted smart device is continuously attached to a human body comprising:
  • the head-mounted smart device is continuously attached to the human body.
  • the acquired body temperature information is continuous body temperature information within a predetermined time, or a point value of body temperature information acquired in a predetermined period within a predetermined time.
  • a device for detecting that a head-mounted smart device is continuously attached to a human body includes at least an identity consistency information acquisition module and an identity consistency information determination module, and an identity consistency information acquisition module. Acquiring the head-mounted smart device to be placed on the weight bearing part of the human body The pressure information, the identity consistency information determining module determines whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the pressure information and the preset threshold.
  • a method of detecting that a head-mounted smart device is continuously attached to a human body comprising:
  • Whether the head-mounted smart device is continuously attached to the human body is determined according to the comparison result of the pressure information and the preset threshold.
  • a device for detecting that a head-mounted smart device is continuously attached to a human body includes at least an identity consistency information acquisition module and an identity consistency information determination module, and an identity consistency information acquisition module. Obtaining image information of at least one part of the human head or the face, the identity consistency information determining module determines whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the image information and the pre-stored standard image information.
  • a method of detecting that a head-mounted smart device is continuously attached to a human body comprising:
  • the acquiring module acquires image information of at least one part of a human head or a face to which the head-mounted smart device is attached;
  • Whether the head-mounted smart device is continuously attached to the human body is determined based on the comparison result of the image information and the pre-stored standard image information.
  • a device for detecting that a head-mounted smart device is continuously attached to a human body includes at least an identity consistency information acquisition module and an identity consistency information determination module, and an identity consistency information acquisition module. Acquiring the pulse information, the identity consistency information determining module calculates the interval of the pulse, and determines whether the head-mounted smart device is continuously attached to the human body according to the set threshold. At least the identity consistency information acquiring module is disposed on the head-mounted smart device.
  • a method of detecting that a head-mounted smart device is continuously attached to a human body comprising:
  • the interval of the pulse is calculated, and it is determined whether the head-mounted smart device is continuously attached to the human body according to the set threshold.
  • a computer program comprising computer readable code that, when executed by an electronic device, causes said detecting head mounted smart device to remain attached to a human body The method is executed.
  • a computer readable medium storing a computer program as described above is provided.
  • FIG. 1 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention
  • FIG. 2a is a block diagram showing the structure of a detecting head-mounted smart device according to an embodiment of the present invention
  • FIG. 2b is a schematic structural diagram of a detecting head-mounted smart device according to an embodiment of the present invention.
  • FIG. 3a is a structural block diagram of a detecting head-mounted smart device according to still another embodiment of the present invention.
  • FIG. 3b is a block diagram showing the structure of a distance sensing module in a head-mounted smart device according to an embodiment of the invention.
  • FIG. 4a is a structural block diagram of a detecting head-mounted smart device according to still another embodiment of the present invention.
  • FIG. 4b is a schematic structural diagram of a detecting head-mounted smart device according to still another embodiment of the present invention.
  • Figure 5 is a flow chart showing the operation of an alarm module according to an embodiment of the present invention.
  • FIG. 6 is a block diagram showing the structure of a detecting head-mounted smart device according to an embodiment of the present invention.
  • FIG. 8 is a structural block diagram of an apparatus 100 for detecting that a head mounted smart device is continuously attached to a human body according to another embodiment of the present invention.
  • FIG. 9 is a structural block diagram of a device for detecting that a head-mounted smart device is continuously attached to a human body according to another embodiment of the present invention.
  • FIG. 10 is a structural block diagram of a device 200 for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention.
  • FIG. 11 is a flow chart showing the operation of an alarm module in a device 200 for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention
  • FIG. 12 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention
  • Figure 13 Method for detecting continuous attachment of a head-mounted smart device to a human body in accordance with an embodiment of the present invention flow chart
  • FIG. 14 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention
  • FIG. 15 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to another embodiment of the present invention.
  • FIG. 16 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention.
  • FIG. 17 is a flow chart showing the operation principle of an alarm module in a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention.
  • FIG. 18 is a schematic structural diagram of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention.
  • FIG. 19 is a flow chart showing a method of detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention
  • 20 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention
  • 21 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to another embodiment of the present invention.
  • FIG. 22 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention.
  • FIG. 23 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention.
  • 24 is a flow chart showing a method of detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention
  • 25 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention
  • 26 is a schematic structural view of a device for detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention
  • FIG. 27 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to another embodiment of the present invention.
  • FIG. 28 is a block diagram showing the structure of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention.
  • 29 is a schematic structural diagram of a device for detecting that a head-mounted smart device is continuously attached to a human body according to still another embodiment of the present invention.
  • FIG. 30 is a schematic diagram of RGB three-color signal sequence data obtained by processing a video having a duration of 30 pulse periods according to another embodiment of the present invention.
  • FIG. 31 is a schematic diagram showing an effect of performing ICA processing on a facial video of a period of 30 pulse periods, and then filtering by arithmetic mean filtering according to another embodiment of the present invention.
  • Figure 32 is a schematic diagram showing the principle of a photoelectric sensor in accordance with one embodiment of the present invention.
  • Figure 33 is a block diagram showing the structure of a photoelectric intelligent pulse measuring system according to an embodiment of the present invention.
  • FIG. 34 is a flowchart of a method for detecting that a head-mounted smart device is continuously attached to a human body according to an embodiment of the present invention
  • Figure 35 shows a block diagram of an electronic device for performing the method of the present invention
  • Figure 36 shows a schematic diagram of a memory unit for holding or carrying program code implementing a method in accordance with the present invention.
  • a device for detecting that a head-mounted smart device is continuously attached to a human body According to an embodiment of the present invention, there is provided a device for detecting that a head-mounted smart device is continuously attached to a human body.
  • the device includes at least an identity consistency information acquiring module 110 and an identity consistency information determining module 120.
  • the identity consistency information acquiring module 110 acquires at least one part of a human head or a face and a head-mounted smart device.
  • the distance information between the corresponding parts, the identity consistency information determining module 120 calculates the distance information and determines whether the head-mounted smart device is continuously attached to the human body according to a preset threshold.
  • the distance information acquired by the identity consistency information acquiring module 110 may also include other distance information, and is not limited to the above-mentioned at least one part of the human head or the face and the head-mounted smart. Distance information between corresponding parts on the device.
  • FIG. 2a is a structural block diagram of the device
  • FIG. 2b is a structural schematic diagram of the device.
  • the device includes a wearing support device 10, a distance sensor 20, and an identity consistency information determining module 120.
  • the distance sensor 20 and the identity consistency information determining module 120 are connected and disposed on the wearing support device 10, and the distance sensor 20 is used.
  • the identity consistency information determining module 120 Obtaining distance information between at least one part of the head or the face of the head-mounted smart device and the corresponding position of the head-mounted smart device, and transmitting the information to the identity consistency information determining module 120, the identity consistency information
  • the determining module 120 compares the received distance information with a preset distance range, and the distance information is within a preset distance range, and then determines that the head-mounted smart device is continuously attached to the human body.
  • the identity consistency information determining module 120 may be disposed on a separate unit outside the wearing support device 10.
  • the wearing support device 10 is worn on the user, and fixes the distance sensor 20 to the detecting portion of the user to continuously detect the distance information between the smart device and the user.
  • the wearing device is worn. 10 is worn on the user's head, which is a glasses-type structure, and the distance sensor 20 is disposed at the front end of the bracket of the glasses.
  • the head-mounted smart device may also be a headset, a hat, a head cover, etc.
  • the head-mounted smart device can further include a display screen, if necessary, in the case of a display screen, the distance sensor 20 transmits the detected distance information to the display screen and displays the distance information through the display screen.
  • the distance information includes continuous distance information within a preset time range or a preset action interval, and may also be a time when the head-mounted smart device performs a certain operation process, or may be a hardware environment such as a power source. All of the time allowed, here, those skilled in the art can make settings according to specific conditions, and the present invention is not specifically limited.
  • FIG. 3a a structural block diagram of a device for detecting that the head mounted smart device is continuously attached to the human body, wherein the identity consistency information acquiring module 110 includes a distance sensing module 111 and a signal.
  • the modulation module 112 and the communication module 113 are connected, and the distance sensing module 111, the signal modulation module 112, and the communication 113 are sequentially and electrically connected.
  • the distance sensing module 111 is configured to sense distance information between the module and the target.
  • the distance sensing module 111 further includes a transmitting unit 114, a receiving unit 115, a calculating unit 116, and a transmitting unit, as shown in FIG. 3b. 114.
  • the receiving unit 115 is electrically connected to the computing unit 116.
  • the transmitting unit 114 is configured to send a distance measurement signal, and the receiving unit 115 is configured to receive the The distance measurement signal reflected by the target is used by the calculation unit 116 to calculate the distance value of the distance sensing module 111 from the target according to the time taken by the distance measurement signal.
  • the transmitting unit 114 is preferably a laser emitter having a laser diode for emitting laser light as a distance measuring signal, but the invention is not limited thereto, and the transmitting unit 114 can also be an infrared emitter.
  • the infrared ray is used as the distance measurement signal, or the transmitting unit 114 may be an ultrasonic transmitter for transmitting the ultrasonic wave as the distance measurement signal, or the distance measurement by other light waves or sound waves, and the calculation unit 116 measures the distance according to different properties. The difference in the propagation speed of the signal in the medium is taken to the corresponding calculation method.
  • the distance sensing module 111 transmits the sensed distance signal to the signal modulation module 112.
  • the signal modulation module 112 amplifies and filters the distance signal and transmits the distance signal to the communication module 113.
  • the communication module 113 will process the distance processed by the signal modulation module 112.
  • the signal is sent to the identity consistency information determining module 120.
  • the identity consistency information determining module 120 compares the received distance signal with a preset threshold distance signal, and determines whether the detected distance information is abnormal according to the comparison result.
  • the identity consistency information determining module 120 further includes a comparator 121, an adjustable resistor 122, and an adjusting component 123, wherein the comparator 121 and the communication module 113 are electrically connected, and receive the distance transmitted by the communication module 113.
  • a signal ie, an electrical signal processed by the signal modulation module 113 and compared with a preset threshold voltage signal, and determining whether the head-mounted smart device is continuously attached to the human body based on the comparison result, for example, when the comparator If the received distance signal exceeds the preset maximum threshold voltage signal or is less than the preset minimum threshold voltage signal, the head-mounted smart device is considered not to be continuously attached to the human body, and if the detected distance is When the signal is continuous, and the distance signal does not exceed the preset maximum threshold voltage signal and is greater than the preset minimum threshold voltage signal, the head-mounted smart device is considered to be continuously attached to the human body.
  • the adjustable resistor 122 is used to adjust the threshold voltage signal. In this embodiment, the resistance value of the adjustable resistor 122 is changed by the adjusting member 123 to adjust the threshold voltage signal.
  • the identity consistency information obtaining module 110 acquires the distance value between the at least one part of the head or the face of the user of the head-mounted smart device and the distance sensor 20 in real time, and the distance value is The preset distance range is compared, and if the distance value falls within the preset distance range, the head-mounted smart device is considered to be continuously attached to the human body because, if the head-mounted smart device is If it is removed, the detected distance value must change significantly, beyond the predetermined range.
  • the detected distance value may be different, so the allowed distance range needs to be set, which can be realized by information acquisition over a period of time, and is adjustable
  • the resistor 122 and the adjustment member 123 are used to achieve a predetermined range of adjustment.
  • another device 200 for detecting that the head-mounted smart device is continuously attached to the human body is continuously attached to the human body with the above-mentioned detecting head-mounted smart device.
  • the device 100 differs in that the device 200 that detects that the head-mounted smart device is continuously attached to the human body further includes an alarm module 40.
  • the alarm module 40 is connected to the identity consistency information determination module 120.
  • the alarm module 40 is connected to the identity consistency information determination module 120 via a communication interface (not shown).
  • the identity consistency information determining module 120 controls the start or stop of the alarm module 40 by comparing the distance signal with the threshold value signal.
  • the comparator 121 compares the distance signal with a preset threshold signal, and when the distance signal is greater than the preset maximum threshold signal, the comparison result output by the comparator 121 is a high level; When the distance signal is less than the preset minimum threshold value signal, the comparison result output by the comparator 121 is a low level.
  • the comparison result of the high level or the low level is transmitted to the alarm module 40, and the alarm module 40 is controlled to start or stop accordingly, and regardless of the type of alarm generated by the alarm module 40, it is considered that the detected distance information is abnormal, possibly
  • the head-mounted smart device leaves the human body, and the user of the head-mounted smart device may change, and in either case, it is unfavorable for the user to operate safely, so it needs to be avoided as much as possible.
  • the identity consistency information determining module 120 configures two 10-pins that receive the comparison result as a PA interrupt pin and a PB interrupt pin, wherein the PA is a falling edge causing an interrupt, and PB is A rising edge causes an interruption.
  • the identity consistency information determining module 120 first determines the source of the interruption. If it is derived from the PA and continuously monitors the low level for a certain period of time, the distance signal of the detected subject is considered to be lower than the preset. The minimum threshold, the identity consistency information judging module 120 issues a close-range reminder, and controls the alarm module 40 to issue a close-range alarm signal; if it returns to the high level during this time, the previous low level is regarded as an isolated value.
  • the interruption originates from the PB, and the high level is continuously monitored for a certain period of time, it is considered that the detected distance information rises above a preset maximum threshold value, and the identity consistency information determining module 120 issues a remote distance reminder. And controlling the alarm module 40 to issue a long-distance alarm signal; if it returns to a low level within this time, it is regarded as the isolated high level as an isolated value, and is not considered to be an abnormal situation.
  • the PA and PB pins are configured as corresponding interrupt functions, and their module interrupts are enabled (implemented through configuration registers).
  • the PA and PB are interrupted, it indicates that the detected distance information is abnormal, that is, it is necessary to analyze whether the head-mounted smart device is continuously attached to the human body and decide whether to alarm.
  • the interrupt needs to be opened, that is, the identity consistency information determination module 120 is allowed to process the maskable interrupt (also implemented by the configuration register).
  • the identity consistency information judging module 120 enters the low power mode, is in a state of waiting for the interrupt to wake up, and the specific implementation is also through the configuration register. Waiting for the interrupt, this state will remain until the interrupt request is generated, so after waiting for the interrupt, it will start processing the interrupt request. It is.
  • data monitoring is performed for a period of time to determine whether the detected distance information is abnormal.
  • the identity consistency information determining module 120 simultaneously processes the distance information and can display it through the display screen.
  • connection between the alarm module 40 and the identity consistency information determining module 120 can also be implemented by wire or wirelessly.
  • the alarm module 40 and the identity consistency information determining module 120 are implemented through the Internet. Communication connection.
  • the alarm module 40 can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm.
  • the alarm module 40 can be disposed on the head-mounted smart device or on the processing unit independent of the head-mounted smart device.
  • the apparatus for detecting that the head mounted smart device is continuously attached to the human body is provided.
  • the identity consistency information acquiring module 110 includes a distance sensor 61 and a signal conditioning circuit 62.
  • the output end of the distance sensor 61 is connected to the input end of the signal conditioning circuit 62.
  • the identity consistency information determining module 120 includes a signal analysis processing module 71 and a comparison module 72.
  • the signal conditioning circuit 62 is connected to the signal analysis processing module 71 for The distance signal acquired by the distance sensor 61 is converted into an electrical signal recognizable by the signal analysis processing module 71, and the signal analysis processing module 71 analyzes the average value of the distance information received within a predetermined period of time, and calculates the distance received in real time.
  • the difference between the information and the average value, the signal indicating the difference is sent to a comparison module 72, and the comparison module 72 compares the difference with a preset allowable change difference within the allowed variation difference. It is determined that the head-mounted smart device is continuously attached to the human body, and conversely, the head-mounted smart device is not continuously attached to the human body.
  • signal conditioning circuit 62 is operative to transform the analog signal into a digital signal for data acquisition, control processes, performing computational display readout, or other purposes.
  • the distance sensor 61 measures the distance information of the user, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current or resistance change, and therefore must be amplified and buffered before being converted into a digital signal. Or scaling the analog signal, etc., that is, the conditioning process, making it suitable for the input of an analog-to-digital converter (ADC). Then, the ADC digitizes the analog signal and sends the digital signal to the MCU or other digital device for use. Data processing in the system.
  • ADC analog-to-digital converter
  • the identity consistency information determining module 120 may be disposed on the head mounted smart device, or may be disposed on a processing unit other than the head mounted smart device, and Headset smart devices are connected via wireless devices such as wifi and Bluetooth.
  • a method of detecting that a head-mounted smart device is continuously attached to a human body is also provided.
  • the method includes:
  • Step S710 Obtain distance information between at least one part of the human head or the face to which the head-mounted smart device is currently attached and the corresponding part on the head-mounted smart device;
  • Step S720 calculating the distance information, and determining whether the head-mounted smart device is continuously attached to the human body according to the preset threshold.
  • the distance information includes distance information within a preset time range. When the distance information is within the set threshold range, it is determined that the head-mounted smart device is continuously attached to the human body.
  • calculating the distance information and determining whether the head-mounted smart device is continuously attached to the human body according to the preset threshold includes:
  • the acquired distance information may also include other distance information, and is not limited to the foregoing between the at least one part of the human head or the face and the corresponding part of the head-mounted smart device. Distance information.
  • the acquired distance signal is converted into an electrical signal, and the difference between the electrical signal and the pre-stored electrical signal representing the average distance information is calculated, and the difference is compared with a pre-stored electrical signal indicating the allowable change difference.
  • the acquired distance information may be distance information within a preset time period, or may be distance information between predetermined actions.
  • the purpose of acquiring the distance information is to ensure that the user is performing an operation.
  • the head-mounted smart device is continuously attached to the human body. Therefore, the distance information can be acquired along with the progress of an operation, and the information can be continuously obtained.
  • the present invention is not specifically limited.
  • the distance information that is learned in real time and the preset distance value or the preset distance range may be used to determine whether the head-mounted smart device is continuously attached to the human body, wherein the preset distance value or the preset distance range may be The information is collected and acquired in advance by the average distance between the smart device and the user, so as to determine whether the smart device is continuously attached to the human body, for example, the following scenario:
  • the identity of the user can also be verified by means of iris information recognition, and the opening of the file can be controlled by eye movements such as blinking or blinking of the user. , closing, or fast forward, rewind, flipping up and down, etc.
  • the device is continuously attached to the human body by the above method.
  • the smart device is smart glasses, and the user wears the glasses. View the video, or the document, after passing the user identity authentication, after opening the file, if the smart glasses are taken down or transferred to another person's head, it is detected by the identity consistency information judgment module. If the distance information is discontinuous or generates fluctuations beyond the predetermined range, a close command is sent to the play end of the video or the open end of the document, and the video being played, or the document being viewed is closed, thereby largely protecting User's privacy.
  • the above-mentioned head-mounted smart device may be glasses, a hat, a headphone, a head cover, and the like.
  • the head-mounted smart device when used for the first time, or the smart device needs to be replaced, the user identity information needs to be collected, and the function may be implemented by the identity consistency information acquiring module, or The information acquisition module is newly added.
  • the information acquisition module When the module receives the information collection instruction, it needs a certain time (for example, 3 minutes) to read and save the user identity information. During this time, the module reads continuously.
  • the distance information between the smart device and the user and records the overall change trend of the distance information during the time period, and determines the fluctuation range of the distance information according to the change trend. Under normal circumstances, a human distance may occur.
  • the information changes drastically at one or more time points beyond the fluctuation range, but as long as the duration of the dramatic change is very short, or only occurs at a point in time, and the change is restored, the overall trend of the information changes. Did not If there is a change, the situation is still considered to be the verification condition.
  • the technical solution of the present invention can be further applied to other fields such as medicine, supervision, and the like.
  • the smart device has a power saving protection device. If the identity consistency information acquiring module continuously monitors the distance information within a predetermined time (for example, 5 minutes), the default is When the head-mounted smart device leaves the human body, it automatically enters a sleep state.
  • a predetermined time for example, 5 minutes
  • Embodiments of the present invention also provide another means of detecting that a head-mounted smart device is continuously attached to a human body.
  • the device includes at least an identity consistency information acquiring module 110 and an identity consistency information determining module 120.
  • the identity consistency information acquiring module 110 acquires body temperature information of the human body, and the identity consistency information determining module 120 obtains the The body temperature information determines whether the head-mounted smart device is continuously attached to the human body.
  • the body temperature information of the acquired human body is continuous body temperature information within a predetermined time, or a point value of body temperature information acquired in a predetermined period within a predetermined time.
  • the identity consistency information obtaining module 110 is a contact type or non-contact body temperature measuring sensor.
  • the identity consistency information acquiring module 110 may also acquire other temperature information than the body temperature information of the human body, and is not limited to the body temperature information of the human body.
  • the identity consistency information obtaining module 110 is a non-contact body temperature measuring sensor
  • the head-mounted smart device is a glasses-type structure
  • the body temperature measuring sensor is disposed on the bracket of the glasses
  • the contact type body temperature measuring sensor may be provided on the nose pad of the smart glasses, and the mounting position of the sensor is not specifically limited.
  • the device 100 for detecting the continuous attachment of the head-mounted smart device to the human body is shown in FIG. 8 , which is a structural block diagram of the device, and FIG. 2 b is a schematic structural view of the device, and the device includes the wearing support device 10 .
  • a body temperature measuring sensor 21 and an identity consistency information determining module 120 wherein the body temperature measuring sensor 21 and the identity consistency information determining module 120 are connected and disposed on the wearing support device 10, and the body temperature measuring sensor is used to acquire the head mounted smart device.
  • the user's body temperature information is transmitted to the identity consistency information determining module 120.
  • the identity consistency information determining module 120 determines whether the head-mounted smart device is continuously attached to the human body based on the received body temperature information.
  • the identity consistency information determining module 120 can be disposed on a separate unit other than the wearing support device.
  • the identity consistency information determining module 120 may include a signal analysis processing module (not shown) and a comparison module (not shown), and the signal analysis processing module analyzes a predetermined time. The average value of the temperature detected in the interval, and the difference between the temperature value obtained in real time and the average value is calculated, and the comparison module compares the difference with the preset allowable change difference range, and the difference is allowed to change. Within the difference range, it is determined that the head-mounted smart device is continuously attached to the human body.
  • the wearing support device 10 is worn on the user, and fixes the body temperature measuring sensor 21 to the detecting portion of the user to continuously detect the body temperature information of the user.
  • the wearing support device 10 is worn on the user's head.
  • the head-mounted smart device can also be an earphone, a hat, a head cover, etc., as long as the body temperature measuring sensor can be fixed in positional relationship with respect to the user's detecting portion.
  • the head-mounted smart device may further include a display screen, and if there is a display screen, the body temperature measurement sensor 21 transmits the detected body temperature information to the display screen, and displays the use through the display screen. Body temperature information.
  • a structural block diagram of a device for detecting that a head mounted smart device is continuously attached to a human body wherein the identity consistency information acquiring module 110 includes an optical probe 117 , a photoelectric conversion module 118 , The signal modulation module 112, and the optical probe 117, the photoelectric conversion module 118, and the signal modulation module 112 are sequentially electrically connected.
  • the optical probe 117 corresponds to the detection site of the user, such as the forehead, to detect the body temperature information of the user, and to sense the body temperature of the user.
  • the optical probe 117 transmits the detected body temperature signal to the photoelectric conversion module 118, and the body temperature signal is converted into an electrical signal via the photoelectric conversion module 118 and transmitted to the signal modulation module 112, and the signal modulation module 112 amplifies and filters the electrical signal to be transmitted to the identity.
  • the consistency information judging module 120 compares the received electrical signal with a preset threshold voltage signal, and determines whether the detected temperature information is abnormal according to the comparison result.
  • the identity consistency information determining module 120 further includes a calculating module 124, a comparator 121, an adjustable resistor 122, and an adjusting component 123.
  • the computing module 124 and the signal modulation module 112 are electrically connected, and receive signals.
  • the body temperature signal transmitted by the modulation module 112 ie, the electrical signal processed by the photoelectric conversion module 22 and the signal modulation module 23
  • the comparator 121 compares the difference with a preset threshold voltage signal range, and determines whether the head-mounted smart device is continuously attached to the human body according to the comparison result, for example, when the comparator 121 receives When the difference signal exceeds the maximum threshold value of the preset allowable change difference, it is considered that the head-mounted smart device does not continuously adhere to the human body. Conversely, if the detected body temperature signal is continuous, and the difference signal is smaller than the preset The maximum critical value of the allowable change difference is considered to be that the head-mounted smart device continues to adhere to the human body.
  • the adjustable resistor 122 is used to adjust the electrical signal corresponding to the maximum critical value of the preset allowable change difference.
  • the resistance of the adjustable resistor 32 is changed by the adjusting member 33.
  • the electrical signal corresponding to the maximum critical value mentioned above may have different body temperature information due to different body qualities. Therefore, the first use of the smart device or the replacement of the smart device may be required.
  • the user's body temperature information is first collected, and an adjustable resistor is applied, and the maximum value of the user's body temperature allowable change difference is set according to the pre-acquired user's body temperature information, and/or Body temperature range.
  • the identity consistency information determining module 120 may also compare the body temperature information received in real time with a preset body temperature range, and determine whether the head-mounted smart device is continuously attached to the human body according to the comparison result. on.
  • the apparatus 200 for detecting that the head mounted smart device is continuously attached to the human body further includes an alarm module 40.
  • the alarm module 40 is connected to the identity consistency information determination module 120.
  • the alarm module 40 is connected to the identity consistency information determination module 120 via a communication interface (not shown).
  • the identity consistency information determining module 120 controls the start or stop of the alarm module 40 by the received comparison of the electrical signal representing the real-time body temperature information with the preset range of the electrical signal representing the body temperature range.
  • the output comparison result is a high level; when the received real-time body temperature information is received When the electrical signal is less than the preset minimum threshold value in the range of the electrical signal indicating the body temperature range, the comparison result of the output is a low level, and the above two level signals control the alarm module 40 to start an alarm.
  • the identity consistency information determining module 120 configures two 10-pins that receive the comparison result as a PA interrupt pin and a PB interrupt pin, wherein the PA is a falling edge causing an interrupt, and PB is A rising edge causes an interruption.
  • the identity consistency information determining module 120 first determines the source of the interruption. If it is derived from the PA and continuously monitors the low level for a certain period of time, the electrical signal representing the real-time body temperature information is considered to be less than the preset body temperature.
  • the identity consistency information determining module 120 issues a low temperature alarm and controls the alarm module 40 to issue a low temperature alarm signal; if it returns to the high level during this time, it is regarded as The previous low level is an isolated value and is not considered an abnormal condition.
  • the processing module 40 issues a high temperature alarm and controls the alarm module 40 to issue a high temperature alarm signal; if it returns to a low level during this time, it is considered that the previous high level is an isolated value and is not considered an abnormal condition.
  • the PA and PB pins are configured as corresponding interrupt functions, and their module interrupts are enabled (implemented through configuration registers).
  • the PA and PB are interrupted, it indicates that the detected body temperature information is abnormal, that is, whether the head-mounted smart device is continuously attached to the human body, or whether the head-mounted smart device needs to be continuously attached. On the human body, and decide whether or not to call the police.
  • the interrupt needs to be opened, that is, the identity consistency information judging module 120 is allowed to process the maskable Interrupts (also implemented through configuration registers).
  • the identity consistency information judging module 120 enters the low power mode, is in a state of waiting for the interrupt to wake up, and the specific implementation is also through the configuration register. Waiting for an interrupt will continue until the interrupt request is generated, so wait for the interrupt and start processing the interrupt request.
  • data monitoring is performed for a period of time to determine whether the detected body temperature information is abnormal.
  • the identity consistency information determining module 120 simultaneously processes the body temperature information and can display it through the display screen.
  • the alarm module 40 can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm.
  • the alarm module 40 can be disposed on the head-mounted smart device, or can be disposed on the processing unit independent of the head-mounted smart device, and is communicatively connected to the head-mounted smart device.
  • connection between the alarm module 40 and the identity consistency information determining module 120 can also be implemented by wire or wirelessly.
  • the alarm module 40 and the identity consistency information determining module 120 are connected through the Internet.
  • the above-mentioned device for detecting that the head-mounted smart device is continuously attached to the human body has the following advantages: First, by wearing the support device 10 worn on the subject, long-term automatic continuous body temperature detection of the subject can be realized; The device is safe to use, and can avoid the hidden dangers of the traditional mercury thermometer; third, the device is easy to wear, can be remotely monitored, and does not need manual measurement; fourth, the scope of application is wide, according to the user's physical difference, The threshold signal is adjusted accordingly so that different measurements can be made for different individuals.
  • the identity consistency information acquiring module 110 includes an integrated temperature measuring sensor 63, and a signal.
  • the conditioning circuit 62, the output of the body temperature measuring sensor 63 is connected to the input end of the signal conditioning circuit 62, and the identity consistency information determining module 120 includes a signal analysis processing module 71 and a comparison module 72, wherein the output and signal of the signal conditioning circuit 62
  • the input end of the analysis processing module 71 is electrically connected for converting the received body temperature signal into an electrical signal recognizable by the signal analysis processing module, and the signal analysis processing module 71 receives the electrical signal indicating the current temperature information sent by the signal conditioning circuit 62.
  • the difference between the difference module and the preset allowable change difference is determined to be that the head-mounted smart device is continuously attached to the human body within the allowable change difference, and vice versa. Smart devices are not continuously attached to the human body.
  • signal conditioning circuit 62 is operative to transform the analog signal into a digital signal for data acquisition, control processes, performing computational display readout, or other purposes.
  • the body temperature measuring sensor 63 measures the user's body temperature information, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current, or resistance change, and therefore must be amplified before being converted into a digital signal. Buffering or scaling analog signals, etc., which is the conditioning process, making it suitable for the input of an analog-to-digital converter (ADC).
  • ADC analog-to-digital converter
  • the ADC then digitizes the analog signal and sends the digital signal to an MCU or other digital device. Used for data processing of the system.
  • the identity consistency information determining module 120 may also allow the real-time acquired body temperature information and the preset body temperature information to be allowed when the head-mounted smart device is continuously attached to the human body according to the body temperature information.
  • the fluctuation range is compared, and in the case that the currently received body temperature information falls within the preset allowable fluctuation range of the body temperature information, it is determined that the head-mounted smart device is continuously attached to the human body.
  • the identity consistency information determining module 120 may be disposed on the head mounted smart device, or may be disposed on a processing unit other than the head mounted smart device, and Headset smart devices are connected via wireless devices such as wifi and Bluetooth.
  • a method of detecting that a head-mounted smart device is continuously attached to a human body is also provided.
  • the method includes:
  • Step S1310 Obtain body temperature information of the human body to which the head-mounted smart device is currently attached.
  • the step may also obtain other temperature information other than the body temperature information of the human body, and Limited to body temperature information of the human body.
  • Step S1320 Determine, according to the acquired body temperature information, whether the head-mounted smart device is continuously attached to the human body.
  • the acquired body temperature information is continuous body temperature information within a predetermined time, or a point value of body temperature information acquired in a predetermined period within a predetermined time.
  • determining whether the head-mounted smart device is continuously attached to the human body according to the acquired body temperature information includes:
  • determining whether the head-mounted smart device is continuously attached to the human body according to the acquired body temperature information includes:
  • the difference is compared with a preset allowable change difference range, and it is determined that the head-mounted smart device is continuously attached to the human body within the range of the allowable change difference.
  • the received body temperature information number is converted into an electrical signal, and the electrical signal is compared with a pre-stored range of electrical signals indicating a range of allowable change differences.
  • determining whether the head-mounted smart device is continuously attached to the human body according to the acquired body temperature information includes:
  • Whether the head-mounted smart device is continuously attached to the human body is determined according to the body temperature value of the human body between a certain time or the set action interval and the preset fluctuation range of the body temperature.
  • the obtained body temperature value is compared with a preset fluctuation range of the body temperature, and in a case where the body temperature value is within a preset fluctuation range of the body temperature, it is determined that the head-mounted smart device is continuously attached to the human body.
  • other temperature information than the body temperature information of the human body described above may be acquired according to a specific case, and is not limited to the body temperature information of the human body.
  • the identity of the user can also be verified by means of iris information recognition, and the opening of the file can be controlled by eye movements such as blinking or blinking of the user. , close, or fast forward, rewind, page up and down, etc.
  • the smart device is smart glasses, and the user wears the glasses to view the video or the document, and after passing the user identity authentication, the user opens.
  • the user's body temperature information detected by the identity consistency information determining module is discontinuous or generates fluctuations exceeding a predetermined range. Sending a close command to the play end of the video or the open end of the document, closing the video being played, or the document being viewed, thus largely protecting the privacy of the user.
  • the above-mentioned head-mounted smart device may be glasses, a hat, a headphone, a head cover, and the like.
  • the user identity information needs to be collected, and the function may be implemented by the identity consistency information acquiring module, or The new information collection module, in the case that the module receives the information collection instruction, requires a certain time (for example, 3 minutes) to read and save the user identity information. During this time, the module continuously reads the current The body temperature information of the user, and records the overall trend of the body temperature information during the time period, and determines the fluctuation range of the body temperature information according to the change trend, and saves to the user identity information library corresponding to the current user identity.
  • the new information collection module in the case that the module receives the information collection instruction, requires a certain time (for example, 3 minutes) to read and save the user identity information. During this time, the module continuously reads the current The body temperature information of the user, and records the overall trend of the body temperature information during the time period, and determines the fluctuation range of the body temperature information according to the change trend, and saves to the user identity information library corresponding to the current user identity.
  • the identity consistency information judging module compares the difference between the body temperature information of the user of the head-mounted smart device received in real time and the average body temperature with the fluctuation range of the body temperature information stored in the user identity information database, and according to the comparison result Determining whether the head-mounted smart device is continuously attached to the human body.
  • the human body temperature information may change drastically at one or more time points beyond the fluctuation range, but as long as the drastic change continues The time is very short, or it is only a point in time, and after the change is restored, the overall change trend of the information has not changed, and the situation is still considered to be the verification that the head-mounted smart device is continuously attached to the human body. .
  • the technical solution of the present invention can be further applied to other fields such as medicine, supervision, and the like.
  • the head-mounted smart device provided by the embodiment of the present invention has a power-saving protection device. If the body temperature information is not continuously monitored within a predetermined time length (for example, 5 minutes), the head-mounted smart device leaves the human body by default. Automatically enters the sleep state.
  • a predetermined time length for example, 5 minutes
  • Embodiments of the present invention also provide another means of detecting that a head-mounted smart device is continuously attached to a human body.
  • the device includes at least an identity consistency information acquiring module 110 and an identity consistency information determining module 120.
  • the identity consistency information acquiring module 110 obtains pressure information of a weight-bearing part of the human body on the human body.
  • the identity consistency information determining module 120 determines whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the pressure information and the preset threshold.
  • the identity consistency information acquiring module 110 acquires the pressure information in a certain period of time in real time, and determines that the head-mounted smart device is continuously attached to the human body when the pressure information is within the set threshold range.
  • the time period for obtaining the pressure information is not limited to the foregoing certain time, and may be within a time period during which the head-mounted smart device performs a certain operation process, or may be allowed in a hardware environment such as a power source. There are no special restrictions on the entire time.
  • the pressure information acquired by the identity consistency information acquiring module is not limited to the pressure information of the above-mentioned head-mounted smart device disposed on the weight-bearing portion of the human body, and may also include the head-mounted type. Pressure information received by the pressure sensing module of the smart device, or other pressure information.
  • a device for detecting that a head-mounted smart device is continuously attached to a human body detects pressure information of a load-bearing portion of a human body by detecting a head-mounted smart device. And determining whether the head-mounted smart device is continuously attached to the human body.
  • FIG. 14 and FIG. 2b show a device 100 for detecting that a head-mounted smart device is continuously attached to a human body
  • FIG. 14 is a structural block diagram of the device
  • FIG. 2b is a structural schematic view of the device, the device including a wearing support device. 10
  • the pressure sensor 22, the identity consistency information determining module 120, the pressure sensor 22 and the identity consistency information determining module 120 are connected and disposed on the wearing support device 10, wherein the pressure sensor 22 is used to acquire the head-mounted smart device
  • the pressure information is set in the weight bearing portion of the human body, and the pressure information is converted into an electrical signal and transmitted to the identity consistency information determining module 120.
  • the identity consistency information determining module 120 receives the electrical signal indicating the pressure information of the bearing portion and the prior The set representation indicates that the range of electrical signals within the pressure range is allowed to be compared, and in the case where the electrical signal representing the pressure information of the load-bearing portion falls within the range of the electrical signal indicating the allowable pressure range, it is determined that the head-mounted smart device is continuously attached to On the human body, otherwise, it is determined that the head-mounted smart device does not continuously adhere to the human body.
  • the wearing support device 10 is worn on the user, and the pressure sensor 22 is fixed to the detecting portion of the user to continuously detect the pressure information of the head-mounted smart device disposed on the weight-bearing portion of the human body, for example, wearing
  • the support device 10 is worn on the head of the subject, which is a glasses-type structure, and the pressure sensor 22 is disposed on a nose pad of the glasses.
  • the head-mounted smart device can also be an earphone, a cap, a head cover, etc., as long as the pressure sensor 22 can be fixed to the user's detection site.
  • the head-mounted smart device may further include a display screen, and if there is a display screen, the pressure sensor 22 transmits the detected pressure information to the display screen, and displays the pressure information through the display screen. .
  • a structural block diagram of a device for detecting that a head mounted smart device is continuously attached to a human body wherein the identity consistency information acquiring module 110 includes: a pressure collecting module 1132 Data processing module 1131, communication module 113. among them,
  • the pressure collection module 1132 is designed to be placed in a cushion shape to the head-mounted smart device for monitoring the pressure of the load bearing portion of the user.
  • the head-mounted smart device is smart glasses, and the nose pads of the smart glasses are made of a thin plastic material, and two pressure sensitive devices are mounted on a side thereof facing the nose of the user. Resistor FSR, one for each of the two nose pads.
  • the data processing module 1131 collects the data information obtained from the pressure acquisition module 1132.
  • the module consists of a microprocessor-based board that contains a low-power, high-performance 8-bit AVR microprocessor, the ATmega16L, peripheral components (resistors, capacitors, etc.) and power supplies.
  • a digital signal ie, a converter that converts the obtained pressure analog signal information into a digital signal
  • the microprocessor has a clock frequency of 8MHz. All circuits operate at 5V and are supplied by the LM78L55 voltage divider and a 7.4V lithium battery.
  • the module is simple and lightweight, can be connected to the pressure acquisition module 1132 via a line, and is easy to integrate with a head-mounted smart device.
  • the communication module 113 is configured to transmit the digital signal processed by the microprocessor-based data processing module 1131 to the identity consistency information determining module 120 in real time.
  • the digital signal referred to is a digital electrical signal.
  • a wireless transmission method with a high sampling rate can be employed. Therefore, a low power consumption radio communication module GW100B (having a size of 56 mm x 28 mm x 7 mm) is selected.
  • the radio transmitter and receiver are respectively connected to the microprocessor based data processing module and the background.
  • the transmission distance can reach 5m in the case of barrier-free conditions.
  • the forward error correction processing of the GW 100B achieves a low error rate, making the entire system reliable, and in other embodiments, a wired transmission method can also be employed.
  • the identity consistency information determining module 120 compares the voltage signal corresponding to the pressure change difference detected in real time with the voltage signal range corresponding to the preset critical change difference range, and determines the detected according to the comparison result. Whether the pressure information is abnormal.
  • the identity consistency information determining module 120 includes a signal analysis processing module 71 and a comparison module 72.
  • the signal analysis processing module 71 calculates an electrical signal converted into real-time acquired pressure information and a pre-stored representation. Comparing the difference between the electrical signals of the average of the pressure information acquired over a period of time, the comparison module 72 compares the difference with a preset allowable change difference, and within the allowable change difference, the head is determined to be the head
  • the wearable smart device is continuously attached to the human body. On the contrary, the smart smart device is not continuously attached to the human body.
  • the comparison module 72 can also obtain the power information indicating the pressure information value in real time.
  • the signal is compared with the maximum value and the minimum value of the electrical signal converted from the acquired pressure information, and the electrical signal representing the pressure information value acquired in real time is greater than the maximum value or smaller than the electrical signal converted by the acquired pressure information.
  • the acquired pressure information is converted into the minimum value of the electrical signal, it is considered that the head-mounted smart device does not continuously adhere to On the human body.
  • another device 200 for detecting that the head-mounted smart device is continuously attached to the human body is continuously attached to the human body with the above-mentioned detecting head-mounted smart device.
  • the device 100 differs in that the device 200 that detects that the head-mounted smart device is continuously attached to the human body further includes an alarm module 40.
  • the alarm module 40 is connected to the identity consistency information determination module 120.
  • the alarm module 40 is connected to the identity consistency information determination module 120 via a communication interface (not shown).
  • the identity consistency information determining module 120 controls the start or stop of the alarm module 40 by the received voltage signal representing the pressure information monitored in real time and the previously set voltage signal range corresponding to the allowable pressure range.
  • the comparison result output by the comparison module 72 is a high level signal, when real time is expressed.
  • the comparison result output by the comparison module 72 is a low level signal, the high level signal, or a low level
  • the flat signal is transmitted to the alarm module 40 and the alarm module 40 is controlled to start or stop accordingly.
  • the alarm module 40 configures two 10-pins that receive the comparison result as a PA interrupt pin and a PB interrupt pin, wherein PA is a falling edge causing an interrupt, and PB is a rising edge causing an interrupt. .
  • the alarm module 40 first determines the source of the interruption. If it is derived from the PA and continuously monitors the low level for a certain period of time, the voltage signal representing the value monitored in real time is considered to be less than the preset allowable pressure range.
  • the alarm module 40 issues a low pressure alarm signal for the minimum threshold value in the corresponding voltage signal range; if it returns to the high level during this time, it is regarded as the isolated low level as an isolated value, and is not considered to be an abnormal situation.
  • the alarm module 40 sends a high pressure alarm signal; if it returns to the low level within this time, it is regarded as the isolated high level as an isolated value, and is not considered to be an abnormal situation, in the above two cases Any occurrence occurs that the head-mounted smart device is not continuously attached to the human body.
  • the PA and PB pins are configured as corresponding interrupt functions, and their module interrupts are enabled (implemented through configuration registers).
  • the PA and PB are interrupted, it indicates that the detected pressure information is abnormal, that is, it is necessary to analyze whether the head-mounted smart device is continuously attached to the human body and decide whether to alarm.
  • the interrupt needs to be opened, that is, the identity consistency information determination module 120 is allowed to process the maskable interrupt (also implemented by the configuration register).
  • the identity consistency information determining module 120 enters the low power mode, In the state of waiting for the interrupt to wake up, the specific implementation is also through the configuration register. Waiting for an interrupt will continue until the interrupt request is generated, so wait for the interrupt and start processing the interrupt request.
  • data monitoring is performed for a period of time to determine whether the monitored pressure information is abnormal.
  • the identity consistency information determining module 120 simultaneously processes the pressure information and can display it through the display screen.
  • connection between the alarm module 40 and the identity consistency information determining module 120 can also be implemented by wire or wirelessly.
  • the alarm module 40 and the identity consistency information determining module 120 are implemented through the Internet. Communication connection.
  • the alarm module 40 can be an audible alarm (such as a buzzer) or an optical alarm (such as a strobe light), or a combination of an audible alarm and an optical alarm.
  • the alarm module 40 can be disposed on the head-mounted smart device or on the processing unit independent of the head-mounted smart device.
  • the identity consistency information acquisition module 110 includes a pressure measurement sensor 64, a signal conditioning circuit 62, and an output of the pressure measurement sensor 64 and an input of the signal conditioning circuit 62.
  • the identity consistency information judging module 120 includes a signal analysis processing module 71 and a comparison module 72.
  • the signal conditioning circuit 62 is connected to the signal analysis processing module 71 for converting the received pressure information number into a signal analysis processing module 71.
  • the electrical signal the signal analysis processing module 71 analyzes the average value of the electrical signal converted into the pressure information acquired in a predetermined period of time, and calculates the difference between the electrical signal representing the real-time pressure information value and the average value, and the comparison module 72 comparing the difference with the preset allowable change difference, and determining that the head-mounted smart device is continuously attached to the human body within the allowable change difference; otherwise, the head-mounted smart device is not continuously attached. On the human body.
  • signal conditioning circuit 62 is used to transform the analog signal into a digital signal for data acquisition, control processes, performing computational display readout or other purposes.
  • the pressure measuring sensor 64 measures the pressure information, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current or resistance change, and therefore must be amplified, buffered or fixed before being converted into a digital signal.
  • the analog signal, etc. is the conditioning process, making it suitable for the input of an analog-to-digital converter (ADC).
  • ADC analog-to-digital converter
  • the ADC then digitizes the analog signal and sends the digital signal to the MCU or other digital device for use in the system. Data processing.
  • the identity consistency information determining module 120 may be disposed on the head-mounted smart device, or may be disposed on a processing unit independent of the head-mounted smart device, and wirelessly through wifi, Bluetooth, and the like.
  • the device is in communication with the head-mounted smart device.
  • a method of detecting that a head-mounted smart device is continuously attached to a human body is also provided.
  • the method includes:
  • Step S1910 Obtain pressure information of the head-mounted smart device disposed on the weight bearing portion of the human body;
  • Step S1920 determining whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the pressure information and the preset threshold.
  • the pressure information is acquired for a certain period of time, and when the pressure information is within the corresponding set threshold range, it is determined that the head-mounted smart device is continuously attached to the human body.
  • determining whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the pressure information and the preset threshold includes:
  • the average value of the electrical signal converted into the pre-acquired pressure information is analyzed, and the difference between the real-time pressure information value and the average value is compared, and the difference is compared with the preset allowable change difference, and the allowable change difference is It is recognized that the head-mounted smart device is continuously attached to the human body.
  • the received pressure information is converted into an electrical signal in real time.
  • the acquired pressure information is not limited to the pressure information of the head-mounted smart device disposed on the weight-bearing portion of the human body, and may also include the pressure sensing module of the head-mounted smart device. Pressure information received, or other pressure information.
  • the identity of the user can also be verified by means of iris information recognition, and the opening of the file can be controlled by eye movements such as blinking or blinking of the user. , closing, or fast forward, rewind, flipping up and down, etc.
  • the device is continuously attached to the human body by the above method.
  • the smart device is smart glasses, and the user wears the glasses. View the video, or the document, after passing the user identity authentication, after opening the file, if the smart glasses are taken down or transferred to another person's head, it is detected by the identity consistency information judgment module. If the pressure information is discontinuous or generates fluctuations beyond the predetermined range, a shutdown command is sent to the playing end of the video or the open end of the document, and the video being played, or the document being viewed is closed, thereby largely protecting User's privacy.
  • the above-mentioned head-mounted smart device may be glasses, a hat, a headphone, a head cover, and the like.
  • the head-mounted smart device when used for the first time, or the smart device needs to be replaced, the user identity information needs to be collected, and the function may be implemented by the identity consistency information acquiring module, or The new information collection module, in the case that the module receives the information collection instruction, requires a certain time (for example, 3 minutes) to read and save the user identity information. During this time, the module continuously reads the current The pressure information of the load-bearing part of the user, and record the overall change trend of the pressure information during the time period, and determine the fluctuation range of the pressure information according to the change trend.
  • the new information collection module in the case that the module receives the information collection instruction, requires a certain time (for example, 3 minutes) to read and save the user identity information. During this time, the module continuously reads the current The pressure information of the load-bearing part of the user, and record the overall change trend of the pressure information during the time period, and determine the fluctuation range of the pressure information according to the change trend.
  • the pressure information of the person may appear in one, Or a sharp change occurs at a plurality of time points beyond the fluctuation range, but as long as the duration of the drastic change is very short, or is only a point in time, and the change is restored, the overall trend of the information does not change, It is still considered that the situation is to satisfy the verification that the head-mounted smart device is continuously attached to the human body. .
  • the pressure information acquired by the pressure information acquiring module may be pressure information before or after an eye movement or for a period of time including the eye motion. It may also be pressure information within a time period between two or more eye movements.
  • the purpose of detecting the pressure information is to ensure that the user or the smart device is not replaced during the action instruction. Since it is not removed, as long as the eye movement of the user is detected, it is necessary to continuously detect the pressure information, and the time point and length of time for detecting the pressure information are not excessively limited.
  • the technical solution of the present invention can be further applied to His field, such as medicine, supervision, etc.
  • the smart device has a power saving protection device. If the identity consistency information acquiring module continuously detects the pressure information within a predetermined time (for example, 5 minutes), the headset is defaulted. The smart device leaves the human body and automatically goes to sleep.
  • a predetermined time for example, 5 minutes
  • a device for detecting that a head-mounted smart device is continuously attached to a human body According to an embodiment of the present invention, there is provided a device for detecting that a head-mounted smart device is continuously attached to a human body.
  • the device includes at least an identity consistency information acquiring module 110 and an identity consistency information determining module 120.
  • the identity consistency information acquiring module 110 acquires image information of at least one part of a human head or a face.
  • the sex information judging module 120 judges whether the head-mounted smart device is continuously attached to the human body based on the comparison result of the image information and the pre-stored standard image information.
  • the image information includes image information acquired in real time within a preset time range.
  • the time period in which the identity information acquisition module 110 acquires the image information is not limited to the image information in the certain time range described above, and may also be the time when the head-mounted smart device performs a certain operation process. In the segment, it can also be within the total time allowed by the hardware environment such as power, and there is no special restriction.
  • the image information acquired by the identity consistency information acquiring module 110 is not limited to the image information of at least one part of the human head or the face, and may include other image information.
  • the device 100 for detecting the head-mounted smart device continuously attached to the human body is shown in FIG. 20 and FIG. 2b.
  • FIG. 20 is a structural block diagram of the device
  • FIG. 2b is a structural schematic diagram of the device.
  • the device includes a wearing support device 10, an image sensor 23, and an identity consistency information determining module 120, wherein the image sensor 23 is configured to acquire image information of a certain part of the face, and convert the obtained image information into an electrical signal for transmission to the identity.
  • the consistency information judging module 120, and the image sensor 23 and the identity consistency information judging module 120 are connected and disposed on the wearing support device 10.
  • the identity consistency information determining module 120 can be disposed on a separate unit outside the wearing support device 10 and communicatively coupled to the wearing support device 10.
  • the wearing support device 10 is worn on the user, and fixes the image sensor 23 to the detecting portion of the user to continuously detect image information of a certain part of the user's face of the head-mounted smart device and convert the detected image information.
  • the electrical signal converted into the electrical signal and converted in real time is transmitted to the identity consistency information determining module 120, and the identity consistency information determining module 120 receives the image information transmitted by the image sensor 23 indicating a certain part of the current human face.
  • the electrical signal is compared with the pre-stored electrical signal representing the standard image information. When the comparison result is the same, the head-mounted smart device is considered to be continuously attached to the human body.
  • the head-mounted smart device is continuously attached to the human body in the above manner.
  • the image information of the part of the face of the user of the head-mounted smart device needs to be collected and stored, thereby acquiring the above-mentioned standard image information, and converting it into an electrical signal for storage, and further, for image information.
  • the conversion and storage forms are not limited to the electrical signals mentioned in the present embodiment, and may be other forms of signals that can be implemented by those skilled in the art without any creative work, and are not described herein.
  • the wearing support device 10 is worn on the head of the user, which is a glasses-type structure, and the image sensor 23 is disposed at the front end portion of the bracket of the glasses.
  • the head-mounted type The smart device can also be an earphone, a hat, a head cover, etc., and the position of the image sensor can also be set according to a specific situation, and is not limited to the front end portion of the bracket, as long as the image sensor 23 can maintain a relatively static positional relationship with the measured portion of the user.
  • the head-mounted smart device may further include a display screen, and if there is a display screen, the image sensor 23 transmits the detected image information to the display screen, and displays the image information through the display screen. .
  • a structural block diagram of a device for detecting that a head-mounted smart device is continuously attached to a human body wherein the identity consistency information acquiring module 110 includes an image sensing module 119, and a photoelectric conversion module 118.
  • the signal modulation module 112, and the image sensing module 119, the photoelectric conversion module 118, and the signal modulation module 112 are sequentially electrically connected.
  • the image sensing module 119 is configured to sense an image signal of a target location.
  • the image sensing module 119 may be a camera.
  • the image sensing module 119 transmits the sensed image signal to the photoelectric conversion module 118.
  • the image signal is converted into an electrical signal via the photoelectric conversion module 118 and transmitted to the signal modulation module 112.
  • the signal modulation module 112 amplifies and filters the electrical signal and transmits the signal.
  • the identity consistency information determining module 120 compares the received electrical signal with a pre-stored standard electrical signal, and determines whether the detected image information is abnormal according to the comparison result.
  • the identity consistency information determining module 120 further includes a comparator 121, an adjustable resistor 122, and an adjustment component 123.
  • the comparator 121 and the signal modulation module 112 are electrically connected, and the received signal modulation module 112 transmits
  • the image signal ie, the electrical signal processed by the photoelectric conversion module 118 and the signal modulation module 112 is compared with a pre-stored standard electrical signal, and based on the comparison result, it is determined whether the head-mounted smart device is continuously attached to the human body.
  • the identity consistency information determining module 120 further includes an adjustable resistor 122 and an adjusting component 123, wherein the adjustable resistor 122 is used to adjust a pre-stored standard voltage signal.
  • the adjusting component 123 is passed through the adjusting component 123. The resistance value of the adjustable resistor 122 is changed to adjust the standard voltage signal.
  • the identity consistency information acquiring module 110 acquires image information of a predetermined part of the face of the user of the head-mounted smart device in real time, and the image information may include the acquired image of the part. Pixel, and/or size, and/or location of feature points, identity
  • the sex information judging module 120 compares the image information with the preset standard image information, and the standard image information may be a determined information value, or may be a predetermined information value range, and the image information and the pre-stored standard image information value.
  • the head-mounted smart device In the case of being consistent or within a range of preset image information values, the head-mounted smart device is considered to remain attached to the human body because, if the head-mounted smart device is removed, the detected image information Inevitably, a significant change occurs, which is beyond the predetermined range.
  • the detected image information may be different when the smart device is worn, so the first use of the smart device is used.
  • the standard image information value or the range of the standard image information value needs to be set, which can be realized by information acquisition in a period of time, and through the adjustable resistor 122 and The adjustment member 123 is used to achieve adjustment of a predetermined value or a predetermined range.
  • the apparatus 200 for detecting that the head mounted smart device is continuously attached to the human body further includes an alarm module 40.
  • the alarm module 40 is connected to the identity consistency information determination module 120.
  • the alarm module 40 is connected to the identity consistency information determination module 120 via a communication interface (not shown).
  • the identity consistency information determining module 120 controls the start or stop of the alarm module 40 by comparing the image signal with the preset standard image information.
  • the identity consistency information determining module 120 compares the received real-time image signal with a pre-stored standard image signal, and when the image signal does not coincide with the pre-stored standard image signal, triggers the alarm module 40 to perform a reminder when the image signal The alarm module 40 stops the reminder when it coincides with the pre-stored standard image signal.
  • the identity consistency information acquiring module 110 includes an image sensor 65 and a signal conditioning circuit 62.
  • the output of the image sensor 65 is connected to the input end of the signal conditioning circuit 62, and the identity is consistent.
  • the information judging module 120 includes a signal analysis processing module 71 and a comparison module 72, wherein the signal conditioning circuit 62 is connected to the signal analysis processing module 71, and the signal conditioning circuit 62 is configured to convert the image signal acquired by the image sensor 65 into a signal analysis.
  • the comparison module 72 compares the difference with a preset allowable change difference, and identifies the head-mounted smart within the allowed change difference.
  • the device is continuously attached to the human body, and conversely, the head-mounted smart device is not continuously attached to the human body.
  • signal conditioning circuit 62 is operative to transform the analog signal into a digital signal for data acquisition, control processes, performing computational display readout, or other purposes.
  • the image sensor 65 measures the image information of the user, but since the sensor signal cannot be directly converted into digital data, the sensor output is a relatively small voltage, current or resistance change, and therefore must be amplified and slowed down before being converted into a digital signal. Rushing or scaling an analog signal, etc., which is a conditioning process that is suitable for the input of an analog-to-digital converter (ADC). The ADC then digitizes the analog signal and sends the digital signal to an MCU or other digital device. Used for data processing of the system.
  • ADC analog-to-digital converter
  • the identity consistency information determining module 120 may be disposed on the head-mounted smart device, or may be disposed on a processing unit independent of the head-mounted smart device, and the headset
  • the communication connection between the smart devices, wherein the communication connection may include: wifi, Bluetooth, and the like.
  • a method of detecting that a head-mounted smart device is continuously attached to a human body is also provided.
  • the method includes:
  • Step S610 The acquiring module acquires image information of at least one part of a human head or a face to which the head-mounted smart device is attached;
  • Step S620 Determine whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the image information and the pre-stored standard image information.
  • the image information includes image information acquired in real time within a preset time range.
  • image information is consistent with the pre-stored standard image information, it is determined that the head-mounted smart device is continuously attached to the human body.
  • determining whether the head-mounted smart device is continuously attached to the human body according to the comparison result of the image information and the pre-stored standard image information includes:
  • the pixel, and/or size, and/or feature point position of the analyzed image information calculate the difference between the real-time image information and the pixel, and/or size, and/or feature point position of the pre-stored standard image information.
  • the difference is compared with the preset allowable change difference, and it is determined that the head-mounted smart device is continuously attached to the human body within the allowable change difference.
  • the image information acquired is not limited to the image information of at least one part of the human head or the face described above, and may include other image information.
  • the preset image information value or the preset image information range may be obtained by acquiring image information of at least one part of the head or the face of the user of the head-mounted smart device in advance, thereby implementing Whether the head-mounted smart device is continuously attached to the human body for judgment, such as the following scenario:
  • the identity of the user can also be verified by means of iris information recognition, and the opening of the file can be controlled by eye movements such as blinking or blinking of the user. , closing, or fast forward, rewind, flipping up and down, etc.
  • the device is continuously attached to the human body by the above method.
  • the smart device is smart glasses, and the user wears the glasses. View the video, or the document, after passing the user identity authentication, after opening the file, if the smart glasses are taken down or transferred to another person's head, it is detected by the identity consistency information judgment module.
  • a close command is sent to the play end of the video or the open end of the document, and the video being played, or the document being viewed is closed, thereby largely protecting User's privacy.
  • the above-mentioned head-mounted smart device may be glasses, a hat, a headphone, a head cover, and the like.
  • the head-mounted smart device when used for the first time, or the smart device needs to be replaced, the user identity information needs to be collected, and the function may be implemented by the identity consistency information acquiring module, or The information acquisition module is newly added.
  • the information acquisition module When the module receives the information collection instruction, it needs a certain time (for example, 3 minutes) to read and save the user identity information. During this time, the module reads continuously.
  • Image information of at least one part of the head or face of the user of the head-mounted smart device and records the overall change trend of the image information during the time period, and determines the fluctuation range of the image information according to the change trend, under normal circumstances It may happen that the image information of the person changes drastically at one or more time points beyond the fluctuation range, but as long as the duration of the drastic change is very short, or only a time point appears, and the change is restored , the overall trend of the information has not changed, it is still considered that the situation is to meet the verification Item of.
  • the technical solution of the present invention can be further applied to other fields such as medicine, supervision, and the like.
  • the head-mounted smart device provided by the embodiment of the present invention has a power-saving protection device. If the identity consistency information acquisition module continuously fails to monitor image information for a predetermined period of time (for example, 5 minutes), the default is The head-mounted smart device leaves the human body and automatically goes to sleep.
  • Embodiments of the present invention also provide another means of detecting that a head-mounted smart device is continuously attached to a human body.
  • the device includes at least an identity consistency information acquiring module 110 and an identity consistency information determining module 120.
  • the identity consistency information acquiring module 110 acquires pulse information, and the identity consistency information determining module 120 calculates a pulse interval. And determining, according to the set threshold, whether the head-mounted smart device is continuously attached to the human body, and at least the identity consistency information acquiring module 110 is disposed on the head-mounted smart device.
  • the identity consistency information acquiring module 110 acquires the pulse information in a certain period of time in real time, and when the interval of the pulse is within the set threshold range, it is determined that the head-mounted smart device is continuously attached to the human body.
  • the time period in which the identity consistency information acquiring module 110 acquires the pulse information is not limited to the foregoing certain time period, and may also be in the time period during which the head-mounted smart device performs a certain operation process. It can be all the time allowed in the hardware environment such as power, and there is no special restriction.
  • the identity consistency information obtaining module 110 acquires pulse information embodied by a certain part of the human head or the face.
  • FIG. 25 is a structural block diagram of the device
  • FIG. 26 is a schematic structural view of the device.
  • the device includes a wearing support device 10, a pulse sensor 24, and an identity consistency information judging module 120, wherein the pulse sensor 24 is configured to detect a sensitive characteristic of a change in blood volume generated by a specific wavelength of infrared rays to a blood microcirculation of a blood vessel at the end of the blood vessel, and is detected by the heart.
  • the pulse sensor 24 and the identity consistency information determination module 120 are connected and disposed on the wearing support device 10.
  • the wearing support device 10 is worn on the user, and fixes the pulse sensor 24 to the detecting portion of the user to continuously detect the pulse information of the user.
  • the wearing device is worn. 10 is worn on the head of the subject, which is an earphone type structure, and, in the embodiment, the pulse sensor 24 is a touch sensor, and the touch sensor passes through a rotatable link and a head-mounted smart device.
  • the brackets are connected to detect the pulse of the ear veins.
  • the head-mounted smart device may also be glasses, a hat, a head cover, a helmet, etc., as long as the sensor can be fixed to the detecting portion of the user, and the head-mounted smart device is provided as needed.
  • the device may also include a display screen with a pulse sensor 24 transmitting the detected pulse information to the display screen and displaying the user's pulse information through the display screen.
  • the identity consistency information obtaining module 120 acquires continuous pulse information between the pulse sensor 24 at a certain time or a set action interval and calculates a pulse interval. When the interval of the pulse is within the set threshold range, the determination is performed.
  • the head-mounted smart device is continuously attached to the human body; otherwise, the head-mounted smart device is not continuously attached to the human body.
  • a structural block diagram of a device for detecting that a head-mounted smart device is continuously attached to a human body wherein the identity consistency information acquiring module 110 includes a pulse acquisition module 1133 and a data processing module 1113, the communication module 113, and the pulse acquisition module 1133, the data processing module 1131, and the communication module 113 are sequentially and electrically connected, wherein
  • the pulse acquisition module 1133 is designed to be in the form of a pad, and is disposed on the head-mounted smart device, and corresponding to the detection part of the user, such as an ear vein, to detect the pulse information of the ear vein of the user, and implement the user Induction of the pulse, wherein the pulse acquisition module can be set only one, or one of the two ear veins can be set.
  • the data processing module 1131 reads the data information obtained from the pulse acquisition module 1133 and processes the data information to monitor the pulse information for a predetermined time interval in real time.
  • the module consists of a microprocessor-based board that contains a low-power, high-performance 8-bit AVR microprocessor, the ATmega16L, peripheral components (resistors, capacitors, etc.) and power supplies. In this embodiment, four ADC input channels with 10-bit resolution are used to convert analog voltage information generated by the pulse acquisition module into digital data.
  • the microprocessor has a clock frequency of 8MHz. All circuits operate at 5V and are supplied by the LM78L05 voltage divider and a 7.4V lithium battery.
  • the module is simple and light, can be connected to the pulse acquisition module 21 through a line, and is easy to integrate with a head-mounted smart device.
  • the communication module 113 is configured to wirelessly transmit the digital data processed by the microprocessor-based data processing module 1131 to the identity consistency information determining module 120 in real time.
  • a high sampling rate wireless transmission method can be employed. Therefore, a low power consumption radio communication module GW100B (having a size of 56 mm x 28 mm x 7 mm) is selected. Radio transmission The transmitter and receiver are respectively connected to the microprocessor based data processing module and the background. The transmission distance can reach 5m in the case of barrier-free conditions. The forward error correction processing of the GW100B achieves a low error rate, making the entire system reliable.
  • the two can also be connected by wired communication.
  • the identity consistency information judging module 120 includes a signal analysis processing module 71 and a judging module 122.
  • the signal analysis processing module 71 calculates a pulse interval according to the voltage signal corresponding to the received pulse information, and the judging module 122 calculates the calculated pulse interval.
  • the value is compared with a range of voltage signals corresponding to the preset critical pulse interval value range, and whether the detected pulse information is abnormal according to the comparison result, for example, if the detected pulse interval value is greater than a preset pulse interval maximum
  • the threshold value, or less than the preset pulse interval threshold value is considered that the head-mounted smart device does not continuously adhere to the human body; conversely, if the detected pulse interval value is between the preset pulse interval value range, then The head-mounted smart device is continuously attached to the human body.
  • the identity consistency information determining module 120 includes a signal analysis processing module 71 and a comparison module 72, and the signal analysis processing module 71 analyzes the acquired pulse information within a predetermined time period and It is converted into an average value of the corresponding electrical signal, and an electrical signal representing the difference between the real-time pulse information value and the average value is calculated, and the comparison module 72 compares the difference signal with a preset allowable change difference value, where allowed. Within the difference of the difference, it is determined that the head-mounted smart device is continuously attached to the human body. Otherwise, the head-mounted smart device is not continuously attached to the human body.
  • the comparison module 72 can also Comparing the real-time obtained electrical signal representing the pulse interval value with the maximum value and the minimum value of the electrical signal converted into the pulse information, the real-time acquired electrical signal representing the pulse interval value is greater than the acquired pulse information conversion
  • the head-mounted type is considered to be the maximum value of the electrical signal or the minimum value of the electrical signal converted into the obtained pulse information.
  • the smart device does not remain attached to the human body.
  • FIG. 28 is a structural block diagram of the device
  • FIG. 29 is a schematic structural diagram of the device
  • the identity consistency information acquiring module 110 is a non-contact sensor.
  • the non-contact sensor includes at least one camera 41 for detecting pulse information of a specified part of the face of the user of the head-mounted smart device.
  • the head-mounted smart device is a glasses-type structure.
  • the camera 41 is disposed at the front end of the bracket of the glasses
  • the identity consistency information determining module 120 includes a signal processing module 42, a calculation module 43, and a comparison module 72.
  • the signal processing module 42 processes the video containing the color face obtained by the camera 41.
  • the obtained face area and face position coordinates, at least the skin color area, the eyes, and the eye area are divided and classified, and the classification is not given
  • the three-color channel separation is performed on the face region in each frame video
  • the spatial mean value is taken for each channel
  • the calculation module 43 performs independent component analysis ICA processing on the sampled data to obtain a pulse interval value, and analyzes the pulse interval value.
  • the average value, and the difference between the real-time pulse information value and the average value, the comparison module 72 is configured to compare the difference value with a preset allowable change difference value, and determine the head within the allowed change difference value.
  • the wearable smart device is continuously attached to the human body.
  • the acquisition and analysis of the user's pulse information can also be implemented by the following methods:
  • the method is based on photoelectric volume pulse wave tracing PPG and independent component analysis ICA model, and non-contact measurement pulse is realized by analyzing a face video.
  • a color video of a face is acquired by a camera, and after a three-primary light mode RGB channel separation and ICA processing is performed on the face region, a group of components closest to the human body pulse wave is found as a measurement result.
  • PPG is a non-invasive method for detecting changes in blood volume in living tissue by means of optoelectronic means.
  • a beam of a certain wavelength When a beam of a certain wavelength is irradiated onto the surface of the skin, it will be transmitted by transmission or reflection.
  • the intensity of the light is weakened due to the absorption of light by the skin, muscles, tissues and blood.
  • the absorption of light by skin, muscle, tissue, etc. is constant throughout the blood circulation, and the blood volume in the skin is pulsating and cyclically changing under the action of the heart: when the heart contracts, the peripheral blood volume is the most, The amount of light absorbed is also the largest, and the intensity of light transmitted is also minimal; conversely, when the heart is diastolic, the intensity of light transmitted is the greatest.
  • the intensity of the light thus received exhibits a pulsating periodic variation with the heartbeat.
  • the blood volume contains important physiological information of many cardiovascular systems such as heartbeat function and blood flow. It also contains abundant microcirculatory physiological and pathological information, and is an important source of information for studying the human circulatory system.
  • This optoelectronic technology can provide information about the cardiovascular system, such as heart rate, blood pressure, blood flow, blood oxygen, respiratory volume, microcirculatory peripheral blood vessels, arterial oxygen saturation.
  • This embodiment is based on this bio-optical principle, but since in the normal case, the photoelectric volume requires the use of a dedicated beam as the light source, the objective of this experiment is to study the method of separating the source information containing the specific signal under the natural light source and feasibility. Assume that the illumination intensity of the experimental environment is constant, set to a constant a, and the absorption of the natural light intensity by the blood volume is x. The light intensity is f(x) observed by an instrument (such as a normal household camera), and you can get:
  • f(x) and x have the same period and frequency, so it is theoretically possible to detect the periodic variation of the light intensity of a specific wavelength in the face region by the camera to measure the pulse of the human body.
  • ICA is a new signal processing and data analysis method developed in the signal processing field in the late 1990s. The purpose is to separate (or extract) mutually independent source signals from the mixed signals observed by unknown source signals. It has a wide range of applications in signal processing, data mining, feature extraction, neural networks and many other fields.
  • a ⁇ R n ⁇ n is an unknown non-singular mixed matrix.
  • the processing of the video is performed in the RGB three-color channel, which is equivalent to three sensor observation source signals, and the purpose is to find the period or frequency in the separated three-color independent component which is relatively close to the comparison test.
  • a set of components are provided.
  • Opencv open source computer vision library, which encapsulates library functions commonly used in digital image processing
  • This process is performed in the YCbCr color space and is completed by skin color area detection, eye detection, eye area detection, and face candidate area division hierarchical structure.
  • different classifiers are given different weights, and all the detection processes mean that the video frame contains a face area.
  • the RGB three-color channel separation is performed on the face region in each frame of video, and the spatial mean is taken for each channel. Let the size of the face area be M ⁇ N.
  • each pixel is represented by a set of (R, G, B) data, and the components of the RGB channel are (R, 0, 0), (0 , G, 0), (0, 0, B).
  • Figure 270 is an RGB three-color signal sequence data obtained by processing a video having a duration of 30 pulse periods, wherein (a) is a red channel; (b) is a green channel; and (c) is a blue channel.
  • step (3) If it does not converge, return to step (3).
  • the estimated source signal [5-9] can be obtained by taking the equation (2).
  • Figure 271 shows the effect of performing ICA processing on the face video of a 30-pulse cycle and then filtering it with arithmetic mean filtering. Where B is the blue channel data, G is the green channel data, and R is the red channel data.
  • the estimated component I, the estimated component II, and the estimated component III are obtained, and then filtered by arithmetic mean filtering.
  • the filtered component (3) After the component (1), the filtered component (2), and the filtered component (3), after the pulse information obtained by the user manually taking the pulse is compared, it is determined that the filtered component (3) is relative to The other two are more characteristic of the pulse wave, so the estimated component III is selected as the effective source signal, and the pulse interval value is used as the data of the pulse information of the present embodiment.
  • the pulse information of the user can also be obtained and analyzed by:
  • the changes in the transmittance of the infrared receiver tube are periodically changed due to the periodic pulsation changes of the arterial blood of the capillaries during the blood circulation, which reflects the arteries.
  • the change of blood thereby realizing the transition of the optical signal to the electrical signal, and then filtering, amplifying, shaping, A/D converting and further processing the photoelectric signal.
  • the principle of the photoelectric sensor is shown in Figure 272.
  • the light emitted from the infrared light-emitting tube 71 disposed on the holder 70 passes through the skin of the site to be tested 72 into the deep tissue, is absorbed by the skin, pigment, nails, blood, etc., and is partially reflected back by the skin and blood, and the rest is projected. It is received by the infrared receiving tube 73.
  • This method can better indicate the time relationship of the heart rate and can be used for the measurement of the pulse waveform.
  • the photoelectric intelligent pulse wave measurement system is based on the ATmega8 single-chip microcomputer. Because the ATmega8 is a low-power, high-performance, anti-interference ability, 8K can be erased multiple times, the AVR high-speed single-chip microcomputer with multiple password protection lock (LOCK) function, Therefore, data processing can be performed at high speed.
  • the photoelectric sensor is used as an input, and the input signal is amplified, filtered, 16-bit A/D converted, and then transmitted to the single-chip microcomputer for processing, and the processed data is transmitted to the identity consistency information determining module 120, as shown in FIG.
  • the sensor circuit is the key to this design, and its performance directly affects the processing of the rear circuit and the display of the results.
  • the content of oxygen-carrying hemoglobin and the content of reduced hemoglobin in the blood are changed, so that the absorption coefficient of blood to light is changing, so the baseline of the pulse wave curve picked up often changes with the fluctuation of respiratory motion. Therefore, the use of an infrared light-emitting tube as a light source suppresses the drift of the pulse wave curve caused by respiratory motion.
  • the core component of the receiving circuit is a phototransistor.
  • the pre-circuit uses a low-noise amplifier to minimize input noise. Therefore, low-noise photosensitive devices and resistors are selected, and low-level power supply is used. According to the impedance characteristics of the sensor output source, low-noise operating points are determined and noise matching is performed to obtain a minimum noise figure.
  • Arterial pulse waves are low-frequency, weak physiological signals that must be filtered and amplified to meet signal acquisition requirements.
  • the frequency of the arterial pulse signal is basically limited to 0.1-20 Hz.
  • a low-pass filter circuit with appropriate frequency band is adopted, so that the detected signal has the maximum fidelity.
  • the op amp is required to have a high input impedance and low input loss. Adjusting the voltage, small drift, the steps of signal amplification and filtering in Figure 273 are implemented.
  • the signal processing system is based on the ATmega8 microcontroller, with A/D conversion, program memory, data memory and keyboard, etc., used to complete the pulse signal A / D conversion, parameter calculation, storage and set various working methods.
  • the identity consistency information judging module 120 includes a signal analysis processing module (not shown) and a comparison module (not shown).
  • the signal analysis processing module analyzes the pulse information received within a predetermined period of time, obtains an average pulse interval, and calculates the real-time. The difference between the pulse interval value and the average value, the electrical signal indicating the difference is transmitted to the comparison module, and the comparison module compares the difference with the preset allowable change difference range, and the allowed variation difference It is determined that the head-mounted smart device is continuously attached to the human body. Conversely, if the difference between the real-time pulse interval value and the average value is not within the preset allowable change difference value, it is determined as the head-mounted smart The device leaves the body.
  • pulse wave measurement is a relatively complicated process and must be implemented by system software.
  • the use of ATmega8 microcontroller makes the system's timing, counting and real-time display functions convenient.
  • the MCU system software mainly includes main program, data acquisition subroutine, digital filtering subroutine, keyboard scanning subroutine, pulse rate calculation subroutine and RS232 communication subroutine. Each subroutine can be debugged separately, with clear structure, convenient calling and expansion.
  • the computer software system VB is written to receive data from the RS232 interface, curve the received data, and display the fitted pulse waveform.
  • the identity consistency information obtaining module 110 and the identity consistency information determining module 120 may be disposed on the same device or not on the same device, if the identity consistency information acquiring module 110 and the identity consistency.
  • the information determining module 120 is not disposed on the same device, and the identity consistency information acquiring module 110 and the identity consistency information determining module 120 can implement electrical connection through wireless devices such as wifi and Bluetooth.
  • a method of detecting that a head-mounted smart device is continuously attached to a human body is also provided.
  • the method includes:
  • Step S3410 acquiring pulse information
  • Step S3420 Calculate the interval of the pulse according to the pulse information, and determine whether the head-mounted smart device is continuously attached to the human body according to the set threshold.
  • the method further comprises:
  • the pulse information in a certain period of time is acquired in real time, and when the interval of the pulse is within the set threshold range, it is determined that the head-mounted smart device is continuously attached to the human body.
  • obtaining pulse information includes:
  • a contact or non-contact sensor is used to acquire the pulse of the ear vein or the radial artery
  • the non-contact sensor includes at least one camera, and the camera is disposed on a bracket of the head-mounted smart device, and acquires pulse information by detecting a facial image.
  • the method further includes:
  • the region performs three-color channel separation, takes the spatial mean value for each channel, and performs independent component analysis ICA processing on the sampled data to obtain pulse information.
  • the method includes:
  • the average of the analyzed pulse information and calculate the difference between the real-time pulse information value and the average value;
  • the difference is compared with the preset allowable change difference, and it is determined that the head-mounted smart device is continuously attached to the human body within the allowable change difference.
  • the real-time monitoring of the pulse information of the user of the head-mounted smart device through the real-time understanding of the user's pulse information and the preset threshold, or the preset pulse interval range
  • it can be determined whether the head-mounted smart device is continuously attached to the human body for example, the following scenario:
  • the identity of the user can also be verified by means of iris information recognition, and the opening of the file can be controlled by eye movements such as blinking or blinking of the user. , closing, or fast forward, rewind, flipping up and down, etc.
  • eye movements such as blinking or blinking of the user. , closing, or fast forward, rewind, flipping up and down, etc.
  • the wearing The smart device is a smart glasses. The user wears the glasses to view the video or the document.
  • the smart glasses After the user identity is authenticated and the file is opened, if the smart glasses are taken down or replaced by another person, If the pulse information of the user detected by the identity consistency information determining module is discontinuous or an interval exceeding a preset threshold is generated, a closing instruction is sent to the playing end of the video or the open end of the document, and the video being played is closed, or The document being viewed, and thus, largely protects the privacy of the user.
  • the above-mentioned head-mounted smart device may be glasses, a hat, a headphone, a head cover, and the like.
  • the user identity information needs to be collected, and the function may be implemented by the identity consistency information acquiring module, or The new information collection module, in the case that the module receives the information collection instruction, requires a certain time (for example, 3 minutes) to read and save the user identity information. During this time, the module continuously reads the current The pulse information of the user, and record the overall trend of the pulse information during the time period, and determine the average interval of the pulse according to the change trend. Under normal circumstances, the pulse interval of the person may occur at one or more times. The point changes drastically beyond the fluctuation range, but as long as the duration of the drastic change is very short, or only occurs at a point in time, and the overall trend of the information does not change after the change is restored, the The situation is to satisfy identity consistency verification.
  • the technical solution of the present invention can be further applied to other fields such as medicine, supervision, and the like.
  • the head-mounted smart device provided by the embodiment of the present invention has a power-saving protection device, and if the smart device is detected to leave the human body, it automatically enters a sleep state.
  • modules in the devices of the embodiments can be adaptively changed and placed in one or more devices different from the embodiment.
  • the modules or units or components of the embodiments may be combined into one module or unit or component, and further they may be divided into a plurality of sub-modules or sub-units or sub-components.
  • any combination of the features disclosed in the specification, including the accompanying claims, the abstract and the drawings, and any methods so disclosed, or All processes or units of the device are combined.
  • Each feature disclosed in this specification (including the accompanying claims, the abstract and the drawings) may be replaced by alternative features that provide the same, equivalent or similar purpose.
  • the various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof.
  • a microprocessor or digital signal processor may be used in practice to implement some or all of the means for detecting that the head mounted smart device is continuously attached to the human body in accordance with an embodiment of the present invention.
  • the invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein.
  • Such a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.
  • FIG. 35 illustrates an electronic device in which the method of detecting the head-mounted smart device of the present invention is continuously attached to a human body.
  • the electronic device conventionally includes a processor 1210 and a computer program product or computer readable medium in the form of a memory 1220.
  • the memory 1220 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM.
  • Memory 1220 has a memory space 1230 for program code 1231 for performing any of the method steps described above.
  • storage space 1230 for program code may include various program codes 1231 for implementing various steps in the above methods, respectively.
  • the program code can be read from or written to one or more computer program products.
  • the program product includes a program code carrier such as a hard disk, a compact disk (CD), a memory card, or a floppy disk.
  • a computer program product is typically a portable or fixed storage unit as described with reference to FIG.
  • the storage unit may have a storage section or a storage space or the like arranged similarly to the storage 1220 in the electronic device of FIG.
  • the program code can be compressed, for example, in an appropriate form.
  • the storage unit comprises a program 1231' for performing the steps of the method according to the invention, ie a code readable by a processor such as 1210, which when executed by the electronic device causes the electronic device to perform the above Each step in the described method.
  • the monitoring and analysis of the pulse information of the user can be performed, and the monitored pulse interval of the user, or the difference in pulse interval variation and the preset pulse interval, or the pulse allowable variation range can be performed. Comparing, and determining, according to the comparison result, a function of determining whether the head-mounted smart device is continuously attached to the human body, thereby ensuring consistency of the identity of the user in the operation of the head-mounted smart device.
  • the operation security of the head-mounted smart device is improved, and the user of the device is not required to perform frequent identity authentication, thereby improving the convenience of operation.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

L'invention concerne un dispositif et un procédé de détection de fixation durable de visiocasque intelligent, le dispositif comprenant au moins un module d'acquisition d'informations de cohérence d'identité et un module de détermination d'informations de cohérence d'identité. Le module d'acquisition d'informations de cohérence d'identité fait l'acquisition d'informations de la distance entre au moins la tête et le visage et d'une partie correspondante du visiocasque intelligent ; le module de détermination d'informations de cohérence d'identité utilise des informations relatives à la distance calculée pour déterminer si le visiocasque intelligent est fixé durablement selon un seuil prédéfini. La solution technique de la présente invention détermine si le visiocasque intelligent est fixé durablement par l'acquisition d'informations de distance entre au moins la tête et le visage et une partie correspondante du visiocasque intelligent sur la base du résultat de la comparaison entre les informations de distance et le seuil prédéfini, ce qui garantit de façon appréciable la sécurité fonctionnelle du visiocasque intelligent.
PCT/CN2014/094297 2014-01-24 2014-12-19 Dispositif et procédé de détection de fixation durable de visiocasque intelligent WO2015109907A1 (fr)

Applications Claiming Priority (10)

Application Number Priority Date Filing Date Title
CN201410035753.6 2014-01-24
CN201410035697.6A CN104808771A (zh) 2014-01-24 2014-01-24 检测头戴式智能设备持续附着在人体上的装置和方法
CN201410035786.0A CN104808773A (zh) 2014-01-24 2014-01-24 检测头戴式智能设备持续附着在人体上的装置和方法
CN201410036713.3A CN104808779A (zh) 2014-01-24 2014-01-24 检测头戴式智能设备持续附着在人体上的装置和方法
CN201410036298.1A CN104808776A (zh) 2014-01-24 2014-01-24 检测头戴式智能设备持续附着在人体上的装置和方法
CN201410035697.6 2014-01-24
CN201410036298.1 2014-01-24
CN201410035786.0 2014-01-24
CN201410036713.3 2014-01-24
CN201410035753.6A CN104808772B (zh) 2014-01-24 2014-01-24 检测头戴式智能设备持续附着在人体上的装置和方法

Publications (1)

Publication Number Publication Date
WO2015109907A1 true WO2015109907A1 (fr) 2015-07-30

Family

ID=53680784

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/094297 WO2015109907A1 (fr) 2014-01-24 2014-12-19 Dispositif et procédé de détection de fixation durable de visiocasque intelligent

Country Status (1)

Country Link
WO (1) WO2015109907A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111752386A (zh) * 2020-06-05 2020-10-09 深圳市欢创科技有限公司 一种空间定位方法、系统及头戴式设备
CN112764518A (zh) * 2019-10-21 2021-05-07 Oppo广东移动通信有限公司 控制方法、穿戴设备和存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102201917A (zh) * 2011-04-10 2011-09-28 沈阳航空航天大学 一种可用于atm机的身份认证方法及装置
CN103119920A (zh) * 2010-09-27 2013-05-22 诺基亚公司 具有可弹性变形的本体的装置
CN103413218A (zh) * 2013-08-07 2013-11-27 天地融科技股份有限公司 移动终端、nfc支付方法、装置及系统

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103119920A (zh) * 2010-09-27 2013-05-22 诺基亚公司 具有可弹性变形的本体的装置
CN102201917A (zh) * 2011-04-10 2011-09-28 沈阳航空航天大学 一种可用于atm机的身份认证方法及装置
CN103413218A (zh) * 2013-08-07 2013-11-27 天地融科技股份有限公司 移动终端、nfc支付方法、装置及系统

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112764518A (zh) * 2019-10-21 2021-05-07 Oppo广东移动通信有限公司 控制方法、穿戴设备和存储介质
CN111752386A (zh) * 2020-06-05 2020-10-09 深圳市欢创科技有限公司 一种空间定位方法、系统及头戴式设备

Similar Documents

Publication Publication Date Title
US10809796B2 (en) Monitoring a user of a head-wearable electronic device
US11154203B2 (en) Detecting fever from images and temperatures
US10791938B2 (en) Smartglasses for detecting congestive heart failure
US11435826B2 (en) Electronic device and control method thereof
Lamonaca et al. Health parameters monitoring by smartphone for quality of life improvement
US11638550B2 (en) Systems and methods for stroke detection
US10346601B2 (en) Biometric information acquisition method and device for same
US20190082974A1 (en) Wearable audio devices
US20180228435A1 (en) Wearable devices for physiological monitoring
US20210345888A1 (en) Detecting alcohol intoxication from video images
US10206573B2 (en) Method of obtaining biometric information in electronic device and electronic device for the same
US10638938B1 (en) Eyeglasses to detect abnormal medical events including stroke and migraine
CN103519794A (zh) 测量装置、测量方法、程序、存储介质和测量系统
KR20200087337A (ko) 헬스 케어 로봇 및 그 제어 방법.
JP7401634B2 (ja) サーバ装置、プログラムおよび方法
CN104809371B (zh) 判断头戴式智能设备的鉴权信息有效性的装置和方法
JP2018005512A (ja) プログラム、電子機器、情報処理装置及びシステム
WO2015109907A1 (fr) Dispositif et procédé de détection de fixation durable de visiocasque intelligent
CN104808778B (zh) 判断头戴式智能设备操作有效性的装置和方法
WO2015109887A1 (fr) Appareil et procédé pour déterminer la validation d'une opération et informations d'authentification de visiocasque intelligent
CN110268480A (zh) 一种生物测定数据存储方法、电子设备及系统
CN115336968A (zh) 一种睡眠状态检测方法与电子设备
KR102410998B1 (ko) 전자 장치 및 그 제어 방법
WO2024005827A1 (fr) Temps avant sommeil profond améliorant la qualité du sommeil
TR2022007775Y (tr) Duygulari anali̇z eden ki̇şi̇sel medi̇tasyon ci̇hazi

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14880275

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14880275

Country of ref document: EP

Kind code of ref document: A1