CN114327070A - Information processing method and head-mounted device - Google Patents

Information processing method and head-mounted device Download PDF

Info

Publication number
CN114327070A
CN114327070A CN202111670507.4A CN202111670507A CN114327070A CN 114327070 A CN114327070 A CN 114327070A CN 202111670507 A CN202111670507 A CN 202111670507A CN 114327070 A CN114327070 A CN 114327070A
Authority
CN
China
Prior art keywords
working mode
acquisition module
module
head
mounted device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111670507.4A
Other languages
Chinese (zh)
Inventor
李凡智
刘旭国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN202111670507.4A priority Critical patent/CN114327070A/en
Publication of CN114327070A publication Critical patent/CN114327070A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The application provides an information processing method and a head-mounted device, wherein the information processing method comprises the following steps: acquiring at least one physiological parameter of a wearer; evaluating the attention of the wearer according to the physiological parameters to obtain an evaluation result; switching the working mode of an environment sensing module of the head-mounted equipment according to the evaluation result; assessing an environmental risk based on the switched operating mode of the environmental awareness module, controlling a physical state of at least one component of the head-mounted device based on the assessed environmental risk, the change in the physical state of the at least one component being related to the wearer's attention.

Description

Information processing method and head-mounted device
Technical Field
The present application belongs to the field of electronic communication technologies, and in particular, to an information processing method and a head-mounted device.
Background
Cognition is the process of acquiring knowledge or applying knowledge by converting external information received by the human brain into intrinsic psychological activities through processing treatment. It includes aspects of memory, language, visual space, execution, calculation, and understanding judgment. When people's attention is focused on an object, the cognitive ability of the people to the surrounding environment is reduced, so that the surrounding is dangerous or some situations occur, and the wearer cannot make a judgment in time. For example, when a wearer wears a head-mounted device such as an AR, the wearer's eyes are blocked, and thus the wearer's cognitive ability with respect to the surrounding environment is degraded, and cannot avoid an object such as a surrounding obstacle in time.
Disclosure of Invention
In view of the above technical problems in the prior art, the present disclosure provides an information processing method and a head-mounted device.
The embodiment of the application provides an information processing method, which is applied to head-mounted equipment and comprises the following steps:
acquiring at least one physiological parameter of a wearer;
evaluating the attention of the wearer according to the physiological parameters to obtain an evaluation result;
switching the working mode of an environment sensing module of the head-mounted equipment according to the evaluation result;
assessing an environmental risk based on the switched operating mode of the environmental awareness module, controlling a physical state of at least one component of the head-mounted device based on the assessed environmental risk, the change in the physical state of the at least one component being related to the wearer's attention.
In some embodiments, the switching the operating mode of the environment sensing module of the head-mounted device according to the evaluation result specifically includes:
controlling the environment sensing module to switch between a first working mode and a second working mode; the environment sensing module has different power consumption and/or different environment sensing capability in the first working mode and the second working mode.
In some embodiments, the context awareness module comprises at least one of an image acquisition module, a location acquisition module, and a velocity acquisition module, the method further comprising:
dynamically adjusting the power consumption of the image acquisition module according to the working mode to ensure that the power consumption of the image acquisition module in the first working mode is lower than that in the second working mode; and/or
Dynamically adjusting the power consumption of the position acquisition module according to the working mode to ensure that the power consumption of the position acquisition module in the first working mode is lower than that in the second working mode; and/or
And dynamically adjusting the power consumption of the speed acquisition module according to the working mode, so that the power consumption of the speed acquisition module in the first working mode is lower than that in the second working mode.
In some embodiments, the context awareness module comprises at least one of an image acquisition module, a location acquisition module, and a velocity acquisition module, the method further comprising:
dynamically adjusting the environment perception capability of the image acquisition module according to the working mode, so that the environment perception capability of the image acquisition module in a first working mode is lower than that in a second working mode; the environment perception capability of the image acquisition module is at least related to the number of the opened modules and the detection angle of the modules; and/or
Dynamically adjusting the environment perception capability of the position acquisition module according to the working mode, so that the environment perception capability of the position acquisition module in a first working mode is lower than that in a second working mode; the environment perception capability of the position acquisition module is at least related to the position updating frequency and the working state of the module; and/or
Dynamically adjusting the environment perception capability of the speed acquisition module according to the working mode, so that the environment perception capability of the speed acquisition module in the first working mode is lower than that in the second working mode; the environment perception capability of the speed acquisition module is at least related to the speed updating frequency and the working state of the module.
In some embodiments, said controlling the physical state of at least one component of the head-mounted device based on the assessed environmental risk specifically comprises:
controlling at least one physical state of a display state, a sound state, and a contact state of at least one component of the head-mounted device according to the assessed environmental risk.
In some embodiments, controlling the display state of the head mounted device specifically includes: manipulating lens transparency and/or presentation content of the head-mounted device according to the assessed environmental risk;
controlling the sound state of the head mounted device specifically includes: controlling an audio module of the head-mounted device according to the assessed environmental risk;
controlling the contact state of the head mounted device specifically includes: manipulating a contact module of the head-mounted device according to the assessed environmental risk.
In some embodiments, the controlling of the switching of the working mode of the environment sensing module of the head-mounted device according to the evaluation result specifically includes;
determining a risk level based on the evaluation result;
dynamically adjusting the operating mode according to the risk level.
An embodiment of the present application further provides a head-mounted device, including:
one or more sensors configured to acquire at least one physiological parameter of the wearer;
an evaluation module configured to evaluate the attention of the wearer according to the physiological parameter to obtain an evaluation result;
a mode switching module configured to switch an operation mode of an environment sensing module of the head-mounted device according to the evaluation result;
a control module configured to evaluate an environmental risk based on the switched operating mode of the environmental awareness module, and issue a manipulation instruction to control a physical state of at least one component of the head-mounted device based on the evaluated environmental risk, the change in the physical state of the at least one component being related to the attention-related physical change of the wearer.
In some embodiments, the context awareness module comprises at least one of an image acquisition module, a location acquisition module, and a velocity acquisition module;
the power consumption of the image acquisition module in the first working mode is lower than that in the second working mode, and/or the environment perception capability of the image acquisition module in the first working mode is lower than that in the second working mode;
the power consumption of the position acquisition module in the first working mode is lower than that in the second working mode, and/or the environment sensing capability of the position acquisition module in the first working mode is lower than that in the second working mode;
the power consumption of the speed acquisition module in the first working mode is lower than that in the second working mode, and/or the environment sensing capability of the speed acquisition module in the first working mode is lower than that in the second working mode.
In some embodiments, the components of the head-mounted device include at least one of a lens, an audio module, and a contact module,
the control module is further configured to: manipulating lens transparency and/or presentation content of the head-mounted device according to the assessed environmental risk;
controlling the sound state of the head mounted device specifically includes: controlling an audio module of the head-mounted device according to the assessed environmental risk;
controlling the contact state of the head mounted device specifically includes: manipulating a contact module of the head-mounted device according to the assessed environmental risk.
Compared with the prior art, the beneficial effects of the embodiment of the present disclosure are that: this is disclosed through the aassessment to wearer's attention, can confirm the mode of operation of environmental perception module, in order when environmental perception module perception reaches the certain degree to environmental risk, accessible environmental perception module assists the wearer to improve its perception ability to environmental risk, and when environmental perception module perception reaches the certain degree, the accessible is to the control of the physical state of the part of head-mounted equipment come in time suggestion wearer, prevent the emergence of dangerous condition effectively, make the wearer can in time avoid the barrier in the environment.
Drawings
In the drawings, which are not necessarily drawn to scale, like reference numerals may describe similar components in different views. Like reference numerals having letter suffixes or different letter suffixes may represent different instances of similar components. The drawings illustrate various embodiments generally by way of example and not by way of limitation, and together with the description and claims serve to explain the disclosed embodiments. The same reference numbers will be used throughout the drawings to refer to the same or like parts, where appropriate. Such embodiments are illustrative, and are not intended to be exhaustive or exclusive embodiments of the present apparatus or method.
FIG. 1 is a flowchart of an information processing method according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of a head-mounted device according to an embodiment of the present application;
FIG. 3 is another flow chart of an information processing method according to an embodiment of the present application;
fig. 4 is another schematic structural diagram of a head-mounted device according to an embodiment of the present application;
fig. 5 is a first block diagram of a head-mounted device according to an embodiment of the present application;
fig. 6 is a second block diagram of a head-mounted device according to an embodiment of the present application.
Detailed Description
Various aspects and features of the present application are described herein with reference to the drawings.
It will be understood that various modifications may be made to the embodiments herein. Accordingly, the foregoing description should not be construed as limiting, but merely as exemplifications of embodiments. Those skilled in the art will envision other modifications within the scope and spirit of the application.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the application and, together with a general description of the application given above and the detailed description of the embodiments given below, serve to explain the principles of the application.
These and other characteristics of the present application will become apparent from the following description of preferred forms of embodiment, given as non-limiting examples, with reference to the attached drawings.
It is also to be understood that although the present application has been described with reference to some specific examples, those skilled in the art are able to ascertain many other equivalents to the practice of the present application.
The above and other aspects, features and advantages of the present application will become more apparent in view of the following detailed description when taken in conjunction with the accompanying drawings.
Specific embodiments of the present application are described hereinafter with reference to the accompanying drawings; however, it is to be understood that the described embodiments are merely examples of the present application and that it may be implemented in various ways. Well-known and/or repeated functions and constructions are not described in detail to avoid obscuring the application of unnecessary or unnecessary detail. Therefore, specific structural and functional details herein are not intended to be limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present application in virtually any appropriately detailed structure.
The specification may use the phrases "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," which may each refer to one or more of the same or different embodiments in accordance with the application.
The embodiment of the application provides an information processing method applied to a head-mounted device 100, and as shown in fig. 1, the information processing method includes steps S101 to S104. The head-mounted device 100 can be understood as a display device capable of realizing different effects such as Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR) and the like, when the wearer wears the head-mounted device 100, the eyes of the wearer are shielded by the head-mounted device 100, the attention of the wearer is concentrated, and the wearer cannot timely identify risks in the surrounding environment.
As shown in fig. 1, step S101: at least one physiological parameter of the wearer is acquired.
Step S102: and evaluating the attention of the wearer according to the physiological parameters to obtain an evaluation result.
Step S103: and switching the working mode of the environment sensing module of the head-mounted device 100 according to the evaluation result.
Step S104: assessing an environmental risk based on the switched mode of operation of the environmental awareness module, and controlling a physical state of at least one component of the head mounted device 100 based on the assessed environmental risk, the change in the physical state of the at least one component being related to the wearer's attention.
In one embodiment, the physiological parameter at least includes at least one of eyeball data, heart rate data and electroencephalogram data, the data included in the physiological parameter is not specifically limited, and the attention of the wearer can be determined through the physiological parameter.
In an embodiment, the acquisition of the physiological parameters may be performed by a sensor of the head-mounted device 100, or the physiological parameters of the wearer may be acquired by a smart device (e.g., an electronic device such as a smart phone, a smart tablet, a smart watch, smart glasses, etc.) in communication connection with the head-mounted device 100, for example, the smart watch worn by the wearer may acquire heart rate data of the wearer, the smart glasses may acquire eyeball data of the wearer, and the acquired physiological parameters are also sent to the head-mounted device 100.
In one embodiment, when the attention of the wearer is evaluated according to the physiological parameters, a preset threshold value may be set for the physiological parameters, the acquired physiological parameters are compared with the preset threshold value, and the evaluation of the attention of the wearer is realized according to the comparison result, for example, a heart rate threshold value of the wearer is set, and when the acquired heart rate data exceeds the heart rate threshold value, the evaluation result may indicate that the wearer is in a state of high concentration of attention, and the perception capability of the wearer on the environmental risk is reduced; when the acquired heart rate data is lower than the heart rate threshold, the evaluation result may indicate that the wearer is not in a state of high concentration, and the sensing capability of the wearer on the environmental risk enables the wearer to sense the environmental risk without the assistance of the environmental sensing module of the head-mounted device 100 to sense the environment.
In one embodiment, after obtaining the evaluation result, the operating mode of the environmental awareness module may be switched according to the evaluation result, and it may be understood that different evaluation results may cause the environmental awareness module to switch to different operating modes, for example, the evaluation result may be divided into a plurality of levels according to the concentration degree of attention, the evaluation result corresponding to the high concentration of attention is a first level, the evaluation result corresponding to the normal state of attention is a second level, and the evaluation result corresponding to the low concentration state of attention is a third level. The working mode of the environment sensing module can be divided into a plurality of grades according to the evaluation result, for example, the working mode of the environment sensing module can be switched into a high sensing mode under the condition that the evaluation result is in a first grade; in the case that the evaluation result is at the second level and/or the third level, the operation mode of the environment sensing module may be switched to the low sensing mode.
Therefore, the working mode of the environment sensing module can be adaptively adjusted according to different evaluation results, so that under the condition that the attention of a wearer is highly concentrated, the sensing capability of the environment sensing module is improved to assist the wearer to identify obstacles in the environment, the dangerous condition is avoided, the sensing capability of the environment sensing module can be reduced under the condition that the attention of the wearer is not highly concentrated, the wearer can identify the environmental risk through the self sensing capability, and the power consumption required by the work of the environment sensing module is reduced.
In one embodiment, the environmental awareness modules may evaluate the environmental risk in various manners, such as identifying an environmental obstacle, collecting a moving speed of a wearer, collecting a distance between the obstacle and the wearer, and the like, and when the number of the environmental awareness modules is plural, each environmental awareness module may evaluate the environmental risk in different manners, and comprehensively evaluate the environmental risk by combining the results sensed by each environmental awareness module.
In one embodiment, after determining the environmental risk, the wearer may be reminded by controlling a physical state of at least one component of the head-mounted device 100, where the physical state may be understood as a display state of the component on the head-mounted device 100, a contact state with the wearer, a sound state, and the like, and in short, the change in the physical state may remind the wearer of the environmental risk in time, so that the wearer may avoid the risk in time, and the safety of the wearer wearing the head-mounted device 100 may be improved.
This is disclosed through the aassessment to wearer's attention, can confirm the mode of operation of environmental perception module, in order when environmental perception module perception reaches the certain degree to environmental risk, accessible environmental perception module assists the wearer to improve its perception ability to environmental risk, and when environmental perception module perception reaches the certain degree, the accessible is to the control of the physical state of the part of wear-type equipment 100 in time suggestion wearer, prevent the emergence of dangerous condition effectively, make the wearer can in time avoid the barrier in the environment.
In some embodiments, step S103: the switching the working mode of the environment sensing module of the head-mounted device 100 according to the evaluation result specifically includes step S201.
Step S201: controlling the environment sensing module to switch between a first working mode and a second working mode; the environment sensing module has different power consumption and/or different environment sensing capability in the first working mode and the second working mode.
In one embodiment, the operation mode of the environmental awareness module has an association relationship with the evaluation result, that is, after the evaluation result is determined, it may be determined whether the environmental awareness module is kept in the current first operation mode or the current second operation mode, or switched to an operation mode different from the current operation mode.
In one embodiment, the power consumption may be related to the sensing capability of the environment sensing module, and a high power consumption corresponds to a high sensing capability and a low power consumption corresponds to a low sensing capability. The adjustment of the power consumption of the environment sensing module can be realized by controlling the opening degree, the working time, the opening and closing quantity and the like of the environment sensing module.
In one embodiment, the above-mentioned environment sensing capability may be related to a sensing angle, a sensing range, a working time, etc. of the environment sensing module, it can be understood that the poorer the sensing capability of the wearer to the environment, the more the environment sensing module is needed to improve the sensing capability to assist the wearer in sensing the environment; the perception capability of the environment perception module can be reduced under the condition that the perception capability of the wearer to the environment is strong, so that the safety can be guaranteed, and the power consumption of the head-mounted device 100 can be reduced.
In some embodiments, as shown in fig. 2 and 3, the environment sensing module includes at least one of an image acquisition module 1, a position acquisition module 2, and a speed acquisition module 3, and the information processing method further includes:
dynamically adjusting the power consumption of the image acquisition module 1 according to the working mode, so that the power consumption of the image acquisition module 1 in the first working mode is lower than that in the second working mode; and/or
Dynamically adjusting the power consumption of the position acquisition module 2 according to the working mode, so that the power consumption of the position acquisition module 2 in the first working mode is lower than that in the second working mode; and/or
And dynamically adjusting the power consumption of the speed acquisition module 3 according to the working mode, so that the power consumption of the speed acquisition module 3 in the first working mode is lower than that in the second working mode.
In an embodiment, as shown in fig. 2, the image capturing module 1 may be disposed between two lenses 4 of the head-mounted device 100, may also be disposed on a temple, or may be disposed on a smart device (e.g., an electronic device such as a smart phone, a smart tablet, a smart watch, and smart glasses) in communication with the head-mounted device 100, and acquires image information of an environment around a wearer through the smart device to capture the image information of the environment around the wearer. Specifically, the obstacle in the environment and the distance between the obstacle and the wearer can be determined through the image information, so that the image acquisition module 1 enters a first working mode, namely the image acquisition module 1 enters a low power consumption mode, under the condition that the evaluation result represents that the environment perception capability of the wearer is strong; and under the condition that the evaluation result represents that the environmental perception capability of the wearer is poor, the image acquisition module 1 is enabled to enter a second working mode, namely, the image acquisition module 1 enters a high power consumption mode.
In an embodiment, as shown in fig. 2, the position acquisition module 2 may be disposed on a temple of the head-mounted device 100 to acquire real-time position information of a wearer, and of course, the position acquisition module 2 may also be disposed on an intelligent device (such as an electronic device, such as a smart phone, a smart tablet, a smart watch, and smart glasses) in communication connection with the head-mounted device 100, and acquire the real-time position information of the wearer through the intelligent device, so that the position acquisition module 2 enters a first working mode, that is, the position acquisition module 2 enters a low power consumption mode, and at this time, the position acquisition module 2 may even be turned off, when an evaluation result represents that an environment perception capability of the wearer is strong; under the condition that the evaluation result represents that the environmental perception capability of the wearer is poor, the position acquisition module 2 is enabled to enter a second working mode, namely the position acquisition module 2 enters a high power consumption mode and is always kept in a state of being capable of acquiring the position of the wearer in real time.
In an embodiment, as shown in fig. 2, the speed acquisition module 3 may be disposed on a temple of the head-mounted device 100 to acquire real-time displacement speed information of a wearer, and of course, the speed acquisition module 3 may also be disposed on an intelligent device (e.g., an electronic device such as a smart phone, a smart tablet, a smart watch, and smart glasses) in communication connection with the head-mounted device 100, and acquire the real-time displacement speed information of the wearer through the intelligent device, so that the speed acquisition module 3 enters a first working mode, that is, the speed acquisition module 3 enters a low power consumption mode, and at this time, the speed acquisition module 3 may even be turned off when an evaluation result represents that an environment perception capability of the wearer is strong; under the condition that the evaluation result represents that the environmental perception capability of the wearer is poor, the speed acquisition module 3 enters a second working mode, namely the speed acquisition module 3 enters a high power consumption mode and is always kept in a state of acquiring the displacement speed of the wearer in real time.
In some embodiments, the environment sensing module includes at least one of an image acquisition module 1, a position acquisition module 2, and a speed acquisition module 3, and the information processing method further includes:
dynamically adjusting the environment perception capability of the image acquisition module 1 according to the working mode, so that the environment perception capability of the image acquisition module 1 in the first working mode is lower than that in the second working mode; wherein, the environment perception capability of the image acquisition module 1 is at least related to the number of the modules started and the detection angle of the modules; and/or
Dynamically adjusting the environment perception capability of the position acquisition module 2 according to the working mode, so that the environment perception capability of the position acquisition module 2 in the first working mode is lower than that in the second working mode; the environment perception capability of the position acquisition module 2 is at least related to the position updating frequency and the module working state; and/or
Dynamically adjusting the environment sensing capability of the speed acquisition module 3 according to the working mode, so that the environment sensing capability of the speed acquisition module 3 in the first working mode is lower than that in the second working mode; the environment sensing ability of the speed acquisition module 3 is at least related to the speed updating frequency and the module working state.
In one embodiment, the number of module openings of the image capturing module 1 in the first operating mode may be smaller than the number of module openings of the image capturing module 1 in the second operating mode, so as to adjust the power consumption of the image capturing module 1 by adjusting the number of module openings. The module detection angle of the image capturing module 1 in the first operating mode may be smaller than the module detection angle of the image capturing module 1 in the second operating mode, so as to adjust the power consumption of the image capturing module 1 by adjusting the module detection angle.
In one embodiment, as shown in fig. 4, the number of the image capturing modules 1 may be multiple, and the multiple image capturing modules 1 are respectively disposed between the two lenses 4 and on the two temples, so that the problem of limitation of the detection angle is improved, and the environment can be sensed from the front and the left and right sides of the wearer. The plurality of image acquisition modules 1 can be matched with each other to detect the environment, for example, the image acquisition module 1 positioned between the two lenses 4 is opened, and the image acquisition module 1 positioned on the glasses legs is closed; or the image acquisition module 1 positioned between the two lenses 4 is opened, the image acquisition module 1 positioned on one of the temples is closed, the image acquisition module 1 positioned on the other temples is opened, and the like, so as to cooperate with the detection of the environment of the wearer.
In one embodiment, the position update frequency of the position acquisition module 2 in the first operation mode may be less than the position update frequency of the position acquisition module 2 in the second operation mode, so as to adjust the power consumption of the position acquisition module 2 by adjusting the position update frequency. The power consumption corresponding to the operating state of the position acquisition module 2 in the first operating mode may be smaller than the power consumption corresponding to the operating state of the position acquisition module 2 in the second operating mode, for example, the position acquisition module 2 is turned off in the first operating mode, and the position acquisition module 2 is turned on in the second operating mode, so as to adjust the power consumption of the position acquisition module 2 by adjusting the operating state of the position acquisition module 2.
In one embodiment, the speed update frequency of the speed acquisition module 3 in the first operation mode may be less than the speed update frequency of the speed acquisition module 3 in the second operation mode, so as to adjust the power consumption of the speed acquisition module 3 by adjusting the speed update frequency. The power consumption corresponding to the operating state of the speed acquisition module 3 in the first operating mode may be smaller than the power consumption corresponding to the operating state of the speed acquisition module 3 in the second operating mode, for example, the speed acquisition module 3 is turned off in the first operating mode, and the speed acquisition module 3 is turned on in the second operating mode, so as to adjust the power consumption of the speed acquisition module 3 by adjusting the operating state of the speed acquisition module 3.
In some embodiments, step S104: the controlling a physical state of at least one component of the head mounted device 100 based on the assessed environmental risk specifically includes:
controlling at least one physical state of a display state, a sound state, and a contact state of at least one component of the head mounted device 100 according to the assessed environmental risk.
In one embodiment, the adjustment of the display state may be understood as the head-mounted device 100 presenting the corresponding display content to the wearer according to the environmental risk, and may also be understood as the head-mounted device 100 switching from an occlusion state occluding the wearer's vision to an exposure state undoing the occlusion of the wearer's vision.
In one embodiment, the sound state may be understood as playing sound through the audio module 5 of the head-mounted device 100 to prompt the wearer of the environmental risk of the environment in which the wearer is located, and the audio module 5 may also be disposed on a smart device communicatively connected to the head-mounted device 100, and the wearer may be prompted by emitting sound through the smart device.
In one embodiment, the contact state can be understood as indicating a risk of repayment to the wearer by the operating state of the contact module 6 in contact with the skin of the wearer, such as by means of cold compress, hot compress and micro-current stimulation.
In some embodiments, as shown in fig. 2, the head mounted device 100 may include at least a lens 4, an audio module 5, and a contact module 6. The controlling the display state of the head mounted device 100 specifically includes: manipulating the lens 4 transparency and/or presentation content of the head-mounted device 100 according to the assessed environmental risk. The controlling the sound state of the head mounted device 100 specifically includes: the audio module 5 of the head mounted device 100 is manipulated according to the assessed environmental risk. The controlling the contact state of the head mounted device 100 specifically includes: the contact module 6 of the head mounted device 100 is manipulated according to the assessed environmental risk.
In some embodiments, the controlling of the switching of the operation mode of the environment sensing module of the head-mounted device 100 according to the evaluation result specifically includes;
determining a risk level based on the evaluation result;
dynamically adjusting the operating mode according to the risk level.
In one embodiment, the risk levels may be divided into a plurality of levels from high to low, different risk levels correspond to different working modes, and whether the working mode of the current environmental awareness module needs to be switched or not can be determined through the determined risk, so that the working mode of the environmental awareness module corresponds to the risk level of the evaluation result.
The embodiment of the present application further provides a head-mounted device 100, as shown in fig. 5, the head-mounted device 100 includes one or more sensors 101, an evaluation module 102, a mode switching module 103, and a control module 104. The one or more sensors 101 are configured to acquire at least one physiological parameter of the wearer. The evaluation module 102 is configured to evaluate the attention of the wearer based on the physiological parameter to obtain an evaluation result. The mode switching module 103 is configured to switch the operation mode of the environment sensing module 105 of the head-mounted device 100 according to the evaluation result. The control module 104 is configured to evaluate the environmental risk based on the switched operation mode of the environmental awareness module 105, and issue a manipulation instruction to control a physical state of at least one component of the head-mounted device 100, the change in the physical state of the at least one component being related to the attention-related physical change of the wearer, based on the evaluated environmental risk.
This is disclosed through the aassessment to the attention of wearer, can confirm the mode of operation of environmental perception module 105, in order when environmental perception module 105 perception reaches the certain degree to environmental risk, accessible environmental perception module 105 assists the wearer to improve its perception ability to environmental risk, and when environmental perception module 105 perception reaches the certain degree, the accessible is to the control of the physical state of the part of wear-type equipment 100 in time suggestion wearer, prevent the emergence of dangerous condition effectively, make the wearer can in time avoid the barrier in the environment.
In some embodiments, as shown in fig. 6, the head-mounted device 100 may further include a context awareness module 105, the context awareness module 105 including at least one of an image acquisition module 1, a position acquisition module 2, and a speed acquisition module 3;
the power consumption of the image acquisition module 1 in the first working mode is lower than that in the second working mode, and/or the environment perception capability of the image acquisition module 1 in the first working mode is lower than that in the second working mode;
the power consumption of the position acquisition module 2 in the first working mode is lower than that in the second working mode, and/or the environment sensing capability of the position acquisition module 2 in the first working mode is lower than that in the second working mode;
the power consumption of the speed acquisition module 3 in the first working mode is lower than that in the second working mode, and/or the environment sensing capability of the speed acquisition module 3 in the first working mode is lower than that in the second working mode.
In an embodiment, as shown in fig. 2, the image capturing module 1 may be disposed between two lenses 4 of the head-mounted device 100, may also be disposed on a temple, or may be disposed on a smart device (e.g., an electronic device such as a smart phone, a smart tablet, a smart watch, and smart glasses) in communication with the head-mounted device 100, and acquires image information of an environment around a wearer through the smart device to capture the image information of the environment around the wearer. Specifically, the obstacle in the environment and the distance between the obstacle and the wearer can be determined through the image information, so that the image acquisition module 1 enters a first working mode, namely the image acquisition module 1 enters a low power consumption mode, under the condition that the evaluation result represents that the environment perception capability of the wearer is strong; and under the condition that the evaluation result represents that the environmental perception capability of the wearer is poor, the image acquisition module 1 is enabled to enter a second working mode, namely, the image acquisition module 1 enters a high power consumption mode.
In an embodiment, as shown in fig. 2, the position acquisition module 2 may be disposed on a temple of the head-mounted device 100 to acquire real-time position information of a wearer, and of course, the position acquisition module 2 may also be disposed on an intelligent device (such as an electronic device, such as a smart phone, a smart tablet, a smart watch, and smart glasses) in communication connection with the head-mounted device 100, and acquire the real-time position information of the wearer through the intelligent device, so that the position acquisition module 2 enters a first working mode, that is, the position acquisition module 2 enters a low power consumption mode, and at this time, the position acquisition module 2 may even be turned off, when an evaluation result represents that an environment perception capability of the wearer is strong; under the condition that the evaluation result represents that the environmental perception capability of the wearer is poor, the position acquisition module 2 is enabled to enter a second working mode, namely the position acquisition module 2 enters a high power consumption mode and is always kept in a state of being capable of acquiring the position of the wearer in real time.
In an embodiment, as shown in fig. 2, the speed acquisition module 3 may be disposed on a temple of the head-mounted device 100 to acquire real-time displacement speed information of a wearer, and of course, the speed acquisition module 3 may also be disposed on an intelligent device (e.g., an electronic device such as a smart phone, a smart tablet, a smart watch, and smart glasses) in communication connection with the head-mounted device 100, and acquire the real-time displacement speed information of the wearer through the intelligent device, so that the speed acquisition module 3 enters a first working mode, that is, the speed acquisition module 3 enters a low power consumption mode, and at this time, the speed acquisition module 3 may even be turned off when an evaluation result represents that an environment perception capability of the wearer is strong; under the condition that the evaluation result represents that the environmental perception capability of the wearer is poor, the speed acquisition module 3 enters a second working mode, namely the speed acquisition module 3 enters a high power consumption mode and is always kept in a state of acquiring the displacement speed of the wearer in real time.
In some embodiments, the components of the head mounted device 100 include at least one of a lens 4, an audio module 5, and a contact module 6, the control module 104 further configured to: manipulating lens 4 transparency and/or presentation content of the head-mounted device 100 according to the assessed environmental risk; controlling the sound state of the head mounted device 100 specifically includes: manipulating the audio module 5 of the head-mounted device 100 according to the assessed environmental risk; controlling the contact state of the head mounted device 100 specifically includes: the contact module 6 of the head mounted device 100 is manipulated according to the assessed environmental risk.
The various component embodiments of the present application may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functionality of some or all of the components in a system according to embodiments of the present application. The present application may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present application may be stored on a computer readable medium or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form. Further, the application may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
Moreover, although exemplary embodiments have been described herein, the scope thereof includes any and all embodiments based on the present application with equivalent elements, modifications, omissions, combinations (e.g., of various embodiments across), adaptations or alterations. The elements of the claims are to be interpreted broadly based on the language employed in the claims and not limited to examples described in the present specification or during the prosecution of the application, which examples are to be construed as non-exclusive. It is intended, therefore, that the specification and examples be considered as exemplary only, with a true scope and spirit being indicated by the following claims and their full scope of equivalents.
The above description is intended to be illustrative and not restrictive. For example, the above-described examples (or one or more versions thereof) may be used in combination with each other. For example, other embodiments may be used by those of ordinary skill in the art upon reading the above description. In addition, in the above detailed description, various features may be grouped together to streamline the application. This should not be interpreted as an intention that a disclosed feature not claimed is essential to any claim. Rather, subject matter of the present application can lie in less than all features of a particular disclosed embodiment. Thus, the following claims are hereby incorporated into the detailed description as examples or embodiments, with each claim standing on its own as a separate embodiment, and it is contemplated that these embodiments may be combined with each other in various combinations or permutations. The scope of the application should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.
The above embodiments are only exemplary embodiments of the present application, and are not intended to limit the present application, and the protection scope of the present application is defined by the claims. Various modifications and equivalents may be made by those skilled in the art within the spirit and scope of the present application and such modifications and equivalents should also be considered to be within the scope of the present application.

Claims (10)

1. An information processing method applied to a head-mounted device, the method comprising:
acquiring at least one physiological parameter of a wearer;
evaluating the attention of the wearer according to the physiological parameters to obtain an evaluation result;
switching the working mode of an environment sensing module of the head-mounted equipment according to the evaluation result;
assessing an environmental risk based on the switched operating mode of the environmental awareness module, controlling a physical state of at least one component of the head-mounted device based on the assessed environmental risk, the change in the physical state of the at least one component being related to the wearer's attention.
2. The information processing method according to claim 1, wherein switching the operating mode of the environment sensing module of the head-mounted device according to the evaluation result specifically includes:
controlling the environment sensing module to switch between a first working mode and a second working mode; the environment sensing module has different power consumption and/or different environment sensing capability in the first working mode and the second working mode.
3. The information processing method of claim 2, wherein the context awareness module comprises at least one of an image acquisition module, a location acquisition module, and a velocity acquisition module, the method further comprising:
dynamically adjusting the power consumption of the image acquisition module according to the working mode to ensure that the power consumption of the image acquisition module in the first working mode is lower than that in the second working mode; and/or
Dynamically adjusting the power consumption of the position acquisition module according to the working mode to ensure that the power consumption of the position acquisition module in the first working mode is lower than that in the second working mode; and/or
And dynamically adjusting the power consumption of the speed acquisition module according to the working mode, so that the power consumption of the speed acquisition module in the first working mode is lower than that in the second working mode.
4. The information processing method of claim 2, wherein the context awareness module comprises at least one of an image acquisition module, a location acquisition module, and a velocity acquisition module, the method further comprising:
dynamically adjusting the environment perception capability of the image acquisition module according to the working mode, so that the environment perception capability of the image acquisition module in a first working mode is lower than that in a second working mode; the environment perception capability of the image acquisition module is at least related to the number of the opened modules and the detection angle of the modules; and/or
Dynamically adjusting the environment perception capability of the position acquisition module according to the working mode, so that the environment perception capability of the position acquisition module in a first working mode is lower than that in a second working mode; the environment perception capability of the position acquisition module is at least related to the position updating frequency and the working state of the module; and/or
Dynamically adjusting the environment perception capability of the speed acquisition module according to the working mode, so that the environment perception capability of the speed acquisition module in the first working mode is lower than that in the second working mode; the environment perception capability of the speed acquisition module is at least related to the speed updating frequency and the working state of the module.
5. The information processing method according to claim 1, wherein the controlling a physical state of at least one component of the head-mounted device based on the assessed environmental risk specifically comprises:
controlling at least one physical state of a display state, a sound state, and a contact state of at least one component of the head-mounted device according to the assessed environmental risk.
6. The information processing method according to claim 5,
controlling the display state of the head mounted device specifically includes: manipulating lens transparency and/or presentation content of the head-mounted device according to the assessed environmental risk;
controlling the sound state of the head mounted device specifically includes: controlling an audio module of the head-mounted device according to the assessed environmental risk;
controlling the contact state of the head mounted device specifically includes: manipulating a contact module of the head-mounted device according to the assessed environmental risk.
7. The information processing method according to claim 1, wherein the controlling of switching of the operation mode of the environment sensing module of the head-mounted device according to the evaluation result specifically includes;
determining a risk level based on the evaluation result;
dynamically adjusting the operating mode according to the risk level.
8. A head-mounted device, comprising:
one or more sensors configured to acquire at least one physiological parameter of the wearer;
an evaluation module configured to evaluate the attention of the wearer according to the physiological parameter to obtain an evaluation result;
a mode switching module configured to switch an operation mode of an environment sensing module of the head-mounted device according to the evaluation result;
a control module configured to evaluate an environmental risk based on the switched operating mode of the environmental awareness module, and issue a manipulation instruction to control a physical state of at least one component of the head-mounted device based on the evaluated environmental risk, the change in the physical state of the at least one component being related to the attention-related physical change of the wearer.
9. The head-mounted device of claim 8, wherein the context awareness module comprises at least one of an image acquisition module, a location acquisition module, and a velocity acquisition module;
the power consumption of the image acquisition module in the first working mode is lower than that in the second working mode, and/or the environment perception capability of the image acquisition module in the first working mode is lower than that in the second working mode;
the power consumption of the position acquisition module in the first working mode is lower than that in the second working mode, and/or the environment sensing capability of the position acquisition module in the first working mode is lower than that in the second working mode;
the power consumption of the speed acquisition module in the first working mode is lower than that in the second working mode, and/or the environment sensing capability of the speed acquisition module in the first working mode is lower than that in the second working mode.
10. The head mounted device of claim 8, wherein the components of the head mounted device include at least one of a lens, an audio module, and a contact module,
the control module is further configured to: manipulating lens transparency and/or presentation content of the head-mounted device according to the assessed environmental risk;
controlling the sound state of the head mounted device specifically includes: controlling an audio module of the head-mounted device according to the assessed environmental risk;
controlling the contact state of the head mounted device specifically includes: manipulating a contact module of the head-mounted device according to the assessed environmental risk.
CN202111670507.4A 2021-12-31 2021-12-31 Information processing method and head-mounted device Pending CN114327070A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111670507.4A CN114327070A (en) 2021-12-31 2021-12-31 Information processing method and head-mounted device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111670507.4A CN114327070A (en) 2021-12-31 2021-12-31 Information processing method and head-mounted device

Publications (1)

Publication Number Publication Date
CN114327070A true CN114327070A (en) 2022-04-12

Family

ID=81020560

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111670507.4A Pending CN114327070A (en) 2021-12-31 2021-12-31 Information processing method and head-mounted device

Country Status (1)

Country Link
CN (1) CN114327070A (en)

Similar Documents

Publication Publication Date Title
EP3709861B1 (en) Systems for visual field analysis
US10915180B2 (en) Systems and methods for monitoring a user's eye
CN105164576B (en) The method that the wear-type electro-optic device for adapting to wearer is controlled
Lee et al. The comparative measurements of eyestrain caused by 2D and 3D displays
US10281980B2 (en) System and method for eye-reactive display
CN101409784A (en) Camera device and information-prompting apparatus
JP2017534957A (en) Display that reduces eye discomfort
Lee et al. Measuring the degree of eyestrain caused by watching LCD and PDP devices
KR20190141684A (en) SYSTEM FOR ASSESSING A HEALTH CONDITION OF A USER
CN113693552A (en) Visual fatigue monitoring method and device, electronic equipment and readable storage medium
CN105512613A (en) Smartphone-based eye fatigue detection method
CN110353671B (en) Visual fixation position measuring method based on video modulation and electroencephalogram signals
Alam et al. Active vision-based attention monitoring system for non-distracted driving
US11947722B2 (en) Devices and headsets
CN114327070A (en) Information processing method and head-mounted device
CN117056872A (en) Advanced brain fatigue prediction method
TWI699672B (en) Method and device for recognizing visual control commands by brain wave signal
CN115132364B (en) Myopia risk determination method and device, storage medium and wearable device
US10503252B2 (en) System and method for eye-reactive display
CN113132642A (en) Image display method and device and electronic equipment
Wong et al. Automatic pupillary light reflex detection in eyewear computing
Kim et al. A new objective visual fatigue measurement system by using a remote infrared camera
KR20210072350A (en) Rendering method based on eye movement state from electrooculography measurement
CN115665399B (en) 3D display switching method based on liquid crystal grating
Penedo et al. Gaze behavior data in the vitrine of human movement science: considerations on eye-tracking technique

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination