CN110730939A - Information prompting method, device and equipment for head-mounted display - Google Patents
Information prompting method, device and equipment for head-mounted display Download PDFInfo
- Publication number
- CN110730939A CN110730939A CN201780091698.4A CN201780091698A CN110730939A CN 110730939 A CN110730939 A CN 110730939A CN 201780091698 A CN201780091698 A CN 201780091698A CN 110730939 A CN110730939 A CN 110730939A
- Authority
- CN
- China
- Prior art keywords
- information
- head
- mounted display
- user
- prompting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
Abstract
An information prompting method and device for a head-mounted display, the head-mounted display and a storage medium. The method comprises the following steps: when it is detected that the user uses the head-mounted display, acquiring outside information of an environment where the head-mounted display is currently located (S110); determining whether the head mounted display is currently in a target scene according to external information (S120); if yes, monitoring external voice information of the current environment (S130); judging whether the external voice information meets preset information reminding conditions or not (S140); if yes, prompting the user to pay attention according to a preset reminding mode (S150). The method can ensure that important notification information in the external environment is provided for the user while the user enjoys immersion experience brought by the head-mounted display, and improves the use experience of the user.
Description
The present application relates to the field of information processing technologies, and in particular, to an information prompting method and apparatus for a head-mounted display, and a storage medium.
A Head Mounted Display (HMD) transmits optical signals to eyes of a wearer, and different effects such as Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), and the like can be achieved. Currently, a head-mounted display generally has a voice noise elimination function, so that when a user wears the head-mounted display to watch a movie, audio or play a game, the head-mounted display can be isolated from the outside, so that the user can really experience a sense of being "personally on the scene" in a "sealed" environment. However, such immersion experience often brings great potential safety hazards to users, and unnecessary property loss and personal safety problems are caused.
Disclosure of Invention
The object of the present application is to solve at least to some extent one of the above mentioned technical problems.
To this end, a first object of the present application is to propose an information prompting method for use on a head-mounted display. The method can ensure that important notification information in the external environment is provided for the user while the user enjoys immersion experience brought by the head-mounted display, and improves the use experience of the user.
A second object of the present application is to provide an information prompting device for use on a head-mounted display.
A third object of the present application is to propose a head mounted display.
A fourth object of the present application is to propose a computer readable storage medium.
In order to achieve the above object, an embodiment of the first aspect of the present application provides an information prompting method for a head-mounted display, including: when the fact that a user uses the head-mounted display is detected, acquiring external information of the current environment where the head-mounted display is located; judging whether the head-mounted display is currently in a target scene or not according to the external information; if the head-mounted display is currently located in the target scene, monitoring external voice information of the current environment; judging whether the external voice information meets preset information reminding conditions or not; and if the external voice information meets the information reminding condition, reminding the user to pay attention according to a preset reminding mode.
According to the information prompting method for the head-mounted display, when the fact that a user uses the head-mounted display is detected, acquiring external information of the current environment where the head-mounted display is located, judging whether the head-mounted display is located in a target scene or not according to the external information, if so, monitoring external voice information of the current environment, and judging whether the external voice information meets preset information prompting conditions or not; and if so, prompting the attention of the user according to a preset prompting mode. The user enjoys the experience of immersing that the head mounted display brought promptly, still can guarantee to provide the user with the important notice information in the external environment, avoids the important external information of mistake when the user is in important function place, avoids the emergence of potential safety hazard problem, guarantees user's property and personal safety, has promoted user's use and has experienced.
In order to achieve the above object, an embodiment of a second aspect of the present application provides an information prompting apparatus for a head-mounted display, including: the first acquisition module is used for acquiring the outside information of the current environment of the head-mounted display when the head-mounted display is detected to be used by a user; the first judgment module is used for judging whether the head-mounted display is in a target scene currently or not according to the external information; the monitoring module is used for monitoring the external voice information of the current environment when the head-mounted display is currently in the target scene; the second judgment module is used for judging whether the external voice information meets a preset information reminding condition or not; and the prompting module is used for prompting the attention of the user according to a preset prompting mode when the external voice information meets the information prompting condition.
According to the information prompting device for the head-mounted display, when it is detected that the user uses the head-mounted display, the first obtaining module can obtain the external information of the current environment of the head-mounted display, the first judging module judges whether the head-mounted display is currently in the target scene according to the external information, if so, the monitoring module monitors the external voice information of the current environment, and the second judging module judges whether the external voice information meets the preset information prompting condition; if yes, the prompting module prompts the attention of the user according to a preset prompting mode. The user enjoys the experience of immersing that the head mounted display brought promptly, still can guarantee to provide the user with the important notice information in the external environment, avoids the important external information of mistake when the user is in important function place, avoids the emergence of potential safety hazard problem, guarantees user's property and personal safety, has promoted user's use and has experienced.
In order to achieve the above object, a head-mounted display according to an embodiment of the third aspect of the present application includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the information prompting method for a head-mounted display according to the embodiment of the first aspect of the present application.
To achieve the above object, a non-transitory computer-readable storage medium is provided in an embodiment of a fourth aspect of the present application, on which a computer program is stored, and the computer program, when executed by a processor, implements the information prompting method for a head-mounted display according to the embodiment of the first aspect of the present application.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
The above and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which,
FIG. 1 is a flow diagram of a method for information prompting on a head mounted display according to one embodiment of the present application;
FIG. 2 is a flow diagram of a method for information prompting on a head mounted display according to another embodiment of the present application;
FIG. 3 is a schematic diagram of an information presentation device for use on a head mounted display according to one embodiment of the present application;
FIG. 4 is a schematic diagram of an information presentation device for use on a head mounted display according to another embodiment of the present application;
FIG. 5 is a schematic diagram of a head mounted display according to an embodiment of the present application.
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.
Currently, a head-mounted display generally has a voice noise elimination function, so that when a user wears the head-mounted display to watch a movie, audio or play a game, the head-mounted display can be isolated from the outside, so that the user can really experience a sense of being "personally on the scene" in a "sealed" environment. However, the immersion experience makes the user hardly hear the external important prompt information, for example, when taking a plane or train, the important information played in voice, such as dangerous information, etc., can be isolated by the noise-eliminating function of the head-mounted display and can be easily ignored by the user, which results in great potential safety hazard to the user.
Therefore, in order to solve the problem that when a user is completely immersed in the world of the HMD, an external prompt cannot be heard, which causes great potential safety hazards to the user, the application provides an information prompting method and device for a head-mounted display, the head-mounted display and a computer-readable storage medium, so that the user can not miss important external information while the user is immersed in experience. Specifically, an information presentation method and apparatus for use on a head-mounted display, and a computer-readable storage medium according to embodiments of the present application are described below with reference to the accompanying drawings.
Fig. 1 is a flow chart of a method for information prompting on a head mounted display according to one embodiment of the present application. It should be noted that the information presentation method for use in a head-mounted display according to the embodiment of the present application is applicable to the information presentation apparatus for use in a head-mounted display according to the embodiment of the present application. The information prompting device can be configured on the head-mounted display.
As shown in fig. 1, the method for prompting information on a head-mounted display may include:
and S110, when the fact that the user uses the head-mounted display is detected, acquiring outside information of the current environment where the head-mounted display is located.
It is understood that when the user wears the head-mounted display, the user usually watches a movie (or audio/video) or plays a game through the head-mounted display, so that in this step, whether the head-mounted display is turned on and worn on the head of the user can be monitored, and if so, the user can be detected to be using the head-mounted display. In the embodiment of the present application, it may be determined that the head mounted display is worn on the head of the user by: judging whether the eyes of the user can be scanned, if so, judging that the head-mounted display is worn on the head of the user; alternatively, a distance sensor (or an infrared sensor) is provided on a headset in the head-mounted display, and whether the headset is mounted in the ear of the user is detected by the distance sensor (or the infrared sensor), and if so, it can be determined that the head-mounted display is mounted on the head of the user. It is understood that the two examples given above for determining that the head mounted display is worn on the head of the user are only for the convenience of the user and should not be taken as a specific limitation of the present application.
When it is detected that the user uses the head-mounted display, the external information of the environment where the head-mounted display is currently located can be acquired in real time. As one example, the context information may include, but is not limited to, geographic location information, motion gesture information, and altitude information.
For example, when it is detected that the user uses the head-mounted display, the geographic location information of the current environment of the head-mounted display may be obtained through a GPS positioning system in the head-mounted display, the altitude information of the current environment of the head-mounted display may be measured through a barometer sensor in the head-mounted display, the current acceleration, tilt, shock, vibration, rotation, and multiple Degree of Freedom (DoF) motion parameters of the head-mounted display may be measured through an inertial sensor (including a gravity sensor and a gyroscope, for example), and the current motion attitude information of the head-mounted display, such as the high-speed motion on the ground, or the high-speed motion on high altitude, may be calculated according to the current acceleration, tilt, shock, vibration, rotation, and multiple Degree of Freedom (DoF) motion parameters, Or motion at the sea surface, etc.
And S120, judging whether the head-mounted display is in the target scene currently according to the external information.
In the embodiment of the present application, the target scene may include, but is not limited to, an airport waiting room, a train station waiting room, a bus station waiting room, a subway station waiting room, a ship waiting room, a train, a high-speed rail, an airplane, an automobile, a ship and the like.
Optionally, in an embodiment of the present application, when the external information includes geographic position information, motion posture information, and altitude information, the specific implementation process of determining whether the head mounted display is currently in the target scene according to the external information may be as follows: whether the head-mounted display is currently located in an important function place such as an airport waiting room, a railway station waiting room, a bus station waiting room, a subway station waiting room, a ship waiting room and the like can be judged according to the geographical position information, and if yes, the step S130 is continuously executed; otherwise, whether the head-mounted display is currently in high-speed motion such as trains, high-speed rails, airplanes, ships, automobiles and the like is further judged according to the geographical position information, the motion attitude information and the height information, and if so, the step S130 is continuously executed.
It should be noted that, in an embodiment of the present application, if it is determined that the head mounted display is not currently located in the target scene according to the external information, the step of obtaining the external information of the environment where the head mounted display is currently located, that is, the step of obtaining the external information of the environment where the head mounted display is currently located, may be continuously performed.
And S130, if the head-mounted display is currently in the target scene, monitoring the external voice information of the current environment.
Optionally, when it is determined that the head-mounted display is currently located in the target scene, the microphone of the head-mounted display may be turned on, and external voice information of an environment where the head-mounted display is currently located may be collected through the microphone, that is, the microphone starts to monitor external voice input.
And S140, judging whether the external voice information meets a preset information reminding condition.
Optionally, when the external voice information of the current environment is monitored, whether the external voice information is the information reminding condition or not may be determined. In the embodiment of the application, the condition that the information reminding condition is met can be used for indicating that the condition that the outside important notification information needs to be prompted to the user is met.
In this step, there are many implementation manners for determining that the external voice information satisfies the preset information prompting condition, and two implementation manners of different examples will be given below:
as an example, it may be determined whether the external voice message includes a preset broadcast alert ring, and if so, it is determined that the external voice message satisfies the message alert condition.
It can be understood that in important function places or when taking public transport means, the scenes broadcast some voices to remind users of some important notification information, and different broadcast prompting ring tones are usually used according to the grade degree of the notification information before broadcasting the important notification information, so that whether the external voice information meets the information reminding condition can be judged by judging whether the external voice information contains the broadcast prompting ring tone. For example, if the external voice message includes the broadcast prompting ringtone, it may be determined that the external voice message satisfies the message prompting condition, or else, it may be determined that the external voice message does not satisfy the message prompting condition.
As another example, the external voice information may be subjected to voice recognition to obtain corresponding text information, and whether the text information includes the target keyword is determined, if yes, it is determined that the external voice information satisfies the information reminding condition.
It can be understood that, in important functional places or when taking public transportation, these scenes broadcast some voices to remind users of some important notification information, and these important notification information usually contain some keywords attracting attention of users, in this step, it can be determined whether the external voice information satisfies the information reminding condition by determining whether the text information corresponding to the external voice information contains a specific target keyword. For example, the target keywords may include, but are not limited to: the method comprises the following steps of 'please pay attention to passengers', 'please pay attention to the airflow in the flight of the airplane and ask for the passengers to sit stably', 'please get on the airplane' and 'please get off the airplane right before the XXX station arrives', and the like.
It should be noted that, in the embodiment of the present application, when it is determined that the external voice information does not meet the preset information prompting condition, the external voice information of the current environment may be monitored continuously. Therefore, when the head-mounted display is used by a user, the voice of the external environment is monitored in real time, so that the user is prompted to pay attention when important external notification information is monitored.
And S150, if the external voice information meets the information reminding condition, reminding the user to pay attention according to a preset reminding mode.
Optionally, when it is determined that the external voice information satisfies the information reminding condition, the user may be prompted to pay attention in a voice broadcast, text display, or screen flashing reminding manner.
As an example implementation manner, when it is determined that the external voice information satisfies the information reminding condition, the voice noise elimination function in the head-mounted display may be turned off, and the internal volume of the head-mounted display may be reduced, so that the external voice information of the current environment is input into the head-mounted display and played to the user. For example, when the external voice information is determined to satisfy the information reminding condition, the voice noise elimination function in the head-mounted display can be turned off, and the system internal volume of the head-mounted display is reduced, so that the external sound is recorded through the microphone of the head-mounted display and then played to the internal headset, and the attention of the user is prompted.
As another example implementation, the external voice information may be converted into corresponding text information, and the text information may be displayed on a screen in the head-mounted display; and/or adjusting a screen backlight value in the head mounted display to cause the screen to blink. For example, the external voice information may be converted into text through TTS and the text may be displayed on a screen of the head-mounted display, for example, the text may be input into a system prompt box of the head-mounted display, and the system prompt box may be called and displayed on the screen. Further, the system setting of the head-mounted display can be triggered, the screen backlight value of the head-mounted display is adjusted, and a flickering effect is formed, so that the user is prompted to pay attention to important notification information input from the outside.
As yet another example implementation, a class type of the external voice information may be determined, and a color of the LED may be adjusted according to the class type, wherein the LED is located under a screen of the head-mounted display. For example, when the external voice message includes a broadcast prompting ring tone (e.g., a ring tone emitted by an alarm) used for an important level event, the level of the external voice message may be determined to be a highest level type, and the color of the LED may be adjusted to be red according to the highest level type, so as to alert the user that there is an important voice notification message in the current external environment, thereby prompting the user to pay attention. For another example, when the external voice message includes a broadcast prompting ring used for a normal level event (e.g., a ring for prompting a passenger to get on a car, etc.), it may be determined that the level of the external voice message is a normal level type, and at this time, the color of the LED may be adjusted to yellow according to the normal level type to remind the user that there is a voice notification message in the current external environment, so as to prompt the user to pay attention.
For another example, a target keyword in the text information corresponding to the external voice information may be obtained, and the urgency level corresponding to the target keyword may be determined to adjust the color of the LED, for example, a common notification prompt yellow LED, and an important safety-related prompt (prompt red); further, the method for identifying the urgency of the keyword is to classify the keyword, such as: the method is divided into general notifications (such as 'notification …', 'airplane prompt …' and the like) and life safety-related categories (such as 'airplane is about to take off', 'airplane meets air flow' and the like).
It should be noted that, for the three different examples of the step of prompting the user attention according to the preset prompting manner, the step of prompting the user attention according to the preset prompting manner may be implemented by any one of the examples described above, and the step of prompting the user attention according to the preset prompting manner may also be implemented by any two or three combined manners described above. That is to say, in an embodiment of the present application, the user may also be prompted to pay attention in a manner of voice broadcast plus text display; or prompting the attention of the user through a voice broadcast and LED color adjustment reminding mode; or prompting the attention of the user through a text display and LED color adjustment reminding mode; or prompting the attention of the user through a voice broadcast, text display and LED color adjustment reminding mode.
According to the information prompting method for the head-mounted display, when the fact that a user uses the head-mounted display is detected, acquiring external information of the current environment where the head-mounted display is located, judging whether the head-mounted display is located in a target scene or not according to the external information, if so, monitoring external voice information of the current environment, and judging whether the external voice information meets preset information prompting conditions or not; and if so, prompting the attention of the user according to a preset prompting mode. The user enjoys the experience of immersing that the head mounted display brought promptly, still can guarantee to provide the user with the important notice information in the external environment, avoids the important external information of mistake when the user is in important function place, avoids the emergence of potential safety hazard problem, guarantees user's property and personal safety, has promoted user's use and has experienced.
Fig. 2 is a flow chart of a method for information prompting on a head mounted display according to another embodiment of the present application. In order to further improve the use experience of the user, in the embodiment of the application, the important weather notification information related to the current position can be further obtained according to the geographic position information in the outside information, and the important weather notification information is provided for the user. Specifically, as shown in fig. 2, the method for prompting information on a head-mounted display may include:
s210, when it is detected that the user uses the head-mounted display, acquiring outside information of the current environment where the head-mounted display is located. As one example, the context information may include, but is not limited to, geographic location information, motion gesture information, and altitude information.
And S220, judging whether the head-mounted display is in the target scene currently according to the external information.
And S230, if the head-mounted display is currently in the target scene, monitoring the external voice information of the current environment.
And S240, judging whether the external voice information meets a preset information reminding condition.
In this step, there are many implementation manners for determining that the external voice information satisfies the preset information prompting condition, and two implementation manners of different examples will be given below:
as an example implementation manner, it may be determined whether the external voice information includes a preset broadcast prompting ringtone, and if so, it is determined that the external voice information satisfies the information prompting condition.
As another example implementation manner, voice recognition may be performed on the external voice information to obtain corresponding text information, and whether the text information includes a target keyword is determined, and if yes, it is determined that the external voice information satisfies an information reminding condition.
And S250, if the external voice information meets the information reminding condition, reminding the user to pay attention according to a preset reminding mode.
As an example implementation manner, the voice denoising function in the head-mounted display may be turned off, and the internal volume of the head-mounted display may be reduced, so that the external voice information of the current environment is input into the head-mounted display and played to the user.
As another example implementation, the external voice information may be converted into corresponding text information, and the text information may be displayed on a screen in the head-mounted display; and/or adjusting a screen backlight value in the head mounted display to cause the screen to blink.
As yet another example implementation, a class type of the external voice information may be determined, and a color of the LED may be adjusted according to the class type, wherein the LED is located under a screen of the head-mounted display.
It should be noted that, for the three different examples of the step of prompting the user attention according to the preset prompting manner, the step of prompting the user attention according to the preset prompting manner may be implemented by any one of the examples described above, and the step of prompting the user attention according to the preset prompting manner may also be implemented by any two or three combined manners described above. That is to say, in an embodiment of the present application, the user may also be prompted to pay attention in a manner of voice broadcast plus text display; or prompting the attention of the user through a voice broadcast and LED color adjustment reminding mode; or prompting the attention of the user through a text display and LED color adjustment reminding mode; or prompting the attention of the user through a voice broadcast, text display and LED color adjustment reminding mode.
And S260, acquiring important weather notification information related to the current position according to the geographical position information.
Optionally, when the geographical location information of the current environment of the head-mounted display is obtained through the GPS positioning system in the head-mounted display, important weather notification information related to the current location may be obtained according to the geographical location information, for example, for severe weather, according to weather prompts issued by provinces and cities (e.g., red rainstorm, typhoon, thunder, haze, etc.), and may also be an earthquake disaster (e.g., earthquake, tsunami, landslide, etc.).
And S270, providing important weather notification information to the user.
Specifically, after obtaining the important weather notification information, the important weather notification information may be used as an input to be input into the interior of the head-mounted display for prompt display, thereby providing the important weather notification information to the user. As an example, the implementation of providing the important weather notification information to the user may be as follows: the method is provided for users in a voice broadcast mode; or, the information is provided for the user in a text display mode; or, the method is provided for the user in a mode of voice broadcast and text display; or, the LED color is provided for the user in a mode of voice broadcasting and LED color adjustment; or, the color of the LED is provided for the user through a text display and adjustment mode; or the LED color adjusting method is provided for the user in a mode of voice broadcasting, text display and LED color adjusting.
According to the information prompting method for the head-mounted display, when the important notification information in the external environment is provided for the user, the important weather notification information related to the current position can be obtained according to the geographic position information in the external information, the important weather notification information is provided for the user, the situation that the user mistakenly gives important external information in an important function place is avoided, the potential safety hazard problem is avoided, the property and personal safety of the user is guaranteed, and the use experience of the user is further improved.
Corresponding to the information prompting methods for a head-mounted display provided in the above-mentioned several embodiments, an embodiment of the present application further provides an information prompting device for a head-mounted display, and since the information prompting device for a head-mounted display provided in the embodiment of the present application corresponds to the information prompting methods for a head-mounted display provided in the above-mentioned several embodiments, the foregoing embodiments of the information prompting method for a head-mounted display are also applicable to the information prompting device for a head-mounted display provided in the embodiment, and will not be described in detail in the embodiment. Fig. 3 is a schematic structural diagram of an information prompting device for a head-mounted display according to an embodiment of the present application. As shown in fig. 3, the information prompting device 300 for use on a head-mounted display may include: the device comprises a first obtaining module 310, a first judging module 320, a monitoring module 330, a second judging module 340 and a prompting module 350.
Specifically, the first obtaining module 310 is configured to obtain the external information of the environment where the head-mounted display is currently located when it is detected that the user uses the head-mounted display. As an example, the context information may include, but is not limited to, geographic location information, motion gesture information, altitude information, and the like.
The first determining module 320 is configured to determine whether the head mounted display is currently in the target scene according to the external information.
The monitoring module 330 is configured to monitor external voice information of a current environment when the head-mounted display is currently in a target scene.
The second determining module 340 is configured to determine whether the external voice information meets a preset information prompting condition. Optionally, there are many implementation manners for determining that the external voice information satisfies the preset information reminding condition, and two implementation manners of different examples will be given below:
as an example implementation manner, the second determining module 340 may determine whether the external voice message includes a preset broadcast prompting ringtone, and if so, determine that the external voice message satisfies the message prompting condition.
As another example implementation manner, the second determining module 340 may perform voice recognition on the external voice information to obtain corresponding text information, and determine whether the text information includes a target keyword, if so, determine that the external voice information satisfies the information reminding condition.
The prompting module 350 is configured to prompt the user to pay attention according to a preset prompting mode when the external voice information meets the information prompting condition.
As an example implementation manner, the prompt module 350 may turn off a voice denoising function in the head-mounted display and reduce the internal volume of the head-mounted display, so that external voice information of the current environment is input into the head-mounted display and played to the user.
As another example implementation, the prompt module 350 may convert the external voice information into corresponding text information and display the text information on a screen in the head-mounted display; and/or adjusting a screen backlight value in the head mounted display to cause the screen to blink.
As yet another example implementation, the prompt module 350 may determine a class type of the external voice information and adjust a color of the LED according to the class type, wherein the LED is located under a screen of the head-mounted display.
It should be noted that, for the three different examples of the step of prompting the user attention according to the preset prompting manner, the step of prompting the user attention according to the preset prompting manner may be implemented by any one of the examples described above, and the step of prompting the user attention according to the preset prompting manner may also be implemented by any two or three combined manners described above. That is to say, in an embodiment of the present application, the user may also be prompted to pay attention in a manner of voice broadcast plus text display; or prompting the attention of the user through a voice broadcast and LED color adjustment reminding mode; or prompting the attention of the user through a text display and LED color adjustment reminding mode; or prompting the attention of the user through a voice broadcast, text display and LED color adjustment reminding mode.
Optionally, in an embodiment of the present application, when the external information includes geographic location information, as shown in fig. 4, the information prompt apparatus 300 for use on a head-mounted display may further include: a second acquisition module 360 and a provision module 370. In the embodiment of the present application, the second obtaining module 360 is configured to obtain important weather notification information related to the current location according to the geographic location information. The providing module 370 is also used to provide important weather notification information to the user. Therefore, when the important notification information in the external environment is provided for the user, the important weather notification information related to the current position can be acquired according to the geographic position information in the external environment, the important weather notification information is provided for the user, the situation that the user mistakes the important external information when the user is in an important function place is avoided, the potential safety hazard problem is avoided, the property and personal safety of the user are guaranteed, and the use experience of the user is further improved.
According to the information prompting device for the head-mounted display, when it is detected that the user uses the head-mounted display, the first obtaining module can obtain the external information of the current environment of the head-mounted display, the first judging module judges whether the head-mounted display is currently in the target scene according to the external information, if so, the monitoring module monitors the external voice information of the current environment, and the second judging module judges whether the external voice information meets the preset information prompting condition; if yes, the prompting module prompts the attention of the user according to a preset prompting mode. The user enjoys the experience of immersing that the head mounted display brought promptly, still can guarantee to provide the user with the important notice information in the external environment, avoids the important external information of mistake when the user is in important function place, avoids the emergence of potential safety hazard problem, guarantees user's property and personal safety, has promoted user's use and has experienced.
In order to implement the above embodiments, the present application also proposes a head-mounted display.
FIG. 5 is a schematic diagram of a head mounted display according to an embodiment of the present application. As shown in fig. 5, the head-mounted display 500 may include: the information prompting method for the head-mounted display is implemented by the processor 520 when the processor 520 executes the program 530, wherein the program 530 is stored in the memory 510 and can be executed on the processor 520.
In order to implement the above embodiments, the present application also proposes a non-transitory computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the information prompting method for a head-mounted display according to any of the above embodiments of the present application.
In the description of the present application, it is to be understood that the terms "first", "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.
Claims (18)
- An information prompting method used on a head-mounted display is characterized by comprising the following steps:when the fact that a user uses the head-mounted display is detected, acquiring external information of the current environment where the head-mounted display is located;judging whether the head-mounted display is currently in a target scene or not according to the external information;if the head-mounted display is currently located in the target scene, monitoring external voice information of the current environment;judging whether the external voice information meets preset information reminding conditions or not;and if the external voice information meets the information reminding condition, reminding the user to pay attention according to a preset reminding mode.
- The method of claim 1, wherein the context information comprises geographic location information, motion gesture information, and altitude information.
- The method of claim 1, wherein the determining whether the external voice message satisfies a preset message alert condition comprises:judging whether the external voice information contains a preset broadcast prompting ring or not;and if so, judging that the external voice information meets the information reminding condition.
- The method of claim 1, wherein the determining whether the external voice message satisfies a preset message alert condition comprises:carrying out voice recognition on the external voice information to obtain corresponding text information;judging whether the text information contains a target keyword or not;and if so, judging that the external voice information meets the information reminding condition.
- The method according to any one of claims 1 to 4, wherein the prompting the user for attention according to a preset prompting manner comprises:turning off a voice noise cancellation function in the head-mounted display;and reducing the internal volume of the head-mounted display so as to enable the external voice information of the current environment to be input into the head-mounted display and played to the user.
- The method according to any one of claims 1 to 4, wherein the prompting the user for attention according to a preset prompting manner comprises:converting external voice information into corresponding text information, and displaying the text information on a screen in the head-mounted display; and/or the presence of a gas in the gas,adjusting a screen backlight value in the head mounted display to cause the screen to blink.
- The method according to any one of claims 1 to 4, wherein the prompting the user for attention according to a preset prompting manner comprises:determining the grade type of the external voice information;adjusting a color of an LED according to the class type, wherein the LED is located below a screen of the head-mounted display.
- The method of any of claims 1 to 4, wherein when the ambient information comprises geographic location information, the method further comprises:acquiring important weather notification information related to the current position according to the geographical position information;providing the important weather notification information to the user.
- An information-prompting device for use on a head-mounted display, comprising:the first acquisition module is used for acquiring the outside information of the current environment of the head-mounted display when the head-mounted display is detected to be used by a user;the first judgment module is used for judging whether the head-mounted display is in a target scene currently or not according to the external information;the monitoring module is used for monitoring the external voice information of the current environment when the head-mounted display is currently in the target scene;the second judgment module is used for judging whether the external voice information meets a preset information reminding condition or not;and the prompting module is used for prompting the attention of the user according to a preset prompting mode when the external voice information meets the information prompting condition.
- The apparatus of claim 9, wherein the context information comprises geographic location information, motion gesture information, and altitude information.
- The apparatus of claim 9, wherein the second determination module is specifically configured to:judging whether the external voice information contains a preset broadcast prompting ring or not;and if so, judging that the external voice information meets the information reminding condition.
- The apparatus of claim 9, wherein the second determination module is specifically configured to:carrying out voice recognition on the external voice information to obtain corresponding text information;judging whether the text information contains a target keyword or not;and if so, judging that the external voice information meets the information reminding condition.
- The apparatus according to any one of claims 9 to 12, wherein the prompting module is specifically configured to:turning off a voice noise cancellation function in the head-mounted display;and reducing the internal volume of the head-mounted display so as to enable the external voice information of the current environment to be input into the head-mounted display and played to the user.
- The apparatus according to any one of claims 9 to 12, wherein the prompting module is specifically configured to:converting external voice information into corresponding text information, and displaying the text information on a screen in the head-mounted display; and/or the presence of a gas in the gas,adjusting a screen backlight value in the head mounted display to cause the screen to blink.
- The apparatus according to any one of claims 9 to 12, wherein the prompting module is specifically configured to:determining the grade type of the external voice information;adjusting a color of an LED according to the class type, wherein the LED is located below a screen of the head-mounted display.
- The apparatus according to any one of claims 9 to 12, wherein when the outside world information includes geographical location information, the method apparatus further comprises:the second acquisition module is used for acquiring important weather notification information related to the current position according to the geographical position information;and the providing module is also used for providing the important weather notification information to the user.
- A head-mounted display comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any one of claims 1 to 8 when executing the program.
- A non-transitory computer-readable storage medium on which a computer program is stored, the program, when executed by a processor, implementing the information presentation method for use on a head-mounted display according to any one of claims 1 to 8.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/113494 WO2019104511A1 (en) | 2017-11-29 | 2017-11-29 | Information prompting method and apparatus for head-mounted display, and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110730939A true CN110730939A (en) | 2020-01-24 |
Family
ID=66663724
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201780091698.4A Pending CN110730939A (en) | 2017-11-29 | 2017-11-29 | Information prompting method, device and equipment for head-mounted display |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110730939A (en) |
| WO (1) | WO2019104511A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114089829A (en) * | 2021-10-13 | 2022-02-25 | 深圳中青宝互动网络股份有限公司 | Virtual reality's meta universe system |
| CN114550430A (en) * | 2022-04-27 | 2022-05-27 | 北京亮亮视野科技有限公司 | Character reminding method and device based on AR technology |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103869469A (en) * | 2012-12-13 | 2014-06-18 | 精工爱普生株式会社 | Head-mounted display device, control method for head-mounted display device, and work supporting system |
| CN104473717A (en) * | 2014-12-04 | 2015-04-01 | 上海交通大学 | Wearable guide apparatus for totally blind people |
| CN105103082A (en) * | 2012-12-11 | 2015-11-25 | 微软技术许可有限责任公司 | People-triggered holographic reminders |
| CN205003494U (en) * | 2015-08-18 | 2016-01-27 | 韦阳 | Intelligence head mounted device |
| CN105807920A (en) * | 2016-03-03 | 2016-07-27 | 北京小鸟看看科技有限公司 | Virtual reality equipment as well as method and device for monitoring ground obstacles under using scene of virtual reality equipment |
| CN105912988A (en) * | 2016-03-31 | 2016-08-31 | 宇龙计算机通信科技(深圳)有限公司 | Environment change prompting method, environment change prompting system and headset VR equipment |
| US20170086731A1 (en) * | 2015-09-30 | 2017-03-30 | Apple Inc. | Facilitating restful sleep using reminders |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106896917B (en) * | 2017-02-21 | 2021-03-30 | 北京小米移动软件有限公司 | Method and device for assisting user in experiencing virtual reality and electronic equipment |
| CN106873788A (en) * | 2017-04-14 | 2017-06-20 | 歌尔科技有限公司 | A kind of virtual reality helmet |
| CN107172414A (en) * | 2017-04-20 | 2017-09-15 | 北京安云世纪科技有限公司 | A kind of method of virtual reality head-mounted display equipment and its processing information |
-
2017
- 2017-11-29 CN CN201780091698.4A patent/CN110730939A/en active Pending
- 2017-11-29 WO PCT/CN2017/113494 patent/WO2019104511A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105103082A (en) * | 2012-12-11 | 2015-11-25 | 微软技术许可有限责任公司 | People-triggered holographic reminders |
| CN103869469A (en) * | 2012-12-13 | 2014-06-18 | 精工爱普生株式会社 | Head-mounted display device, control method for head-mounted display device, and work supporting system |
| CN104473717A (en) * | 2014-12-04 | 2015-04-01 | 上海交通大学 | Wearable guide apparatus for totally blind people |
| CN205003494U (en) * | 2015-08-18 | 2016-01-27 | 韦阳 | Intelligence head mounted device |
| US20170086731A1 (en) * | 2015-09-30 | 2017-03-30 | Apple Inc. | Facilitating restful sleep using reminders |
| CN105807920A (en) * | 2016-03-03 | 2016-07-27 | 北京小鸟看看科技有限公司 | Virtual reality equipment as well as method and device for monitoring ground obstacles under using scene of virtual reality equipment |
| CN105912988A (en) * | 2016-03-31 | 2016-08-31 | 宇龙计算机通信科技(深圳)有限公司 | Environment change prompting method, environment change prompting system and headset VR equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114089829A (en) * | 2021-10-13 | 2022-02-25 | 深圳中青宝互动网络股份有限公司 | Virtual reality's meta universe system |
| CN114550430A (en) * | 2022-04-27 | 2022-05-27 | 北京亮亮视野科技有限公司 | Character reminding method and device based on AR technology |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019104511A1 (en) | 2019-06-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104658548B (en) | Alerting vehicle occupants to external events and masking in-vehicle conversations with external sounds | |
| US10205890B2 (en) | Systems, methods, and devices for rendering in-vehicle media content based on vehicle sensor data | |
| US8838384B1 (en) | Method and apparatus for sharing geographically significant information | |
| JP5966121B2 (en) | Driving support system and driving support program | |
| CN106471823B (en) | Directional audio notification | |
| US9771082B2 (en) | Reducing cognitive demand on a vehicle operator by generating passenger stimulus | |
| JP6900950B2 (en) | Vibration control control device, vibration control control method, and moving object | |
| US20180290590A1 (en) | Systems for outputting an alert from a vehicle to warn nearby entities | |
| US20130210406A1 (en) | Phone that prevents texting while driving | |
| US20130094682A1 (en) | Augmented reality sound notification system | |
| US20180022290A1 (en) | Systems, Methods, And Devices For Rendering In-Vehicle Media Content Based On Vehicle Sensor Data | |
| US20180181366A1 (en) | Modification of distracting sounds | |
| JP2017204104A (en) | Control device, on-vehicle device, video distribution method, and program | |
| US20210380143A1 (en) | Handover assistant for machine to driver transitions | |
| CN110730939A (en) | Information prompting method, device and equipment for head-mounted display | |
| US11061236B2 (en) | Head-mounted display and control method thereof | |
| US11543521B2 (en) | Information processing apparatus, information processing method, and recording medium | |
| US20180022357A1 (en) | Driving recorder system | |
| WO2018079624A1 (en) | Processing device, server device, output method, and program | |
| JP7384185B2 (en) | Information presentation control device | |
| US10068620B1 (en) | Affective sound augmentation for automotive applications | |
| US20090157240A1 (en) | Advisory system to aid pilot recovery from spatial disorientation during an excessive roll | |
| WO2018079527A1 (en) | Control device, output method and program | |
| CN108639056B (en) | Driving state detection method and device and mobile terminal | |
| US20230191992A1 (en) | Conversation detector to insert audible announcements |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200124 |