Disclosure of Invention
It is an object of the present invention to provide a head-mounted virtual reality device capable of protecting user safety.
According to a first aspect of the present invention, there is provided a head-mounted virtual reality device comprising a displacement detection module, a judgment module and an alarm module, the displacement detection module being arranged to detect a movement displacement of a user; the judging module is arranged to judge whether the user is in a safety range according to the initial position of the user and the movement displacement; the alarm module is set to send out an alarm to prompt the user when the judging result of the judging module is negative.
Optionally, the displacement detection module comprises a panoramic camera and a first processing unit, and the first processing unit is configured to detect the movement displacement of the user according to a panoramic image acquired by the panoramic camera.
Optionally, the displacement detection module further comprises an inertial measurement unit, and the first processing unit is further configured to correct the movement displacement according to data measured by the inertial measurement unit.
Optionally, the first processing unit and the judging module are provided by a processor chip.
Optionally, the inertial detection unit includes a three-axis acceleration sensor and a three-axis gyro sensor.
Optionally, the head-mounted virtual reality device further includes an initial distance detection module and a safety range determination module, wherein the initial distance detection module is configured to detect an initial distance between the initial position and each object in the environment; the safety range determination module is configured to determine the safety range based on the initial distance.
Optionally, the initial distance detection module comprises a depth camera and a second processing unit, and the second processing unit is configured to determine the initial distance between each object in the environment and the initial position according to a gray level image acquired by the depth camera.
Optionally, the initial distance detection module further includes an RGB camera, and the second processing unit is further configured to correct the initial distance according to an RGB image acquired by the RGB camera.
Optionally, the secure range determination module and the second processing unit are provided by a processor chip.
Optionally, the alarm module includes a speaker.
According to a second aspect of the present invention, there is provided a security protection method for a head-mounted virtual reality device, comprising:
detecting a movement displacement of a user;
judging whether the user exceeds a safety range or not according to the mobile displacement and the initial position of the user, if so, then:
an alarm is sent to prompt the user.
Optionally, the detecting the movement displacement of the user includes, before:
detecting an initial distance between the initial position and each object in the environment;
and determining the safety range according to the initial distance.
Optionally, the method for detecting the movement displacement of the user specifically includes:
collecting two frames of panoramic images of the environment where the user is located;
and calculating the movement displacement of the user according to the position change of each object in the two frames of panoramic images.
The invention has the beneficial effects that the safety of the user can be protected by monitoring the movement displacement of the user in real time to ensure that the user is in a safety range, and the problems of personal injury to the user caused by the collision between the user and surrounding objects are prevented. The invention can not only effectively reduce the calculated amount, but also accurately identify whether the current position is safe or not without using peripheral equipment such as a computer and the like and building a map in real time, thereby increasing the flexibility of equipment use.
Other features of the present invention and its advantages will become apparent from the following detailed description of exemplary embodiments of the invention, which proceeds with reference to the accompanying drawings.
Detailed Description
Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless it is specifically stated otherwise.
The following description of at least one exemplary embodiment is merely exemplary in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods, and apparatus known to one of ordinary skill in the relevant art may not be discussed in detail, but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any specific values should be construed as merely illustrative, and not a limitation. Thus, other examples of exemplary embodiments may have different values.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further discussion thereof is necessary in subsequent figures.
In order to solve the problem that a user in the prior art is easy to collide and further cause personal injury to the user due to the fact that the user cannot see the real world when using the head-mounted virtual reality device, the head-mounted virtual reality device comprises a displacement detection module U1, a judgment module U2 and an alarm module U3, wherein the displacement detection module U1 is used for detecting the movement displacement of the user; the judging module U2 is used for judging whether the user is in a safety range according to the initial position and the movement displacement of the user; the alarm module U3 is configured to issue an alarm to prompt the user when the judgment result of the judgment module U2 is no.
Specifically, the safety range may be a circular closed area centered on an initial position and having a radius set value, wherein the set value is smaller than a distance between the initial position and an object nearest thereto; the safety range may also be a closed area including the initial position but excluding all objects in the environment, wherein each object has a minimum distance from the safety range boundary greater than a predetermined distance, and each object has a minimum distance from the safety range boundary equal to the minimum distance. Therefore, whether the user exceeds the boundary of the safety range or not can be judged through the initial position and the movement displacement, namely whether the user is in the safety range or not is judged. If the user exceeds the boundary of the safety range, the possibility that the user collides with surrounding objects is indicated, and the user is prompted by an alarm so as to ensure the safety of the user.
Further, the displacement detection module U1 may transmit the movement displacement to the judgment module U2 in real time, so as to judge whether the user is in the safety range in real time; alternatively, the displacement detection module U1 may transmit the displacement to the determination module U2 at intervals of 1 second, for example, to determine whether the user is in the safety range at intervals of the displacement detection module U1.
Based on this, the determining module U2 may update the initial position in real time according to the movement displacement, for example, the first position of the user may be obtained according to the initial position and the first movement displacement, then the first position is used as the initial position when the second movement displacement is received, the second position of the user may be obtained according to the initial position (i.e. the first position) and the second movement displacement, then the second position is used as the initial position when the third movement displacement is received, and so on. The judging module U2 receives the first movement displacement, the second movement displacement and the third movement displacement in sequence, and the first movement displacement, the second movement displacement and the third movement displacement are continuous.
Therefore, through monitoring the mobile displacement of the user, the user can be ensured to be in a safe range, the safety of the user can be protected, and the problems of personal injury to the user caused by the collision between the user and surrounding objects are prevented. The invention can not only effectively reduce the calculated amount, but also accurately identify whether the current position is safe or not without using peripheral equipment such as a computer and the like and building a map in real time, thereby increasing the flexibility of equipment use.
In a specific embodiment of the present invention, as shown in fig. 2, the displacement detection module U1 includes a panoramic camera U11 and a first processing unit U12, where the first processing unit U12 is configured to detect a movement displacement of the user according to a panoramic image acquired by the panoramic camera U11.
Specifically, the panoramic camera U11 may collect panoramic images including all objects around the user, and the first processing unit U12 may calculate the real-time movement displacement of the user according to the position change condition of each object in every two continuous frames of panoramic images collected by the panoramic camera U11, for example; the first processing unit U12 may calculate the interval movement displacement of the user according to the position change condition of each object in the two frames of panoramic images acquired by the panoramic camera U11 at the interval set time.
In another embodiment of the present invention, the panoramic camera U11 may be replaced by a plurality of normal cameras disposed on the same horizontal plane, and the shooting angles of the normal cameras may be stitched to 360 degrees, so that the images collected by each normal camera may be stitched to a panoramic image.
Further, the displacement detection module U1 further comprises an inertial measurement unit U13, and the first processing unit U12 is further configured to correct the movement displacement according to data measured by the inertial measurement unit.
On the basis of this, the inertial measurement unit U13 may include a three-axis acceleration sensor and a three-axis gyro sensor. The three-axis acceleration sensor can collect the space acceleration data of the user, the three-axis gyroscope sensor can collect the space angular velocity data of the user, the movement displacement of the user can be calculated through an inertial navigation algorithm, and the movement displacement obtained according to the panoramic image is corrected through the three-axis acceleration sensor and the three-axis gyroscope sensor, so that the measured movement displacement is more accurate.
According to fig. 2, the head-mounted virtual reality device may further include an initial distance detection module U4 and a safety range determination module U5, the initial distance detection module U4 being configured to detect an initial distance between an initial position of a user and each object in the environment; the safety range determination module U5 is arranged to determine the safety range from the initial distance.
The initial position is specifically the position of the user before the user moves and shifts; the objects in the environment specifically refer to objects which are located around and above the user in the real environment where the user is located and can touch in the moving process of the user.
For example, in the case where the initial distance detection module U4 detects that the distance between the initial position of the user and the nearest object in the environment is 1 meter, it is possible to determine that the safety range is a circular area with a radius of 0.8 meter centered on the initial position of the user.
For another example, in the case where the distance between the first object and the initial position is detected as a, the distance between the second object and the initial position is detected as B, the distance between the third object and the initial position is detected as C, the distance between the fourth object and the initial position is detected as D, the distance between the fifth object and the initial position is detected as E, the distance between the sixth object and the initial position is detected as F, and the initial position is located between the circles of the first object, the second object, the third object, the fourth object, the fifth object and the sixth object, six calibration points may be calibrated, the first calibration point is located on the line between the first object near the initial position and the initial position, the second calibration point is located on the line between the second object near the initial position and the initial position, the third calibration point is located on the line between the third object near the initial position and the initial position, the fourth calibration point is located on a line between the fourth object close to the initial position and the initial position, the fifth calibration point is located on a line between the fifth object close to the initial position and the initial position, the sixth calibration point is located on a line between the sixth object close to the initial position and the initial position, and the distance between the first calibration point and the first object, the distance between the second calibration point and the second object, the distance between the third calibration point and the third object, the distance between the fourth calibration point and the fourth object, the distance between the fifth calibration point and the fifth object, and the distance between the sixth calibration point and the sixth object are all set distances, for example, 0.1 meter, and a closed area formed by connecting two adjacent calibration points can be a safe range.
In a specific embodiment of the present invention, the initial distance detection module U4 may include a depth camera U41 and a second processing unit U42, where the second processing unit U42 is configured to determine an initial distance between each object in the environment and the user based on the gray scale image acquired by the depth camera U41.
Specifically, when the user is at the initial position, the user may rotate around the initial position as a circle center, so that the depth camera U41 collects images of all objects in the environment.
Since the depth camera captures a depth image, the gray value of a pixel in the depth image is only related to the distance of the field window plane to the object surface. Therefore, the depth image has space color independence, cannot be influenced by factors such as illumination and shadow, and the gray value of the depth image is combined with the horizontal coordinate and the vertical coordinate of the image, so that the depth image can be used for representing the coordinates of an object in a 3D space in a certain space range, and can be equivalently identified in a 3D space mode, and the shielding or overlapping problem can be overcome. More importantly, the imaging principle of the depth image camera can well ensure the robustness of camera calibration, adapt to the change of various environments, enable the camera to be self-adjusting and recalibrated easily and avoid measuring calibration objects.
Therefore, according to the gray value of each pixel in the current gray image, the initial distance between each object and the user can be calculated, for example, in the case that the distances between different positions of a certain object and the initial position of the user are different, the minimum distance between the object and the initial position can be used as the initial distance between the object and the initial position.
Further, the initial distance detection module U4 further includes an RGB camera U43, and the second processing unit U42 is further configured to correct the initial distance according to the RGB image acquired by the RGB camera.
The depth camera U41 is used for measuring object depth information and contour information in a visual range, the RGB camera is used for obtaining texture information of the object surface, and the second processing unit U42 can well judge the shape of the distance of the object by combining images acquired by the two cameras, so that the obtained initial distance is more accurate.
The initial distance detection module U4 may be provided by a distance sensor, and in another embodiment of the present invention, the initial distance detection module U4 is provided by a common camera and a third processing unit, and the third processing unit is configured to calculate the movement displacement of the user according to the position change condition of each object in each two continuous frames of images acquired by the common camera. Specifically, the determining module U2, the first processing unit U12, the safety range determining module U5, and the second processing unit U42 may be provided by a processor chip. The processor chip may be, for example, a CPU processor chip or a microprocessor MCU chip or the like.
Further, the alarm module U3 may include a speaker, and when the judgment module U2 judges that the user is out of the safety range, the speaker may be controlled to sound, for example, may be "drip" sound. The alarm module U3 may also include a display screen, and when the judgment module U2 judges that the user is out of the safety range, the display screen may be controlled to display a prompt similar to "out of the safety area". The alarm module U3 can also be a motor, and when the judgment module U2 judges that the user exceeds the safety range, the motor can be controlled to vibrate.
The invention further provides a safety protection method for the head-mounted virtual reality equipment. Fig. 3 is a flow chart of one embodiment of a security protection method for a head-mounted virtual reality device according to this invention.
According to the illustration of fig. 3, the security protection method comprises the following steps:
step S301, detecting a movement displacement of the user.
Further, the method for detecting the movement displacement of the user specifically may be:
collecting panoramic images of the environment where two frames of users are located;
and calculating the movement displacement of the user according to the position change condition of each object in the two frames of panoramic images.
Step S302, judging whether the user exceeds a safety range according to the mobile displacement and the initial position of the user, if so, executing step S303; if not, the process continues to step S301.
Step S303, an alarm is sent to prompt the user.
In a specific embodiment of the present invention, the security protection method further includes:
detecting an initial distance between the initial position and each object in the environment;
the safe distance is determined from the initial distance.
The foregoing embodiments mainly focus on describing differences from other embodiments, and identical and similar parts between the embodiments are mutually referred to.
While certain specific embodiments of the invention have been described in detail by way of example, it will be appreciated by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the invention. It will be appreciated by those skilled in the art that modifications may be made to the above embodiments without departing from the scope and spirit of the invention. The scope of the invention is defined by the appended claims.