CN114022543A - AR/VR glasses, system and method for measuring height, electronic device and storage medium - Google Patents

AR/VR glasses, system and method for measuring height, electronic device and storage medium Download PDF

Info

Publication number
CN114022543A
CN114022543A CN202111262308.XA CN202111262308A CN114022543A CN 114022543 A CN114022543 A CN 114022543A CN 202111262308 A CN202111262308 A CN 202111262308A CN 114022543 A CN114022543 A CN 114022543A
Authority
CN
China
Prior art keywords
glasses
wearer
module
height
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111262308.XA
Other languages
Chinese (zh)
Inventor
苗顺平
马斌斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Ileja Tech Co ltd
Original Assignee
Beijing Ileja Tech Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Ileja Tech Co ltd filed Critical Beijing Ileja Tech Co ltd
Priority to CN202111262308.XA priority Critical patent/CN114022543A/en
Publication of CN114022543A publication Critical patent/CN114022543A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • A61B5/1072—Measuring physical dimensions, e.g. size of the entire body or parts thereof measuring distances on the body, e.g. measuring length, height or thickness
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • A61B5/1075—Measuring physical dimensions, e.g. size of the entire body or parts thereof for measuring dimensions by non-invasive methods, e.g. for determining thickness of tissue layer
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • A61B5/1079—Measuring physical dimensions, e.g. size of the entire body or parts thereof using optical or photographic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/80—Geometric correction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G06T7/85—Stereo camera calibration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Pathology (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Dentistry (AREA)
  • Optics & Photonics (AREA)
  • Geometry (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention provides AR/VR glasses, a system and a method for measuring height, an electronic device and a storage medium, and relates to the technical field of artificial intelligence, wherein the method for measuring the height specifically comprises the following steps: s20, collecting image information of the feet of the wearer; s21, calibrating the RGB camera to obtain RGB camera parameters; s22, correcting image information according to RGB camera parameters to obtain corrected images, matching pixel points of the two corrected images to obtain matching results, and calculating the depth of each pixel according to the matching results to obtain depth images; and S23, calculating the image deformation of the two-foot area according to the depth image, and obtaining the distance information of the two feet of the measurer from the glasses according to the image deformation. The height measuring method solves the problems that hardware equipment needs to be added and the operation process is complex when the height of the eyes of a wearer is measured in the prior art.

Description

AR/VR glasses, system and method for measuring height, electronic device and storage medium
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to AR/VR glasses, a system and a method for measuring height, electronic equipment and a storage medium.
Background
In order to realize the fusion and superposition of the AR/VR content and the actual content, the height of a wearer, particularly the height of the eye position, needs to be detected.
Disclosure of Invention
The invention aims to provide AR/VR glasses, a system and a method for measuring height, an electronic device and a storage medium, wherein the method for measuring height can solve the problems that hardware equipment is required to be added for measuring the height of eyes of a wearer and the operation process is complex in the prior art.
In order to achieve the above purpose, the invention provides the following technical scheme:
the embodiment of the invention provides a method for measuring height, which specifically comprises the following steps:
s20, collecting image information of the feet of the wearer;
s21, calibrating the RGB camera to obtain RGB camera parameters;
s22, correcting image information according to RGB camera parameters to obtain corrected images, matching pixel points of the two corrected images to obtain matching results, and calculating the depth of each pixel according to the matching results to obtain depth images;
and S23, calculating the image deformation of the two-foot area according to the depth image, and obtaining the distance information of the two feet of the measurer from the glasses according to the image deformation.
On the basis of the technical scheme, the invention can be further improved as follows:
further, the method further comprises:
s24, acquiring sensor data of the wearer from the view of looking at the feet from head down to the view of head up to the horizontal angle:
and S25, obtaining height information of the wearer from the angle that the wearer looks at the feet from head down to head up to the horizontal angle by combining the sensor data with an integration algorithm, and adding the height information and the distance information to obtain the height information of the AR/VR glasses from the ground after the wearer looks up to the horizontal angle.
A method of measuring height, the method comprising:
s30, collecting original phase images of the feet of a wearer, and acquiring corresponding depth images according to the original phase images according to a TOF (time of flight) distance measuring principle;
and S31, obtaining the distance from the feet of the wearer to the glasses according to the depth image, and adding the distance from the feet of the wearer to the glasses and the height of the shoes to obtain the height information from the AR/VR glasses to the ground.
A system for measuring height, applied to AR/VR glasses, comprising:
the image acquisition module comprises RGB cameras arranged on the left side and the right side of the AR/VR glasses and is used for acquiring image information of the feet of a wearer;
the camera calibration module is connected with the image acquisition module and used for calibrating the RGB camera to obtain RGB camera parameters;
the camera calibration module is connected with the camera calibration module and used for calibrating image information according to RGB camera parameters to obtain a calibrated image, matching pixel points of the two calibrated images to obtain a matching result, and calculating the depth of each pixel according to the matching result to obtain a depth image;
and the control module is connected with the camera correction module and used for receiving the depth image, calculating the image deformation of the two-foot area according to the depth image and obtaining the distance information of the two-foot distance glasses of the measurer through the image deformation.
Further, sensors are included, including but not limited to lidar sensors, gyroscope sensors, acceleration of gravity sensors, geomagnetic sensors, and distance sensors, for obtaining sensor data for the wearer from looking down at both feet to head-up to a horizontal angle.
Further, the control module is connected to the sensor and further configured to:
and obtaining height information of the angle from the head of the wearer to the horizontal angle from the head raising to the head raising according to the sensor data and an integral algorithm, and adding the height information and the distance information to obtain the height information from the AR/VR glasses to the ground after the angle from the head raising to the horizontal angle of the wearer is obtained.
A system for measuring height, comprising:
the image acquisition module comprises a TOF camera arranged on AR/VR glasses and is used for acquiring original phase images of both feet of a wearer and acquiring corresponding depth images according to the original phase images according to the TOF ranging principle; and the control module is connected with the image acquisition module and used for receiving the depth image, obtaining the distance from the feet of the wearer to the glasses according to the depth image, and adding the distance from the feet of the wearer to the glasses and the height of the shoes to obtain the height information from the AR/VR glasses to the ground.
An AR/VR glasses comprising: a system for measuring height, further comprising:
the battery module is connected with the control module and is used for power supply and charge-discharge management of the AR/VR glasses and outputting battery electric quantity information to the control module;
the user interaction module is connected with the control module and used for transmitting a control instruction to the control module and controlling the current working mode of the AR glasses;
the display module is connected with the control module and used for displaying the AR/VR video signal, the current working mode information of the AR/VR glasses and the battery power information;
and the transmission module is connected with the display module, the battery module, the control module and the user interaction module and is used for wireless network transmission among the display module, the battery module, the control module and the user interaction module.
An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method when executing the computer program.
A non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method.
The invention has the following advantages:
the method for measuring the height comprises the steps of collecting image information of both feet of a wearer through an image collecting module; calibrating the RGB camera through a camera calibration module to obtain RGB camera parameters; correcting image information according to RGB camera parameters through a camera correction module to obtain a corrected image, matching pixel points of the two corrected images to obtain a matching result, and calculating the depth of each pixel according to the matching result to obtain a depth image; and calculating the image deformation of the two-foot area of the depth image through a control module, and obtaining the distance information of the two-foot distance glasses of the measurer according to the image deformation. The support of other hardware is not needed, the hardware cost is saved, the operation of measuring the height is simple and convenient, and a wearer does not need to squat down and put down the handle and then pick up the handle. The problem of measure among the prior art that the person's eye height of wearing need increase hardware equipment and the operation process is complicated is solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flow chart of a method of measuring height according to the present invention;
FIG. 2 is a flow chart of a method of measuring height according to the present invention;
FIG. 3 is a schematic diagram of the control principle of the height measuring system of the present invention;
FIG. 4 is a schematic diagram of the control principle of the height measuring system of the present invention;
FIG. 5 is a schematic view of the structure of AR glasses according to the present invention;
fig. 6 is a schematic structural diagram of an electronic device provided in the present invention.
The system comprises an image acquisition module 10, a camera calibration module 20, a camera calibration module 30, a control module 40, a sensor 50, an electronic device 60, a processor 601, a memory 602, a bus 603, a battery module 70, a user interaction module 80, a display module 90 and a transmission module 100.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a flowchart of an embodiment of a method for measuring height according to the present invention, and as shown in fig. 1, the embodiment of the present invention provides a method for measuring height, which includes the following steps:
s20, collecting image information of the feet of the wearer;
specifically, the AR/VR glasses run a height measuring program, two RGB cameras of the AR/VR glasses are respectively positioned on the left side and the right side of the AR/VR glasses, and the AR/VR glasses start to work simultaneously; the wearer stands upright, lowers the head to see the feet of the wearer, and the two RGB cameras of the AR/VR glasses can shoot the images of the feet of the wearer to obtain the image information of the feet of the wearer.
The RGB camera is a color camera, pictures shot by the RGB camera are colored, and the three primary colors of R-red, G-green, B-blue and red-green and blue-green can be superposed in different proportions to present various colors.
S21, calibrating the RGB camera to obtain RGB camera parameters;
specifically, the binocular camera needs to be calibrated to obtain internal and external parameters and homography matrixes of the left RGB camera and the right RGB camera of the AR/VR glasses.
S22, correcting image information according to RGB camera parameters to obtain corrected images, matching pixel points of the two corrected images to obtain matching results, and calculating the depth of each pixel according to the matching results to obtain depth images;
specifically, the image information is corrected according to the RGB camera parameters according to the calibration result to obtain a corrected image, and the two corrected images are located on the same plane and are parallel to each other. And matching pixel points of the two corrected images, and calculating the depth of each pixel according to a matching result so as to obtain a depth image.
And S23, calculating the image deformation of the two-foot area according to the depth image, and obtaining the distance information of the two feet of the measurer from the glasses according to the image deformation.
Specifically, the two feet of the wearer in the depth image can be identified through the identification program built in the control module 40 of the AR/VR glasses; through image data respectively shot by the two RGB cameras and by combining parameters (FOV, distortion characteristics, pixels and the like) of the two RGB cameras, image deformation of a double-foot area in the depth image can be calculated, and therefore the distance between the double feet of a wearer and AR/VR glasses is reversely deduced.
Acquiring sensor data of a wearer from looking at both feet from head-down to head-up to a horizontal angle: and obtaining height information of the wearer from the angle from head lowering to head raising to the horizontal angle by combining the sensor data with an integral algorithm, and adding the height information and the distance information to obtain the height information of the AR glasses to the ground after the wearer raises to the horizontal angle.
In order to compensate height errors caused by head lowering of a wearer, the wearer can be guided to raise the head to a horizontal angle after the head of the wearer is lowered and the distance between the glasses and the feet is measured, and the AR/VR glasses can give a guidance prompt and confirm whether the horizontal angle is reached or not; in this case, the AR/VR glasses can obtain sensor data of the wearer from the posture of looking at both feet with his head down to the angle of head up to horizontal, including not limited to acceleration sensor, gyroscope data, etc., and by combining these data with an integration algorithm, height information of the wearer from head down to angle of head up to horizontal can be calculated. The height information is added with the height from the AR/VR glasses at the head-down position of the wearer to the ground, namely the height from the AR/VR glasses to the ground after the user raises the head to the horizontal angle.
Fig. 2 is a flowchart of an embodiment of a height measuring method according to the present invention, and as shown in fig. 2, the height measuring method according to the embodiment of the present invention includes the following steps:
s30, collecting original phase images of the feet of a wearer, and acquiring corresponding depth images according to the original phase images according to a TOF (time of flight) distance measuring principle;
specifically, the AR/VR glasses are internally provided with TOF cameras which can shoot images of two feet. TOF is an imaging technique in which infrared light (laser pulses) invisible to the human eye is emitted outward, reflected after encountering an object, reflected to the end of the camera, the time difference or phase difference from emission to reflection back to the camera is calculated, and data is collected to form a set of distance depth data, thereby obtaining a three-dimensional 3D model.
And S31, obtaining the distance from the feet of the wearer to the glasses according to the depth image, and adding the distance from the feet of the wearer to the glasses and the height of the shoes to obtain the height information from the AR/VR glasses to the ground.
Specifically, the identification program built in the control module 40 of the AR/VR glasses can identify the feet of the wearer in the image; the distance from the two feet to the glasses can be confirmed through the TOF camera; optionally, the height of the shoes can be supplemented according to the average height of the shoes, and the distance between the glasses and the shoes measured by the TOF is the height from the glasses to the ground;
fig. 3 is a schematic control diagram of the height measuring system according to the present invention, and as shown in fig. 3, the embodiment of the present invention provides a height measuring system;
the image acquisition module 10 comprises RGB cameras arranged on the left side and the right side of the AR/VR glasses and is used for acquiring image information of the feet of a wearer;
the camera calibration module 20 is connected with the image acquisition module 10 and is used for calibrating the RGB camera to obtain RGB camera parameters;
the camera calibration module 30 is connected with the camera calibration module 20 and is used for calibrating image information according to the RGB camera parameters to obtain a calibrated image, performing pixel point matching on the two calibrated images to obtain a matching result, and calculating the depth of each pixel according to the matching result to obtain a depth image;
and the control module 40 is connected with the camera correction module 30 and is used for receiving the depth image, calculating the image deformation of the two-foot area according to the depth image, and obtaining the distance information of the two-foot distance glasses of the measurer through the image deformation.
The system for measuring height according to the embodiment of the present invention may be specifically configured to execute the processing flow of each of the method embodiments, and the functions of the system are not described herein again, and refer to the detailed description of the method embodiments.
Fig. 4 is a schematic control diagram of the height measuring system of the present invention, and as shown in fig. 4, an embodiment of the present invention provides a height measuring system;
the image acquisition module 10 comprises a TOF camera arranged on AR/VR glasses and is used for acquiring original phase images of both feet of a wearer and acquiring corresponding depth images according to the original phase images according to a TOF ranging principle;
and the control module 40 is connected with the image acquisition module 10 and is used for receiving the depth image, obtaining the distance from the feet of the wearer to the glasses according to the depth image, and adding the distance from the feet of the wearer to the glasses and the height of the shoes to obtain the height information from the AR/VR glasses to the ground.
Also included are sensors 50, including but not limited to lidar sensors, gyroscope sensors, gravitational acceleration sensors, geomagnetic sensors, and distance sensors, for obtaining sensor data for a wearer looking from a head-down to a head-up to a horizontal angle.
The control module 40 is connected to the sensor 50, and further configured to:
and obtaining height information of the angle from the head of the wearer to the horizontal angle from the head raising to the head raising according to the sensor data and an integral algorithm, and adding the height information and the distance information to obtain the height information from the AR/VR glasses to the ground after the angle from the head raising to the horizontal angle of the wearer is obtained.
The system for measuring height according to the embodiment of the present invention may be specifically configured to execute the processing flow of each of the method embodiments, and the functions of the system are not described herein again, and refer to the detailed description of the method embodiments.
FIG. 5 is a schematic diagram illustrating the control principle of AR/VR glasses according to the present invention, and as shown in FIG. 5, an AR/VR glasses according to an embodiment of the present invention is provided;
the method comprises the following steps: a system for measuring height, further comprising:
the battery module 70 is connected with the control module 40 and used for power supply and charging and discharging management of AR/VR glasses and outputting battery power information to the control module 40; the battery module 70 includes a battery and a power management portion, and implements power supply and charging/discharging management of the AR/VR glasses.
The user interaction module 80 is connected with the control module 40 and is used for transmitting a control instruction to the control module 40 and controlling the current working mode of the AR/VR glasses;
the display module 90 is connected with the control module 40 and is used for displaying the AR/VR video signal, the current working mode information of the AR/VR glasses and the battery power information; the display module 90 includes one or two lens modules for AR/VR display, including but not limited to an indicator light, a display screen except for the AR/VR display module, and the like. The display module 90 displays the AR/VR video signals and also displays the working state of the AR glasses, such as the battery level and the current working mode.
And a transmission module 100 connected to the display module 90, the battery module 70, the control module 40 and the user interaction module 80, for wireless network transmission among the display module 90, the battery module 70, the control module 40 and the user interaction module 80. The transmission module 100 enables wireless network transmissions including, but not limited to, one or more forms of Wi-Fi, bluetooth, RF, mobile networking, and the like.
The control module 40 contains the computing functionality (including but not limited to CPU, memory, storage, etc.) and user interaction controls of the AR/VR glasses. The user interaction control comprises the steps of not limiting to keys, a touch pad, vibration induction, a remote controller and the like, and the control of the working state of the AR/VR glasses is realized, such as the operations of switching, setting modification and the like.
FIG. 6 is a schematic structural diagram of AR/VR glasses according to the present invention, and as shown in FIG. 6, an AR/VR glasses according to an embodiment of the present invention is provided;
the battery module 70 is connected with the control module 40 and used for power supply and charging and discharging management of AR/VR glasses and outputting battery power information to the control module 40;
the user interaction module 80 is connected with the control module 40 and is used for transmitting a control instruction to the control module 40 and controlling the current working mode of the AR/VR glasses;
the display module 90 is connected with the control module 40 and is used for displaying the AR/VR video signal, the current working mode information of the AR/VR glasses and the battery power information;
and a transmission module 100 connected to the display module 90, the battery module 70, the control module 40 and the user interaction module 80, for wireless network transmission among the display module 90, the battery module 70, the control module 40 and the user interaction module 80.
Fig. 6 is a schematic structural diagram of an entity of an electronic device 60 according to an embodiment of the present invention, and as shown in fig. 6, the electronic device 60 includes: a processor 601(processor), a processor 601(memory), and a bus 603;
wherein, the processor 601 and the processor 601 complete mutual communication through a bus 603;
the processor 601 is configured to call program instructions in the processor 601 to execute the methods provided by the above-mentioned method embodiments, including: collecting image information of both feet of a wearer; calibrating the RGB camera to obtain RGB camera parameters; correcting image information according to RGB camera parameters to obtain corrected images, matching pixel points of the two corrected images to obtain matching results, and calculating the depth of each pixel according to the matching results to obtain depth images; and calculating the image deformation of the two-foot area according to the depth image, and obtaining the distance information of the two-foot distance glasses of the measurer according to the image deformation.
The present embodiments provide a non-transitory computer-readable storage medium storing computer instructions that cause a computer to perform the methods provided by the above method embodiments, for example, including: collecting image information of both feet of a wearer; calibrating the RGB camera to obtain RGB camera parameters; correcting image information according to RGB camera parameters to obtain corrected images, matching pixel points of the two corrected images to obtain matching results, and calculating the depth of each pixel according to the matching results to obtain depth images; and calculating the image deformation of the two-foot area according to the depth image, and obtaining the distance information of the two-foot distance glasses of the measurer according to the image deformation.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods of the various embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A method for measuring height, the method comprising:
s20, collecting image information of the feet of the wearer;
s21, calibrating the RGB camera to obtain RGB camera parameters;
s22, correcting image information according to RGB camera parameters to obtain corrected images, matching pixel points of the two corrected images to obtain matching results, and calculating the depth of each pixel according to the matching results to obtain depth images;
and S23, calculating the image deformation of the two-foot area according to the depth image, and obtaining the distance information of the two feet of the measurer from the glasses according to the image deformation.
2. The method of measuring height of claim 1, further comprising:
s24, acquiring sensor data of the wearer from the view of looking at the feet from head down to the view of head up to the horizontal angle:
and S25, obtaining height information of the wearer from the angle that the wearer looks at the feet from head down to head up to the horizontal angle by combining the sensor data with an integration algorithm, and adding the height information and the distance information to obtain the height information of the AR/VR glasses from the ground after the wearer looks up to the horizontal angle.
3. A method for measuring height, the method comprising:
s30, collecting original phase images of the feet of a wearer, and acquiring corresponding depth images according to the original phase images according to a TOF (time of flight) distance measuring principle;
and S31, obtaining the distance from the feet of the wearer to the glasses according to the depth image, and adding the distance from the feet of the wearer to the glasses and the height of the shoes to obtain the height information from the AR glasses to the ground.
4. A system for measuring height is applied to AR/VR glasses, and is characterized by comprising:
the image acquisition module comprises RGB cameras arranged on the left side and the right side of the AR glasses and is used for acquiring image information of the feet of a wearer;
the camera calibration module is connected with the image acquisition module and used for calibrating the RGB camera to obtain RGB camera parameters;
the camera calibration module is connected with the camera calibration module and used for calibrating image information according to RGB camera parameters to obtain a calibrated image, matching pixel points of the two calibrated images to obtain a matching result, and calculating the depth of each pixel according to the matching result to obtain a depth image;
and the control module is connected with the camera correction module and used for receiving the depth image, calculating the image deformation of the two-foot area according to the depth image and obtaining the distance information of the two-foot distance glasses of the measurer through the image deformation.
5. The system of claim 4, further comprising sensors including, but not limited to, lidar sensors, gyroscope sensors, acceleration of gravity sensors, geomagnetic sensors, and distance sensors, for obtaining sensor data for a wearer looking down at both feet to a head-up to level angle.
6. The system of claim 5, wherein the control module is coupled to the sensor and further configured to:
and obtaining height information of the angle from the head of the wearer to the horizontal angle from the head raising to the head raising according to the sensor data and an integral algorithm, and adding the height information and the distance information to obtain the height information of the AR glasses to the ground after the head of the wearer is raised to the horizontal angle.
7. A system for measuring height is applied to AR/VR glasses, and is characterized by comprising:
the image acquisition module comprises a TOF camera arranged on AR/VR glasses and is used for acquiring original phase images of both feet of a wearer and acquiring corresponding depth images according to the original phase images according to the TOF ranging principle;
and the control module is connected with the image acquisition module and used for receiving the depth image, obtaining the distance from the feet of the wearer to the glasses according to the depth image, and adding the distance from the feet of the wearer to the glasses and the height of the shoes to obtain the height information from the AR/VR glasses to the ground.
8. An AR/VR glasses, comprising: the system for measuring height of any of claims 4-7, further comprising:
the battery module is connected with the control module and is used for power supply and charge-discharge management of the AR/VR glasses and outputting battery electric quantity information to the control module;
the user interaction module is connected with the control module and used for transmitting a control instruction to the control module and controlling the current working mode of the AR/VR glasses;
the display module is connected with the control module and used for displaying the AR/VR video signal, the current working mode information of the AR/VR glasses and the battery power information;
and the transmission module is connected with the display module, the battery module, the control module and the user interaction module and is used for wireless network transmission among the display module, the battery module, the control module and the user interaction module.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method according to any of claims 1 to 2 are implemented when the computer program is executed by the processor, or in that the steps of the method according to claim 3 are implemented when the computer program is executed by the processor.
10. A non-transitory computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 2; alternatively, the computer program when executed implements the steps of the method of claim 3.
CN202111262308.XA 2021-10-28 2021-10-28 AR/VR glasses, system and method for measuring height, electronic device and storage medium Pending CN114022543A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111262308.XA CN114022543A (en) 2021-10-28 2021-10-28 AR/VR glasses, system and method for measuring height, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111262308.XA CN114022543A (en) 2021-10-28 2021-10-28 AR/VR glasses, system and method for measuring height, electronic device and storage medium

Publications (1)

Publication Number Publication Date
CN114022543A true CN114022543A (en) 2022-02-08

Family

ID=80058349

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111262308.XA Pending CN114022543A (en) 2021-10-28 2021-10-28 AR/VR glasses, system and method for measuring height, electronic device and storage medium

Country Status (1)

Country Link
CN (1) CN114022543A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117316455A (en) * 2023-10-10 2023-12-29 尚氏(广东)大数据服务有限公司 Apparatus and method for BMI data analysis and computer storage medium
CN117398088A (en) * 2023-12-15 2024-01-16 四川大学华西医院 Height measurement method based on XR
JP7475539B1 (en) 2022-10-19 2024-04-26 三菱電機株式会社 Lighting Control System

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7475539B1 (en) 2022-10-19 2024-04-26 三菱電機株式会社 Lighting Control System
CN117316455A (en) * 2023-10-10 2023-12-29 尚氏(广东)大数据服务有限公司 Apparatus and method for BMI data analysis and computer storage medium
CN117398088A (en) * 2023-12-15 2024-01-16 四川大学华西医院 Height measurement method based on XR
CN117398088B (en) * 2023-12-15 2024-02-20 四川大学华西医院 Height measurement method based on XR

Similar Documents

Publication Publication Date Title
CN114022543A (en) AR/VR glasses, system and method for measuring height, electronic device and storage medium
KR102380335B1 (en) Scanning laser planarity detection
US11200646B2 (en) Compensation for deformation in head mounted display systems
TWI633336B (en) Helmet mounted display, visual field calibration method thereof, and mixed reality display system
KR20160110350A (en) Image display device and image display method, image output device and image output method, and image display system
CN111819521A (en) Information processing apparatus, information processing method, and program
CN108124150B (en) The method that virtual reality wears display equipment and observes real scene by it
CN110780742B (en) Eyeball tracking processing method and related device
CN112188059B (en) Wearable device, intelligent guiding method and device and guiding system
CN105594205A (en) 3d image system
CN107851334A (en) Information processor
JPWO2018186255A1 (en) INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, PROGRAM, AND RECORDING MEDIUM
CN104731372B (en) Cursor of mouse points to control method, apparatus and system
CN109497925A (en) Eye visual function evaluating apparatus and eye Evaluation of visual function
CN108830943A (en) A kind of image processing method and virtual reality device
CN108171116A (en) Aircraft obstacle avoidance aiding method, device and obstacle avoidance aiding system
CN112543318A (en) 3D display screen compensation method, system and computer readable storage medium
US11521297B2 (en) Method and device for presenting AR information based on video communication technology
US10402939B2 (en) Information processing device, information processing method, and program
CN107704397B (en) Application program testing method and device and electronic equipment
CN105227828A (en) Filming apparatus and method
CN108021346A (en) VR helmets show method, VR helmets and the system of image
CN113395438A (en) Image correction method and related device for eyeball tracking technology
US20230028976A1 (en) Display apparatus, image generation method, and program
CN109408011B (en) Display method, device and equipment of head-mounted display equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination