CN114815257A - XR glasses and camera adjusting method, system, equipment and medium - Google Patents
XR glasses and camera adjusting method, system, equipment and medium Download PDFInfo
- Publication number
- CN114815257A CN114815257A CN202210439932.0A CN202210439932A CN114815257A CN 114815257 A CN114815257 A CN 114815257A CN 202210439932 A CN202210439932 A CN 202210439932A CN 114815257 A CN114815257 A CN 114815257A
- Authority
- CN
- China
- Prior art keywords
- target
- camera
- information
- glasses
- adjusting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000011521 glass Substances 0.000 title claims abstract description 108
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000005070 sampling Methods 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 11
- 238000004458 analytical method Methods 0.000 claims description 6
- 230000000007 visual effect Effects 0.000 abstract description 8
- 230000008569 process Effects 0.000 description 11
- 238000009434 installation Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 230000001360 synchronised effect Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000003993 interaction Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000003068 static effect Effects 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 210000001145 finger joint Anatomy 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0123—Head-up displays characterised by optical features comprising devices increasing the field of view
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The application discloses XR glasses and a camera adjusting method, system, equipment and medium, which are applied to a controller installed on the XR glasses to acquire target adjusting information acquired by an information acquisition device installed on the XR glasses, wherein the target adjusting information comprises information for adjusting a target camera on the XR glasses; analyzing the target adjustment information to obtain target adjustment parameters for adjusting the target camera; and sending the target adjusting parameters to a target adjusting device which is arranged on the XR glasses and corresponds to the target camera, so that the target adjusting device adjusts the camera shooting angle of the target camera based on the target adjusting parameters. This application has realized that XR glasses are automatic adjusts the angle of making a video recording of camera according to adjustment information, compares with the prior art of fixed angle of making a video recording, can enlarge the visual field of vision of camera on the XR glasses. The camera adjustment system, the electronic equipment, the computer readable storage medium and the XR glasses provided by the application also solve the corresponding technical problems.
Description
Technical Field
The application relates to the technical field of XR glasses, in particular to XR glasses and a camera adjusting method, system, equipment and medium.
Background
The Augmented Reality (AR) technology is a technology that skillfully fuses virtual information and the real world, and a plurality of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, sensing and the like are widely applied, and virtual information such as characters, images, three-dimensional models, music, videos and the like generated by a computer is applied to the real world after being simulated, and the two kinds of information complement each other, so that the real world is enhanced.
Virtual Reality (VR) refers to the combination of Virtual and real, and Virtual Reality technology is a computer simulation system that can create and experience a Virtual world, and uses a computer to create a simulated environment in which a user is immersed.
The Extended Reality (XR) is a general term for technologies such as AR and VR, which combines Reality and virtual by a computer to create a virtual environment capable of human-computer interaction. By fusing the visual interaction technologies of the three parts, the experience is provided with the 'immersion feeling' of seamless conversion between the virtual world and the real world.
XR glasses include AR glasses and VR glasses, and in the use, need interact with the environment with the camera of installing on it, however, the visual field of vision of camera is limited on the XR glasses, and the environmental information who gathers is limited, is difficult to satisfy user's demand.
In summary, how to enlarge the visual field of the camera on the XR glasses is a problem to be solved urgently by those skilled in the art.
Disclosure of Invention
The application aims to provide a camera adjusting method which can solve the technical problem of how to enlarge the visual field of a camera on XR glasses to a certain extent. The application also provides a camera adjustment system, an electronic device, a computer readable storage medium and XR glasses.
In order to achieve the above purpose, the present application provides the following technical solutions:
a camera adjusting method is applied to a controller installed on XR glasses and comprises the following steps:
acquiring target adjustment information acquired by an information acquisition device arranged on the XR glasses, wherein the target adjustment information comprises information for adjusting a target camera on the XR glasses;
analyzing the target adjustment information to obtain a target adjustment parameter for adjusting the target camera;
and sending the target adjustment parameters to a target adjustment device which is arranged on the XR glasses and corresponds to the target camera, so that the target adjustment device adjusts the camera shooting angle of the target camera based on the target adjustment parameters.
Preferably, the information collector comprises an infrared sensor, and the target adjustment information comprises a target infrared image carrying a hand position;
analyzing the target adjustment information to obtain a target adjustment parameter for adjusting the target camera, including:
analyzing the hand position in the target infrared image to obtain hand motion information;
converting the hand motion information into the target adjustment parameters for adjusting the target camera.
Preferably, the analyzing the hand position in the target infrared image to obtain hand motion information includes:
sampling the target infrared image acquired within a preset time length to obtain target position coordinates of a target part in the hand position, wherein the number of the target position coordinates is equal to the sampling times;
taking the average coordinate of the sampled first number of the target position coordinates as the motion starting position of the target part;
taking the average coordinate of the sampled final second number of the target position coordinates as the motion ending position of the target part;
determining movement distance information and movement direction information of the target part based on the movement starting position and the movement ending position;
and taking the motion distance information and the motion direction information as the hand motion information.
Preferably, the acquiring of the target adjustment information acquired by the information acquirer installed on the XR glasses includes:
acquiring a current infrared image acquired by the infrared sensor;
judging whether the current infrared image contains the hand position;
and if so, taking the current infrared image as the target infrared image.
Preferably, before determining whether the current infrared image includes the hand position, the method further includes:
acquiring a historical infrared image acquired last time by the infrared sensor;
calculating the difference rate between the current infrared image and the historical infrared image;
judging whether the difference rate is greater than a preset value or not;
and if the difference rate is larger than the preset value, executing the step of judging whether the current infrared image contains the hand position.
Preferably, after acquiring the current infrared image acquired by the infrared sensor, before determining whether the current infrared image includes the hand position, the method further includes:
controlling the infrared sensor to enter a low-power-consumption working mode;
and after the current infrared image is taken as the target infrared image, controlling the infrared sensor to release the low-power-consumption working mode.
A camera adjustment system for use with a controller mounted on XR glasses, comprising:
the first acquisition module is used for acquiring target adjustment information acquired by an information acquisition device installed on the XR glasses, and the target adjustment information comprises information for adjusting a target camera on the XR glasses;
the first analysis module is used for analyzing the target adjustment information to obtain a target adjustment parameter for adjusting the target camera;
the first sending module is configured to send the target adjustment parameter to a target adjustment device, which is installed on the XR glasses and corresponds to the target camera, so that the target adjustment device adjusts a camera angle of the target camera based on the target adjustment parameter.
An electronic device, comprising:
a memory for storing a computer program;
a processor, configured to implement the steps of the camera adjustment method as described above when executing the computer program.
A computer-readable storage medium, in which a computer program is stored, which computer program, when being executed by a processor, carries out the steps of the camera adjustment method as set forth in any one of the above.
An XR glasses, comprising:
the information collector is used for collecting and sending target adjustment information for adjusting a target camera on the XR glasses;
the controller is connected with the information collector and used for analyzing the target adjustment information to obtain and send target adjustment parameters for adjusting the target camera;
and the target adjusting device is connected with the controller and used for adjusting the shooting angle of the target camera based on the target adjusting parameters.
Preferably, the target camera is mounted at a temple corner of the XR glasses; the information collector is arranged below or above the target camera, wherein the upper side or the lower side is the relative position of the XR glasses when the XR glasses are horizontally placed.
The camera adjusting method is applied to a controller installed on XR glasses, and target adjusting information collected by an information collector installed on the XR glasses is obtained, wherein the target adjusting information comprises information for adjusting a target camera on the XR glasses; analyzing the target adjustment information to obtain target adjustment parameters for adjusting the target camera; and sending the target adjusting parameters to a target adjusting device which is arranged on the XR glasses and corresponds to the target camera, so that the target adjusting device adjusts the camera shooting angle of the target camera based on the target adjusting parameters. In this application, the information collection station of installation can collect the target adjustment information of adjusting to the target camera on the XR glasses, and the controller of installation can be followed the target adjustment parameter of target adjustment in the target adjustment information, the target adjusting device of installation can be based on the angle of making a video recording of target adjustment parameter adjustment target camera on the XR glasses at last, the automatic camera angle of adjusting the camera according to adjustment information of XR glasses has been realized, compared with the prior art of fixed camera angle, can enlarge the visual field of vision of camera on the XR glasses. The camera adjustment system, the electronic equipment, the computer readable storage medium and the XR glasses provided by the application also solve the corresponding technical problems.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a first flowchart of a camera adjustment method according to an embodiment of the present disclosure;
fig. 2 is a second flowchart of a camera adjustment method according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of hand motion information calculation;
fig. 4 is a schematic structural diagram of a camera adjustment system according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an XR glasses according to an embodiment of the present disclosure;
fig. 6 is a schematic diagram of a hardware component structure of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a first flowchart of a camera adjustment method according to an embodiment of the present disclosure.
The camera adjusting method provided by the embodiment of the application is applied to a controller installed on XR glasses, and can comprise the following steps:
step S101: the method comprises the steps of obtaining target adjustment information collected by an information collector installed on XR glasses, wherein the target adjustment information comprises information for adjusting a target camera on the XR glasses.
In practical application, install controller and information collection station on the XR glasses that this application provided, and information collection station can collect the target adjustment information that adjusts to the target camera on the XR glasses and send the controller.
It should be noted that the types of the information collector and the target adjustment information may be determined according to actual needs, for example, in order to facilitate a user to quickly manage and control adjustment of a camera on XR glasses, the information collector may be a voice collector, and the target adjustment information at this time may be target voice for adjusting the target camera sent by the user through voice, and the like; for another example, in order to facilitate a user to accurately control adjustment of a camera on the XR glasses, the information collector may also be an image collector, for example, the information collector may be an infrared sensor, a camera, or the like, the target adjustment information at this time may be a target infrared image or the like carrying a hand position of the user, and the hand position may be a finger or the like of the user; for example, the information collector may be a touch screen, and the target adjustment information may be a user touch trajectory collected by the touch screen, which is not specifically limited herein. In addition, the type of the controller installed on the XR glasses in the present application may also be determined according to actual needs, for example, the controller may be a microprocessor or the like.
In a specific application scenario, in the process that the information collector can be an infrared sensor and the target adjustment information is a target infrared image carrying the hand position of a user, the controller can acquire a current infrared image acquired by the infrared sensor in the process of acquiring the target adjustment information acquired by the information collector installed on the XR glasses; judging whether the current infrared image contains a hand position; and if so, taking the current infrared image as a target infrared image. In addition, in the process, when judging whether the current infrared image contains the hand position, the controller may identify the current infrared image, and if the hand position can be identified, it may be judged that the current infrared image contains the hand position and the like.
In a specific application scene, when a user transmits target adjustment information through a hand position, a current infrared image acquired by an infrared sensor is different from a historical infrared image acquired last time, namely, a controller can estimate whether the current infrared image contains the hand position or not based on the difference and then accurately judge the current infrared image, so that the efficiency of acquiring the target infrared image by the controller is improved, namely, the controller can acquire the historical infrared image acquired last time by the infrared sensor before judging whether the current infrared image contains the hand position or not; calculating the difference rate between the current infrared image and the historical infrared image; judging whether the difference rate is greater than a preset value or not; and if the difference rate is greater than the preset value, executing a step of judging whether the current infrared image contains the hand position. It should be noted that, in this process, the specific numerical value of the preset value may be determined according to actual needs, for example, the preset value may be 5%, and the calculation method of the difference rate may be: the difference rate is 100% of the change sampling point/total sampling point, and the like, and the present application is not limited thereto.
In a specific application scene, in order to reduce the power consumption of the infrared sensor and prolong the working time of the infrared sensor, the controller judges whether the current infrared image acquired by the infrared sensor contains a hand position or not after acquiring the current infrared image, and can also control the infrared sensor to enter a low-power-consumption working mode; correspondingly, after the current infrared image is taken as the target infrared image, the infrared sensor can be controlled to release the low-power-consumption working mode, and in addition, after the difference rate between the current infrared image and the historical infrared image is less than or equal to the preset value or the current infrared image does not contain the hand position, the infrared sensor can be controlled to enter the low-power-consumption working mode and the like. It should be further noted that, in the present application, when the infrared sensor is in the low power consumption operating mode, it still collects the infrared image with a power smaller than that in the normal operating mode.
Step S102: and analyzing the target adjustment information to obtain target adjustment parameters for adjusting the target camera.
In practical application, after the controller installed on the XR glasses acquires the target adjustment information acquired by the information collector installed on the XR glasses, the target adjustment information can be analyzed to obtain target adjustment parameters for adjusting the target camera.
It should be noted that, the process of analyzing the target adjustment information by the controller to obtain the target adjustment parameter of the adjustment target camera may be determined according to the type of the target adjustment information, for example, when the target adjustment information is the target voice, the target voice may be recognized, the motion information of the target camera required by the user is extracted from the target voice, and then the motion information is converted into the corresponding target adjustment parameter; and when the target adjustment information is the target infrared image, analyzing the hand position in the target infrared image to obtain hand motion information, and converting the hand motion information into target adjustment parameters for adjusting the target camera, and the like.
Step S103: and sending the target adjusting parameters to a target adjusting device which is arranged on the XR glasses and corresponds to the target camera, so that the target adjusting device adjusts the camera shooting angle of the target camera based on the target adjusting parameters.
In practical application, the XR glasses provided by the application are further provided with a target adjusting device corresponding to the target camera, and the controller needs to send the target adjusting parameter to the target adjusting device after determining the target adjusting parameter, so that the target adjusting device can adjust the camera angle of the target camera based on the target adjusting parameter, and the user can understand the camera angle of the target camera and correspondingly enhance the visual field of the target camera after the camera angle of the target camera changes.
The camera adjusting method is applied to a controller installed on XR glasses, and target adjusting information collected by an information collector installed on the XR glasses is obtained, wherein the target adjusting information comprises information for adjusting a target camera on the XR glasses; analyzing the target adjustment information to obtain target adjustment parameters for adjusting the target camera; and sending the target adjusting parameters to a target adjusting device which is arranged on the XR glasses and corresponds to the target camera, so that the target adjusting device adjusts the camera shooting angle of the target camera based on the target adjusting parameters. In this application, the information collection station of installation can collect the target adjustment information of adjusting to the target camera on the XR glasses, and the controller of installation can be followed the target adjustment parameter of target adjustment in the target adjustment information, the target adjusting device of installation can be based on the angle of making a video recording of target adjustment parameter adjustment target camera on the XR glasses at last, the automatic camera angle of adjusting the camera according to adjustment information of XR glasses has been realized, compared with the prior art of fixed camera angle, can enlarge the visual field of vision of camera on the XR glasses.
Referring to fig. 2, fig. 2 is a second flowchart of a camera adjustment method according to an embodiment of the present disclosure.
The camera adjusting method provided by the embodiment of the application is applied to a controller installed on XR glasses, and can comprise the following steps:
step S201: and acquiring a target infrared image carrying the hand position, which is acquired by an infrared sensor arranged on the XR glasses.
Step S202: sampling is carried out on the target infrared image acquired within the preset time length, and target position coordinates of a target part in the hand position are obtained, wherein the number of the target position coordinates is equal to the sampling times.
In practical application, because the target infrared images acquired by the infrared sensor are continuous, the controller can obtain the hand motion information only by analyzing the hand positions in the continuous multiple target infrared images, but if the user moves the hand positions for a long time, the controller can hardly determine the hand motion information quickly, and further the target camera can be missed, in order to avoid the situation, the controller analyzes the hand positions in the target infrared images to obtain the hand motion information, the target infrared images acquired within a preset time duration can be sampled to obtain target position coordinates of target parts in the hand positions, the number of the target position coordinates is equal to the sampling times, the preset time duration can be determined according to specific application scenes, for example, the preset time duration can be 1s, 2s and the like, the corresponding sampling times can also be determined according to a specific application scene, such as 30 times of sampling, 50 times of sampling and the like, if the preset time length is 1s and the sampling times is 30 times, the controller only needs to sample the target infrared image acquired in 1s for 30 times, so that 30 target position coordinates can be obtained, and then hand movement information in 1s can be obtained according to the 30 target position coordinates.
It should be noted that the type of the target portion in the hand position may be determined according to actual needs, for example, the target portion may be a finger tip, a finger joint, and the like, and the application is not specifically limited herein.
Step S203: and taking the average coordinate of the sampled first number of target position coordinates as the motion starting position of the target part.
Step S204: and taking the average coordinate of the sampled target position coordinates of the last second number as the motion ending position of the target part.
In practical application, the controller needs to determine a corresponding movement starting position and a movement ending position in the process of analyzing the hand position in the target infrared image to obtain the hand movement information, at this time, the controller samples the target infrared image acquired within a preset time period to obtain the target position coordinates of the target part in the hand position, and then the average coordinates of the sampled first number of target position coordinates can be used as the movement starting position of the target part, and the average coordinates of the sampled last second number of target position coordinates can be used as the movement ending position of the target part.
Need to make sure thatIt should be noted that the values of the first number and the second number may be determined according to actual needs, and the present application is not limited specifically, for example, in an example, the first number and the second number may be 5, and the average coordinate of the first 5 sampled target position coordinates may be used as the movement starting position of the target portion, the average coordinate of the last 5 sampled target position coordinates may be used as the movement ending position of the target portion, and the number of the target position coordinates is assumed to be 30, and is (x) after being sorted in time order 1 ,y 1 ),(x 2 ,y 2 )…(x n ,y n ) (n-30), the motion start position and the motion end position may be calculated as follows:
wherein,
which represents the starting position of the movement,
indicating the end of the movement.
Step S205: and determining the movement distance information and the movement direction information of the target part based on the movement starting position and the movement ending position.
In practical applications, after taking the average coordinate of the first number of coordinates of the target position before sampling as the motion start position of the target portion and the average coordinate of the second number of coordinates of the target position after sampling as the motion end position of the target portion, the controller may determine the motion distance information and the motion direction information of the target portion based on the motion start position and the motion end position, and the calculation schematic diagram may be as shown in fig. 3, and the calculation process may be as follows:
wherein,
represents movement distance information and theta represents movement direction information.
Step S206: and taking the motion distance information and the motion direction information as hand motion information.
Step S207: and converting the hand motion information into a target adjusting parameter for adjusting the target camera.
In practical application, the controller may pre-make a comparison table between the hand motion information and the adjustment parameter, and then only need to search the comparison table, the corresponding hand motion information may be converted into the target adjustment parameter of the adjustment target camera, and the like.
Step S208: and sending the target adjusting parameters to a target adjusting device which is arranged on the XR glasses and corresponds to the target camera, so that the target adjusting device adjusts the camera shooting angle of the target camera based on the target adjusting parameters.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a camera adjustment system according to an embodiment of the present disclosure.
The camera adjustment system that this application embodiment provided is applied to the controller of installation on the XR glasses, can include:
the first acquisition module 101 is configured to acquire target adjustment information acquired by an information acquisition device installed on the XR glasses, where the target adjustment information includes information for adjusting a target camera on the XR glasses;
the first analysis module 102 is configured to analyze the target adjustment information to obtain a target adjustment parameter for adjusting the target camera;
and the first sending module 103 is configured to send the target adjustment parameter to a target adjustment device corresponding to the target camera and mounted on the XR glasses, so that the target adjustment device adjusts the camera angle of the target camera based on the target adjustment parameter.
According to the camera adjusting system provided by the embodiment of the application, the information collector comprises an infrared sensor, and the target adjusting information comprises a target infrared image carrying a hand position;
the first analysis module may include:
the first analysis unit is used for analyzing the hand position in the target infrared image to obtain hand motion information;
and the first processing unit is used for converting the hand motion information into a target adjusting parameter for adjusting the target camera.
In an embodiment of the camera adjustment system, the first analysis unit may be specifically configured to: sampling the target infrared image acquired within a preset time length to obtain target position coordinates of a target part in the hand position, wherein the number of the target position coordinates is equal to the sampling times; taking the average coordinate of the sampled first number of target position coordinates as the motion starting position of the target part; taking the average coordinate of the sampled target position coordinates of the last second number as the movement ending position of the target part; determining movement distance information and movement direction information of the target part based on the movement starting position and the movement ending position; and taking the motion distance information and the motion direction information as hand motion information.
In an embodiment of the present application, a camera adjustment system, a first obtaining module may include:
the first acquisition unit is used for acquiring a current infrared image acquired by the infrared sensor;
the first judgment unit is used for judging whether the current infrared image contains a hand position; and if so, taking the current infrared image as a target infrared image.
The camera adjustment system provided by the embodiment of the application can further include:
the second acquisition unit is used for acquiring the historical infrared image acquired last time by the infrared sensor before the first judgment unit judges whether the current infrared image contains the hand position;
the first calculating unit is used for calculating the difference rate between the current infrared image and the historical infrared image;
the second judging unit is used for judging whether the difference rate is greater than a preset value or not; and if the difference rate is larger than the preset value, prompting the first judging unit to execute a step of judging whether the current infrared image contains the hand position.
The camera adjustment system provided by the embodiment of the application can further include:
the first control module is used for controlling the infrared sensor to enter a low-power-consumption working mode after the first acquisition unit acquires the current infrared image acquired by the infrared sensor and before the first judgment unit judges whether the current infrared image contains the hand position;
and the second control module is used for controlling the infrared sensor to remove the low-power-consumption working mode after the first judgment unit takes the current infrared image as the target infrared image.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an XR glasses according to an embodiment of the present disclosure.
The XR glasses that this application embodiment provided can include:
the information acquisition unit 201 is configured to acquire and send target adjustment information for adjusting a target camera on the XR glasses;
the controller 202 is connected with the information collector 201 and is used for analyzing the target adjustment information to obtain and send target adjustment parameters of the adjustment target camera;
and the target adjusting device 203 is connected with the controller 202 and is used for adjusting the shooting angle of the target camera based on the target adjusting parameter.
In the XR glasses provided by the embodiment of the application, the target camera can be arranged at the corner of the glasses leg of the XR glasses; the information collector can be arranged below or above the target camera, wherein the upper or lower part is the relative position of the XR glasses when the XR glasses are horizontally placed. The number of the information collectors can be determined according to actual needs, for example, the information collectors can be information collectors composed of two infrared sensors, the two infrared sensors can be arranged left and right, and the like, so that the environment information collection capability in a large range can be obtained.
It should be noted that the installation positions of the target camera and the information collector may be determined according to actual needs, for example, in a case where the information collector is composed of two infrared sensors, the target camera may be installed at a corner of a temple of the XR glasses, the two infrared sensors may be installed on a left side and a right side of the target camera, respectively, so as to obtain environment information collection capability in a large range, and the like. In addition, the installation position of the controller on the XR glasses can also be determined according to actual needs, such as the controller can be installed on a bridge of the XR glasses, a corner of a temple of the XR glasses, and the like, and the application is not particularly limited herein.
It should be noted that, the target camera, the information collector, and the target adjusting device may be used in a matching manner, for example, one target camera needs to be installed with a corresponding information collector and a corresponding target adjusting device, and for convenience of understanding, if a camera is installed at each of corners of left and right glasses legs of the XR glasses, the information collector and the target adjusting device need to be installed at each of the corners of the left and right glasses legs of the XR glasses, at this time, the target adjusting information collected by a single information collector can only adjust the camera angle of the corresponding camera, for example, the information collector installed at the corner of the left glasses leg can only adjust the camera angle of the camera installed at the corner of the left glasses leg, and the like; of course, a plurality of cameras may share one information collector, at this time, the target adjustment information collected by a single information collector needs to be transmitted to a corresponding camera, a specific mode of adjusting the camera angle of the corresponding camera according to a certain target adjustment information may be determined according to actual needs, for example, a camera is respectively installed at the corners of the left and right glasses legs of the XR glasses, if the information collector collects the target adjustment information generated by the left hand, the camera angle of the camera installed at the corner of the left glasses leg may be adjusted accordingly, if the information collector collects the target adjustment information generated by the right hand, the camera angle of the camera installed at the corner of the right glasses leg may be adjusted accordingly, and the like.
Based on the hardware implementation of the program module, and in order to implement the method according to the embodiment of the present invention, an embodiment of the present invention further provides an electronic device, fig. 6 is a schematic diagram of a hardware composition structure of the electronic device according to the embodiment of the present invention, and as shown in fig. 6, the electronic device includes:
a communication interface 1 capable of information interaction with other devices such as network devices and the like;
and the processor 2 is connected with the communication interface 1 to realize information interaction with other equipment, and is used for executing the camera adjusting method of the application provided by one or more technical schemes when running a computer program. And the computer program is stored on the memory 3.
In practice, of course, the various components in the electronic device are coupled together by the bus system 4. It will be appreciated that the bus system 4 is used to enable connection communication between these components. The bus system 4 comprises, in addition to a data bus, a power bus, a control bus and a status signal bus. For the sake of clarity, however, the various buses are labeled as bus system 4 in fig. 6.
The memory 3 in the embodiment of the present invention is used to store various types of data to support the operation of the electronic device. Examples of such data include: any computer program for operating on an electronic device.
It will be appreciated that the memory 3 may be either volatile memory or nonvolatile memory, and may include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The memory 2 described in the embodiments of the present invention is intended to comprise, without being limited to, these and any other suitable types of memory.
The method disclosed by the above embodiment of the present invention can be applied to the processor 2, or implemented by the processor 2. The processor 2 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 2. The processor 2 described above may be a general purpose processor, a DSP, or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. The processor 2 may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed by the embodiment of the invention can be directly implemented by a hardware decoding processor, or can be implemented by combining hardware and software modules in the decoding processor. The software modules may be located in a storage medium located in the memory 3, and the processor 2 reads the program in the memory 3 and in combination with its hardware performs the steps of the aforementioned method.
When the processor 2 executes the program, the corresponding processes in the methods according to the embodiments of the present invention are realized, and for brevity, are not described herein again.
In an exemplary embodiment, the present invention further provides a storage medium, i.e. a computer storage medium, in particular a computer readable storage medium, for example comprising a memory 3 storing a computer program, which is executable by a processor 2 to perform the steps of the aforementioned method. The computer readable storage medium may be Memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface Memory, optical disk, or CD-ROM.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus, terminal and method may be implemented in other manners. The above-described device embodiments are only illustrative, for example, the division of the unit is only one logical function division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling an electronic device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (11)
1. A camera adjusting method is applied to a controller installed on XR glasses and comprises the following steps:
acquiring target adjustment information acquired by an information acquisition device arranged on the XR glasses, wherein the target adjustment information comprises information for adjusting a target camera on the XR glasses;
analyzing the target adjustment information to obtain a target adjustment parameter for adjusting the target camera;
and sending the target adjustment parameters to a target adjustment device which is installed on the XR glasses and corresponds to the target camera, so that the target adjustment device adjusts the shooting angle of the target camera based on the target adjustment parameters.
2. The method of claim 1, wherein the information collector comprises an infrared sensor, and the target adjustment information comprises a target infrared image carrying a hand position;
analyzing the target adjustment information to obtain a target adjustment parameter for adjusting the target camera, including:
analyzing the hand position in the target infrared image to obtain hand motion information;
converting the hand motion information into the target adjustment parameters for adjusting the target camera.
3. The method of claim 2, wherein the analyzing the hand position in the target infrared image for hand motion information comprises:
sampling the target infrared image acquired within a preset time length to obtain target position coordinates of a target part in the hand position, wherein the number of the target position coordinates is equal to the sampling times;
taking the average coordinate of the sampled first number of the target position coordinates as the motion starting position of the target part;
taking the average coordinate of the sampled final second number of the target position coordinates as the motion ending position of the target part;
determining movement distance information and movement direction information of the target part based on the movement starting position and the movement ending position;
and taking the motion distance information and the motion direction information as the hand motion information.
4. The method of claim 3, wherein the obtaining target adjustment information collected by an information collector installed on the XR glasses comprises:
acquiring a current infrared image acquired by the infrared sensor;
judging whether the current infrared image contains the hand position;
and if so, taking the current infrared image as the target infrared image.
5. The method of claim 4, wherein before determining whether the hand position is included in the current infrared image, further comprising:
acquiring a historical infrared image acquired last time by the infrared sensor;
calculating the difference rate between the current infrared image and the historical infrared image;
judging whether the difference rate is greater than a preset value or not;
and if the difference rate is larger than the preset value, executing the step of judging whether the current infrared image contains the hand position.
6. The method of claim 5, wherein after the obtaining the current infrared image captured by the infrared sensor and before the determining whether the current infrared image includes the hand position, further comprising:
controlling the infrared sensor to enter a low-power-consumption working mode;
and after the current infrared image is taken as the target infrared image, controlling the infrared sensor to release the low-power-consumption working mode.
7. A camera adjustment system for use with a controller mounted on XR glasses, comprising:
the first acquisition module is used for acquiring target adjustment information acquired by an information collector installed on the XR glasses, and the target adjustment information comprises information for adjusting a target camera on the XR glasses;
the first analysis module is used for analyzing the target adjustment information to obtain a target adjustment parameter for adjusting the target camera;
the first sending module is configured to send the target adjustment parameter to a target adjustment device, which is installed on the XR glasses and corresponds to the target camera, so that the target adjustment device adjusts a camera angle of the target camera based on the target adjustment parameter.
8. An electronic device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the camera adjustment method according to any one of claims 1 to 6 when executing the computer program.
9. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the camera adjustment method according to any one of claims 1 to 6.
10. An XR glasses, comprising:
the information collector is used for collecting and sending target adjustment information for adjusting a target camera on the XR glasses;
the controller is connected with the information collector and used for analyzing the target adjustment information to obtain and send target adjustment parameters for adjusting the target camera;
and the target adjusting device is connected with the controller and used for adjusting the shooting angle of the target camera based on the target adjusting parameters.
11. The XR glasses according to claim 10, wherein the target camera is mounted at a temple corner of the XR glasses; the information collector is arranged below or above the target camera, wherein the upper side or the lower side is the relative position of the XR glasses when the XR glasses are horizontally placed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210439932.0A CN114815257A (en) | 2022-04-25 | 2022-04-25 | XR glasses and camera adjusting method, system, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210439932.0A CN114815257A (en) | 2022-04-25 | 2022-04-25 | XR glasses and camera adjusting method, system, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114815257A true CN114815257A (en) | 2022-07-29 |
Family
ID=82508478
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210439932.0A Pending CN114815257A (en) | 2022-04-25 | 2022-04-25 | XR glasses and camera adjusting method, system, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114815257A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115955547A (en) * | 2022-12-30 | 2023-04-11 | 上海梵企光电科技有限公司 | Method and system for adjusting camera of XR glasses |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106713773A (en) * | 2017-03-31 | 2017-05-24 | 联想(北京)有限公司 | Shooting control method and electronic device |
| US20190037144A1 (en) * | 2016-06-30 | 2019-01-31 | Shenzhen Royole Technologies Co. Ltd. | Method for adjusting an angle of an element of a photographing unit and a head mounted display |
| CN110086988A (en) * | 2019-04-24 | 2019-08-02 | 薄涛 | Shooting angle method of adjustment, device, equipment and its storage medium |
| WO2019237984A1 (en) * | 2018-06-15 | 2019-12-19 | Oppo广东移动通信有限公司 | Image correction method, electronic device and computer readable storage medium |
| CN210924102U (en) * | 2019-11-28 | 2020-07-03 | 维沃移动通信有限公司 | Glasses |
| CN111552076A (en) * | 2020-05-13 | 2020-08-18 | 歌尔科技有限公司 | Image display method, AR glasses and storage medium |
| CN111669508A (en) * | 2020-07-01 | 2020-09-15 | 海信视像科技股份有限公司 | Camera control method and display device |
| CN112666705A (en) * | 2019-10-15 | 2021-04-16 | 北京七鑫易维信息技术有限公司 | Eye movement tracking device and eye movement tracking method |
| US20210208675A1 (en) * | 2018-06-06 | 2021-07-08 | Beijing 7Invensun Technology Co., Ltd. | Smart Glasses, Method and Device for Tracking Eyeball Trajectory, and Storage Medium |
| CN114280781A (en) * | 2021-12-17 | 2022-04-05 | 歌尔光学科技有限公司 | Intelligent glasses and control method and device of intelligent glasses |
-
2022
- 2022-04-25 CN CN202210439932.0A patent/CN114815257A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190037144A1 (en) * | 2016-06-30 | 2019-01-31 | Shenzhen Royole Technologies Co. Ltd. | Method for adjusting an angle of an element of a photographing unit and a head mounted display |
| CN106713773A (en) * | 2017-03-31 | 2017-05-24 | 联想(北京)有限公司 | Shooting control method and electronic device |
| US20210208675A1 (en) * | 2018-06-06 | 2021-07-08 | Beijing 7Invensun Technology Co., Ltd. | Smart Glasses, Method and Device for Tracking Eyeball Trajectory, and Storage Medium |
| WO2019237984A1 (en) * | 2018-06-15 | 2019-12-19 | Oppo广东移动通信有限公司 | Image correction method, electronic device and computer readable storage medium |
| CN110086988A (en) * | 2019-04-24 | 2019-08-02 | 薄涛 | Shooting angle method of adjustment, device, equipment and its storage medium |
| CN112666705A (en) * | 2019-10-15 | 2021-04-16 | 北京七鑫易维信息技术有限公司 | Eye movement tracking device and eye movement tracking method |
| CN210924102U (en) * | 2019-11-28 | 2020-07-03 | 维沃移动通信有限公司 | Glasses |
| CN111552076A (en) * | 2020-05-13 | 2020-08-18 | 歌尔科技有限公司 | Image display method, AR glasses and storage medium |
| CN111669508A (en) * | 2020-07-01 | 2020-09-15 | 海信视像科技股份有限公司 | Camera control method and display device |
| CN114280781A (en) * | 2021-12-17 | 2022-04-05 | 歌尔光学科技有限公司 | Intelligent glasses and control method and device of intelligent glasses |
Non-Patent Citations (1)
| Title |
|---|
| 杨露菁等: "《智能图像处理及应用》", 31 March 2019, 中国铁道出版社, pages: 178 - 179 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115955547A (en) * | 2022-12-30 | 2023-04-11 | 上海梵企光电科技有限公司 | Method and system for adjusting camera of XR glasses |
| CN115955547B (en) * | 2022-12-30 | 2023-06-30 | 上海梵企光电科技有限公司 | Camera adjustment method and system for XR glasses |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109240576B (en) | Image processing method and device in game, electronic device and storage medium | |
| JP6259545B2 (en) | System and method for inputting a gesture in a 3D scene | |
| EP2273450A2 (en) | Target tracking apparatus, image tracking apparatus, methods of controlling operation of same, and digital camera | |
| CN110809101B (en) | Image zooming processing method and device, electronic equipment and storage medium | |
| CN111145215B (en) | Target tracking method and device | |
| CN108777765B (en) | Method and device for acquiring full-definition image and electronic equipment | |
| CN103106388B (en) | Method and system of image recognition | |
| CN114815257A (en) | XR glasses and camera adjusting method, system, equipment and medium | |
| WO2015014280A1 (en) | Method, apparatus and electronic device for display orientation switching | |
| JP7446644B2 (en) | Positioning methods, devices, mobile terminals, storage media | |
| CN108805056A (en) | A kind of monitoring camera-shooting face sample extending method based on 3D faceforms | |
| CN111656313A (en) | Screen display switching method, display device and movable platform | |
| CN111382691A (en) | Screen content page turning method and mobile terminal | |
| CN112183431A (en) | Real-time pedestrian number statistical method and device, camera and server | |
| CN115278084A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN111986229A (en) | Video target detection method, device and computer system | |
| CN117456558A (en) | Human body posture estimation and control method based on camera and related equipment | |
| JP2013080266A (en) | Input device | |
| CN110493618A (en) | Android method for intelligently controlling televisions and system based on USB3.0 interface | |
| CN112799502A (en) | Walking redirection control method, equipment and storage medium in virtual reality space | |
| CN114840086B (en) | Control method, electronic equipment and computer storage medium | |
| CN113762017B (en) | Action recognition method, device, equipment and storage medium | |
| CN109993143A (en) | Installation method, device, electronic equipment and the storage medium of image capture device | |
| CN109871179B (en) | Gesture direction recognition method, gesture direction recognition device, mobile terminal and storage medium | |
| CN117032447B (en) | Alternate gesture interaction method and device, electronic chip and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |