WO2022227374A1 - 手柄控制追踪器的控制方法、装置及头戴式显示设备 - Google Patents

手柄控制追踪器的控制方法、装置及头戴式显示设备 Download PDF

Info

Publication number
WO2022227374A1
WO2022227374A1 PCT/CN2021/118549 CN2021118549W WO2022227374A1 WO 2022227374 A1 WO2022227374 A1 WO 2022227374A1 CN 2021118549 W CN2021118549 W CN 2021118549W WO 2022227374 A1 WO2022227374 A1 WO 2022227374A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
handle
emitting
time period
tracker
Prior art date
Application number
PCT/CN2021/118549
Other languages
English (en)
French (fr)
Inventor
吴涛
Original Assignee
青岛小鸟看看科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 青岛小鸟看看科技有限公司 filed Critical 青岛小鸟看看科技有限公司
Priority to US17/880,750 priority Critical patent/US11896894B2/en
Publication of WO2022227374A1 publication Critical patent/WO2022227374A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/24Constructional details thereof, e.g. game controllers with detachable joystick handles
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014Hand-worn input/output arrangements, e.g. data gloves
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082Virtual reality

Definitions

  • Embodiments of the present disclosure relate to the field of virtual reality technologies, and more particularly, to a control method, device, head-mounted display device, and computer-readable storage medium for a handle-controlled tracker.
  • HMD Head Mounted Display
  • VR Virtual Reality
  • AR Augmented Reality
  • Mixed Reality Mixed Reality
  • MR Mixed Reality
  • the HMD can be used in conjunction with the joystick control tracker.
  • a virtual reality, augmented reality or mixed reality scene is presented on the HMD, and the user interacts with the elements in the above scene by controlling the joystick control tracker held in the hand.
  • An object of the embodiments of the present disclosure is to provide a new technical solution for controlling the control of a tracker by a handle.
  • a method for controlling a handle-controlled tracker is provided, which is applied to a head-mounted display device used in conjunction with the handle-controlled tracker.
  • the handle-controlled tracker includes a handle body and a handle provided on the surface of the handle body.
  • a plurality of light-emitting units includes: acquiring tracking information obtained by tracking a handle to control a tracker within a first time period; wherein the tracking information includes: pose information, position information and acceleration; and predicting the handle to control the tracker according to the tracking information Motion information in the second time period; wherein the second time period is located after the first time period; according to the motion information, the parameter values of the light-emitting parameters of the plurality of light-emitting units in the second time period are adjusted.
  • the motion information includes the motion position, and the light-emitting parameter includes the light-emitting duration; according to the motion information, adjusting the parameter values of the light-emitting parameters of the plurality of light-emitting units in the second time period includes: obtaining a preset in the head-mounted display device.
  • the tracking distance between the reference point and the motion position according to the corresponding relationship between the tracking distance and the preset distance segment and the luminous duration, obtain the target luminous duration corresponding to the target distance segment where the tracking distance is located; wherein, the preset distance segment In the corresponding relationship with the light-emitting duration, the light-emitting duration corresponding to each distance segment is less than or equal to the light-emitting duration of a plurality of light-emitting units in each case that the head-mounted display device in the distance segment is tracked to the handle-controlled tracker;
  • the second time period adjusts the light-emitting duration of the plurality of light-emitting units to be the target light-emitting duration.
  • the length of the distance section is less than or equal to 30 cm.
  • the motion information includes: a preset reference point in the head-mounted display device points to a target in a first direction in which the handle controls the tracker, and a second direction in which the front of the display screen in the head-mounted display device points to the back. included angle; according to the motion information, adjusting the parameter values of the lighting parameters of the plurality of light-emitting units in the second time period, including: when the target included angle is within the preset concealed viewing angle range, adjusting the number of light-emitting units in the second time period The light-emitting duration of each light-emitting unit is 0.
  • the concealed viewing angle ranges from 200° to 360°.
  • the motion information includes: motion speed; according to the motion information, adjusting parameter values of light-emitting parameters of the plurality of light-emitting units in the second time period, including: when the motion speed is less than a preset speed threshold, reducing the The light-emitting frequency of each light-emitting unit.
  • reducing the light-emitting frequency of the plurality of light-emitting units includes: reducing the light-emitting frequency of the plurality of light-emitting units to a preset frequency; wherein, the frequency range of the preset frequency is 0-15 Hz.
  • a control device for a handle control tracker which is applied to a head-mounted display device used in conjunction with the handle control tracker.
  • the handle control tracker includes a handle body and a handle body disposed on the surface of the handle body.
  • the device includes: an acquisition module, configured to acquire the tracking information of the handle-controlled tracker in the first time period; wherein, the tracking information includes: pose information, position information and acceleration; processing module, set to According to the tracking information, the motion information of the handle control tracker in the second time period is predicted; wherein, the second time period is located after the first time period; the adjustment module is configured to adjust the plurality of light-emitting units in the second time period according to the motion information The parameter value of the glow parameter within the segment.
  • the motion information includes a motion position
  • the lighting parameter includes a lighting duration
  • the adjustment module is specifically set to: obtain the tracking distance between the preset reference point and the motion position in the head-mounted display device; obtain the target distance where the tracking distance is located according to the tracking distance and the corresponding relationship between the preset distance segment and the lighting duration The target lighting duration corresponding to the segment; wherein, in the preset corresponding relationship between the distance segment and the lighting duration, the lighting duration corresponding to each distance segment is less than or equal to the distance segment when the head mounted display device is tracking to the handle control
  • the light-emitting duration of the plurality of light-emitting units is adjusted; in the second time period, the light-emitting duration of the plurality of light-emitting units is adjusted to be the target light-emitting duration.
  • the length of the distance section is less than or equal to 30 cm.
  • the motion information includes: a preset reference point in the head-mounted display device points to a target in a first direction in which the handle controls the tracker, and a second direction in which the front of the display screen in the head-mounted display device points to the back.
  • the adjustment module is specifically set as: when the target included angle is within the preset concealed viewing angle range, adjust the light-emitting duration of the plurality of light-emitting units to 0 in the second time period.
  • the concealed viewing angle ranges from 200° to 360°.
  • the motion information includes: a motion speed; the adjustment module is specifically configured to: reduce the light-emitting frequency of the plurality of light-emitting units when the motion speed is less than a preset speed threshold.
  • the adjustment module is specifically set to: reduce the light-emitting frequency of the plurality of light-emitting units to a preset frequency; wherein, the frequency range of the preset frequency is 0-15 Hz.
  • a head-mounted display device comprising a memory and a processor, where the memory is used for storing a computer program; the processor is used for executing the computer program, so as to realize the first aspect according to the present disclosure Methods.
  • a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method according to the first aspect of the present disclosure.
  • the control method of the handle tracking controller provided by the embodiment of the present disclosure can be applied to a head-mounted display device used in conjunction with a handle control tracker.
  • the handle control tracker includes a handle body and a plurality of light-emitting units disposed on the surface of the handle body.
  • the embodiment of the present disclosure can obtain the tracking information obtained by tracking the handle to control the tracker in the first time period; wherein, the tracking information includes: posture information, position information and acceleration, and then according to the above tracking information, it is predicted that the handle controls the tracker in Motion information in the second time period; wherein the second time period is located after the first time period, and finally, according to the motion information, the parameter values of the lighting parameters of the plurality of light-emitting units in the second time period are adjusted to adjust the handle Control the power consumption on the tracker, so as to reduce the heat generated on the handle control tracker by adjusting the power consumption of the handle control tracker without affecting the user's normal use of the handle control tracker, so that the heat generated on the handle control tracker is generated.
  • the heat can be applied to the needs of miniaturized design.
  • FIG. 1 is a schematic structural diagram of a handle-controlled tracker according to an embodiment of the disclosure
  • FIG. 2 is a functional structural block diagram of a head-mounted display device according to an embodiment of the present disclosure
  • FIG. 3 is a method flowchart of a control method for a handle-controlled tracker according to an embodiment of the present disclosure
  • FIG. 4 is a method flowchart of another method for controlling a tracker with a handle in an embodiment of the present disclosure
  • FIG. 5 is a functional structural block diagram of another control device for a handle to control a tracker according to an embodiment of the disclosure.
  • the reduction in the volume of the handle-controlled tracker usually reduces the surface area of the handle-controlled tracker, resulting in a heat dissipation area on the handle-controlled tracker that can be used for heat dissipation. becomes smaller, and the heat dissipation performance deteriorates.
  • the user's hand holding the handle-controlled tracker will directly contact part of the surface on the handle-controlled tracker. In this case, the heat generated on the handle-controlled tracker will pass through the above-mentioned Part of the surface is transferred to the skin of the user's hand, causing discomfort to the user.
  • the embodiments of the present disclosure provide a new technical solution for the control of handle control tracking, so as to reduce the volume of handle control tracking and effectively reduce the heat generated by handle control tracking.
  • FIG. 1 shows a schematic structural diagram of a handle tracking controller according to an embodiment of the present disclosure.
  • the handle control tracker 10 includes a handle body 101 and a plurality of light-emitting units 102 disposed on the surface of the handle body 101 .
  • the handle body 101 includes an end portion 1011 and a handle portion 1012 , and a plurality of light-emitting units are disposed on the surface of the end portion 1011 .
  • a plurality of light-emitting mark positions may be provided on the surface of the end portion 1011 , and each light-emitting mark position is provided with a light-emitting unit 102 .
  • the arrangement manner of the positions of the plurality of light-emitting marks can be set by those skilled in the art according to the actual situation, which is not limited in this embodiment of the present disclosure.
  • the plurality of illuminated marker locations includes 24 illuminated marker locations.
  • the light-emitting unit 102 is a light-emitting diode (light-emitting diode, English abbreviation: LED).
  • the light emitting unit 102 is used to emit detection light.
  • the wavelength of the detection light is, for example, in the range of 420 nm to 690 nm; or, the wavelength of the detection light is, for example, in the range of 780 nm to 1100 nm, for example, 850 nm or 940 nm.
  • the plurality of light-emitting units 102 are in a light-emitting state at the same time during operation (ie, the light-emitting units emit light); or the plurality of light-emitting units 102 are in an off state at the same time (ie, the light-emitting units do not emit light).
  • the light-emitting unit 102 is simultaneously activated to emit light according to a preset duty cycle, and the light-emitting duration is in the range of 15 ⁇ s ⁇ 150 ⁇ s.
  • the above preset duty ratio is, for example, 40%.
  • the head-mounted display device correspondingly displays the same frame of picture.
  • FIG. 2 shows a functional structural block diagram of a head-mounted display device according to an embodiment of the present disclosure.
  • the head mounted display device 20 includes: a positioning tracking sensor 21 .
  • the location tracking sensor 21 includes: a memory 211 and a processor 212 .
  • the memory 211 of the head-mounted display device 20 is used to store a computer program, and the computer program is used to control the processor 212 of the head-mounted display device 20 to operate to implement any implementation according to the present disclosure.
  • Example of the handle control method of the tracker A skilled person can design a computer program according to the solutions of the embodiments of the present disclosure. How the computer program controls the processor 212 to operate is well known in the art, so it will not be described in detail here.
  • an inertial navigation unit (not shown in FIG. 1 ) for tracking acceleration data is built into the head mounted display device.
  • FIG. 3 is a flowchart of a method for controlling a tracker with a handle according to an embodiment of the present disclosure. As shown in FIG. 3, the method includes the following steps S310-S330:
  • Step S310 Acquire tracking information obtained by tracking the handle to control the tracker in the first time period; wherein the tracking information includes: pose information, position information and acceleration.
  • the pose information is the information related to the pose.
  • the pose information may include rotation angles in three rotation planes, wherein the three rotation planes are perpendicular to each other.
  • the pose information of the handle-controlled tracker is the rotation angle that occurs in the three rotation planes when the pose of the handle-controlled tracker changes.
  • the pose information may also include rotation angles in more than three rotation planes, so as to improve the accuracy of the pose determination.
  • Location information is information related to location. For example, it may be information representing a spatial position, such as coordinates in a three-dimensional spatial coordinate system.
  • the 6DoF (Six degrees of freedom tracking) information of the handle control tracker can be obtained, and the above-mentioned pose information and position information can be obtained according to the obtained results.
  • the acceleration includes acceleration in a first direction, a second direction, and a third direction.
  • the first direction, the second direction and the third direction are perpendicular to each other.
  • the aforementioned acceleration can be obtained by means of an inertial navigation unit.
  • Step S320 Predicting motion information of the handle-controlled tracker in a second time period according to the tracking information, wherein the second time period is located after the first time period.
  • the motion information includes motion locations.
  • the movement position is the spatial position where the handle controls the tracker, which can be the coordinates in the three-dimensional space coordinate system.
  • step S320 the tracker can be controlled according to the tracking handle in the first time period to obtain the first position information, the second position information, and the first time point corresponding to the first position information (for example, the start time point of the first time period) And the second time point corresponding to the second position information, such as the end time point of the first time period, obtain the movement speed of the handle control tracker (for example, the average speed of the handle control tracker in the second time period), and control the tracker according to the handle
  • the movement speed, position information and acceleration are predicted, and the movement position of the handle to control the tracker in the second time period is predicted.
  • the first position information is (x 1 , y 1 , z 1 )
  • the second position information is (x 2 , y 2 , z 2 )
  • the first time point is t 1
  • the second time point is t 2 , where t 2 >t 1 .
  • the distance between the first position information and the second position information can be obtained according to the first position information and the second position information, and the distance is used as the first displacement s of the handle control tracker, and the handle controls the tracking
  • a second possible displacement of the handle in the second time period can be calculated according to the movement speed and the acceleration tracked in step S310, according to the position of the handle in the first time period. The information and the above-mentioned second displacement are used to obtain the movement position of the handle corresponding to each time point in the second time period.
  • the motion information includes: a preset reference point in the head-mounted display device points to a first target direction of the handle to control the tracker, and a second target direction in which the front of the display screen in the head-mounted display device points to the back target angle between.
  • the above-mentioned preset reference point is, for example, a point on the position of the positioning tracking sensor in the head-mounted display device.
  • the position coordinates obtained by the tracking handle controlling the tracker in the first time period are obtained, and the direction in which the preset reference point in the head-mounted display device points to the position coordinates is used as the first target direction. Then, the angle between the first target direction and the second target direction is obtained as the target angle.
  • the motion information includes motion speed.
  • the process of acquiring the motion speed reference may be made to the corresponding introduction on the process of acquiring the motion speed in the foregoing embodiment, which will not be repeated here.
  • the above motion information may be acquired periodically.
  • the time length of the second time period (hereinafter referred to as the time length for short) is the same as the time length of the first time period.
  • the second period is the next period; and when the first period is the historical period (previous period), the second period is the current period.
  • the durations of the first time period and the second time period may be set by those skilled in the art according to actual conditions, which are not limited in this embodiment of the present disclosure.
  • Step S330 Adjust parameter values of light-emitting parameters of the plurality of light-emitting units in the second time period according to the motion information.
  • the lighting parameter when the motion information is a motion position, the lighting parameter includes lighting duration.
  • the execution process of step S330 may include the following steps S410-S430:
  • Step S410 Obtain the tracking distance between the preset reference point in the head-mounted display device and the movement position.
  • the preset reference point in the head-mounted display device and the above-mentioned movement position can be mapped in the preset three-dimensional space coordinate system, according to the first coordinate of the preset reference point in the three-dimensional space coordinate system and the movement position in the three-dimensional space.
  • the distance between the first coordinate and the second coordinate is obtained as the above-mentioned tracking distance.
  • Step S420 According to the tracking distance and the preset corresponding relationship between the distance section and the light-emitting duration, obtain the target light-emitting duration corresponding to the target distance section where the tracking distance is located.
  • the tracking distance of the handle control tracker has a maximum distance and a minimum distance, so the tracking distance of the handle control tracker corresponds to a distance range.
  • the distance range can be divided into a plurality of preset distance segments, and each distance segment has the same length.
  • the distance segment may be less than or equal to 30 cm in length.
  • the number of the plurality of preset distance segments can be set by those skilled in the art according to the actual situation, which is not limited in this embodiment of the present disclosure.
  • the distance range for tracking the handle control tracker is 3cm to 150cm, and the distance range is divided into 5 preset distance segments, and the length of each preset distance segment is 30cm.
  • the five preset distance sections include a first distance section, a second distance section, a third distance section, a fourth distance section and a fifth distance section, and the first distance section corresponding to the first distance section
  • the distance range is 3cm ⁇ 30cm
  • the second distance range corresponding to the second distance segment is 31cm ⁇ 60cm
  • the third distance range corresponding to the third distance segment is 61cm ⁇ 90cm
  • the fourth distance range corresponding to the fourth distance segment is 91cm-120cm
  • the fifth distance range corresponding to the fifth distance segment is 121cm-150cm.
  • the lighting duration corresponding to each distance segment is less than or equal to that of the distance segment when the head-mounted display device is tracked to the handle-controlled tracker.
  • the corresponding relationship between the preset distance section and the light-emitting duration can be obtained by those skilled in the art according to the measurement result of the actual distance section and the light-emitting duration.
  • step S420 according to the tracking distance acquired in step S410, the distance segment including the tracking distance (ie, the distance segment where the tracking distance is located) is used as the target distance segment.
  • the tracking distance is 15 cm, and the target distance segment is the above-mentioned first distance segment.
  • the tracking distance is 36 cm, and the target distance segment is the above-mentioned second distance segment.
  • Step S430 Adjust the light-emitting duration of the plurality of light-emitting units to be the target light-emitting duration in the second time period.
  • the light-emitting duration of the plurality of light-emitting units is adjusted to be the target light-emitting time duration, so that in the second time period, the light-emitting duration of the plurality of light-emitting units is less than or equal to that when the head-mounted display device is tracking the handle to control the tracker
  • the light-emitting duration of the plurality of light-emitting units is reduced, the power consumption of the plurality of light-emitting units is reduced, and the purpose of reducing the heat generated by the plurality of light-emitting units is achieved.
  • step S330 it may be determined whether the target angle is within a preset hidden viewing angle range.
  • the concealed viewing angle range is the viewing angle range of the user when the user's line of sight cannot track the handle control tracker (for example, the handle control tracker is located behind the user). If the determination result is yes, that is, the target angle is within the preset concealed viewing angle range, it means that the handle control tracker is not within the user's line of sight at this time, and the light-emitting duration of the plurality of light-emitting units is adjusted to 0 in the second time period.
  • the multiple light-emitting units are adjusted to be in an off state, so as to reduce the power consumption of the multiple light-emitting units and achieve the purpose of reducing the heat generated by the multiple light-emitting units. If the determination result is negative, no processing is performed on the plurality of light emitting units.
  • the hidden viewing angle ranges from 200° to 360°.
  • step S330 when the motion information is a motion speed, in this case, in step S330, it may be determined whether the motion speed is less than a preset speed threshold.
  • the preset speed threshold may be the speed at which the handle-controlled tracker is in a stationary state or in a substantially stationary state.
  • the preset speed threshold is set by those skilled in the art according to the actual situation, which is not limited in this embodiment of the present disclosure.
  • the determination result is yes, that is, the movement speed is less than the preset speed threshold, it means that the handle control tracker is at or basically in a static state at this time, and the position of the handle control tracker has not changed or basically has not changed.
  • the light-emitting frequency of the light-emitting units is reduced, so as to reduce the power consumption of the plurality of light-emitting units and achieve the purpose of reducing the heat generated on the plurality of light-emitting units. If the determination result is negative, no processing is performed on the plurality of light emitting units.
  • reducing the light-emitting frequency of the plurality of light-emitting units may specifically be reducing the light-emitting frequency of the plurality of light-emitting units to a preset frequency.
  • the frequency range of the above-mentioned preset frequency is, for example, 0-15 Hz.
  • the handle control tracker includes a handle body and a plurality of light-emitting units disposed on the surface of the handle body. Tracking information obtained by tracking the handle to control the tracker in the first time period; wherein the tracking information includes: pose information, position information and acceleration, and then predicting that the handle controls the tracker in the second time period according to the above-mentioned pose information and acceleration where the second time period is located after the first time period, and finally, according to the motion information, the parameter values of the lighting parameters of the plurality of light-emitting units in the second time period are adjusted to adjust the power consumption on the handle control tracker , in order to reduce the heat generated on the handle-controlled tracker by adjusting the power consumption of the handle-controlled tracker without affecting the user's normal use of the handle-controlled tracker, so that the heat generated on the handle-controlled tracker can be applied to miniaturization. design needs.
  • Fig. 5 is a functional structural block diagram of a control device for a handle-controlled tracker provided according to some embodiments of the present disclosure.
  • the control device of the handle-controlled tracker is applied to the head-mounted display device 12 used in conjunction with, for example, the handle-controlled tracker 10 described above.
  • the control device 50 of the handle control tracker includes: an acquisition module 51 , a processing module 52 and an adjustment module 53 .
  • the obtaining module 51 is configured to obtain the tracking information of the handle-controlled tracker in the first time period; wherein the tracking information includes: pose information, position information and acceleration.
  • the processing module 52 is configured to predict the motion information of the handle control tracker in the second time period according to the tracking information obtained by the obtaining module 51 , wherein the second time period is located after the first time period.
  • the adjustment module 53 is configured to adjust the parameter values of the light-emitting parameters of the plurality of light-emitting units in the second time period according to the motion information obtained by the processing module 52 .
  • the motion information includes the motion position
  • the light-emitting parameter includes the light-emitting duration
  • the adjustment module is specifically set to: obtain the tracking distance between the preset reference point in the head-mounted display device and the motion position; The corresponding relationship between the distance segment and the luminous duration is obtained, and the target luminous duration corresponding to the target distance segment where the tracking distance is located is obtained; wherein, in the preset correspondence between the distance segment and the luminous duration, the luminous duration corresponding to each distance segment is less than or It is equal to the light-emitting duration of the plurality of light-emitting units under the condition that the head-mounted display device is tracked to the handle-controlled tracker in the distance section; adjusting the light-emitting duration of the plurality of light-emitting units in the second time period is the target light-emitting duration.
  • the length of the distance section is less than or equal to 30 cm.
  • the motion information includes: a preset reference point in the head-mounted display device points to a target in a first direction in which the handle controls the tracker, and a second direction in which the front of the display screen in the head-mounted display device points to the back.
  • the adjustment module is specifically set as: when the target included angle is within the preset concealed viewing angle range, adjust the light-emitting duration of the plurality of light-emitting units to 0 in the second time period.
  • the concealed viewing angle ranges from 200° to 360°.
  • the motion information includes: a motion speed; the adjustment module is specifically configured to: reduce the light-emitting frequency of the plurality of light-emitting units when the motion speed is less than a preset speed threshold.
  • the adjustment module is specifically set to: reduce the light-emitting frequency of the plurality of light-emitting units to a preset frequency; wherein, the frequency range of the preset frequency is 0-15 Hz.
  • the above modules may be implemented by the processor 212 in this embodiment executing the computer program stored in the memory 211, or may be implemented by other circuit structures, which are not limited herein.
  • the handle control tracker includes a handle body and a plurality of light-emitting units disposed on the surface of the handle body. Tracking information obtained by tracking the handle to control the tracker in the first time period; wherein the tracking information includes: pose information, position information and acceleration, and then predicting that the handle controls the tracker in the second time period according to the above-mentioned pose information and acceleration where the second time period is located after the first time period, and finally, according to the motion information, the parameter values of the lighting parameters of the plurality of light-emitting units in the second time period are adjusted to adjust the power consumption on the handle control tracker , in order to reduce the heat generated on the handle-controlled tracker by adjusting the power consumption of the handle-controlled tracker without affecting the user's normal use of the handle-controlled tracker, so that the heat generated on the handle-controlled tracker can be applied to miniaturization. design needs.
  • the present disclosure may be a system, method and/or computer program product.
  • the computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the present invention.
  • a computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
  • Non-exhaustive list of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
  • RAM random access memory
  • ROM read only memory
  • EPROM erasable programmable read only memory
  • flash memory static random access memory
  • SRAM static random access memory
  • CD-ROM compact disk read only memory
  • DVD digital versatile disk
  • memory sticks floppy disks
  • mechanically coded devices such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
  • Computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.
  • the computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network, and/or a wireless network.
  • the network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers.
  • a network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .
  • the computer program instructions for carrying out the operations of the present invention may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages.
  • the computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement.
  • the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect).
  • LAN local area network
  • WAN wide area network
  • custom electronic circuits such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs)
  • FPGAs field programmable gate arrays
  • PDAs programmable logic arrays
  • Computer readable program instructions are executed to implement various aspects of the present invention.
  • These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
  • These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium on which the instructions are stored includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
  • Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executables for implementing the specified logical function(s) instruction.
  • the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation in hardware, implementation in software, and implementation in a combination of software and hardware are all equivalent.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Illuminated Signs And Luminous Advertising (AREA)

Abstract

一种手柄控制追踪器的控制方法、装置、头戴式显示设备及计算机可读存储介质,涉及虚拟现实技术领域,应用于与手柄控制追踪器配合使用的头戴式显示设备,该手柄控制追踪器包括手柄本体和设置于手柄本体表面的多个发光单元,该方法包括:获取在第一时间段内追踪手柄控制追踪器得到的追踪信息;其中,追踪信息包括:位姿信息、位置信息和加速度(S310);根据追踪信息,预测手柄控制追踪器在第二时间段内的运动信息;其中,第二时间段位于第一时间段之后(S320);根据运动信息,调整多个发光单元在第二时间段内的发光参数的参数值(S330)。

Description

手柄控制追踪器的控制方法、装置及头戴式显示设备
本公开要求于2021年4月27日提交中国专利局、申请号为202110459625.4、发明名称“手柄控制追踪器的控制方法、装置及头戴式显示设备”的中国专利申请的优先权,其全部内容通过引用结合在本公开中。
技术领域
本公开实施例涉及虚拟现实技术领域,更具体地,涉及一种手柄控制追踪器的控制方法、装置、头戴式显示设备以及计算机可读存储介质。
背景技术
头戴式显示设备(Head Mounted Display,HMD)是一种可以穿戴在用户头部的显示设备,能够实现虚拟现实(Virtual Reality,VR)、增强现实(Augmented Reality,AR)和混合现实(Mixed Reality,MR)等不同效果。HMD可以和手柄控制追踪器配合使用,在此过程中,HMD上呈现虚拟现实、增强现实或混合现实的场景,用户通过控制握持在手中的手柄控制追踪器与上述场景中的元素进行交互。
实际情况中,从人体工学方面考虑,为了使手柄控制追踪器在使用方式上尽可能具备舒适性和便利性,需要对手柄控制追踪器进行小型化设计,尽可能减小手柄控制追踪器的体积。
发明内容
本公开实施例的一个目的是提供一种手柄控制追踪器的控制的新的技术方案。
根据本公开的第一方面,提供了一种手柄控制追踪器的控制方法,应用于与手柄控制追踪器配合使用的头戴式显示设备,手柄控制追踪器包括手柄本体和设置于手柄本体表面的多个发光单元,该方法包括:获取在第一时间段内追踪手柄控制追踪器得到的追踪信息;其中,追踪信 息包括:位姿信息、位置信息和加速度;根据追踪信息,预测手柄控制追踪器在第二时间段内的运动信息;其中,第二时间段位于第一时间段之后;根据运动信息,调整多个发光单元在第二时间段内的发光参数的参数值。
可选地,运动信息包括运动位置,发光参数包括发光时长;根据运动信息,调整多个发光单元在第二时间段内的发光参数的参数值,包括:获取头戴式显示设备中的预设参考点与运动位置之间的追踪距离;根据追踪距离和预设的距离区段与发光时长对应关系,获取追踪距离所在的目标距离区段对应的目标发光时长;其中,预设的距离区段与发光时长对应关系中,每个距离区段对应的发光时长小于或等于该距离区段下头戴式显示设备在追踪到手柄控制追踪器的各情况下多个的发光单元的发光时长;在第二时间段调整多个发光单元的发光时长为目标发光时长。
可选地,距离区段的长度小于或等于30cm。
可选地,运动信息包括:头戴式显示设备中的预设参考点指向手柄控制追踪器的第一方向、与头戴式显示设备中显示屏的正面指向背面的第二方向之间的目标夹角;根据运动信息,调整多个发光单元在第二时间段内的发光参数的参数值,包括:在目标夹角在预设的隐蔽视角范围内的情况下,在第二时间段调整多个发光单元的发光时长为0。
可选地,隐蔽视角范围为200°~360°。
可选地,运动信息包括:运动速度;根据运动信息,调整多个发光单元在第二时间段内的发光参数的参数值,包括:在运动速度小于预设的速度阈值的情况下,降低多个发光单元的发光频率。
可选地,降低多个发光单元的发光频率,包括:降低多个发光单元的发光频率至预设频率;其中,预设频率的频率范围为0~15HZ。
根据本公开的第二方面,还提供了一种手柄控制追踪器的控制装置,应用于与手柄控制追踪器配合使用的头戴式显示设备,手柄控制追踪器包括手柄本体和设置于手柄本体表面的多个发光单元,该装置包括:获取模块,设置为获取手柄控制追踪器在第一时间段内的追踪信息;其中,追踪信息包括:位姿信息、位置信息和加速度;处理模块,设置为根据 追踪信息,预测手柄控制追踪器在第二时间段内的运动信息;其中,第二时间段位于第一时间段之后;调整模块,设置为根据运动信息,调整多个发光单元在第二时间段内的发光参数的参数值。
可选地,运动信息包括运动位置,发光参数包括发光时长;
调整模块具体设置为:获取头戴式显示设备中的预设参考点与运动位置之间的追踪距离;根据追踪距离和预设的距离区段与发光时长对应关系,获取追踪距离所在的目标距离区段对应的目标发光时长;其中,预设的距离区段与发光时长对应关系中,每个距离区段对应的发光时长小于或等于该距离区段下头戴式显示设备在追踪到手柄控制追踪器的各情况下多个发光单元的发光时长;在第二时间段调整多个发光单元的发光时长为目标发光时长。
可选地,距离区段的长度小于或等于30cm。
可选地,运动信息包括:头戴式显示设备中的预设参考点指向手柄控制追踪器的第一方向、与头戴式显示设备中显示屏的正面指向背面的第二方向之间的目标夹角;调整模块具体设置为:在目标夹角在预设的隐蔽视角范围内的情况下,在第二时间段调整多个发光单元的发光时长为0。
可选地,隐蔽视角范围为200°~360°。
可选地,运动信息包括:运动速度;调整模块具体设置为:在运动速度小于预设的速度阈值的情况下,降低多个发光单元的发光频率。
可选地,调整模块具体设置为:降低多个发光单元的发光频率至预设频率;其中,预设频率的频率范围为0~15HZ。
根据本公开的第三方面,还提供了一种头戴式显示设备,包括存储器和处理器,该存储器用于存储计算机程序;该处理器用于执行该计算机程序,以实现根据本公开第一方面的方法。
根据本公开的第四方面,还提供了一种计算机可读存储介质,该计算机可读存储介质上存储计算机程序,该计算机程序在被处理器执行时实现根据本公开的第一方面的方法。
本公开实施例提供的手柄追踪控制器的控制方法,能够应用于与手柄控制追踪器配合使用的头戴式显示设备,上述手柄控制追踪器包括手柄本体和设置于手柄本体表面的多个发光单元,本公开实施例能够获取在第一时间段内追踪手柄控制追踪器得到的追踪信息;其中,追踪信息包括:位姿信息、位置信息和加速度,然后根据上述追踪信息,预测手柄控制追踪器在第二时间段内的运动信息;其中,第二时间段位于所述第一时间段之后,最后根据运动信息,调整多个发光单元在第二时间段内的发光参数的参数值,以调整手柄控制追踪器上的功耗,以便在不影响用户正常使用手柄控制追踪器的前提下,通过调整手柄控制追踪器的功耗来降低手柄控制追踪器上产生的热量,使得手柄控制追踪器上产生的热量能够适用于小型化设计的需求。
通过以下参照附图对本公开的示例性实施例的详细描述,本公开实施例的其它特征及其优点将会变得清楚。
附图说明
被结合在说明书中并构成说明书的一部分的附图示出了本公开的实施例,并且连同其说明一起用于解释本公开实施例的原理。
图1为本公开实施例中的一种手柄控制追踪器的结构示意图;
图2为本公开实施例中的一种头戴式显示设备的功能结构框图;
图3为本公开实施例中的一种手柄控制追踪器的控制方法的方法流程图;
图4为本公开实施例中的另一种手柄控制追踪器的控制方法的方法流程图;
图5为本公开实施例中的另一种手柄控制追踪器的控制装置的功能结构框图。
具体实施方式
现在将参照附图来详细描述本公开的各种示例性实施例。应注意到:除非另外具体说明,否则在这些实施例中阐述的部件和步骤的相对布置、 数字表达式和数值不限制本发明的范围。
以下对至少一个示例性实施例的描述实际上仅仅是说明性的,决不作为对本发明及其应用或使用的任何限制。
对于相关领域普通技术人员已知的技术、方法和设备可能不作详细讨论,但在适当情况下,所述技术、方法和设备应当被视为说明书的一部分。
在这里示出和讨论的所有例子中,任何具体值应被解释为仅仅是示例性的,而不是作为限制。因此,示例性实施例的其它例子可以具有不同的值。
应注意到:相似的标号和字母在下面的附图中表示类似项,因此,一旦某一项在一个附图中被定义,则在随后的附图中不需要对其进行进一步讨论。
在对手柄控制追踪器进行小型化设计的过程中,手柄控制追踪器体积的减小通常使得手柄控制追踪器的表面积也随之减小,由此导致手柄控制追踪器上可用于散热的散热面积变小,散热性能变差。对于握持手柄控制追踪器的用户而言,用户握持手柄控制追踪器的手会直接与手柄控制追踪器上的部分表面接触,在此情况下,手柄控制追踪器上产生的热量会通过上述部分表面传递至用户手部的皮肤上,给用户造成不适。
为了避免上述情况的发生,在对手柄控制追踪器进行小型化设计时,需要考虑如何降低手柄控制追踪器在使用过程中产生的热量。
目前,手柄控制追踪器使用过程中产生的热量大部分来手柄控制追踪器中的电池和处理器。为了减小电池上产生的热量,在保证电池体积尽可能小、待机时间尽量长的前提下,考虑到生产成本,只能牺牲电池的寿命,即降低电池的使用寿命;为了降低处理器上产生的热量,需要牺牲处理器的计算能力(例如处理器每秒执行的浮点运算次数(单位:floating-point operations per second,英文简称:FLOPS)),即降低处理器的计算能力。
然而,降低电池的使用寿命和处理器的计算能力均会影响手柄控制追踪器的性能,致使手柄控制追踪器性能变差。
基于上述存在问题,本公开实施例提供一种手柄控制追踪的控制的新的技术方案,以实现在减小手柄控制追踪体积的同时有效降低手柄控制追踪上产生的热量的目的。
<实施环境及硬件配置>
图1示出了根据本公开实施例的一种手柄追踪控制器的结构示意图。如图1所示,手柄控制追踪器10包括手柄本体101和设置于手柄本体101表面的多个发光单元102。
示例地,如图1所示,手柄本体101包括端部1011和手持部1012,多个发光单元设置在端部1011的表面上。端部1011的表面上可以设置有多个发光标记位置(图1中未示出),每个发光标记位置上设置有一个发光单元102。
多个发光标记位置的排布方式可以由本领域技术人员根据实际情况进行设置,本公开实施例对此不作限定。
示例地,多个发光标记位置包括24个发光标记位置。
示例地,发光单元102为发光二级管(light-emitting diode,英文简称:LED)。
发光单元102用于发出检测光。检测光的波长例如在420nm~690nm的范围内;或者,检测光的波长例如在780nm~1100nm的范围内,例如850nm或940nm。
示例地,多个发光单元102在工作时同时处于发光状态(即发光单元发光);或者多个发光单元102同时处于熄灭状态(即发光单元不发光)。
发光单元102按照预设的占空比同时被启动发光,发光时长在15μs~150μs的范围内。上述预设的占空比例如40%。
对于多个发光单元102,同一次处于发光状态的情况下,头戴式显示设备中对应显示同一帧画面。
图2示出了根据本公开实施例的一种头戴式显示设备的功能结构框图。如图2所示,头戴式显示设备20包括:定位追踪传感器21。
如图2所示,定位追踪传感器21包括:存储器211和处理器212。 应用于本公开实施例中,头戴式显示设备20的存储器211用于存储计算机程序,该计算机程序用于控制该头戴式显示设备20的处理器212进行操作以实施本公开中根据任意实施例的手柄控制追踪器的控制方法。技术人员可以根据本公开实施例的方案设计计算机程序。该计算机程序如何控制处理器212进行操作,这是本领域公知,故在此不再详细描述。
在一些示例中,头戴式显示设备中内置有用于追踪加速度数据的惯性导航单元(图1中未示出)。
下面,参照附图描述根据本发明的各个实施例和例子。
<方法实施例>
图3为根据本公开实施例提供的一种手柄控制追踪器的控制方法的方法流程图。如图3所示,该方法包括如下步骤S310~S330:
步骤S310:获取在第一时间段内追踪手柄控制追踪器得到的追踪信息;其中,追踪信息包括:位姿信息、位置信息和加速度。
位姿信息即与位姿相关的信息。例如,位姿信息可以包括3个旋转平面内的旋转角度,其中该3个旋转平面相互垂直。手柄控制追踪器的位姿信息即手柄控制追踪器的位姿发生改变时,在该3个旋转平面内发生的旋转角度。
当然,可以理解的是,位姿信息也可以包括3个以上的多个旋转平面内的旋转角度,以提升位姿确定的准确性。
位置信息即与位置相关的信息。例如可以是表示空间位置的信息,例如三维空间坐标系中的坐标。
实际情况中,可以获取手柄控制追踪器的6DoF(Six degrees of freedom tracking)信息,根据获取结果得到上述位姿信息和位置信息。
示例地,加速度包括第一方向、第二方向和第三方向上的加速度。其中,第一方向、第二方向和第三方向两两垂直。上述加速度可以通过惯性导航单元获得。
步骤S320:根据追踪信息,预测手柄控制追踪器在第二时间段内的运动信息;其中,第二时间段位于第一时间段之后。
在一些实施例中,运动信息包括运动位置。运动位置即:手柄控制 追踪器所在的空间位置,具体可以是三维空间坐标系中的坐标。
在步骤S320中,可以根据第一时间段中追踪手柄控制追踪器得到第一位置信息、第二位置信息、第一位置信息对应的第一时间点(例如第一时间段的起始时间点)以及第二位置信息对应的第二时间点例如第一时间段的结束时间点,得到手柄控制追踪器的运动速度(例如手柄控制追踪器在第二时间段内平均速度),根据手柄控制追踪器的运动速度、位置信息和加速度,预测手柄控制追踪器在第二时间段内的运动位置。
示例地,第一位置信息为(x 1,y 1,z 1),第二位置信息为(x 2,y 2,z 2),第一时间点为t 1,第二时间点为t 2,其中t 2>t 1。在获取运动速度时,可以根据第一位置信息和第二位置信息,得到第一位置信息和第二位置信息之间的距离,将该距离作为手柄控制追踪器的第一位移s,手柄控制追踪器产生上述第一位移s所对应的时间t=t 2-t 1,手柄控制追踪器的运动速度v=s/t。
在得到手柄控制追踪器的运动速度后,可以根据该运动速度和步骤S310中追踪到的加速度,计算手柄在第二时间段内可能发生的第二位移,根据手柄在第一时间段内的位置信息和上述第二位移,得到手柄在第二时间段内各个时间点对应的运动位置。
在一些实施例中,运动信息包括:头戴式显示设备中的预设参考点指向手柄控制追踪器的第一目标方向、与头戴式显示设备中显示屏的正面指向背面的第二目标方向之间的目标夹角。上述预设参考点例如头戴式显示设备中定位追踪传感器所在位置上的一点。
示例地,获取第一时间段内追踪手柄控制追踪器得到的位置坐标,将头戴式显示设备中的预设参考点指向该位置坐标的方向作为第一目标方向。然后获得第一目标方向和第二目标方向之间的夹角作为目标夹角。
获得第一目标方向和第二目标方向之间的夹角的方式由本领域技术人员根据实际情况进行设置,本公开实施例对此不作限定。
在一些实施例中,运动信息包括运动速度。运动速度的获取过程可以参考上述实施例中关于获取运动速度的过程的对应介绍,此处不再赘述。
本公开实施例中,可以是周期性获取上述运动信息。在此情况下,第二时间段的时间长度(后文将时间长度简称时长)与第一时间段的时长相同。
示例地,在第一时间段是当前周期的情况下,第二时间段是下一周期;在第一时间段是历史周期(上一周期)的情况下,第二时间段是当前周期。
第一时间段和第二时间段的时长可以由本领域技术人员根据实际情况进行设置,本公开实施例对此不作限定。
步骤S330:根据运动信息,调整多个发光单元在第二时间段内的发光参数的参数值。
在一些实施例中,在运动信息为运动位置的情况下,发光参数包括发光时长。在此情况下,如图4所示,步骤S330的执行过程可以包括如下步骤S410~S430:
步骤S410:获取头戴式显示设备中的预设参考点与运动位置之间的追踪距离。
可以将头戴式显示设备中的预设参考点和上述运动位置映射在预设的三维空间坐标系中,根据预设参考点在三维空间坐标系中的第一坐标以及运动位置的在三维空间坐标系中的第二坐标,获取第一坐标和第二坐标之间的距离作为上述追踪距离。
步骤S420:根据追踪距离和预设的距离区段与发光时长对应关系,获取追踪距离所在的目标距离区段对应的目标发光时长。
通常情况下,对手柄控制追踪器进行追踪的距离具有一个最大距离和一个最小距离,因此对手柄控制追踪器进行追踪的距离对应一个距离范围。在此情况下,可以将该距离范围划分为多个预设的距离区段,每个距离区段的长度相同。距离区段可以长度小于或等于30cm。
多个预设的距离区段的数量可以由本领域技术人员根据实际情况进行设置,本公开实施例对此不作限定。
示例地,对手柄控制追踪器进行追踪的距离范围为3cm~150cm,将该距离范围划分为5个预设的距离区段,每个预设的距离区段的长度 为30cm。其中,5个预设的距离区段包括第一距离区段、第二距离区段、第三距离区段、第四距离区段和第五距离区段,第一距离区段对应的第一距离范围为3cm~30cm,第二距离区段对应的第二距离范围为31cm~60cm,第三距离区段对应的第三距离范围为61cm~90cm,第四距离区段对应的第四距离范围为91cm~120cm,第五距离区段对应的第五距离范围为121cm~150cm。
在预设的距离区段与发光时长对应关系中,每个距离区段对应的发光时长小于或等于该距离区段下头戴式显示设备在追踪到手柄控制追踪器的各情况下多个发光单元的发光时长。其中,预设的距离区段与发光时长对应关系可以由本领域技术人员根据实际的距离区段与发光时长的测量结果得到。
在步骤S420中,根据步骤S410中获取的追踪距离,将包括该追踪距离的距离区段(即追踪距离所在的距离区段)作为目标距离区段。
例如,追踪距离为15cm,目标距离区段即上述第一距离区段。又如,追踪距离为36cm,目标距离区段即上述第二距离区段。
步骤S430:在第二时间段调整多个发光单元的发光时长为目标发光时长。
在第二时间段,调整多个发光单元的发光时长为目标发光时长,以便使得第二时间段下,多个发光单元发光的发光时长小于或等于头戴式显示设备在追踪到手柄控制追踪器的各情况下多个发光单元的发光时长,降低多个发光单元的功耗,实现降低多个发光单元上产生的热量的目的。
在一些实施例中,在运动信息为目标夹角的情况下,在步骤S330中,可以确定目标夹角是否在预设的隐蔽视角范围内。其中,隐蔽视角范围即在用户的视线无法追踪到手柄控制追踪器的情况下用户的视角范围(例如手柄控制追踪器位于用户的背后)。若确定结果为是,即目标夹角在预设的隐蔽视角范围内,则说明手柄控制追踪器此时不在用户视线范围内,则在第二时间段调整多个发光单元的发光时长为0,即调整多个发光单元使其处于熄灭状态,以此来降低多个发光单元的功耗,实现降低多个发光单元上产生的热量的目的。若确定结果为否,则对多个 发光单元不作处理。
示例地,隐蔽视角范围为200°~360°。
在一些实施例中,在运动信息为运动速度,在此情况下,在步骤S330中,可以确定运动速度是否小于预设的速度阈值。其中,预设的速度阈值可以是手柄控制追踪器为静止状态或者基本处于静止状态时的速度。预设的速度阈值由本领域技术人员根据实际情况进行设置,本公开实施例对此不作限定。
若确定结果为是,即运动速度小于预设的速度阈值,说明手柄控制追踪器此时处于或基本处于静止状态,手柄控制追踪器的位置未发生改变或者基本未发生改变,在此情况下,降低发光单元的发光频率,以降低多个发光单元的功耗,实现降低多个发光单元上产生的热量的目的。若确定结果为否,则对多个发光单元不作处理。
在一些示例中,降低多个发光单元的发光频率具体可以是降低多个发光单元的发光频率至预设频率。上述预设频率的频率范围例如为0~15HZ。
本公开实施例中,能够应用于与手柄控制追踪器配合使用的头戴式显示设备,上述手柄控制追踪器包括手柄本体和设置于手柄本体表面的多个发光单元,本公开实施例能够获取在第一时间段内追踪手柄控制追踪器得到的追踪信息;其中,追踪信息包括:位姿信息、位置信息和加速度,然后根据上述位姿信息和加速度,预测手柄控制追踪器在第二时间段内的运动信息;其中,第二时间段位于第一时间段之后,最后根据运动信息,调整多个发光单元在第二时间段内的发光参数的参数值,以调整手柄控制追踪器上的功耗,以便在不影响用户正常使用手柄控制追踪器的前提下,通过调整手柄控制追踪器的功耗来降低手柄控制追踪器上产生的热量,使得手柄控制追踪器上产生的热量能够适用于小型化设计的需求。
<设备实施例>
图5是根据本公开一些实施例提供的手柄控制追踪器的控制装置的 功能结构框图。手柄控制追踪器的控制装置应用于与例如上述手柄控制追踪器10配合使用的头戴式显示设备12。
如图5所示,手柄控制追踪器的控制装置50包括:获取模块51、处理模块52和调整模块53。
获取模块51,设置为获取手柄控制追踪器在第一时间段内的追踪信息;其中,追踪信息包括:位姿信息、位置信息和加速度。
处理模块52,设置为根据获取模块51获取的追踪信息,预测手柄控制追踪器在第二时间段内的运动信息;其中,第二时间段位于第一时间段之后。
调整模块53,设置为根据处理模块52获取的运动信息,调整多个发光单元在第二时间段内的发光参数的参数值。
可选地,运动信息包括运动位置,发光参数包括发光时长;调整模块具体设置为:获取头戴式显示设备中的预设参考点与运动位置之间的追踪距离;根据追踪距离和预设的距离区段与发光时长对应关系,获取追踪距离所在的目标距离区段对应的目标发光时长;其中,预设的距离区段与发光时长对应关系中,每个距离区段对应的发光时长小于或等于该距离区段下头戴式显示设备在追踪到手柄控制追踪器的各情况下多个发光单元的发光时长;在第二时间段调整多个发光单元的发光时长为目标发光时长。
可选地,距离区段的长度小于或等于30cm。
可选地,运动信息包括:头戴式显示设备中的预设参考点指向手柄控制追踪器的第一方向、与头戴式显示设备中显示屏的正面指向背面的第二方向之间的目标夹角;调整模块具体设置为:在目标夹角在预设的隐蔽视角范围内的情况下,在第二时间段调整多个发光单元的发光时长为0。
可选地,隐蔽视角范围为200°~360°。
可选地,运动信息包括:运动速度;调整模块具体设置为:在运动速度小于预设的速度阈值的情况下,降低多个发光单元的发光频率。
可选地,调整模块具体设置为:降低多个发光单元的发光频率至预 设频率;其中,预设频率的频率范围为0~15HZ。
以上各模块可以由本实施例中的处理器212执行存储器211存储的计算机程序实现,也可以通过其他电路结构实现,在此不做限定。
本公开实施例中,能够应用于与手柄控制追踪器配合使用的头戴式显示设备,上述手柄控制追踪器包括手柄本体和设置于手柄本体表面的多个发光单元,本公开实施例能够获取在第一时间段内追踪手柄控制追踪器得到的追踪信息;其中,追踪信息包括:位姿信息、位置信息和加速度,然后根据上述位姿信息和加速度,预测手柄控制追踪器在第二时间段内的运动信息;其中,第二时间段位于第一时间段之后,最后根据运动信息,调整多个发光单元在第二时间段内的发光参数的参数值,以调整手柄控制追踪器上的功耗,以便在不影响用户正常使用手柄控制追踪器的前提下,通过调整手柄控制追踪器的功耗来降低手柄控制追踪器上产生的热量,使得手柄控制追踪器上产生的热量能够适用于小型化设计的需求。
本公开可以是系统、方法和/或计算机程序产品。计算机程序产品可以包括计算机可读存储介质,其上载有用于使处理器实现本发明的各个方面的计算机可读程序指令。
计算机可读存储介质可以是可以保持和存储由指令执行设备使用的指令的有形设备。计算机可读存储介质例如可以是――但不限于――电存储设备、磁存储设备、光存储设备、电磁存储设备、半导体存储设备或者上述的任意合适的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括:便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、静态随机存取存储器(SRAM)、便携式压缩盘只读存储器(CD-ROM)、数字多功能盘(DVD)、记忆棒、软盘、机械编码设备、例如其上存储有指令的打孔卡或凹槽内凸起结构、以及上述的任意合适的组合。这里所使用的计算机可读存储介质不被解释为瞬时信号本身,诸如无线电波或者其他自由传播的电磁波、通过波导或其他传输媒介传播的电磁波(例如,通过光纤电缆的光脉冲)、或者通过电线传输的电信号。
这里所描述的计算机可读程序指令可以从计算机可读存储介质下载到各个计算/处理设备,或者通过网络、例如因特网、局域网、广域网和/或无线网下载到外部计算机或外部存储设备。网络可以包括铜传输电缆、光纤传输、无线传输、路由器、防火墙、交换机、网关计算机和/或边缘服务器。每个计算/处理设备中的网络适配卡或者网络接口从网络接收计算机可读程序指令,并转发该计算机可读程序指令,以供存储在各个计算/处理设备中的计算机可读存储介质中。
用于执行本发明操作的计算机程序指令可以是汇编指令、指令集架构(ISA)指令、机器指令、机器相关指令、微代码、固件指令、状态设置数据、或者以一种或多种编程语言的任意组合编写的源代码或目标代码,编程语言包括面向对象的编程语言—诸如Smalltalk、C++等,以及常规的过程式编程语言—诸如“C”语言或类似的编程语言。计算机可读程序指令可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中,远程计算机可以通过任意种类的网络—包括局域网(LAN)或广域网(WAN)—连接到用户计算机,或者,可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。在一些实施例中,通过利用计算机可读程序指令的状态信息来个性化定制电子电路,例如可编程逻辑电路、现场可编程门阵列(FPGA)或可编程逻辑阵列(PLA),该电子电路可以执行计算机可读程序指令,从而实现本发明的各个方面。
这里参照根据本发明实施例的方法、装置(系统)和计算机程序产品的流程图和/或框图描述了本发明的各个方面。应当理解,流程图和/或框图的每个方框以及流程图和/或框图中各方框的组合,都可以由计算机可读程序指令实现。
这些计算机可读程序指令可以提供给通用计算机、专用计算机或其它可编程数据处理装置的处理器,从而生产出一种机器,使得这些指令在通过计算机或其它可编程数据处理装置的处理器执行时,产生了实现流程图和/或框图中的一个或多个方框中规定的功能/动作的装置。也可以 把这些计算机可读程序指令存储在计算机可读存储介质中,这些指令使得计算机、可编程数据处理装置和/或其他设备以特定方式工作,从而,存储有指令的计算机可读介质则包括一个制造品,其包括实现流程图和/或框图中的一个或多个方框中规定的功能/动作的各个方面的指令。
也可以把计算机可读程序指令加载到计算机、其它可编程数据处理装置、或其它设备上,使得在计算机、其它可编程数据处理装置或其它设备上执行一系列操作步骤,以产生计算机实现的过程,从而使得在计算机、其它可编程数据处理装置、或其它设备上执行的指令实现流程图和/或框图中的一个或多个方框中规定的功能/动作。
附图中的流程图和框图显示了根据本发明的多个实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或指令的一部分,模块、程序段或指令的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或动作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。对于本领域技术人员来说公知的是,通过硬件方式实现、通过软件方式实现以及通过软件和硬件结合的方式实现都是等价的。
以上已经描述了本发明的各实施例,上述说明是示例性的,并非穷尽性的,并且也不限于所披露的各实施例。在不偏离所说明的各实施例的范围和精神的情况下,对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。本文中所用术语的选择,旨在最好地解释各实施例的原理、实际应用或对市场中的技术改进,或者使本技术领域的其它普通技术人员能理解本文披露的各实施例。本发明的范围由所附权利要求来限定。

Claims (10)

  1. 一种手柄控制追踪器的控制方法,应用于与所述手柄控制追踪器配合使用的头戴式显示设备,所述手柄控制追踪器包括手柄本体和设置于所述手柄本体表面的多个发光单元,所述方法包括:
    获取在第一时间段内追踪所述手柄控制追踪器得到的追踪信息;其中,所述追踪信息包括:位姿信息、位置信息和加速度;
    根据所述追踪信息,预测所述手柄控制追踪器在第二时间段内的运动信息;其中,所述第二时间段位于所述第一时间段之后;
    根据所述运动信息,调整所述多个发光单元在第二时间段内的发光参数的参数值。
  2. 根据权利要求1所述的方法,其中,所述运动信息包括运动位置,所述发光参数包括发光时长;
    所述根据所述运动信息,调整所述多个发光单元在第二时间段内的发光参数的参数值,包括:
    获取所述头戴式显示设备中的预设参考点与所述运动位置之间的追踪距离;
    根据所述追踪距离和预设的距离区段与发光时长对应关系,获取所述追踪距离所在的目标距离区段对应的目标发光时长;其中,预设的距离区段与发光时长对应关系中,每个距离区段对应的发光时长小于或等于该距离区段下所述头戴式显示设备在追踪到所述手柄控制追踪器的各情况下所述多个发光单元的发光时长;
    在所述第二时间段调整所述多个发光单元的发光时长为所述目标发光时长。
  3. 根据权利要求2所述的方法,其中,所述距离区段的长度小于或等于30cm。
  4. 根据权利要求1所述的方法,其中,所述运动信息包括:所述头戴式显示设备中的预设参考点指向所述手柄控制追踪器的第一方向、与所述头戴式显示设备中显示屏的正面指向背面的第二方向之间的目标夹角;
    所述根据所述运动信息,调整所述多个发光单元在第二时间段内的发光参数的参数值,包括:
    在所述目标夹角在预设的隐蔽视角范围内的情况下,在所述第二时间段调整所述多个发光单元的发光时长为0。
  5. 根据权利要求4所述的方法,其中,所述隐蔽视角范围为200°~360°。
  6. 根据权利要求1所述的方法,其中,所述运动信息包括:运动速度;
    所述根据所述运动信息,调整所述多个发光单元在第二时间段内的发光参数的参数值,包括:
    在所述运动速度小于预设的速度阈值的情况下,降低所述多个发光单元的发光频率。
  7. 根据权利要求6所述的方法,其中,降低所述多个发光单元的发光频率,包括:
    降低所述多个发光单元的发光频率至预设频率;其中,所述预设频 率的频率范围为0~15HZ。
  8. 一种手柄控制追踪器的控制装置,应用于与所述手柄控制追踪器配合使用的头戴式显示设备,所述手柄控制追踪器包括手柄本体和设置于所述手柄本体表面的多个发光单元,所述装置包括:
    获取模块,设置为获取所述手柄控制追踪器在第一时间段内的追踪信息;其中,所述追踪信息包括:位姿信息、位置信息和加速度;
    处理模块,设置为根据所述追踪信息,预测所述手柄控制追踪器在第二时间段内的运动信息;其中,所述第二时间段位于所述第一时间段之后;
    调整模块,设置为根据所述运动信息,调整所述多个发光单元在第二时间段内的发光参数的参数值。
  9. 一种头戴式显示设备,其中,包括存储器和处理器,所述存储器用于存储计算机程序;所述处理器用于执行所述计算机程序,以实现根据权利要求1-7中任意一项所述的方法。
  10. 一种计算机可读存储介质,其中,所述计算机可读存储介质上存储计算机程序,所述计算机程序在被处理器执行时实现根据权利要求1-7中任意一项所述的方法。
PCT/CN2021/118549 2021-04-27 2021-09-15 手柄控制追踪器的控制方法、装置及头戴式显示设备 WO2022227374A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/880,750 US11896894B2 (en) 2021-04-27 2022-08-04 Control method and apparatus for handle control, and head mounted display

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110459625.4A CN113318435A (zh) 2021-04-27 2021-04-27 手柄控制追踪器的控制方法、装置及头戴式显示设备
CN202110459625.4 2021-04-27

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/880,750 Continuation US11896894B2 (en) 2021-04-27 2022-08-04 Control method and apparatus for handle control, and head mounted display

Publications (1)

Publication Number Publication Date
WO2022227374A1 true WO2022227374A1 (zh) 2022-11-03

Family

ID=77413822

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/118549 WO2022227374A1 (zh) 2021-04-27 2021-09-15 手柄控制追踪器的控制方法、装置及头戴式显示设备

Country Status (3)

Country Link
US (1) US11896894B2 (zh)
CN (1) CN113318435A (zh)
WO (1) WO2022227374A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116506991A (zh) * 2023-06-30 2023-07-28 深圳市赛太克电子科技有限公司 一种发光游戏手柄的灯光控制方法和系统

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113318435A (zh) * 2021-04-27 2021-08-31 青岛小鸟看看科技有限公司 手柄控制追踪器的控制方法、装置及头戴式显示设备
CN114973042A (zh) * 2022-05-13 2022-08-30 歌尔股份有限公司 一种vr手柄位置侦测方法、装置、设备及介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105117016A (zh) * 2015-09-07 2015-12-02 众景视界(北京)科技有限公司 用于虚拟现实和增强现实交互控制中的交互手柄
CN110837295A (zh) * 2019-10-17 2020-02-25 重庆爱奇艺智能科技有限公司 一种手持控制设备及其追踪定位的方法、设备与系统
US20200168181A1 (en) * 2018-11-28 2020-05-28 Acer Incorporated Tracking System and Related Positioning and Calibration Methods
CN112451962A (zh) * 2020-11-09 2021-03-09 青岛小鸟看看科技有限公司 一种手柄控制追踪器
CN113318435A (zh) * 2021-04-27 2021-08-31 青岛小鸟看看科技有限公司 手柄控制追踪器的控制方法、装置及头戴式显示设备

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8019121B2 (en) * 2002-07-27 2011-09-13 Sony Computer Entertainment Inc. Method and system for processing intensity from input devices for interfacing with a computer program
US8323106B2 (en) * 2008-05-30 2012-12-04 Sony Computer Entertainment America Llc Determination of controller three-dimensional location using image analysis and ultrasonic communication
CN104113680B (zh) * 2013-04-19 2019-06-28 北京三星通信技术研究有限公司 视线跟踪系统及方法
US10456685B2 (en) * 2015-04-14 2019-10-29 Nintendo Co., Ltd. Identifying and tracking objects via lighting patterns
US9898091B2 (en) * 2015-06-03 2018-02-20 Oculus Vr, Llc Virtual reality system with head-mounted display, camera and hand-held controllers
US10532277B2 (en) * 2015-06-11 2020-01-14 Facebook Technologies, Llc Hand-held controllers with light-emitting diodes synchronized to an external camera
US10010788B2 (en) * 2015-12-21 2018-07-03 Sony Interactive Entertainment Inc. Game controller with lights visible inside and outside the game controller
JP6242473B1 (ja) * 2016-12-22 2017-12-06 株式会社コロプラ 仮想空間を提供するための方法、および当該方法をコンピュータに実行させるためのプログラム、および当該プログラムを実行するための情報処理装置
US10503247B2 (en) * 2017-05-09 2019-12-10 Microsoft Technology Licensing, Llc Calibration of stereo cameras and handheld object
US20190012835A1 (en) * 2017-07-07 2019-01-10 Microsoft Technology Licensing, Llc Driving an Image Capture System to Serve Plural Image-Consuming Processes
US10386938B2 (en) * 2017-09-18 2019-08-20 Google Llc Tracking of location and orientation of a virtual controller in a virtual reality system
WO2019122950A1 (ru) * 2017-12-18 2019-06-27 Общество С Ограниченной Ответственностью "Альт" Способ и система для оптико-инерциального трекинга подвижного объекта
US10740924B2 (en) * 2018-04-16 2020-08-11 Microsoft Technology Licensing, Llc Tracking pose of handheld object
US10679376B2 (en) * 2018-04-24 2020-06-09 Microsoft Technology Licensing, Llc Determining a pose of a handheld object
US10628711B2 (en) * 2018-04-24 2020-04-21 Microsoft Technology Licensing, Llc Determining pose of handheld object in environment
US10852815B2 (en) * 2019-04-30 2020-12-01 Valve Corporation Display system with dynamic light output adjustment for maintaining constant brightness
CN111174683B (zh) * 2020-01-07 2021-11-30 青岛小鸟看看科技有限公司 手柄定位方法、头戴显示设备以及存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105117016A (zh) * 2015-09-07 2015-12-02 众景视界(北京)科技有限公司 用于虚拟现实和增强现实交互控制中的交互手柄
US20200168181A1 (en) * 2018-11-28 2020-05-28 Acer Incorporated Tracking System and Related Positioning and Calibration Methods
CN110837295A (zh) * 2019-10-17 2020-02-25 重庆爱奇艺智能科技有限公司 一种手持控制设备及其追踪定位的方法、设备与系统
CN112451962A (zh) * 2020-11-09 2021-03-09 青岛小鸟看看科技有限公司 一种手柄控制追踪器
CN113318435A (zh) * 2021-04-27 2021-08-31 青岛小鸟看看科技有限公司 手柄控制追踪器的控制方法、装置及头戴式显示设备

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116506991A (zh) * 2023-06-30 2023-07-28 深圳市赛太克电子科技有限公司 一种发光游戏手柄的灯光控制方法和系统
CN116506991B (zh) * 2023-06-30 2023-11-10 深圳市赛太克电子科技有限公司 一种发光游戏手柄的灯光控制方法和系统

Also Published As

Publication number Publication date
CN113318435A (zh) 2021-08-31
US20220370895A1 (en) 2022-11-24
US11896894B2 (en) 2024-02-13

Similar Documents

Publication Publication Date Title
WO2022227374A1 (zh) 手柄控制追踪器的控制方法、装置及头戴式显示设备
US20190369752A1 (en) Styluses, head-mounted display systems, and related methods
CN113853570B (zh) 为头戴式显示器生成动态障碍物碰撞警告的系统和方法
US11256336B2 (en) Integration of artificial reality interaction modes
US11675415B2 (en) Hierarchical power management in artificial reality systems
CN109906424B (zh) 用于虚拟现实系统的输入控制器稳定技术
US11809617B2 (en) Systems and methods for generating dynamic obstacle collision warnings based on detecting poses of users
US10715746B2 (en) Enhanced telestrator for wearable devices
US11023035B1 (en) Virtual pinboard interaction using a peripheral device in artificial reality environments
WO2021236170A1 (en) Low-power semi-passive relative six-degree-of-freedom tracking
US10884505B1 (en) Systems and methods for transitioning to higher order degree-of-freedom tracking
US20220253131A1 (en) Systems and methods for object tracking using fused data
EP3811186B1 (en) Input scaling to keep controller inside field of view
EP4176331A1 (en) Hierarchical power management of memory for artificial reality systems
US11023036B1 (en) Virtual drawing surface interaction using a peripheral device in artificial reality environments
US20230161165A1 (en) Artificial reality systems including digital and analog control of pixel intensity
CN110073314B (zh) 磁跟踪器双模式
US12013988B1 (en) Adjusting brightness of light sources of controller
US20230326144A1 (en) Triggering Field Transitions for Artificial Reality Objects
US20230324986A1 (en) Artificial Reality Input Using Multiple Modalities
CN113900604A (zh) 在一个或多个显示器上的移动内容呈现的电子设备和方法
JP2018205981A (ja) 制御装置、操作装置、および操作システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21938838

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 27.03.2024)