CN115996357B - Virtual position processing method and virtual device - Google Patents

Virtual position processing method and virtual device Download PDF

Info

Publication number
CN115996357B
CN115996357B CN202310286576.8A CN202310286576A CN115996357B CN 115996357 B CN115996357 B CN 115996357B CN 202310286576 A CN202310286576 A CN 202310286576A CN 115996357 B CN115996357 B CN 115996357B
Authority
CN
China
Prior art keywords
virtual
data
network type
local
location data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310286576.8A
Other languages
Chinese (zh)
Other versions
CN115996357A (en
Inventor
林科
王霄
程黎辉
关亚东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanchang Longqi Intelligent Technology Co ltd
Original Assignee
Nanchang Longqi Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanchang Longqi Intelligent Technology Co ltd filed Critical Nanchang Longqi Intelligent Technology Co ltd
Priority to CN202310286576.8A priority Critical patent/CN115996357B/en
Publication of CN115996357A publication Critical patent/CN115996357A/en
Application granted granted Critical
Publication of CN115996357B publication Critical patent/CN115996357B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Abstract

The application provides a virtual position processing method and virtual equipment, and relates to a virtual display technology, wherein the method comprises the following steps: based on the network type connected with the virtual equipment, acquiring initial virtual position data corresponding to initial physical position data where the virtual equipment is located, and displaying the initial virtual position data in a virtual space corresponding to the virtual equipment; the virtual device corresponds to a physical object. If the position of the entity object corresponding to the initial virtual position data in the virtual space is changed, changing the network type of the virtual equipment connection according to a preset network optimization mode; the network optimization mode includes optimized global microwave access interoperability and/or fifth generation mobile communication technology. And determining target virtual position data of the entity object in the virtual space according to the changed optimized network type. The method can interact the position information and track the position among a plurality of virtual devices, and solves the technical problem that the interaction mode for determining the position information is limited by a network.

Description

Virtual position processing method and virtual device
Technical Field
The present application relates to virtual display technologies, and in particular, to a virtual location processing method and a virtual device.
Background
Currently, virtual Reality (VR)/augmented Reality (Augmented Reality, AR)/Mixed Reality (MR) refines relevant product positioning and technology corresponding to the vertical field in the process of technology development, and deviates from the most initial product consistency positioning.
In the prior art, the VR/AR/MR related products all perform position information interaction in a point-to-point transmission mode. Because VR is positioned in the indoor game social product to replace, the position information interaction mode is self plus external (referring to App network connection interaction), so the use of VR is limited by the indoor network, and the interaction delay is larger; the AR further preliminarily has the attribute of the mobile terminal mobile phone but is limited by physical limitation, or highly depends on the existing mobile terminal product mobile phone and the like, and the position information interaction mode is mobile terminal matched equipment (namely Bluetooth or data line connection), so that interaction delay is larger; the same bottleneck exists for the MR to combine the two. The interaction mode which is not limited by the network to determine the position information needs to be determined, so that the interaction time delay is shortened.
Thus, there is a need for a method that can determine the manner in which network-defined location information is not limited.
Disclosure of Invention
The application provides a virtual position processing method and virtual equipment, which are used for solving the technical problem that the interaction mode for determining position information is limited by a network.
In a first aspect, the present application provides a virtual location processing method, including:
based on the network type connected with the virtual equipment, acquiring initial virtual position data corresponding to initial physical position data where the virtual equipment is located, and displaying the initial virtual position data in a virtual space corresponding to the virtual equipment; wherein the virtual device corresponds to a physical object;
if the position of the entity object corresponding to the initial virtual position data in the virtual space is changed, changing the network type connected with the virtual equipment according to a preset network optimization mode; wherein the network optimization mode comprises optimized global microwave access interoperability and/or fifth generation mobile communication technology;
and determining target virtual position data of the entity object in the virtual space according to the changed optimized network type so as to determine the virtual motion trail of the entity object in the virtual space.
Further, the determining the target virtual location data of the entity object in the virtual space according to the modified optimized network type includes:
Judging whether other entity objects appear in the field of view of the current entity object in the virtual space according to the changed optimized first network type;
if it is determined that other entity objects appear in the field of view of the current entity object, determining first position data of the current entity object at a plurality of moments and second position data of the other entity objects at the plurality of moments according to the modified optimized second network type;
if it is determined that no other entity objects exist in the field of view of the current entity object, acquiring first local data of the current entity object and second local data of the other entity objects;
and determining target virtual position data of the current entity object and target virtual position data of other entity objects in the virtual space according to the first position data, the second position data, the first local data and the second local data.
Further, the determining the target virtual location data of the current entity object and the target virtual location data of other entity objects in the virtual space according to the first location data, the second location data, the first local data and the second local data includes:
Determining first calibration offset data of a current entity object according to first position data of the current entity object at a plurality of moments; determining second calibration offset data of other entity objects according to second position data of the other entity objects at a plurality of moments;
determining target virtual position data of a current entity object in the virtual space according to the first calibration offset data and the first local data; and determining target virtual position data of the other entity objects according to the second calibration offset data and the second local data.
Further, if the position of the physical object corresponding to the initial virtual position data in the virtual space changes, changing the network type connected to the virtual device according to a preset network optimization mode, including:
if the position of the entity object corresponding to the initial virtual position data in the virtual space changes, determining an optimized network type corresponding to the network type connected with the virtual device based on a mapping relation between the network type indicated by a preset network optimization mode and the optimized network type;
And changing the network type of the virtual equipment connection into global microwave access interoperability and/or a fifth generation mobile communication technology according to the optimized network type corresponding to the network type of the virtual equipment connection.
Further, the first location data includes modified physical location data of the current entity object, modified virtual location data corresponding to the modified location data of the current entity object, and the second location data includes modified physical location data of the other entity object, modified virtual location data corresponding to the modified location data of the other entity object.
Further, the first local data includes local physical location data of the current entity object, local virtual location data corresponding to the local location data of the current entity object; the second local data includes local physical location data of the other entity object, and local virtual location data corresponding to the local location data of the other entity object.
In a second aspect, the present application provides a virtual device comprising:
the display unit is used for acquiring initial virtual position data corresponding to initial physical position data of the virtual equipment based on the network type connected with the virtual equipment and displaying the initial virtual position data in a virtual space corresponding to the virtual equipment; wherein the virtual device corresponds to a physical object;
A changing unit, configured to change a network type connected to the virtual device according to a preset network optimization mode if a position of an entity object corresponding to initial virtual position data in the virtual space changes; wherein the network optimization mode comprises optimized global microwave access interoperability and/or fifth generation mobile communication technology;
and the determining unit is used for determining target virtual position data of the entity object in the virtual space according to the changed optimized network type so as to determine the virtual motion trail of the entity object in the virtual space.
Further, the determining unit includes:
the judging module is used for judging whether other entity objects appear in the visual field of the current entity object in the virtual space according to the changed optimized first network type;
the first determining module is used for determining first position data of the current entity object at a plurality of moments and second position data of other entity objects at a plurality of moments according to the modified optimized second network type if other entity objects appear in the field of view of the current entity object;
the acquisition module is used for acquiring the first local data of the current entity object and the second local data of other entity objects if the fact that other entity objects do not appear in the field of view of the current entity object is determined;
And the second determining module is used for determining target virtual position data of the current entity object and target virtual position data of other entity objects in the virtual space according to the first position data, the second position data, the first local data and the second local data.
Further, the second determining module includes:
a first determining sub-module, configured to determine first calibration offset data of a current entity object according to first position data of the current entity object at a plurality of moments; determining second calibration offset data of other entity objects according to second position data of the other entity objects at a plurality of moments;
a second determining sub-module, configured to determine target virtual position data of a current physical object in the virtual space according to the first calibration offset data and the first local data; and determining target virtual position data of the other entity objects according to the second calibration offset data and the second local data.
Further, the modification unit includes:
a third determining module, configured to determine, if the location of the entity object corresponding to the initial virtual location data in the virtual space changes, an optimized network type corresponding to the network type connected by the virtual device based on a mapping relationship between a network type indicated by a preset network optimization mode and the optimized network type;
And the changing module is used for changing the network type of the virtual equipment connection into global microwave access interoperability and/or a fifth generation mobile communication technology according to the optimized network type corresponding to the network type of the virtual equipment connection.
Further, the first location data includes modified physical location data of the current entity object, modified virtual location data corresponding to the modified location data of the current entity object, and the second location data includes modified physical location data of the other entity object, modified virtual location data corresponding to the modified location data of the other entity object.
Further, the first local data includes local physical location data of the current entity object, local virtual location data corresponding to the local location data of the current entity object; the second local data includes local physical location data of the other entity object, and local virtual location data corresponding to the local location data of the other entity object.
In a third aspect, the present application provides a virtual device comprising a memory, a processor, the memory storing a computer program executable on the processor, the processor implementing the method of the first aspect when executing the computer program.
In a fourth aspect, the present application provides a computer-readable storage medium having stored therein computer-executable instructions for performing the method of the first aspect when executed by a processor.
In a fifth aspect, the application provides a computer program product comprising a computer program which, when executed by a processor, implements the method of the first aspect.
According to the virtual position processing method and the virtual device, initial virtual position data corresponding to initial physical position data where the virtual device is located is obtained based on the network type connected with the virtual device, and the initial virtual position data is displayed in a virtual space corresponding to the virtual device; wherein the virtual device corresponds to a physical object. If the position of the entity object corresponding to the initial virtual position data in the virtual space is changed, changing the network type of the virtual equipment connection according to a preset network optimization mode; wherein the network optimization mode comprises optimized global microwave access interoperability and/or fifth generation mobile communication technology. And determining target virtual position data of the entity object in the virtual space according to the changed optimized network type so as to determine the virtual motion trail of the entity object in the virtual space. In the scheme, the virtual device can acquire initial physical position data of the virtual device, acquire initial virtual position data corresponding to the initial physical position data, display the initial virtual position data in a virtual space corresponding to the virtual device, and correspond to one entity object. And monitoring the position of the entity object in the virtual space, and if the position of the entity object corresponding to the initial virtual position data in the virtual space is determined to change, changing the network type of the virtual equipment connection according to a preset network optimization mode. And finally, according to the changed optimized network type, determining target virtual position data of the entity object in the virtual space, and further determining the virtual motion trail of the entity object in the virtual space. Therefore, through multidimensional calibration of the position information acquired under a plurality of network types, the position information and the tracking position can be interacted among a plurality of virtual devices, the advantages of low delay, high precision, high mobile convenience and the like are achieved in the interaction process, the social property of the product is improved, the product interaction function is optimized, and the technical problem that the interaction mode for determining the position information is limited by the network is solved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.
FIG. 1 is a schematic flow chart of tracking virtual positions according to an embodiment of the present application;
fig. 2 is a flow chart of a virtual location processing method according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating another virtual location processing method according to an embodiment of the present application;
FIG. 4 is a system model diagram of a virtual device according to an embodiment of the present application;
FIG. 5 is a flowchart illustrating another virtual location processing method according to an embodiment of the present application;
FIG. 6 is a system configuration diagram of a virtual device according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a virtual device according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of another virtual device according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a virtual device according to an embodiment of the present application.
Specific embodiments of the present disclosure have been shown by way of the above drawings and will be described in more detail below. These drawings and the written description are not intended to limit the scope of the disclosed concepts in any way, but rather to illustrate the disclosed concepts to those skilled in the art by reference to specific embodiments.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure.
Currently, virtual Reality (VR)/augmented Reality (Augmented Reality, AR)/Mixed Reality (MR) refines relevant product positioning and technology corresponding to the vertical field in the process of technology development, and deviates from the most initial product consistency positioning. In the prior art, the VR/AR/MR related products all perform position information interaction in a point-to-point transmission mode. Because VR is positioned in the indoor game social product to replace, the position information interaction mode is self plus external (referring to App network connection interaction), so the use of VR is limited by the indoor network, and the interaction delay is larger; the AR further preliminarily has the attribute of the mobile terminal mobile phone but is limited by physical limitation, or highly depends on the existing mobile terminal product mobile phone and the like, and the position information interaction mode is mobile terminal matched equipment (namely Bluetooth or data line connection), so that interaction delay is larger; the same bottleneck exists for the MR to combine the two. The interaction mode which is not limited by the network to determine the position information needs to be determined, so that the interaction time delay is shortened. Thus, there is a need for a method that can determine the manner in which network-defined location information is not limited.
In one example, fig. 1 is a schematic flow chart of an existing tracking virtual location provided in an embodiment of the present application, as shown in fig. 1, including a WLAN network, a VR/AR/MR platform, a VR/AR/MR application (app), a VR/AR/MR system #1 (i.e., a system of a first virtual device), a VR/AR/MR system #2 (i.e., a system between second virtual devices), a social network system, and a third party system. The conventional interaction scheme is shown in fig. 1, and related information such as a location is transmitted through an application (app), and the mode is point (point refers to virtual device) to point.
The application provides a virtual position processing method and virtual equipment, and aims to solve the technical problems in the prior art.
The following describes the technical scheme of the present application and how the technical scheme of the present application solves the above technical problems in detail with specific embodiments. The following embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.
Fig. 2 is a flow chart of a virtual location processing method according to an embodiment of the present application, as shown in fig. 2, where the method includes:
Step 101, acquiring initial virtual position data corresponding to initial physical position data where virtual equipment is located based on a network type connected with the virtual equipment, and displaying the initial virtual position data in a virtual space corresponding to the virtual equipment; wherein the virtual device corresponds to a physical object.
Illustratively, the execution subject of the present embodiment may be a virtual device. First, the virtual device, after being started, connects to a network, and the network type of the network includes a wireless wide area network (WWLAN), a wireless metropolitan area network (Wireless Metropolitan Area Network, WMAN), or a personal area network (WPAN), etc., wherein the wireless metropolitan area network belongs to a Local Area Network (LAN). Based on the network type of the connection of the virtual equipment, the virtual equipment can be connected with a plurality of networks at the same time, the virtual equipment can acquire initial physical position data of the virtual equipment, acquire initial virtual position data corresponding to the initial physical position data, and display the initial virtual position data in a virtual space corresponding to the virtual equipment; the initial physical position data and the initial virtual position data may be determined according to the optical sensor or the mobile device, the virtual device corresponds to one entity object, and the virtual space corresponding to the virtual device includes at least one entity object.
102, if the position of the entity object corresponding to the initial virtual position data in the virtual space changes, changing the network type of the virtual equipment connection according to a preset network optimization mode; wherein the network optimization mode comprises optimized global microwave access interoperability and/or fifth generation mobile communication technology.
Illustratively, the network optimization mode includes optimized worldwide interoperability for microwave access (World Interoperability for Microwave Access, wiMAX) and/or fifth generation mobile communication technology (5th Generation Mobile Communication Technology,5G), and the virtual device may change the network type to which the virtual device itself is connected to any one. The virtual device monitors the position of the entity object in the virtual space, if the position of the entity object corresponding to the initial virtual position data in the virtual space is determined to change, the optimized network type corresponding to the network type connected with the virtual device is determined based on the mapping relation between the network type indicated by the preset network optimization mode and the optimized network type, and the network type connected with the virtual device is changed into global microwave access interoperability and/or a fifth generation mobile communication technology according to the optimized network type corresponding to the network type connected with the virtual device.
And step 103, determining target virtual position data of the entity object in the virtual space according to the changed optimized network type so as to determine the virtual motion trail of the entity object in the virtual space.
For example, the virtual device may determine target virtual location data of the entity object in the virtual space according to the modified optimized network type, thereby determining a virtual motion trail of the entity object in the virtual space.
For example, the virtual devices are VR/AR/MR head mounted displays (HMDs, head displays) and handles corresponding to VR/AR/MR head mounted displays, and the virtual devices may be 1 or more. When the number of the virtual devices is 1, the initial physical position data and the initial virtual position data are determined according to the optical sensor; when the virtual device is multiple, the multiple head-mounted displays are networked, the initial physical position data and the initial virtual position data are determined according to the mobile device, the mobile device can be an optical sensor in other head-mounted displays, and the multiple VR/AR/MR head-mounted displays are networked to track respective motions. For example, the motion includes three-dimensional (i.e., 6-DOF) motion and is tracked based on changes in three-dimensional (3D) positions each in a physical environment over time. Including inertial data, proximity data, images of the physical environment, etc., the images and position data are further analyzed by implementing image processing techniques, velocity measurements, velocity offsets, and image reconstruction techniques to determine the 3D position and track changes over time, thereby determining the virtual motion trajectories of the physical objects in the virtual space.
Therefore, the position information and the tracking position can be interacted between n head displays and n handles, and the interaction of the position information and the tracking position of the WPAN between the head displays or between the handles and the head displays can be realized, so that the multidimensional calibration can be realized through the interaction of the position information and the tracking position of the WMAN & WWLAN between the head displays or between the handles and the head displays. The position information and tracking position between the head displays or between the handle and the head displays are optimized (such as WiMax & 5G) interaction through the active radio frequency module, and the method has the characteristics of low delay and high precision.
In the embodiment of the application, based on the network type connected with the virtual equipment, initial virtual position data corresponding to initial physical position data where the virtual equipment is located is obtained, and the initial virtual position data is displayed in a virtual space corresponding to the virtual equipment; wherein the virtual device corresponds to a physical object. If the position of the entity object corresponding to the initial virtual position data in the virtual space is changed, changing the network type of the virtual equipment connection according to a preset network optimization mode; wherein the network optimization mode comprises optimized global microwave access interoperability and/or fifth generation mobile communication technology. And determining target virtual position data of the entity object in the virtual space according to the changed optimized network type so as to determine the virtual motion trail of the entity object in the virtual space. In the scheme, the virtual device can acquire initial physical position data of the virtual device, acquire initial virtual position data corresponding to the initial physical position data, display the initial virtual position data in a virtual space corresponding to the virtual device, and correspond to one entity object. And monitoring the position of the entity object in the virtual space, and if the position of the entity object corresponding to the initial virtual position data in the virtual space is determined to change, changing the network type of the virtual equipment connection according to a preset network optimization mode. And finally, according to the changed optimized network type, determining target virtual position data of the entity object in the virtual space, and further determining the virtual motion trail of the entity object in the virtual space. Therefore, through multidimensional calibration of the position information acquired under a plurality of network types, the position information and the tracking position can be interacted among a plurality of virtual devices, the advantages of low delay, high precision, high mobile convenience and the like are achieved in the interaction process, the social property of the product is improved, the product interaction function is optimized, and the technical problem that the interaction mode for determining the position information is limited by the network is solved.
Fig. 3 is a flow chart of another virtual location processing method according to an embodiment of the present application, as shown in fig. 3, the method includes:
step 201, based on the network type connected with the virtual device, acquiring initial virtual position data corresponding to the initial physical position data where the virtual device is located, and displaying the initial virtual position data in a virtual space corresponding to the virtual device; wherein the virtual device corresponds to a physical object.
Illustratively, this step may refer to step 101 in fig. 1, and will not be described in detail.
Step 202, if the position of the entity object corresponding to the initial virtual position data in the virtual space changes, determining an optimized network type corresponding to the network type connected by the virtual device based on a mapping relationship between the network type indicated by the preset network optimization mode and the optimized network type.
For example, if the virtual device determines that the position of the entity object corresponding to the initial virtual position data in the virtual space changes, the virtual device determines an optimized network type corresponding to the network type connected by the virtual device based on a mapping relationship between the network type indicated by the preset network optimization mode and the optimized network type. For example, a local area network corresponds to optimized WiMAX and a wireless wide area network corresponds to optimized 5G.
Step 203, according to the optimized network type corresponding to the network type of the virtual device connection, changing the network type of the virtual device connection into global microwave access interoperability and/or fifth generation mobile communication technology.
The virtual device changes the network type of the virtual device connection to global interoperability for microwave access and/or fifth generation mobile communication technology according to the optimized network type corresponding to the network type of the virtual device connection.
Step 204, according to the modified optimized first network type, it is determined whether other physical objects appear in the field of view of the current physical object in the virtual space.
The virtual device determines whether other physical objects appear in the field of view of the current physical object in the virtual space according to the modified optimized first network type, that is, determines whether the current physical object can see the other physical objects. For example, the network type of the current connection is a local area network, the modified optimized first network type is WiMAX, and the virtual device determines whether other physical objects appear in the field of view of the current physical object in the virtual space according to the optimized WiMAX.
Step 205, if it is determined that other physical objects appear in the field of view of the current physical object, determining, according to the modified optimized second network type, first location data of the current physical object at multiple times and second location data of the other physical objects at multiple times.
In one example, the first location data includes modified physical location data of the current entity object, modified virtual location data corresponding to the modified location data of the current entity object, and the second location data includes modified physical location data of other entity objects, modified virtual location data corresponding to the modified location data of other entity objects.
For example, if it is determined that other entity objects appear in the field of view of the current entity object, the network type of the connected other network is changed to an optimized second network type, and according to the optimized second network type after the change, first location data of the current entity object at a plurality of moments and second location data of the other entity object at a plurality of moments are tracked and determined, wherein the first location data includes changed physical location data of the current entity object and changed virtual location data corresponding to the changed location data of the current entity object, and the second location data includes changed physical location data of the other entity object and changed virtual location data corresponding to the changed location data of the other entity object, and the changed physical location data refers to a changed physical location relative to a previous physical location.
For example, if it is determined that other physical objects appear in the field of view of the current physical object, the connected wireless wide area network is changed to the optimized second network type 5G, and the first location data of the current physical object at a plurality of times and the second location data of the other physical object at a plurality of times are determined according to the changed optimized second network type 5G.
Step 206, if it is determined that no other physical objects appear in the field of view of the current physical object, acquiring the first local data of the current physical object and the second local data of the other physical objects.
In one example, the first local data includes local physical location data of the current entity object, local virtual location data corresponding to the local location data of the current entity object; the second local data includes local physical location data of the other entity object, local virtual location data corresponding to the local location data of the other entity object.
For example, if it is determined that no other entity object appears in the field of view of the current entity object, acquiring first local data of the current entity object and second local data of the other entity object, where the first local data includes local physical location data of the current entity object and local virtual location data corresponding to the local location data of the current entity object; the second local data includes local physical location data of the other entity object, local virtual location data corresponding to the local location data of the other entity object.
Step 207, determining target virtual position data of the current entity object and target virtual position data of other entity objects in the virtual space according to the first position data, the second position data, the first local data and the second local data.
In one example, step 207 includes: determining first calibration offset data of the current entity object according to the first position data of the current entity object at a plurality of moments; determining second calibration offset data of other entity objects according to the second position data of the other entity objects at a plurality of moments; determining target virtual position data of a current entity object in the virtual space according to the first calibration offset data and the first local data; and determining target virtual position data of other entity objects according to the second calibration offset data and the second local data.
The virtual device calibrates the current physical object according to the first position data of the current physical object at a plurality of moments, and determines first calibration offset data of the current physical object. And determining second calibration offset data of other entity objects according to the second position data of the other entity objects at a plurality of moments. Then, according to the first calibration offset data and the first local data, target virtual position data of the current entity object in the virtual space is tracked and determined, and according to the second calibration offset data and the second local data, target virtual position data of other entity objects is determined, and then virtual motion tracks of the current entity object and the other entity objects in the virtual space are determined.
In the embodiment of the application, based on the network type connected with the virtual equipment, initial virtual position data corresponding to initial physical position data where the virtual equipment is located is obtained, and the initial virtual position data is displayed in a virtual space corresponding to the virtual equipment; wherein the virtual device corresponds to a physical object. If the position of the entity object corresponding to the initial virtual position data in the virtual space changes, determining the optimized network type corresponding to the network type connected by the virtual device based on the mapping relation between the network type indicated by the preset network optimization mode and the optimized network type. And changing the network type of the virtual equipment connection into global microwave access interoperability and/or a fifth generation mobile communication technology according to the optimized network type corresponding to the network type of the virtual equipment connection. And judging whether other entity objects appear in the field of view of the current entity object in the virtual space according to the changed optimized first network type. If it is determined that other physical objects appear in the field of view of the current physical object, determining first position data of the current physical object at a plurality of moments and second position data of the other physical objects at the plurality of moments according to the modified optimized second network type. And if the fact that other entity objects do not appear in the field of view of the current entity object is determined, acquiring the first local data of the current entity object and the second local data of the other entity objects. And determining target virtual position data of the current entity object and target virtual position data of other entity objects in the virtual space according to the first position data, the second position data, the first local data and the second local data. Therefore, through multidimensional calibration of the position information acquired under a plurality of network types, the position information and the tracking position can be interacted among a plurality of virtual devices, the advantages of low delay, high precision, high mobile convenience and the like are achieved in the interaction process, the social property of the product is improved, the product interaction function is optimized, and the technical problem that the interaction mode for determining the position information is limited by the network is solved. The calibration mode is point-to-point (point refers to virtual equipment) +point-to-point calibration, and in the operation process, related information such as position and the like is transmitted through an optimized radio frequency communication network (for example, an optimized virtual equipment transmission system based on WiMax & 5G), so that the advantages of a local area network and a wireless wide area network are compatible, and the characteristics of high broadband, low power consumption and low delay of 5G are matched.
Exemplary, fig. 4 is a system model diagram of a virtual device according to an embodiment of the present application, as shown in fig. 4, including a WLAN network, a WMAN, a 110 intelligent radio module, 122 VR/AR/MR system #1 (i.e., a system of a first virtual device), 124 VR/AR/MR system #2 (i.e., a system between second virtual devices), a social network system, a VR/AR/MR platform, and a third party system.
In one embodiment, a computer system in the virtual device optimizes different antenna signals through the radio frequency wireless transmission circuit, determines a target antenna for radiating radio frequency signals, accesses position data of the first virtual device according to the target antenna, determines a position of the first virtual device in a physical environment based on the position data by the computer system, and causes virtual reality content to be presented in a virtual space corresponding to the virtual device (where the virtual device is a head mounted display and the virtual space is a first virtual reality head mounted display) based on the position data by the computer system.
Fig. 5 is a schematic flow chart of still another virtual location processing method according to an embodiment of the present application, where, as shown in fig. 5, the flow includes an operation 402 in which location data of a virtual device (VR/AR/MR HMD) is accessed, and locally approaching the data, where the location data is generated according to image data captured by another n VR/AR/MR HMDs, and the location data includes modified physical location data and modified virtual location data. The virtual device implements image processing techniques, speed measurements, speed offsets, and image reconstruction techniques to calculate the position data. And if the approach of the obstacle is identified, the distance exceeds a threshold and/or the direction indicates a possible collision course, a warning is issued.
The virtual device tracks changes over time by repeating operations 402 and 404. The tracked 3D physical location represents a 6-Dof motion of a user (e.g., the user's head) in physical space. And presents VR/AR/MR content at operation 406, tracking the location over time based on the updating of the location data at operation 408, i.e., updating the tracked modified virtual location information.
In one example, the process includes an operation 420 in which the three-dimensional information of the virtual device is more precisely located by three edges 420 (local data, personal area network data, local area network or wireless wide area network data), while the active smart radio module may assist and in order to achieve the low latency effect shown by the active smart radio module 110, in an outdoor scenario a metropolitan area network (WMAN) may be optimized, for example, for WiMax communication network connectivity mode, and/or a wireless wide area network (WWLAN) may be optimized, for example, for 5G communication network connectivity mode.
In one example, the flow includes an operation 430 in which it is determined whether a line of sight exists between the virtual device and the n virtual devices. If a line of sight is present, the image data generated by the computing means corresponds to images showing the virtual devices relative to each other, the image data may be obtained from an optical sensor or an image acquisition means on the virtual devices. However, if a line of sight does not exist, position tracking may not be dependent on the image data any more. In this case, operation 450 is generally followed.
In one example, the flow includes an operation 450 in which the location is tracked based on local location data updates of the virtual device, the local location data including first local data and second local data, and the like.
Therefore, the above procedure can be similarly applied to mutual tracking through a large number of VR/AR/MR HMDs. In a multiplayer video game, each virtual player may be displayed a view of VR/AR/MR content that accurately identifies other virtual players and indicates the locations of the other virtual players with low latency even in real time.
Fig. 6 is a system structure diagram of a virtual device according to an embodiment of the present application, as shown in fig. 6, including two VR/AR/MR devices (intelligent), extension and WPAN, where the two VR/AR/MR devices track each other through Extension and WPAN, where Extension includes a virtual private network (Virtual Private Network, VPN), a local area network (Local Area Network, LAN), a wireless local area network (Wireless Local Area Networks, WLAN), a wide area network (Wide Area Network, WAN), a WWAN, a metropolitan area network (Metropolitan Area Network, MAN), a Wireless Metropolitan Area Network (WMAN), and the like; personal Area Networks (WPANs) include ultra mobile broadband systems (Ultra Mobile Broadband, UMB), BT, zigbee, other (other), and the like.
Fig. 7 is a schematic structural diagram of a virtual device according to an embodiment of the present application, as shown in fig. 7, where the apparatus includes:
a display unit 31, configured to acquire initial virtual location data corresponding to initial physical location data of a virtual device based on a network type to which the virtual device is connected, and display the initial virtual location data in a virtual space corresponding to the virtual device; wherein the virtual device corresponds to a physical object.
A changing unit 32, configured to change a network type of the virtual device connection according to a preset network optimization mode if a position of the physical object corresponding to the initial virtual position data in the virtual space changes; wherein the network optimization mode comprises optimized global microwave access interoperability and/or fifth generation mobile communication technology.
A determining unit 33, configured to determine target virtual position data of the entity object in the virtual space according to the modified optimized network type, so as to determine a virtual motion track of the entity object in the virtual space.
The device of the embodiment may execute the technical scheme in the above method, and the specific implementation process and the technical principle are the same and are not described herein again.
Fig. 8 is a schematic structural diagram of another virtual device according to an embodiment of the present application, and, on the basis of the embodiment shown in fig. 7, as shown in fig. 8, the determining unit 33 includes:
The judging module 331 is configured to judge whether other physical objects appear in the field of view of the current physical object in the virtual space according to the modified optimized first network type.
The first determining module 332 is configured to determine, if it is determined that other physical objects appear in the field of view of the current physical object, first location data of the current physical object at multiple times and second location data of the other physical objects at multiple times according to the modified optimized second network type.
The obtaining module 333 is configured to obtain the first local data of the current entity object and the second local data of the other entity objects if it is determined that no other entity object appears in the field of view of the current entity object.
The second determining module 334 is configured to determine target virtual location data of the current entity object and target virtual location data of other entity objects in the virtual space according to the first location data, the second location data, the first local data, and the second local data.
In one example, the second determination module 334 includes:
a first determining submodule 3341, configured to determine first calibration offset data of the current entity object according to first position data of the current entity object at a plurality of moments; and determining second calibration offset data of other entity objects according to the second position data of the other entity objects at a plurality of moments.
A second determining submodule 3342, configured to determine target virtual position data of a current physical object in the virtual space according to the first calibration offset data and the first local data; and determining target virtual position data of other entity objects according to the second calibration offset data and the second local data.
In one example, the modification unit 32 includes:
the third determining module 321 is configured to determine, if the position of the entity object corresponding to the initial virtual position data in the virtual space changes, an optimized network type corresponding to the network type connected to the virtual device based on a mapping relationship between the network type indicated by the preset network optimization mode and the optimized network type.
A modifying module 322, configured to modify the network type of the virtual device connection into global interoperability for microwave access and/or a fifth generation mobile communication technology according to the optimized network type corresponding to the network type of the virtual device connection.
In one example, the first location data includes modified physical location data of the current entity object, modified virtual location data corresponding to the modified location data of the current entity object, and the second location data includes modified physical location data of other entity objects, modified virtual location data corresponding to the modified location data of other entity objects.
In one example, the first local data includes local physical location data of the current entity object, local virtual location data corresponding to the local location data of the current entity object; the second local data includes local physical location data of the other entity object, local virtual location data corresponding to the local location data of the other entity object.
The device of the embodiment may execute the technical scheme in the above method, and the specific implementation process and the technical principle are the same and are not described herein again.
Fig. 9 is a schematic structural diagram of a virtual device according to an embodiment of the present application, where, as shown in fig. 9, the virtual device includes: a memory 51, and a processor 52.
The memory 51 stores a computer program executable on the processor 52.
The processor 52 is configured to perform the method as provided by the above-described embodiments.
The virtual device further comprises a receiver 53 and a transmitter 54. The receiver 53 is for receiving instructions and data transmitted from an external device, and the transmitter 54 is for transmitting instructions and data to the external device.
The embodiments of the present application also provide a non-transitory computer-readable storage medium, which when executed by a processor of a virtual device, enables the virtual device to perform the method provided by the above embodiments.
The embodiment of the application also provides a computer program product, which comprises: a computer program stored in a readable storage medium, from which at least one processor of a virtual device can read, the at least one processor executing the computer program causing the virtual device to perform the solution provided by any one of the embodiments described above.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (10)

1. A virtual location processing method, comprising:
based on the network type connected with the virtual equipment, acquiring initial virtual position data corresponding to initial physical position data where the virtual equipment is located, and displaying the initial virtual position data in a virtual space corresponding to the virtual equipment; wherein the virtual device corresponds to a physical object;
if the position of the entity object corresponding to the initial virtual position data in the virtual space is changed, changing the network type connected with the virtual equipment according to a preset network optimization mode; wherein the network optimization mode comprises optimized global microwave access interoperability and/or fifth generation mobile communication technology;
determining target virtual position data of the entity object in the virtual space according to the changed optimized network type so as to determine a virtual motion track of the entity object in the virtual space;
the determining the target virtual position data of the entity object in the virtual space according to the changed optimized network type comprises the following steps:
judging whether other entity objects appear in the field of view of the current entity object in the virtual space according to the changed optimized first network type;
If it is determined that other entity objects appear in the field of view of the current entity object, determining first position data of the current entity object at a plurality of moments and second position data of the other entity objects at the plurality of moments according to the modified optimized second network type;
if it is determined that no other entity objects exist in the field of view of the current entity object, acquiring first local data of the current entity object and second local data of the other entity objects;
determining first calibration offset data of a current entity object according to first position data of the current entity object at a plurality of moments; determining second calibration offset data of other entity objects according to second position data of the other entity objects at a plurality of moments;
determining target virtual position data of a current entity object in the virtual space according to the first calibration offset data and the first local data; and determining target virtual position data of the other entity objects according to the second calibration offset data and the second local data.
2. The method according to claim 1, wherein if the location of the physical object corresponding to the initial virtual location data in the virtual space changes, changing the network type of the virtual device connection according to a preset network optimization mode includes:
If the position of the entity object corresponding to the initial virtual position data in the virtual space changes, determining an optimized network type corresponding to the network type connected with the virtual device based on a mapping relation between the network type indicated by a preset network optimization mode and the optimized network type;
and changing the network type of the virtual equipment connection into global microwave access interoperability and/or a fifth generation mobile communication technology according to the optimized network type corresponding to the network type of the virtual equipment connection.
3. The method of claim 1, wherein the first location data comprises modified physical location data of the current physical object, modified virtual location data corresponding to modified location data of the current physical object, and the second location data comprises modified physical location data of the other physical object, modified virtual location data corresponding to modified location data of the other physical object.
4. The method of claim 1, wherein the first local data comprises local physical location data of the current physical object, local virtual location data corresponding to the local location data of the current physical object; the second local data includes local physical location data of the other entity object, and local virtual location data corresponding to the local location data of the other entity object.
5. A virtual device, comprising:
the display unit is used for acquiring initial virtual position data corresponding to initial physical position data of the virtual equipment based on the network type connected with the virtual equipment and displaying the initial virtual position data in a virtual space corresponding to the virtual equipment; wherein the virtual device corresponds to a physical object;
a changing unit, configured to change a network type connected to the virtual device according to a preset network optimization mode if a position of an entity object corresponding to initial virtual position data in the virtual space changes; wherein the network optimization mode comprises optimized global microwave access interoperability and/or fifth generation mobile communication technology;
the determining unit is used for determining target virtual position data of the entity object in the virtual space according to the changed optimized network type so as to determine a virtual motion track of the entity object in the virtual space;
the determination unit includes:
the judging module is used for judging whether other entity objects appear in the visual field of the current entity object in the virtual space according to the changed optimized first network type;
The first determining module is used for determining first position data of the current entity object at a plurality of moments and second position data of other entity objects at a plurality of moments according to the modified optimized second network type if other entity objects appear in the field of view of the current entity object;
the acquisition module is used for acquiring the first local data of the current entity object and the second local data of other entity objects if the fact that other entity objects do not appear in the field of view of the current entity object is determined;
a second determination module comprising:
a first determining sub-module, configured to determine first calibration offset data of a current entity object according to first position data of the current entity object at a plurality of moments; determining second calibration offset data of other entity objects according to second position data of the other entity objects at a plurality of moments;
a second determining sub-module, configured to determine target virtual position data of a current physical object in the virtual space according to the first calibration offset data and the first local data; and determining target virtual position data of the other entity objects according to the second calibration offset data and the second local data.
6. The apparatus of claim 5, wherein the modification unit comprises:
a third determining module, configured to determine, if the location of the entity object corresponding to the initial virtual location data in the virtual space changes, an optimized network type corresponding to the network type connected by the virtual device based on a mapping relationship between a network type indicated by a preset network optimization mode and the optimized network type;
and the changing module is used for changing the network type of the virtual equipment connection into global microwave access interoperability and/or a fifth generation mobile communication technology according to the optimized network type corresponding to the network type of the virtual equipment connection.
7. The apparatus of claim 5, wherein the first location data comprises modified physical location data of the current physical object, modified virtual location data corresponding to modified location data of the current physical object, and the second location data comprises modified physical location data of the other physical object, modified virtual location data corresponding to modified location data of the other physical object.
8. The apparatus of claim 5, wherein the first local data comprises local physical location data of the current physical object, local virtual location data corresponding to the local location data of the current physical object; the second local data includes local physical location data of the other entity object, and local virtual location data corresponding to the local location data of the other entity object.
9. A virtual device comprising a memory, a processor, the memory having stored therein a computer program executable on the processor, the processor implementing the method of any of the preceding claims 1-4 when the computer program is executed.
10. A computer readable storage medium having stored therein computer executable instructions which when executed by a processor are adapted to carry out the method of any one of claims 1-4.
CN202310286576.8A 2023-03-23 2023-03-23 Virtual position processing method and virtual device Active CN115996357B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310286576.8A CN115996357B (en) 2023-03-23 2023-03-23 Virtual position processing method and virtual device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310286576.8A CN115996357B (en) 2023-03-23 2023-03-23 Virtual position processing method and virtual device

Publications (2)

Publication Number Publication Date
CN115996357A CN115996357A (en) 2023-04-21
CN115996357B true CN115996357B (en) 2023-10-31

Family

ID=85995247

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310286576.8A Active CN115996357B (en) 2023-03-23 2023-03-23 Virtual position processing method and virtual device

Country Status (1)

Country Link
CN (1) CN115996357B (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018195278A1 (en) * 2017-04-21 2018-10-25 Walmart Apollo, Llc Virtual reality appliance management user interface
CN111459280A (en) * 2020-04-02 2020-07-28 深圳市瑞立视多媒体科技有限公司 VR space expansion method, device, equipment and storage medium
CN111586777A (en) * 2020-03-25 2020-08-25 北京邮电大学 Network switching method and device under indoor environment, electronic equipment and storage medium
CN111784844A (en) * 2020-06-09 2020-10-16 当家移动绿色互联网技术集团有限公司 Method and device for observing virtual object, storage medium and electronic equipment
CN112102682A (en) * 2020-11-09 2020-12-18 中电科芜湖钻石飞机制造有限公司南京研发中心 Aircraft driving training system and method based on 5G communication
CN112650391A (en) * 2020-12-23 2021-04-13 网易(杭州)网络有限公司 Human-computer interaction method, device and equipment based on virtual reality and storage medium
CN112675541A (en) * 2021-03-22 2021-04-20 航天宏图信息技术股份有限公司 AR information sharing method and device, electronic equipment and storage medium
WO2021109793A1 (en) * 2019-12-02 2021-06-10 荣耀终端有限公司 Display method for effective scene of smart communication strategy, and mobile terminal
WO2022142373A1 (en) * 2020-12-31 2022-07-07 大唐移动通信设备有限公司 Communication transmission method, device and system
WO2022148469A1 (en) * 2021-01-11 2022-07-14 华为技术有限公司 Security protection method, apparatus and system
CN114885388A (en) * 2022-04-29 2022-08-09 广西师范大学 Multi-service type self-adaptive switching judgment method combined with RSS prediction

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018195278A1 (en) * 2017-04-21 2018-10-25 Walmart Apollo, Llc Virtual reality appliance management user interface
WO2021109793A1 (en) * 2019-12-02 2021-06-10 荣耀终端有限公司 Display method for effective scene of smart communication strategy, and mobile terminal
CN111586777A (en) * 2020-03-25 2020-08-25 北京邮电大学 Network switching method and device under indoor environment, electronic equipment and storage medium
CN111459280A (en) * 2020-04-02 2020-07-28 深圳市瑞立视多媒体科技有限公司 VR space expansion method, device, equipment and storage medium
CN111784844A (en) * 2020-06-09 2020-10-16 当家移动绿色互联网技术集团有限公司 Method and device for observing virtual object, storage medium and electronic equipment
CN112102682A (en) * 2020-11-09 2020-12-18 中电科芜湖钻石飞机制造有限公司南京研发中心 Aircraft driving training system and method based on 5G communication
CN112650391A (en) * 2020-12-23 2021-04-13 网易(杭州)网络有限公司 Human-computer interaction method, device and equipment based on virtual reality and storage medium
WO2022142373A1 (en) * 2020-12-31 2022-07-07 大唐移动通信设备有限公司 Communication transmission method, device and system
WO2022148469A1 (en) * 2021-01-11 2022-07-14 华为技术有限公司 Security protection method, apparatus and system
CN112675541A (en) * 2021-03-22 2021-04-20 航天宏图信息技术股份有限公司 AR information sharing method and device, electronic equipment and storage medium
CN114885388A (en) * 2022-04-29 2022-08-09 广西师范大学 Multi-service type self-adaptive switching judgment method combined with RSS prediction

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
5G 网络中的移动 VR 应用;刘洁等;《电信科学》;全文 *
Meta-Reinforcement Learning for Reliable Communication in THz/VLC Wireless VR Networks;Yining Wang et;《IEEE》;全文 *
陈学亮 ; 庞涛.基于5G网络的虚拟现实优化方案研究.《广东通信技术》.2018,全文. *

Also Published As

Publication number Publication date
CN115996357A (en) 2023-04-21

Similar Documents

Publication Publication Date Title
US10905950B2 (en) Head-mounted display tracking
US10706629B2 (en) Coordinate override in virtual, augmented, and mixed reality (xR) applications
US11740690B2 (en) Systems and methods for tracking a controller
CN110457414B (en) Offline map processing and virtual object display method, device, medium and equipment
US11503428B2 (en) Systems and methods for co-localization of multiple devices
CN107274469A (en) The coordinative render method of Virtual reality
US11776151B2 (en) Method for displaying virtual object and electronic device
CN111079079B (en) Data correction method, device, electronic equipment and computer readable storage medium
US20210042988A1 (en) Fast 3d reconstruction with depth information
US20200209958A1 (en) User interaction in head-mounted display with eye tracking
KR102296139B1 (en) Method and apparatus for transmitting virtual reality images
WO2019221800A1 (en) System and method for spatially registering multiple augmented reality devices
EP4332904A1 (en) Image processing method and apparatus, electronic device, and storage medium
KR102503337B1 (en) Image display method, apparatus and system
CN115996357B (en) Virtual position processing method and virtual device
CN114466308B (en) Positioning method and electronic equipment
CN113763504A (en) Map updating method, map updating system, vehicle-mounted terminal, server and storage medium
US20240046583A1 (en) Real-time photorealistic view rendering on augmented reality (ar) device
CN115880555B (en) Target detection method, model training method, device, equipment and medium
CN105183142A (en) Digital information reproduction method by means of space position nailing
US20190228583A1 (en) Systems and methods for tracking object location and orientation in virtual reality environments using ultra-wideband signals, inertia measurement units, and reflective markers
US10630810B2 (en) Communications between head-mounted devices (HMDs) in virtual, augmented, and mixed reality (xR) applications
Chen et al. Networked Architectures for Localization-Based Multi-User Augmented Reality
US20230128662A1 (en) Electronic device and method for spatial mapping using the same
WO2023069164A1 (en) Determining relative position and orientation of cameras using hardware

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant