WO2022016953A1 - Navigation method and apparatus, storage medium and electronic device - Google Patents

Navigation method and apparatus, storage medium and electronic device Download PDF

Info

Publication number
WO2022016953A1
WO2022016953A1 PCT/CN2021/091916 CN2021091916W WO2022016953A1 WO 2022016953 A1 WO2022016953 A1 WO 2022016953A1 CN 2021091916 W CN2021091916 W CN 2021091916W WO 2022016953 A1 WO2022016953 A1 WO 2022016953A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
information
navigation
navigation information
real scene
Prior art date
Application number
PCT/CN2021/091916
Other languages
French (fr)
Chinese (zh)
Inventor
韩秉权
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2022016953A1 publication Critical patent/WO2022016953A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance

Definitions

  • the present application relates to the field of navigation technologies, and in particular, to a navigation method, device, storage medium and electronic device.
  • an electronic device provides a navigation function to a user by installing a navigation application and then combining with its own configured navigation hardware (such as a Beidou module).
  • the embodiments of the present application provide a navigation method, an apparatus, a storage medium, and an electronic device, which can reduce the hardware cost of the electronic device for implementing the navigation function.
  • an embodiment of the present application provides a navigation method, including:
  • navigation information from a second electronic device, where the navigation information is generated by the second electronic device according to its own orientation information;
  • the revised navigation information is displayed.
  • an embodiment of the present application provides a navigation device, including:
  • an information acquisition module configured to acquire navigation information from a second electronic device, where the navigation information is generated by the second electronic device based on its own orientation information
  • an information correction module configured to obtain the current orientation information of the first electronic device, and correct the navigation information according to the current orientation information to obtain corrected navigation information
  • the information display module is used to display the revised navigation information.
  • embodiments of the present application provide a storage medium on which a computer program is stored, and when the computer program is loaded by a processor of a first electronic device, the navigation method provided by the embodiments of the present application is executed.
  • an embodiment of the present application further provides an electronic device, the electronic device includes a processor and a memory, the memory stores a computer program, when the electronic device is configured as a first electronic device, the The processor executes the navigation method provided by the embodiments of the present application by loading the computer program.
  • FIG. 1 is a schematic diagram of a navigation system provided by an embodiment of the present application.
  • FIG. 2 is a schematic flowchart of a navigation method provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a navigation interface provided in an embodiment of the present application.
  • FIG. 4 is a schematic diagram of correcting the travel direction in the navigation information in an embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of smart glasses in an embodiment of the present application.
  • FIG. 6 is a schematic diagram of eyeball imaging of a user when the user wears smart glasses according to an embodiment of the present application.
  • FIG. 7 is another schematic structural diagram of the smart glasses in the embodiment of the present application.
  • FIG. 8 is another schematic structural diagram of the smart glasses in the embodiment of the present application.
  • FIG. 9 is another schematic flowchart of a navigation method provided by an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of a navigation device provided by an embodiment of the present application.
  • FIG. 11 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • An embodiment of the present application provides a navigation method, which is applied to a first electronic device, including:
  • navigation information from a second electronic device, where the navigation information is generated by the second electronic device according to its own orientation information;
  • the revised navigation information is displayed.
  • the displaying the revised navigation information may include:
  • the target navigation information is displayed according to the gesture information and the current orientation information, so that the target navigation information matches the real scene.
  • the first electronic device further includes a first camera, a second camera, and an inertial measurement unit, and the acquiring the current posture information of the first electronic device may include:
  • the attitude information is obtained by performing multi-degree-of-freedom tracking on the first electronic device according to the first image, the second image and the inertial data.
  • the first electronic device further includes a camera module
  • the three-dimensional reconstruction of the real scene where the first electronic device is currently located to obtain the virtual reality scene may include:
  • Three-dimensional reconstruction is performed on the real scene according to the depth image and the color image to obtain the virtual reality scene.
  • the method may include:
  • the navigation information is acquired from the second electronic device when the first electronic device and the second electronic device are in the same location.
  • the identifying whether the first electronic device and the second electronic device are in the same location may include:
  • the communication distance is less than a preset communication distance, it is determined that the first electronic device and the second electronic device are in the same position.
  • the method may include:
  • the navigation method may further include:
  • the acquiring navigation information from the second electronic device may include:
  • the navigation information is acquired from the second electronic device.
  • an embodiment of the present application provides a navigation system, where the navigation system includes a first electronic device 10 and a second electronic device 20. It should be noted that the embodiments of the present application do not specifically limit the entity presentation forms of the first electronic device 10 and the second electronic device 20.
  • the entity presentation form of the first electronic device 10 may be the smart glasses shown in FIG. 1 .
  • the entity presentation form of the second electronic device 20 can be the smartphone shown in FIG.
  • the entity presentation form of the first electronic device 10 can also be a wearable electronic device such as a smart helmet, and the entity presentation form of the second electronic device 20
  • the form can also be a mobile electronic device such as a tablet computer (it can be a non-wearable mobile electronic device or a wearable mobile electronic device).
  • the first electronic device 10 and the second electronic device 20 perform information exchange through a communication connection therebetween, and the communication connection may be a wired communication connection or a wireless communication connection.
  • the first electronic device 10 obtains navigation information leading to the destination from the second electronic device 20 through the communication connection between the first electronic device 10 and the second electronic device 20, and displays the navigation information to the user.
  • FIG. 1 shows only an example of a system architecture for implementing the embodiments of the present application, and the embodiments of the present application are not limited to the system architecture shown in the foregoing FIG. 1 .
  • Various embodiments of the present application are presented below by taking the system architecture shown in FIG. 1 as an example.
  • FIG. 2 is a schematic flowchart of a navigation method provided by an embodiment of the present application.
  • the navigation method is applied to the first electronic device in the navigation system shown in FIG. 1 .
  • the process of the navigation method provided by the embodiment of the present application may be as follows:
  • navigation information is acquired from a second electronic device, where the navigation information is generated by the second electronic device according to its own orientation information.
  • a communication connection is established between the first electronic device and the second electronic device in advance, and the communication connection may be a wired communication connection or a wireless communication connection.
  • the first electronic device will establish a wired communication connection with the second electronic device through the data cable between the two.
  • the user may also operate the first electronic device and the second electronic device to perform Bluetooth pairing, which will enable the first electronic device and the second electronic device to establish a Bluetooth wireless communication connection.
  • the first electronic device when the navigation is triggered, obtains the navigation information leading to the destination from the second electronic device through the communication connection between the first electronic device and the second electronic device.
  • the first electronic device is triggered to perform navigation according to the input navigation instruction
  • the input method of the navigation instruction is not specifically limited in the embodiments of the present application, including but not limited to a touch method, an eye movement method, a voice method, and the like.
  • the user can say “I'm going to XX mall", so as to input a navigation instruction to the destination "XX mall” in the form of voice into the first electronic device.
  • the first electronic device will navigate according to the navigation instruction.
  • the first electronic device will generate a navigation request according to the message format pre-agreed with the second electronic device and send it to the second electronic device.
  • the navigation request Navigation information for instructing the second electronic device to return to the aforementioned destination.
  • the second electronic device when receiving the navigation request from the first electronic device, the second electronic device obtains its current position and its own orientation information, and adopts the preset navigation according to the aforesaid current position and the aforesaid destination.
  • the algorithm calculates the navigation path guided by the current position to the aforementioned destination, and the remaining distance corresponding to the navigation path, and obtains the travel direction according to the self-orientation information, and packs the aforementioned travel direction, the foregoing current position, the foregoing remaining distance and the foregoing navigation path accordingly.
  • the first electronic device receives the navigation information returned by the second electronic device according to the aforementioned navigation request.
  • the current orientation information of the first electronic device is acquired, and the navigation information before navigation is corrected according to the current orientation information to obtain corrected navigation information.
  • the first electronic device may acquire current orientation information of itself through the configured geomagnetic sensor.
  • the first electronic device After acquiring its own current orientation information, the first electronic device corrects the aforementioned navigation information according to the current orientation information, and obtains revised navigation information matching the aforementioned current orientation information.
  • the first electronic device may take the direction described by the aforementioned current orientation information as the corrected travel direction, and correspondingly replace the travel direction included in the navigation information with the corrected travel direction, The correction of the aforementioned navigation information is thereby achieved.
  • the first electronic device when the user carries the first electronic device (not shown in the figure) and the second electronic device (not shown in the figure) at the intersection shown in the figure, since the second electronic device faces the northeast direction, The travel direction in the navigation information generated and returned by the corresponding second electronic device is also the northeast direction, but the orientation of the first electronic device is east. If the first electronic device does not correct the navigation information returned by the second electronic device, the navigation information The traveling direction of the first electronic device will be different from the actual orientation of the first electronic device, causing misguided users. To this end, the first electronic device uses its current orientation as the corrected travel direction, and replaces the travel direction in the aforementioned navigation information with the corrected travel direction to complete the correction of the navigation information.
  • the revised navigation information is presented.
  • the first electronic device After completing the correction of the aforementioned navigation information and correspondingly obtaining the corrected navigation information, the first electronic device displays the corrected navigation information according to the configured navigation information display strategy.
  • the configuration of the aforementioned navigation information display strategy is not specifically limited in the embodiments of the present application, and can be configured by those of ordinary skill in the art according to actual needs, including but not limited to map-based two-dimensional display, augmented reality-based The two-dimensional display method and the three-dimensional display method based on augmented reality, etc.
  • the present application obtains navigation information from the second electronic device through the first electronic device, the navigation information is generated by the second electronic device according to its own orientation information; and obtains the current orientation information of the first electronic device, and according to the current orientation information.
  • the orientation information corrects the acquired navigation information to obtain revised navigation information matched with the current orientation information of the first electronic device; and displays the aforementioned revised navigation information. Therefore, by correcting the navigation information of other electronic devices so that the corrected navigation information matches itself, and then using the corrected navigation information for navigation, the accuracy of the electronic device's navigation can be improved.
  • displaying revised navigation information includes:
  • the embodiments of the present application provide a three-dimensional display method based on augmented reality.
  • Augmented reality also known as augmented reality
  • Augmented reality is a technology that skillfully integrates virtual information with the real world.
  • Computer-generated text, images, 3D models, music, videos and other virtual information are simulated and applied to the real world, and the two kinds of information complement each other, thereby realizing the "enhancement" of the real world.
  • the first electronic device may be an electronic device with an augmented reality function, such as a smart phone with an augmented reality function, smart glasses with an augmented reality function, a smart helmet with an augmented reality function, and the like.
  • the first electronic device when displaying the revised navigation information, performs 3D reconstruction according to the configured 3D reconstruction strategy by aligning the current real scene to obtain a virtual reality scene corresponding to the real scene.
  • the three-dimensional reconstruction of the real scene can be regarded as a process of digitizing a real real scene, that is, the process of the first electronic device recognizing the real scene in which it is located.
  • the configuration of the 3D reconstruction strategy is not specifically limited in the embodiments of the present application, and a person of ordinary skill in the art can configure an appropriate 3D reconstruction strategy according to actual needs. For example, a three-dimensional reconstruction strategy that achieves a certain balance between reconstruction accuracy and reconstruction efficiency may be selected according to the processing capability of the first electronic device.
  • the first electronic device After completing the three-dimensional reconstruction of the real scene and correspondingly obtaining a virtual reality scene corresponding to the real scene, the first electronic device further generates augmented reality target navigation information according to the virtual reality scene and the revised navigation information. For example, taking the navigation path in the revised navigation information as an example, the original navigation path is in the two-dimensional space, and the first electronic device will obtain the virtual reality scene according to the three-dimensional reconstruction, and convert the original navigation path in the two-dimensional space to the real one.
  • the target navigation path in 3D space for scene matching.
  • the first electronic device also obtains its own current posture information.
  • the first electronic device can obtain its own current posture information by means of multi-degree-of-freedom tracking.
  • the first electronic device After generating the augmented reality target navigation information and acquiring the current posture information, the first electronic device displays the target navigation information according to the foregoing posture information and the foregoing current orientation information, so that the displayed target navigation information will match the real scene.
  • the target navigation path in the target navigation information as an example, for the user, the target navigation path seen by the user will match the road in the real scene.
  • the first electronic device includes a display component and a diffractive waveguide.
  • the first electronic device After generating the target navigation information of the augmented reality and acquiring the current attitude information, the first electronic device displays the augmented reality through the display component according to its own current attitude information and current orientation information.
  • target navigation information wherein the target navigation information includes the navigation path, the corrected travel direction, the remaining distance, the destination and the current position.
  • the target navigation information displayed by the display component will be projected into the user's eyeball together with the real scene through the diffractive waveguide, and will be seen by the user. Please continue to refer to FIG.
  • the target navigation information displayed by the first electronic device is the same as the real scene. matched. Among them, it shows the current position "XX Mountain", the target navigation path matching the road in the real scene, the prompt information carrying the remaining distance "continue to crawl 500 meters (ie remaining distance) to the destination", and the purpose of the four-pointed star logo ground, correct the direction of travel.
  • the corrected travel direction is the current orientation of the first electronic device, that is, the real orientation of the user, thereby realizing the augmented reality three-dimensional navigation based on the real scene.
  • the first electronic device further includes a first camera, a second camera, and an inertial measurement unit, and obtains current attitude information of the first electronic device, including:
  • the embodiment of the present application further provides an acquisition method for optionally acquiring the current posture information of the first electronic device.
  • the first electronic device further includes a first camera, a second camera and an inertial measurement unit.
  • a first camera a second camera
  • an inertial measurement unit a first camera, a second camera and an inertial measurement unit.
  • FIG. 7 shows an optional arrangement of the first camera, the second camera and the inertial measurement unit. It should be noted that the first camera, the second camera and the inertial measurement unit are not limited to the arrangement shown in FIG. 7 .
  • the first electronic device when the first electronic device acquires its current posture information, it can shoot the real scene through the first camera, record the image captured by the first camera as the first image, and simultaneously shoot the real scene through the second camera, and record the real scene through the second camera.
  • the image captured by the second camera is recorded as the second image.
  • inertial data is also obtained by measuring the inertial measurement unit.
  • the first electronic device uses the configured multi-degree-of-freedom tracking algorithm to calculate and obtain the current attitude information according to the first image, the second image and the inertial data.
  • multi-degree-of-freedom tracking algorithm there is no specific limitation on which multi-degree-of-freedom tracking algorithm is adopted, and those of ordinary skill in the art can select according to actual needs.
  • a six-degree-of-freedom tracking algorithm is used in the embodiment of the present application, and correspondingly, the six-degree-of-freedom attitude information of the first electronic device is obtained, including pitch information, heave information, sway information, pitch information, roll information, and yaw information information. Accordingly, combined with the virtual reality scene, the visual field and angle of the user wearing the smart glasses in the real scene can be obtained, so as to realize the matching display of the target navigation information and the real scene.
  • the first electronic device further includes a camera module, which performs three-dimensional reconstruction on the real scene where the first electronic device is currently located to obtain a virtual reality scene, including:
  • the first electronic device further includes a camera module.
  • the camera module includes a depth camera and an RGB camera.
  • FIG. 8 shows an optional setting method of the depth camera and the RGB camera. It should be noted that the depth camera and the RGB camera are not limited to the arrangement shown in FIG. 8 .
  • the depth camera selected in the embodiment of the present application is a time-of-flight camera.
  • the time-of-flight camera uses the reflection characteristics of light to calculate the depth (or say, the distance of the object to the time-of-flight camera).
  • the electronic device can obtain a depth image of the real scene through the time-of-flight camera, and the depth image includes the depth values (depth values) at different positions in the real scene.
  • the value reflects the distance from a location in the real scene to the time-of-flight camera, the smaller the value, the closer to the time-of-flight camera, and the larger the value, the farther away from the time-of-flight camera).
  • An RGB camera receives light reflected (or emitted) by an object and converts the light into a color image that carries the color characteristics of the object.
  • the electronic device may obtain a color image of the real scene through the RGB camera when the RGB camera is aimed at the real scene, and the color image includes color data at different positions in the real scene.
  • the acquired depth image includes the depth value of the real scene, but does not include the color data of the real scene
  • the acquired color image includes the color data of the real scene, but does not include the depth value of the real scene
  • the electronic device can synchronize the depth image and color image of the real scene acquired by the time-of-flight camera and the RGB camera.
  • the first electronic device After acquiring the depth image and color image of the real scene, the first electronic device performs three-dimensional reconstruction of the real scene according to the aforementioned depth image and color image according to the configured three-dimensional reconstruction algorithm, and correspondingly obtains a virtual reality scene corresponding to the real scene. It should be noted that. There is no specific limitation on which three-dimensional reconstruction algorithm is adopted in the embodiments of the present application, and can be selected by those of ordinary skill in the art according to actual needs.
  • the method before acquiring the navigation information from the second electronic device, the method further includes:
  • the first electronic device itself may not have the navigation capability, but the navigation information obtained from the second electronic device implements navigation.
  • the navigation information generated by the second electronic device will not be applicable to the first electronic device.
  • the first electronic device before acquiring the navigation information from the second electronic device, the first electronic device first identifies whether the first electronic device and the second electronic device are in the same location, and after identifying the first electronic device and the second electronic device When the two electronic devices are in the same position, the navigation information is obtained from the second electronic device, and the navigation information is used for navigation.
  • the manner of using the navigation information of the second electronic device to perform navigation may refer to the relevant descriptions in the above embodiments, which will not be repeated here.
  • identifying whether the first electronic device and the second electronic device are in the same position includes:
  • the embodiment of the present application is preconfigured with a preset communication distance for determining whether the first electronic device and the second electronic device are in the same position, and the value of the preset communication distance can be determined by a person of ordinary skill in the art according to the actual situation. An empirical value needs to be taken, which is not specifically limited in the embodiment of the present application.
  • the preset communication distance is configured to be 2 meters in the embodiment of the present application.
  • the first electronic device When identifying whether the first electronic device and the second electronic device are in the same position, the first electronic device first obtains the communication distance between it and the second electronic device, and then determines whether the communication distance is less than the preset communication distance, if the aforementioned If the communication distance is less than the preset communication distance, it is determined that the first electronic device and the second electronic device are in the same location, otherwise it is determined that the first electronic device and the second electronic device are in different locations.
  • the first electronic device constructs a ranging request according to a message format pre-agreed with the second electronic device, and sends the constructed ranging request to the second electronic device, where the ranging request is used to indicate the second electronic device.
  • the electronic device returns ranging information.
  • the ranging information may be a blank frame, and the blank frame carries a time stamp, and the time stamp is the sending moment when the second electronic device sends the blank frame.
  • the first electronic device parses the time stamp carried by the blank frame to obtain the sending time of the blank frame.
  • the data interaction is realized in the form of electromagnetic waves (or currents) at the physical level, and the propagation speeds of electromagnetic waves and currents are known, and they are both approximately the speed of light. Therefore, the first electronic device can calculate the current communication distance with the second electronic device according to the aforementioned sending time and the receiving time of receiving the aforementioned blank frame, combined with the speed of light, as follows:
  • L represents the communication distance between the first electronic device and the second electronic device
  • Tr represents the reception time when the first electronic device receives the aforementioned blank frame (ie, ranging information)
  • Tt represents the second electronic device sends the aforementioned blank frame
  • the sending time of , C represents the speed of light.
  • the method further includes:
  • the first electronic device after the communication distance between the first electronic device and the second electronic device is obtained, if the communication distance is greater than or equal to the preset communication distance, the first electronic device will determine that it is in a position with the second electronic device. different positions. In order to prevent the user from leaving the second electronic device, the first electronic device further prompts the second electronic device for a location.
  • a positioning request is generated and sent to the second electronic device, and the positioning request is sent to the second electronic device.
  • the request is used to instruct the second electronic device to return to its current location.
  • the second electronic device receives the positioning request from the first electronic device, it obtains the current location information of itself, and returns the current location information to the first electronic device.
  • the first electronic device receives the current location information returned by the second electronic device according to the aforementioned positioning request.
  • the first electronic device After acquiring the current location information of the second electronic device, the first electronic device further generates location prompt information according to the current location information, and displays it according to a preconfigured display mode (including but not limited to text mode, audio mode, video mode, etc.) Displays the generated location hints.
  • a preconfigured display mode including but not limited to text mode, audio mode, video mode, etc.
  • the location prompt information generated by the first electronic device consists of two parts, which are the prompt information "Master, you have left the second electronic device" and the current location information of the second electronic device.
  • the navigation method provided by the present application further includes:
  • the embodiments of the present application do not specifically limit the manner in which the second electronic device performs the location prompting operation, and can be configured by those of ordinary skill in the art as required.
  • the second electronic device may generate the second location prompt information according to its current location information, and output the second location prompt information in a voice manner.
  • the second location prompt information consists of two parts, which are the prompt information "Master, I am here" and the current location information of the second electronic device.
  • the navigation method provided by the present application further includes:
  • the first electronic device may also have a navigation capability for providing navigation information to other electronic devices.
  • the first electronic device can also establish a communication connection with the third electronic device, and receive the navigation request transmitted by the third electronic device.
  • the first electronic device parses the orientation information and destination of the third electronic device carried in the navigation request. Taking the orientation information of the third electronic device as its own orientation information, and generating navigation information corresponding to the third electronic device according to its current location and the aforementioned destination. Then, the navigation information corresponding to the third electronic device is sent to the third electronic device, and the third electronic device performs navigation.
  • acquiring navigation information from the second electronic device further includes:
  • the navigation information is acquired from the second electronic device.
  • the navigation information can also be obtained from the second electronic device, and the navigation capability of the second electronic device is used for navigation accordingly.
  • the embodiment of the present application is configured with a preset navigation condition that restricts the first electronic device from acquiring navigation information from the second electronic device, so that the first electronic device obtains the navigation information from the second electronic device when the preset navigation condition is satisfied.
  • Navigation information and use the acquired navigation information to navigate.
  • the manner of using the navigation information of the second electronic device to perform navigation may refer to the relevant descriptions in the above embodiments, which will not be repeated here.
  • the preset navigation conditions in this embodiment of the present application are configured as:
  • the remaining power of the first electronic device is less than the preset power
  • the navigation accuracy of the first electronic device is less than the navigation accuracy of the second electronic device.
  • the navigation function of the first electronic device is unavailable, and the navigation function of the second electronic device is available.
  • FIG. 9 is another schematic flowchart of a navigation method provided by an embodiment of the present application.
  • the following describes the navigation method provided by the embodiment of the present application by using the first electronic device as smart glasses and the second electronic device as a smart phone.
  • the process of the navigation method provided by the embodiment of the present application may be as follows:
  • the smart glasses receive the input navigation instruction, and send a navigation request corresponding to the destination indicated by the navigation instruction to the smart phone.
  • a communication connection is established between the smart glasses and the smart phone in advance, and the communication connection may be a wired communication connection or a wireless communication connection.
  • the communication connection may be a wired communication connection or a wireless communication connection.
  • the smart glasses will establish a wired communication connection with the smartphone through the data cable between the two.
  • the user can also operate the smart glasses to pair with the smart phone via Bluetooth, which will enable the smart glasses and the smart phone to establish a Bluetooth wireless communication connection.
  • the smart glasses when the navigation is triggered, the smart glasses obtain the navigation information leading to the destination from the smart phone through the communication connection between the smart glasses and the smart phone.
  • the smart glasses are triggered to navigate according to the input navigation instruction, and the input method of the navigation instruction is not specifically limited in the embodiments of the present application, including but not limited to a touch method, an eye movement method, a voice method, and the like.
  • the smart glasses are provided with a navigation interface.
  • the navigation interface includes an input control in the form of an input box and a confirmation control.
  • the confirmation control includes a prompt message "Start Navigation".
  • the prompt message of the destination "Please enter the destination”.
  • FIG. 3 when the user inputs the destination "XX mall" into the input control through eye movement and triggers the confirmation control, a navigation instruction instructing the smart glasses to navigate to the destination "XX mall" will be generated.
  • the user can say “I'm going to XX mall", so as to input a voice navigation instruction to the destination "XX mall" into the smart glasses.
  • the smart glasses will navigate according to the navigation instruction.
  • the smart glasses will generate a navigation request and send it to the smart phone according to the message format pre-agreed with the smart phone.
  • the navigation request is used to instruct the smart phone to return to the aforementioned direction. Navigation information for the destination.
  • the smartphone In 202, the smartphone generates navigation information leading to a destination according to its own orientation information and the current location.
  • the smart phone When the smart phone receives the navigation request from the smart glasses, it obtains its current position and its own orientation information, and uses the preset navigation algorithm to calculate the direction from the current position to the aforementioned according to the aforementioned current position and the aforementioned destination.
  • the navigation path of the destination, the remaining distance corresponding to the navigation path, and the travel direction are obtained according to the self-orientation information, and the foregoing travel direction, the foregoing current position, the foregoing remaining distance and the foregoing navigation path are correspondingly packaged as navigation information.
  • the smartphone returns the generated navigation information to the smart glasses.
  • the smart phone After the navigation information is packaged and obtained, the smart phone returns the aforementioned navigation information to the smart glasses through the communication connection between it and the smart glasses.
  • the smart glasses obtain their own current orientation information, and correct the navigation information according to the current orientation information to obtain corrected navigation information.
  • smart glasses can obtain their current orientation information through the configured geomagnetic sensor.
  • the smart glasses After acquiring its own current orientation information, the smart glasses correct the aforementioned navigation information according to the current orientation information, and obtain revised navigation information matching the aforementioned current orientation information.
  • the smart glasses when correcting the aforementioned navigation information according to the aforementioned current orientation information, can use the direction described by the aforementioned current orientation information as the corrected travel direction, and correspondingly replace the travel direction included in the navigation information with the corrected travel direction, thereby Realize the correction of the aforementioned navigation information.
  • the smart glasses when the user is at the intersection with smart glasses (not shown in the figure) and a smart phone (not shown in the figure), since the smart phone faces the northeast direction, the corresponding smart phone generates and returns The travel direction in the navigation information is also the northeast direction, but the orientation of the smart glasses is east. If the smart glasses do not correct the navigation information returned by the smartphone, the travel direction in the navigation information will be different from the actual direction of the smart glasses. cause misdirection. To this end, the smart glasses take their current orientation as the corrected travel direction, and replace the travel direction in the aforementioned navigation information with the corrected travel direction, thereby completing the correction of the navigation information.
  • the smart glasses perform three-dimensional reconstruction on the current real scene to obtain a virtual reality scene corresponding to the real scene.
  • the smart glasses further include a camera module.
  • the camera module includes a depth camera and an RGB camera.
  • FIG. 8 shows an optional setting method of the depth camera and the RGB camera. It should be noted that the depth camera and the RGB camera are not limited to the arrangement shown in FIG. 8 .
  • the depth camera selected in the embodiment of the present application is a time-of-flight camera.
  • the time-of-flight camera uses the reflection characteristics of light to calculate the depth (or say, the distance of the object to the time-of-flight camera).
  • the electronic device can obtain a depth image of the real scene through the time-of-flight camera, and the depth image includes the depth values (depth values) at different positions in the real scene.
  • the value reflects the distance from a location in the real scene to the time-of-flight camera, the smaller the value, the closer to the time-of-flight camera, and the larger the value, the farther away from the time-of-flight camera).
  • An RGB camera receives light reflected (or emitted) by an object and converts the light into a color image that carries the color characteristics of the object.
  • the electronic device may obtain a color image of the real scene through the RGB camera when the RGB camera is aimed at the real scene, and the color image includes color data at different positions in the real scene.
  • the acquired depth image includes the depth value of the real scene, but does not include the color data of the real scene
  • the acquired color image includes the color data of the real scene, but does not include the depth value of the real scene
  • the electronic device can synchronize the depth image and color image of the real scene acquired by the time-of-flight camera and the RGB camera.
  • the smart glasses After acquiring the depth image and the color image of the real scene, the smart glasses perform three-dimensional reconstruction of the real scene according to the aforementioned depth image and color image according to the configured three-dimensional reconstruction algorithm, and correspondingly obtain a virtual reality scene corresponding to the real scene. It should be noted that. There is no specific limitation on which three-dimensional reconstruction algorithm is adopted in the embodiments of the present application, and can be selected by those of ordinary skill in the art according to actual needs.
  • the smart glasses generate augmented reality target navigation information according to the virtual reality scene and the revised navigation information.
  • Augmented reality also known as augmented reality
  • Augmented reality is a technology that skillfully integrates virtual information with the real world.
  • Computer-generated text, images, 3D models, music, videos and other virtual information are simulated and applied to the real world, and the two kinds of information complement each other, thereby realizing the "enhancement" of the real world.
  • the smart glasses may be electronic devices with augmented reality functions, such as smart phones with augmented reality functions, smart glasses with augmented reality functions, smart helmets with augmented reality functions, and the like.
  • the smart glasses can display the revised navigation information based on the three-dimensional display of augmented reality.
  • the smart glasses After completing the three-dimensional reconstruction of the real scene and correspondingly obtaining the virtual reality scene corresponding to the real scene, the smart glasses further generate the augmented reality target navigation information according to the virtual reality scene and the revised navigation information. For example, taking the navigation path in the revised navigation information as an example, the original navigation path is in the two-dimensional space, and the smart glasses will obtain the virtual reality scene according to the three-dimensional reconstruction, and convert the original navigation path in the two-dimensional space to match the real scene.
  • the target navigation path in 3D space.
  • the smart glasses perform multi-degree-of-freedom tracking to obtain current posture information.
  • the smart glasses further include a first camera, a second camera and an inertial measurement unit.
  • a first camera a second camera
  • an inertial measurement unit a first camera, a second camera and an inertial measurement unit.
  • FIG. 7 shows an optional arrangement of the first camera, the second camera and the inertial measurement unit. It should be noted that the first camera, the second camera and the inertial measurement unit are not limited to the arrangement shown in FIG. 7 .
  • the smart glasses when they obtain their current posture information, they can use the first camera to shoot the real scene, record the image captured by the first camera as the first image, and simultaneously shoot the real scene through the second camera, and use the second camera to shoot the real scene.
  • the image captured by the camera is recorded as the second image.
  • inertial data is also obtained by measuring the inertial measurement unit.
  • the smart glasses use the configured multi-degree-of-freedom tracking algorithm to calculate and obtain the current posture information according to the aforementioned first image, the aforementioned second image, and the aforementioned inertial data.
  • multi-degree-of-freedom tracking algorithm there is no specific limitation on which multi-degree-of-freedom tracking algorithm is adopted, and those of ordinary skill in the art can select according to actual needs.
  • the six-degree-of-freedom tracking algorithm is used in the embodiment of the present application, and correspondingly, the six-degree-of-freedom attitude information of the smart glasses is obtained, including pitch information, heave information, sway information, pitch information, roll information, and yaw information. Accordingly, combined with the virtual reality scene, the visual field and angle of the user wearing the smart glasses in the real scene can be obtained, so as to realize the matching display of the target navigation information and the real scene.
  • the smart glasses display the target navigation information according to the aforementioned posture information and the aforementioned current orientation information, so that the target navigation information matches the real scene.
  • the smart glasses After generating the augmented reality target navigation information and acquiring the current posture information, the smart glasses display the target navigation information according to the foregoing posture information and the foregoing current orientation information, so that the displayed target navigation information will match the real scene.
  • the target navigation path in the target navigation information as an example, for the user, the target navigation path seen by the user will match the road in the real scene.
  • the smart glasses include a display component and a diffractive waveguide.
  • the smart glasses After generating the target navigation information of augmented reality and acquiring the current attitude information, the smart glasses pass the display component according to their current attitude information and current orientation information. Display the target navigation information of augmented reality, wherein the target navigation information includes the navigation path, the corrected travel direction, the remaining distance, the destination and the current position.
  • the target navigation information displayed by the display component will be projected into the user's eyeball together with the real scene through the diffractive waveguide and seen by the user.
  • FIG. 6 shows the image actually seen by the user, which is a fusion image of the real scene and the target navigation information.
  • the target navigation information displayed by the smart glasses matches the real scene. .
  • it shows the current position "XX Mountain”, the target navigation path matching the road in the real scene, the prompt information carrying the remaining distance "continue to crawl 500 meters (ie remaining distance) to the destination", and the purpose of the four-pointed star logo , correct the direction of travel.
  • the corrected travel direction is the current orientation of the smart glasses, that is, the real orientation of the user, thereby realizing the 3D navigation of augmented reality based on the real scene.
  • FIG. 10 is a schematic structural diagram of a navigation device provided by an embodiment of the present application.
  • the navigation device is applied to the electronic equipment provided in this application.
  • the navigation device may include an information acquisition module 301 and an information correction module 302, wherein,
  • an information acquisition module 301 configured to acquire navigation information from a second electronic device, where the navigation information is generated by the second electronic device according to its own orientation information;
  • the information correction module 302 is used for acquiring the current orientation information of the first electronic device, and correcting the aforementioned navigation information according to the current orientation information to obtain the corrected navigation information;
  • the information display module 303 is used to display the revised navigation information.
  • the information displaying module 303 when displaying the revised navigation information, is configured to:
  • the target navigation information is displayed according to the posture information and the current orientation information, so that the target navigation information matches the real scene.
  • the first electronic device further includes a first camera, a second camera, and an inertial measurement unit, and when acquiring the current attitude information of the first electronic device, the information display module 303 is configured to:
  • the first image is obtained by shooting the real scene with the first camera
  • the second image is obtained by shooting the real scene with the second camera
  • the inertial data is obtained by measuring the inertial measurement unit
  • the multi-degree-of-freedom tracking is performed on the first electronic device according to the first image, the second image and the inertial data to obtain current attitude information.
  • the first electronic device further includes a camera module, and when performing three-dimensional reconstruction of the real scene where the first electronic device is currently located to obtain a virtual reality scene, the information display module 303 is configured to execute:
  • the virtual reality scene is obtained by 3D reconstruction of the real scene according to the depth image and the color image.
  • the information acquiring module 301 before acquiring the navigation information from the second electronic device, is further configured to:
  • the navigation information is acquired from the second electronic device.
  • the information acquisition module 301 when identifying whether the first electronic device and the second electronic device are in the same position, the information acquisition module 301 is used to:
  • the navigation device provided by the present application further includes a prompting module, which is configured to: after acquiring the communication distance between the first electronic device and the second electronic device:
  • the navigation device provided by the present application further includes a navigation module for:
  • the navigation information corresponding to the third electronic device is sent to the third electronic device.
  • the information acquisition module 301 when acquiring navigation information from the second electronic device, is configured to:
  • the navigation information is acquired from the second electronic device.
  • navigation device provided in the embodiment of the present application and the navigation method in the above embodiment belong to the same concept, and the navigation device can run any method provided in the navigation method embodiment.
  • the specific implementation process please refer to the above related implementation. For example, it will not be repeated here.
  • the embodiments of the present application provide a storage medium on which a computer program is stored, and when the stored computer program is loaded by a processor of a first electronic device, the steps in the navigation method provided by the embodiments of the present application are executed.
  • the storage medium may be a magnetic disk, an optical disk, a read only memory (Read Only Memory, ROM), or a random access device (Random Access Memory, RAM), and the like.
  • An embodiment of the present application further provides an electronic device. Please refer to FIG. 11 .
  • the electronic device includes a processor 401 and a memory 402 .
  • the processor in the embodiment of the present application is a general-purpose processor, such as a processor of an ARM architecture.
  • a computer program is stored in the memory 402, which may be a high-speed random access memory, or a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
  • the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.
  • the processor 401 implements the following functions by loading the computer program in the memory 402:
  • the processor 401 when the revised navigation information is displayed, the processor 401 is configured to execute:
  • the target navigation information is displayed according to the posture information and the current orientation information, so that the target navigation information matches the real scene.
  • the first electronic device further includes a first camera, a second camera, and an inertial measurement unit, and when acquiring the current attitude information of the first electronic device, the processor 401 is configured to execute:
  • the first image is obtained by shooting the real scene with the first camera
  • the second image is obtained by shooting the real scene with the second camera
  • the inertial data is obtained by measuring the inertial measurement unit
  • the multi-degree-of-freedom tracking is performed on the first electronic device according to the first image, the second image and the inertial data to obtain current attitude information.
  • the first electronic device further includes a camera module, and when performing three-dimensional reconstruction on the real scene where the first electronic device is currently located to obtain a virtual reality scene, the processor 401 is configured to execute:
  • the virtual reality scene is obtained by 3D reconstruction of the real scene according to the depth image and the color image.
  • the processor 401 before acquiring the navigation information from the second electronic device, the processor 401 is further configured to execute:
  • the navigation information is acquired from the second electronic device.
  • the processor 401 when identifying whether the first electronic device and the second electronic device are in the same position, the processor 401 is configured to execute:
  • the processor 401 is further configured to execute:
  • the processor 401 is further configured to execute:
  • the navigation information corresponding to the third electronic device is sent to the third electronic device.
  • the processor 401 when acquiring navigation information from the second electronic device, the processor 401 is configured to execute:
  • the navigation information is acquired from the second electronic device.
  • the computer program can be stored in a computer-readable storage medium, such as a memory of an electronic device, and executed by a processor in the electronic device, and the execution process can include processes such as embodiments of the navigation method.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory, a random access memory, or the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Navigation (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A navigation method and apparatus, a storage medium and an electronic device, the method comprising: acquiring navigation information from a second electronic device by means of a first electronic device, the navigation information being generated by the second electronic device according to its own orientation information (101); acquiring current orientation information of the first electronic device, and modifying the acquired navigation information according to the current orientation information to obtain the modified navigation information that matches the current orientation information of the first electronic device (102); and displaying the modified navigation information (103).

Description

导航方法、装置、存储介质及电子设备Navigation method, device, storage medium and electronic device
本申请要求于2020年07月22日提交中国专利局、申请号为202010711894.0、发明名称为“导航方法、装置、存储介质及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed on July 22, 2020 with the application number 202010711894.0 and the title of the invention is "navigation method, device, storage medium and electronic device", the entire contents of which are incorporated by reference in in this application.
技术领域technical field
本申请涉及导航技术领域,具体涉及一种导航方法、装置、存储介质及电子设备。The present application relates to the field of navigation technologies, and in particular, to a navigation method, device, storage medium and electronic device.
背景技术Background technique
目前,如智能手机、平板电脑等电子设备已成为人们生活所必须。通过在电子设备安装不同的应用,使得电子设备能够实现各种各样的功能。比如,电子设备通过安装导航应用,然后结合自身配置的导航硬件(比如北斗模块)向用户提供导航功能。At present, electronic devices such as smart phones and tablet computers have become a must in people's lives. By installing different applications on the electronic device, the electronic device can realize various functions. For example, an electronic device provides a navigation function to a user by installing a navigation application and then combining with its own configured navigation hardware (such as a Beidou module).
发明内容SUMMARY OF THE INVENTION
本申请实施例提供了一种导航方法、装置、存储介质及电子设备,能够降低电子设备实现导航功能的硬件成本。The embodiments of the present application provide a navigation method, an apparatus, a storage medium, and an electronic device, which can reduce the hardware cost of the electronic device for implementing the navigation function.
第一方面,本申请实施例提供一种导航方法,包括:In a first aspect, an embodiment of the present application provides a navigation method, including:
从第二电子设备获取导航信息,所述导航信息由所述第二电子设备根据其自身朝向信息生成;obtaining navigation information from a second electronic device, where the navigation information is generated by the second electronic device according to its own orientation information;
获取所述第一电子设备的当前朝向信息,并根据所述当前朝向信息对所述导航信息进行修正,得到修正导航信息;Acquiring the current orientation information of the first electronic device, and correcting the navigation information according to the current orientation information to obtain revised navigation information;
展示所述修正导航信息。The revised navigation information is displayed.
第二方面,本申请实施例提供一种导航装置,包括:In a second aspect, an embodiment of the present application provides a navigation device, including:
信息获取模块,用于从第二电子设备获取导航信息,所述导航信息由所述第二电子设备基于其自身朝向信息生成;an information acquisition module, configured to acquire navigation information from a second electronic device, where the navigation information is generated by the second electronic device based on its own orientation information;
信息修正模块,用于获取所述第一电子设备的当前朝向信息,并根据所述当前朝向信息对所述导航信息进行修正,得到修正导航信息;an information correction module, configured to obtain the current orientation information of the first electronic device, and correct the navigation information according to the current orientation information to obtain corrected navigation information;
信息展示模块,用于展示所述修正导航信息。The information display module is used to display the revised navigation information.
第三方面,本申请实施例提供了一种存储介质,其上存储有计算机程序,当所述计算机程序被第一电子设备的处理器加载时执行本申请实施例提供的导航方法。In a third aspect, embodiments of the present application provide a storage medium on which a computer program is stored, and when the computer program is loaded by a processor of a first electronic device, the navigation method provided by the embodiments of the present application is executed.
第四方面,本申请实施例还提供了一种电子设备,所述电子设备包括处理器和存储器,所述存储器储存有计算机程序,当所述电子设备被配置为第一电子设备时,所述处理器通过加载所述计算机程序执行本申请实施例提供的导航方法。In a fourth aspect, an embodiment of the present application further provides an electronic device, the electronic device includes a processor and a memory, the memory stores a computer program, when the electronic device is configured as a first electronic device, the The processor executes the navigation method provided by the embodiments of the present application by loading the computer program.
附图说明Description of drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.
图1是本申请实施例提供的导航系统的示意图。FIG. 1 is a schematic diagram of a navigation system provided by an embodiment of the present application.
图2是本申请实施例提供的导航方法的一流程示意图。FIG. 2 is a schematic flowchart of a navigation method provided by an embodiment of the present application.
图3是本申请实施例中提供的导航界面的示意图。FIG. 3 is a schematic diagram of a navigation interface provided in an embodiment of the present application.
图4是本申请实施例中对导航信息中的行进方向进行修正的示意图。FIG. 4 is a schematic diagram of correcting the travel direction in the navigation information in an embodiment of the present application.
图5是本申请实施例中智能眼镜的一结构示意图。FIG. 5 is a schematic structural diagram of smart glasses in an embodiment of the present application.
图6是本申请实施例中用户穿戴智能眼镜时的用户眼球成像示意图。FIG. 6 is a schematic diagram of eyeball imaging of a user when the user wears smart glasses according to an embodiment of the present application.
图7是本申请实施例中智能眼镜的另一结构示意图。FIG. 7 is another schematic structural diagram of the smart glasses in the embodiment of the present application.
图8是本申请实施例中智能眼镜的又一结构示意图。FIG. 8 is another schematic structural diagram of the smart glasses in the embodiment of the present application.
图9是本申请实施例提供的导航方法的另一流程示意图。FIG. 9 is another schematic flowchart of a navigation method provided by an embodiment of the present application.
图10是本申请实施例提供的导航装置的结构示意图。FIG. 10 is a schematic structural diagram of a navigation device provided by an embodiment of the present application.
图11是本申请实施例提供的电子设备的结构示意图。FIG. 11 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
具体实施方式detailed description
请参照图式,其中相同的组件符号代表相同的组件,本申请的原理是以实施在一适当的运算环境中来举例说明。以下的说明是基于所例示的本申请具体实施例,其不应被视为限制本申请未在此详述的其它具体实施例。Please refer to the drawings, wherein the same component symbols represent the same components, and the principles of the present application are exemplified by being implemented in a suitable computing environment. The following description is based on illustrated specific embodiments of the present application and should not be construed as limiting other specific embodiments of the present application not detailed herein.
应当说明的是,本申请以下实施例中所涉及的诸如第一和第二等关系术语仅用于将一个实体或者操作与另一个实体或者操作区分开来,并不用于限定这些实体或操作之间存在着实际的顺序关系。It should be noted that the relational terms such as first and second involved in the following embodiments of this application are only used to distinguish one entity or operation from another entity or operation, and are not used to limit these entities or operations. There is an actual sequential relationship between them.
本申请实施例提供一种导航方法,应用于第一电子设备,包括:An embodiment of the present application provides a navigation method, which is applied to a first electronic device, including:
从第二电子设备获取导航信息,所述导航信息由所述第二电子设备根据其自身朝向信息生成;obtaining navigation information from a second electronic device, where the navigation information is generated by the second electronic device according to its own orientation information;
获取所述第一电子设备的当前朝向信息,并根据所述当前朝向信息对所述导航信息进行修正,得到修正导航信息;Acquiring the current orientation information of the first electronic device, and correcting the navigation information according to the current orientation information to obtain revised navigation information;
展示所述修正导航信息。The revised navigation information is displayed.
在一种实施方式中,所述展示所述修正导航信息,可以包括:In one embodiment, the displaying the revised navigation information may include:
对所述第一电子设备当前所处的现实场景进行三维重建,得到虚拟现实场景;performing three-dimensional reconstruction on the real scene where the first electronic device is currently located to obtain a virtual reality scene;
根据所述虚拟现实场景和所述修正导航信息,生成增强现实的目标导航信息;generating augmented reality target navigation information according to the virtual reality scene and the revised navigation information;
获取所述第一电子设备当前的姿态信息;obtaining the current posture information of the first electronic device;
根据所述姿态信息和所述当前朝向信息展示所述目标导航信息,使得所述目标导航信息与所述现实场景匹配。The target navigation information is displayed according to the gesture information and the current orientation information, so that the target navigation information matches the real scene.
在一种实施方式中,所述第一电子设备还包括第一摄像头、第二摄像头以及惯性测量单元,所述获取所述第一电子设备当前的姿态信息,可以包括:In one embodiment, the first electronic device further includes a first camera, a second camera, and an inertial measurement unit, and the acquiring the current posture information of the first electronic device may include:
通过所述第一摄像头拍摄所述现实场景得到第一图像,通过所述第二摄像头拍摄所述现实场景得到第二图像,以及通过所述惯性测量单元测量得到惯性数据;Shooting the real scene with the first camera to obtain a first image, shooting the real scene with the second camera to obtain a second image, and measuring the inertial measurement unit to obtain inertial data;
根据所述第一图像、所述第二图像以及所述惯性数据对所述第一电子设备进行多自由度跟踪,得到所述姿态信息。The attitude information is obtained by performing multi-degree-of-freedom tracking on the first electronic device according to the first image, the second image and the inertial data.
在一种实施方式中,所述第一电子设备还包括摄像模组,所述对所述第一电子设备当前所处的现实场景进行三维重建,得到虚拟现实场景,可以包括:In one embodiment, the first electronic device further includes a camera module, and the three-dimensional reconstruction of the real scene where the first electronic device is currently located to obtain the virtual reality scene may include:
通过所述摄像模组获取所述现实场景的深度图像和彩色图像;Obtain the depth image and the color image of the real scene through the camera module;
根据所述深度图像以及所述彩色图像对所述现实场景进行三维重建,得到所述虚拟现实场景。Three-dimensional reconstruction is performed on the real scene according to the depth image and the color image to obtain the virtual reality scene.
在一种实施方式中,所述从第二电子设备获取导航信息之前,可以包括:In an implementation manner, before acquiring the navigation information from the second electronic device, the method may include:
识别所述第一电子设备与所述第二电子设备是否处于相同位置;identifying whether the first electronic device and the second electronic device are in the same location;
在所述第一电子设备与所述第二电子设备处于相同位置时,从所述第二电子设备获取所述导航信息。The navigation information is acquired from the second electronic device when the first electronic device and the second electronic device are in the same location.
在一种实施方式中,所述识别所述第一电子设备与所述第二电子设备是否处于相同位置,可以包括:In an implementation manner, the identifying whether the first electronic device and the second electronic device are in the same location may include:
获取所述第一电子设备与所述第二电子设备之间的通信距离;obtaining the communication distance between the first electronic device and the second electronic device;
在所述通信距离小于预设通信距离时,判定所述第一电子设备与所述第二电子设备处于相同位置。When the communication distance is less than a preset communication distance, it is determined that the first electronic device and the second electronic device are in the same position.
在一种实施方式中,所述获取所述第一电子设备与所述第二电子设备之间的通信距离之后,可以包括:In an implementation manner, after acquiring the communication distance between the first electronic device and the second electronic device, the method may include:
在所述通信距离大于或等于所述预设通信距离时,获取所述第二电子设备当前位置信息;When the communication distance is greater than or equal to the preset communication distance, acquiring current location information of the second electronic device;
根据所述当前位置信息生成位置提示信息,并展示所述位置提示信息。Generate location prompt information according to the current location information, and display the location prompt information.
在一种实施方式中,导航方法还可以包括:In one embodiment, the navigation method may further include:
在接收到第三电子设备传输的导航请求时,解析出所述导航请求携带的所述第三电子设备的朝向信息;When receiving the navigation request transmitted by the third electronic device, parse out the orientation information of the third electronic device carried in the navigation request;
根据所述第三电子设备的朝向信息生成对应所述第三电子设备的导航信息;generating navigation information corresponding to the third electronic device according to the orientation information of the third electronic device;
将对应所述第三电子设备的导航信息发送至所述第三电子设备。Sending navigation information corresponding to the third electronic device to the third electronic device.
在一种实施方式中,所述从第二电子设备获取导航信息,可以包括:In an implementation manner, the acquiring navigation information from the second electronic device may include:
在所述第一电子设备的剩余电量小于预设电量时,从所述第二电子设备获取所述导航信息;或者,When the remaining power of the first electronic device is less than a preset power, acquire the navigation information from the second electronic device; or,
在所述第一电子设备的导航精度小于所述第二电子设备的导航精度时,从所述第二电子设备获取导航信息。When the navigation accuracy of the first electronic device is smaller than the navigation accuracy of the second electronic device, the navigation information is acquired from the second electronic device.
请参照图1,本申请实施例提供一种导航系统,该导航系统包括第一电子设备10和第二电子设备 20。应当说明的是,本申请实施例对第一电子设备10和第二电子设备20的实体展现形式不做具体限制,比如,第一电子设备10的实体展现形式可以为图1示出的智能眼镜,第二电子设备20的实体展现形式可以为图1示出的智能手机,此外,第一电子设备10的实体展现形式还可以为智能头盔等穿戴式电子设备,第二电子设备20的实体展现形式还可以为平板电脑等移动电子设备(可以是非穿戴式移动电子设备,也可以是穿戴式移动电子设备)。Referring to FIG. 1 , an embodiment of the present application provides a navigation system, where the navigation system includes a first electronic device 10 and a second electronic device 20. It should be noted that the embodiments of the present application do not specifically limit the entity presentation forms of the first electronic device 10 and the second electronic device 20. For example, the entity presentation form of the first electronic device 10 may be the smart glasses shown in FIG. 1 . , the entity presentation form of the second electronic device 20 can be the smartphone shown in FIG. 1 , in addition, the entity presentation form of the first electronic device 10 can also be a wearable electronic device such as a smart helmet, and the entity presentation form of the second electronic device 20 The form can also be a mobile electronic device such as a tablet computer (it can be a non-wearable mobile electronic device or a wearable mobile electronic device).
其中,第一电子设备10和第二电子设备20通过二者之间的通信连接进行信息交互,该通信连接可以为有线通信连接,也可以为无线通信连接。比如,第一电子设备10通过其与第二电子设备20之间的通信连接,从第二电子设备20处获取到导向目的地的导航信息,并将该导航信息展示给用户。The first electronic device 10 and the second electronic device 20 perform information exchange through a communication connection therebetween, and the communication connection may be a wired communication connection or a wireless communication connection. For example, the first electronic device 10 obtains navigation information leading to the destination from the second electronic device 20 through the communication connection between the first electronic device 10 and the second electronic device 20, and displays the navigation information to the user.
应当说明的是,上述图1示出的仅是实现本申请实施例的一个系统架构实例,本申请实施例并不限于上述图1所示的系统架构。以下以图1示出的系统架构为例,提出本申请的各个实施例。It should be noted that the foregoing FIG. 1 shows only an example of a system architecture for implementing the embodiments of the present application, and the embodiments of the present application are not limited to the system architecture shown in the foregoing FIG. 1 . Various embodiments of the present application are presented below by taking the system architecture shown in FIG. 1 as an example.
请参照图2,图2为本申请实施例提供的导航方法的流程示意图。该导航方法应用于图1所示导航系统中的第一电子设备,如图2所示,本申请实施例提供的导航方法的流程可以如下:Please refer to FIG. 2 , which is a schematic flowchart of a navigation method provided by an embodiment of the present application. The navigation method is applied to the first electronic device in the navigation system shown in FIG. 1 . As shown in FIG. 2 , the process of the navigation method provided by the embodiment of the present application may be as follows:
在101中,从第二电子设备获取导航信息,导航信息由第二电子设备根据其自身朝向信息生成。In 101, navigation information is acquired from a second electronic device, where the navigation information is generated by the second electronic device according to its own orientation information.
应当说明的是,第一电子设备与第二电子设备预先建立有通信连接,该通信连接可以是有线通信连接,也可以是无线通信连接。比如,当用户使用数据线将第一电子设备与第二电子设备链接时,第一电子设备将通过二者之间的数据线与第二电子设备建立有线通信连接。又比如,用户还可以操作第一电子设备与第二电子设备进行蓝牙配对,这样将使得第一电子设备与第二电子设备建立蓝牙无线通信连接。It should be noted that a communication connection is established between the first electronic device and the second electronic device in advance, and the communication connection may be a wired communication connection or a wireless communication connection. For example, when a user uses a data cable to link the first electronic device and the second electronic device, the first electronic device will establish a wired communication connection with the second electronic device through the data cable between the two. For another example, the user may also operate the first electronic device and the second electronic device to perform Bluetooth pairing, which will enable the first electronic device and the second electronic device to establish a Bluetooth wireless communication connection.
本申请实施例中,在触发进行导航时,第一电子设备通过其与第二电子设备之间的通信连接,从第二电子设备处获取到导向目的地的导航信息。其中,第一电子设备根据输入的导航指令触发进行导航,本申请实施例中对于导航指令的输入方式不做具体限制,包括但不限于触摸方式、眼动方式、语音方式等。In this embodiment of the present application, when the navigation is triggered, the first electronic device obtains the navigation information leading to the destination from the second electronic device through the communication connection between the first electronic device and the second electronic device. Wherein, the first electronic device is triggered to perform navigation according to the input navigation instruction, and the input method of the navigation instruction is not specifically limited in the embodiments of the present application, including but not limited to a touch method, an eye movement method, a voice method, and the like.
比如,请参照图3,第一电子设备提供有导航界面,该导航界面包括输入框形式的输入控件和确认控件,该确认控件包括提示信息“开始导航”,此外,导航界面还包括用于提示用户输入目的地的提示信息“请输入目的地”。如图3所示,用户通过眼动方式向输入控件输入了目的地“XX商场”并触发确认控件时,将产生指示第一电子设备导航至目的地“XX商场”的导航指令。For example, referring to FIG. 3, the first electronic device is provided with a navigation interface, the navigation interface includes an input control in the form of an input box and a confirmation control, the confirmation control includes a prompt message "start navigation", in addition, the navigation interface also includes a prompt for prompting The prompt message "Please input the destination" for the user to input the destination. As shown in FIG. 3 , when the user inputs the destination "XX mall" into the input control through eye movement and triggers the confirmation control, a navigation instruction instructing the first electronic device to navigate to the destination "XX mall" will be generated.
又比如,用户可以说出“我要去XX商场”,从而向第一电子设备输入语音形式的导航至目的地“XX商场”的导航指令。For another example, the user can say "I'm going to XX mall", so as to input a navigation instruction to the destination "XX mall" in the form of voice into the first electronic device.
一方面,第一电子设备将根据该导航指令触发进行导航,此时,第一电子设备将按照与第二电子设备预先约定的报文格式,生成导航请求发送至第二电子设备,该导航请求用于指示第二电子设备返回导 向前述目的地的导航信息。另一方面,第二电子设备在接收到来自于第一电子设备的导航请求时,获取到自身所处的当前位置以及自身朝向信息,并根据前述当前位置以及前述目的地,采用预设的导航算法计算出由当前位置导向前述目的地的导航路径,以及对应该导航路径的剩余距离,以及根据自身朝向信息得到行进方向,相应将前述行进方向、前述当前位置、前述剩余距离和前述导航路径打包为导航信息返回至第一电子设备。相应的,第一电子设备接收第二电子设备根据前述导航请求所返回的导航信息。On the one hand, the first electronic device will navigate according to the navigation instruction. At this time, the first electronic device will generate a navigation request according to the message format pre-agreed with the second electronic device and send it to the second electronic device. The navigation request Navigation information for instructing the second electronic device to return to the aforementioned destination. On the other hand, when receiving the navigation request from the first electronic device, the second electronic device obtains its current position and its own orientation information, and adopts the preset navigation according to the aforesaid current position and the aforesaid destination. The algorithm calculates the navigation path guided by the current position to the aforementioned destination, and the remaining distance corresponding to the navigation path, and obtains the travel direction according to the self-orientation information, and packs the aforementioned travel direction, the foregoing current position, the foregoing remaining distance and the foregoing navigation path accordingly. Return to the first electronic device for navigation information. Correspondingly, the first electronic device receives the navigation information returned by the second electronic device according to the aforementioned navigation request.
在102中,获取第一电子设备的当前朝向信息,并根据当前朝向信息对导前述航信息进行修正,得到修正导航信息。In 102, the current orientation information of the first electronic device is acquired, and the navigation information before navigation is corrected according to the current orientation information to obtain corrected navigation information.
比如,第一电子设备可以通过配置的地磁传感器获取到自身的当前朝向信息。For example, the first electronic device may acquire current orientation information of itself through the configured geomagnetic sensor.
在获取到自身的当前朝向信息之后,第一电子设备即根据该当前朝向信息对前述导航信息进行修正,得到与前述当前朝向信息所匹配的修正导航信息。After acquiring its own current orientation information, the first electronic device corrects the aforementioned navigation information according to the current orientation information, and obtains revised navigation information matching the aforementioned current orientation information.
其中,在根据前述当前朝向信息对前述导航信息进行修正时,第一电子设备可以将前述当前朝向信息所描述的方向作为修正行进方向,相应将导航信息所包括的行进方向替换为修正行进方向,由此实现对前述导航信息的修正。Wherein, when revising the aforementioned navigation information according to the aforementioned current orientation information, the first electronic device may take the direction described by the aforementioned current orientation information as the corrected travel direction, and correspondingly replace the travel direction included in the navigation information with the corrected travel direction, The correction of the aforementioned navigation information is thereby achieved.
比如,请参照图4,当用户携带第一电子设备(图中未示出)和第二电子设备(图中未示出)位于图示十字路口时,由于其中第二电子设备朝向东北方向,相应第二电子设备生成并返回的导航信息中的行进方向也为东北方向,但是第一电子设备的朝向为东,若第一电子设备不对第二电子设备返回的导航信息进行修正,导航信息中的行进方向将与第一电子设备实际的朝向不同,对用户造成错误引导。为此,第一电子设备将自身的当前朝向作为修正行进方向,并将前述导航信息中的行进方向替换为修正行进方向,完成对导航信息的修正。For example, referring to FIG. 4 , when the user carries the first electronic device (not shown in the figure) and the second electronic device (not shown in the figure) at the intersection shown in the figure, since the second electronic device faces the northeast direction, The travel direction in the navigation information generated and returned by the corresponding second electronic device is also the northeast direction, but the orientation of the first electronic device is east. If the first electronic device does not correct the navigation information returned by the second electronic device, the navigation information The traveling direction of the first electronic device will be different from the actual orientation of the first electronic device, causing misguided users. To this end, the first electronic device uses its current orientation as the corrected travel direction, and replaces the travel direction in the aforementioned navigation information with the corrected travel direction to complete the correction of the navigation information.
在103中,展示修正导航信息。At 103, the revised navigation information is presented.
在完成对前述导航信息的修正,相应得到修正导航信息之后,第一电子设备按照配置的导航信息展示策略对修正导航信息进行展示。After completing the correction of the aforementioned navigation information and correspondingly obtaining the corrected navigation information, the first electronic device displays the corrected navigation information according to the configured navigation information display strategy.
应当说明的是,本申请实施例中对于前述导航信息展示策略的配置不做具体限制,可由本领域普通技术人员根据实际需要进行配置,包括但不限于基于地图的二维展示方式、基于增强现实的二维展示方式以及基于增强现实的三维展示方式等。It should be noted that the configuration of the aforementioned navigation information display strategy is not specifically limited in the embodiments of the present application, and can be configured by those of ordinary skill in the art according to actual needs, including but not limited to map-based two-dimensional display, augmented reality-based The two-dimensional display method and the three-dimensional display method based on augmented reality, etc.
由上可知,本申请通过第一电子设备从第二电子设备获取导航信息,该导航信息由第二电子设备根据其自身朝向信息生成;以及获取第一电子设备的当前朝向信息,并根据该当前朝向信息对获取到的导航信息进行修正,得到与第一电子设备的当前朝向信息所匹配的修正导航信息;以及展示前述修正导航信息。由此,通过对其它电子设备的导航信息进行修正,使得修正后的导航信息与自身所匹配,再将修 正后的导航信息用于导航,能够提高电子设备进行导航的准确度。As can be seen from the above, the present application obtains navigation information from the second electronic device through the first electronic device, the navigation information is generated by the second electronic device according to its own orientation information; and obtains the current orientation information of the first electronic device, and according to the current orientation information. The orientation information corrects the acquired navigation information to obtain revised navigation information matched with the current orientation information of the first electronic device; and displays the aforementioned revised navigation information. Therefore, by correcting the navigation information of other electronic devices so that the corrected navigation information matches itself, and then using the corrected navigation information for navigation, the accuracy of the electronic device's navigation can be improved.
可选地,在一实施例中,展示修正导航信息,包括:Optionally, in one embodiment, displaying revised navigation information includes:
(1)对第一电子设备当前所处的现实场景进行三维重建,得到虚拟现实场景;(1) 3D reconstruction of the real scene where the first electronic device is currently located to obtain a virtual reality scene;
(2)根据虚拟现实场景和修正导航信息,生成增强现实的目标导航信息;(2) Generate augmented reality target navigation information according to the virtual reality scene and the revised navigation information;
(3)获取第一电子设备当前的姿态信息;(3) obtaining the current attitude information of the first electronic device;
(4)根据姿态信息和当前朝向信息展示目标导航信息,使得目标导航信息与现实场景匹配。(4) Display the target navigation information according to the attitude information and the current orientation information, so that the target navigation information matches the real scene.
本申请实施例中提供一种基于增强现实的三维展示方式。The embodiments of the present application provide a three-dimensional display method based on augmented reality.
增强现实也被称为扩增现实,是一种将虚拟信息与真实世界巧妙融合的技术,广泛运用了多媒体、三维建模、实时跟踪及注册、智能交互、传感等多种技术手段,将计算机生成的文字、图像、三维模型、音乐、视频等虚拟信息模拟仿真后,应用到真实世界中,两种信息互为补充,从而实现对真实世界的“增强”。本申请实施例中,第一电子设备可以为具备增强现实功能的电子设备,比如具备增强现实功能的智能手机,具备增强现实功能的智能眼镜,具备增强现实功能的智能头盔等。Augmented reality, also known as augmented reality, is a technology that skillfully integrates virtual information with the real world. Computer-generated text, images, 3D models, music, videos and other virtual information are simulated and applied to the real world, and the two kinds of information complement each other, thereby realizing the "enhancement" of the real world. In this embodiment of the present application, the first electronic device may be an electronic device with an augmented reality function, such as a smart phone with an augmented reality function, smart glasses with an augmented reality function, a smart helmet with an augmented reality function, and the like.
相应的,在展示修正导航信息时,第一电子设备按照配置的三维重建策略,对齐当前所处的现实场景进行三维重建,得到与现实场景对应的虚拟现实场景。其中,对现实场景进行三维重建可以看做是对真实存在的现实场景进行数字化的过程,也即是第一电子设备认知其所在现实场景的过程。应当说明的是,本申请实施例中对于三维重建策略的配置不做具体限制,可由本领域普通技术人员根据实际需要配置合适的三维重建策略。比如,可以根据第一电子设备的处理能力选取重建精度和重建效率达到一定平衡的三维重建策略。Correspondingly, when displaying the revised navigation information, the first electronic device performs 3D reconstruction according to the configured 3D reconstruction strategy by aligning the current real scene to obtain a virtual reality scene corresponding to the real scene. The three-dimensional reconstruction of the real scene can be regarded as a process of digitizing a real real scene, that is, the process of the first electronic device recognizing the real scene in which it is located. It should be noted that the configuration of the 3D reconstruction strategy is not specifically limited in the embodiments of the present application, and a person of ordinary skill in the art can configure an appropriate 3D reconstruction strategy according to actual needs. For example, a three-dimensional reconstruction strategy that achieves a certain balance between reconstruction accuracy and reconstruction efficiency may be selected according to the processing capability of the first electronic device.
在完成对现实场景的三维重建,并相应得到与现实场景对应的虚拟现实场景之后,第一电子设备进一步根据该虚拟现实场景以及修正导航信息,生成增强现实的目标导航信息。比如,以修正导航信息中的导航路径为例,原始的导航路径是二维空间内的,第一电子设备将根据三维重建得到虚拟现实场景,将二维空间内的原生导航路径转换为与现实场景匹配的三维空间内的目标导航路径。After completing the three-dimensional reconstruction of the real scene and correspondingly obtaining a virtual reality scene corresponding to the real scene, the first electronic device further generates augmented reality target navigation information according to the virtual reality scene and the revised navigation information. For example, taking the navigation path in the revised navigation information as an example, the original navigation path is in the two-dimensional space, and the first electronic device will obtain the virtual reality scene according to the three-dimensional reconstruction, and convert the original navigation path in the two-dimensional space to the real one. The target navigation path in 3D space for scene matching.
此外,第一电子设备还获取自身当前的姿态信息,比如,第一电子设备可以通过多自由度跟踪的方式获取到自身当前的姿态信息。In addition, the first electronic device also obtains its own current posture information. For example, the first electronic device can obtain its own current posture information by means of multi-degree-of-freedom tracking.
在生成增强现实的目标导航信息,并获取到当前的姿态信息之后,第一电子设备即根据前述姿态信息以及前述当前朝向信息展示目标导航信息,这样,展示的目标导航信息将与现实场景匹配。以目标导航信息中的目标导航路径为例,对于用户而言,用户所看到的目标导航路径将与现实场景中的道路匹配。After generating the augmented reality target navigation information and acquiring the current posture information, the first electronic device displays the target navigation information according to the foregoing posture information and the foregoing current orientation information, so that the displayed target navigation information will match the real scene. Taking the target navigation path in the target navigation information as an example, for the user, the target navigation path seen by the user will match the road in the real scene.
比如,请参照图5,以第一电子设备的实体展现形式为智能眼镜为例。第一电子设备包括显示组件和衍射波导,在生成增强现实的目标导航信息,并获取到当前的姿态信息之后,第一电子设备根据自身 当前的姿态信息以及当前朝向信息,通过显示组件显示增强现实的目标导航信息,其中目标导航信息包括导航路径、修正行进方向、剩余距离、目的地以及当前位置。如图5所示,显示组件显示的目标导航信息将通过衍射波导,连同现实场景一起投射进用户眼球,被用户所看到。请继续参照图6,示出了用户实际看到的图像,该图像为现实场景和目标导航信息融合图像,可以看出,对于用户而言,第一电子设备所显示的目标导航信息与现实场景所匹配。其中,示出了当前位置“XX山”,与现实场景中道路匹配的目标导航路径,携带剩余距离的提示信息“继续爬行500米(即剩余距离)到达目的地”,以及四角星标识的目的地,修正行进方向。本领域普通技术人员可以理解的是,其中修正行进方向即为第一电子设备的当前朝向,也即是用户的真实朝向,由此,即实现了以现实场景为基础的增强现实的三维导航。For example, please refer to FIG. 5 , taking the physical presentation form of the first electronic device as smart glasses as an example. The first electronic device includes a display component and a diffractive waveguide. After generating the target navigation information of the augmented reality and acquiring the current attitude information, the first electronic device displays the augmented reality through the display component according to its own current attitude information and current orientation information. target navigation information, wherein the target navigation information includes the navigation path, the corrected travel direction, the remaining distance, the destination and the current position. As shown in FIG. 5 , the target navigation information displayed by the display component will be projected into the user's eyeball together with the real scene through the diffractive waveguide, and will be seen by the user. Please continue to refer to FIG. 6 , which shows the image actually seen by the user, which is a fusion image of the real scene and the target navigation information. It can be seen that, for the user, the target navigation information displayed by the first electronic device is the same as the real scene. matched. Among them, it shows the current position "XX Mountain", the target navigation path matching the road in the real scene, the prompt information carrying the remaining distance "continue to crawl 500 meters (ie remaining distance) to the destination", and the purpose of the four-pointed star logo ground, correct the direction of travel. Those of ordinary skill in the art can understand that the corrected travel direction is the current orientation of the first electronic device, that is, the real orientation of the user, thereby realizing the augmented reality three-dimensional navigation based on the real scene.
可选地,在一实施例中,第一电子设备还包括第一摄像头、第二摄像头以及惯性测量单元,获取第一电子设备当前的姿态信息,包括:Optionally, in an embodiment, the first electronic device further includes a first camera, a second camera, and an inertial measurement unit, and obtains current attitude information of the first electronic device, including:
(1)通过第一摄像头拍摄现实场景得到第一图像,通过第二摄像头拍摄现实场景得到第二图像,以及通过惯性测量单元测量得到惯性数据;(1) photographing the real scene with the first camera to obtain the first image, photographing the actual scene with the second camera to obtain the second image, and measuring the inertial data by the inertial measurement unit;
(2)根据第一图像、第二图像以及惯性数据对第一电子设备进行多自由度跟踪,得到当前的姿态信息。(2) Perform multi-degree-of-freedom tracking on the first electronic device according to the first image, the second image and the inertial data to obtain current attitude information.
本申请实施例进一步提供一可选地获取第一电子设备当前的姿态信息的获取方式。The embodiment of the present application further provides an acquisition method for optionally acquiring the current posture information of the first electronic device.
其中,第一电子设备还包括第一摄像头、第二摄像头以及惯性测量单元。比如,请参照图7,示出了一种可选地第一摄像头、第二摄像头以及惯性测量单元的设置方式。应当说明的是,第一摄像头、第二摄像头以及惯性测量单元并不限于图7示出的设置方式。Wherein, the first electronic device further includes a first camera, a second camera and an inertial measurement unit. For example, please refer to FIG. 7 , which shows an optional arrangement of the first camera, the second camera and the inertial measurement unit. It should be noted that the first camera, the second camera and the inertial measurement unit are not limited to the arrangement shown in FIG. 7 .
相应的,第一电子设备在获取自身当前的姿态信息时,可以通过第一摄像头拍摄现实场景,将第一摄像头所拍摄的图像记为第一图像,以及同步通过第二摄像头拍摄现实场景,将第二摄像头所拍摄的图像记为第二图像,此外,还通过惯性测量单元测量得到惯性数据。Correspondingly, when the first electronic device acquires its current posture information, it can shoot the real scene through the first camera, record the image captured by the first camera as the first image, and simultaneously shoot the real scene through the second camera, and record the real scene through the second camera. The image captured by the second camera is recorded as the second image. In addition, inertial data is also obtained by measuring the inertial measurement unit.
之后,第一电子设备即利用配置的多自由度跟踪算法,根据前述第一图像、前述第二图像以及前述惯性数据,计算得到当前的姿态信息。应当说明的是,本申请实施例中对于采用何种多自由度跟踪算法不做具体限制,可由本领域普通技术人员根据实际需要进行选择。比如,本申请实施例中采用六自由度跟踪算法,相应得到第一电子设备的六自由度姿态信息,包括纵荡信息、垂荡信息、横荡信息、纵摇信息、横摇信息、艏摇信息。据此,结合虚拟现实场景即可得到用户穿戴智能眼镜在现实场景中的视野和角度,从而实现目标导航信息与现实场景的匹配显示。After that, the first electronic device uses the configured multi-degree-of-freedom tracking algorithm to calculate and obtain the current attitude information according to the first image, the second image and the inertial data. It should be noted that, in the embodiments of the present application, there is no specific limitation on which multi-degree-of-freedom tracking algorithm is adopted, and those of ordinary skill in the art can select according to actual needs. For example, a six-degree-of-freedom tracking algorithm is used in the embodiment of the present application, and correspondingly, the six-degree-of-freedom attitude information of the first electronic device is obtained, including pitch information, heave information, sway information, pitch information, roll information, and yaw information information. Accordingly, combined with the virtual reality scene, the visual field and angle of the user wearing the smart glasses in the real scene can be obtained, so as to realize the matching display of the target navigation information and the real scene.
可选地,在一实施例中,第一电子设备还包括摄像模组,对第一电子设备当前所处的现实场景进行三维重建,得到虚拟现实场景,包括:Optionally, in an embodiment, the first electronic device further includes a camera module, which performs three-dimensional reconstruction on the real scene where the first electronic device is currently located to obtain a virtual reality scene, including:
(1)通过摄像模组获取现实场景的深度图像和彩色图像;(1) Obtain the depth image and color image of the real scene through the camera module;
(2)根据深度图像以及彩色图像对现实场景进行三维重建,得到虚拟现实场景。(2) 3D reconstruction of the real scene according to the depth image and the color image to obtain a virtual reality scene.
本申请实施例中,第一电子设备还包括摄像模组。比如,该摄像模组包括深度摄像头和RGB摄像头,请参照图8,示出了一种可选地深度摄像头和RGB摄像头的设置方式。应当说明的是,深度摄像头和RGB摄像头并不限于图8示出的设置方式。In the embodiment of the present application, the first electronic device further includes a camera module. For example, the camera module includes a depth camera and an RGB camera. Please refer to FIG. 8 , which shows an optional setting method of the depth camera and the RGB camera. It should be noted that the depth camera and the RGB camera are not limited to the arrangement shown in FIG. 8 .
其中,本申请实施例中对于深度摄像头的类型不做具体限制,可由本领域普通技术人员根据实际需要进行选取。比如,本申请实施例中选取的深度摄像头为飞行时间摄像头。飞行时间摄像头利用光的反射特性,通过向物体发射调制后的光脉冲信号,并接收从物体反射回的光脉冲信号,利用光脉冲信号往返的时间(或相位差)来计算物体的深度(或者说,物体到飞行时间摄像头的距离)。相应的,在本申请实施例中,电子设备可以在飞行时间摄像头对准现实场景时,通过该飞行时间摄像头获取到现实场景的深度图像,该深度图像包括现实场景不同位置处的深度值(深度值反映现实场景某一位置到飞行时间摄像头的距离,其值越小,表示距离飞行时间摄像头越近,而值越大,表示距离飞行时间摄像头越远)。The type of the depth camera is not specifically limited in the embodiments of the present application, and can be selected by those of ordinary skill in the art according to actual needs. For example, the depth camera selected in the embodiment of the present application is a time-of-flight camera. The time-of-flight camera uses the reflection characteristics of light to calculate the depth (or say, the distance of the object to the time-of-flight camera). Correspondingly, in this embodiment of the present application, when the time-of-flight camera is aimed at the real scene, the electronic device can obtain a depth image of the real scene through the time-of-flight camera, and the depth image includes the depth values (depth values) at different positions in the real scene. The value reflects the distance from a location in the real scene to the time-of-flight camera, the smaller the value, the closer to the time-of-flight camera, and the larger the value, the farther away from the time-of-flight camera).
RGB摄像头接收物体反射的光线(或者发出的光线),将光线转换为携带物体颜色特征的彩色图像。相应的,在本申请实施例中,电子设备可以在RGB摄像头对准现实场景时,通过该RGB摄像头获取到的现实场景的彩色图像,该彩色图像包括现实场景不同位置处的颜色数据。An RGB camera receives light reflected (or emitted) by an object and converts the light into a color image that carries the color characteristics of the object. Correspondingly, in this embodiment of the present application, the electronic device may obtain a color image of the real scene through the RGB camera when the RGB camera is aimed at the real scene, and the color image includes color data at different positions in the real scene.
需要说明的是,获取到的深度图像包括了现实场景的深度值,但不包括现实场景的颜色数据,而获取到的彩色图像包括了现实场景的颜色数据,但不包括现实场景的深度值,为了确保获取到现实场景深度图像和彩色图像的一致性,电子设备可以同步通过飞行时间摄像头和RGB摄像头获取到的现实场景的深度图像和彩色图像。It should be noted that the acquired depth image includes the depth value of the real scene, but does not include the color data of the real scene, and the acquired color image includes the color data of the real scene, but does not include the depth value of the real scene, In order to ensure the consistency of the acquired depth image and color image of the real scene, the electronic device can synchronize the depth image and color image of the real scene acquired by the time-of-flight camera and the RGB camera.
在获取到现实场景的深度图像以及彩色图像之后,第一电子设备按照配置的三维重建算法,根据前述深度图像以及彩色图像对现实场景进行三维重建,相应得到对应现实场景的虚拟现实场景。应当说明的是。本申请实施例中对于采用何种三维重建算法不做具体限制,可由本领域普通技术人员根据实际需要进行选取。After acquiring the depth image and color image of the real scene, the first electronic device performs three-dimensional reconstruction of the real scene according to the aforementioned depth image and color image according to the configured three-dimensional reconstruction algorithm, and correspondingly obtains a virtual reality scene corresponding to the real scene. It should be noted that. There is no specific limitation on which three-dimensional reconstruction algorithm is adopted in the embodiments of the present application, and can be selected by those of ordinary skill in the art according to actual needs.
可选地,在一实施例中,从第二电子设备获取导航信息之前,还包括:Optionally, in an embodiment, before acquiring the navigation information from the second electronic device, the method further includes:
(1)识别第一电子设备与第二电子设备是否处于相同位置;(1) Identify whether the first electronic device and the second electronic device are in the same position;
(2)在第一电子设备与第二电子设备处于相同位置时,从第二电子设备获取导航信息。(2) When the first electronic device and the second electronic device are in the same position, the navigation information is acquired from the second electronic device.
根据以上相关描述,本领域普通技术人员可以理解的是,第一电子设备自身可以不具备导航能力,而是从第二电子设备出获取到导航信息实现导航。相应的,若第一电子设备与第二电子设备处于不同的位置,那么第二电子设备所生成的导航信息将不适用于第一电子设备。According to the above description, those of ordinary skill in the art can understand that the first electronic device itself may not have the navigation capability, but the navigation information obtained from the second electronic device implements navigation. Correspondingly, if the first electronic device and the second electronic device are in different locations, the navigation information generated by the second electronic device will not be applicable to the first electronic device.
因此,本申请实施例中,第一电子设备在从第二电子设备获取导航信息之前那,首先识别第一电子设备与第二电子设备是否出处于相同位置,在识别到第一电子设备与第二电子设备处于相同位置时,再从第二电子设备出获取导航信息,并利用获取到的导航信息进行导航。其中,利用第二电子设备的导航信息进行导航的方式可以参照以上实施例中的相关描述,此处不再赘述。Therefore, in this embodiment of the present application, before acquiring the navigation information from the second electronic device, the first electronic device first identifies whether the first electronic device and the second electronic device are in the same location, and after identifying the first electronic device and the second electronic device When the two electronic devices are in the same position, the navigation information is obtained from the second electronic device, and the navigation information is used for navigation. The manner of using the navigation information of the second electronic device to perform navigation may refer to the relevant descriptions in the above embodiments, which will not be repeated here.
可选地,在一实施例中,识别第一电子设备与第二电子设备是否处于相同位置,包括:Optionally, in an embodiment, identifying whether the first electronic device and the second electronic device are in the same position includes:
(1)获取第一电子设备与第二电子设备之间的通信距离;(1) Obtain the communication distance between the first electronic device and the second electronic device;
(2)在通信距离小于预设通信距离时,判定第一电子设备与第二电子设备处于相同位置。(2) When the communication distance is less than the preset communication distance, it is determined that the first electronic device and the second electronic device are in the same position.
如上所述,第一电子设备与第二电子设备建立有通信连接,则二者之间的通信距离能够反映二者的位置关系,因此,可以利用二者之间的通信距离来识别第一电子设备和第二电子设备是否处于相同位置。相应的,本申请实施例中预先配置有用于判定第一电子设备和第二电子设备是否处于相同位置的预设通信距离,对于该预设通信距离的取值,可由本领域普通技术人员根据实际需要取经验值,本申请实施例对此不做具体限制,比如,本申请实施例中配置预设通信距离为2米。As mentioned above, if a communication connection is established between the first electronic device and the second electronic device, the communication distance between the two can reflect the positional relationship between the two. Therefore, the communication distance between the two can be used to identify the first electronic device. Whether the device and the second electronic device are in the same location. Correspondingly, the embodiment of the present application is preconfigured with a preset communication distance for determining whether the first electronic device and the second electronic device are in the same position, and the value of the preset communication distance can be determined by a person of ordinary skill in the art according to the actual situation. An empirical value needs to be taken, which is not specifically limited in the embodiment of the present application. For example, the preset communication distance is configured to be 2 meters in the embodiment of the present application.
在识别第一电子设备与第二电子设备是否处于相同位置时,第一电子设备首先获取到其与第二电子设备之间的通信距离,然后判断该通信距离是否小于预设通信距离,若前述通信距离小于预设通信距离,则判定第一电子设备与第二电子设备处于相同位置,否则判定第一电子设备和第二电子设备处于不同位置。When identifying whether the first electronic device and the second electronic device are in the same position, the first electronic device first obtains the communication distance between it and the second electronic device, and then determines whether the communication distance is less than the preset communication distance, if the aforementioned If the communication distance is less than the preset communication distance, it is determined that the first electronic device and the second electronic device are in the same location, otherwise it is determined that the first electronic device and the second electronic device are in different locations.
示例性的,第一电子设备按照与第二电子设备预先约定的报文格式,构建测距请求,并将构建的该测距请求发送至第二电子设备,该测距请求用于指示第二电子设备返回测距信息。Exemplarily, the first electronic device constructs a ranging request according to a message format pre-agreed with the second electronic device, and sends the constructed ranging request to the second electronic device, where the ranging request is used to indicate the second electronic device. The electronic device returns ranging information.
其中,测距信息可以为空白帧,该空白帧携带有时间戳,该时间戳为第二电子设备发送该空白帧的发送时刻。相应的,第一电子设备在接收到来自第二电子设备的前述空白帧之后,解析出前述空白帧所携带的时间戳,得到前述空白帧的发送时刻,由于第一电子设备与第二电子设备的数据交互在物理层面以电磁波(或电流)的形式实现,且电磁波和电流的传播速度已知,均近似为光速。因此,第一电子设备可以根据前述发送时刻,以及接收到前述空白帧的接收时刻,结合光速计算得到当前与第二电子设备之间的通信距离,如下公式:The ranging information may be a blank frame, and the blank frame carries a time stamp, and the time stamp is the sending moment when the second electronic device sends the blank frame. Correspondingly, after receiving the blank frame from the second electronic device, the first electronic device parses the time stamp carried by the blank frame to obtain the sending time of the blank frame. The data interaction is realized in the form of electromagnetic waves (or currents) at the physical level, and the propagation speeds of electromagnetic waves and currents are known, and they are both approximately the speed of light. Therefore, the first electronic device can calculate the current communication distance with the second electronic device according to the aforementioned sending time and the receiving time of receiving the aforementioned blank frame, combined with the speed of light, as follows:
L=(Tr-Tt)*C;L=(Tr-Tt)*C;
其中,L表示第一电子设备和第二电子设备之间的通信距离,Tr表示第一电子设备接收到前述空白帧(即测距信息)的接收时刻,Tt表示第二电子设备发送前述空白帧的发送时刻,C表示光速。Wherein, L represents the communication distance between the first electronic device and the second electronic device, Tr represents the reception time when the first electronic device receives the aforementioned blank frame (ie, ranging information), and Tt represents the second electronic device sends the aforementioned blank frame The sending time of , C represents the speed of light.
可选地,在一实施例中,获取第一电子设备与第二电子设备之间的通信距离之后,还包括:Optionally, in an embodiment, after acquiring the communication distance between the first electronic device and the second electronic device, the method further includes:
(1)在通信距离大于或等于预设通信距离时,获取第二电子设备当前位置信息;(1) when the communication distance is greater than or equal to the preset communication distance, obtain the current location information of the second electronic device;
(2)根据当前位置信息生成位置提示信息,并展示位置提示信息。(2) Generate location prompt information according to the current location information, and display the location prompt information.
本申请实施例中,在获取到第一电子设备与第二电子设备之间的通信距离之后,若该通信距离大于或等于预设通信距离,第一电子设备将判定其与第二电子设备处于不同位置。为避免用户遗落第二电子设备,第一电子设备还对第二电子设备进行位置提示。In this embodiment of the present application, after the communication distance between the first electronic device and the second electronic device is obtained, if the communication distance is greater than or equal to the preset communication distance, the first electronic device will determine that it is in a position with the second electronic device. different positions. In order to prevent the user from leaving the second electronic device, the first electronic device further prompts the second electronic device for a location.
其中,第一电子设备在其与第二电子设备之间的通信距离大于预设通信距离时,按照与第二电子设备预先约定的报文格式,生成定位请求发送至第二电子设备,该定位请求用于指示第二电子设备返回其自身所处的当前位置。另一方面,第二电子设备在接收到来自于第一电子设备的定位请求时,获取到自身所处的当前位置信息,并将该当前位置信息返回至第一电子设备。相应的,第一电子设备接收第二电子设备根据前述定位请求所返回的当前位置信息。Wherein, when the communication distance between the first electronic device and the second electronic device is greater than the preset communication distance, according to the message format pre-agreed with the second electronic device, a positioning request is generated and sent to the second electronic device, and the positioning request is sent to the second electronic device. The request is used to instruct the second electronic device to return to its current location. On the other hand, when the second electronic device receives the positioning request from the first electronic device, it obtains the current location information of itself, and returns the current location information to the first electronic device. Correspondingly, the first electronic device receives the current location information returned by the second electronic device according to the aforementioned positioning request.
在获取到第二电子设备的当前位置信息之后,第一电子设备进一步根据该当前位置信息生成位置提示信息,并按照预先配置的展示方式(包括但不限于文字方式、音频方式、视频方式等)展示生成的位置提示信息。After acquiring the current location information of the second electronic device, the first electronic device further generates location prompt information according to the current location information, and displays it according to a preconfigured display mode (including but not limited to text mode, audio mode, video mode, etc.) Displays the generated location hints.
比如,第一电子设备生成的位置提示信息由两部分组成,分别为提示信息“主人主人,你把第二电子设备落在”和第二电子设备的当前位置信息组成。For example, the location prompt information generated by the first electronic device consists of two parts, which are the prompt information "Master, you have left the second electronic device" and the current location information of the second electronic device.
可选地,在一实施例中,本申请提供的导航方法还包括:Optionally, in an embodiment, the navigation method provided by the present application further includes:
发送指示信息至第二电子设备,指示信息用于指示第二电子设备执行位置提示操作。Sending indication information to the second electronic device, where the indication information is used to instruct the second electronic device to perform a location prompting operation.
其中,本申请实施例对于第二电子设备执行位置提示操作的方式不做具体限定,可由本领域普通技术人员根据需要进行配置。The embodiments of the present application do not specifically limit the manner in which the second electronic device performs the location prompting operation, and can be configured by those of ordinary skill in the art as required.
比如,第二电子设备可以根据其当前位置信息生成第二位置提示信息,并以语音的方式输出该第二位置提示信息。其中,第二位置提示信息由两部分组成,分别为提示信息“主人主人,我在”和第二电子设备的当前位置信息组成。For example, the second electronic device may generate the second location prompt information according to its current location information, and output the second location prompt information in a voice manner. Wherein, the second location prompt information consists of two parts, which are the prompt information "Master, I am here" and the current location information of the second electronic device.
可选地,在一实施例中,本申请提供的导航方法还包括:Optionally, in an embodiment, the navigation method provided by the present application further includes:
(1)在接收到第三电子设备传输的导航请求时,解析出导航请求携带的第三电子设备的朝向信息;(1) When receiving the navigation request transmitted by the third electronic device, parse out the orientation information of the third electronic device carried in the navigation request;
(2)根据第三电子设备的朝向信息生成对应第三电子设备的导航信息;(2) generating navigation information corresponding to the third electronic device according to the orientation information of the third electronic device;
(3)将对应第三电子设备的导航信息发送至第三电子设备。(3) Sending the navigation information corresponding to the third electronic device to the third electronic device.
本申请实施例中,第一电子设备也可具备导航能力,用于向其它电子设备提供导航信息。In this embodiment of the present application, the first electronic device may also have a navigation capability for providing navigation information to other electronic devices.
其中,第一电子设备还可以与第三电子设备建立通信连接,并接收第三电子设备所传输的导航请求。Wherein, the first electronic device can also establish a communication connection with the third electronic device, and receive the navigation request transmitted by the third electronic device.
在接收到第三电子设备所传输的导航请求时,第一电子设备解析出导航请求中所携带的第三电子设备的朝向信息以及目的地。将第三电子设备的朝向信息作为自身的朝向信息,根据自身当前所处的位置 以及前述目的地生成对应于第三电子设备的导航信息。然后,将该对应第三电子设备的导航信息发送至第三电子设备,由第三电子设备进行导航。When receiving the navigation request transmitted by the third electronic device, the first electronic device parses the orientation information and destination of the third electronic device carried in the navigation request. Taking the orientation information of the third electronic device as its own orientation information, and generating navigation information corresponding to the third electronic device according to its current location and the aforementioned destination. Then, the navigation information corresponding to the third electronic device is sent to the third electronic device, and the third electronic device performs navigation.
可选地,在一实施例中,从第二电子设备获取导航信息,还包括:Optionally, in an embodiment, acquiring navigation information from the second electronic device further includes:
在第一电子设备满足预设导航条件时,从第二电子设备获取导航信息。When the first electronic device satisfies the preset navigation condition, the navigation information is acquired from the second electronic device.
本申请实施例中,当第一电子设备具备导航能力时,也可以从第二电子设备获取导航信息,相应借用第二电子设备的导航能力进行导航。In the embodiment of the present application, when the first electronic device has the navigation capability, the navigation information can also be obtained from the second electronic device, and the navigation capability of the second electronic device is used for navigation accordingly.
相应的,本申请实施例中配置有约束第一电子设备从第二电子设备获取导航信息的预设导航条件,使得第一电子设备在满足该预设导航条件时,从第二电子设备处获取导航信息,并利用获取到的导航信息进行导航。其中,利用第二电子设备的导航信息进行导航的方式可以参照以上实施例中的相关描述,此处不再赘述。Correspondingly, the embodiment of the present application is configured with a preset navigation condition that restricts the first electronic device from acquiring navigation information from the second electronic device, so that the first electronic device obtains the navigation information from the second electronic device when the preset navigation condition is satisfied. Navigation information, and use the acquired navigation information to navigate. The manner of using the navigation information of the second electronic device to perform navigation may refer to the relevant descriptions in the above embodiments, which will not be repeated here.
应当说明的是,本申请实施例中对于预设导航条件的配置不做具体限制,可由本领域技术人员根据实际需要进行配置。It should be noted that the configuration of the preset navigation conditions is not specifically limited in the embodiments of the present application, and can be configured by those skilled in the art according to actual needs.
示例性的,本申请实施例中预设导航条件被配置为:Exemplarily, the preset navigation conditions in this embodiment of the present application are configured as:
第一电子设备的剩余电量小于预设电量;或者The remaining power of the first electronic device is less than the preset power; or
第一电子设备的导航精度小于第二电子设备的导航精度;或者The navigation accuracy of the first electronic device is less than the navigation accuracy of the second electronic device; or
第一电子设备的导航功能不可用,第二电子设备的导航功能可用。The navigation function of the first electronic device is unavailable, and the navigation function of the second electronic device is available.
图9为本申请实施例提供的导航方法的另一流程示意图。以下以第一电子设备为智能眼镜,第二电子设备为智能手机对本申请实施例提供的导航方法进行说明,如图9所示,本申请实施例提供的导航方法的流程可以如下:FIG. 9 is another schematic flowchart of a navigation method provided by an embodiment of the present application. The following describes the navigation method provided by the embodiment of the present application by using the first electronic device as smart glasses and the second electronic device as a smart phone. As shown in FIG. 9 , the process of the navigation method provided by the embodiment of the present application may be as follows:
在201中,智能眼镜接收输入的导航指令,并向智能手机发送对应导航指令指示的目的地的导航请求。In 201, the smart glasses receive the input navigation instruction, and send a navigation request corresponding to the destination indicated by the navigation instruction to the smart phone.
应当说明的是,智能眼镜与智能手机预先建立有通信连接,该通信连接可以是有线通信连接,也可以是无线通信连接。比如,当用户使用数据线将智能眼镜与智能手机链接时,智能眼镜将通过二者之间的数据线与智能手机建立有线通信连接。又比如,用户还可以操作智能眼镜与智能手机进行蓝牙配对,这样将使得智能眼镜与智能手机建立蓝牙无线通信连接。It should be noted that a communication connection is established between the smart glasses and the smart phone in advance, and the communication connection may be a wired communication connection or a wireless communication connection. For example, when a user uses a data cable to link the smart glasses with the smartphone, the smart glasses will establish a wired communication connection with the smartphone through the data cable between the two. For another example, the user can also operate the smart glasses to pair with the smart phone via Bluetooth, which will enable the smart glasses and the smart phone to establish a Bluetooth wireless communication connection.
本申请实施例中,在触发进行导航时,智能眼镜通过其与智能手机之间的通信连接,从智能手机处获取到导向目的地的导航信息。其中,智能眼镜根据输入的导航指令触发进行导航,本申请实施例中对于导航指令的输入方式不做具体限制,包括但不限于触摸方式、眼动方式、语音方式等。In the embodiment of the present application, when the navigation is triggered, the smart glasses obtain the navigation information leading to the destination from the smart phone through the communication connection between the smart glasses and the smart phone. Wherein, the smart glasses are triggered to navigate according to the input navigation instruction, and the input method of the navigation instruction is not specifically limited in the embodiments of the present application, including but not limited to a touch method, an eye movement method, a voice method, and the like.
比如,请参照图3,智能眼镜提供有导航界面,该导航界面包括输入框形式的输入控件和确认控件,该确认控件包括提示信息“开始导航”,此外,导航界面还包括用于提示用户输入目的地的提示信息“请输入目的地”。如图3所示,用户通过眼动方式向输入控件输入了目的地“XX商场”并触发确认控件时,将产生指示智能眼镜导航至目的地“XX商场”的导航指令。For example, referring to FIG. 3 , the smart glasses are provided with a navigation interface. The navigation interface includes an input control in the form of an input box and a confirmation control. The confirmation control includes a prompt message "Start Navigation". The prompt message of the destination "Please enter the destination". As shown in FIG. 3 , when the user inputs the destination "XX mall" into the input control through eye movement and triggers the confirmation control, a navigation instruction instructing the smart glasses to navigate to the destination "XX mall" will be generated.
又比如,用户可以说出“我要去XX商场”,从而向智能眼镜输入语音形式的导航至目的地“XX商场”的导航指令。For another example, the user can say "I'm going to XX mall", so as to input a voice navigation instruction to the destination "XX mall" into the smart glasses.
一方面,智能眼镜将根据该导航指令触发进行导航,此时,智能眼镜将按照与智能手机预先约定的报文格式,生成导航请求发送至智能手机,该导航请求用于指示智能手机返回导向前述目的地的导航信息。On the one hand, the smart glasses will navigate according to the navigation instruction. At this time, the smart glasses will generate a navigation request and send it to the smart phone according to the message format pre-agreed with the smart phone. The navigation request is used to instruct the smart phone to return to the aforementioned direction. Navigation information for the destination.
在202中,智能手机根据自身朝向信息以及当前位置生成导向至目的地的导航信息。In 202, the smartphone generates navigation information leading to a destination according to its own orientation information and the current location.
智能手机在接收到来自于智能眼镜的导航请求时,获取到自身所处的当前位置以及自身朝向信息,并根据前述当前位置以及前述目的地,采用预设的导航算法计算出由当前位置导向前述目的地的导航路径,以及对应该导航路径的剩余距离,以及根据自身朝向信息得到行进方向,相应将前述行进方向、前述当前位置、前述剩余距离和前述导航路径打包为导航信息。When the smart phone receives the navigation request from the smart glasses, it obtains its current position and its own orientation information, and uses the preset navigation algorithm to calculate the direction from the current position to the aforementioned according to the aforementioned current position and the aforementioned destination. The navigation path of the destination, the remaining distance corresponding to the navigation path, and the travel direction are obtained according to the self-orientation information, and the foregoing travel direction, the foregoing current position, the foregoing remaining distance and the foregoing navigation path are correspondingly packaged as navigation information.
在203中,智能手机将生成的导航信息返回至智能眼镜。In 203, the smartphone returns the generated navigation information to the smart glasses.
在打包得到导航信息之后,智能手机将前述导航信息通过其与智能眼镜之间的通信连接返回至智能眼镜。After the navigation information is packaged and obtained, the smart phone returns the aforementioned navigation information to the smart glasses through the communication connection between it and the smart glasses.
在204中,智能眼镜获取自身的当前朝向信息,并根据当前朝向信息对导航信息进行修正,得到修正导航信息。In 204, the smart glasses obtain their own current orientation information, and correct the navigation information according to the current orientation information to obtain corrected navigation information.
比如,智能眼镜可以通过配置的地磁传感器获取到自身的当前朝向信息。For example, smart glasses can obtain their current orientation information through the configured geomagnetic sensor.
在获取到自身的当前朝向信息之后,智能眼镜即根据该当前朝向信息对前述导航信息进行修正,得到与前述当前朝向信息所匹配的修正导航信息。After acquiring its own current orientation information, the smart glasses correct the aforementioned navigation information according to the current orientation information, and obtain revised navigation information matching the aforementioned current orientation information.
其中,在根据前述当前朝向信息对前述导航信息进行修正时,智能眼镜可以将前述当前朝向信息所描述的方向作为修正行进方向,相应将导航信息所包括的行进方向替换为修正行进方向,由此实现对前述导航信息的修正。Wherein, when correcting the aforementioned navigation information according to the aforementioned current orientation information, the smart glasses can use the direction described by the aforementioned current orientation information as the corrected travel direction, and correspondingly replace the travel direction included in the navigation information with the corrected travel direction, thereby Realize the correction of the aforementioned navigation information.
比如,请参照图4,当用户携带智能眼镜(图中未示出)和智能手机(图中未示出)位于图示十字路口时,由于其中智能手机朝向东北方向,相应智能手机生成并返回的导航信息中的行进方向也为东北方向,但是智能眼镜的朝向为东,若智能眼镜不对智能手机返回的导航信息进行修正,导航信息中的行进方向将与智能眼镜实际的朝向不同,对用户造成错误引导。为此,智能眼镜将自身的当前朝向作为修 正行进方向,并将前述导航信息中的行进方向替换为修正行进方向,完成对导航信息的修正。For example, please refer to FIG. 4 , when the user is at the intersection with smart glasses (not shown in the figure) and a smart phone (not shown in the figure), since the smart phone faces the northeast direction, the corresponding smart phone generates and returns The travel direction in the navigation information is also the northeast direction, but the orientation of the smart glasses is east. If the smart glasses do not correct the navigation information returned by the smartphone, the travel direction in the navigation information will be different from the actual direction of the smart glasses. cause misdirection. To this end, the smart glasses take their current orientation as the corrected travel direction, and replace the travel direction in the aforementioned navigation information with the corrected travel direction, thereby completing the correction of the navigation information.
在205中,智能眼镜对当前所处的现实场景进行三维重建,得到对应现实场景的虚拟现实场景。In 205 , the smart glasses perform three-dimensional reconstruction on the current real scene to obtain a virtual reality scene corresponding to the real scene.
本申请实施例中,智能眼镜还包括摄像模组。比如,该摄像模组包括深度摄像头和RGB摄像头,请参照图8,示出了一种可选地深度摄像头和RGB摄像头的设置方式。应当说明的是,深度摄像头和RGB摄像头并不限于图8示出的设置方式。In the embodiment of the present application, the smart glasses further include a camera module. For example, the camera module includes a depth camera and an RGB camera. Please refer to FIG. 8 , which shows an optional setting method of the depth camera and the RGB camera. It should be noted that the depth camera and the RGB camera are not limited to the arrangement shown in FIG. 8 .
其中,本申请实施例中对于深度摄像头的类型不做具体限制,可由本领域普通技术人员根据实际需要进行选取。比如,本申请实施例中选取的深度摄像头为飞行时间摄像头。飞行时间摄像头利用光的反射特性,通过向物体发射调制后的光脉冲信号,并接收从物体反射回的光脉冲信号,利用光脉冲信号往返的时间(或相位差)来计算物体的深度(或者说,物体到飞行时间摄像头的距离)。相应的,在本申请实施例中,电子设备可以在飞行时间摄像头对准现实场景时,通过该飞行时间摄像头获取到现实场景的深度图像,该深度图像包括现实场景不同位置处的深度值(深度值反映现实场景某一位置到飞行时间摄像头的距离,其值越小,表示距离飞行时间摄像头越近,而值越大,表示距离飞行时间摄像头越远)。The type of the depth camera is not specifically limited in the embodiments of the present application, and can be selected by those of ordinary skill in the art according to actual needs. For example, the depth camera selected in the embodiment of the present application is a time-of-flight camera. The time-of-flight camera uses the reflection characteristics of light to calculate the depth (or say, the distance of the object to the time-of-flight camera). Correspondingly, in the embodiment of the present application, when the time-of-flight camera is aimed at the real scene, the electronic device can obtain a depth image of the real scene through the time-of-flight camera, and the depth image includes the depth values (depth values) at different positions in the real scene. The value reflects the distance from a location in the real scene to the time-of-flight camera, the smaller the value, the closer to the time-of-flight camera, and the larger the value, the farther away from the time-of-flight camera).
RGB摄像头接收物体反射的光线(或者发出的光线),将光线转换为携带物体颜色特征的彩色图像。相应的,在本申请实施例中,电子设备可以在RGB摄像头对准现实场景时,通过该RGB摄像头获取到的现实场景的彩色图像,该彩色图像包括现实场景不同位置处的颜色数据。An RGB camera receives light reflected (or emitted) by an object and converts the light into a color image that carries the color characteristics of the object. Correspondingly, in this embodiment of the present application, the electronic device may obtain a color image of the real scene through the RGB camera when the RGB camera is aimed at the real scene, and the color image includes color data at different positions in the real scene.
需要说明的是,获取到的深度图像包括了现实场景的深度值,但不包括现实场景的颜色数据,而获取到的彩色图像包括了现实场景的颜色数据,但不包括现实场景的深度值,为了确保获取到现实场景深度图像和彩色图像的一致性,电子设备可以同步通过飞行时间摄像头和RGB摄像头获取到的现实场景的深度图像和彩色图像。It should be noted that the acquired depth image includes the depth value of the real scene, but does not include the color data of the real scene, and the acquired color image includes the color data of the real scene, but does not include the depth value of the real scene, In order to ensure the consistency of the acquired depth image and color image of the real scene, the electronic device can synchronize the depth image and color image of the real scene acquired by the time-of-flight camera and the RGB camera.
在获取到现实场景的深度图像以及彩色图像之后,智能眼镜按照配置的三维重建算法,根据前述深度图像以及彩色图像对现实场景进行三维重建,相应得到对应现实场景的虚拟现实场景。应当说明的是。本申请实施例中对于采用何种三维重建算法不做具体限制,可由本领域普通技术人员根据实际需要进行选取。After acquiring the depth image and the color image of the real scene, the smart glasses perform three-dimensional reconstruction of the real scene according to the aforementioned depth image and color image according to the configured three-dimensional reconstruction algorithm, and correspondingly obtain a virtual reality scene corresponding to the real scene. It should be noted that. There is no specific limitation on which three-dimensional reconstruction algorithm is adopted in the embodiments of the present application, and can be selected by those of ordinary skill in the art according to actual needs.
在206中,智能眼镜根据虚拟现实场景和修正导航信息,生成增强现实的目标导航信息。In 206, the smart glasses generate augmented reality target navigation information according to the virtual reality scene and the revised navigation information.
增强现实也被称为扩增现实,是一种将虚拟信息与真实世界巧妙融合的技术,广泛运用了多媒体、三维建模、实时跟踪及注册、智能交互、传感等多种技术手段,将计算机生成的文字、图像、三维模型、音乐、视频等虚拟信息模拟仿真后,应用到真实世界中,两种信息互为补充,从而实现对真实世界的“增强”。本申请实施例中,智能眼镜可以为具备增强现实功能的电子设备,比如具备增强现实功能的智能手机,具备增强现实功能的智能眼镜,具备增强现实功能的智能头盔等。Augmented reality, also known as augmented reality, is a technology that skillfully integrates virtual information with the real world. Computer-generated text, images, 3D models, music, videos and other virtual information are simulated and applied to the real world, and the two kinds of information complement each other, thereby realizing the "enhancement" of the real world. In the embodiments of the present application, the smart glasses may be electronic devices with augmented reality functions, such as smart phones with augmented reality functions, smart glasses with augmented reality functions, smart helmets with augmented reality functions, and the like.
相应的,智能眼镜可以基于增强现实的三维展示方式来展示修正导航信息。Correspondingly, the smart glasses can display the revised navigation information based on the three-dimensional display of augmented reality.
其中,在完成对现实场景的三维重建,并相应得到与现实场景对应的虚拟现实场景之后,智能眼镜进一步根据该虚拟现实场景以及修正导航信息,生成增强现实的目标导航信息。比如,以修正导航信息中的导航路径为例,原始的导航路径是二维空间内的,智能眼镜将根据三维重建得到虚拟现实场景,将二维空间内的原生导航路径转换为与现实场景匹配的三维空间内的目标导航路径。After completing the three-dimensional reconstruction of the real scene and correspondingly obtaining the virtual reality scene corresponding to the real scene, the smart glasses further generate the augmented reality target navigation information according to the virtual reality scene and the revised navigation information. For example, taking the navigation path in the revised navigation information as an example, the original navigation path is in the two-dimensional space, and the smart glasses will obtain the virtual reality scene according to the three-dimensional reconstruction, and convert the original navigation path in the two-dimensional space to match the real scene. The target navigation path in 3D space.
在207中,智能眼镜进行多自由度跟踪,得到当前的姿态信息。In 207, the smart glasses perform multi-degree-of-freedom tracking to obtain current posture information.
其中,智能眼镜还包括第一摄像头、第二摄像头以及惯性测量单元。比如,请参照图7,示出了一种可选地第一摄像头、第二摄像头以及惯性测量单元的设置方式。应当说明的是,第一摄像头、第二摄像头以及惯性测量单元并不限于图7示出的设置方式。Wherein, the smart glasses further include a first camera, a second camera and an inertial measurement unit. For example, please refer to FIG. 7 , which shows an optional arrangement of the first camera, the second camera and the inertial measurement unit. It should be noted that the first camera, the second camera and the inertial measurement unit are not limited to the arrangement shown in FIG. 7 .
相应的,智能眼镜在获取自身当前的姿态信息时,可以通过第一摄像头拍摄现实场景,将第一摄像头所拍摄的图像记为第一图像,以及同步通过第二摄像头拍摄现实场景,将第二摄像头所拍摄的图像记为第二图像,此外,还通过惯性测量单元测量得到惯性数据。Correspondingly, when the smart glasses obtain their current posture information, they can use the first camera to shoot the real scene, record the image captured by the first camera as the first image, and simultaneously shoot the real scene through the second camera, and use the second camera to shoot the real scene. The image captured by the camera is recorded as the second image. In addition, inertial data is also obtained by measuring the inertial measurement unit.
之后,智能眼镜即利用配置的多自由度跟踪算法,根据前述第一图像、前述第二图像以及前述惯性数据,计算得到当前的姿态信息。应当说明的是,本申请实施例中对于采用何种多自由度跟踪算法不做具体限制,可由本领域普通技术人员根据实际需要进行选择。比如,本申请实施例中采用六自由度跟踪算法,相应得到智能眼镜的六自由度姿态信息,包括纵荡信息、垂荡信息、横荡信息、纵摇信息、横摇信息、艏摇信息。据此,结合虚拟现实场景即可得到用户穿戴智能眼镜在现实场景中的视野和角度,从而实现目标导航信息与现实场景的匹配显示。After that, the smart glasses use the configured multi-degree-of-freedom tracking algorithm to calculate and obtain the current posture information according to the aforementioned first image, the aforementioned second image, and the aforementioned inertial data. It should be noted that, in the embodiments of the present application, there is no specific limitation on which multi-degree-of-freedom tracking algorithm is adopted, and those of ordinary skill in the art can select according to actual needs. For example, the six-degree-of-freedom tracking algorithm is used in the embodiment of the present application, and correspondingly, the six-degree-of-freedom attitude information of the smart glasses is obtained, including pitch information, heave information, sway information, pitch information, roll information, and yaw information. Accordingly, combined with the virtual reality scene, the visual field and angle of the user wearing the smart glasses in the real scene can be obtained, so as to realize the matching display of the target navigation information and the real scene.
在208中,智能眼镜根据前述姿态信息、前述当前朝向信息展示目标导航信息,使得目标导航信息与现实场景匹配。In 208, the smart glasses display the target navigation information according to the aforementioned posture information and the aforementioned current orientation information, so that the target navigation information matches the real scene.
在生成增强现实的目标导航信息,并获取到当前的姿态信息之后,智能眼镜即根据前述姿态信息以及前述当前朝向信息展示目标导航信息,这样,展示的目标导航信息将与现实场景匹配。以目标导航信息中的目标导航路径为例,对于用户而言,用户所看到的目标导航路径将与现实场景中的道路匹配。After generating the augmented reality target navigation information and acquiring the current posture information, the smart glasses display the target navigation information according to the foregoing posture information and the foregoing current orientation information, so that the displayed target navigation information will match the real scene. Taking the target navigation path in the target navigation information as an example, for the user, the target navigation path seen by the user will match the road in the real scene.
比如,请参照图5,智能眼镜包括显示组件和衍射波导,在生成增强现实的目标导航信息,并获取到当前的姿态信息之后,智能眼镜根据自身当前的姿态信息以及当前朝向信息,通过显示组件显示增强现实的目标导航信息,其中目标导航信息包括导航路径、修正行进方向、剩余距离、目的地以及当前位置。如图5所示,显示组件显示的目标导航信息将通过衍射波导,连同现实场景一起投射进用户眼球,被用户所看到。请继续参照图6,示出了用户实际看到的图像,该图像为现实场景和目标导航信息融合图像,可以看出,对于用户而言,智能眼镜所显示的目标导航信息与现实场景所匹配。其中,示出了当 前位置“XX山”,与现实场景中道路匹配的目标导航路径,携带剩余距离的提示信息“继续爬行500米(即剩余距离)到达目的地”,以及四角星标识的目的地,修正行进方向。本领域普通技术人员可以理解的是,其中修正行进方向即为智能眼镜的当前朝向,也即是用户的真实朝向,由此,即实现了以现实场景为基础的增强现实的三维导航。For example, referring to FIG. 5 , the smart glasses include a display component and a diffractive waveguide. After generating the target navigation information of augmented reality and acquiring the current attitude information, the smart glasses pass the display component according to their current attitude information and current orientation information. Display the target navigation information of augmented reality, wherein the target navigation information includes the navigation path, the corrected travel direction, the remaining distance, the destination and the current position. As shown in FIG. 5 , the target navigation information displayed by the display component will be projected into the user's eyeball together with the real scene through the diffractive waveguide and seen by the user. Please continue to refer to FIG. 6 , which shows the image actually seen by the user, which is a fusion image of the real scene and the target navigation information. It can be seen that, for the user, the target navigation information displayed by the smart glasses matches the real scene. . Among them, it shows the current position "XX Mountain", the target navigation path matching the road in the real scene, the prompt information carrying the remaining distance "continue to crawl 500 meters (ie remaining distance) to the destination", and the purpose of the four-pointed star logo , correct the direction of travel. It can be understood by those skilled in the art that the corrected travel direction is the current orientation of the smart glasses, that is, the real orientation of the user, thereby realizing the 3D navigation of augmented reality based on the real scene.
请参照图10,图10为本申请实施例提供的导航装置的结构示意图。该导航装置应用于本申请提供的电子设备。如图10所示,导航装置可以包括信息获取模块301和信息修正模块302,其中,Please refer to FIG. 10 , which is a schematic structural diagram of a navigation device provided by an embodiment of the present application. The navigation device is applied to the electronic equipment provided in this application. As shown in FIG. 10, the navigation device may include an information acquisition module 301 and an information correction module 302, wherein,
信息获取模块301,用于从第二电子设备获取导航信息,导航信息由第二电子设备根据其自身朝向信息生成;an information acquisition module 301, configured to acquire navigation information from a second electronic device, where the navigation information is generated by the second electronic device according to its own orientation information;
信息修正模块302,用于获取第一电子设备的当前朝向信息,并根据当前朝向信息对导前述航信息进行修正,得到修正导航信息;The information correction module 302 is used for acquiring the current orientation information of the first electronic device, and correcting the aforementioned navigation information according to the current orientation information to obtain the corrected navigation information;
信息展示模块303,用于展示修正导航信息。The information display module 303 is used to display the revised navigation information.
可选地,在一实施例中,在展示修正导航信息时,信息展示模块303用于:Optionally, in an embodiment, when displaying the revised navigation information, the information displaying module 303 is configured to:
对第一电子设备当前所处的现实场景进行三维重建,得到虚拟现实场景;performing three-dimensional reconstruction on the real scene where the first electronic device is currently located to obtain a virtual reality scene;
根据虚拟现实场景和修正导航信息,生成增强现实的目标导航信息;Generate augmented reality target navigation information according to the virtual reality scene and revised navigation information;
获取第一电子设备当前的姿态信息;obtaining the current attitude information of the first electronic device;
根据姿态信息和当前朝向信息展示目标导航信息,使得目标导航信息与现实场景匹配。The target navigation information is displayed according to the posture information and the current orientation information, so that the target navigation information matches the real scene.
可选地,在一实施例中,第一电子设备还包括第一摄像头、第二摄像头以及惯性测量单元,在获取第一电子设备当前的姿态信息时,信息展示模块303用于:Optionally, in an embodiment, the first electronic device further includes a first camera, a second camera, and an inertial measurement unit, and when acquiring the current attitude information of the first electronic device, the information display module 303 is configured to:
通过第一摄像头拍摄现实场景得到第一图像,通过第二摄像头拍摄现实场景得到第二图像,以及通过惯性测量单元测量得到惯性数据;The first image is obtained by shooting the real scene with the first camera, the second image is obtained by shooting the real scene with the second camera, and the inertial data is obtained by measuring the inertial measurement unit;
根据第一图像、第二图像以及惯性数据对第一电子设备进行多自由度跟踪,得到当前的姿态信息。The multi-degree-of-freedom tracking is performed on the first electronic device according to the first image, the second image and the inertial data to obtain current attitude information.
可选地,在一实施例中,第一电子设备还包括摄像模组,在对第一电子设备当前所处的现实场景进行三维重建,得到虚拟现实场景时,信息展示模块303用于执行:Optionally, in one embodiment, the first electronic device further includes a camera module, and when performing three-dimensional reconstruction of the real scene where the first electronic device is currently located to obtain a virtual reality scene, the information display module 303 is configured to execute:
通过摄像模组获取现实场景的深度图像和彩色图像;Obtain the depth image and color image of the real scene through the camera module;
根据深度图像以及彩色图像对现实场景进行三维重建,得到虚拟现实场景。The virtual reality scene is obtained by 3D reconstruction of the real scene according to the depth image and the color image.
可选地,在一实施例中,在从第二电子设备获取导航信息之前,信息获取模块301还用于:Optionally, in an embodiment, before acquiring the navigation information from the second electronic device, the information acquiring module 301 is further configured to:
识别第一电子设备与第二电子设备是否处于相同位置;Identifying whether the first electronic device and the second electronic device are in the same position;
在第一电子设备与第二电子设备处于相同位置时,从第二电子设备获取导航信息。When the first electronic device and the second electronic device are in the same location, the navigation information is acquired from the second electronic device.
可选地,在一实施例中,在识别第一电子设备与第二电子设备是否处于相同位置时,信息获取模块 301用于:Optionally, in one embodiment, when identifying whether the first electronic device and the second electronic device are in the same position, the information acquisition module 301 is used to:
获取第一电子设备与第二电子设备之间的通信距离;obtaining the communication distance between the first electronic device and the second electronic device;
在通信距离小于预设通信距离时,判定第一电子设备与第二电子设备处于相同位置。When the communication distance is less than the preset communication distance, it is determined that the first electronic device and the second electronic device are in the same position.
可选地,在一实施例中,本申请提供的导航装置还包括提示模块,在获取第一电子设备与第二电子设备之间的通信距离之后,用于:Optionally, in an embodiment, the navigation device provided by the present application further includes a prompting module, which is configured to: after acquiring the communication distance between the first electronic device and the second electronic device:
在通信距离大于或等于预设通信距离时,获取第二电子设备当前位置信息;When the communication distance is greater than or equal to the preset communication distance, acquiring the current location information of the second electronic device;
根据当前位置信息生成位置提示信息,并展示位置提示信息。Generate location prompt information based on the current location information, and display the location prompt information.
可选地,在一实施例中,本申请提供的导航装置还包括导航模块,用于:Optionally, in an embodiment, the navigation device provided by the present application further includes a navigation module for:
在接收到第三电子设备传输的导航请求时,解析出导航请求携带的第三电子设备的朝向信息;When receiving the navigation request transmitted by the third electronic device, parse out the orientation information of the third electronic device carried in the navigation request;
根据第三电子设备的朝向信息生成对应第三电子设备的导航信息;generating navigation information corresponding to the third electronic device according to the orientation information of the third electronic device;
将对应第三电子设备的导航信息发送至第三电子设备。The navigation information corresponding to the third electronic device is sent to the third electronic device.
可选地,在一实施例中,在从第二电子设备获取导航信息时,信息获取模块301用于:Optionally, in an embodiment, when acquiring navigation information from the second electronic device, the information acquisition module 301 is configured to:
在第一电子设备的剩余电量小于预设电量时,从第二电子设备获取导航信息;或者,When the remaining power of the first electronic device is less than the preset power, obtain navigation information from the second electronic device; or,
在第一电子设备的导航精度小于第二电子设备的导航精度时,从第二电子设备获取导航信息。When the navigation accuracy of the first electronic device is smaller than the navigation accuracy of the second electronic device, the navigation information is acquired from the second electronic device.
应当说明的是,本申请实施例提供的导航装置与上文实施例中的导航方法属于同一构思,导航装置可以运行导航方法实施例中提供的任一方法,其具体实现过程详见以上相关实施例,此处不再赘述。It should be noted that the navigation device provided in the embodiment of the present application and the navigation method in the above embodiment belong to the same concept, and the navigation device can run any method provided in the navigation method embodiment. For the specific implementation process, please refer to the above related implementation. For example, it will not be repeated here.
本申请实施例提供一种存储介质,其上存储有计算机程序,当其存储的计算机程序被第一电子设备的处理器加载时执行如本申请实施例提供的导航方法中的步骤。其中,存储介质可以是磁碟、光盘、只读存储器(Read Only Memory,ROM)或者随机存取器(Random Access Memory,RAM)等。The embodiments of the present application provide a storage medium on which a computer program is stored, and when the stored computer program is loaded by a processor of a first electronic device, the steps in the navigation method provided by the embodiments of the present application are executed. The storage medium may be a magnetic disk, an optical disk, a read only memory (Read Only Memory, ROM), or a random access device (Random Access Memory, RAM), and the like.
本申请实施例还提供一种电子设备,请参照图11,电子设备包括处理器401和存储器402。An embodiment of the present application further provides an electronic device. Please refer to FIG. 11 . The electronic device includes a processor 401 and a memory 402 .
本申请实施例中的处理器是通用处理器,比如ARM架构的处理器。The processor in the embodiment of the present application is a general-purpose processor, such as a processor of an ARM architecture.
存储器402中存储有计算机程序,其可以为高速随机存取存储器,还可以为非易失性存储器,比如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件等。相应地,存储器402还可以包括存储器控制器,以提供处理器401对存储器402的访问,当电子设备被配置为第一电子设备时,处理器401通过加载存储器402中的计算机程序实现如下功能:A computer program is stored in the memory 402, which may be a high-speed random access memory, or a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices. Correspondingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402. When the electronic device is configured as the first electronic device, the processor 401 implements the following functions by loading the computer program in the memory 402:
从第二电子设备获取导航信息,导航信息由第二电子设备根据其自身朝向信息生成;obtaining navigation information from the second electronic device, where the navigation information is generated by the second electronic device according to its own orientation information;
获取第一电子设备的当前朝向信息,并根据当前朝向信息对导前述航信息进行修正,得到修正导航信息;Acquiring the current orientation information of the first electronic device, and revising the aforementioned navigation information according to the current orientation information to obtain revised navigation information;
展示修正导航信息。Displays revised navigation information.
可选地,在一实施例中,在展示修正导航信息时,处理器401用于执行:Optionally, in an embodiment, when the revised navigation information is displayed, the processor 401 is configured to execute:
对第一电子设备当前所处的现实场景进行三维重建,得到虚拟现实场景;performing three-dimensional reconstruction on the real scene where the first electronic device is currently located to obtain a virtual reality scene;
根据虚拟现实场景和修正导航信息,生成增强现实的目标导航信息;Generate augmented reality target navigation information according to the virtual reality scene and revised navigation information;
获取第一电子设备当前的姿态信息;obtaining the current attitude information of the first electronic device;
根据姿态信息和当前朝向信息展示目标导航信息,使得目标导航信息与现实场景匹配。The target navigation information is displayed according to the posture information and the current orientation information, so that the target navigation information matches the real scene.
可选地,在一实施例中,第一电子设备还包括第一摄像头、第二摄像头以及惯性测量单元,在获取第一电子设备当前的姿态信息时,处理器401用于执行:Optionally, in an embodiment, the first electronic device further includes a first camera, a second camera, and an inertial measurement unit, and when acquiring the current attitude information of the first electronic device, the processor 401 is configured to execute:
通过第一摄像头拍摄现实场景得到第一图像,通过第二摄像头拍摄现实场景得到第二图像,以及通过惯性测量单元测量得到惯性数据;The first image is obtained by shooting the real scene with the first camera, the second image is obtained by shooting the real scene with the second camera, and the inertial data is obtained by measuring the inertial measurement unit;
根据第一图像、第二图像以及惯性数据对第一电子设备进行多自由度跟踪,得到当前的姿态信息。The multi-degree-of-freedom tracking is performed on the first electronic device according to the first image, the second image and the inertial data to obtain current attitude information.
可选地,在一实施例中,第一电子设备还包括摄像模组,在对第一电子设备当前所处的现实场景进行三维重建,得到虚拟现实场景时,处理器401用于执行:Optionally, in an embodiment, the first electronic device further includes a camera module, and when performing three-dimensional reconstruction on the real scene where the first electronic device is currently located to obtain a virtual reality scene, the processor 401 is configured to execute:
通过摄像模组获取现实场景的深度图像和彩色图像;Obtain the depth image and color image of the real scene through the camera module;
根据深度图像以及彩色图像对现实场景进行三维重建,得到虚拟现实场景。The virtual reality scene is obtained by 3D reconstruction of the real scene according to the depth image and the color image.
可选地,在一实施例中,在从第二电子设备获取导航信息之前,处理器401还用于执行:Optionally, in an embodiment, before acquiring the navigation information from the second electronic device, the processor 401 is further configured to execute:
识别第一电子设备与第二电子设备是否处于相同位置;Identifying whether the first electronic device and the second electronic device are in the same position;
在第一电子设备与第二电子设备处于相同位置时,从第二电子设备获取导航信息。When the first electronic device and the second electronic device are in the same location, the navigation information is acquired from the second electronic device.
可选地,在一实施例中,在识别第一电子设备与第二电子设备是否处于相同位置时,处理器401用于执行:Optionally, in an embodiment, when identifying whether the first electronic device and the second electronic device are in the same position, the processor 401 is configured to execute:
获取第一电子设备与第二电子设备之间的通信距离;obtaining the communication distance between the first electronic device and the second electronic device;
在通信距离小于预设通信距离时,判定第一电子设备与第二电子设备处于相同位置。When the communication distance is less than the preset communication distance, it is determined that the first electronic device and the second electronic device are in the same position.
可选地,在一实施例中,在获取第一电子设备与第二电子设备之间的通信距离之后,处理器401还用于执行:Optionally, in an embodiment, after acquiring the communication distance between the first electronic device and the second electronic device, the processor 401 is further configured to execute:
在通信距离大于或等于预设通信距离时,获取第二电子设备当前位置信息;When the communication distance is greater than or equal to the preset communication distance, acquiring the current location information of the second electronic device;
根据当前位置信息生成位置提示信息,并展示位置提示信息。Generate location prompt information based on the current location information, and display the location prompt information.
可选地,在一实施例中,处理器401还用于执行:Optionally, in an embodiment, the processor 401 is further configured to execute:
在接收到第三电子设备传输的导航请求时,解析出导航请求携带的第三电子设备的朝向信息;When receiving the navigation request transmitted by the third electronic device, parse out the orientation information of the third electronic device carried in the navigation request;
根据第三电子设备的朝向信息生成对应第三电子设备的导航信息;generating navigation information corresponding to the third electronic device according to the orientation information of the third electronic device;
将对应第三电子设备的导航信息发送至第三电子设备。The navigation information corresponding to the third electronic device is sent to the third electronic device.
可选地,在一实施例中,在从第二电子设备获取导航信息时,处理器401用于执行:Optionally, in an embodiment, when acquiring navigation information from the second electronic device, the processor 401 is configured to execute:
在第一电子设备的剩余电量小于预设电量时,从第二电子设备获取导航信息;或者,When the remaining power of the first electronic device is less than the preset power, obtain navigation information from the second electronic device; or,
在第一电子设备的导航精度小于第二电子设备的导航精度时,从第二电子设备获取导航信息。When the navigation accuracy of the first electronic device is smaller than the navigation accuracy of the second electronic device, the navigation information is acquired from the second electronic device.
应当说明的是,本申请实施例提供的电子设备与上文实施例中的导航方法属于同一构思,在电子设备上可以运行导航方法实施例中提供的任一方法,其具体实现过程详见以上实施例,此处不再赘述。It should be noted that the electronic device provided in the embodiment of the present application and the navigation method in the above embodiment belong to the same concept, and any method provided in the navigation method embodiment can be executed on the electronic device, and the specific implementation process is detailed above. Examples are not repeated here.
需要说明的是,对本申请实施例的导航方法而言,本领域普通测试人员可以理解实现本申请实施例的导航方法的全部或部分流程,是可以通过计算机程序来控制相关的硬件来完成,所述计算机程序可存储于一计算机可读取存储介质中,如存储在电子设备的存储器中,并被该电子设备内的处理器执行,在执行过程中可包括如导航方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储器、随机存取记忆体等。It should be noted that for the navigation method of the embodiment of the present application, ordinary testers in the art can understand that all or part of the process of implementing the navigation method of the embodiment of the present application can be completed by controlling the relevant hardware through a computer program, so The computer program can be stored in a computer-readable storage medium, such as a memory of an electronic device, and executed by a processor in the electronic device, and the execution process can include processes such as embodiments of the navigation method. The storage medium may be a magnetic disk, an optical disk, a read-only memory, a random access memory, or the like.
以上对本申请实施例所提供的一种导航方法、装置、存储介质及电子设备进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。A navigation method, an apparatus, a storage medium and an electronic device provided by the embodiments of the present application have been described in detail above. The principles and implementations of the present application are described with specific examples. The descriptions of the above embodiments are only used for In order to help understand the method of the present application and its core idea; at the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation and application scope. In summary, the content of this specification It should not be construed as a limitation of this application.

Claims (20)

  1. 一种导航方法,应用于第一电子设备,其中,包括:A navigation method, applied to a first electronic device, comprising:
    从第二电子设备获取导航信息,所述导航信息由所述第二电子设备根据其自身朝向信息生成;obtaining navigation information from a second electronic device, where the navigation information is generated by the second electronic device according to its own orientation information;
    获取所述第一电子设备的当前朝向信息,并根据所述当前朝向信息对所述导航信息进行修正,得到修正导航信息;Acquiring the current orientation information of the first electronic device, and correcting the navigation information according to the current orientation information to obtain revised navigation information;
    展示所述修正导航信息。The revised navigation information is displayed.
  2. 根据权利要求1所述的导航方法,其中,所述展示所述修正导航信息,包括:The navigation method according to claim 1, wherein the displaying the revised navigation information comprises:
    对所述第一电子设备当前所处的现实场景进行三维重建,得到虚拟现实场景;performing three-dimensional reconstruction on the real scene where the first electronic device is currently located to obtain a virtual reality scene;
    根据所述虚拟现实场景和所述修正导航信息,生成增强现实的目标导航信息;generating augmented reality target navigation information according to the virtual reality scene and the revised navigation information;
    获取所述第一电子设备当前的姿态信息;obtaining the current posture information of the first electronic device;
    根据所述姿态信息和所述当前朝向信息展示所述目标导航信息,使得所述目标导航信息与所述现实场景匹配。The target navigation information is displayed according to the gesture information and the current orientation information, so that the target navigation information matches the real scene.
  3. 根据权利要求2所述的导航方法,其中,所述第一电子设备还包括第一摄像头、第二摄像头以及惯性测量单元,所述获取所述第一电子设备当前的姿态信息,包括:The navigation method according to claim 2, wherein the first electronic device further comprises a first camera, a second camera and an inertial measurement unit, and the acquiring the current attitude information of the first electronic device comprises:
    通过所述第一摄像头拍摄所述现实场景得到第一图像,通过所述第二摄像头拍摄所述现实场景得到第二图像,以及通过所述惯性测量单元测量得到惯性数据;Shooting the real scene with the first camera to obtain a first image, shooting the real scene with the second camera to obtain a second image, and measuring the inertial measurement unit to obtain inertial data;
    根据所述第一图像、所述第二图像以及所述惯性数据对所述第一电子设备进行多自由度跟踪,得到所述姿态信息。The attitude information is obtained by performing multi-degree-of-freedom tracking on the first electronic device according to the first image, the second image and the inertial data.
  4. 根据权利要求2所述的导航方法,其中,所述第一电子设备还包括摄像模组,所述对所述第一电子设备当前所处的现实场景进行三维重建,得到虚拟现实场景,包括:The navigation method according to claim 2, wherein the first electronic device further comprises a camera module, and the three-dimensional reconstruction of the real scene where the first electronic device is currently located to obtain a virtual reality scene, comprising:
    通过所述摄像模组获取所述现实场景的深度图像和彩色图像;Obtain the depth image and the color image of the real scene through the camera module;
    根据所述深度图像以及所述彩色图像对所述现实场景进行三维重建,得到所述虚拟现实场景。Three-dimensional reconstruction is performed on the real scene according to the depth image and the color image to obtain the virtual reality scene.
  5. 根据权利要求1-4任一项所述的导航方法,其中,所述从第二电子设备获取导航信息之前,还包括:The navigation method according to any one of claims 1-4, wherein before acquiring the navigation information from the second electronic device, the method further comprises:
    识别所述第一电子设备与所述第二电子设备是否处于相同位置;identifying whether the first electronic device and the second electronic device are in the same location;
    在所述第一电子设备与所述第二电子设备处于相同位置时,从所述第二电子设备获取所述导航信息。The navigation information is acquired from the second electronic device when the first electronic device and the second electronic device are in the same location.
  6. 根据权利要求5所述的导航方法,其中,所述识别所述第一电子设备与所述第二电子设备是否处于相同位置,包括:The navigation method according to claim 5, wherein the identifying whether the first electronic device and the second electronic device are in the same location comprises:
    获取所述第一电子设备与所述第二电子设备之间的通信距离;obtaining the communication distance between the first electronic device and the second electronic device;
    在所述通信距离小于预设通信距离时,判定所述第一电子设备与所述第二电子设备处于相同位置。When the communication distance is less than a preset communication distance, it is determined that the first electronic device and the second electronic device are in the same position.
  7. 根据权利要求6所述的导航方法,其中,所述获取所述第一电子设备与所述第二电子设备之间的通信距离之后,还包括:The navigation method according to claim 6, wherein after acquiring the communication distance between the first electronic device and the second electronic device, the method further comprises:
    在所述通信距离大于或等于所述预设通信距离时,获取所述第二电子设备当前位置信息;When the communication distance is greater than or equal to the preset communication distance, acquiring current location information of the second electronic device;
    根据所述当前位置信息生成位置提示信息,并展示所述位置提示信息。Generate location prompt information according to the current location information, and display the location prompt information.
  8. 根据权利要求1-4任一项所述的导航方法,其中,所述导航方法还包括:The navigation method according to any one of claims 1-4, wherein the navigation method further comprises:
    在接收到第三电子设备传输的导航请求时,解析出所述导航请求携带的所述第三电子设备的朝向信息;When receiving the navigation request transmitted by the third electronic device, parse out the orientation information of the third electronic device carried in the navigation request;
    根据所述第三电子设备的朝向信息生成对应所述第三电子设备的导航信息;generating navigation information corresponding to the third electronic device according to the orientation information of the third electronic device;
    将对应所述第三电子设备的导航信息发送至所述第三电子设备。Sending navigation information corresponding to the third electronic device to the third electronic device.
  9. 根据权利要求1-4任一项所述的导航方法,其中,所述从第二电子设备获取导航信息,包括:The navigation method according to any one of claims 1-4, wherein the acquiring navigation information from the second electronic device comprises:
    在所述第一电子设备的剩余电量小于预设电量时,从所述第二电子设备获取所述导航信息;或者,When the remaining power of the first electronic device is less than a preset power, acquire the navigation information from the second electronic device; or,
    在所述第一电子设备的导航精度小于所述第二电子设备的导航精度时,从所述第二电子设备获取导航信息。When the navigation accuracy of the first electronic device is smaller than the navigation accuracy of the second electronic device, the navigation information is acquired from the second electronic device.
  10. 一种导航装置,应用于第一电子设备,其中,包括:A navigation device, applied to a first electronic device, comprising:
    信息获取模块,用于从第二电子设备获取导航信息,所述导航信息由所述第二电子设备基于其自身朝向信息生成;an information acquisition module, configured to acquire navigation information from a second electronic device, where the navigation information is generated by the second electronic device based on its own orientation information;
    信息修正模块,用于获取所述第一电子设备的当前朝向信息,并根据所述当前朝向信息对所述导航信息进行修正,得到修正导航信息;an information correction module, configured to obtain the current orientation information of the first electronic device, and correct the navigation information according to the current orientation information to obtain corrected navigation information;
    信息展示模块,用于展示所述修正导航信息。The information display module is used to display the revised navigation information.
  11. 一种存储介质,其上存储有计算机程序,其中,当所述计算机程序被第一电子设备的处理器加载时执行如权利要求1-8任一项所述的导航方法。A storage medium having a computer program stored thereon, wherein the navigation method according to any one of claims 1-8 is executed when the computer program is loaded by a processor of a first electronic device.
  12. 一种电子设备,所述电子设备包括处理器和存储器,所述存储器储存有计算机程序,其中,当所述电子设备被配置为第一电子设备时,所述处理器用于执行:An electronic device comprising a processor and a memory, the memory storing a computer program, wherein, when the electronic device is configured as a first electronic device, the processor is configured to execute:
    从第二电子设备获取导航信息,所述导航信息由所述第二电子设备根据其自身朝向信息生成;obtaining navigation information from a second electronic device, where the navigation information is generated by the second electronic device according to its own orientation information;
    获取所述第一电子设备的当前朝向信息,并根据所述当前朝向信息对所述导航信息进行修正,得到修正导航信息;Acquiring the current orientation information of the first electronic device, and correcting the navigation information according to the current orientation information to obtain revised navigation information;
    展示所述修正导航信息。The revised navigation information is displayed.
  13. 根据权利要求12所述的电子设备,其中,所述处理器用于执行:The electronic device of claim 12, wherein the processor is configured to perform:
    对所述第一电子设备当前所处的现实场景进行三维重建,得到虚拟现实场景;performing three-dimensional reconstruction on the real scene where the first electronic device is currently located to obtain a virtual reality scene;
    根据所述虚拟现实场景和所述修正导航信息,生成增强现实的目标导航信息;generating augmented reality target navigation information according to the virtual reality scene and the revised navigation information;
    获取所述第一电子设备当前的姿态信息;obtaining the current posture information of the first electronic device;
    根据所述姿态信息和所述当前朝向信息展示所述目标导航信息,使得所述目标导航信息与所述现实场景匹配。The target navigation information is displayed according to the gesture information and the current orientation information, so that the target navigation information matches the real scene.
  14. 根据权利要求13所述的电子设备,其中,所述处理器用于执行:The electronic device of claim 13, wherein the processor is configured to perform:
    通过所述第一摄像头拍摄所述现实场景得到第一图像,通过所述第二摄像头拍摄所述现实场景得到第二图像,以及通过所述惯性测量单元测量得到惯性数据;Shooting the real scene with the first camera to obtain a first image, shooting the real scene with the second camera to obtain a second image, and measuring the inertial measurement unit to obtain inertial data;
    根据所述第一图像、所述第二图像以及所述惯性数据对所述第一电子设备进行多自由度跟踪,得到所述姿态信息。The attitude information is obtained by performing multi-degree-of-freedom tracking on the first electronic device according to the first image, the second image and the inertial data.
  15. 根据权利要求13所述的电子设备,其中,所述处理器用于执行:The electronic device of claim 13, wherein the processor is configured to perform:
    通过所述摄像模组获取所述现实场景的深度图像和彩色图像;Obtain the depth image and the color image of the real scene through the camera module;
    根据所述深度图像以及所述彩色图像对所述现实场景进行三维重建,得到所述虚拟现实场景。Three-dimensional reconstruction is performed on the real scene according to the depth image and the color image to obtain the virtual reality scene.
  16. 根据权利要求12-15任一项所述的电子设备,其中,所述处理器用于执行:The electronic device of any one of claims 12-15, wherein the processor is configured to execute:
    识别所述第一电子设备与所述第二电子设备是否处于相同位置;identifying whether the first electronic device and the second electronic device are in the same location;
    在所述第一电子设备与所述第二电子设备处于相同位置时,从所述第二电子设备获取所述导航信息。The navigation information is acquired from the second electronic device when the first electronic device and the second electronic device are in the same location.
  17. 根据权利要求16所述的电子设备,其中,所述处理器用于执行:The electronic device of claim 16, wherein the processor is configured to perform:
    获取所述第一电子设备与所述第二电子设备之间的通信距离;obtaining the communication distance between the first electronic device and the second electronic device;
    在所述通信距离小于预设通信距离时,判定所述第一电子设备与所述第二电子设备处于相同位置。When the communication distance is less than a preset communication distance, it is determined that the first electronic device and the second electronic device are in the same position.
  18. 根据权利要求17所述的电子设备,其中,所述处理器用于执行:The electronic device of claim 17, wherein the processor is configured to perform:
    在所述通信距离大于或等于所述预设通信距离时,获取所述第二电子设备当前位置信息;When the communication distance is greater than or equal to the preset communication distance, acquiring current location information of the second electronic device;
    根据所述当前位置信息生成位置提示信息,并展示所述位置提示信息。Generate location prompt information according to the current location information, and display the location prompt information.
  19. 根据权利要求12-15任一项所述的电子设备,其中,所述处理器用于执行:The electronic device of any one of claims 12-15, wherein the processor is configured to execute:
    在接收到第三电子设备传输的导航请求时,解析出所述导航请求携带的所述第三电子设备的朝向信息;When receiving the navigation request transmitted by the third electronic device, parse out the orientation information of the third electronic device carried in the navigation request;
    根据所述第三电子设备的朝向信息生成对应所述第三电子设备的导航信息;generating navigation information corresponding to the third electronic device according to the orientation information of the third electronic device;
    将对应所述第三电子设备的导航信息发送至所述第三电子设备。Sending navigation information corresponding to the third electronic device to the third electronic device.
  20. 根据权利要求12-15任一项所述的电子设备,其中,所述处理器用于执行:The electronic device of any one of claims 12-15, wherein the processor is configured to execute:
    在所述第一电子设备的剩余电量小于预设电量时,从所述第二电子设备获取所述导航信息;或者,When the remaining power of the first electronic device is less than a preset power, acquire the navigation information from the second electronic device; or,
    在所述第一电子设备的导航精度小于所述第二电子设备的导航精度时,从所述第二电子设备获取导航信息。When the navigation accuracy of the first electronic device is smaller than the navigation accuracy of the second electronic device, the navigation information is acquired from the second electronic device.
PCT/CN2021/091916 2020-07-22 2021-05-06 Navigation method and apparatus, storage medium and electronic device WO2022016953A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010711894.0 2020-07-22
CN202010711894.0A CN111896015A (en) 2020-07-22 2020-07-22 Navigation method, navigation device, storage medium and electronic equipment

Publications (1)

Publication Number Publication Date
WO2022016953A1 true WO2022016953A1 (en) 2022-01-27

Family

ID=73190418

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/091916 WO2022016953A1 (en) 2020-07-22 2021-05-06 Navigation method and apparatus, storage medium and electronic device

Country Status (2)

Country Link
CN (1) CN111896015A (en)
WO (1) WO2022016953A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111896015A (en) * 2020-07-22 2020-11-06 Oppo广东移动通信有限公司 Navigation method, navigation device, storage medium and electronic equipment
CN112577488B (en) * 2020-11-24 2022-09-02 腾讯科技(深圳)有限公司 Navigation route determining method, navigation route determining device, computer equipment and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104613959A (en) * 2015-02-11 2015-05-13 小米科技有限责任公司 Navigation method and device for wearable device and electronic equipment
CN105661731A (en) * 2016-04-13 2016-06-15 京东方科技集团股份有限公司 Wearable navigation equipment and navigation system
CN108896066A (en) * 2018-03-23 2018-11-27 江苏泽景汽车电子股份有限公司 A kind of augmented reality head up display and its navigation implementation method
CN109668575A (en) * 2019-01-29 2019-04-23 苏州车萝卜汽车电子科技有限公司 For the method for processing navigation information and device of augmented reality head-up display device, equipment, system
CN109990797A (en) * 2017-12-29 2019-07-09 周秦娜 A kind of control method of the augmented reality navigation display for HUD
DE102018203462A1 (en) * 2018-03-07 2019-09-12 Volkswagen Aktiengesellschaft Method for calculating a display of additional information for a display on a display unit, device for carrying out the method and motor vehicle and computer program
CN110920604A (en) * 2018-09-18 2020-03-27 阿里巴巴集团控股有限公司 Driving assistance method, driving assistance system, computing device, and storage medium
CN111055853A (en) * 2018-10-15 2020-04-24 三星电子株式会社 Content visualization method and device
CN111896015A (en) * 2020-07-22 2020-11-06 Oppo广东移动通信有限公司 Navigation method, navigation device, storage medium and electronic equipment

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3037784B1 (en) * 2014-12-23 2019-05-01 Nokia Technologies OY Causation of display of supplemental map information
CN105444775A (en) * 2015-12-31 2016-03-30 歌尔科技有限公司 Augmented reality navigation system, head-mounted device and navigation method
CN105867640B (en) * 2016-05-12 2020-07-03 上海擎感智能科技有限公司 Intelligent glasses, and control method and control system of intelligent glasses
CN106197462A (en) * 2016-07-01 2016-12-07 上海卓易云汇智能技术有限公司 Air navigation aid and system
CN108520552A (en) * 2018-03-26 2018-09-11 广东欧珀移动通信有限公司 Image processing method, device, storage medium and electronic equipment
CN108962241B (en) * 2018-06-27 2021-04-02 Oppo广东移动通信有限公司 Position prompting method and device, storage medium and electronic equipment
CN111010641A (en) * 2019-12-20 2020-04-14 联想(北京)有限公司 Information processing method, earphone and electronic equipment

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104613959A (en) * 2015-02-11 2015-05-13 小米科技有限责任公司 Navigation method and device for wearable device and electronic equipment
CN105661731A (en) * 2016-04-13 2016-06-15 京东方科技集团股份有限公司 Wearable navigation equipment and navigation system
CN109990797A (en) * 2017-12-29 2019-07-09 周秦娜 A kind of control method of the augmented reality navigation display for HUD
DE102018203462A1 (en) * 2018-03-07 2019-09-12 Volkswagen Aktiengesellschaft Method for calculating a display of additional information for a display on a display unit, device for carrying out the method and motor vehicle and computer program
CN108896066A (en) * 2018-03-23 2018-11-27 江苏泽景汽车电子股份有限公司 A kind of augmented reality head up display and its navigation implementation method
CN110920604A (en) * 2018-09-18 2020-03-27 阿里巴巴集团控股有限公司 Driving assistance method, driving assistance system, computing device, and storage medium
CN111055853A (en) * 2018-10-15 2020-04-24 三星电子株式会社 Content visualization method and device
CN109668575A (en) * 2019-01-29 2019-04-23 苏州车萝卜汽车电子科技有限公司 For the method for processing navigation information and device of augmented reality head-up display device, equipment, system
CN111896015A (en) * 2020-07-22 2020-11-06 Oppo广东移动通信有限公司 Navigation method, navigation device, storage medium and electronic equipment

Also Published As

Publication number Publication date
CN111896015A (en) 2020-11-06

Similar Documents

Publication Publication Date Title
US11533489B2 (en) Reprojecting holographic video to enhance streaming bandwidth/quality
US11928838B2 (en) Calibration system and method to align a 3D virtual scene and a 3D real world for a stereoscopic head-mounted display
JP6391685B2 (en) Orientation and visualization of virtual objects
EP3619599B1 (en) Virtual content displayed with shared anchor
JP6860488B2 (en) Mixed reality system
US10380799B2 (en) Dockable billboards for labeling objects in a display having a three-dimensional perspective of a virtual or real environment
KR20200055010A (en) Head mounted display tracking system
US20230350628A1 (en) Intuitive augmented reality collaboration on visual data
JP6465672B2 (en) Information processing apparatus and information processing method
US11156843B2 (en) End-to-end artificial reality calibration testing
US10755486B2 (en) Occlusion using pre-generated 3D models for augmented reality
WO2022016953A1 (en) Navigation method and apparatus, storage medium and electronic device
US11100713B2 (en) System and method for aligning virtual objects on peripheral devices in low-cost augmented reality/virtual reality slip-in systems
CN110728756B (en) Remote guidance method and device based on augmented reality
CN112368746A (en) Information processing apparatus, information processing method, and program
EP4352567A1 (en) Depth sensing via device case
JP6494305B2 (en) Information processing apparatus, display apparatus, and information processing method
US11150470B2 (en) Inertial measurement unit signal based image reprojection
US11954269B2 (en) Information processing apparatus, information processing method, and program for generating location data
KR20230046694A (en) Camera system, smart mirror system and live commerce system including the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21846535

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21846535

Country of ref document: EP

Kind code of ref document: A1