WO2018119701A1

WO2018119701A1 - Navigation interface display method and device

Info

Publication number: WO2018119701A1
Application number: PCT/CN2016/112464
Authority: WO
Inventors: 王斌; 王凤周; 马世奎; 邵煜璇; 郭丽媛; 廉士国; 王恺
Original assignee: 深圳前海达闼云端智能科技有限公司
Priority date: 2016-12-27
Filing date: 2016-12-27
Publication date: 2018-07-05
Also published as: CN107466357B; CN107466357A

Abstract

Disclosed are a navigation interface display method and device, which relate to the field of navigation and are used for visually displaying various types of environment information on a navigation interface. The navigation interface display method comprises: acquiring a real-time image of a current position and corresponding auxiliary navigation information, the auxiliary navigation information being obtained by measuring a surrounding environment of the current position; converting the auxiliary navigation information into a virtual image; and displaying, on a navigation interface, the real-time image and the virtual image, wherein the virtual image is superimposed on the real-time image. The embodiments of the present application are applied to a blind guide helmet.

Description

Navigation interface display method and device

Technical field

The present application relates to the field of navigation, and in particular, to a navigation interface display method and apparatus.

Background technique

In the process of intelligent navigation, intelligent terminals usually need to obtain a variety of environmental information for navigation decisions through various sensors. For example, the real-time image of the surrounding environment, the distance of the nearby obstacles, the current position indicated by the GPS (global position system) signal, and the current position obtained by three-point positioning of the base station signal are acquired by the terminal located at the site, These environmental information is then displayed on the navigation interface to make navigation decisions based on the above environmental information.

In general, real-time images of the surrounding environment (eg, front vehicles, traffic lights, etc.) are displayed on the navigation interface, and navigation decisions (eg, steering, forward, stop, etc.) can be made accordingly. The inventors found in the process of studying the prior art that other environmental information, such as the distance of the nearby obstacles, the current location, etc., are also necessary for making more accurate navigation decisions. However, if the environmental information is displayed directly in the navigation interface, it is not intuitive enough to make navigation decisions quickly. For example, if the distance of the nearest obstacle is displayed directly on the navigation interface, the distance between the recent obstacles is 5m, and the real-time image of the surrounding environment is used to judge the nearest. The direction or location of the obstacle.

Summary of the invention

Embodiments of the present application provide a navigation interface display method and apparatus for visually displaying various environmental information on a navigation interface.

To achieve the above objective, the embodiment of the present application adopts the following technical solutions:

In a first aspect, a navigation interface display method is provided, including:

Obtaining a real-time image of the current location and corresponding auxiliary navigation information, the auxiliary guide The navigation information is measured for the surrounding environment of the current location;

Converting the auxiliary navigation information into a virtual image;

The real-time image and the virtual image are displayed on a navigation interface, wherein the virtual image is superimposed on the real-time image.

In a second aspect, a navigation interface display device is provided, including:

An acquiring unit, configured to acquire a real-time image of the current location and corresponding auxiliary navigation information, where the auxiliary navigation information is measured by the surrounding environment of the current location;

a converting unit, configured to convert the auxiliary navigation information into a virtual image;

And a display unit, configured to display the real-time image and the virtual image on a navigation interface, wherein the virtual image is superimposed on the real-time image.

In a third aspect, a computer storage medium is provided for storing computer software instructions for use in a navigation interface display device, comprising program code designed to perform the navigation interface display method of the first aspect.

In a fourth aspect, a computer program product is provided, which can be directly loaded into an internal memory of a computer and includes software code, and the computer program can be loaded and executed by a computer to implement the navigation interface display method according to the first aspect. .

In a fifth aspect, an electronic device is provided, comprising: a memory for communicating computer execution code, and a processor for executing the computer to perform code control to perform the navigation according to the first aspect An interface display method is used for navigating data transmission between the interface display device and an external device.

The navigation interface display method and device provided by the embodiments of the present application obtain the real-time image of the current location and the corresponding auxiliary navigation information, and convert the auxiliary navigation information into a virtual image and superimpose it on the real-time image for display, so that the auxiliary navigation information is further Intuitively displayed on the navigation interface, it is easy to make navigation decisions quickly with real-time images.

DRAWINGS

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings to be used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only Is some embodiments of the present application, for Those skilled in the art can also obtain other drawings based on these drawings without paying any creative work.

FIG. 1 is a schematic structural diagram of a navigation interface display system according to an embodiment of the present disclosure;

2 is a schematic structural diagram of a server according to an embodiment of the present application;

FIG. 3 is a schematic flowchart of a navigation interface display method according to an embodiment of the present disclosure;

4 is a schematic diagram of the distance of the auxiliary navigation information provided by the embodiment of the present application as a nearby obstacle;

FIG. 5 is a schematic diagram of the auxiliary navigation information provided by the embodiment of the present application as location information;

FIG. 6 is a schematic diagram of displaying real-time images and virtual images on a navigation interface according to an embodiment of the present application;

FIG. 7 is a schematic diagram of another real-time image and a virtual image displayed on a navigation interface according to an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a navigation interface display device according to an embodiment of the present disclosure;

FIG. 9 is a schematic structural diagram of another navigation interface display device according to an embodiment of the present disclosure;

FIG. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

detailed description

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the drawings in the embodiments of the present application. It is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

The embodiment of the present application provides a navigation interface display system, which is shown in FIG. 1 and includes: a server 1 and a corresponding display device 2 located in the cloud, and a terminal 3 located at the site. The server 1 includes a navigation interface display device 11 for controlling content displayed in the display device 2. The display device 2 may include a device having a display function such as a display, a tablet, or the like. Terminal 3 can be a smart device that combines information collection and presentation (such as mobile phone, smart glasses, smart helmet, etc.), which can collect target information and send it to the server 1 through wired (for example, cable, network cable) or wireless (for example, WIFI, Bluetooth), and is controlled by the navigation interface display device 11 of the server. Display is performed on the display device 2. Target information includes, but is not limited to, sound, image, distance, light intensity, three-dimensional data, and the like.

The server 1 provided by the embodiment of the present application, as shown in FIG. 2, includes: the server 12 includes: a processor 1101, a memory 1102, and a communication interface 1103, which are connected by a bus. The memory 1102 is configured to store code and data and the like for execution by the processor 1101, and the communication interface 1103 is configured to communicate with the terminal 3 in a wired or wireless manner.

Embodiments of the present application are particularly applicable to guide blind helmet products. In the process of guiding blindness, environmental information such as images and distances are collected by the guide helmet located in the field, and then transmitted to the server located in the cloud and displayed by the server on the navigation interface, which is displayed by the manual customer service according to the navigation interface. Environmental information makes blind decisions.

The embodiment of the present application provides a navigation interface display method, as shown in FIG. 3, including:

S101. The server acquires a real-time image of the current location and corresponding auxiliary navigation information, where the auxiliary navigation information is measured by a surrounding environment of the current location, and the auxiliary navigation information is used to provide decision assistance when making a navigation decision for the terminal.

The auxiliary navigation information described in the embodiments of the present application may include: a distance of a nearby obstacle measured by a distance sensor such as an ultrasonic radar or a laser radar, or a position information corresponding to a GPS signal measured by a GPS sensor, or received by a transceiver. The base station signal performs position information obtained by three-point positioning and the like. It will be understood by those skilled in the art that the embodiments of the present application are merely exemplified by the above-mentioned types, and those skilled in the art may also think that other types of auxiliary navigation information are also applicable to the present application, and details are not described herein again.

Preferably, the terminal is a guide blind device.

S102. The server converts the auxiliary navigation information into a virtual image.

Exemplarily, referring to FIG. 4, when the auxiliary navigation information is the distance of the nearby obstacle, since a plurality of distance sensors are generally used, and respectively, different directions are detected. Direction, so the actual distribution position of each distance sensor can be represented by a different position marker 401 in the virtual image to represent the distance sensor in different measurement directions (shown by black arrows in the figure). And different colors can be used to represent the distance value measured by the distance sensor in each direction, for example, the first color indicates safety, indicating nearby obstacles; the second color indicates normal alarm, indicating that there is an obstacle in the distance; The third color indicates a severe alarm indicating that there is an obstacle in the close range or the movement speed is fast. By combining different colors with different position markers, the alarm information of the distance sensor is enhanced, so that the manual customer service can easily judge the dangerous direction and urgency. Preferably, the first color is green, the second color is yellow, and the third color is red.

When the auxiliary navigation information is position information, as shown in FIG. 5, the current position 501 and the forward direction 502 corresponding to the position information may be displayed in a map in the virtual image.

S103. The server displays the real-time image and the virtual image on the navigation interface, wherein the virtual image is superimposed on the real-time image.

Illustratively, when the auxiliary navigation information is the distance of the nearby obstacle, as shown in FIG. 6, the virtual image 601 representing the distance sensor may be superimposed on the real-time image 602. The solid mark in the virtual image 601 indicates that the distance sensor in the direction measures an obstacle nearby, and in combination with the real-time image 601, it is found that the object 6021 exists in the direction, so that the navigation decision can be made accordingly.

When the auxiliary navigation information is position information, as shown in FIG. 7, the virtual image 701 representing the position information in the form of a map may be superimposed on the live image 602. The current location in the map can be known to facilitate further navigation decisions.

The navigation interface display method provided by the embodiment of the present application obtains the real-time image of the current location and the corresponding auxiliary navigation information, and converts the auxiliary navigation information into a virtual image and superimposes it on the real-time image for display, so that the auxiliary navigation information is more intuitively Displayed on the navigation interface, it is easy to make navigation decisions quickly with real-time images.

The embodiments of the present application may divide the functional modules of each device according to the foregoing method example. For example, each functional module may be divided according to each function, or two or more functions may be integrated into one processing module. The above integrated modules can be used It can be implemented in the form of hardware or in the form of software function modules. It should be noted that the division of the module in the embodiment of the present application is schematic, and is only a logical function division, and the actual implementation may have another division manner.

FIG. 8 is a schematic diagram showing a possible structure of the navigation interface display device involved in the above embodiment. The navigation interface display device 11 includes: an acquisition unit 1111 and a conversion unit. 1112. Display unit 1113. The obtaining unit 1111 is configured to support the navigation interface display device to perform the process S101 in FIG. 3; the converting unit 1112 is configured to support the navigation interface display device to perform the process S102 in FIG. 3; and the display unit 1113 is configured to support the navigation interface display device to perform the process in FIG. Process S103. Specifically, the acquiring unit 1111 is configured to acquire a real-time image of the current location and corresponding auxiliary navigation information, where the auxiliary navigation information is measured by the surrounding environment of the current location; the converting unit 1112 is configured to convert the auxiliary navigation information into a virtual image; 1113 is used to display real-time images and virtual images on a navigation interface, wherein the virtual images are superimposed on the real-time images. All the related content of the steps involved in the foregoing method embodiments may be referred to the functional descriptions of the corresponding functional modules, and details are not described herein again.

In one possible design, the auxiliary navigation information is distance information, the virtual image contains markers at different positions, the markers at different positions are used to identify the actual distribution position of the distance sensor, and the markers at different positions represent the distance sensor measured by different colors. Distance value.

In one possible design, the markers at different positions are safe in the first color, indicating no obstacles in the vicinity; the second color indicates the normal alarm, indicating that there is an obstacle in the distance; the third color indicates the severe alarm, indicating Obstacle or obstacle moves at a short distance.

In one possible design, the auxiliary navigation information is the current location and the virtual image displays the current location as a map.

In one possible design, the terminal is a guide blind device.

In the case of using an integrated unit, FIG. 9 shows a possible structural diagram of the navigation interface display device involved in the above embodiment. Navigation interface display device 11 includes a processing module 1122 and a communication module 1123. The processing module 1122 is configured to control and manage the actions of the navigation interface display device. For example, the processing module 1122 is configured to support the navigation interface display device to perform the processes S101-S103 in FIG. 3. The communication module 1113 is for supporting communication between the navigation interface display device and other entities, such as communication with the functional modules or network entities shown in FIG. The navigation interface display device 11 may further include a storage module 1121 for storing program codes and data of the navigation interface display device.

The processing module 1122 may be a processor or a controller, for example, may be a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (application-specific Integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, transistor logic device, hardware component, or any combination thereof. It is possible to implement or carry out the various illustrative logical blocks, modules and circuits described in connection with the present disclosure. The processor may also be a combination of computing functions, for example, including one or more microprocessor combinations, a combination of a DSP and a microprocessor, and the like. The communication module 1123 can be a transceiver, a transceiver circuit, a communication interface, or the like. The storage module 1121 can be a memory.

When the processing module 1122 is a processor, the communication module 1123 is a transceiver, and the storage module 1121 is a memory, the navigation interface display device according to the embodiment of the present application may be the electronic device shown in FIG.

Referring to FIG. 10, the electronic device 1 includes a processor 1132, a transceiver 1133, a memory 1131, and a bus 1134. The transceiver 1133, the processor 1132, and the memory 1131 are connected to each other through a bus 1134; the bus 1134 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. Wait. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 11, but it does not mean that there is only one bus or one type of bus.

The steps of a method or algorithm described in connection with the present disclosure may be implemented in a hardware or may be implemented by a processor executing software instructions. Ben Shen The embodiment also provides a storage medium, which may include a memory 1131 for storing computer software instructions for use, including program code designed to execute a navigation interface display method. Specifically, the software instructions may be composed of corresponding software modules, and the software modules may be stored in a random access memory (RAM), a flash memory, a read only memory (ROM), and an erasable programmable only. An erasable programmable ROM (EPROM), an electrically erasable programmable read only memory (EEPROM), or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor to enable the processor to read information from, and write information to, the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in the middle. Of course, the processor and the storage medium may also be present as discrete components.

The embodiment of the present application further provides a computer program, which can be directly loaded into the memory 1131 and contains software code. After the computer program is loaded and executed by the computer, the navigation interface display method described above can be implemented.

The foregoing is only a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application. It should be covered by the scope of protection of this application. Therefore, the scope of protection of the present application should be determined by the scope of the claims.

Claims

A navigation interface display method, comprising:

Obtaining a real-time image of the current location and corresponding auxiliary navigation information, where the auxiliary navigation information is measured by the surrounding environment of the current location;

Converting the auxiliary navigation information into a virtual image;

The real-time image and the virtual image are displayed on a navigation interface, wherein the virtual image is superimposed on the real-time image.
The method according to claim 1, wherein the auxiliary navigation information is distance information, the virtual image includes indicia of different positions, and the indicia of the different positions are used to identify an actual distribution position of the distance sensor, The markers at different locations represent the distance values measured by the distance sensor in different colors.
The method according to claim 2, wherein the mark of the different position is safe in a first color, indicating no obstacles in the vicinity; the ordinary color is represented in a second color, indicating that there is an obstacle in a long distance; The three colors indicate a serious alarm, indicating that obstacles or obstacles move at a short distance.
The method according to claim 1, wherein the auxiliary navigation information is a current location, and the virtual image displays a current location in a map form.
A navigation interface display device, comprising:

An acquiring unit, configured to acquire a real-time image of the current location and corresponding auxiliary navigation information, where the auxiliary navigation information is measured by the surrounding environment of the current location;

a converting unit, configured to convert the auxiliary navigation information into a virtual image;

And a display unit, configured to display the real-time image and the virtual image on a navigation interface, wherein the virtual image is superimposed on the real-time image.
The apparatus according to claim 5, wherein the auxiliary navigation information is distance information, the virtual image includes indicia of different positions, and the indicia of the different positions are used to identify an actual distribution position of the distance sensor, The markers at different locations represent the distance values measured by the distance sensor in different colors.
Apparatus according to claim 6 wherein said different locations The mark is safe in the first color, indicating no obstacles nearby; the second color indicates the normal alarm, indicating that there is an obstacle in the distance; the third color indicates the severe alarm, indicating that there is an obstacle or obstacle moving speed in the close distance. fast.
The apparatus according to claim 5, wherein said auxiliary navigation information is a current location, and said virtual image displays a current location in a map form.
A computer storage medium for storing computer software instructions for use as a navigation interface display device, comprising program code designed to perform the navigation interface display method according to any one of claims 1 to 4.
A computer program product, which can be directly loaded into an internal memory of a computer and containing software code, which can be loaded and executed by a computer to implement the method of any one of claims 1 to 4. Navigation interface display method.
An electronic device, comprising: a memory, a communication interface for storing computer execution code, and a processor for executing the computer to execute code control to perform any one of claims 1 to 4. The navigation interface display method is used for guiding data transmission between the interface display device and an external device.