CN111723682A - Method and device for providing location service, readable storage medium and electronic equipment - Google Patents
Method and device for providing location service, readable storage medium and electronic equipment Download PDFInfo
- Publication number
- CN111723682A CN111723682A CN202010470666.9A CN202010470666A CN111723682A CN 111723682 A CN111723682 A CN 111723682A CN 202010470666 A CN202010470666 A CN 202010470666A CN 111723682 A CN111723682 A CN 111723682A
- Authority
- CN
- China
- Prior art keywords
- marker
- mobile terminal
- image
- positioning
- position information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 239000003550 marker Substances 0.000 claims abstract description 266
- 230000004044 response Effects 0.000 claims abstract description 18
- 238000004590 computer program Methods 0.000 claims description 12
- 238000003062 neural network model Methods 0.000 claims description 5
- 238000012549 training Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 abstract description 8
- 230000000875 corresponding effect Effects 0.000 description 14
- 238000005516 engineering process Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000010801 machine learning Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/24—Aligning, centring, orientation detection or correction of the image
- G06V10/245—Aligning, centring, orientation detection or correction of the image by locating a pattern; Special marks for positioning
Abstract
The disclosure relates to a method, an apparatus, a readable storage medium and an electronic device for providing location services. Applied to a server, the method comprises the following steps: identifying a marker in a positioning image in response to a positioning request received from a mobile terminal; acquiring position information of a marker in a positioning image; determining relative position information of the mobile terminal relative to the marker according to the positioning image; and determining the position information of the mobile terminal according to the position information of the marker and the relative position information. Therefore, hardware equipment does not need to be deployed, the position information of the mobile terminal can be determined only through the positioning image shot by the mobile terminal, and the positioning process is simplified. In addition, in the positioning process, the relative position information of the mobile terminal relative to the marker is considered, so that the position information of the mobile terminal can be accurately determined, and accurate positioning is realized.
Description
Technical Field
The present disclosure relates to the field of positioning technologies, and in particular, to a method and an apparatus for providing location services, a readable storage medium, and an electronic device.
Background
With the rapid development of positioning technology and the continuous update of intelligent terminal technology, location-based services are widely applied to various fields of work and life, and people have higher and higher requirements on positioning accuracy. Outdoor positioning often uses GPS (global positioning System) for positioning. However, when positioning is performed indoors using GPS, the error is large.
In general, positioning is often performed indoors by using a method such as bluetooth, WIFI (Wireless Fidelity), RFID (Radio Frequency Identification), UWB (Ultra-Wideband, non-carrier communication), and the like. However, the bluetooth and WIFI indoor positioning technologies are adopted, so that the positioning error is large, the position information cannot be accurately identified, and hardware needs to be deployed in advance; by adopting the RFID and UWB indoor positioning technology, if higher positioning accuracy is to be achieved, the required hardware cost of related equipment is higher, and the positioning can be realized only by binding the radio frequency tag to the positioning object, if the positioning object is a user, the user can perceive that the user can influence the user experience when the radio frequency tag is bound to the user. Therefore, the existing indoor positioning technology needs to rely on additional hardware equipment during positioning, and the positioning accuracy is not high, so that high-accuracy positioning cannot be realized.
Disclosure of Invention
The disclosure provides a method, an apparatus, a readable storage medium and an electronic device for providing a location service, so as to improve positioning accuracy.
In order to achieve the above object, a first aspect of the present disclosure provides a method for providing a location service, which is applied to a server, and includes:
in response to a positioning request containing a positioning image and received from a mobile terminal, identifying a marker in the positioning image;
acquiring position information of a marker in the positioning image; determining the relative position information of the mobile terminal relative to the marker according to the positioning image;
and determining the position information of the mobile terminal according to the position information of the marker and the relative position information.
Optionally, the determining, according to the positioning image, the relative position information of the mobile terminal with respect to the marker includes:
inputting the positioning image into a relative position information determination model, and obtaining the relative position information of the mobile terminal relative to the marker output by the relative position information determination model, wherein the relative position information determination model is obtained by training a neural network model by taking a sample positioning image as a model input parameter and taking the relative position information of the mobile terminal relative to the marker in the sample positioning image when the sample positioning image is shot as a model output parameter.
Optionally, the determining, according to the positioning image, the relative position information of the mobile terminal with respect to the marker includes:
determining a target key frame image matched with the positioning image from a preset key frame image library, wherein a preset number of frame scene images of the area where the mobile terminal is located currently are stored in the key frame image library;
and determining the relative position information of the mobile terminal relative to the marker according to the three-dimensional point cloud data of the target key frame image and the positioning image.
Optionally, the identifying a marker in a positioning image in response to a positioning request containing the positioning image and sent from a mobile terminal includes:
in response to a positioning request containing a positioning image, which is received from a mobile terminal, extracting a marker image part from the positioning image;
and identifying a target marker image partially matched with the marker image in a preset marker database, and taking a target marker corresponding to the target marker image as a marker in the positioning image, wherein the marker database stores the marker image and a marker identifier.
Optionally, the positioning request further includes a marker image portion extracted from the positioning image by the mobile terminal; the identifying the marker in the positioning image in response to the positioning request containing the positioning image and sent by the mobile terminal comprises:
in response to a positioning request containing a positioning image and sent by a mobile terminal, identifying a target marker image partially matched with the marker image in a preset marker database, and taking a target marker corresponding to the target marker image as a marker in the positioning image, wherein the marker database stores the marker image and a marker identifier.
Optionally, the method further comprises:
and sending the position information of the mobile terminal to the mobile terminal so that the mobile terminal displays the position information of the mobile terminal.
Optionally, the location information of the mobile terminal includes a location of the mobile terminal and an orientation of the mobile terminal; the method further comprises the following steps:
responding to a path planning request sent by the mobile terminal, and planning a path according to a terminal position, a map of an area where the mobile terminal is located currently and the position of the mobile terminal, wherein the path planning request comprises the terminal position;
and sending the planned path and the direction of the mobile terminal to the mobile terminal.
The second aspect of the present disclosure also provides an apparatus for providing location service, which is applied to a server, and includes:
the mobile terminal comprises an identification module, a display module and a display module, wherein the identification module is used for responding to a positioning request containing a positioning image sent by a mobile terminal and identifying a marker in the positioning image;
an acquisition module configured to acquire position information of a marker in the positioning image;
a first determining module configured to determine relative position information of the mobile terminal with respect to the marker from the positioning image;
a second determining module configured to determine location information of the mobile terminal according to the location information of the marker and the relative location information.
Optionally, the first determining module is further configured to input the positioning image into a relative position information determining model, and obtain the relative position information of the mobile terminal relative to the marker output by the relative position information determining model, where the relative position information determining model is obtained by training a neural network model using a sample positioning image as a model input parameter and using the relative position information of the mobile terminal relative to the marker in the sample positioning image when the sample positioning image is captured as a model output parameter.
Optionally, the first determining module includes:
the first determining sub-module is configured to determine a target key frame image matched with the positioning image from a preset key frame image library, wherein a preset number of frame scene images of an area where the mobile terminal is located currently are stored in the key frame image library;
a second determining sub-module configured to determine relative position information of the mobile terminal with respect to the marker from the three-dimensional point cloud data of the target key frame image and the positioning image.
Optionally, the identification module comprises:
the extraction sub-module is configured to be used for responding to a positioning request containing a positioning image sent by a mobile terminal and extracting a marker image part from the positioning image;
the identification submodule is configured to identify a target marker image partially matched with the marker image in a preset marker database, and use a target marker corresponding to the target marker image as a marker in the positioning image, wherein the marker database stores the marker image and a marker identifier.
Optionally, the positioning request further includes a marker image portion extracted from the positioning image by the mobile terminal; the identification module is configured to, in response to a positioning request containing a positioning image and received from a mobile terminal, identify a target marker image partially matching the marker image in a preset marker database, and use a target marker corresponding to the target marker image as a marker in the positioning image, wherein the marker database stores the marker image and a marker identifier.
Optionally, the apparatus further comprises:
a first sending module configured to send the location information of the mobile terminal to cause the mobile terminal to display the location information of the mobile terminal.
Optionally, the location information of the mobile terminal includes a location of the mobile terminal and an orientation of the mobile terminal; the device further comprises:
the planning module is configured to respond to a path planning request sent by the mobile terminal, and perform path planning according to an end point position, a map of an area where the mobile terminal is located currently and the position of the mobile terminal, wherein the path planning request comprises the end point position;
a second sending module configured to send the planned path and the orientation of the mobile terminal to the mobile terminal.
The third aspect of the present disclosure also provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the method provided by the first aspect of the present disclosure.
The fourth aspect of the present disclosure also provides an electronic device, including:
a memory having a computer program stored thereon;
a processor for executing the computer program in the memory to implement the steps of the method provided by the first aspect of the present disclosure.
According to the technical scheme, the position information of the mobile terminal can be determined through the position information of the marker in the positioning image and the relative position information of the mobile terminal relative to the marker, hardware equipment does not need to be deployed, the position information of the mobile terminal can be determined only through the positioning image shot by the mobile terminal, and the positioning process is simplified. In addition, in the positioning process, the relative position information of the mobile terminal relative to the marker is considered, so that the position information of the mobile terminal can be accurately determined, and accurate positioning is realized.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure without limiting the disclosure. In the drawings:
fig. 1 is a flow chart illustrating a method of providing location services in accordance with an example embodiment.
FIG. 2 is a flow diagram illustrating a method of identifying markers in a scout image according to an exemplary embodiment.
Fig. 3 is a flow chart illustrating a method of determining relative position information of a mobile terminal with respect to a marker according to an example embodiment.
Fig. 4 is a flowchart illustrating a method of providing location services according to another exemplary embodiment.
Fig. 5 is a block diagram illustrating an apparatus for providing location services according to an example embodiment.
FIG. 6 is a block diagram illustrating an electronic device in accordance with an example embodiment.
Detailed Description
Considering that different markers are usually present in a room and the positions of the markers are determined, and that some markers are present around the locator when the locator is in the room, the position of the locator can be determined based on the positions of the markers in the room. Therefore, the defect that hardware equipment needs to be deployed in indoor positioning can be avoided. Furthermore, the inventors consider that the locator is not necessarily located at the position of the marker, that is, there may be a certain deviation between the position of the locator and the position of the marker, which may result in low positioning accuracy if the position of the marker is directly determined as the position of the locator. Based on the above analysis, the present disclosure provides a method, an apparatus, a readable storage medium, and an electronic device for providing location services.
The following detailed description of specific embodiments of the present disclosure is provided in connection with the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating the present disclosure, are given by way of illustration and explanation only, not limitation.
Fig. 1 is a flowchart illustrating a method of providing a location service, which is applied to a server, according to an exemplary embodiment. As shown in fig. 1, the method may include the following steps.
In step 11, in response to a positioning request containing a positioning image received from a mobile terminal, a marker in the positioning image is identified.
In the present disclosure, the method of providing location services may be applied in an outdoor environment as well as an indoor environment. The present disclosure does not specifically limit this. When a user needs to determine the current position of the user, a scene image (hereinafter referred to as a positioning image) of the current environment of the user is shot through a mobile terminal of the user, wherein the scene image at least comprises a marker image part, and then a positioning request is sent to a server, wherein the positioning request comprises the scene image. In this way, the server can receive the positioning request containing the positioning image sent by the mobile terminal, and identify the marker in the positioning image by using the image identification technology. The sign can be a signboard, a propaganda banner, a shop front, a guide sign, a landmark and the like of each merchant in a room.
Among them, the mobile terminal may include but is not limited to: smart phones, tablets, personal digital assistants, wearable electronic devices, and the like.
In step 12, position information of the marker in the scout image is acquired.
In addition, the server stores the marker identifiers in the current area of the mobile terminal and the position information of the markers corresponding to the marker identifiers in advance, so that after the markers in the positioning image are identified in step 11, the server can further acquire the position information of the markers in the positioning image.
In step 13, relative position information of the mobile terminal relative to the marker is determined according to the positioning image.
As shown above, there may be a certain deviation between the current position of the mobile terminal and the position of the marker, and in the present disclosure, in order to improve the accuracy of positioning, in the positioning process, the relative position information of the mobile terminal that captures the positioning image with respect to the marker needs to be determined. It should be noted that, in the present disclosure, step 12 may be executed first and then step 13 may be executed, step 13 may be executed first and then step 12 may be executed, and step 12 and step 13 may also be executed simultaneously.
In step 14, the position information of the mobile terminal is determined based on the position information and the relative position information of the marker.
After the position information of the marker and the relative position information of the mobile terminal with respect to the marker are respectively determined in the above manner, the position information of the mobile terminal may be determined based on the position information and the relative position information of the marker. For example, the position information of the marker and the relative position information may be superimposed to obtain the position information of the mobile terminal. The position information and the relative position information of the marker are based on the same position coordinate system.
By adopting the technical scheme, the position information of the mobile terminal can be determined through the position information of the marker in the positioning image and the relative position information of the mobile terminal relative to the marker, so that hardware equipment does not need to be deployed, the position information of the mobile terminal can be determined only through the positioning image shot by the mobile terminal, and the positioning process is simplified. In addition, in the positioning process, the relative position information of the mobile terminal relative to the marker is considered, so that the position information of the mobile terminal can be accurately determined, and accurate positioning is realized.
In order to provide a better understanding of the method for providing location services provided by the present disclosure, a full embodiment is described below.
First, a specific embodiment in fig. 1 will be described in which a marker in a positioning image is recognized in response to a positioning request including the positioning image received from a mobile terminal.
In one embodiment, the markers in the positioning image may be identified based on the positioning image included in the positioning request. However, considering that the positioning image may include other information unrelated to the marker besides the marker image portion, if the whole frame of positioning image is identified to determine the marker in the positioning image, so that the identified area is larger (the whole frame of positioning image), the workload of comparing the pixel points or the feature points in the image identification process may be increased. Therefore, in the present disclosure, it is preferable that the marker image portion be recognized to determine the marker in the positioning image.
In another embodiment, as shown in fig. 2, step 11 in fig. 1 may specifically include the following steps.
In step 111, in response to a positioning request containing a positioning image received from a mobile terminal, a marker image portion is extracted from the positioning image.
In this embodiment, when receiving a positioning request sent by a mobile terminal, a server extracts a marker image portion from a positioning image included in the positioning request. The marker image portion may be extracted by an image recognition technique or a machine learning method, which is not specifically limited in this disclosure.
In step 112, a target marker image partially matching the marker image is identified in a preset marker database, and a target marker corresponding to the target marker image is used as a marker in the positioning image.
The marker database stores marker images and marker identifications in advance, and the marker identifications can be marker names. Where the marker is a merchant sign, the marker identity may be a merchant name.
Specifically, after the marker image portion is extracted, a target marker image matching the marker image portion is identified in a preset marker database. For example, the similarity of the marker image portion and the marker images stored in the marker database may be calculated, respectively, and the marker image having the greatest similarity may be determined as the target marker image matching the marker image portion.
It should be noted that one or more markers may be included in the positioning image, and in the case that a plurality of markers are included, a plurality of marker image portions may be extracted accordingly. In one mode, the similarity between any one of the marker image portions and the marker images stored in the marker database may be calculated, and the marker image with the maximum similarity may be determined as the target marker image matching the marker image portion, and the other marker image portions may be ignored. For example, assuming that the marker a, the marker B, and the marker C are included in the positioning image, a marker a image portion, a marker B image portion, and a marker C image portion may be extracted. One of the marker image portions may be arbitrarily selected for matching with the marker images stored in the marker database to identify the marker corresponding to the selected marker image portion. For example, a marker a image portion is selected, the similarity between the marker a image portion and the marker images stored in the marker database is calculated, respectively, and the marker image having the greatest similarity is determined as the target marker image matching the marker a image portion.
In another mode, for each marker image portion, the similarity between the marker image portion and the stored marker images in the marker database is calculated, and the marker image with the maximum similarity is determined as the target marker image matched with the marker image portion, so as to obtain the marker image matched with each marker image portion. After that, the marker image having the greatest similarity is determined as the target marker image again. Illustratively, following the above example, assuming that the marker image matching the image portion of the marker a is the image a, the similarity between the two is 0.6, the marker image matching the image portion of the marker B is the image B, the similarity between the two is 0.8, the marker image matching the image portion of the marker C is the image C, and the similarity between the two is 0.9, the image C is determined as the target marker image.
After the target marker image is determined according to the method, the target marker corresponding to the target marker image is determined according to the identification of the target marker image, and the target marker is used as the marker in the positioning image.
In a further embodiment, the positioning request may comprise, in addition to the positioning image, a marker image portion extracted from the positioning image by the mobile terminal. Correspondingly, when the server receives the positioning request, the server can acquire the marker image part, then identify a target marker image matched with the marker image part in a preset marker database, and take the target marker corresponding to the target marker image as the marker in the positioning image.
The mobile terminal may extract the marker image portion through an image recognition technique or a machine learning manner, which is not specifically limited in this disclosure. The specific implementation of identifying the target marker image partially matching with the marker image and using the target marker corresponding to the target marker image as the marker in the positioning image is as described above, and is not described herein again.
It should be noted that, the preset marker database may also store the position information of the markers in advance, so that after the target marker image is determined, the position information of the target marker corresponding to the target marker image may be further acquired, and the position information may be determined as the position information of the markers in the positioning image.
Next, a specific embodiment of determining the relative position information of the mobile terminal with respect to the marker from the positioning image in fig. 1 will be described.
In one embodiment of the present disclosure, the relative position information of the mobile terminal with respect to the marker may be determined by way of machine learning. Specifically, the positioning image is input to the relative position information determination model, and the relative position information of the mobile terminal relative to the marker output by the relative position information determination model is obtained.
In this embodiment, the relative position information determination model may be trained in advance. For example, for each marker in the area, images including the marker are respectively captured at different positions and directions, the images may be referred to as sample positioning images, the sample positioning images serve as model input parameters, relative position information of the mobile terminal relative to the marker in the sample positioning images when the sample positioning images are captured serves as model output parameters, and the neural network model is trained to obtain a relative position information determination model.
It should be noted that in this embodiment, a total relative position information determination model may be trained for all markers in the area. However, considering that the accuracy of the relative position information determination model is low, the output relative position information of the mobile terminal relative to the markers may not be accurate after the positioning image is input to the relative position information determination model, and therefore, in an embodiment, a relative position information determination model may be trained for each marker in the area by using a division principle. After the marker in the positioning image is identified, the relative position information determining model corresponding to the marker is determined, and then the positioning image is input into the determined relative position information determining model to obtain the relative position information of the mobile terminal relative to the marker output by the relative position information determining model.
In order to improve the accuracy of the determination of the relative position and ensure the accuracy of the determined position information of the mobile terminal, in another embodiment of the present disclosure, another method for determining the relative position information of the mobile terminal with respect to the marker based on the positioning image is provided. Referring to fig. 3, fig. 3 is a flowchart illustrating a method of determining relative position information of a mobile terminal with respect to a marker according to an example embodiment. As shown in fig. 3, the method may include the following steps.
In step 131, a target key frame image matching the positioning image is determined from a preset key frame image library.
The key frame image library can be pre-established in the following way: firstly, recording a video of an area (such as a certain shopping mall) where the mobile terminal is currently located, so that the video can include all markers in the area, then extracting a preset number of scene images including the markers in the area from the video according to a preset rule, using the scene images as key frame images, and storing the key frame images in a database to obtain a key frame image library. In this way, the preset number of frames of the current area of the mobile terminal including the scene images of the markers in the area are stored in the key frame image library.
The similarity between the positioning image and each scene image in the preset key frame image library may be calculated through an image processing technique in the related art, and the scene image with the maximum similarity is determined as the target key frame image matched with the positioning image, which is not specifically illustrated and limited in the present disclosure.
In step 132, the relative position information of the mobile terminal relative to the marker is determined according to the three-dimensional point cloud data of the target key frame image and the positioning image.
Besides the preset number of frames of scene images, the key frame image library also stores three-dimensional point cloud data of each scene image in a correlated manner. Therefore, when the target key frame image matched with the positioning image is determined, the three-dimensional point cloud data of the target key frame image can be determined. And then, determining the relative position information of the mobile terminal relative to the marker according to the three-dimensional point cloud data and the positioning image of the target key frame image. Specifically, according to the mapping relationship between the three-dimensional point cloud data of the target key frame image and the two-dimensional positioning image, the relative position information of the mobile terminal relative to the marker is calculated through a Direct Linear Transformation (DLT) algorithm.
After the relative position information of the mobile terminal relative to the marker is determined according to the above mode, the relative position information and the position information of the marker are superposed to obtain the position information of the mobile terminal.
In an implementation manner, after the location information of the mobile terminal is determined, the server may further send the location information of the mobile terminal to the mobile terminal, so that the mobile terminal displays the location information, and a user of the mobile terminal may know a current location of the user.
In another embodiment, the location information of the mobile terminal includes a location of the mobile terminal and an orientation of the mobile terminal. Fig. 4 is a flowchart illustrating a method of providing location services according to another exemplary embodiment. As shown in fig. 4, the method for providing location services may further include steps 15 and 16 in addition to steps 11 to 14.
In step 15, in response to the path planning request received from the mobile terminal, a path is planned according to the end position, the map of the area where the mobile terminal is currently located, and the position of the mobile terminal.
When a path planning request sent by the mobile terminal is received, a path can be planned for the mobile terminal according to the end point position included in the path planning request, the map of the current area where the mobile terminal is located, and the position of the mobile terminal determined by the scheme. The path planning may be performed by using a related technology, which is not described herein again.
In step 16, the planned path and the orientation of the mobile terminal are transmitted to the mobile terminal.
In some cases, the user of the mobile terminal may have poor sense of direction and may not know the current direction of the user, and even after the user looks at the planned path, the movement trajectory of the user may deviate from the path planned by the server. In order to avoid the inconsistency between the movement track of the user and the planned path and ensure that the user can quickly move along the planned path, in the disclosure, the server sends the planned path and the orientation of the mobile terminal to the mobile terminal after planning the path, so that the user can know the orientation of the mobile terminal. It should be noted that, the user's direction is usually the same as the direction of the mobile terminal, so that when knowing the direction of the mobile terminal, the user can know the direction of the user, and can move along the planned path quickly.
Based on the same inventive concept, the disclosure also provides a device for providing location service. Fig. 5 is a block diagram illustrating an apparatus for providing a location service according to an exemplary embodiment, applied to a server, and as shown in fig. 5, the apparatus may include:
an identification module 51 configured to identify a marker in a positioning image in response to a positioning request containing the positioning image received from a mobile terminal;
an obtaining module 52 configured to obtain position information of a marker in the positioning image;
a first determining module 53 configured to determine relative position information of the mobile terminal with respect to the marker from the positioning image;
a second determining module 54 configured to determine the location information of the mobile terminal according to the location information of the marker and the relative location information.
Optionally, the first determining module 53 is further configured to input the positioning image into a relative position information determining model, and obtain the relative position information of the mobile terminal relative to the marker output by the relative position information determining model, where the relative position information determining model is obtained by training a neural network model using a sample positioning image as a model input parameter and using the relative position information of the mobile terminal relative to the marker in the sample positioning image when the sample positioning image is captured as a model output parameter.
Optionally, the first determining module 53 may include:
the first determining sub-module is configured to determine a target key frame image matched with the positioning image from a preset key frame image library, wherein a preset number of frame scene images of an area where the mobile terminal is located currently are stored in the key frame image library;
a second determining sub-module configured to determine relative position information of the mobile terminal with respect to the marker from the three-dimensional point cloud data of the target key frame image and the positioning image.
Optionally, the identification module 51 may include:
the extraction sub-module is configured to be used for responding to a positioning request containing a positioning image sent by a mobile terminal and extracting a marker image part from the positioning image;
the identification submodule is configured to identify a target marker image partially matched with the marker image in a preset marker database, and use a target marker corresponding to the target marker image as a marker in the positioning image, wherein the marker database stores the marker image and a marker identifier.
Optionally, the positioning request further includes a marker image portion extracted from the positioning image by the mobile terminal; the identification module 51 is configured to, in response to a positioning request including a positioning image sent from a mobile terminal, identify a target marker image matching the marker image portion extracted from the positioning image by the mobile terminal in a preset marker database in which the marker image and a marker identifier are stored, and use a target marker corresponding to the target marker image as a marker in the positioning image.
Optionally, the apparatus further comprises:
a first sending module configured to send the location information of the mobile terminal to cause the mobile terminal to display the location information of the mobile terminal.
Optionally, the location information of the mobile terminal includes a location of the mobile terminal and an orientation of the mobile terminal; the apparatus may further include:
the planning module is configured to respond to a path planning request sent by the mobile terminal, and perform path planning according to an end point position, a map of an area where the mobile terminal is located currently and the position of the mobile terminal, wherein the path planning request comprises the end point position;
a second sending module configured to send the planned path and the orientation of the mobile terminal to the mobile terminal.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
FIG. 6 is a block diagram illustrating an electronic device in accordance with an example embodiment. For example, the electronic device 600 may be provided as a server. Referring to fig. 6, the electronic device 600 includes a processor 622, which may be one or more in number, and a memory 632 for storing computer programs executable by the processor 622. The computer program stored in memory 632 may include one or more modules that each correspond to a set of instructions. Further, the processor 622 may be configured to execute the computer program to perform the method of providing location services described above.
Additionally, electronic device 600 may also include a power component 626 that may be configured to perform power management of electronic device 600 and a communication component 650 that may be configured to enable communication, e.g., wired or wireless communication, of electronic device 600. The electronic device 600 may also include input/output (I/O) interfaces 658. The electronic device 600 may operate based on an operating system stored in the memory 632, such as Windows Server, Mac OSXTM, UnixTM, LinuxTM, and the like.
In another exemplary embodiment, a computer readable storage medium comprising program instructions which, when executed by a processor, implement the steps of the above-described method of providing location services is also provided. For example, the computer readable storage medium may be the memory 632 described above that includes program instructions executable by the processor 622 of the electronic device 600 to perform the method of providing location services described above.
In another exemplary embodiment, a computer program product is also provided, which comprises a computer program executable by a programmable apparatus, the computer program having code portions for performing the above-mentioned method of providing location services when executed by the programmable apparatus.
The preferred embodiments of the present disclosure are described in detail with reference to the accompanying drawings, however, the present disclosure is not limited to the specific details of the above embodiments, and various simple modifications may be made to the technical solution of the present disclosure within the technical idea of the present disclosure, and these simple modifications all belong to the protection scope of the present disclosure.
It should be noted that the various features described in the above embodiments may be combined in any suitable manner without departing from the scope of the invention. In order to avoid unnecessary repetition, various possible combinations will not be separately described in this disclosure.
In addition, any combination of various embodiments of the present disclosure may be made, and the same should be considered as the disclosure of the present disclosure, as long as it does not depart from the spirit of the present disclosure.
Claims (10)
1. A method for providing location services, applied to a server, comprising:
in response to a positioning request containing a positioning image and received from a mobile terminal, identifying a marker in the positioning image;
acquiring position information of a marker in the positioning image; determining the relative position information of the mobile terminal relative to the marker according to the positioning image;
and determining the position information of the mobile terminal according to the position information of the marker and the relative position information.
2. The method according to claim 1, wherein the determining the relative position information of the mobile terminal with respect to the marker according to the positioning image comprises:
inputting the positioning image into a relative position information determination model, and obtaining the relative position information of the mobile terminal relative to the marker output by the relative position information determination model, wherein the relative position information determination model is obtained by training a neural network model by taking a sample positioning image as a model input parameter and taking the relative position information of the mobile terminal relative to the marker in the sample positioning image when the sample positioning image is shot as a model output parameter.
3. The method according to claim 1, wherein the determining the relative position information of the mobile terminal with respect to the marker according to the positioning image comprises:
determining a target key frame image matched with the positioning image from a preset key frame image library, wherein a preset number of frame scene images of the area where the mobile terminal is located currently are stored in the key frame image library;
and determining the relative position information of the mobile terminal relative to the marker according to the three-dimensional point cloud data of the target key frame image and the positioning image.
4. The method according to claim 1, wherein the identifying a marker in the positioning image in response to receiving a positioning request containing the positioning image sent from a mobile terminal comprises:
in response to a positioning request containing a positioning image, which is received from a mobile terminal, extracting a marker image part from the positioning image;
and identifying a target marker image partially matched with the marker image in a preset marker database, and taking a target marker corresponding to the target marker image as a marker in the positioning image, wherein the marker database stores the marker image and a marker identifier.
5. The method according to claim 1, characterized in that the positioning request further comprises a marker image portion extracted from the positioning image by the mobile terminal; the identifying the marker in the positioning image in response to the positioning request containing the positioning image and sent by the mobile terminal comprises:
in response to a positioning request containing a positioning image and sent by a mobile terminal, identifying a target marker image partially matched with the marker image in a preset marker database, and taking a target marker corresponding to the target marker image as a marker in the positioning image, wherein the marker database stores the marker image and a marker identifier.
6. The method of claim 1, further comprising:
and sending the position information of the mobile terminal to the mobile terminal so that the mobile terminal displays the position information.
7. The method according to claim 1, wherein the location information of the mobile terminal comprises a location of the mobile terminal and an orientation of the mobile terminal; the method further comprises the following steps:
responding to a path planning request sent by the mobile terminal, and planning a path according to a terminal position, a map of an area where the mobile terminal is located currently and the position of the mobile terminal, wherein the path planning request comprises the terminal position;
and sending the planned path and the direction of the mobile terminal to the mobile terminal.
8. An apparatus for providing location service, applied to a server, comprising:
the mobile terminal comprises an identification module, a display module and a display module, wherein the identification module is used for responding to a positioning request containing a positioning image sent by a mobile terminal and identifying a marker in the positioning image;
an acquisition module configured to acquire position information of a marker in the positioning image;
a first determining module configured to determine relative position information of the mobile terminal with respect to the marker from the positioning image;
a second determining module configured to determine location information of the mobile terminal according to the location information of the marker and the relative location information.
9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
10. An electronic device, comprising:
a memory storing a computer program;
a processor for executing the computer program in the memory to carry out the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010470666.9A CN111723682A (en) | 2020-05-28 | 2020-05-28 | Method and device for providing location service, readable storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010470666.9A CN111723682A (en) | 2020-05-28 | 2020-05-28 | Method and device for providing location service, readable storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111723682A true CN111723682A (en) | 2020-09-29 |
Family
ID=72565239
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010470666.9A Withdrawn CN111723682A (en) | 2020-05-28 | 2020-05-28 | Method and device for providing location service, readable storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111723682A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114485605A (en) * | 2020-10-23 | 2022-05-13 | 丰田自动车株式会社 | Position specifying method and position specifying system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006101013A (en) * | 2004-09-28 | 2006-04-13 | Hitachi Ltd | Guide information display |
| CN103067856A (en) * | 2011-10-24 | 2013-04-24 | 康佳集团股份有限公司 | Geographic position locating method and system based on image recognition |
| CN110132274A (en) * | 2019-04-26 | 2019-08-16 | 中国铁道科学研究院集团有限公司电子计算技术研究所 | A kind of indoor orientation method, device, computer equipment and storage medium |
| CN111199564A (en) * | 2019-12-23 | 2020-05-26 | 中国科学院光电研究院 | Indoor positioning method and device of intelligent mobile terminal and electronic equipment |
-
2020
- 2020-05-28 CN CN202010470666.9A patent/CN111723682A/en not_active Withdrawn
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006101013A (en) * | 2004-09-28 | 2006-04-13 | Hitachi Ltd | Guide information display |
| CN103067856A (en) * | 2011-10-24 | 2013-04-24 | 康佳集团股份有限公司 | Geographic position locating method and system based on image recognition |
| CN110132274A (en) * | 2019-04-26 | 2019-08-16 | 中国铁道科学研究院集团有限公司电子计算技术研究所 | A kind of indoor orientation method, device, computer equipment and storage medium |
| CN111199564A (en) * | 2019-12-23 | 2020-05-26 | 中国科学院光电研究院 | Indoor positioning method and device of intelligent mobile terminal and electronic equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114485605A (en) * | 2020-10-23 | 2022-05-13 | 丰田自动车株式会社 | Position specifying method and position specifying system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180188033A1 (en) | Navigation method and device | |
| EP2975555B1 (en) | Method and apparatus for displaying a point of interest | |
| CN105318881B (en) | Map navigation method, device and system | |
| CN111238496B (en) | Robot posture confirming method, device, computer equipment and storage medium | |
| US20130211718A1 (en) | Apparatus and method for providing indoor navigation service | |
| CN109668563B (en) | Indoor-based track processing method and device | |
| CN104936283A (en) | Indoor positioning method, server and system | |
| CN105571583B (en) | User position positioning method and server | |
| EP3163802B1 (en) | Test device for utilizing machine-readable codes for testing a communication network | |
| CN108693548B (en) | Navigation method and system based on scene target recognition | |
| CN103996036A (en) | Map data acquisition method and device | |
| CN103162682A (en) | Indoor path navigation method based on mixed reality | |
| KR102622585B1 (en) | Indoor navigation apparatus and method | |
| CN112150072A (en) | Asset checking method and device based on intelligent robot, electronic equipment and medium | |
| CN111664848A (en) | Multi-mode indoor positioning navigation method and system | |
| KR101573289B1 (en) | Apparatus and method for recongnizing position using camera | |
| KR102033075B1 (en) | A providing location information systme using deep-learning and method it | |
| CN111723682A (en) | Method and device for providing location service, readable storage medium and electronic equipment | |
| CN112689234B (en) | Indoor vehicle positioning method, device, computer equipment and storage medium | |
| CN109190466A (en) | A kind of method and apparatus that personnel position in real time | |
| CN103557834A (en) | Dual-camera-based solid positioning method | |
| CN111060110A (en) | Robot navigation method, robot navigation device and robot | |
| CN115468568A (en) | Indoor navigation method, device and system, server equipment and storage medium | |
| CN113063424B (en) | Method, device, equipment and storage medium for intra-market navigation | |
| US11085992B2 (en) | System and method for positioning a terminal device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200929 |