CN115563072A - Log storage method, device and system for high-precision map data - Google Patents

Log storage method, device and system for high-precision map data Download PDF

Info

Publication number
CN115563072A
CN115563072A CN202211366522.4A CN202211366522A CN115563072A CN 115563072 A CN115563072 A CN 115563072A CN 202211366522 A CN202211366522 A CN 202211366522A CN 115563072 A CN115563072 A CN 115563072A
Authority
CN
China
Prior art keywords
log
target
map data
logs
candidate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211366522.4A
Other languages
Chinese (zh)
Inventor
徐宏祯
刘莹
王辉
白宇
黄杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN202211366522.4A priority Critical patent/CN115563072A/en
Publication of CN115563072A publication Critical patent/CN115563072A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/1805Append-only file systems, e.g. using logs or journals to store data
    • G06F16/1815Journaling file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The disclosure provides a log storage method, device and system for high-precision map data, and relates to the technical field of artificial intelligence, in particular to the technical field of automatic driving. The method is executed by a target server and comprises the following steps: receiving a first service request sent by a superior server; processing the first map data according to the business processing logic of the first map data to generate second map data and a second candidate log; determining the log identifier of the first candidate log as the log identifier of the second candidate log; storing the log generated by the target server to the log storage system based on the second candidate log and the log identification of the second candidate log. The method can be used for tracking the whole process in the production and manufacturing process of the high-precision map, can improve the flexibility of processing the map data, can determine the processing process of the map data, the flow direction of the map data and the problem log positioning problem, and can improve the efficiency of storing the log of the map data and the efficiency of subsequently inquiring the log of the map data.

Description

Log storage method, device and system for high-precision map data
Technical Field
The utility model relates to an artificial intelligence technical field especially relates to automatic driving technical field, can use under the scene of high-accuracy map location.
Background
In the related technology, after map data is subjected to a series of services such as resolving, drawing and labeling, a processing result, namely a part of a high-precision map, is finally obtained, wherein each service module maintains an identifier, an execution path and related intermediate output of the map data in the service module are determined through the identifier, a plurality of service modules at the upstream and the downstream are isolated from each other, the execution path among the plurality of service modules can be connected in series only through request parameters, the whole execution process cannot be observed visually, and the problem is difficult to locate. Therefore, how to improve the flexibility and efficiency of processing map data, and to clarify the flow, data flow direction and positioning problems has become one of important research directions.
Disclosure of Invention
The disclosure provides a log storage method, device and system for high-precision map data.
According to an aspect of the present disclosure, there is provided a log storage method of map data, wherein the log storage method is performed by a target server, and includes:
receiving a first service request sent by a superior server, wherein the first service request comprises first map data and a log identifier of a first candidate log generated when the superior server generates the first map data;
processing the first map data according to the business processing logic of the first map data to generate second map data and a second candidate log;
determining the log identifier of the first candidate log as the log identifier of the second candidate log;
the log generated by the target server is stored to the log storage system based on the second candidate log and the log identification of the second candidate log.
The method can be used for tracking the whole process in the production and manufacturing process of the high-precision map, can improve the flexibility of processing the map data, can determine the processing process of the map data, the flow direction of the map data and the problem log positioning problem, and can improve the efficiency of storing the log of the map data and the efficiency of subsequently inquiring the log of the map data.
According to another aspect of the present disclosure, there is provided a log query method of map data, wherein the log query method is performed by a log storage system and includes:
receiving target logs corresponding to different map data and log identifications of the target logs, wherein the target logs belonging to the same map data are marked in the servers of different levels with the same target identification, and the target identifications corresponding to different map data are different;
responding to a received log query request sent by a client, and acquiring a first log identifier of a log to be queried from the log query request;
determining one or more first target logs corresponding to the first log identification from the target logs;
and sending one or more first target logs to the client.
The method and the device can realize the tracking of the whole process in the production and manufacturing process of the high-precision map, improve the flexibility of inquiring the map data, determine the processing flow of the map data, the flow direction of the map data and the problem log positioning problem, and improve the efficiency of inquiring the log of the map data.
According to another aspect of the present disclosure, there is provided a log storage apparatus of map data, including:
the receiving module is used for receiving a first service request sent by a previous-level server, wherein the first service request comprises first map data and a log identifier of a first candidate log generated when the previous-level server generates the first map data;
the processing module is used for processing the first map data according to the business processing logic of the processing module to generate second map data and a second candidate log;
the determining module is used for determining that the log identifier of the first candidate log is the log identifier of the second candidate log;
and the storage module is used for storing the logs generated by the target server to the log storage system based on the second candidate log and the log identification of the second candidate log.
According to another aspect of the present disclosure, there is provided a log query apparatus for map data, including:
the receiving module is used for receiving target logs corresponding to different map data and log identifications of the target logs, wherein the target logs belonging to the same map data are marked in the servers of different levels with the same target identification, and the target identifications corresponding to different map data are different;
the acquisition module is used for responding to a received log query request sent by a client and acquiring a first log identifier of a log to be queried from the log query request;
the determining module is used for determining one or more first target logs corresponding to the first log identification from the target logs;
and the sending module is used for sending the one or more first target logs to the client.
According to an aspect of the disclosure, an electronic device is proposed, comprising at least one processor, and
a memory communicatively coupled to the at least one processor; wherein, the first and the second end of the pipe are connected with each other,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the log storing method of map data of the present disclosure.
According to an aspect of the disclosure, an electronic device is proposed, comprising at least one processor, and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the log query method of map data of the present disclosure.
According to an aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute a log storage method of map data of the present disclosure.
According to an aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute a log query method of map data of the present disclosure.
According to an aspect of the present disclosure, a computer program product is proposed, comprising a computer program which, when executed by a processor, realizes the steps of the log storage method of map data of the present disclosure.
According to an aspect of the present disclosure, a computer program product is presented, comprising a computer program which, when executed by a processor, realizes the steps of the log query method of map data of the present disclosure.
According to one aspect of the disclosure, a log storage system for map data is provided, wherein the log storage system comprises a multi-level server, a log storage system and a client;
the multi-level server is used for acquiring corresponding target logs according to different map data and storing the target logs and log identifiers of the target logs to the log storage system, wherein the target identifiers marked by the target logs belonging to the same map data in the servers at different levels are the same, and the target identifiers corresponding to different map data are different;
the log storage system is used for receiving target logs corresponding to different map data and log identifications of the target logs, which are sent by the multi-level server; responding to a received log query request sent by a client, and acquiring a first log identifier of a log to be queried from the log query request; determining one or more first target logs corresponding to the first log identification from the target logs; sending one or more first target logs to a client;
the client is used for sending a log query request to the log storage system and receiving one or more first target logs sent by the log storage system.
It should be understood that the statements in this section are not intended to identify key or critical features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
fig. 1 is a flowchart of a log storage method of map data according to one embodiment of the present disclosure;
FIG. 2 is a flow diagram of a method of log storage of map data according to one embodiment of the present disclosure;
FIG. 3 is a flow chart of a method of log storage of map data according to one embodiment of the present disclosure;
FIG. 4 is a flow diagram of a method of log query of map data according to one embodiment of the present disclosure;
FIG. 5 is a flow diagram of a method of log query of map data according to one embodiment of the present disclosure;
FIG. 6 is a schematic diagram of a log storage system for map data according to one embodiment of the present disclosure
FIG. 7 is a schematic diagram of a method of log tracking of map data according to one embodiment of the present disclosure;
FIG. 8 is a block diagram of a log storage of map data according to one embodiment of the present disclosure;
fig. 9 is a structural diagram of a log query apparatus of map data according to one embodiment of the present disclosure;
FIG. 10 is a block diagram of an electronic device used to implement an embodiment of the disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
For a better understanding of the present disclosure, reference is made to the following description of the field to which the present disclosure pertains.
Artificial Intelligence (AI) is a new technical science to study and develop theories, methods, techniques and application systems for simulating, extending and expanding human Intelligence. Artificial intelligence is a branch of computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can react in a manner similar to human intelligence, and research in this field includes robotics, language recognition, image recognition, natural language processing, and expert systems.
The unmanned technology is a complex of multi-leading-edge subjects such as sensors, computers, artificial intelligence, communication, navigation positioning, mode recognition, machine vision, intelligent control and the like.
Fig. 1 is a flowchart of a log storage method of map data according to an embodiment of the present disclosure, as shown in fig. 1, the method is performed by a target server and includes the following steps:
s101, a first service request sent by a superior server is received, wherein the first service request comprises first map data and a log identifier of a first candidate log generated when the superior server generates the first map data.
In the embodiments of the present disclosure, a plurality of servers have a hierarchical relationship therebetween, and in some implementations, different servers have different business functions. Taking high-precision map positioning as an example, a service actually participating in map creation in the server operates and processes map data, and there are input and output of map data or map intermediate data. Alternatively, the business function of the server may implement a series of services of resolving, drawing, labeling, publishing, and the like of the map data.
In the embodiment of the present disclosure, the target server needs to acquire the map data, so as to process the first map data subsequently according to the service processing logic of the target server. In the embodiment of the present disclosure, the map data is obtained through a service request sent by a previous-stage server, optionally, the service request may be a Hyper Text Transfer Protocol (HTTP) request or a Remote Procedure Call (RPC) request, that is, the first service request may be an HTTP request or an RPC request. Alternatively, the map data may be various types of data such as images, text, and the like.
In some implementations, if the target server is a first-level server. Optionally, the initial service request obtained by the first-level server may include initial map data; optionally, the initial service request obtained by the first-level server may include initial map data and a log identifier.
In some implementations, the server may be a physical machine, such as a computer, and the like, and in some implementations, the server may be a container, such as a virtual system, and the like.
In some implementations, the target server invokes an agent service (agent) to receive the first service request, and further obtains first map data in the first service request and a log identifier of a first candidate log generated when the previous-level server generates the first map data.
Optionally, the agent service is a general external service, and is only responsible for forwarding requests, printing and collecting logs, and managing logids during forwarding and collecting processes, and does not participate in actual business processing/map data processing.
And S102, processing the first map data according to the business processing logic of the first map data to generate second map data and a second candidate log.
In some implementations, each server is preconfigured with business processing logic, and optionally, the target server may process the first map data through its preconfigured business processing logic to generate the second map data and the second candidate log.
Alternatively, the number of the second candidate logs may be 1 or more.
Taking high-precision map positioning as an example, if the first map data is the first image of the scene a, the first image of the scene a may be scaled, rotated, and the like according to the business processing logic of the target server itself, so as to generate the second map data and the second candidate log. The second candidate log may include a second image obtained by scaling the first image and a third image obtained by rotating the second image, and the second map data may be the third image.
S103, determining the log identification of the first candidate log as the log identification of the second candidate log.
In the embodiment of the present disclosure, the log identifier of the first candidate log is consistent with the log identifier of the second candidate log, that is, the first candidate log and the second candidate log have the same log identifier.
It should be noted that, if the servers have C levels, in the embodiment of the present disclosure, the logs generated by one initial map data unit in each server of the whole pipeline have the same log identifier, the logs are screened by the log identifier and sorted by time, that is, the initial map data unit is executed in the whole pipeline in the order of time.
And S104, storing the logs generated by the target server to the log storage system based on the second candidate log and the log identification of the second candidate log.
In some implementations, the second candidate log and the log identification of the second candidate log are directly sent to the log storage system to enable storage of the log generated by the target server to the log storage system.
In some implementations, the second candidate log is printed, that is, the second candidate log is sent to the agent service, the log printing time of the second candidate log is obtained, and the agent service forwards the second candidate log, the log printing time, and the log identifier of the second candidate log to the log storage system, so as to store the log generated by the target server in the log storage system.
In the embodiment of the disclosure, a first service request sent by a superior server is received, and first map data is processed according to the service processing logic of the first map data to generate second map data and a second candidate log; determining the log identifier of the first candidate log as the log identifier of the second candidate log; the log generated by the target server is stored to the log storage system based on the second candidate log and the log identification of the second candidate log. The method and the device can be used for tracking the whole process in the production and manufacturing process of the high-precision map, can improve the flexibility of processing the map data, determine the processing process of the map data, the flow direction of the map data and the problem log positioning problem, and improve the efficiency of storing the log of the map data and the efficiency of subsequently inquiring the log of the map data.
In order to further improve the flexibility of processing the map data and improve the efficiency of storing the log of the map data and the efficiency of subsequently querying the log of the map data, in some implementations, a second service request is generated according to the second map data and the log identifier of the second candidate log, and the second service request is sent to the next-level server. Alternatively, the second service request may be an HTTP request or an RPC request.
In some implementations, the server sends the second service request to the agent service, and the agent service forwards the second service request to the next-level server.
Fig. 2 is a flowchart of a log storage method of map data according to an embodiment of the present disclosure, as shown in fig. 2, the method is performed by a target server, and includes the following steps:
s201, receiving a first service request sent by a previous-level server, wherein the first service request comprises first map data and a log identifier of a first candidate log generated when the previous-level server generates the first map data.
S202, processing the first map data according to the business processing logic of the first map data to generate second map data and a second candidate log.
S203, determining the log identifier of the first candidate log as the log identifier of the second candidate log.
For the relevant content of step S201 to step S203, reference may be made to the description in the above embodiments, and details are not described here.
It should be noted that, in the embodiment of the present disclosure, the number of the second candidate logs is M, where M is a positive integer, and N is a positive integer smaller than M.
S204, determining N target logs from the M second candidate logs.
In some implementations, log print logic of a target server is obtained. And screening the M second candidate logs according to the log printing logic, acquiring the second candidate logs meeting the log printing logic from the M second candidate logs, and determining the second candidate logs as target logs.
For example, if the first map data is the first image of the scene a, the first image of the scene a may be zoomed, rotated, and the like according to the business processing logic of the target server itself, so as to generate the second map data and the second candidate log. The second candidate log comprises a second image obtained by scaling the first image and a third image obtained by rotating the second image. The third image may be confirmed as the target log according to the log printing logic.
S205, the target log and the log identification of the target log are sent to a log storage system.
In some implementations, the target log and the log identification of the target log are associated to generate first association information. And calling the proxy process, sending the first associated information to the proxy process, and sending the first associated information to the log storage system by the proxy process. That is, the log identifier of the target log is an index of the target log, so as to query the log of the map data subsequently according to the log identifier of the target log.
In some implementations, after generating the first association information, the method further includes: and acquiring the current time, and determining the current time as the log printing time of the target log. And updating the first associated information according to the log printing time to obtain second associated information. And calling the proxy process and sending the second associated information to the log storage system. That is, the log identifier of the target log is a first index of the target log, and the log printing time is a second index of the target log, so that the log of the map data can be subsequently queried according to the log identifier of the target log and the log printing time of the target log.
Optionally, during the execution, the log is printed by calling (agent software development kit) agent sdk, that is, the log is sent to the agent process.
The method and the device for processing the map data determine N target logs from M second candidate logs and send the target logs and the log identifications of the target logs to the log storage system.
Fig. 3 is a flowchart of a log storage method of map data according to an embodiment of the present disclosure, as shown in fig. 3, the method is executed by a target server, and in the case that the target server is a first-level server, the method further includes the following steps:
s301, an initial service request is obtained, and initial map data and an initial candidate log are obtained based on the initial service request, wherein the initial candidate log is a log generated when the initial map data is generated by the first-level server.
In some implementations, the map data acquisition device acquires map data to be processed, and the upper computer generates an initial service request according to the map data to be processed and sends the initial service request to the target server after acquiring the map data to be processed.
In some implementations, the upper computer acquires the map data to be processed from the preset database, and after acquiring the map data to be processed, the upper computer generates an initial service request according to the map data to be processed and sends the initial service request to the target server.
Alternatively, the map data acquisition device may be an image acquisition device, an infrared detection device, or other data acquisition devices, and the map data may be various types of data such as images and texts.
In some implementations, the initial service request includes pending map data; in some implementations, the initial service request includes pending map data and a unique log identification.
And the target server processes the map data to be processed according to the service processing logic of the target server, and generates an initial candidate log and initial map data.
S302, identify a request header of the initial service request.
In some implementations, the agent service is invoked to identify a request header of the initial service request and determine whether a log identifier is included in a request field of the request header.
S303, responding to the request header containing the log identification, and determining the log identification contained in the request header as the target identification of the initial candidate log.
S304, responding to the request header without the log identification, calling the proxy service to generate a unique log identification, and determining the unique log identification as the target identification of the initial candidate log.
The method comprises the steps of identifying a request head of an initial service request, determining a log identifier included in the request head as a target identifier of an initial candidate log in response to the request head including the log identifier, calling a proxy service to generate a unique log identifier in response to the request head not including the log identifier, and determining the unique log identifier as the target identifier of the initial candidate log. The method and the device can be used for tracking the whole process in the production and manufacturing process of the high-precision map, can improve the flexibility of processing the map data, determine the processing process of the map data, the flow direction of the map data and the problem log positioning problem, and improve the efficiency of storing the log of the map data and the efficiency of subsequently inquiring the log of the map data.
Fig. 4 is a flowchart of a log query method of map data according to an embodiment of the disclosure, as shown in fig. 4, the method is executed by a log storage system and includes the following steps:
s401, receiving target logs corresponding to different map data and log identifiers of the target logs sent by servers at different levels, wherein the target logs belonging to the same map data are marked in the servers at different levels with the same target identifier, and the target identifiers corresponding to different map data are different.
Optionally, the log storage system may be a server with a storage function, and may also be a cloud server cluster with a storage function.
In some implementations, different map data include map data a, map data B, and map data C as model descriptions, the map data a has a same identifier in the pipeline processing process of each level of server, and the object identifiers marked by the object logs belonging to the map data a in the servers of different levels are the same. The map data B has a same identifier in the pipeline processing process of the servers at each level, and the object identifiers marked by the object logs belonging to the map data B in the servers at different levels are the same. The map data C has a same identifier in the pipeline processing process of the servers at each level, and the object identifiers marked by the object logs belonging to the map data C in the servers at different levels are the same. The map data A, the map data B and the map data C have different corresponding target identifications.
S402, responding to the received log query request sent by the client, and acquiring a first log identifier of the log to be queried from the log query request.
The method comprises the steps that a client side obtains a log identifier of a problem log, a log query request is generated according to the log identifier of the problem log, the log query request is sent to a log storage system, the log storage system receives the log query request sent by the client side, and a first log identifier of a log to be queried is obtained from the log query request.
In the disclosed embodiment, the problem log may be a log of occurrences of computational errors or logical errors.
S403, one or more first target logs corresponding to the first log identification are determined from the target logs.
In the embodiment of the disclosure, the log to be queried is a log in the target log, which has the same log identifier as the problem log. Thus, one or more first target logs may be determined from the target logs based on the first log identifications.
S404, one or more first target logs are sent to the client.
The log storage system sends one or more first target logs associated with the first log identification to the client.
The method comprises the steps of receiving target logs corresponding to different map data and log identifiers of the target logs sent by servers at all levels, responding to a received log query request sent by a client, and acquiring a first log identifier of a log to be queried from the log query request; determining one or more first target logs corresponding to the first log identification from the target logs; and sending one or more first target logs to the client. The method and the device can realize the tracking of the whole process in the production and manufacturing process of the high-precision map, improve the flexibility of inquiring the map data, determine the processing flow of the map data, the flow direction of the map data and the problem log positioning problem, and improve the efficiency of inquiring the log of the map data.
Fig. 5 is a flowchart of a log query method of map data according to an embodiment of the present disclosure, as shown in fig. 5, the method is performed by a log storage system, and includes the following steps:
s501, receiving target logs corresponding to different map data and log identifiers of the target logs sent by servers at all levels, wherein the target logs belonging to the same map data are marked with the same target identifier in the servers at different levels, and the target identifiers corresponding to different map data are different.
S502, in response to receiving a log query request sent by a client, obtaining a first log identifier of a log to be queried from the log query request.
For the related contents of step S501 to step S502, reference may be made to the description in the foregoing embodiments, and details are not repeated here.
S503, matching the first identifier with the log identifier of the target log, and determining the target log as a first target log in response to the first identifier being consistent with the log identifier of the target log.
And matching the first identifier with the log identifier of the target log to judge whether the first identifier is consistent with the log identifier of the target log, and determining the target log as the first target log in response to the consistency of the first identifier and the log identifier of the target log. In response to the first identification not being consistent with the log identification of the target log, determining that the target log is not the first target log.
S504, log printing time of any one of the first target logs is obtained.
When the number of the first target logs is multiple, in order to further clarify the processing flow of the map data and the flow direction of the map data, the multiple first target logs may be sorted according to the log printing time, and the log printing time of any one of the multiple first target logs may be acquired.
And S505, sorting the plurality of first target logs according to the log printing time of any first target log.
If the log printing time of the first target log D is earlier than that of the first target log E, the first target log D is sorted before the first target log E.
S506, sending the sequenced first target logs to a client.
And the log storage system sends the sorted one or more first target logs to the client.
In the embodiment of the disclosure, the first identifier is matched with the log identifier of the target log, the target log is determined to be the first target log in response to the consistency of the first identifier and the log identifier of the target log, the log printing time of any first target log in the multiple first target logs is acquired, the multiple first target logs are sequenced according to the log printing time of any first target log, and one or more sequenced first target logs are sent to the client. The method and the device can realize the tracking of the whole process in the production and manufacturing process of the high-precision map, improve the flexibility of inquiring the map data, determine the processing flow of the map data, the flow direction of the map data and the problem log positioning problem, and improve the efficiency of inquiring the log of the map data.
Fig. 6 is a schematic diagram of a journal storage system for map data 600 according to one embodiment of the present disclosure, wherein the journal storage system for map data 600 includes a multi-stage server 610, a journal storage system 620, and a client 630;
the multi-level server 610 is configured to obtain corresponding target logs according to different map data, and store the target logs and log identifiers of the target logs to the log storage system 620, where target identifiers marked by the target logs belonging to the same map data in servers of different levels are the same, and target identifiers corresponding to different map data are different;
the log storage system 620 is configured to receive target logs corresponding to different map data and log identifiers of the target logs, where the target logs correspond to different map data and are sent by the multi-stage server 610; in response to receiving a log query request sent by a client 630, acquiring a first log identifier of a log to be queried from the log query request; determining one or more first target logs corresponding to the first log identification from the target logs; sending the one or more first target logs to a client 630;
the client 630 is configured to send a log query request to the log storage system 620 and receive one or more first target logs sent by the log storage system 620.
The method and the device can realize the tracking of the whole process in the production and manufacturing process of the high-precision map, improve the flexibility of inquiring the map data, determine the processing flow of the map data, the flow direction of the map data and the problem log positioning problem, and improve the efficiency of inquiring the log of the map data.
Fig. 7 is a flowchart of a log tracking method for map data according to an embodiment of the present disclosure, as shown in fig. 7, in the embodiment of the present disclosure, an upper computer generates an initial service request according to map data to be processed, that is, an original data unit, and sends the initial service request to a first-level server, the first-level server calls an agent service to receive the initial service request, the agent service identifies a request header of the initial service request to obtain a log identifier, and then sends the log identifier and the initial service request to the first-level server, the first-level server processes the request according to its own business processing logic to generate an initial candidate log and initial map data, and determines the log identifier sent by the agent service to be the log identifier of the initial candidate log, the server prints the initial candidate log and the log identifier of the initial candidate log to the agent service, and obtains log printing time, obtains second related information according to the initial candidate log, the initial candidate log printing time and the log identifier of the initial candidate log, and sends the second related information to a log storage system, finally, the first-level server generates a new service request for calling a downstream based on the initial candidate log data and sends the log identifier of the initial candidate log to a next-level log storage system, and continues to receive the log storage system according to analogize the log.
As shown in fig. 7, the log storage system receives target logs corresponding to different map data sent by servers at different levels and log identifiers of the target logs, the client obtains the log identifiers of problem logs, generates a log query request according to the log identifiers of the problem logs, and sends the log query request to the log storage system, after receiving the log query request sent by the client, the log storage system obtains a first log identifier of a log to be queried from the log query request, determines a plurality of first target logs corresponding to the first log identifier from the target logs, obtains log printing time of any one of the first target logs, sorts the first target logs according to the log printing time of any one of the first target logs, and sends the sorted first target logs to the client.
The method and the device can realize the tracking of the whole process in the production and manufacturing process of the high-precision map, improve the flexibility of inquiring the map data, determine the processing flow of the map data, the flow direction of the map data and the problem log positioning problem, and improve the efficiency of inquiring the log of the map data.
Fig. 8 is a structural diagram of a log storage device of map data according to an embodiment of the present disclosure, and as shown in fig. 8, the log storage device 800 of map data includes:
a receiving module 810, configured to receive a first service request sent by a superior server, where the first service request includes first map data and a log identifier of a first candidate log generated when the superior server generates the first map data;
a processing module 820, configured to process the first map data according to its own business processing logic, and generate second map data and a second candidate log;
a determining module 830, configured to determine that the log identifier of the first candidate log is the log identifier of the second candidate log;
a storage module 840, configured to store the log generated by the target server to the log storage system based on the second candidate log and the log identifier of the second candidate log.
In some implementations, the number of second candidate logs is M, and the storage module 840 is further configured to: determining N target logs from M second candidate logs, wherein M is a positive integer, and N is a positive integer smaller than M; and sending the target log and the log identifier of the target log to a log storage system.
In some implementations, the storage module 840 is further configured to: acquiring a log printing logic of a target server; and screening the M second candidate logs according to the log printing logic, acquiring the second candidate logs meeting the log printing logic from the M second candidate logs, and determining the second candidate logs as target logs.
In some implementations, the storage module 840 is further configured to: associating the target log with the log identifier of the target log to generate first association information; and calling the proxy process, sending the first associated information to the proxy process, and sending the first associated information to the log storage system by the proxy process.
In some implementations, the storage module 840 is further configured to: acquiring current time, and determining the current time as the log printing time of a target log; updating the first associated information according to the log printing time to obtain second associated information; and calling the proxy process and sending the second associated information to the log storage system.
In some implementations, the apparatus further includes a sending module 850 to: and generating a second service request according to the second map data and the log identification of the second candidate log, and sending the second service request to the next-level server.
In some implementations, where the target server is a first-level server, the determining module 830 is further configured to: acquiring an initial service request, and acquiring initial map data and an initial candidate log based on the initial service request, wherein the initial candidate log is a log generated when a first-level server generates the initial map data; identifying a request header of an initial service request; and in response to the request header comprising the log identification, determining the log identification comprised in the request header as the target identification of the initial candidate log.
In some implementations, the determining module 830 is further configured to: and in response to the request header not including the log identification, calling the proxy service to generate a unique log identification, and determining the unique log identification as the target identification of the initial candidate log.
The method can be used for tracking the whole process in the production and manufacturing process of the high-precision map, can improve the flexibility of processing the map data, can determine the processing process of the map data, the flow direction of the map data and the problem log positioning problem, and can improve the efficiency of storing the log of the map data and the efficiency of subsequently inquiring the log of the map data.
Fig. 9 is a block diagram of a log query apparatus for map data according to an embodiment of the present disclosure, and as shown in fig. 9, a log query apparatus 900 for map data includes:
a receiving module 910, configured to receive target logs corresponding to different map data and log identifiers of the target logs sent by servers at different levels, where target logs belonging to the same map data are marked with the same target identifier in servers at different levels, and target identifiers corresponding to different map data are different;
an obtaining module 920, configured to, in response to receiving a log query request sent by a client, obtain a first log identifier of a log to be queried from the log query request;
a determining module 930, configured to determine, from the target logs, one or more first target logs corresponding to the first log identifiers;
a sending module 940, configured to send the one or more first target logs to the client.
In some implementations, the determining module 930 is further configured to: and matching the first identifier with the log identifier of the target log, and determining the target log as the first target log in response to the consistency of the first identifier and the log identifier of the target log.
In some implementations, the sending module 940 is further configured to: when a plurality of first target logs are available, acquiring the log printing time of any one of the first target logs; and sequencing the first target logs according to the log printing time of any first target log.
The method and the device can track the whole process in the production and manufacturing process of the high-precision map, improve the flexibility of map data query, clarify the processing flow of the map data, the flow direction of the map data and the problem log positioning problem, and improve the efficiency of map data query.
The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.
FIG. 10 illustrates a schematic block diagram of an example electronic device 1000 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 10, the apparatus 1000 includes a computing unit 1001 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 1002 or a computer program loaded from a storage unit 1008 into a Random Access Memory (RAM) 1003. In the RAM 1003, various programs and data necessary for the operation of the device 1000 can be stored. The calculation unit 1001, the ROM 1002, and the RAM 1003 are connected to each other by a bus 1004. An input/output (I/O) interface 1005 is also connected to bus 1004.
A number of components in device 1000 are connected to I/O interface 1005, including: an input unit 1006 such as a keyboard, a mouse, and the like; an output unit 1007 such as various types of displays, speakers, and the like; a storage unit 1008 such as a magnetic disk, an optical disk, or the like; and a communication unit 1009 such as a network card, a modem, a wireless communication transceiver, or the like. The communication unit 1009 allows the device 1000 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.
Computing unit 1001 may be a variety of general and/or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 1001 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The calculation unit 1001 executes the respective methods and processes described above, such as a log storage method of map data or a log query method of map data. For example, in some embodiments, a log storage method of map data or a log query method of map data may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 1008. In some embodiments, part or all of the computer program may be loaded and/or installed onto device 1000 via ROM 1002 and/or communications unit 1009. When the computer program is loaded into the RAM 1003 and executed by the computing unit 1001, one or more steps of the log storage method of the map data or the log query method of the map data described above may be performed. Alternatively, in other embodiments, the computing unit 1001 may be configured by any other suitable means (e.g., by means of firmware) to perform a log storage method of map data or a log query method of map data.
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server combining a blockchain.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims (26)

1. A log storage method of map data, wherein the log storage method is executed by a target server, and comprises the following steps:
receiving a first service request sent by a superior server, wherein the first service request comprises first map data and a log identifier of a first candidate log generated when the superior server generates the first map data;
processing the first map data according to the business processing logic of the first map data to generate second map data and a second candidate log;
determining the log identifier of the first candidate log as the log identifier of the second candidate log;
storing the log generated by the target server to a log storage system based on the second candidate log and the log identification of the second candidate log.
2. The method of claim 1, wherein the second candidate logs are M in number, the storing the target server generated logs to a log storage system based on the second candidate logs and log identifications of the second candidate logs, further comprising:
determining N target logs from the M second candidate logs, wherein M is a positive integer, and N is a positive integer smaller than M;
and sending the target log and the log identifier of the target log to a log storage system.
3. The method of claim 2, wherein said determining N target logs from M of said second candidate logs comprises:
acquiring log printing logic of the target server;
and screening the M second candidate logs according to the log printing logic, acquiring second candidate logs meeting the log printing logic from the M second candidate logs, and determining the second candidate logs as the target logs.
4. The method of claim 3, wherein the sending the target log and the log identification of the target log to a log storage system further comprises:
associating the target log with the log identifier of the target log to generate first association information;
and calling the proxy process, sending the first associated information to the proxy process, and sending the first associated information to the log storage system by the proxy process.
5. The method of claim 4, wherein after the generating the first association information, further comprising:
acquiring current time, and determining the current time as the log printing time of the target log;
updating the first associated information according to the log printing time to obtain second associated information;
and calling the proxy process and sending the second associated information to the log storage system.
6. The method according to any one of claims 1-5, wherein the method further comprises:
and generating a second service request according to the second map data and the log identification of the second candidate log, and sending the second service request to a next-level server.
7. The method of any of claims 1-5, wherein, in the case where the target server is a first-level server, the method further comprises:
acquiring an initial service request, and acquiring initial map data and an initial candidate log based on the initial service request, wherein the initial candidate log is a log generated when the initial map data is generated by the first-level server;
identifying a request header of the initial service request;
and responding to the request header comprising the log identification, and determining the log identification comprised in the request header as the target identification of the initial candidate log.
8. The method of claim 7, further comprising:
and responding to the request header without the log identification, calling a proxy service to generate a unique log identification, and determining the unique log identification as the target identification of the initial candidate log.
9. A log query method of map data, wherein the log query method is executed by a log storage system and comprises the following steps:
receiving target logs corresponding to different map data and log identifications of the target logs, wherein the target logs belonging to the same map data are marked in the servers of different levels with the same target identification, and the target identifications corresponding to different map data are different;
responding to a received log query request sent by a client, and acquiring a first log identifier of a log to be queried from the log query request;
determining one or more first target logs corresponding to the first log identification from the target logs;
and sending the one or more first target logs to the client.
10. The method of claim 9, wherein said determining, from the target logs, one or more first target logs corresponding to the first log identification comprises:
and matching the first identifier with the log identifier of the target log, and determining that the target log is the first target log in response to the first identifier being consistent with the log identifier of the target log.
11. The method of claim 10, wherein prior to sending the one or more first target logs to the client, further comprising:
when the first target logs are multiple, acquiring the log printing time of any one of the first target logs;
and sequencing the plurality of first target logs according to the log printing time of any first target log.
12. A log storage device for map data, comprising:
the system comprises a receiving module, a sending module and a receiving module, wherein the receiving module is used for receiving a first service request sent by a superior server, and the first service request comprises first map data and a log identifier of a first candidate log generated when the superior server generates the first map data;
the processing module is used for processing the first map data according to the business processing logic of the processing module, and generating second map data and a second candidate log;
a determining module, configured to determine that the log identifier of the first candidate log is the log identifier of the second candidate log;
and the storage module is used for storing the logs generated by the target server to a log storage system based on the second candidate log and the log identification of the second candidate log.
13. The apparatus of claim 12, wherein the second candidate logs are M in number, and the storage module is further configured to:
determining N target logs from M second candidate logs, wherein M is a positive integer, and N is a positive integer smaller than M;
and sending the target log and the log identification of the target log to a log storage system.
14. The apparatus of claim 13, wherein the storage module is further configured to:
acquiring log printing logic of the target server;
and screening the M second candidate logs according to the log printing logic, acquiring second candidate logs meeting the log printing logic from the M second candidate logs, and determining the second candidate logs as the target logs.
15. The apparatus of claim 14, wherein the storage module is further configured to:
associating the target log with the log identifier of the target log to generate first association information;
and calling the proxy process, sending the first associated information to the proxy process, and sending the first associated information to the log storage system by the proxy process.
16. The apparatus of claim 15, wherein the storage module is further configured to:
acquiring current time, and determining the current time as the log printing time of the target log;
updating the first associated information according to the log printing time to obtain second associated information;
and calling the proxy process and sending the second associated information to the log storage system.
17. The apparatus of any one of claims 12-16, wherein the apparatus further comprises a transmitting module to:
and generating a second service request according to the second map data and the log identification of the second candidate log, and sending the second service request to a next-level server.
18. The apparatus of any of claims 12-16, wherein, in the case that the target server is a first-level server, the means for determining is further configured to:
acquiring an initial service request, and acquiring initial map data and an initial candidate log based on the initial service request, wherein the initial candidate log is a log generated when the initial map data is generated by the first-level server;
identifying a request header of the initial service request;
and responding to the request header comprising the log identification, and determining the log identification comprised in the request header as the target identification of the initial candidate log.
19. The apparatus of claim 18, wherein the means for determining is further configured to:
and responding to the request header without the log identification, calling a proxy service to generate a unique log identification, and determining the unique log identification as the target identification of the initial candidate log.
20. A log query device of map data comprises:
the receiving module is used for receiving target logs corresponding to different map data and log identifications of the target logs, wherein the target logs belonging to the same map data are marked in the servers of different levels with the same target identification, and the target identifications corresponding to different map data are different;
the system comprises an acquisition module, a query module and a query module, wherein the acquisition module is used for responding to a received log query request sent by a client and acquiring a first log identifier of a log to be queried from the log query request;
the determining module is used for determining one or more first target logs corresponding to the first log identification from the target logs;
a sending module, configured to send the one or more first target logs to the client.
21. The apparatus of claim 20, wherein the means for determining is further configured to:
and matching the first identifier with the log identifier of the target log, and determining the target log as the first target log in response to the consistency of the first identifier and the log identifier of the target log.
22. The apparatus of claim 21, wherein the means for transmitting is further configured to:
when the number of the first target logs is multiple, acquiring the log printing time of any one first target log in the multiple first target logs;
and sequencing the plurality of first target logs according to the log printing time of any first target log.
23. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the method of any one of claims 1-8 or the method of any one of claims 9-11.
24. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any of claims 1-8 or the method of any of claims 9-11.
25. A computer program product comprising a computer program which, when executed by a processor, carries out the steps of the method according to any one of claims 1-8 or carries out the steps of the method according to any one of claims 9-11.
26. A log storage system of map data comprises a multi-stage server, a log storage system and a client;
the multi-stage server is used for acquiring corresponding target logs according to different map data and storing the target logs and log identifications of the target logs to the log storage system, wherein the target logs belonging to the same map data are marked in the servers at different levels with the same target identification, and the target identifications corresponding to different map data are different;
the log storage system is used for receiving target logs corresponding to different map data sent by the multi-stage server and log identifiers of the target logs; responding to a received log query request sent by the client, and acquiring a first log identifier of a log to be queried from the log query request; determining one or more first target logs corresponding to the first log identification from the target logs; sending the one or more first target logs to the client;
the client is used for sending the log query request to the log storage system and receiving the one or more first target logs sent by the log storage system.
CN202211366522.4A 2022-10-31 2022-10-31 Log storage method, device and system for high-precision map data Pending CN115563072A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211366522.4A CN115563072A (en) 2022-10-31 2022-10-31 Log storage method, device and system for high-precision map data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211366522.4A CN115563072A (en) 2022-10-31 2022-10-31 Log storage method, device and system for high-precision map data

Publications (1)

Publication Number Publication Date
CN115563072A true CN115563072A (en) 2023-01-03

Family

ID=84769537

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211366522.4A Pending CN115563072A (en) 2022-10-31 2022-10-31 Log storage method, device and system for high-precision map data

Country Status (1)

Country Link
CN (1) CN115563072A (en)

Similar Documents

Publication Publication Date Title
CN112559007B (en) Parameter updating method and device of multitask model and electronic equipment
CN113642583B (en) Deep learning model training method for text detection and text detection method
CN112866391A (en) Message pushing method and device, electronic equipment and storage medium
CN113159091A (en) Data processing method and device, electronic equipment and storage medium
CN114428677B (en) Task processing method, processing device, electronic equipment and storage medium
CN113378855A (en) Method for processing multitask, related device and computer program product
CN114881129A (en) Model training method and device, electronic equipment and storage medium
CN113627536A (en) Model training method, video classification method, device, equipment and storage medium
CN115311469A (en) Image labeling method, training method, image processing method and electronic equipment
CN113904943B (en) Account detection method and device, electronic equipment and storage medium
CN114186681A (en) Method, apparatus and computer program product for generating model clusters
CN112784102A (en) Video retrieval method and device and electronic equipment
CN116302218B (en) Function information adding method, device, equipment and storage medium
CN114329164B (en) Method, apparatus, device, medium, and article for processing data
CN115563072A (en) Log storage method, device and system for high-precision map data
CN115599571A (en) Data processing method and device, electronic equipment and storage medium
CN113691937A (en) Method for determining position information, cloud mobile phone and terminal equipment
CN113591709A (en) Motion recognition method, motion recognition device, motion recognition apparatus, motion recognition medium, and computer program product
CN113554062A (en) Training method, device and storage medium of multi-classification model
CN113627526A (en) Vehicle identification recognition method and device, electronic equipment and medium
CN114926447B (en) Method for training a model, method and device for detecting a target
CN110780937A (en) Task issuing method and device, computer readable storage medium and equipment
CN114491040B (en) Information mining method and device
CN114791996B (en) Information processing method, device, system, electronic equipment and storage medium
CN115965018B (en) Training method of information generation model, information generation method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination