CN111008320A - Data processing method and device and electronic equipment - Google Patents

Data processing method and device and electronic equipment Download PDF

Info

Publication number
CN111008320A
CN111008320A CN201911305888.9A CN201911305888A CN111008320A CN 111008320 A CN111008320 A CN 111008320A CN 201911305888 A CN201911305888 A CN 201911305888A CN 111008320 A CN111008320 A CN 111008320A
Authority
CN
China
Prior art keywords
information
key
vehicle
field
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911305888.9A
Other languages
Chinese (zh)
Inventor
陈志刚
任鑫琦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Mininglamp Software System Co ltd
Original Assignee
Beijing Mininglamp Software System Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Mininglamp Software System Co ltd filed Critical Beijing Mininglamp Software System Co ltd
Priority to CN201911305888.9A priority Critical patent/CN111008320A/en
Publication of CN111008320A publication Critical patent/CN111008320A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/907Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/901Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/907Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/909Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location

Abstract

The application provides a data processing method, a data processing device and electronic equipment, wherein the data processing method comprises the following steps: obtaining object information from a plurality of data sources; identifying the object information to extract a plurality of items of key information in the object information, wherein the key information comprises: time information, object identification information, location information; and storing the plurality of items of key information according to a preset data format to construct an object information base.

Description

Data processing method and device and electronic equipment
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data processing method and apparatus, and an electronic device.
Background
In the development of the society at present, various information influencing the life of people can be collected and recorded through electronic equipment. But the distribution of the devices that may generate data is so distributed that even if data is present, it may not be used efficiently.
Disclosure of Invention
In view of this, an object of the present application is to provide a data processing method, an apparatus and an electronic device. The effect of summarizing required information and conveniently managing data can be achieved.
In a first aspect, an embodiment of the present application provides a data processing method, including:
obtaining object information from a plurality of data sources;
identifying the object information to extract a plurality of items of key information in the object information, wherein the key information comprises: time information, object identification information, location information;
and storing the plurality of items of key information according to a preset data format to construct an object information base.
In an optional implementation manner, the step of identifying the object information to extract a plurality of items of key information in the object information includes:
according to the data type of the object information, obtaining field information of storage key information corresponding to the data type;
and determining key information in the object information according to the field information.
According to the data processing method provided by the embodiment of the application, because the types of data obtained from different data sources may be different and keywords used for storing information may not be used, the field information for storing various types of information is determined based on the data types, and then the key information is obtained based on the field information, so that the data identification amount can be reduced, and the key information can be identified more accurately.
In an optional implementation manner, the object information includes person information, and the key information of the person information includes: name, identification, location information and information generation time; the step of determining key information in the personnel information according to the field information comprises the following steps:
determining the target name of the person represented by the person information according to the name field information;
determining a first target identity of a person represented by the person information according to the identity field information;
determining real-time position information of the personnel represented by the personnel information according to the position field information;
and determining the generation time of the personnel information according to the time field information.
According to the data processing method provided by the embodiment of the application, the object information can be personnel information, and the trails of personnel can be searched in the constructed object information base by extracting the key information of the personnel information.
In an optional embodiment, the object information includes vehicle information, and the key information of the vehicle information includes: license plate number, identity mark, position information and information generation time; the step of determining key information in the vehicle information according to the field information comprises the following steps:
determining a target license plate number of the vehicle represented by the vehicle information according to the license plate number field information;
according to the identification field information, determining a second target identification of the person to which the vehicle belongs, which is represented by the vehicle information;
according to the position field information, determining the real-time position information of the vehicle represented by the vehicle information;
and determining the generation time of the vehicle information according to the time field information.
According to the data processing method provided by the embodiment of the application, the vehicle is also a key travel mode of the personnel, and the travel tracks of the personnel related to the vehicle can be searched in the constructed object information base through the travel tracks of the vehicle by storing the vehicle information.
In an optional embodiment, the key information of the vehicle information further includes: driver information; the step of determining key information in the vehicle information according to the field information further includes:
and carrying out face recognition on the image information in the vehicle information to determine driver information corresponding to the vehicle information.
The data processing method provided by the embodiment of the application can also determine the driver information, so that the vehicle information and the personnel information can be associated.
In an optional implementation manner, the step of storing the plurality of items of key information according to a preset data format to construct an object information base includes:
matching a key field name for each type of information in the key information;
and respectively storing a plurality of items of key information into storage spaces corresponding to the key field names to which the key information belongs to form object information in a preset data format, wherein the plurality of items of object information form an object information base.
The data processing method provided by the embodiment of the application can also be stored according to a set format, so that the formats of the stored object information can be unified, and the follow-up query in the object information base is convenient.
In an optional implementation manner, the step of storing the plurality of items of key information according to a preset data format to construct an object information base includes:
and storing the key information according to a JSON format to construct an object information base.
The data processing method provided by the embodiment of the application can also store information in a JSON format, and can improve the speed of inquiring information in the object information base.
In an optional embodiment, the method further comprises:
receiving a data query request sent by a client terminal, wherein the data query request carries index information;
inquiring all information corresponding to the index information in the object information base according to the index information;
and sending all information corresponding to the index information to a client terminal, wherein all information corresponding to the index information is used for forming space-time trajectory information in the client terminal.
The data processing method provided by the embodiment of the application can also be used for the client terminal to inquire the required information in the object information base and send all the inquired information to the client terminal, and all the information corresponding to the index information is used for forming the space-time trajectory information in the client terminal, so that a user can know the space-time trajectory information of the inquired object and know the tracings of the inquired object.
In a second aspect, an embodiment of the present application provides a data processing apparatus, including:
an acquisition module for acquiring object information from a plurality of data sources;
an extracting module, configured to identify the object information to extract multiple items of key information in the object information, where the key information includes: time information, object identification information, location information;
and the storage module is used for storing the plurality of items of key information according to a preset data format so as to construct an object information base.
In a third aspect, an embodiment of the present application further provides an electronic device, including: a processor, a memory storing machine-readable instructions executable by the processor, the machine-readable instructions, when executed by the processor, performing the steps of the method of the first aspect described above, or any possible implementation of the first aspect, when the electronic device is run.
In a fourth aspect, this embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps of the method in the first aspect or any one of the possible implementation manners of the first aspect.
According to the data processing method and device, the electronic equipment and the computer readable storage medium, the object information is obtained from the plurality of data sources, so that the data sources are richer, the obtained data are richer, and the recorded data can better represent the data condition of the object. Furthermore, the information extraction can be carried out on the object information, so that only useful information can be stored, and the data storage pressure can be reduced as much as possible under the condition of improving the data volume of the object.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
Fig. 1 is a block diagram of an electronic device according to an embodiment of the present disclosure.
Fig. 2 is a flowchart of a data processing method according to an embodiment of the present application.
Fig. 3 is a detailed flowchart of step 202 of the data processing method according to the embodiment of the present application.
Fig. 4 is a partial flowchart of a data processing method according to an embodiment of the present application.
Fig. 5 is a schematic diagram of spatiotemporal trajectory data displayed with respect to query data in the data processing method according to the embodiment of the present application.
Fig. 6 is a schematic functional block diagram of a data processing apparatus according to an embodiment of the present application.
Detailed Description
The technical solution in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
Example one
To facilitate understanding of the present embodiment, first, an electronic device executing the data processing method disclosed in the embodiments of the present application will be described in detail.
As shown in fig. 1, is a block schematic diagram of an electronic device. The electronic device 100 may include a memory 111, a memory controller 112, a processor 113, a peripheral interface 114, an input-output unit 115, and a display unit 116. It will be understood by those of ordinary skill in the art that the structure shown in fig. 1 is merely exemplary and is not intended to limit the structure of the electronic device 100. For example, electronic device 100 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The above-mentioned elements of the memory 111, the memory controller 112, the processor 113, the peripheral interface 114, the input/output unit 115 and the display unit 116 are electrically connected to each other directly or indirectly, so as to implement data transmission or interaction. For example, the components may be electrically connected to each other via one or more communication buses or signal lines. The processor 113 is used to execute the executable modules stored in the memory.
The Memory 111 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like. The memory 111 is configured to store a program, and the processor 113 executes the program after receiving an execution instruction, and the method executed by the electronic device 100 defined by the process disclosed in any embodiment of the present application may be applied to the processor 113, or implemented by the processor 113.
The processor 113 may be an integrated circuit chip having signal processing capability. The Processor 113 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The peripheral interface 114 couples various input/output devices to the processor 113 and memory 111. In some embodiments, the peripheral interface 114, the processor 113, and the memory controller 112 may be implemented in a single chip. In other examples, they may be implemented separately from the individual chips.
The input/output unit 115 is used to provide input data to the user. The input/output unit 115 may be, but is not limited to, a mouse, a keyboard, and the like.
The display unit 116 provides an interactive interface (e.g., a user operation interface) between the electronic device 100 and the user or is used for displaying image data to the user for reference. In this embodiment, the display unit may be a liquid crystal display or a touch display. In the case of a touch display, the display can be a capacitive touch screen or a resistive touch screen, which supports single-point and multi-point touch operations. The support of single-point and multi-point touch operations means that the touch display can sense touch operations simultaneously generated from one or more positions on the touch display, and the sensed touch operations are sent to the processor for calculation and processing.
In this embodiment, the memory 111 may store an object information base constructed by the method in the embodiment of the present application. The display interface 116 may be provided with a query window, and when the query window receives the index information corresponding to the data query request, all corresponding information may be queried from the object information base according to the index information and displayed. Illustratively, the index information may be displayed in the form of spatiotemporal trajectory information.
In some special application scenarios, for example, in the field of intelligence research and judgment of public security units, it is necessary to know the track situation of a person or a vehicle, and the object information may be acquired by communicating with each device for acquiring object information, for example, the object information may be person-related information: the object identification card number, the object name, the information generation time and the information generation place; the object information may be vehicle-related information: vehicle license plate number, vehicle place of occurrence, vehicle time of occurrence, and the like. Based on this, the method provided in the embodiments of the present application can integrate and store these spatiotemporal data with temporal and spatial characteristics uniformly to form an object database. Further, a query method can be established, and the query method can be used for querying in the object database.
The electronic device 100 in this embodiment may be configured to perform each step in each method provided in this embodiment. The implementation of the data processing method is described in detail below by means of several embodiments.
Example two
Please refer to fig. 2, which is a flowchart illustrating a data processing method according to an embodiment of the present disclosure. The specific process shown in fig. 2 will be described in detail below.
Step 201, object information is obtained from a plurality of data sources.
In this embodiment, the plurality of data sources may be databases capable of recording personnel information, for example, the data sources may include, but are not limited to, a database storing accommodation information, a database storing personnel security check data, a database recording internet access personnel information of an internet bar, a database recording access records of a bank, and the like.
Alternatively, the plurality of data sources may be devices capable of recording vehicle information, for example, the data sources may include, but are not limited to, a database for storing vehicle information collected by the skyhook; a database for storing vehicle entrance/exit data of each parking lot.
In this embodiment, the database may be a relational database, such as MySql, Oracle.
Alternatively, the plurality of data sources may be a data warehouse Hive, a message middleware Kafka, or the like.
Optionally, tools such as Jdbc, Sqoop, Flume, logstack, etc. may be used to incrementally or fully import source data in different data sources into the target database in a uniform format.
Step 202, identifying the object information to extract a plurality of items of key information in the object information.
In this embodiment, the key information includes: time information, object identification information, location information. Of course, the key information may also include more information that can characterize the state of the object. For example, image information, gender information.
In one embodiment, as shown in FIG. 3, step 202 may include the following steps.
Step 2021, obtaining field information of the storage key information corresponding to the data type according to the data type of the object information.
In this embodiment, different types of data may use different fields to store various pieces of information.
In one example, with respect to a piece of accommodation information, the object information may be expressed as:
<ID>3707022019<ID>;
< NAME > Wang Xiaohua < NAME >;
<ID_CODE>370481********1245<ID_CODE>;
<NO_ROOM>2206<NO_ROOM>;
< hotelinhome > international business hotel < hotelinhome >;
<ID_CODE>201901011030<ID_CODE>;
<ID_CODE>370702<ID_CODE>。
the above object information is only exemplary, and an object information may be more or less information than the above.
Step 2022, determining the key information in the object information according to the field information.
Taking the above example as an example, if the person NAME needs to be queried, the information corresponding to the field "NAME" may be queried. If the person identification needs to be queried, the information corresponding to the field "ID _ CODE" can be queried.
In an optional embodiment, the object information includes person information. The key information of the personnel information comprises: name, identification, location information and information generation time.
Step 2022 may include: determining the target name of the person represented by the person information according to the name field information; determining a first target identity of a person represented by the person information according to the identity field information; determining real-time position information of the personnel represented by the personnel information according to the position field information; and determining the generation time of the personnel information according to the time field information.
Optionally, the key information of the person information may further include image information. The image information can be a face image in the identity card read when the identity card is scanned; the image information may also be an image of a person collected on site.
In an optional embodiment, the object information includes vehicle information, and key information of the vehicle information includes: license plate number, identity mark, position information and information generation time.
For example, a vehicle information may be represented as:
“lane_id”:1,
“location_id”:370804,
"license _ plate": Rouz 12345 ",
“capture_time”:“2019-3-1 14:48:55”,
“loc_id”:“370782:1024”,
“plate_type_id”:2。
step 2022 may include: determining a target license plate number of the vehicle represented by the vehicle information according to the license plate number field information; according to the identification field information, determining a second target identification of the person to which the vehicle belongs, which is represented by the vehicle information; according to the position field information, determining the real-time position information of the vehicle represented by the vehicle information; and determining the generation time of the vehicle information according to the time field information.
By identifying the content corresponding to the field information "license _ plate", the license plate number of the vehicle can be determined. By identifying the content corresponding to the field information "capture _ time", the time of the piece of vehicle information can be determined.
Optionally, the key information of the vehicle information may further include image information. The image information may be a real-time image of the vehicle that is acquired.
Optionally, the key information of the vehicle information may further include: driver information. Step 2022 may include: and carrying out face recognition on the image information in the vehicle information to determine driver information corresponding to the vehicle information.
Optionally, the driver information may be face image information, or may be information such as a driver name and an identification number.
The target face contained in the image information may be determined by face recognition, for example. And matching the target face with a pre-stored face database to determine face information corresponding to the face. The face information may include: personnel name, personnel identification number, etc.
And 203, storing the plurality of items of key information according to a preset data format to construct an object information base.
In one embodiment, step 203 may include the following steps.
Step 2031, matching key field names for each type of information in the key information.
Illustratively, the key field names may be as shown in the following table:
key information Name of key field Remarks for note
Object type targetType Indicating persons or vehicles
Target object coding targetCode Identity card number or license plate number
Name (I) targetName
Point location coding locationCode
Point location name locationName
Point location address locationAddress
Coordinates of the object coordinate Longitude and latitude
Time of occurrence occurTime
Alternatively, the value corresponding to the targetType may be 1 or 2, where 1 indicates that the target object is a person and 2 indicates that the target object is a vehicle. the value corresponding to the targetCode may be an identification number, a passport number, or a license plate number. The value corresponding to the targetCode may be an identification number or a passport number, on the part of the person. In the case of a vehicle, the value corresponding to the targetCode may be a license plate number. the value corresponding to the targetName may be a person name, or a license plate model, etc. The value corresponding to the locationCode may represent the code to which the corresponding location belongs. Illustratively, the code to which the location belongs may be a unique code for the location, video device configuration, by the police system. The locationName may correspond to a location name, such as a hotel name, an internet cafe name, or the like.
Alternatively, the object information of one preset data format may include more information than the above.
Illustratively, one location, device, etc. may be taken as one point location, and in terms of point location information, one point location information may include: point location code, point location name, point location address, point location type, etc. The point location name may be a location name, a device name, etc. The point location type can be internet bar, hotel, highway camera bayonet, station, parking lot, etc.
Illustratively, one point location information may be information of an internet bar, a hotel, a highway camera mount, a station, a parking lot, and the like. Optionally, the point location information is recorded in advance by collection and is uniquely encoded.
For example, each point location type may correspond to a point location type value, for example, when the point location type is 11, it indicates that the point location is a hotel; for another example, when the point location type is 10, it indicates that the point location is an internet cafe; for another example, if the point location type is 6, it indicates that the point location is a road camera mount.
Illustratively, one point location information may be expressed as:
point location address: yuhua No. 23
The point location name: yuhua road all-season hotel
Point location code: 3707009918
Longitude: 119.018634
Latitude: 37.1155934
Point location type: 11
In the above example, the point location type is 11, which may indicate that the point location information is about a hotel.
Step 2032, storing multiple items of key information into storage spaces corresponding to the key field names to which the key information belongs, respectively, to form object information in a preset data format, where the multiple items of object information form an object information base.
The following description will be given taking an example in which one object information is person information, and the person information is information generated at the time of a hotel stay.
Object information forming a preset data format:
"type":"11",
"coordinate":"119.018634,37.1155934",
"locationCode":"3707009918",
"locationName": Yuhua road all-season hotel ",
"locationAddress" Yuhua No. 23 ",
"targetCode":"370704********2560",
"targetName": Zhang III ",
"targetType":"1",
"occurTime":1538543350000。
in the above object information in the form of the preset data format, information of the target object code, the target type, the occurrence time, and the geographical location is embodied.
In one embodiment, step 203 may be implemented as: and storing the key information according to a JSON format to construct an object information base.
As shown in fig. 4, the data processing method in the present embodiment may further include the following steps.
Step 204, receiving a data query request sent by the client terminal.
Wherein, the data query request carries index information. The index information is used as a query basis to query in an object information base.
Alternatively, the index information may be information capable of uniquely identifying a vehicle or a person. For example, the index information may be identification card information, license plate number, face information, and the like.
Alternatively, the data query request may be for a person or vehicle present at a location for a certain period of time. The index information may also be information that can indicate a certain time period and a certain bit.
Alternatively, the data query request may be used to query a certain type of vehicle travel situation. The index information may be the vehicle model.
Step 205, according to the index information, querying all information corresponding to the index information in the object information base.
Illustratively, the whereabouts of a person are queried if needed. The value of the targetCode in the information of the person to be inquired is used as an inquiry condition to inquire the spatiotemporal trajectory data of one person.
For example, if the track of a vehicle needs to be queried, the spatiotemporal trajectory data of the vehicle is queried by using the value of the targetCode of the vehicle information as a query condition.
In one example, a query is made in the object repository with an identity certificate "370704199804102560" as the index information. Three pieces of information are inquired, which are respectively: 2018-10-313: 01:00 appears in Yuhua road all-season hotel; 2018-10-408: 12:00 appears in Sophora japonica Anlu No. 21 stars Internet bar; 2018-10-423: 19:00 appears in the tower south road star hotel.
For example, one of the pieces of information may be expressed as:
id:"3489-4978-5922-9010-4231",
locationAddress, Yuhua No. 23,
locationCode:"3707009918",
locationName: "Yuhua road all-season hotel",
occurTime:"2018-10-03T13:09:10",
coordinate:"119.018634,37.1155934",
targetCode:"370704199804102560",
targetName: "ZhangiI",
targetType:"1"。
step 206, all information corresponding to the index information is sent to the client terminal.
Wherein all information corresponding to the index information may be used to form spatiotemporal trajectory information in the client terminal.
Illustratively, all the queried information may be sent to the client terminal, which displays it in JSON format.
Illustratively, as shown in fig. 5, all the queried information may be transmitted to the client terminal, and all the queried information may be displayed on a map by the terminal.
As shown in fig. 5, the name, time, and location may be identified at corresponding locations in the map. Respectively marked at three positions: zhangsan 2018-10-313: 01:00 Yuhua road all-season hotel; zhang San 2018-10-408: 12:00 Sophora Anlu No. 21 Star Internet Bar; 2018-10-423: 19:00 appears in the tower south road star hotel.
Alternatively, as shown in fig. 5, the trajectory of the target person of the query may also be described on a map. Alternatively, the chronological order of the trajectories can also be indicated by arrows.
The method shown in step 204 and 206 is to query the information in the object database by sending a query request through the client terminal. Alternatively, the building of the object database and the query data may be performed in the same terminal.
In an embodiment, the data processing method in this embodiment may further include: receiving a data query request input by a user, wherein the query request comprises index information; inquiring all information corresponding to the index information in the object information base according to the index information; and then, displaying all information corresponding to the inquired index information. The query method in this embodiment may be similar to the query method provided in step 204-. Therefore, other details in the present embodiment can refer to the description of the step 204 and the step 206, and are not repeated herein.
By the method in the embodiment, the source data of each data source can be subjected to information extraction and stored in a preset data format, so that the data can be managed conveniently, and the track of related personnel can be inquired conveniently.
EXAMPLE III
Based on the same application concept, a data processing apparatus corresponding to the data processing method is also provided in the embodiments of the present application, and since the principle of the apparatus in the embodiments of the present application for solving the problem is similar to that in the embodiments of the data processing method, the implementation of the apparatus in the embodiments of the present application may refer to the description in the embodiments of the method, and repeated details are not repeated.
Please refer to fig. 6, which is a schematic diagram of functional modules of a data processing apparatus according to an embodiment of the present disclosure. Each module in the data processing apparatus in this embodiment is configured to execute each step in the above-described method embodiment. The data processing apparatus includes: an acquisition module 301, an extraction module 302 and a storage module 303; wherein the content of the first and second substances,
an obtaining module 301, configured to obtain object information from a plurality of data sources;
an extracting module 302, configured to identify the object information to extract multiple items of key information in the object information, where the key information includes: time information, object identification information, location information;
the storage module 303 is configured to store the multiple items of key information according to a preset data format, so as to construct an object information base.
In a possible implementation, the extracting module 302 is configured to:
according to the data type of the object information, obtaining field information of storage key information corresponding to the data type;
and determining key information in the object information according to the field information.
In a possible implementation manner, the object information includes person information, and key information of the person information includes: name, identification, location information and information generation time; an extraction module 302 to:
determining the target name of the person represented by the person information according to the name field information;
determining a first target identity of a person represented by the person information according to the identity field information;
determining real-time position information of the personnel represented by the personnel information according to the position field information;
and determining the generation time of the personnel information according to the time field information.
In one possible embodiment, the object information includes vehicle information, and the key information of the vehicle information includes: license plate number, identity mark, position information and information generation time; an extraction module 302 to:
determining a target license plate number of the vehicle represented by the vehicle information according to the license plate number field information;
according to the identification field information, determining a second target identification of the person to which the vehicle belongs, which is represented by the vehicle information;
according to the position field information, determining the real-time position information of the vehicle represented by the vehicle information;
and determining the generation time of the vehicle information according to the time field information.
In one possible embodiment, the key information of the vehicle information further includes: driver information; an extraction module 302 to:
and carrying out face recognition on the image information in the vehicle information to determine driver information corresponding to the vehicle information.
In a possible implementation, the storage module 303 is configured to:
matching a key field name for each type of information in the key information;
and respectively storing a plurality of items of key information into storage spaces corresponding to the key field names to which the key information belongs to form object information in a preset data format, wherein the plurality of items of object information form an object information base.
In a possible implementation, the storage module 303 is configured to:
and storing the key information according to a JSON format to construct an object information base.
In a possible implementation manner, the data processing apparatus in this embodiment further includes: a query module to:
receiving a data query request sent by a client terminal, wherein the data query request carries index information;
inquiring all information corresponding to the index information in the object information base according to the index information;
and sending all information corresponding to the index information to a client terminal, wherein all information corresponding to the index information is used for forming space-time trajectory information in the client terminal.
In addition, an embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program performs the steps of the data processing method in the foregoing method embodiment.
The computer program product of the data processing method provided in the embodiment of the present application includes a computer-readable storage medium storing a program code, where instructions included in the program code may be used to execute the steps of the data processing method in the foregoing method embodiment, which may be specifically referred to in the foregoing method embodiment, and are not described herein again.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes. It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (10)

1. A data processing method, comprising:
obtaining object information from a plurality of data sources;
identifying the object information to extract a plurality of items of key information in the object information, wherein the key information comprises: time information, object identification information, location information;
and storing the plurality of items of key information according to a preset data format to construct an object information base.
2. The method according to claim 1, wherein the step of identifying the object information to extract a plurality of items of key information in the object information comprises:
according to the data type of the object information, obtaining field information of storage key information corresponding to the data type;
and determining key information in the object information according to the field information.
3. The method of claim 2, wherein the object information comprises person information, and the key information of the person information comprises: name, identification, location information and information generation time; the step of determining key information in the personnel information according to the field information comprises the following steps:
determining the target name of the person represented by the person information according to the name field information;
determining a first target identity of a person represented by the person information according to the identity field information;
determining real-time position information of the personnel represented by the personnel information according to the position field information;
and determining the generation time of the personnel information according to the time field information.
4. The method of claim 2, wherein the object information includes vehicle information, and key information of the vehicle information includes: license plate number, identity mark, position information and information generation time; the step of determining key information in the vehicle information according to the field information comprises the following steps:
determining a target license plate number of the vehicle represented by the vehicle information according to the license plate number field information;
according to the identification field information, determining a second target identification of the person to which the vehicle belongs, which is represented by the vehicle information;
according to the position field information, determining the real-time position information of the vehicle represented by the vehicle information;
and determining the generation time of the vehicle information according to the time field information.
5. The method of claim 4, wherein the key information of the vehicle information further comprises: driver information; the step of determining key information in the vehicle information according to the field information further includes:
and carrying out face recognition on the image information in the vehicle information to determine driver information corresponding to the vehicle information.
6. The method according to claim 1, wherein the step of storing the plurality of items of key information according to a preset data format to construct an object information base comprises:
matching a key field name for each type of information in the key information;
and respectively storing a plurality of items of key information into storage spaces corresponding to the key field names to which the key information belongs to form object information in a preset data format, wherein the plurality of items of object information form an object information base.
7. The method according to claim 1, wherein the step of storing the plurality of items of key information according to a preset data format to construct an object information base comprises:
and storing the key information according to a JSON format to construct an object information base.
8. The method according to any one of claims 1-7, further comprising:
receiving a data query request sent by a client terminal, wherein the data query request carries index information;
inquiring all information corresponding to the index information in the object information base according to the index information;
and sending all information corresponding to the index information to a client terminal, wherein all information corresponding to the index information is used for forming space-time trajectory information in the client terminal.
9. A data processing apparatus, comprising:
an acquisition module for acquiring object information from a plurality of data sources;
an extracting module, configured to identify the object information to extract multiple items of key information in the object information, where the key information includes: time information, object identification information, location information;
and the storage module is used for storing the plurality of items of key information according to a preset data format so as to construct an object information base.
10. An electronic device, comprising: a processor, a memory storing machine-readable instructions executable by the processor, the machine-readable instructions when executed by the processor performing the steps of the method of any of claims 1 to 8 when the electronic device is run.
CN201911305888.9A 2019-12-17 2019-12-17 Data processing method and device and electronic equipment Pending CN111008320A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911305888.9A CN111008320A (en) 2019-12-17 2019-12-17 Data processing method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911305888.9A CN111008320A (en) 2019-12-17 2019-12-17 Data processing method and device and electronic equipment

Publications (1)

Publication Number Publication Date
CN111008320A true CN111008320A (en) 2020-04-14

Family

ID=70116750

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911305888.9A Pending CN111008320A (en) 2019-12-17 2019-12-17 Data processing method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN111008320A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112181986A (en) * 2020-10-10 2021-01-05 武汉中科通达高新技术股份有限公司 Data analysis method and device based on Flink framework
WO2024001756A1 (en) * 2022-06-27 2024-01-04 中国第一汽车股份有限公司 Data storage method and apparatus, and electronic device and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101196884A (en) * 2006-12-07 2008-06-11 厦门雅迅网络股份有限公司 Data query processing method of vehicle data base
US20180217607A1 (en) * 2017-02-02 2018-08-02 Futurewei Technologies, Inc. Object recognition in autonomous vehicles
CN109345316A (en) * 2018-10-23 2019-02-15 出门问问信息科技有限公司 Information processing method, device, electronic equipment and computer readable storage medium
CN109710817A (en) * 2018-12-14 2019-05-03 深圳壹账通智能科技有限公司 Electronic device information input method, device, computer equipment and storage medium
CN109753517A (en) * 2018-12-06 2019-05-14 北京明略软件系统有限公司 A kind of method, apparatus, computer storage medium and the terminal of information inquiry
CN110196924A (en) * 2019-05-31 2019-09-03 银河水滴科技(北京)有限公司 The building in characteristic information library, the method for tracing of target object and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101196884A (en) * 2006-12-07 2008-06-11 厦门雅迅网络股份有限公司 Data query processing method of vehicle data base
US20180217607A1 (en) * 2017-02-02 2018-08-02 Futurewei Technologies, Inc. Object recognition in autonomous vehicles
CN109345316A (en) * 2018-10-23 2019-02-15 出门问问信息科技有限公司 Information processing method, device, electronic equipment and computer readable storage medium
CN109753517A (en) * 2018-12-06 2019-05-14 北京明略软件系统有限公司 A kind of method, apparatus, computer storage medium and the terminal of information inquiry
CN109710817A (en) * 2018-12-14 2019-05-03 深圳壹账通智能科技有限公司 Electronic device information input method, device, computer equipment and storage medium
CN110196924A (en) * 2019-05-31 2019-09-03 银河水滴科技(北京)有限公司 The building in characteristic information library, the method for tracing of target object and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112181986A (en) * 2020-10-10 2021-01-05 武汉中科通达高新技术股份有限公司 Data analysis method and device based on Flink framework
WO2024001756A1 (en) * 2022-06-27 2024-01-04 中国第一汽车股份有限公司 Data storage method and apparatus, and electronic device and storage medium

Similar Documents

Publication Publication Date Title
Andresen et al. The (in) appropriateness of aggregating across crime types
Zavareh et al. Estimating road traffic mortality more accurately: use of the capture–recapture method in the West Azarbaijan Province of Iran
US9854208B2 (en) System and method for detecting an object of interest
CN110109908B (en) Analysis system and method for mining potential relationship of person based on social basic information
Zandbergen Influence of street reference data on geocoding quality
US10970318B2 (en) Active change detection for geospatial entities using trend analysis
CN112861972B (en) Site selection method and device for exhibition area, computer equipment and medium
CN106156279A (en) Address based on longitude and latitude and text comparison similarity recognition method and system
US20180150683A1 (en) Systems, methods, and devices for information sharing and matching
CN112131325A (en) Track determination method, device and equipment and storage medium
CN111008320A (en) Data processing method and device and electronic equipment
CA3159045C (en) Method and system for associating a license plate number with a user
CN111709714B (en) Loss personnel prediction method and device based on artificial intelligence
CN113139743A (en) Sewage discharge index analysis method and device, electronic equipment and storage medium
CN111177568B (en) Object pushing method based on multi-source data, electronic device and storage medium
US11468377B2 (en) System and method for creating a census hub in resource constrained regions
CN113178071B (en) Driving risk level identification method and device, electronic equipment and readable storage medium
CN103034866B (en) A kind of target identification method, Apparatus and system
CN111738558B (en) Visualization method, device, equipment and storage medium for behavior risk identification
US20160342846A1 (en) Systems, Methods, and Devices for Information Sharing and Matching
CN116775747A (en) Personnel early warning method and system based on Apriori algorithm
CN117076788A (en) Personnel foothold point location analysis method and system based on multidimensional sensing data
CN112218046B (en) Object monitoring method and device
WO2023039075A1 (en) Systems and methods for high volume processing support of electronic signature tracking
CN115630834A (en) Case dispatching method and device, electronic equipment and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20200414