WO2022110801A1 - Procédé et appareil de traitement de données, dispositif électronique et support de stockage - Google Patents

Procédé et appareil de traitement de données, dispositif électronique et support de stockage Download PDF

Info

Publication number
WO2022110801A1
WO2022110801A1 PCT/CN2021/103180 CN2021103180W WO2022110801A1 WO 2022110801 A1 WO2022110801 A1 WO 2022110801A1 CN 2021103180 W CN2021103180 W CN 2021103180W WO 2022110801 A1 WO2022110801 A1 WO 2022110801A1
Authority
WO
WIPO (PCT)
Prior art keywords
sensing data
location information
data
physical location
sensing
Prior art date
Application number
PCT/CN2021/103180
Other languages
English (en)
Chinese (zh)
Inventor
张笑宇
焦飞
盛崇山
Original Assignee
浙江商汤科技开发有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 浙江商汤科技开发有限公司 filed Critical 浙江商汤科技开发有限公司
Publication of WO2022110801A1 publication Critical patent/WO2022110801A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/20—Instruments for performing navigational calculations
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/005—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 with correlation of navigation data from several sources, e.g. map or contour matching
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29—Geographical information databases

Definitions

  • the present disclosure relates to the technical field of computer vision, and in particular, to a data processing method and apparatus, an electronic device, and a storage medium.
  • the present disclosure proposes a data processing method and apparatus, an electronic device and a storage medium for data processing.
  • a data processing method comprising:
  • the data information includes first sensing data and second sensing data
  • the physical location information of the first sensing data is obtained.
  • obtaining the physical location information of the second sensing data according to the physical location information of the first sensing data includes:
  • the physical location information of the first sensing data the physical location information of the second sensing data collected at the same time as the first sensing data is obtained.
  • the first sensing data and the second sensing data have timestamp information, and obtaining the first sensing data according to the physical location information of the first sensing data is the same as the first sensing data.
  • the physical location information of the second sensing data collected at the same time as the sensing data including:
  • the physical location information of the first sensing data is used as the physical location information of the second sensing data having the same timestamp information as the first sensing data.
  • the timestamp information of the first sensing data and the timestamp information of the second sensing data are determined by the same clock system.
  • the method further includes:
  • performing data segmentation processing on the second sensing data with physical location information to obtain at least one second sensing data set including:
  • any second sensing data set update the physical location information of the second sensing data in the second sensing data set according to the physical location information of the second sensing data corresponding to the intermediate time, where the intermediate time is the The middle value of the start time and the end time of the second sensor data set.
  • performing data segmentation processing on the second sensing data with physical location information to obtain at least one second sensing data set including:
  • For any second sensing data set update the physical location information of the second sensing data in the second sensing data set according to the intermediate location information, where the intermediate location information is the first one in the second sensing data set
  • the physical location information of the second sensing data is an intermediate value of the physical location information of the last second sensing data.
  • a data processing apparatus comprising:
  • an acquisition part configured to acquire a plurality of data information collected for the target area, wherein the data information includes the first sensing data and the second sensing data;
  • a first processing part configured to obtain physical location information of the first sensing data according to the positioning model
  • the second processing part is configured to obtain the physical location information of the second sensing data according to the physical location information of the first sensing data.
  • the second processing part is further configured to:
  • the physical location information of the first sensing data the physical location information of the second sensing data collected at the same time as the first sensing data is obtained.
  • the first sensing data and the second sensing data have timestamp information
  • the second processing part is further configured to:
  • the physical location information of the first sensing data is used as the physical location information of the second sensing data having the same timestamp information as the first sensing data.
  • the timestamp information of the first sensing data and the timestamp information of the second sensing data are determined by the same clock system.
  • the apparatus further includes:
  • the data segmentation part is configured to perform data segmentation processing on the second sensing data with physical location information to obtain at least one second sensing data set.
  • the data segmentation part is further configured as:
  • any second sensing data set update the physical location information of the second sensing data in the second sensing data set according to the physical location information of the second sensing data corresponding to the intermediate time, where the intermediate time is the The middle value of the start time and the end time of the second sensor data set.
  • the data segmentation part is further configured as:
  • For any second sensing data set update the physical location information of the second sensing data in the second sensing data set according to the intermediate location information, where the intermediate location information is the first one in the second sensing data set
  • the physical location information of the second sensing data is an intermediate value of the physical location information of the last second sensing data.
  • an electronic device comprising: a processor; a memory configured to store instructions executable by the processor; wherein the processor is configured to invoke the instructions stored in the memory to execute the above method.
  • a computer-readable storage medium having computer program instructions stored thereon, the computer program instructions implementing the above method when executed by a processor.
  • a plurality of data information for the target area may be acquired, the data information may include first sensing data and second sensing data, and a positioning corresponding to the target area may be established according to the first sensing data Model.
  • the positioning model the physical position information of the first sensing data can be obtained, and then the physical position information of the second sensing data can be obtained according to the physical position information of the first sensing data.
  • the physical location information of the second sensing data collected at the same time can be determined by the physical location information of the first sensing data, and there is no need to preset data collection Pointing and manually marking the physical location information of the sensor data can improve the efficiency of data collection, and because the physical location information obtained through the positioning model is more accurate, the accuracy of each sensor data obtained can be improved.
  • FIG. 1 shows a flowchart of a data processing method according to an embodiment of the present disclosure
  • FIG. 2 shows a schematic diagram of a positioning model according to an embodiment of the present disclosure
  • FIG. 3 shows a flowchart of a data processing method according to an embodiment of the present disclosure
  • FIG. 4 shows a schematic diagram 1 of an application scenario according to an embodiment of the present disclosure
  • FIG. 5 shows a second schematic diagram of an application scenario according to an embodiment of the present disclosure
  • FIG. 6 shows a schematic diagram of a data processing method according to an embodiment of the present disclosure
  • FIG. 7 shows a schematic diagram of a file display interface for the second sensor data according to an embodiment of the present disclosure
  • FIG. 8 shows a block diagram of a data processing apparatus according to an embodiment of the present disclosure
  • FIG. 9 shows a block diagram of an electronic device 800 according to an embodiment of the present disclosure.
  • FIG. 10 shows a block diagram of an electronic device 1900 according to an embodiment of the present disclosure.
  • Data collection is the basis of the indoor positioning model.
  • multiple data collection points are set in advance, sensors are set to collect data on each data collection point, and the physical location information of the data collection point is marked for the collected data.
  • the information data establishes a positioning model, and performs positioning through the established positioning model.
  • the way of manually marking the physical locations of the sensors of the data collection points is inefficient for data collection.
  • an embodiment of the present disclosure provides a data processing method, which can synchronously collect multiple data information of a target area, including first sensing data and second sensing data, wherein the first sensing data may be It is used to establish a positioning model. After the positioning model is obtained, each first sensing data can be positioned through the positioning model to obtain the physical location information of each first sensing data, and then the first sensing data and the second sensing data can be obtained according to each first sensing data.
  • the relationship between the sensing data in time, and the physical location information of the first sensing data, to determine the physical location information of the second sensing data, without the need to preset data collection points and manually mark the physical location information of the sensing data you can Improve the efficiency of data collection.
  • the data processing method may be executed by an electronic device such as a terminal device or a server.
  • the terminal device may be a user equipment (User Equipment, UE), a mobile device, a user Terminals, terminals, cellular phones, cordless phones, personal digital assistants (PDAs), handheld devices, computing devices, in-vehicle devices, wearable devices, intelligent robots, etc.
  • the method can call the stored in the memory through the processor.
  • computer readable instructions Alternatively, the method may be performed by a server.
  • the data processing method may include:
  • step S11 multiple pieces of data information collected for the target area are acquired, the data information including the first sensing data and the second sensing data.
  • the target area is an area to be data collected, and the area may be a building, a venue, or other area.
  • the positioning network is a neural network
  • the data information of the shopping mall needs to be collected, and the shopping mall is the target area.
  • the first sensory data may be data that can be used to build a positioning model.
  • the first sensing data may be collected by at least one first sensing device.
  • the first sensing device may be at least one of a video acquisition device, a laser radar device, an infrared device, and an ultrasonic device, and the first sensing data may be at least one of video data, laser data, infrared data, and ultrasonic data. kind.
  • the number of first sensing data included in the data information may be one or more.
  • one first sensing device may collect one or more pieces of first sensing data, which is not limited in this embodiment of the present disclosure.
  • the second sensing data is data for which physical location information cannot be directly obtained.
  • the second sensing data may be collected by at least one second sensing device.
  • the second sensing device may include at least one of a wireless broadband WIFI device, a Bluetooth device, and an Ultra Wide Band (UWB) device, and the second sensing data may include WiFi signals, Bluetooth signals, and UWB data. at least one of.
  • the number of second sensing data included in the data information may be one or more.
  • a second sensing device may collect one or more second sensing data, which is not limited in this embodiment of the present disclosure.
  • At least one first sensing device and at least one second sensing device may be located at the same position in the target area, and collect data information of the target area.
  • step S12 a positioning model corresponding to the target area is established according to the first sensing data.
  • a three-dimensional reconstruction method For example: SFM (Structure from motion, motion structure recovery) and other methods, establish a localization model corresponding to the target area.
  • FIG. 2 shows a positioning model obtained by performing three-dimensional reconstruction of the first sensing data through a three-dimensional reconstruction method.
  • the acquired inertial measurement unit (IMU, Inertial measurement unit) data can also be used as constraints to obtain a positioning model with higher accuracy.
  • the number of the first transmission data is multiple.
  • the registration transmission data in the multiple first sensing data may be used.
  • the registered sensor data is data satisfying a preset condition in the first sensor data, and the registered sensor data may be one or more of a plurality of first transmission data.
  • the preset condition may be a condition for measuring the data quality of the first sensing data.
  • a first sensing data satisfies a preset condition, it can be considered that the quality of the first sensing data is better, that is, the first sensing data can be used to establish a positioning model corresponding to the target area.
  • the first sensing data is determined to be registered sensing data.
  • first sensing data is video data and a positioning model is established by using the SFM technology, which is only an example of the embodiment of the present disclosure.
  • type of the first sensing data in the embodiment of the present disclosure is without limitation, the method for establishing the positioning model based on the first sensing data is not specifically limited.
  • step S13 the physical location information of the first sensing data is obtained according to the positioning model.
  • each first sensing data may be positioned based on the positioning model to obtain physical location information of each first sensing data.
  • the Visual positioning is performed on the sensing data to obtain the positioning result of the first sensing data, that is, the physical position information of the first video data is obtained.
  • the physical location information of the first video data may be obtained by visual positioning through a VPS (Visual Positioning Service, visual positioning service).
  • VPS Visual Positioning Service, visual positioning service
  • step S14 the physical location information of the second sensing data is obtained according to the physical location information of the first sensing data.
  • the time correlation between each first sensing data and the second sensing data may be determined, and after obtaining the physical location information of each first sensing data, the physical location corresponding to the first sensing data may be information, as the physical location information of the second sensing data that has a time-related relationship with the first sensing data.
  • the data information can include the first sensing data and the second sensing data, and a positioning model corresponding to the target area can be established according to the first sensing data.
  • the positioning model the physical position information of the first sensing data can be obtained, and then the physical position information of the second sensing data can be obtained according to the physical position information of the first sensing data.
  • the physical location information of the second sensor data collected at the same time can be determined by the physical location information of the first sensor data, and there is no need to preset the data collection point and manually mark the sensor data.
  • the physical location information can improve the efficiency of data collection, and because the physical location information obtained through the positioning model is more precise, the accuracy of the acquired sensing data can be improved.
  • the obtaining the physical location information of the second sensing data according to the physical location information of the first sensing data may include:
  • the physical location information of the first sensing data the physical location information of the second sensing data collected at the same time as the first sensing data is obtained.
  • the second sensing data collected at the same time as the first sensing data may be determined, and then the physical location information of the first sensing data may be used as the second sensing data collected at the same time as the first sensing data. Physical location information of sensor data.
  • the user may control the first sensing device and the second sensing device to collect data at the same time, the first sensing device collects the first sensing data 1 at time 1, and collects the first sensing data 2 at time 2, , wherein the first sensory data 1 is data for establishing a positioning model.
  • the second sensing data collects the second sensing data 1 at time 1, and after obtaining the physical location information 1 of the first sensing data 1 according to the positioning model, it can be determined that the physical location information corresponding to the second sensing data 1 is physical Location information 1.
  • the first sensing data and the second sensing data have timestamp information.
  • the The physical location information of the second sensing data collected at the same moment of the first sensing data may include:
  • step S141 the first sensing data and the second sensing data having the same timestamp information are determined.
  • the first sensing device and the second sensing device may be integrated into the same device, and the first sensing device and the second sensing device may obtain the first sensing device by accessing the first clock system of the device. Timestamp information of the sensing data and timestamp information of the second sensing data.
  • the first clock system is a built-in clock system of the device, and each sensor and each application program can obtain time stamp information by accessing the first clock system.
  • the first clock system can be implemented by a software program.
  • the present disclosure does not specifically limit the implementation of the first clock system.
  • the timestamp information of the first sensing data and the timestamp information of the second sensing data are determined by the same clock system.
  • the first sensing device may be a camera 41
  • the second sensing device may be a Bluetooth device 42
  • the first sensing device and the second sensing device are integrated into the electronic device 40 .
  • the electronic device 40 can control the camera 41 and the Bluetooth device 42 to collect data synchronously, and generate time stamp information through the clock system inside the electronic device 40 , and add the time stamp information to the data collected by the camera 41 and the data collected by the Bluetooth device 42 .
  • the first sensing device and the second sensing device are independent devices.
  • the first sensing device and the second sensing device can be connected to the same data acquisition system.
  • the data acquisition system has a second clock system, and the second clock system can provide standard and reliable time stamp information for the connected sensing devices, which can be realized by a hardware timing module or software.
  • Embodiments of the present disclosure The implementation manner of the second clock system is not limited. Both the first sensing device and the second sensing device can obtain timestamp information of the first sensing data and timestamp information of the second sensing data by accessing the second clock system.
  • the user can send data synchronously to the first sensing device and the second sensing device through the data acquisition system
  • the collection instruction the first sensing device can collect the first sensing data in response to the data collection instruction, and access the second clock system when collecting the first sensing data to obtain timestamp information of the first sensing data.
  • the second sensing device may collect the second sensing data in response to the data collection instruction, and access the second clock system when collecting the second sensing data to obtain timestamp information of the second sensing data.
  • the first sensing device may be a digital camera device 51
  • the second sensing device may be a wireless fidelity (Wireless Fidelity, WiFi) device 52
  • the digital camera device 51 and the WiFi device 52 can collect data under the control of the smart phone 53 .
  • the smartphone 53 can be connected to the digital camera device 51 and the WiFi device 52 through the network 54.
  • the smart phone 53 can send the data collection instruction to the digital camera device 51 and the WiFi device 52 through the network 54 .
  • the digital camera device 51 and the WiFi device 52 can access the clock system of the smart phone 53 to obtain time stamp information corresponding to the collected data.
  • the timestamp information of the first sensing data and the second sensing data can be compared, and the second sensing data that is the same as the timestamp information of each first sensing data can be determined from the second sensing data.
  • the timestamp information can be accurate to the millisecond level.
  • the timestamp information corresponding to a certain transmission data is "2019:10:23:21:05:45:835".
  • step S142 the physical location information of the first sensing data is used as the physical location information of the second sensing data having the same timestamp information as the first sensing data.
  • the first sensing data and the second sensing data collected at the same time are data collected at the same location. Since the physical location information of the first sensing data has been obtained through the positioning model, the first sensing data can be The physical location information of the first sensing data is taken as the physical location information of the second sensing data collected at the same time as the first sensing data (that is, having the same timestamp information), so that the second sensing data with the physical location information is obtained. sensor data.
  • the method may further include:
  • the purpose of collecting sensor data is to construct a data set, and the data set is used to establish a sensor positioning model corresponding to the target area. Therefore, after the sensor data with physical location information is obtained, the sensor data can be processed by data segmentation to obtain at least one data set, and then a sensor positioning model can be established according to the at least one data set.
  • data segmentation processing may be performed on the second sensing data with physical location information from the perspective of time and/or space to obtain at least one first sensing data.
  • Two sensor data sets any one of the second sensor data sets includes at least one second sensor data set.
  • multiple second sensing data in the second sensing data set may be regarded as multiple sensing data collected at a data collection point corresponding to the second sensing data set sense data.
  • a sensing positioning model of the corresponding sensing device can be established according to the second sensing data sets, so that after the second sensing data is subsequently collected, The sensor data and sensor positioning model are used for positioning operation.
  • the data processing method provided by the embodiments of the present disclosure can support mobile continuous collection of sensor data, and automatically segment the continuous data to obtain at least one data set for establishing a positioning model, which saves labor costs and improves data efficiency. collection efficiency.
  • performing data segmentation processing on the second sensing data with physical location information to obtain at least one second sensing data set may include:
  • any second sensing data set update the physical location information of the second sensing data in the second sensing data set according to the physical location information of the second sensing data corresponding to the intermediate time, where the intermediate time is the The middle value of the start time and the end time of the second sensor data set.
  • the preset time interval can be a preset value, or the preset time interval can also be determined according to the timestamp information and the preset number of second sensing data sets, for example: the timestamp of the second sensing data
  • the minimum information is 00:00:00, and the maximum is 02:00:00.
  • the preset time interval can be determined to be 2 minutes.
  • the second sensing data is segmented once every preset time interval, and at least one second transmission data obtained by each segmenting constitutes a second sensing data set.
  • the preset time interval is 2 minutes
  • the timestamp information of the second sensing data is divided into: 00:00:00 ⁇ 00:02:00, 00:02:01 ⁇ 00:04:00, ... ..., 01:58:01 ⁇ 02:00:00, that is, the second sensing data whose timestamp information is within 00:00:00 ⁇ 00:02:00 constitutes a second sensing data set, and so on, A plurality of second sensory data sets may be obtained.
  • the middle time in the second sensor data set may be determined, and the middle time may be the middle value of the start time and the end time of the second sensor data set, for example: the second sensor data set
  • the corresponding start time and end time of the sensory data set are: 00:00:00 ⁇ 00:02:00, and the middle time is 00:01:00.
  • the second sensing data corresponding to the intermediate time can be determined, and the physical location information corresponding to the second sensing data can be used as the location information of the data collection point corresponding to the second sensing data set, and the second sensing data
  • the physical location information corresponding to other second sensing data in the data collection point is updated to the location information of the data collection point, so as to obtain a plurality of second sensor data collected at the data collection point.
  • each second sensing data set is updated, it is equivalent to obtaining multiple second sensing data sets collected at multiple data collection points, and then the multiple second sensing data sets can be obtained according to the multiple second sensing data sets. Set up the positioning model.
  • performing data segmentation processing on the second sensing data with physical location information to obtain at least one second sensing data set may include:
  • For any second sensing data set update the physical location information of the second sensing data in the second sensing data set according to the intermediate location information, where the intermediate location information is the first one in the second sensing data set
  • the physical location information of the second sensing data is an intermediate value of the physical location information of the last second sensing data.
  • the preset position interval can be a preset value, or the preset position interval can also be determined according to the physical position information and the preset number of second sensing data sets, for example: all the collected second sensing data The longest distance between them is 120m. Assuming that the preset number of second sensing data sets is 60, the preset time interval can be determined to be 2m.
  • the second sensing data is segmented once every preset location interval, and at least one second transmission data obtained by each segmenting constitutes a second sensing data set. For example, if the preset position interval is 2m, the second sensing data is divided every 2m, and a plurality of second sensing data obtained by each division forms a second sensing data set, and so on. A plurality of second sensor data sets are obtained.
  • intermediate location information in the second sensing data set may be determined, and the intermediate location information may be physical location information corresponding to the first second sensing data in the second sensing data set , the middle value of the physical location information corresponding to the last second sensor data, for example: the physical location information of the first second sensor data corresponding to the second sensor data set is (x1, y1), the last The physical location information of the second sensing data is (x2, y2), and the intermediate location information is ((x1+x2)/2, (y1+y2)/2).
  • the intermediate position information can be used as the position information of the data collection point corresponding to the second sensing data set, and the physical position information corresponding to a plurality of second sensing data in the second sensing data can be updated to the data collection point. position information of the point to obtain a plurality of second sensing data collected at the data collection point.
  • each second sensing data set is updated, it is equivalent to obtaining multiple second sensing data sets collected at multiple data collection points, and then the multiple second sensing data sets can be obtained according to the multiple second sensing data sets. Set up the positioning model.
  • the second sensing data set for training the positioning model can be obtained without presetting the data collection point and manually marking the physical location of the sensing data, which can improve the efficiency of data collection and the training accuracy of the positioning model.
  • the method may further include:
  • the sensing positioning model is trained by the second sensing data set, and the sensing positioning model is obtained, and the sensing positioning model is used for positioning according to the sensing data collected by the second sensing device.
  • each second sensing data set may be used as sample data, and each second sensing data set may be used as sample data.
  • the physical location information corresponding to the second sensing data in the sensing data set is the labeling information of the sample data, and the sensing positioning model corresponding to the second sensing device is obtained through the training of the second sensing data set. Furthermore, during the positioning process, a corresponding positioning result can be obtained through the sensing positioning model according to the second sensing data collected by the second sensing device.
  • fusion positioning may be performed subsequently, that is, according to the sensing data collected by the first sensing device and The positioning model obtains the first positioning result, the second positioning result is obtained according to the sensing data collected by the second sensing device and the sensing positioning model, and the first positioning result and the second positioning result are fused to obtain the final positioning result.
  • the fusion positioning of the sensing positioning models obtained through training can improve the The accuracy of the fusion positioning results is improved to improve the robustness of the positioning service.
  • the data processing method may include the following steps:
  • Step 1 Collect sensing data through multiple sensing devices.
  • the data processing device can control different sensing devices to collect data synchronously to obtain sensing data carrying time stamp information
  • the sensing data may include first sensing data and second sensing data.
  • Step 2 using the first sensing data to establish a positioning model.
  • the first sensing data may be image frames in a video.
  • the data processing device uses the SFM technology to reconstruct the three-dimensional model of the plurality of first sensing data to obtain a positioning model.
  • Step 3 Determine physical location information corresponding to the first sensing data based on the positioning model.
  • the data processing device can obtain the position of the optical center of the image frame, thereby obtaining the physical position information of the image frame (ie, the first sensing data).
  • the corresponding relationship between time and location can be determined.
  • Step 4 Based on the timestamp information corresponding to the second sensing data, construct a corresponding relationship between the time and the second sensing data.
  • Step 5 Obtain second sensing data with physical location information by using the corresponding relationship between time and location and the corresponding relationship between time and second sensing data.
  • the data processing apparatus determines the first sensing data having the same timestamp information as the second sensing data.
  • the location information of the first sensing data is determined as the location information of the second sensing data, so that the second sensing data having the physical location information is obtained.
  • Step 6 Perform data segmentation processing on the second sensing data to obtain a plurality of second sensing data sets.
  • the data processing apparatus may segment and archive the second sensing data according to time intervals.
  • the second sensing data set is equivalent to obtaining multiple second sensing data sets collected at multiple data collection points, and then a sensing positioning model can be established according to the multiple second sensing data sets.
  • the data processing apparatus performs data segmentation processing on the second sensing data to obtain a schematic diagram of a file display interface of a plurality of second sensing data sets.
  • the sensing data of the sensor positioning model is collected at the same time, and the physical location information is aligned according to the collection time. Therefore, when each sensor positioning model obtained through training is used for fusion positioning, the accuracy of the fusion positioning results can be improved, and the positioning service can be improved. robustness.
  • the present disclosure also provides data processing apparatuses, electronic devices, computer-readable storage media, and programs, all of which can be used to implement any data processing method provided by the present disclosure.
  • data processing apparatuses electronic devices, computer-readable storage media, and programs, all of which can be used to implement any data processing method provided by the present disclosure.
  • FIG. 8 shows a block diagram of a data processing apparatus according to an embodiment of the present disclosure. As shown in FIG. 8 , the apparatus includes:
  • the acquiring part 81 can be configured to acquire a plurality of data information collected for the target area, wherein the data information includes the first sensing data and the second sensing data;
  • model part 82 which may be configured to establish a positioning model corresponding to the target area according to the first sensing data
  • the first processing part 83 can be configured to obtain the physical location information of the first sensing data according to the positioning model
  • the second processing part 84 may be configured to obtain the physical location information of the second sensing data according to the physical location information of the first sensing data.
  • the data information can include the first sensing data and the second sensing data, and a positioning model corresponding to the target area can be established according to the first sensing data.
  • the positioning model the physical position information of the first sensing data can be obtained, and then the physical position information of the second sensing data can be obtained according to the physical position information of the first sensing data.
  • the physical location information of the second sensor data collected at the same time can be determined by the physical location information of the first sensor data, and there is no need to preset the data collection point and manually mark the sensor data.
  • the physical location information can improve the efficiency of data collection, and because the physical location information obtained through the positioning model is more precise, the accuracy of the acquired sensing data can be improved.
  • the second processing part 84 may also be configured as:
  • the physical location information of the first sensing data the physical location information of the second sensing data collected at the same time as the first sensing data is obtained.
  • the first sensing data and the second sensing data have timestamp information
  • the second processing part 84 may be further configured as:
  • the physical location information of the first sensing data is used as the physical location information of the second sensing data having the same timestamp information as the first sensing data.
  • the timestamp information of the first sensing data and the timestamp information of the second sensing data are determined by the same clock system.
  • the apparatus may further include:
  • the data segmentation part may be configured to perform data segmentation processing on the second sensing data with physical location information to obtain at least one second sensing data set.
  • the data segmentation part may also be configured as:
  • any second sensing data set update the physical location information of the second sensing data in the second sensing data set according to the physical location information of the second sensing data corresponding to the intermediate time, where the intermediate time is the The middle value of the start time and the end time of the second sensor data set.
  • the data segmentation part may also be configured as:
  • For any second sensing data set update the physical location information of the second sensing data in the second sensing data set according to the intermediate location information, where the intermediate location information is the first one in the second sensing data set
  • the physical location information of the second sensing data is an intermediate value of the physical location information of the last second sensing data.
  • the functions or included parts of the apparatus provided in the embodiments of the present disclosure may be configured to execute the methods described in the above method embodiments, and the specific implementation may refer to the above method embodiments. For brevity, I won't go into details here.
  • Embodiments of the present disclosure further provide a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the foregoing method is implemented.
  • the computer-readable storage medium may be a non-volatile computer-readable storage medium.
  • An embodiment of the present disclosure further provides an electronic device, including: a processor; a memory that can be configured to store instructions executable by the processor; wherein the processor is configured to call the instructions stored in the memory to execute the above method .
  • Embodiments of the present disclosure also provide a computer program product, including computer-readable code, when the computer-readable code is run on a device, a processor in the device executes a data processing method configured to implement the data processing method provided in any of the above embodiments instruction.
  • Embodiments of the present disclosure further provide another computer program product configured to store computer-readable instructions, which, when executed, cause the computer to perform the operations of the data processing method provided by any of the foregoing embodiments.
  • the electronic device may be provided as a terminal, server or other form of device.
  • FIG. 9 shows a block diagram of an electronic device 800 according to an embodiment of the present disclosure.
  • electronic device 800 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, etc. terminal.
  • an electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814 , and the communication component 816 .
  • the processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations.
  • the processing component 802 can include one or more processors 820 to execute instructions to perform all or some of the steps of the methods described above.
  • processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components.
  • processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.
  • Memory 804 is configured to store various types of data to support operation at electronic device 800 . Examples of such data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. Memory 804 may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM erasable Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Magnetic or Optical Disk Magnetic Disk
  • Power supply assembly 806 provides power to various components of electronic device 800 .
  • Power supply components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800 .
  • Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user.
  • the touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action.
  • the multimedia component 808 includes a front-facing camera and/or a rear-facing camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.
  • Audio component 810 is configured to output and/or input audio signals.
  • audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when electronic device 800 is in operating modes, such as calling mode, recording mode, and voice recognition mode.
  • the received audio signal may be further stored in memory 804 or transmitted via communication component 816 .
  • audio component 810 also includes a speaker for outputting audio signals.
  • the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.
  • Sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of electronic device 800 .
  • the sensor assembly 814 can detect the on/off state of the electronic device 800, the relative positioning of the components, such as the display and the keypad of the electronic device 800, the sensor assembly 814 can also detect the electronic device 800 or one of the electronic device 800 Changes in the position of components, presence or absence of user contact with the electronic device 800 , orientation or acceleration/deceleration of the electronic device 800 and changes in the temperature of the electronic device 800 .
  • Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact.
  • Sensor assembly 814 may also include a light sensor, such as a complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) image sensor, for use in imaging applications.
  • CMOS complementary metal oxide semiconductor
  • CCD charge coupled device
  • the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices.
  • the electronic device 800 may access a wireless network based on a communication standard, such as wireless network (WiFi), second generation mobile communication technology (2G) or third generation mobile communication technology (3G), or a combination thereof.
  • the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication.
  • the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • electronic device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmed gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable A programmed gate array
  • controller microcontroller, microprocessor or other electronic component implementation is used to perform the above method.
  • a non-volatile computer-readable storage medium such as a memory 804 comprising computer program instructions executable by the processor 820 of the electronic device 800 to perform the above method is also provided.
  • FIG. 10 shows a block diagram of an electronic device 1900 according to an embodiment of the present disclosure.
  • the electronic device 1900 may be provided as a server.
  • electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource, represented by memory 1932, for storing instructions executable by processing component 1922, such as applications.
  • An application program stored in memory 1932 may include one or more modules, each corresponding to a set of instructions.
  • the processing component 1922 is configured to execute instructions to perform the above-described methods.
  • the electronic device 1900 may also include a power supply assembly 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input output (I/O) interface 1958 .
  • the electronic device 1900 can operate based on an operating system stored in the memory 1932, such as a Microsoft server operating system (Windows ServerTM), a graphical user interface based operating system (Mac OS XTM) introduced by Apple, a multi-user, multi-process computer operating system (UnixTM). ), Free and Open Source Unix-like Operating System (LinuxTM), Open Source Unix-like Operating System (FreeBSDTM) or similar.
  • a non-volatile computer-readable storage medium such as memory 1932 comprising computer program instructions executable by processing component 1922 of electronic device 1900 to perform the above-described method.
  • the present disclosure may be a system, method and/or computer program product.
  • the computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the present disclosure.
  • a computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
  • Non-exhaustive list of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
  • RAM random access memory
  • ROM read only memory
  • EPROM erasable programmable read only memory
  • flash memory static random access memory
  • SRAM static random access memory
  • CD-ROM compact disk read only memory
  • DVD digital versatile disk
  • memory sticks floppy disks
  • mechanically coded devices such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
  • Computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.
  • An embodiment of the present disclosure further provides a computer program, including computer-readable code, when the computer-readable code is executed in an electronic device, a processor in the electronic device executes a state detection method configured to implement the above-mentioned camera lens Example steps.
  • the computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network, and/or a wireless network.
  • the network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers.
  • a network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .
  • Computer program instructions for carrying out operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages.
  • Source or object code written in any combination, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as the "C" language or similar programming languages.
  • the computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement.
  • the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect).
  • LAN local area network
  • WAN wide area network
  • custom electronic circuits such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs) can be personalized by utilizing state information of computer readable program instructions.
  • Computer readable program instructions are executed to implement various aspects of the present disclosure.
  • These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
  • These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium on which the instructions are stored includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
  • Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more functions for implementing the specified logical function(s) executable instructions.
  • the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.
  • the computer program product can be specifically implemented by hardware, software or a combination thereof.
  • the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), etc. Wait.
  • a software development kit Software Development Kit, SDK

Landscapes

  • Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Position Fixing By Use Of Radio Waves (AREA)
  • Telephone Function (AREA)

Abstract

La présente invention concerne un procédé et un appareil de traitement de données, un dispositif électronique et un support de stockage. Le procédé consiste à : obtenir de multiples éléments d'informations de données acquises par rapport à une région cible, les informations de données comprenant des premières données de détection et des secondes données de détection (S11) ; construire, en fonction des premières données de détection, un modèle de positionnement correspondant à la région cible (S12) ; obtenir, sur la base du modèle de positionnement, des informations d'emplacement physique des premières données de détection (S13) ; et obtenir, sur la base des informations d'emplacement physique des premières données de détection, des informations d'emplacement physique des secondes données de détection (S14). L'invention peut améliorer l'efficacité de l'acquisition de données.
PCT/CN2021/103180 2020-11-26 2021-06-29 Procédé et appareil de traitement de données, dispositif électronique et support de stockage WO2022110801A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011355417.1A CN112461245A (zh) 2020-11-26 2020-11-26 数据处理方法及装置、电子设备和存储介质
CN202011355417.1 2020-11-26

Publications (1)

Publication Number Publication Date
WO2022110801A1 true WO2022110801A1 (fr) 2022-06-02

Family

ID=74808977

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/103180 WO2022110801A1 (fr) 2020-11-26 2021-06-29 Procédé et appareil de traitement de données, dispositif électronique et support de stockage

Country Status (2)

Country Link
CN (1) CN112461245A (fr)
WO (1) WO2022110801A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112461245A (zh) * 2020-11-26 2021-03-09 浙江商汤科技开发有限公司 数据处理方法及装置、电子设备和存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110082639A1 (en) * 2005-01-31 2011-04-07 Searete Llc Method and system for interactive mapping to provide goal-oriented instructions
CN109766793A (zh) * 2018-12-25 2019-05-17 百度在线网络技术（北京）有限公司 数据处理方法和装置
CN109814710A (zh) * 2018-12-27 2019-05-28 青岛小鸟看看科技有限公司 数据处理方法、装置及虚拟现实设备
CN109871385A (zh) * 2019-02-28 2019-06-11 北京百度网讯科技有限公司 用于处理数据的方法和装置
CN111811521A (zh) * 2020-07-09 2020-10-23 北京百度网讯科技有限公司 定位方法和装置、电子设备、车端设备、自动驾驶汽车
CN112461245A (zh) * 2020-11-26 2021-03-09 浙江商汤科技开发有限公司 数据处理方法及装置、电子设备和存储介质

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101277511B (zh) * 2007-03-30 2011-06-01 展讯通信（上海）有限公司 一种无线定位方法与装置
CN105044668A (zh) * 2015-08-25 2015-11-11 武汉易得路位置科技有限公司 一种基于多传感器装置的wifi指纹数据库构建方法
US9772395B2 (en) * 2015-09-25 2017-09-26 Intel Corporation Vision and radio fusion based precise indoor localization
US10660062B1 (en) * 2019-03-14 2020-05-19 International Business Machines Corporation Indoor positioning
CN110704683A (zh) * 2019-09-27 2020-01-17 深圳市商汤科技有限公司 音视频信息处理方法及装置、电子设备和存储介质
CN111651441B (zh) * 2020-05-11 2023-05-09 北京小米移动软件有限公司 数据处理方法及装置、计算机存储介质
CN111664844B (zh) * 2020-05-29 2022-08-16 阿波罗智联(北京)科技有限公司 导航方法、导航装置和电子设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110082639A1 (en) * 2005-01-31 2011-04-07 Searete Llc Method and system for interactive mapping to provide goal-oriented instructions
CN109766793A (zh) * 2018-12-25 2019-05-17 百度在线网络技术（北京）有限公司 数据处理方法和装置
CN109814710A (zh) * 2018-12-27 2019-05-28 青岛小鸟看看科技有限公司 数据处理方法、装置及虚拟现实设备
CN109871385A (zh) * 2019-02-28 2019-06-11 北京百度网讯科技有限公司 用于处理数据的方法和装置
CN111811521A (zh) * 2020-07-09 2020-10-23 北京百度网讯科技有限公司 定位方法和装置、电子设备、车端设备、自动驾驶汽车
CN112461245A (zh) * 2020-11-26 2021-03-09 浙江商汤科技开发有限公司 数据处理方法及装置、电子设备和存储介质

Also Published As

Publication number Publication date
CN112461245A (zh) 2021-03-09

Similar Documents

Publication Publication Date Title
TWI781359B (zh) 人臉和人手關聯檢測方法及裝置、電子設備和電腦可讀儲存媒體
TWI769635B (zh) 網路訓練、行人重識別方法、電子設備及電腦可讀存儲介質
TWI766286B (zh) 圖像處理方法及圖像處理裝置、電子設備和電腦可讀儲存媒介
TWI753348B (zh) 位姿確定方法、位姿確定裝置、電子設備和電腦可讀儲存媒介
RU2648625C2 (ru) Способ и устройство для определения пространственного параметра на основе изображения, а также оконечное устройство
TW202113756A (zh) 圖像處理方法及裝置、電子設備、儲存媒體和電腦程式
TW202113757A (zh) 目標對象匹配方法及目標對象匹配裝置、電子設備和電腦可讀儲存媒介
US20200327353A1 (en) Image processing method and apparatus, electronic device, and storage medium
WO2021253777A1 (fr) Procédés et appareils de traitement vidéo et de détection d'attitude, dispositif électronique et support de stockage
CN114814872A (zh) 位姿确定方法及装置、电子设备和存储介质
CN104112129A (zh) 图像识别方法及装置
WO2022188305A1 (fr) Procédé et appareil de présentation d'informations, dispositif électronique, support de stockage et programme informatique
CN105959587A (zh) 快门速度获取方法和装置
US20220043164A1 (en) Positioning method, electronic device and storage medium
WO2022134475A1 (fr) Procédé et appareil de construction de carte de nuage de points, dispositif électronique, support de stockage et programme
CN112432637B (zh) 定位方法及装置、电子设备和存储介质
WO2022017140A1 (fr) Procédé et appareil de détection de cible, dispositif électronique et support de stockage
TW202205127A (zh) 目標檢測方法、電子設備和電腦可讀儲存介質
CN111523599B (zh) 目标检测方法及装置、电子设备和存储介质
WO2023035481A1 (fr) Procédé et appareil de statistique de volume de piéton, dispositif électronique et support de stockage
WO2022179080A1 (fr) Procédé et appareil de positionnement, dispositif électronique, support de stockage, programme et produit
WO2022110801A1 (fr) Procédé et appareil de traitement de données, dispositif électronique et support de stockage
TWI770531B (zh) 人臉識別方法、電子設備和儲存介質
WO2023155350A1 (fr) Procédé et appareil de positionnement de foule, dispositif électronique et support de stockage
CN106203436A (zh) 图像二值化方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21896309

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21896309

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 21896309

Country of ref document: EP

Kind code of ref document: A1