WO2022135459A1

WO2022135459A1 - Method for reporting terminal sensor information, terminal, and readable storage medium

Info

Publication number: WO2022135459A1
Application number: PCT/CN2021/140400
Authority: WO
Inventors: 孙鹏; 邬华明; 司晔; 王园园
Original assignee: 维沃移动通信有限公司
Priority date: 2020-12-23
Filing date: 2021-12-22
Publication date: 2022-06-30
Also published as: CN114666784A

Abstract

Disclosed by the present application are a method for reporting terminal sensor information, a terminal, and a readable storage medium, the method for reporting terminal sensor information comprising: a first terminal reporting sensor-related information, the sensor-related information comprising at least one of the following: device information of the sensor and first measurement information of the sensor.

Description

Method, terminal and readable storage medium for reporting terminal sensor information

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to Chinese Patent Application No. 202011541787.4 filed in China on Dec. 23, 2020, the entire contents of which are incorporated herein by reference.

technical field

The present application belongs to the technical field of positioning, and in particular relates to a method for reporting terminal sensor information, a terminal and a readable storage medium.

Background technique

In the related art, a terminal such as a mobile phone is provided with a variety of sensors, such as an image sensor, and a camera is generally provided on a terminal such as a mobile phone, a tablet computer, and a driving recorder, and a camera is an image sensor.

However, in the related art, image sensors such as cameras are generally only used to obtain media data such as photos and videos, and cannot be applied to other scenarios such as positioning. Therefore, these sensors are not effectively utilized, resulting in waste of terminal sensor performance.

Therefore, how to solve the waste of terminal sensor performance is an urgent technical problem to be solved.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a method for reporting terminal sensor information, a terminal, and a readable storage medium, which can achieve the effect of solving the waste of terminal sensor performance.

In a first aspect, an embodiment of the present application provides a method for reporting terminal sensor information, including:

Obtain sensor-related information of the first terminal, where the sensor-related information includes at least one of the following: device information of the sensor and first measurement information of the sensor.

In a second aspect, an embodiment of the present application provides a terminal, including a memory and a processor, the memory stores programs or instructions, and the processor implements the method for reporting terminal sensor information according to the first aspect when the processor executes the programs or instructions.

In a third aspect, embodiments of the present application provide a readable storage medium on which programs or instructions are stored, and when the programs or instructions are executed by a processor, the method for reporting terminal sensor information according to the first aspect is implemented.

In a fourth aspect, a chip is provided, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a network-side device program or instruction to implement the first aspect Method for reporting terminal sensor information.

In a fifth aspect, a computer program product is provided, the computer program product is stored in a non-transitory storage medium, and the computer program product is executed by at least one processor to implement the reporting of terminal sensor information according to the first aspect Methods.

A sixth aspect provides a communication device configured to perform the steps of the method for reporting terminal sensor information as in the first aspect.

In the embodiment provided in this application, by collecting the device information of the sensor and the first measurement information of the sensor in the current terminal, that is, the first terminal, the device information of the sensor and the first measurement information of the sensor are collected, such as data transmission and positioning. The realization of such functions, on the one hand, effectively utilizes the performance of various sensors set on the terminal device, solves the problem of waste of terminal sensor performance, and on the other hand makes the terminal positioning no longer dependent on base station positioning or global positioning system Positioning System, GPS) signal, which improves the success rate and versatility of terminal positioning, and improves the positioning performance of the terminal.

Description of drawings

FIG. 1 shows one of the flowcharts of a method for reporting terminal sensor information according to an embodiment of the present application;

FIG. 2 shows the second flowchart of a method for reporting terminal sensor information according to an embodiment of the present application;

FIG. 3 shows the third flowchart of a method for reporting terminal sensor information according to an embodiment of the present application;

FIG. 4 shows a fourth flowchart of a method for reporting terminal sensor information according to an embodiment of the present application;

FIG. 5 shows the fifth flowchart of the method for reporting terminal sensor information according to an embodiment of the present application;

FIG. 6 shows the sixth flowchart of the method for reporting terminal sensor information according to an embodiment of the present application;

FIG. 7 shows the seventh flowchart of the method for reporting terminal sensor information according to an embodiment of the present application;

FIG. 8 shows a schematic structural diagram of a terminal according to an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

The terms "first", "second" and the like in the description and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It is to be understood that data so used may be interchanged under appropriate circumstances so that embodiments of the application can be practiced in sequences other than those illustrated or described herein. In addition, "and/or" in the description and claims indicates at least one of the connected objects, and the character "/" generally indicates that the associated objects are in an "or" relationship.

The method for reporting terminal sensor information provided by the embodiments of the present application will be described in detail below through specific embodiments and application scenarios with reference to the accompanying drawings.

In some embodiments of the present application, the method for reporting terminal sensor information includes: the first terminal reports sensor-related information, and the sensor-related information includes at least one of the following: device information of the sensor and first measurement information of the sensor.

In the embodiment of the present application, the device information of the sensor and the first measurement information of the sensor in the current terminal, that is, the first terminal, are collected and reported, and the device information of the sensor and the first measurement information of the sensor are used to perform such as The realization of functions such as data transmission and positioning effectively utilizes the performance of various sensors set on the terminal device, and solves the problem of waste of terminal sensor performance.

In some embodiments of the present application, FIG. 1 shows one of the flowcharts of a method for reporting terminal sensor information according to an embodiment of the present application. As shown in FIG. 1 , the method for reporting terminal sensor information includes:

Step 102, the first terminal reports sensor-related information;

In step 102, the sensor-related information includes at least one of the following: device information of the sensor and first measurement information of the sensor;

Step 104, the network performs positioning of the first terminal and/or data transmission of the first terminal according to the sensor-related information.

In the embodiment of the present application, the device information of the sensor and the first measurement information of the sensor in the current terminal, that is, the first terminal, are collected and reported, and the device information of the sensor and the first measurement information of the sensor are used to perform such as The realization of functions such as data transmission and positioning, on the one hand, effectively utilizes the performance of various sensors set on the terminal device, and solves the problem of waste of terminal sensor performance, on the other hand, makes the terminal positioning no longer depend on base station positioning or global The positioning system (Global Positioning System, GPS) signal improves the success rate and versatility of terminal positioning, and improves the positioning performance of the terminal.

In some embodiments of the present application, FIG. 2 shows one of the flowcharts of a method for reporting terminal sensor information according to an embodiment of the present application. As shown in FIG. 2 , the method for reporting terminal sensor information further includes at least two of the following :

Step 202, reporting one or more of device information and first measurement information;

Step 204, requesting second measurement information.

The device information includes one or more of the following:

Sensor type, data type information, sensor orientation, and spatial relationship between the sensor and the antenna of the first terminal.

In the embodiment of the present application, the terminal actively reports the device information of the sensor, and reports the first measurement information of the sensor, so that network devices, such as base stations, positioning servers, etc., can use the device information and the first measurement information to realize the detection of the terminal device. Positioning and other functions can be performed according to the location of the device, so as to effectively utilize the performance of the terminal sensor and avoid the waste of sensor performance.

Among them, the device type includes the type of sensor, such as image sensor, audio sensor, etc. The device type also includes the data type information of the sensory data collected by the sensor, such as image information, audio information, etc. The device type also includes the orientation of the sensor, such as the orientation of the image sensor camera, the orientation of the microphone pickup components, and so on. The device type also includes the spatial relationship between the sensor and the antenna assembly, that is, the positional relationship between the sensor and the terminal antenna, and the spatial relationship may be coordinate data, angle data, and the like.

In some embodiments of the present application, the sensor types include one or more of the following:

Image sensor, radar sensor, infrared detection sensor, structured light sensor;

In the case where the sensor type includes an image sensor, the data type information includes one or more of the frame rate information of the image sensor and the encoding type of the image sensor;

In the case where the sensor type includes a structured light sensor, the data type information includes one or more of a measurement result of the structured light sensor and a time-of-flight method measurement value, wherein the measurement result of the structured light sensor includes depth information.

In this embodiment of the present application, the radar sensor may be a short-wave radar sensor. The image sensor may be a sensor such as a camera. The infrared detection sensor may be a position sensor, a distance sensor, a temperature sensor, and the like.

When the sensor includes a structured light sensor, the measurement result of the structured light sensor may be a three-dimensional model composed of lattices. If the structured light sensor is a Time of Flight (TOF) sensor, the data type information also includes the time of flight method. Measurements. The information finally obtained by the structured light sensor is stereo information, that is, depth (y-axis) information is included.

In some embodiments of the present application, the data type information includes one or more of the following:

The positioning algorithm, the artificial intelligence network type corresponding to the first measurement information, the parameter information of the artificial intelligence network corresponding to the first measurement information, whether it is necessary to receive feedback information, and the corresponding working mode; and

When the sensor needs to receive feedback information, the data type information also includes one or more of the following:

The return method of feedback information, the format of feedback information, and the type of feedback information.

In this embodiment, the data type information includes a positioning algorithm utilized by the sensor, which may be an algorithm corresponding to the type of sensor.

The artificial intelligence network type corresponding to the first measurement information can process the detection data of the sensor through the artificial intelligence network, and finally realize functions such as positioning.

The parameter information of the artificial intelligence network corresponding to the first measurement information, that is, the configuration information of the artificial intelligence network when the first measurement information is processed by the artificial intelligence network.

Whether it is necessary to receive feedback information, that is, when positioning is achieved through the sensor of the terminal, after the first measurement information is reported to the location server, whether the location server needs to return the corresponding feedback information to realize functions such as positioning.

If the sensor needs to end the feedback information, the reported data type information also includes the return method of the feedback information required by the terminal, and the number and type of the feedback information.

The working mode corresponding to the sensor, that is, the current working state of the sensor, including but not limited to: positioning, data transmission, calibration, testing, self-checking, etc.

In some embodiments of the present application, the artificial intelligence network includes one or more of the following:

Convolutional Networks, Fully Connected Networks, Recurrent Neural Networks, Generative Adversarial Networks, Deep Belief Networks, Autoencoders.

In the embodiments of the present application, it can be understood that the artificial intelligence network may be a convolutional network, a neural network, etc., and the convolutional network may be various types of convolutional networks. The types of networks such as adversarial networks, belief networks and auto-encoders are not specifically limited.

In some embodiments of the present application, the spatial relationship includes one or more of the following:

The coordinate relationship between the sensor and the antenna assembly; the angular relationship between the sensor and the antenna assembly; the conversion parameters between the local coordinate system of the first terminal and the global coordinate system; the bearing angle, downtilt angle and inclination angle of the local coordinate system; relative spatial relationship;

Among them, the reported spatial relationship includes:

Report the predicted value of the spatial relationship, or the motion range corresponding to the spatial relationship.

In this embodiment of the present application, the spatial relationship between the sensor and the antenna may be the coordinate relationship and the angle relationship between the sensor and the antenna component, wherein the coordinate relationship may be the coordinate relationship in the geodetic coordinate system, or the local coordinate relationship of the first terminal. The coordinate relationship under the coordinate system, in the case of the local coordinate system, the spatial relationship also includes the conversion parameters between the local coordinate system and the global coordinate system, the bearing angle of the local coordinate system, the downtilt angle and the inclination angle, etc.

The relative spatial relationship between the sensor and the antenna assembly, for example, with the antenna assembly as a reference, the sensor is located at the azimuth, distance and angle of the antenna assembly.

The step of reporting the spatial relationship may specifically include the predicted value of the spatial relationship, such as predicting the spatial relationship at a certain time point according to the position change trend of the sensor, or the motion range of the spatial relationship, such as the motion range of the detection end of the sensor, etc.

In some embodiments of the present application, the spatial relationship is reported again according to preconfigured conditions;

The pre-configured conditions include at least one of the following: the spatial relationship changes, the network triggers a new report, and the working mode changes.

In this embodiment, the first terminal may dynamically report the device information, for example, the reporting of the spatial relationship may be a static report or a dynamic report, wherein the dynamic report is to determine whether to report or re-report according to whether the pre-configured conditions are satisfied. Report the control relationship. Whether to report or re-report the control relationship is determined according to whether pre-configured conditions are satisfied, wherein the conditions include one or more of a change in the spatial relationship, a new report triggered by the network, and a change in the working mode.

In some embodiments of the present application, the first measurement information further includes a working mode of the sensor, and the working mode includes one or more of the following: initial position marking mode, map making mode, map update mode, and real-time positioning mode.

In the embodiment of the present application, the working mode of the sensor includes the initial position marking mode, that is, the initial position of the current terminal is calibrated, and the initial position can be used as the starting point of distance measurement, for example, it is applied in scenarios such as measuring the number of steps, distance, and the length of the motion trajectory. .

The map making mode specifically includes the following scenarios. One is to record the real-time location information of the sensor at certain intervals, and connect these real-time location information in chronological order to form a "map". The second is to use the image sensor and the structured light sensor to create a "map" data file of the control in real time. The map can be a two-dimensional map or a three-dimensional map.

The map update mode is based on the map creation mode, that is, the mode of updating the created map file.

The real-time positioning mode specifically acquires the real-time position of the terminal, and the real-time position can be displayed in combination with the map, and is used for calibrating the position of the terminal on the map.

In some embodiments of the present application, FIG. 3 shows the third flowchart of a method for reporting terminal sensor information according to an embodiment of the present application. As shown in FIG. 3 , the method for reporting terminal sensor information further includes:

Step 302, in the case that the working mode is switched, obtain the first position information and the first orientation information before the working mode switching, and obtain the second position information and the second orientation information after the working mode switching;

Step 304 , when the second location information is different from the first location information, report the second location information, and when the second orientation information is different from the first orientation information, report the second orientation information.

In the embodiment of the present application, when the working mode of the sensor changes, it is necessary to determine whether the orientation information and position information of the sensor change accordingly. Specifically, the first position information and the first orientation information before the working mode change is obtained, and Obtain the second position information and the second orientation information after the working mode is changed. If the second position information and the second orientation information are different from the first position information and the first orientation information, it means that the orientation and position have changed, and report it at this time. Changed location information and orientation information.

In some embodiments of the present application, the first measurement information includes one or more of the following:

Measurement results, positioning information determined based on the measurement results, and data format of the measurement results;

The data format of the measurement result is a data format that cannot be recovered by the network.

In the embodiment of the present application, the measurement result is specifically the detection result of the sensor, such as distance value, brightness value, image data, etc., and the positioning information determined based on the measurement result is obtained through the corresponding positioning algorithm or positioning method according to the measurement result. The location information of the terminal, such as the location of the terminal in the map obtained from the image information and the established map information, etc. The data format of the measurement result is the data format of the detection value of the sensor, such as the picture format of the image information (such as .jpg and .png, etc.).

In some embodiments of the present application, the first terminal periodically reports the device information and/or the first measurement information according to the configured reporting type and/or the set period; or the first terminal receives a trigger signal or signaling, and according to the trigger The signal or signaling reports the device information and/or the first measurement information; or the first terminal detects the current event information, and reports the device information and/or the first measurement when the current event information matches the preset target event information information.

In this embodiment of the present application, the first terminal may periodically report one or both of the device information and the first measurement information according to a set period for real-time positioning.

The first terminal may also report one or both of the device information and the first measurement information according to the received trigger signal, where the trigger signal may come from the network or other terminals, which is not limited in this embodiment of the present application.

The first device may also select whether to report one or both of the device information and the first measurement information according to the current event. Specifically, if the current event matches the preset target event, the reporting action is performed. The preset target event can be edited according to user settings, network rules, and the like. For example, reporting when the terminal is in a charging state, reporting when the terminal time is in a preset time period, and the like.

The image information collected by the image sensor, the information of the signal sent by the radar sensor and the reflected signal, the intensity information of the reflected signal of the radar sensor at different angles or positions, the time delay information of the radar sensor, the information and structure of the signal sent by the structured light sensor and the reflected signal The depth information of the reflected signal of the light sensor at different angles or positions, the time delay information of the structured light sensor, the preset measurement data, the processing request information for at least one measurement data, the time stamp information, the position information, the positioning corresponding to the position information Mode information, sensor type information corresponding to location information, angle information of at least one sensor, downlink-based positioning data (Downlink-based Positioning), uplink positioning data (Uplink-based Positioning), ultra-wide band (Ultra Wide Band, UWB) positioning measurement data , Wi-Fi positioning measurement data.

In the embodiment of the present application, the first measurement information may be detection data of a specific sensor, data agreed by the network, local data of the first terminal, state parameters of the sensor, etc., which are not limited in the embodiment of the present application.

In some embodiments of the present application, the first measurement information is used to perform terminal-assisted positioning of the terminal, and the first measurement information includes

Image information, time stamp information, position information, positioning method information corresponding to the position information, and angle information of the image sensor.

In the embodiment of the present application, the positioning method includes terminal positioning (User Equipment based) or terminal assisted positioning (User Equipment assisted). When performing terminal assisted positioning (User Equipment assisted), the first measurement information includes image information and timestamp information. , position information, positioning method information corresponding to the position information, and angle information of the image sensor.

In some embodiments of the present application, performing the positioning of the first terminal includes performing terminal positioning, and the first measurement information includes:

Timestamp information, position information, angle information of the image sensor, and positioning method information corresponding to the position information.

In the embodiment of the present application, the positioning method includes terminal positioning (User Equipment based) or terminal assisted positioning (User Equipment assisted). When performing terminal positioning (User Equipment based), the first measurement information includes timestamp information, location information, The angle information of the image sensor and the positioning method information corresponding to the position information.

In some embodiments of the present application, when the sensor is used to perform positioning of the first terminal, the first measurement information includes: preset measurement data, processing request information for at least one measurement data, and time stamp information.

In this embodiment of the present application, when the sensor is used to locate the first terminal, the first measurement information further includes preset measurement data, processing request information for at least one type of measurement data, and time stamp information.

In some embodiments of the present application, the first measurement information includes:

Image information, time stamp information, location information, angle information of the image sensor, positioning method information corresponding to the location information, downlink positioning data, uplink positioning data, ultra-bandwidth positioning measurement data, and Wi-Fi positioning measurement data.

In this embodiment of the present application, in some cases, such as when the first terminal or the sensor of the first terminal is in the calibration mode, the following first measurement information may be collected, including image information collected by the image sensor, time stamp information, Position information, angle information of the image sensor, positioning method information corresponding to the position information, downlink positioning data, uplink positioning data, ultra-bandwidth positioning measurement data, and Wi-Fi positioning measurement data.

In some embodiments of the present application, the first measurement information is reported when the working mode is the calibration mode.

In the embodiment of the present application, when the working mode of the sensor of the first terminal is the calibration mode, the first measurement information collected is reported, which specifically includes: image information collected by the image sensor, time stamp information, location information, data of the image sensor Angle information, positioning method information corresponding to the location information, downlink positioning data, uplink positioning data, ultra-bandwidth positioning measurement data, and Wi-Fi positioning measurement data.

In some embodiments of the present application, requesting the second measurement information includes:

sending an image request to the network side device, and receiving image information obtained by the image sensor of the second terminal fed back by the network side device;

wherein the image information includes absolute time identification information; or

The image information includes relative time identification information relative to the time of transmission of the positioning reference system.

In this embodiment of the present application, the first terminal may also obtain image information obtained by an image sensor of the second terminal through an image request, so as to perform tasks such as positioning and map drawing in the current scene by combining image information of multiple different terminals. .

Wherein, the image information includes time information, which may be absolute time identification information, so as to avoid the time difference of local time between multiple terminals, and the time information may also be relative time identification information relative to the transmission time of the positioning reference system, that is, The normalization of local time between different terminals is achieved through a positioning reference system.

In some embodiments of the present application, FIG. 4 shows a fourth flowchart of a method for reporting terminal sensor information according to an embodiment of the present application. As shown in FIG. 4 , the method for reporting terminal sensor information further includes:

Step 402, receiving the second measurement information sent by the network side device or the positioning server;

Step 404: Determine the location information of the first terminal based on the first measurement information and the second measurement information.

In this embodiment of the present application, the terminal device receives the second measurement information sent by the network-side device or the positioning server, and determines the current location information of the first terminal by combining the first measurement information and the second measurement information. The second measurement information may be measurement information obtained by the positioning server or network device through its own hardware or algorithm, or may be measurement information obtained by other terminals different from the first terminal, which is not limited in this embodiment of the present application.

Further, the second measurement information may be of the same data type as the first measurement information, and its measurement angle may be the same or different from the first measurement information. The second measurement information may also be of a different data type from the first measurement information, that is, the second measurement information and the first measurement information are complementary. The second measurement information may also be measurement information corresponding to the first measurement information, and more accurate and more complete measurement data can be obtained by combining the first measurement information and the second measurement information.

In some embodiments of the present application, FIG. 5 shows the fifth flowchart of a method for reporting terminal sensor information according to an embodiment of the present application. As shown in FIG. 5 , the method for reporting terminal sensor information further includes:

Step 502, receiving the information processing mode sent by the network side device or the positioning server;

Step 505: Process the first measurement information and the second measurement information by means of information processing.

In this embodiment of the present application, the first terminal receives an information processing method from a network-side device or from a positioning server, and the information processing method may be a preset algorithm, a preset processing program, etc., through the information processing method , can perform effective information processing on the first measurement information and the second measurement information, so as to integrate the original data into effective information that can be used for positioning or data transmission, or obtain the current position information of the first terminal according to the original data, or Do map drawing, map update, etc.

In some embodiments of the present application, FIG. 6 shows the sixth flowchart of a method for reporting terminal sensor information according to an embodiment of the present application. As shown in FIG. 6 , requesting second measurement information includes:

Step 602, sending a data request to the network side device;

Step 604: Receive second measurement information corresponding to the data request fed back by the network side device.

In this embodiment of the present application, the first terminal may send a data request to the network-side device, and after receiving the data request, the network-side device feeds back the corresponding second measurement information to the terminal device according to the data request of the first terminal. The second measurement information may be measurement information obtained by the positioning server or network device through its own hardware or algorithm, or may be measurement information obtained by other terminals different from the first terminal, which is not limited in this embodiment of the present application.

In some embodiments of the present application, FIG. 7 shows the seventh flowchart of a method for reporting terminal sensor information according to an embodiment of the present application. As shown in FIG. 7 , requesting the second measurement information includes:

Step 702, sending positioning mode information to the network side device;

Step 704: Receive second measurement information corresponding to the positioning mode information fed back by the network side device.

In this embodiment of the present application, the first terminal sends positioning mode information to the network-side device, where the positioning mode information indicates the working mode of the positioning process to be initiated by the first terminal, such as the type of sensor used, the sensor used After receiving the positioning mode information, the network device determines, according to the positioning mode information, the second measurement information that may be used by the first terminal when positioning, and feeds back the obtained second measurement information to the first terminal. The second measurement information, so that the first terminal can realize positioning according to its own first measurement information and the received second measurement information.

In some embodiments of the present application, the positioning process is initiated by the first terminal; or

Initiate the positioning process through the network-side device; or

The positioning process is initiated through the third terminal.

In this embodiment of the present application, the positioning process is a process in which the first terminal acquires and/or reports its own location information, and the positioning process may be initiated by the first terminal itself, and the first terminal itself actively acquires the first measurement information, and The second measurement information is requested to realize positioning.

The positioning process can also be initiated by a network-side device, such as a positioning server, etc., the network-side device sends corresponding signaling to the first terminal, and the first terminal starts to collect its own first measurement information and report it according to the received signaling. The second measurement information on the network side is received to realize positioning.

The positioning process can also be initiated by any third terminal that is different from the first terminal. The third terminal can directly establish a point-to-point connection with the first terminal and initiate the positioning process. The third terminal can also use network-side equipment, such as positioning The server forwards the positioning process to realize positioning.

In some embodiments of the present application, the method for reporting terminal sensor information further includes: the first terminal reporting time information corresponding to the first measurement information.

In this embodiment of the present application, when reporting the first measurement information, the first terminal simultaneously reports the time information corresponding to the first measurement information. Through the time dimension, different measurement information reported by different terminals can be matched with each other, and accurate and accurate implementation can be achieved based on the time axis. position.

In some embodiments of the present application, the time information is relative time information of the first terminal relative to any fourth terminal.

In this embodiment of the present application, the time information corresponding to the first measurement information is specifically the relative time information of the first terminal relative to any fourth terminal, where the fourth terminal is the reference terminal, and the time information of the fourth terminal may be It is local time information or absolute time information. When the time of the fourth terminal remains unchanged, the time information of any terminal relative to the same fourth terminal can ensure that the time information of all terminals is in the same time axis, avoiding different The local time difference between the terminals causes the time mismatch of the measurement information, which can effectively improve the positioning accuracy.

In some embodiments of the present application, the time information is absolute time information.

In this embodiment of the present application, the time information corresponding to the first measurement information is specifically absolute time information, wherein the first terminal can obtain the absolute time by means of satellite time calibration, accessing a time server, etc., and keep the local time at the absolute time. Synchronized. The measurement information uploaded by all terminals matches the absolute time information, which can ensure that the time information of all terminals is in the same time axis, avoid the local time difference between different terminals causing the time mismatch of the measurement information, and can effectively improve the positioning accuracy.

In some embodiments of the present application, the first measurement information further includes measurement information of a sensor of at least one fifth terminal.

In this embodiment of the present application, the first measurement information reported by the first terminal to the network-side device may include, in addition to the measurement information collected from its own sensor, measurement information of any sensor of the fifth terminal, that is, through a terminal Simultaneously report the measurement information of the sensors of multiple different terminals. Wherein, a point-to-point direct data connection may be established between the first terminal and the fifth terminal, or an indirect data connection may be established through a backbone network, a base station, a server, etc., so as to obtain the measurement information of the sensor of the fifth terminal. This embodiment of the present application This is not limited.

In some embodiments of the present application, collecting the device information of the sensor of the first terminal and the first measurement information of the sensor includes:

Through a preset neural network, local information is extracted from local data of the first terminal, and device information and/or first measurement information are generated according to the local information.

In this embodiment of the present application, local information can be extracted from the local data of the first terminal through a preset neural network, and corresponding device information and first measurement information can be generated, and this process will not occupy the local computing of the first terminal. On the one hand, it can avoid terminal performance loss caused by over-occupancy of the performance of the first terminal, and on the other hand, it can avoid excessive use of battery power of the first terminal to ensure the endurance of the first terminal.

In some embodiments of the present application, the terminal collects the device information of its own sensor and the measurement information of the sensor, and reports it, and in the process of realizing the positioning of the terminal, its data collection, interaction, transmission, data structure, etc. standard specification.

Specifically, the terminal reports device information to the network/location server, and the device information may specifically include the following content:

The terminal reports supported sensor types, supported sensor data types, and/or sensor-related device information, and may also include other information used for positioning, such as calculation type information.

The sensor may be a device for collecting image information, a device for radar detection, a device for infrared detection, or a device for collecting measurement results related to structured light.

The terminal may further report capability information for each device, such as capability information such as the frame rate (Frames Per Second, FPS) of the image device.

Specifically, the sensor data type refers to the data type that can be reported by a certain type of sensor. For example, a device used for structured light acquisition can directly report structured light measurement results with depth information, or Report TOF measurements at different angles.

The data type also includes how the reported measurement data is encoded, such as how the image information measured by the image device is encoded.

Among them, other information used for positioning includes:

Corresponding to the supported positioning algorithms, such as mixed positioning of sensor information and other information, or Time Difference of Arrival (TDOA) positioning, or based on machine learning positioning;

The supported positioning algorithms can be reported separately for the supported sensor types;

Artificial Intelligence (AI) network characteristics corresponding to the reported data, such as which type of AI network processing you want the network to use for the reported data;

Including the parameter information of the corresponding AI network;

Whether the network is required to return corresponding data, and/or the method, type, format, etc. of the returned data;

Supported working modes, such as whether the device supports initial location marking/map making updates, whether it supports real-time location updates, whether it can switch between multiple modes, etc.;

The orientation of a certain type of sensor, and/or the spatial relationship to the antenna.

The spatial relationship includes: a coordinate relationship, an angular relationship such as sensor orientation.

Specifically, if the equiangular relationship of the sensor (sensor) orientation is relative to the local coordinate system of the terminal, it is also necessary to report the conversion parameters of the local coordinate system (LCS) and the global coordinate system (GCS), including at least the local coordinate system of the terminal. The angles α (bearing angle), β (down-tilt angle) and γ (tilt angle) of the coordinate system.

The reporting includes but is not limited to the reporting of the relative spatial relationship, and the reporting of the spatial relationship can report multiple possible values, or a certain range of motion.

Taking the camera as an example, the reporting of the spatial relationship of the camera can be static reporting or dynamic reporting. For example, when the camera/radar probe angle is continuously adjusted, the camera/probe angle information can be reported in real time, or the device information can be reported simultaneously with the measurement information, such as Along with a certain measurement result, the spatial relationship corresponding to this measurement is reported at the same time.

The working modes of the sensor include:

1. Initial position mark;

2. Map making;

3. Map update;

4. Real-time location determination.

Considering that the surrounding position may be changing, the working mode of the sensor may need to be switched between the two modes. Once switched, in order to save the calibration overhead, it may only need to report the specific result of the specific position and orientation.

The terminal reports the measurement information to the network, and the measurement information is the real-time measurement result obtained by the sensor, such as the image data of the camera, the radar measurement data (such as the distance, angle, TOF information obtained by the millimeter wave radar, etc.), structured light measurement equipment The collected data includes TOF information of various reflections and depth information corresponding to each angle.

The measurement information may also be some kind of abstract information based on the above-mentioned data, such as reporting newly appearing occlusion information detected according to the image information.

For example, the network may preconfigure a specific direction, position, and depth, and require the terminal to report corresponding occlusion information for the specific direction, position, and depth.

For example, the network can pre-configure a specific image, and require the terminal to report the content of the non-conforming image when the detected image and the target image and/or a certain type of specific transformation (eg, translation, angle change) of the target image do not conform to the pre-configured specific image. .

The format of the sensor data can be agreed in advance between the network and the terminal, for example, it can be a data format that cannot be recovered by the network to protect privacy.

Alternatively, the network may only know how to process the data reported by the corresponding terminal and return the data to the terminal, but has no way to obtain the user's location.

Privacy can also be protected by other data desensitization methods.

The terminal reporting sensor measurement data can be triggered by the network, or reported periodically, or based on a preset event.

Among them, the preset events include:

1. The event of entering a specific area (such as a cell);

2. Events where a certain type of measurement signal reaches a certain threshold;

3. An event where the terminal moves more than some predefined (straight-line) distance from its previous position.

In some implementations, the network may preconfigure a specific image and require the terminal to report when the detected image does not conform to the target image and/or a certain type of specific transformation (eg, translation, angle change) of the target image.

The format reported by the terminal to the network may include some or all of the following information:

According to the different positioning methods used (such as terminal-assisted positioning (User Equipment assisted) or terminal positioning (User Equipment based)) or different working modes, the reported content is different:

For example, when using the image information collected by the image equipment to perform the terminal-assisted positioning (User Equipment assisted) positioning, the reported content includes the following parts:

For example, when using the image information collected by the image device to implement the UE based solution, the reported content includes the following parts:

For example, when an AI-based positioning solution is adopted, the reported content includes the following parts:

For example, in calibration mode, the reported content includes the following parts:

The terminal can request specific measurement data from the network:

For example, the device 2 requests the network to obtain the image data of the device 1; the network sends the image data to the device 1; when the network sends data to the terminal, the information is identified by absolute time or relative time.

Wherein, the relative time may be relative to the time of sending the Pricing Reference Server (PRS); when the terminal requests the network, it identifies the time at which data is desired to be obtained.

The network/location server configures the terminal with corresponding auxiliary data, including the following:

The network/location server sends specific data to the terminal, and the terminal determines the location of the terminal based on the local data and the data sent by the network;

The network/location server sends a specific processing method to the terminal for the terminal to process the corresponding information in combination with the local data and the data sent by the network;

The provision of the auxiliary data depends on the request made by the terminal, or the network provides it to the terminal according to the positioning method selected by the terminal;

The provision of corresponding data may be based on a differential manner: for example, at a first time point, the network provides corresponding data, and at a second time point, the data provided by the network to the terminal is provided in a differential manner with the first time point, Thereby reducing the data configuration overhead.

The location service can be initiated by the terminal, or initiated by the network/location service, or initiated by a third party;

Collaboration between various measurement information:

The terminal reports the time relationship between different measurement results to the network;

The time relationship between different devices can be initially reported. This kind of time relationship includes but is not limited to the possible time difference introduced by the software system and the hardware system. Such data may need to be obtained through factory calibration or real-time calibration;

The terminal directly identifies the absolute time in each type of report;

Various measurement information includes information originating from one device as well as information originating from multiple devices.

For example, the image data may originate from the above-mentioned device 1, the wireless measurement signal originates from the device 2, and the network can indicate whether the time relationship between the corresponding data is implicitly indicated in the same report based on various measurement information, and whether they can be used at the same time. , what is the error range of the time relationship, etc.

About privacy settings:

The key reporting information can be extracted from the local data through the pre-agreed/configured neural network, but the network side cannot restore the original image data based on the key reporting information;

The network side configures the corresponding neural network on the terminal side, or the terminal side notifies the network side of the neural network used.

In some embodiments of the present application, FIG. 8 shows a schematic structural diagram of a terminal according to an embodiment of the present application. Optionally, an embodiment of the present application further provides a terminal 1900, including a processor 1910 and a memory 1909, which are stored in A program or instruction on the memory 1909 that can be run on the processor 1910. When the program or instruction is executed by the processor 1910, each process of the above-mentioned method for reporting terminal sensor information is implemented, and can achieve the same technical effect, In order to avoid repetition, details are not repeated here.

It should be noted that the terminals in the embodiments of the present application include the aforementioned mobile terminals and non-mobile terminals.

The terminal 1900 includes but is not limited to: a radio frequency unit 1901, a network module 1902, an audio output unit 1903, an input unit 1904, a sensor 1905, a display unit 1906, a user input unit 1907, an interface unit 1908, a memory 1909, a processor 1910 and other components .

Among them, the processor 1910 invokes the program or instruction in the memory 1909 to obtain the relevant information of the sensor 1905, and executes the positioning and/or data transmission of the terminal 1900 according to the relevant information. On the one hand, the various sensors provided on the terminal device are effectively used It solves the problem of waste of terminal sensor performance. On the other hand, terminal positioning no longer depends on base station positioning or Global Positioning System (GPS) signals, which improves the success rate and versatility of terminal positioning. And improve the positioning performance of the terminal.

Those skilled in the art can understand that the terminal 1900 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 1910 through a power management system, so as to manage charging, discharging, and power consumption through the power management system management and other functions. The terminal structure shown in FIG. 8 does not constitute a limitation on the terminal, and the terminal may include more or less components than shown, or combine some components, or arrange different components, which will not be repeated here.

It should be understood that, in this embodiment of the present application, the radio frequency unit 1901 may be used to send and receive information or send and receive signals during a call, and specifically, receive downlink data from the base station or send uplink data to the base station. The radio frequency unit 1901 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.

The network module 1902 provides the user with wireless broadband Internet access, such as helping the user to send and receive emails, browse the web, access streaming media, and the like.

The audio output unit 1903 may convert audio data received by the radio frequency unit 1901 or the network module 1902 or stored in the memory 1909 into audio signals and output as sound. Also, the audio output unit 1903 may also provide audio output related to a specific function performed by the terminal 1900 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 1903 includes a speaker, a buzzer, a receiver, and the like.

The input unit 1904 is used to receive audio or video signals. The input unit 1904 may include a graphics processor (Graphics Processing Unit, GPU) 5082 and a microphone 5084, and the graphics processor 5082 is used for still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode data is processed. The processed image frames may be displayed on the display unit 1906, or stored in the memory 1909 (or other storage medium), or transmitted via the radio frequency unit 1901 or the network module 1902. The microphone 5084 can receive sound, and can process the sound into audio data, and the processed audio data can be output in a format that can be transmitted to a mobile communication base station via the radio frequency unit 1901 in the case of a phone call mode.

Terminal 1900 also includes one or more sensors 1905, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, light sensors, motion sensors, and other sensors.

The display unit 1906 is used to display information input by the user or information provided to the user. The display unit 1906 may include a display panel 5122, which may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.

The user input unit 1907 may be used to receive input numerical or character information, and generate key signal input related to user settings and function control of the terminal. Specifically, the user input unit 1907 includes a touch panel 5142 and other input devices 5144 . The touch panel 5142, also referred to as a touch screen, collects the user's touch operations on or near it. The touch panel 5142 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 1910, the command sent by the processor 1910 is received and executed. Other input devices 5144 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which are not described herein again.

Further, the touch panel 5142 can be overlaid on the display panel 5122. When the touch panel 5142 detects a touch operation on or near it, it transmits it to the processor 1910 to determine the type of the touch event, and then the processor 1910 determines the type of the touch event according to the touch The type of event provides corresponding visual output on display panel 5122. The touch panel 5142 and the display panel 5122 can be used as two independent components, or can be integrated into one component.

The interface unit 1908 is an interface for connecting an external device to the terminal 1900 . For example, external devices may include wired or wireless headset ports, external power (or battery charger) ports, wired or wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input/output (I/0) port, video I/0 port, headphone port, etc. Interface unit 1908 may be used to receive input from external devices (eg, data type information, power, etc.) and transmit the received input to one or more elements within terminal 1900 or may be used between terminal 1900 and external devices transfer data between.

The memory 1909 may be used to store software programs as well as various data. The memory 1909 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required for at least one function, etc.; Data (such as audio data, phone book, etc.) created by the use of the mobile terminal, etc. Additionally, memory 1909 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 1910 executes various functions of the terminal 1900 and processes data by running or executing software programs and/or modules stored in the memory 1909 and calling data stored in the memory 1909, thereby monitoring the terminal 1900 as a whole. The processor 1910 may include one or more processing units; optionally, the processor 1910 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem The modulation processor mainly handles wireless communication.

The terminal 1900 may further include a power supply 1911 for supplying power to various components. Optionally, the power supply 1911 may be logically connected to the processor 1910 through a power management system, so as to implement functions such as managing charging, discharging, and power consumption through the power management system.

Embodiments of the present application further provide a readable storage medium, the readable storage medium may be non-volatile or volatile, and a program or instruction is stored on the readable storage medium, and the program or instruction is processed by a processor During execution, each process of the foregoing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.

The processor is the processor in the terminal in the foregoing embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

The embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used for running a program or an instruction, implementing the various processes of the above method embodiments, and can achieve the same technical effect , in order to avoid repetition, it will not be repeated here.

It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system-on-chip, a system-on-a-chip, or a system-on-a-chip, or the like.

An embodiment of the present application further provides a computer program product, wherein the computer program product is stored in a non-transitory readable storage medium, and the computer program product is executed by at least one processor to implement the above method embodiments and can achieve the same technical effect, in order to avoid repetition, it will not be repeated here.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in the reverse order depending on the functions involved. To perform functions, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to some examples may be combined in other examples.

From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in a part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network side device, etc.) execute the methods of the various embodiments of the present application.

The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of this application, without departing from the scope of protection of the purpose of this application and the claims, many forms can be made, all of which fall within the protection of this application.

Claims

A method for reporting terminal sensor information, comprising:

The first terminal reports sensor-related information, where the sensor-related information includes at least one of the following: device information of the sensor and first measurement information of the sensor.
The method according to claim 1, wherein the sensor-related information is used for positioning of the first terminal and/or data transmission of the first terminal.
The method of claim 1, wherein the method further comprises at least one of the following:

reporting the device information and/or the first measurement information;

requesting second measurement information;

Wherein, the device information includes one or more of the following:

Sensor type, data type information, sensor orientation, and spatial relationship between the sensor and the antenna of the first terminal.
4. The method of claim 3, wherein the sensor types include one or more of the following:

Image sensor, radar sensor, infrared detection sensor, structured light sensor;

In the case where the sensor type includes the image sensor, the data type information includes one or more of frame rate information of the image sensor and an encoding type of the image sensor;

In the case where the sensor type includes the structured light sensor, the data type information includes one or more of a measurement result of the structured light sensor and a time-of-flight measurement value, wherein the structured light sensor's The measurement results include depth information.
The method of claim 3, wherein the data type information includes one or more of the following:

The positioning algorithm, the artificial intelligence network type corresponding to the first measurement information, the parameter information of the artificial intelligence network corresponding to the first measurement information, and the working mode corresponding to whether the feedback information needs to be received; and

When the sensor needs to receive the feedback information, the data type information further includes one or more of the following:

The return method of the feedback information, the format of the feedback information, and the type of the feedback information.
The method of claim 5, wherein the artificial intelligence network comprises one or more of the following:

Convolutional Networks, Fully Connected Networks, Recurrent Neural Networks, Generative Adversarial Networks, Deep Belief Networks, Autoencoders.
The method of claim 3, wherein the spatial relationship comprises one or more of the following:

The coordinate relationship between the sensor and the antenna assembly; the angular relationship between the sensor and the antenna assembly; the conversion parameter between the local coordinate system of the first terminal and the global coordinate system; the bearing angle of the local coordinate system , down-tilt angle and tilt angle; the relative spatial relationship between the sensor and the antenna assembly;

The reporting of the spatial relationship includes:

Report the predicted value of the spatial relationship, or the motion range corresponding to the spatial relationship.
The method of claim 7, wherein the method further comprises:

The spatial relationship is reported again according to a preconfigured condition, wherein the preconfigured condition includes at least one of the following: the spatial relationship changes, the network triggers a new report, and the working mode changes.
The method according to claim 3, wherein the first measurement information further comprises an operating mode of the sensor, the operating mode comprising one or more of the following:

Initial position marking mode, map making mode, map update mode, real-time positioning mode.
The method of claim 9, wherein the method further comprises:

In the case of switching of the working mode, acquiring first position information and first orientation information before the switching of the working mode, and acquiring second position information and second orientation information after the switching of the working mode;

reporting the second location information when the second location information is different from the first location information, and reporting the second orientation information when the second orientation information is different from the first orientation information The second orientation information.
The method of claim 1, wherein the first measurement information comprises one or more of the following:

a measurement result, the positioning information determined based on the measurement result, and the data format of the measurement result;

Wherein, the data format of the measurement result is a data format that cannot be recovered by the network.
The method according to claim 11, wherein the first terminal periodically reports the device information and/or the first measurement information according to a configured reporting type and/or a set period; or

The first terminal receives a trigger signal or signaling, and reports the device information and/or the first measurement information according to the trigger signal or signaling; or

The first terminal detects current event information, and reports the device information and/or the first measurement information when the current event information matches preset target event information.
The method according to claim 4, wherein the first measurement information comprises one or more of the following:

The image information collected by the image sensor, the information of the signal sent and reflected by the radar sensor, the intensity information of the reflected signal of the radar sensor at different angles or positions, the time delay information of the radar sensor, the structured light The information of the signal sent by the sensor and the reflected signal, the depth information of the reflected signal of the structured light sensor at different angles or positions, the time delay information of the structured light sensor, the preset measurement data, and the processing request for at least one measurement data information, timestamp information, location information, location information corresponding to the location information, sensor type information corresponding to the location information, angle information of at least one of the sensors, downlink positioning data, uplink positioning data, and ultra-bandwidth positioning measurements data, Wi-Fi positioning measurement data.
The method according to claim 13, wherein the first measurement information is used to perform terminal-assisted positioning of the terminal, and the first measurement information includes one or more of the following:

The image information, the time stamp information, the location information, the positioning method information corresponding to the location information, and the angle information of the image sensor.
The method according to claim 4, wherein the first measurement information is used to perform terminal-based positioning of the terminal, and the first measurement information includes one or more of the following:

Timestamp information, location information of the first terminal, angle information of the image sensor, and positioning method information corresponding to the location information.
The method according to claim 13, wherein, when the sensor-related information is used for the positioning of the first terminal, the first measurement information includes one or more of the following:

The preset measurement data, processing request information for the at least one measurement data, and the timestamp information.
The method according to claim 4, wherein the first measurement information comprises:

the image information, the time stamp information, the position information of the first terminal, the angle information of the image sensor, the positioning mode information corresponding to the position information of the first terminal, downlink positioning data, uplink positioning data, Ultra-bandwidth positioning measurement data and Wi-Fi positioning measurement data.
The method according to claim 17, wherein the first measurement information is reported when the operating mode of the sensor is a calibration mode.
The method according to claim 3, wherein the requesting the second measurement information comprises:

sending an image request to the network side device, and receiving image information obtained by the image sensor of the second terminal fed back by the network side device;

wherein, the image information includes absolute time identification information; or

The image information includes relative time identification information relative to the transmission time of the positioning reference system.
The method of claim 3, further comprising:

The second measurement information sent by the network-side device or the positioning server is received, and the location information of the first terminal is determined based on the first measurement information and the second measurement information.
The method of claim 20, further comprising:

The information processing method sent by the network side device or the positioning server is received, and the first measurement information and the second measurement information are processed by the information processing method.
The method according to claim 3, wherein the requesting the second measurement information comprises:

Send a data request to the network side device;

The second measurement information corresponding to the data request fed back by the network side device is received.
The method according to claim 3, wherein the requesting the second measurement information comprises:

Send the positioning method information to the network side device;

The second measurement information corresponding to the positioning mode information fed back by the network side device is received.
The method according to claim 2, wherein a positioning procedure is initiated by the first terminal; or

Initiate the positioning process through the network-side device; or

The positioning process is initiated through the third terminal.
The method of claim 1, further comprising:

The time information corresponding to the first measurement information is reported.
The method according to claim 25, wherein the time information is relative time information of the first terminal with respect to any fourth terminal.
26. The method of claim 25, wherein the time information is absolute time information.
The method according to claim 1, wherein the first measurement information further comprises measurement information of a sensor of at least one fifth terminal.
The method according to claim 1, wherein before the first terminal reports sensor-related information, the method comprises:

By using a preset neural network, local information is extracted from the local data of the first terminal, and the device information and/or the first measurement information is generated according to the local information.
A terminal, comprising a memory and a processor, wherein a program or an instruction is stored on the memory, wherein the processor implements the method according to any one of claims 1 to 29 when the processor executes the program or the instruction.
A readable storage medium on which programs or instructions are stored, wherein when the programs or instructions are executed by a processor, the steps of the method for reporting terminal sensor information according to any one of claims 1 to 29 are implemented.
A chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or an instruction to implement the reporting terminal according to any one of claims 1 to 29 The steps of the method for sensor information.
A computer program product, wherein the computer program product is stored in a non-transitory readable storage medium, the computer program product being executed by at least one processor to implement the invention as claimed in any one of claims 1 to 29 The steps of the method for reporting terminal sensor information.
A communication device configured to perform the steps of the method for reporting terminal sensor information as claimed in any one of claims 1 to 29.