WO2024131584A1 - Trajectory playback method and apparatus - Google Patents

Abstract

The present application relates to the technical field of smart life, and discloses a trajectory playback method and apparatus, used for reducing the out-of-range problem of a trajectory. The method comprises: determining trajectory playback information of a motion trajectory of a user according to motion data of the user, wherein the motion data comprises motion trajectory longitudes, motion trajectory latitudes, and an altitude, the trajectory playback information comprises a trajectory point sequence, lens data, and map control coefficients, and the map control coefficients are used for representing a display proportion of a map; and playing back the motion trajectory in the map according to the trajectory playback information. In embodiments of the present application, the lens data and the map control coefficients corresponding to the motion trajectory are determined according to the motion data, so that when the motion trajectory is played back, the display proportion of the map can adapt to the motion trajectory, so as to achieve the purpose of reducing the out-of-range problem of the trajectory, thereby improving the dynamic trajectory experience of the user.

Description

A track playback method and device

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to a Chinese patent application filed with the Chinese Patent Office on December 21, 2022, with application number 202211651358.1 and application name “A track playback method and device”, the entire contents of which are incorporated by reference in this application.

Technical Field

The embodiments of the present application relate to the field of smart life technology, and in particular to a trajectory playback method and device.

Background technique

As people's material life becomes more and more abundant, exercise is an indispensable part of their daily life. When exercising, people usually carry portable smart terminal devices to record their exercise tracks; after exercise, people can also dynamically play their exercise tracks through sports-related applications to understand their exercise process.

At present, the trajectory playback method usually rotates the screen according to the center point and starting point of the motion trajectory to dynamically display the user's motion trajectory. However, when this method plays the trajectory under the 3D trajectory, the trajectory will overflow the visible area during the drawing process, making it impossible to fully observe the user's trajectory, and thus unable to provide users with a good user experience.

Summary of the invention

The embodiments of the present application provide a trajectory playback method and device, which are used to provide a technical solution for dynamically playing a trajectory on a three-dimensional map, which can reduce or avoid the problem of trajectory line overflow and improve the user's dynamic trajectory experience.

In the first aspect, the embodiment of the present application provides a trajectory playback method, which is described below with a terminal device that plays a motion trajectory as the execution subject, and the method includes: the terminal device determines the trajectory playback information of the user's motion trajectory according to the user's motion data; wherein the motion data includes the longitude, latitude and altitude of the motion trajectory; the trajectory playback information includes a trajectory point sequence, lens data and a map control coefficient; the lens data is used to determine the playback angle of the motion trajectory, and the map control coefficient is used to characterize the display ratio of the map. Then, the terminal device plays the motion trajectory in the map according to the trajectory playback information.

In this method, the terminal device determines the trajectory sequence, lens data and map control coefficient of the motion trajectory according to the user's motion data, so that when the motion trajectory is played, it can provide a suitable playback perspective and map display ratio for the motion trajectory, thereby reducing or avoiding the problem of trajectory line overflow, improving the integrity of the motion trajectory playback, and further improving the user's dynamic trajectory experience.

In a possible design, the terminal device determines the trajectory attributes of the motion trajectory according to the motion data, wherein the trajectory attributes include the position of the trajectory point, the altitude of the trajectory point, and the trajectory length. The terminal device determines the trajectory playback information according to the trajectory attributes.

In this design, the terminal device determines the trajectory playback information according to the trajectory point position, the altitude of the trajectory point and the trajectory length of the motion trajectory, so that the trajectory playback information can be more consistent with the user's motion trajectory, thereby reducing or avoiding the problem of trajectory line overflow.

In a possible design, when the motion data includes the motion type, the trajectory attribute also includes the motion type.

In a possible design, the terminal device obtains the trajectory point sequence based on the trajectory point position in the trajectory attribute. In addition, the terminal device determines a map control coefficient according to at least one trajectory attribute; wherein the map control coefficient includes a zoom ratio and an elevation coefficient, and the elevation coefficient is used to characterize the relative change of elevation in the map.

In this design, the terminal device obtains a trajectory point sequence according to the trajectory point position, and determines a scaling ratio and an elevation coefficient according to at least one trajectory attribute, thereby providing a data basis for the subsequent playback of the motion trajectory.

In a possible design, the terminal device determines the scaling ratio according to the track length, and determines the elevation coefficient according to the altitude and movement type of the track point, wherein the elevation coefficient is positively correlated with the altitude difference of the track point.

In this design, the terminal device can accurately determine the scaling ratio suitable for the motion trajectory based on the trajectory length; and the terminal device can determine the elevation coefficient suitable for the motion trajectory based on the altitude and motion type of the trajectory point, thereby reducing or avoiding the problem of trajectory line overflow when the motion trajectory is played.

In one possible design, the terminal device determines lens data based on the type of movement; the lens data includes the lens angle.

In this design, the terminal device can determine a lens angle that is more suitable for the motion trajectory according to the type of motion.

In a possible design, the terminal device determines lens data according to the position of the trajectory point and the altitude of the trajectory point; the lens data includes a camera path; and the camera path includes a lens angle and a camera position.

In this design, the terminal device determines the camera path according to the position and altitude of the trajectory point, so that when the trajectory is played, the viewing perspective of the motion trajectory can be transformed into a movie perspective, reducing the occlusion of the motion trajectory and thus improving the user experience.

In a possible design, the terminal device obtains the initial track according to the position of the track point; the terminal device extracts multiple track points from the initial track as the camera visual focus according to the set track point distance interval. Then, the terminal device determines the track area corresponding to the initial track in the map, and uses the highest point in the track area as the occlusion point. The terminal device determines the camera path according to the camera visual focus and the occlusion point.

In this design, the terminal device determines the camera path based on the camera's visual focus and occlusion points, thereby reducing occlusion of the motion trajectory, increasing the visualization of the motion trajectory, and thus improving the user experience.

In a possible design, the terminal device determines the viewing angle area of the observation point according to the camera visual focus; wherein the observation point is the position point of the camera when the camera visual focus coincides with the camera visual focus. When the viewing angle area does not contain the occlusion point, the terminal device uses the position of the observation point and the lens angle of the observation point as the camera path.

In this design, the camera path determined by the terminal device can reduce or avoid occlusion of the motion trajectory when the motion trajectory is played, thereby increasing the visualization of the motion trajectory.

In one possible design, the terminal device adjusts the map according to the map control coefficient and sets the lens based on the lens data; then, the terminal device plays the motion trajectory drawn according to the trajectory point sequence in the adjusted map based on the lens.

In this design, the terminal device plays the motion trajectory in the adjusted lens and the adjusted map, thereby ensuring the integrity of the motion trajectory playback and improving the user experience.

In a possible design, during the motion track playback process, the terminal device determines the length of the drawn track and the altitude of the drawn track points; determines the zoom ratio of the map according to the length of the drawn track; and determines the elevation coefficient of the map according to the altitude of the drawn track points. Then, the terminal device adjusts the map according to the zoom ratio of the map and the elevation coefficient of the map.

In this design, during the motion trajectory playback process, the terminal device determines the elevation coefficient and zoom ratio of the map according to the trajectory length of the drawn trajectory and the altitude of the drawn trajectory points to adjust the map so that the display ratio of the map changes as the motion trajectory is drawn, thereby ensuring the integrity of the motion trajectory.

In a second aspect, an embodiment of the present application further provides a track playback device, the device comprising:

A determination unit, configured to determine the track playback information of the user's track according to the user's motion data; wherein the motion data includes the longitude, latitude and altitude of the track; the track playback information includes a track point sequence, lens data and a map control coefficient; the lens data is used to determine the playback viewing angle of the track, and the map control coefficient is used to characterize the display ratio of the map;

A playback unit is used to play the motion trajectory in the map according to the trajectory playback information.

In a possible design, the determining unit is specifically configured to:

Determining the trajectory attributes of the motion trajectory according to the motion data; wherein the trajectory attributes include the position of the trajectory point, the altitude of the trajectory point, and the trajectory length;

The track playing information is determined according to the track attribute.

In a possible design, when the motion data includes a motion type, the trajectory attribute also includes the motion type.

In a possible design, the determining unit is specifically configured to:

Based on the trajectory point positions in the trajectory attributes, obtaining the trajectory point sequence;

The map control coefficient is determined according to at least one of the trajectory attributes; the map control coefficient includes a zoom ratio and an elevation coefficient; the elevation coefficient is used to characterize the relative change of the elevation in the map.

In a possible design, the determining unit is specifically configured to:

Determining the scaling ratio according to the trajectory length;

The elevation coefficient is determined according to the altitude of the trajectory point and the movement type; the elevation coefficient is positively correlated with the altitude difference of the trajectory point.

In a possible design, the determining unit is specifically configured to:

The lens data is determined according to the motion type; the lens data includes a lens angle.

In a possible design, the determining unit is specifically configured to:

The lens data is determined according to the position of the track point and the altitude of the track point; the lens data includes a camera path; and the camera path includes a lens angle and a camera position.

In a possible design, the determining unit is specifically configured to:

According to the positions of the trajectory points, an initial trajectory is obtained;

Extracting a plurality of trajectory points from the initial trajectory as camera visual focus according to a set trajectory point distance interval;

In the map, determining a track area corresponding to the initial track, and taking the highest point in the track area as an occlusion point;

The camera path is determined according to the camera visual focus and the occlusion point.

In a possible design, the determining unit is specifically configured to:

Determine the viewing angle area of the observation point according to the visual focus of the camera; the observation point is the position point of the camera when the visual focus of the camera coincides with the visual focus of the camera;

When the viewing angle area does not include the occlusion point, the position of the observation point and the lens angle of the observation point are used as the camera path.

In a possible design, the playback unit is specifically used for:

adjusting the map according to the map control coefficient;

Setting the lens based on the lens data;

Based on the lens, a motion trajectory drawn according to the sequence of trajectory points is played in the adjusted map.

In a possible design, during the motion trajectory playback process, the playback unit is further configured to:

determining the track length of the drawn track and the altitude of the drawn track points;

Determining a zoom ratio of the map according to the track length of the drawn track;

Determining the elevation coefficient of the map according to the altitude of the drawn trajectory points;

The map is adjusted according to a zoom ratio of the map and an elevation factor of the map.

In the third aspect, an embodiment of the present application also provides a terminal device, comprising: one or more processors; one or more memories; the one or more memories are used to store one or more computer programs and data information; wherein the one or more computer programs include instructions; when the instructions are executed by the one or more processors, the terminal device executes the method described in any possible design of the first aspect above.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program (also referred to as code, or instructions) that, when executed on a computer, enables the computer to execute a method in any possible implementation of the first aspect described above.

In a fifth aspect, an embodiment of the present application provides a computer program product, which includes: a computer program (also referred to as code, or instructions), which, when executed, enables a computer to execute a method in any possible implementation of the first aspect described above.

For the beneficial effects of any of the second to fifth aspects, please refer to the beneficial effects of various possible designs in the first aspect, which will not be repeated here.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of a possible hardware structure of a terminal device provided in an embodiment of the present application;

FIG2 is a software structure block diagram of a terminal device provided in an embodiment of the present application;

FIG3 is a schematic diagram of a flow chart of a track playback method provided in an embodiment of the present application;

FIG4 is a schematic diagram of a trajectory line provided in an embodiment of the present application;

FIG5 is a schematic diagram of a trajectory line and an occlusion line provided in an embodiment of the present application;

FIG6 is a schematic diagram of a scene of an observation point provided in an embodiment of the present application;

FIG7 is a schematic diagram of a possible camera path provided in an embodiment of the present application;

FIG8 is an example diagram of a possible motion trajectory playback situation provided by an embodiment of the present application;

FIG9 is an example diagram of another possible motion track playback situation provided by an embodiment of the present application;

FIG10 is a schematic diagram of the architecture of a track playback system provided in an embodiment of the present application;

FIG11 is a schematic diagram of the structure of a terminal device provided in an embodiment of the present application;

FIG. 12 is a schematic diagram of the structure of a track playback device provided in an embodiment of the present application.

Detailed ways

With the development of life and technology, people pay more and more attention to sports and health. In addition, with the development of electronic devices, people usually carry portable terminal devices when exercising to monitor the exercise conditions during exercise and understand the exercise conditions at that time. At present, the terminal device can draw and play the exercise trajectory based on the exercise data collected by the portable terminal to display the exercise conditions. Among them, the terminal device can be a portable terminal device, such as a mobile phone, a bracelet, a watch, etc., or it can be other terminal devices, such as a computer, etc.

At present, one implementation method of trajectory playback is to obtain the user's motion data, determine the trajectory point sequence based on the motion data, draw the motion trajectory based on the trajectory point sequence, and rotate the screen according to the correspondence between the midpoint and the starting point in the trajectory point sequence during the drawing of the motion trajectory. However, this implementation method only displays the motion trajectory by rotating the screen, which makes it impossible to fully display the motion trajectory on the screen and observe the motion trajectory completely.

In view of this, an embodiment of the present application provides a trajectory playback method and device. On the one hand, the trajectory point sequence, the lens data of the trajectory, and the control coefficient of the map can be determined according to the motion trajectory. The terminal device draws the user's trajectory according to the trajectory point sequence, and dynamically plays the motion trajectory according to the lens data and the control coefficient of the map. On the other hand, the terminal device can also determine the camera path based on the motion trajectory and the trajectory area, and play the user's motion trajectory based on the camera path and the motion trajectory. In this way, through the method provided by this application, the playback integrity of the motion trajectory can be guaranteed, and the user experience of the user's dynamic trajectory can be improved.

The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

It is understandable that the terminal device of the embodiment of the present application can be a device with display capability such as smart home devices (e.g., smart TVs, smart screens, etc.), mobile phones, tablet computers, wearable devices (e.g., bracelets, watches, etc.), augmented reality (AR)/virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), etc. It is understandable that the embodiment of the present application does not impose any restrictions on the specific type of terminal devices. In the embodiment of the present application, the terminal device can communicate with a wearable device on the user's hand or a wearable device on the user's foot to obtain the user's motion data and realize dynamic playback of the user's motion trajectory; wherein, the terminal device can also be a wearable device with a display unit on the user's hand.

The terminal device to which the present application can be applied includes but is not limited to a terminal device equipped with Or terminal devices of other operating systems.

FIG1 shows a schematic diagram of the hardware structure of a possible terminal device. The terminal device 100 includes: a radio frequency (RF) circuit 110, a power supply 120, a processor 130, a memory 140, an input unit 150, a display unit 160, an audio circuit 170, a communication interface 180, and a wireless fidelity (Wi-Fi) module 190 and other components. Those skilled in the art will understand that the hardware structure of the terminal device 100 shown in FIG1 does not constitute a limitation on the terminal device 100. The terminal device 100 provided in the embodiment of the present application may include more or fewer components than shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in FIG1 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application-specific integrated circuits.

The following is a detailed introduction to the various components of the terminal device 100 in conjunction with FIG. 1 :

The RF circuit 110 can be used for receiving and sending data during communication or calls. In particular, after receiving downlink data from the base station, the RF circuit 110 sends it to the processor 130 for processing; in addition, the uplink data to be sent is sent to the base station. Generally, the RF circuit 110 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, etc.

In addition, the RF circuit 110 can also communicate with other devices through a wireless communication network. The wireless communication can use any communication standard or protocol, including but not limited to global system of mobile communication (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), email, short messaging service (SMS), etc.

Wi-Fi technology is a short-range wireless transmission technology. The terminal device 100 can connect to an access point (AP) through the Wi-Fi module 190 to access the data network. The Wi-Fi module 190 can be used for receiving and sending data during the communication process. In the embodiment of the present application, the terminal device 100 can also be connected to the user's portable device through the Wi-Fi module 190 to achieve information interaction, such as receiving motion data collected by the portable device in the user's hand.

The terminal device 100 can be physically connected to other devices through the communication interface 180. Optionally, the communication interface 180 is connected to the communication interface of the other device through a cable to achieve data transmission between the terminal device 100 and the other device.

Since in the embodiment of the present application, the terminal device 100 can implement communication services, for example, it can interact with a portable device, so the terminal device 100 needs to have a data transmission function, that is, the terminal device 100 needs to include a communication module. Although FIG1 shows communication modules such as the RF circuit 110, the Wi-Fi module 190, and the communication interface 180, it is understandable that at least one of the above components or other communication modules (such as a Bluetooth module) for implementing communication exists in the terminal device 100 for data transmission.

For example, when the terminal device 100 is a mobile phone, the terminal device 100 may include the RF circuit 110, and may also include the Wi-Fi module 190, or may include a Bluetooth module (not shown in FIG. 1 ); when the terminal device 100 is a computer, the terminal device 100 may include the communication interface 180, and may also include the Wi-Fi module 190, or may include a Bluetooth module (not shown in FIG. 1 ); when the terminal device 100 is a tablet computer, the terminal device 100 may include the Wi-Fi module, or may include a Bluetooth module (not shown in FIG. 1 ).

The memory 140 can be used to store software programs and modules. The processor 130 executes various functional applications and data processing of the terminal device 100 by running the software programs and modules stored in the memory 140. Optionally, the memory 140 may mainly include a program storage area and a data storage area. Among them, the program storage area can store an operating system (mainly including software programs or modules corresponding to the kernel layer, system layer, application framework layer, and application layer, etc.).

In addition, the memory 140 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

The input unit 150 can be used to receive the editing operations of various types of data objects such as digital or character information input by the user, and generate key signal input related to the user settings and function control of the terminal device 100. Optionally, the input unit 150 may include a touch panel 151 and other input devices 152.

Among them, the touch panel 151, also known as a touch screen, can collect user touch operations on or near it (for example, operations performed by the user using fingers, stylus, or any other suitable object or accessory on or near the touch panel 151), and drive the corresponding connection device according to a pre-set program.

Optionally, the other input devices 152 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, etc.

The display unit 160 can be used to display information input by the user or information provided to the user and various menus of the terminal device 100. The display unit 160 is the display system of the terminal device 100, which is used to present an interface and realize human-computer interaction. The display unit 160 may include a display panel 161. Optionally, the display panel 161 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. In the embodiment of the present application, the display unit 160 is set on the terminal device, and the motion data uploaded by each portable device can be displayed through the display unit 160, or if the terminal device is some portable devices, the motion data can be displayed through the display unit 160, for example, the user's motion trajectory can be displayed on the mobile phone.

The processor 130 is the control center of the terminal device 100, and uses various interfaces and lines to connect various components, and executes various functions and processes data of the terminal device 100 by running or executing software programs and/or modules stored in the memory 140, and calling data stored in the memory 140, thereby realizing various services based on the terminal device 100. In the embodiment of the present application, the processor 130 is used to implement the method provided in the embodiment of the present application, so as to realize dynamic playback of motion trajectories, etc.

The terminal device 100 also includes a power supply 120 (such as a battery) for supplying power to various components. Optionally, the power supply 120 can be logically connected to the processor 130 through a power management system, so that the power management system can manage functions such as charging, discharging, and power consumption.

As shown in FIG1 , the terminal device 100 further includes an audio circuit 170, a microphone 171 and a speaker 172, which can provide an audio interface between the user and the terminal device 100. The audio circuit 170 can be used to convert audio data into a signal that can be recognized by the speaker 172, and transmit the signal to the speaker 172, which is converted into a sound signal for output by the speaker 172. The microphone 171 is used to collect external sound signals (such as the sound of a person speaking, or other sounds, etc.), and convert the collected external sound signals into signals that can be recognized by the audio circuit 170, and send them to the audio circuit 170. The audio circuit 170 can also be used to convert the signal sent by the microphone 171 into audio data, and then output the audio data to the RF circuit 110 to send it to, for example, another terminal device, or output the audio data to the memory 140 for subsequent further processing.

Although not shown, the terminal device 100 may also include at least one sensor, camera, etc., which will not be described in detail herein. The at least one sensor may include but is not limited to a pressure sensor, an air pressure sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a touch sensor, a temperature sensor, etc.

The operating system (OS) involved in the embodiment of the present application is the most basic system software running on the terminal device 100. Taking a mobile phone as an example, the operating system can be HarmonyOS or Android system or IOS system. The software system of the terminal device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes an operating system adopting a layered architecture as an example to exemplify the software structure of the terminal device 100.

FIG2 is a block diagram of the software structure of a terminal device provided in an embodiment of the present application. As shown in FIG2, the software structure of the terminal device can be a layered architecture, for example, the software can be divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into five layers, from top to bottom, namely, the application layer, the application framework layer (framework, FWK), the runtime and system library, the kernel layer, and the hardware layer.

The application layer may include a series of application packages. As shown in Figure 2, the application layer may include camera, settings, skin module, user interface (UI), third-party applications, etc. Among them, third-party applications may include WLAN, music, calls, Bluetooth, video, etc.

In one possible implementation, applications can be developed using the Java language by calling the application programming interface (API) provided by the application framework layer. Developers can interact with the underlying layers of the operating system (such as the hardware layer, kernel layer, etc.) through the application framework layer to develop their own applications. The application framework layer is mainly a series of services and management systems for the operating system.

The application framework layer provides an application programming interface and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions. As shown in FIG2 , the application framework layer may include a shortcut icon management module, a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.

The shortcut icon management module is used to manage the shortcut icons displayed on the terminal device, such as creating shortcut icons, removing shortcut icons, monitoring whether the shortcut icons meet the display conditions, etc.

The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

The phone manager is used to provide communication functions for terminal devices, such as the management of call status (including answering, hanging up, etc.).

The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, the terminal device vibrates, the indicator light flashes, etc.

In some embodiments of the present application, the application framework layer is mainly responsible for calling the service interface for communication with the hardware layer to pass the user's operation request to the hardware layer, and the operation request may include the user playing the motion trajectory through the display unit 160, etc.

The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.

The core library consists of two parts: one is the function that the Java language needs to call, and the other is the core library of the operating system. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The system library can include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

A 2D graphics engine is a drawing engine for 2D drawings.

In some embodiments, the three-dimensional graphics processing library may be used to draw a three-dimensional motion trajectory image, and the 2D graphics engine may be used to draw a two-dimensional motion trajectory image.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

The hardware layer can include various types of sensors, such as accelerometers, gyroscopes, touch sensors, etc.

Usually, the terminal device 100 can run multiple applications at the same time. In a simpler way, one application can correspond to one process, and in a more complex way, one application can correspond to multiple processes. Each process has a process number (process ID).

In combination with the introduction to the hardware structure of the terminal device in Figure 1 and the introduction to the software framework of the terminal device in Figure 2, the following, in combination with multiple embodiments and drawings, exemplifies the working principles of the software and hardware of the terminal device for executing a target scene recognition method proposed in an embodiment of the present application.

It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And/or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character "/" generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.

The "multiple" involved in the embodiments of the present application refers to greater than or equal to two.

In addition, it should be understood that, in the description of this application, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

In addition, in the embodiments of the present application, "terminal device", "device", etc. can be used interchangeably, that is, to refer to various devices that can be used to implement the embodiments of the present application.

It should be understood that the hardware structure of the terminal device can be as shown in Figure 1, and the software architecture can be as shown in Figure 2, wherein the software programs and/or modules corresponding to the software architecture in the terminal device can be stored in the memory 140, and the processor 130 can run the software programs and applications stored in the memory 140 to execute the process of a trajectory playback method provided in an embodiment of the present application.

In order to facilitate understanding of a track playback method provided by the present application, the implementation process of the method provided by the present application is introduced below in combination with the contents shown in Figures 3 to 10.

First, a possible track playback method applicable to the embodiment of the present application is introduced. FIG3 is a flow chart of a track playback method provided by the embodiment of the present application. The flow chart includes:

Step 301: The terminal device determines the track playback information of the user's track according to the user's sports data. Exemplarily, the terminal device may be a portable terminal device, such as a mobile phone, a sports bracelet, and the like.

The motion data includes, but is not limited to, the type of motion, the longitude of the motion track, the latitude of the motion track, the speed, the altitude, and the accuracy of the track points. The track playback information includes, but is not limited to, the track point sequence, the lens data, and the map control coefficient. The lens data is used to determine the playback angle of the motion track, and the map control coefficient is used to characterize the display ratio of the map.

In some embodiments, the trajectory points in the trajectory point sequence are sorted according to the acquisition time, and the trajectory points in the trajectory point sequence can form a motion trajectory.

When the present application is implemented, the user's motion data recorded by the terminal device may be stored in the memory of the terminal device. Alternatively, the terminal device may obtain the user's motion data from other devices. For example, the terminal device obtains the user's motion data from a sports bracelet.

In some embodiments, after acquiring the motion data, the terminal device may determine the track playback information through the following steps:

A1: The terminal device determines the trajectory attributes of the motion trajectory based on the motion data.

The track attributes include but are not limited to: the location of the track point, the altitude of the track point, and the track length.

In some embodiments, after preprocessing the motion data, the terminal device performs feature value recognition on the motion data to obtain trajectory attributes.

The terminal device uses the longitude and latitude of the motion track in the motion data as the position of the track point. In addition, the terminal device can also determine the track length according to the longitude and latitude of the motion track.

In some embodiments, when the motion data includes a motion type, the terminal device may also use the motion type as a trajectory attribute. In addition, the trajectory attribute may also include a trajectory point terrain. In implementation, the terminal device may also obtain terrain data on a map based on the longitude and latitude of the trajectory point in the motion data, and use the obtained terrain data as the trajectory point terrain. For example, when the longitude and latitude of the trajectory point in the motion data correspond to a mountainous terrain on the map, the mountainous terrain is used as the trajectory point terrain.

A2: The terminal device determines the track playback information according to the track attributes.

The map control coefficients include but are not limited to elevation coefficient and zoom ratio.

After determining the trajectory attributes, the terminal device determines the trajectory point sequence, lens data and map control coefficient according to the obtained trajectory attributes.

In some embodiments, the terminal device may obtain a trajectory point sequence based on the trajectory point position. Used to draw motion trajectories.

In some embodiments, the lens data may include a lens angle or a camera path. Furthermore, the two conditions of the lens data are respectively applicable to different situations. The following describes the process of determining the lens data according to the above two situations.

Case 1: The lens data includes the lens angle.

In some embodiments, when the lens data includes a lens angle, the lens is visually focused on a track point in the track point sequence.

When the present application is implemented, the terminal device can determine the lens angle according to the type of movement.

In some embodiments, the terminal device may determine the lens angle based on a preset correspondence between the sport type and the lens angle. For example, when the terminal device determines that the sport type is running, the lens angle is determined to be 45°.

In some embodiments, the terminal device may also determine the lens angle according to the correspondence between the track point terrain and the lens angle. For example, when the terminal device determines that the track point terrain is a mountain, the lens angle is determined to be 45°.

Case 2: The lens data includes a camera path, where the camera path includes a camera position and a lens angle.

In some embodiments, the terminal device may determine the camera path according to the position of the track point and the altitude of the track point. In addition, the terminal device may determine the camera path by the following steps:

B1: The terminal device obtains the initial trajectory based on the position of the trajectory point.

In some embodiments, the initial trajectory may be a trajectory composed of trajectory points in a trajectory point sequence, or may be a trajectory composed of trajectory points corresponding to trajectory point positions.

B2: The terminal device extracts multiple trajectory points from the initial trajectory as the camera visual focus according to the set trajectory point distance interval.

For example, as shown in FIG. 4 , the terminal device may obtain trajectory points in the initial trajectory every 10 meters, and connect the obtained trajectory points to obtain a trajectory line.

In one embodiment, after obtaining the camera visual focus, the terminal device determines the camera path according to the camera visual focus.

B3: The terminal device determines the trajectory area corresponding to the initial trajectory in the map, and uses the highest point in the trajectory area as the occlusion point.

In some embodiments, the terminal device may determine the track area corresponding to the initial track in the map according to the track point position, and the terminal device obtains the highest point in the track area and uses the highest point in the track area as the blocking point.

For example, as shown in Figure 5, after the terminal device determines the highest point in the trajectory area corresponding to the initial trajectory, it connects the highest points in the altitude with a dotted line to form an occlusion line. There is an overlap between the occlusion line and the trajectory line in Figure 5, indicating that the terrain in the trajectory area will occlude the trajectory point.

B4: The terminal device determines the camera path based on the camera visual focus and occlusion points.

In some embodiments, the terminal device may establish a buffer zone outside the initial trajectory to generate a camera path.

In implementation, the terminal device determines the viewing angle area of the observation point according to the visual focus of the camera, wherein the observation point is the position point of the camera when the visual focus of the camera coincides with the visual focus of the camera.

In some embodiments, the terminal device may determine the camera path by determining whether there is an occlusion point in the viewing area from the observation point to the camera visual focus. When determining the camera path, the initial position of the observation point is located on the connecting line between the camera visual focus and the occlusion point.

When the terminal device determines that there is an occlusion point in the viewing angle area from the observation point to the camera visual focus, the terminal device moves the position of the observation point and changes the lens angle of the observation point until there is no occlusion point in the viewing angle area.

When the terminal device determines that there is no occlusion point in the viewing angle area from the observation point to the camera visual focus, the terminal device uses the position and the lens angle of the observation point as the camera path.

In one embodiment, the terminal device determines multiple camera positions and lens angles according to the visual focal points of multiple cameras, connects the position points of the obtained multiple camera positions to form a camera path, and determines the lens action according to the lens angle corresponding to each position point.

In one embodiment, the terminal device may also determine the camera path according to the viewing angle attribute. For example, the terminal device may determine the camera path according to the following code:

Camera.position=mapboxgl.MercatorCoordinate.fromLngLat(

{

lng：alongCamera[0],

lat：alongCamera[1]

},

camerAltitude

);

Camera.lookAtPoint({

lng：alongRoute[0],

lat：alongRoute[1]

});

For example, as shown in FIG6 , there is an overlap between the trajectory line formed by the trajectory point and the occlusion line formed by the occlusion. The triangle in FIG6 represents the observation point of the camera. The terminal device adjusts the position and viewing angle of the observation point so that the viewing angle from the observation point to the trajectory point passes through the occlusion, thereby achieving the purpose that the occlusion cannot block the trajectory point.

The terminal device generates a camera path based on the determined camera position and lens angle. The camera path is located outside the trajectory line and the occlusion line. For example, as shown in FIG7 , the camera path is located outside the trajectory line and the occlusion line, and the camera's perspective world on the camera path crosses the occlusion line to reach the trajectory line, and does not occlude the trajectory point.

In an embodiment of the present application, the terminal device may determine the map control coefficient according to at least one trajectory attribute. In implementation, the terminal device may determine the map control coefficient according to the following method:

The terminal device determines the scaling ratio based on the trajectory length.

In some embodiments, the terminal device may determine the scaling ratio corresponding to the track length according to the corresponding relationship between the track length and the scaling ratio. The scaling ratio includes a maximum value and a minimum value. In addition, the terminal device may also adjust the scaling ratio within the scaling ratio range according to the track length.

For example, when the track length L is 1000 meters, the terminal device determines that the maximum value of the zoom ratio corresponding to L is 13.5 and the minimum value is 11.5 according to the corresponding relationship between the track length and the zoom ratio; that is, the terminal device determines that the zoom value corresponding to L is in the range of [11.5, 13.5]. During the track playback process, the zoom value will fluctuate in the range of [11.5, 13.5] as the L of the drawn track changes. The larger the L, the smaller the zoom value.

In some embodiments, the terminal device may also determine the zoom ratio according to the altitude of the track point and the track length. After determining the zoom ratio, the terminal device adjusts the zoom ratio within the range of the zoom ratio according to changes in the track length and the altitude.

In some embodiments, the terminal device may also determine at least one scaling ratio corresponding to the track length according to the corresponding relationship between the track length and the scaling ratio. The terminal device determines a target scaling ratio corresponding to the track point terrain from at least one scaling ratio according to the corresponding relationship between the track point terrain and the scaling ratio.

For example, when the trajectory length L is 5 meters, the terminal device determines that the zoom value corresponding to L is 14 and [12.5, 13.5] according to the correspondence between the trajectory length and the zoom ratio, and selects 14 from 14 and [12.5, 13.5] as the target zoom ratio corresponding to the plain according to the correspondence between the trajectory point terrain and the zoom ratio.

In some embodiments, the terminal device may also determine the scaling ratio according to the altitude of the track point and the position of the track point. In the embodiment of the present application, the terminal device may also determine the scaling ratio in other ways, which are not limited to the above.

In an embodiment of the present application, the terminal device can determine the elevation coefficient based on the altitude and movement type of the trajectory point.

The terminal device determines the altitude difference of the track point according to the altitude of the track point, and determines the elevation coefficient according to the altitude difference and the movement type. The elevation coefficient is positively correlated with the altitude difference of the track point.

In some embodiments, the elevation coefficient is used to modify the elevation in the map, thereby changing the undulation of the surface in the map.

The terminal device may determine at least one elevation coefficient corresponding to the movement type according to the movement type. The terminal device may determine one of the at least one elevation coefficients as the elevation coefficient according to the altitude difference.

For example, when the sport type is mountain climbing, the corresponding elevation coefficients for mountain climbing are 1.1 and 1.3 respectively; when the altitude difference of the trajectory point is 100 meters, the terminal device determines that the elevation coefficient can be 1.1; when the altitude difference is 200 meters, the elevation coefficient is determined to be 1.3.

In some embodiments, the terminal device may also determine the elevation coefficient according to the terrain of the track point. In implementation, the terminal device may determine the elevation coefficient according to the correspondence between the terrain of the track point and the elevation coefficient. For example, when the terminal device determines that the terrain of the track point is mountainous, the initial value of the elevation coefficient is determined to be 1.5.

In some embodiments, the map control coefficient also includes whether to display 3D building blocks. The terminal device determines whether to display 3D building blocks according to the terrain of the track point in the track attribute. For example, when the terrain of the track point in the track attribute is mountainous, it is determined that the 3D building blocks do not need to be displayed.

Step 302: The terminal device plays the motion trajectory on the map according to the trajectory playback information.

In the implementation of the present application, the terminal device adjusts the map according to the map control coefficient and sets the lens based on the lens data. Then, the terminal device plays the motion trajectory drawn according to the trajectory point sequence in the adjusted map based on the lens.

The terminal device draws the motion trajectory on the map according to the trajectory point sequence. In addition, the terminal device determines the motion trajectory according to the lens data. The display viewing angle and the display scale of the map are determined according to the map control coefficient.

In some embodiments, when the lens data includes a lens angle, the terminal device sets the lens according to the lens angle and the position of the track point, wherein the lens angle changes as the motion track is played.

In other embodiments, when the lens data includes a camera path, the terminal device sets the lens according to the camera path, wherein the viewing angle of the lens changes according to the camera path as the motion trajectory is played.

Furthermore, during the motion trajectory playback process, the terminal device may also adjust the elevation coefficient according to the altitude of the trajectory point in the drawn trajectory, and adjust the zoom ratio according to the trajectory length of the drawn trajectory.

In one embodiment, the terminal device can adjust the zoom ratio of the map based on the determined zoom ratio and the track length. After determining the elevation coefficient based on the altitude and the movement type of the track point, the terminal device can adjust the elevation in the map based on the determined elevation coefficient to change the undulation of the surface in the map.

In implementation, after determining the initial value of the zoom ratio and the initial value of the elevation coefficient, the terminal device modifies the zoom ratio and the elevation coefficient in the map control coefficient according to the initial value. In addition, the terminal device plays the motion trajectory based on the lens in the adjusted map.

In some embodiments, during the trajectory playback process, the terminal device will dynamically modify the map control coefficient as the trajectory length and the altitude of the trajectory points change, so that the map can change with the movement trajectory, thereby reducing or avoiding the problem of trajectory line overflow.

In implementation, during the trajectory playback process, the terminal device determines the altitude of the drawn trajectory points, and dynamically modifies the altitude coefficient according to the altitude of the drawn trajectory points.

For example, the terminal device determines that the initial value of the elevation coefficient is 1.5. During the trajectory drawing process, the terminal device determines the altitude of the drawn trajectory point. As the altitude of the drawn trajectory point increases, the elevation coefficient is continuously modified; when the altitude difference of the drawn trajectory point increases to 200 meters, the terminal device can increase the elevation coefficient from 1.5 to 1.7.

During the trajectory playback process, the terminal device determines the trajectory length of the drawn trajectory, and dynamically modifies the zoom ratio according to the trajectory length of the drawn trajectory.

For example, as shown in FIG8 , when the terminal device just starts to draw the motion trajectory, the length of the drawn trajectory is the smallest, and at this time, the zoom ratio of the map is the largest. In the process of the terminal device drawing the motion trajectory, as the length of the drawn trajectory increases, the zoom ratio of the map gradually decreases to more completely display the motion trajectory in the display interface. In addition, in the process of the terminal device drawing the motion trajectory, the lens angle of view changes with the motion trajectory. When the motion trajectory is drawn, the zoom ratio of the map is the smallest.

In this application, the terminal device dynamically modifies the lens angle and map control coefficient according to the trajectory attributes such as the trajectory point terrain, motion type, trajectory point position, trajectory point length and altitude of the trajectory point, so as to ensure that in the process of drawing the motion trajectory, the occurrence of trajectory line overflow problems is reduced or even avoided, thereby improving the user experience.

In one embodiment, when the lens data includes a camera path, the terminal device directly draws the motion trajectory according to the trajectory point sequence. The map control coefficient may be a preset fixed value. When the terminal device plays the motion trajectory, the gaze angle of the motion trajectory is determined according to the camera path, and the motion trajectory is played with the gaze angle.

For example, as shown in FIG9 , the terminal device draws a motion trajectory according to the sequence of trajectory points, and the motion trajectory is the thick black line portion in FIG9 . The terminal device takes the starting point of the motion trajectory as the starting point and plays the motion trajectory according to the camera path until the camera view reaches the starting point of the motion trajectory, and the motion trajectory display ends. During the process of the terminal device playing the motion trajectory, the user's gaze perspective changes to a movie perspective to view the motion trajectory.

In this application, the terminal device sets observation points and occlusion points to establish a camera path, and transforms the viewing perspective of the motion trajectory into a movie perspective. While reducing the occlusion of the trajectory points by obstructions, it also increases the visualization of the motion trajectory and provides a better user experience.

Based on the above embodiments, the present application also provides a track playback system. As shown in FIG10 , the track playback system includes a portal database, a preprocessing unit, a feature value extraction unit, an algorithm unit, a map unit and a sports health unit.

Among them, the portal database is used to store users' sports data.

The preprocessing unit is used to preprocess the motion data obtained from the portal database and eliminate abnormal data.

The feature value extraction unit is used to obtain the processed motion data output by the preprocessing unit, and perform feature value recognition on the motion data to obtain trajectory attributes, wherein the trajectory attributes include but are not limited to trajectory length, motion type, altitude of trajectory points, terrain of trajectory points, and location of trajectory points.

The algorithm unit is used to determine the trajectory point sequence, lens data and map control coefficient according to the trajectory attributes. The algorithm unit includes Algorithm 1 and Algorithm 2. The algorithm unit responds to the motion trajectory display mode selected by the user and inputs the trajectory attributes into the motion trajectory display mode. In the corresponding algorithm, the corresponding trajectory point sequence, lens data and map control coefficient are obtained. For example, the explicit mode corresponding to Algorithm 1 is the ordinary display motion trajectory, and the lens data output by Algorithm 1 includes the lens angle and trajectory point position. The display mode corresponding to Algorithm 2 is the movie perspective display motion trajectory, and the lens data output by Algorithm 2 includes the camera path.

The map unit is used to draw the motion trajectory, determine the lens angle and adjust the map control coefficient according to the trajectory point sequence, lens data and map control coefficient sent by the algorithm unit, and obtain the display screen of the motion trajectory. The map unit sends the obtained display screen to the sports health unit.

The sports health unit is used to display the received display image in the display interface to complete the playback of the sports trajectory.

Based on the above embodiments and the same concept, the embodiments of the present application also provide an electronic device, which is used to implement the air conditioning control method provided in the embodiments of the present application. As shown in FIG. 11 , the terminal device 1100 may include: a display screen 1101, a memory 1102, one or more processors 1103, and one or more computer programs (not shown in the figure). The above-mentioned devices can be coupled via one or more communication buses 1104.

The display screen 1101 is used to display relevant user interfaces such as motion trajectories, images, videos, and application interfaces. The memory 1102 stores one or more computer programs (codes), and the one or more computer programs include computer instructions; one or more processors 1103 call the computer instructions stored in the memory 1102, so that the terminal device 1100 executes the trajectory playback method provided in the embodiment of the present application.

In a specific implementation, the memory 1102 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state storage devices. The memory 1102 may store an operating system (hereinafter referred to as system), such as ANDROID, IOS, WINDOWS, or embedded operating systems such as LINUX. The memory 1102 may be used to store the implementation program of the embodiment of the present application. The memory 1102 may also store a network communication program, which may be used to communicate with one or more additional devices, one or more user devices, and one or more network devices. The one or more processors 1103 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application.

It should be noted that FIG. 11 is only one implementation of the terminal device 1100 provided in an embodiment of the present application. In actual applications, the terminal device 1100 may also include more or fewer components, which is not limited here.

Based on the above embodiments and the same concept, the present application embodiment further provides a track playback device, which can be applied to the terminal device shown in Figure 11. As shown in Figure 12, the track playback device 1200 may include:

The determining unit 1201 is used to determine the track playback information of the user's track according to the user's motion data; wherein the motion data includes the longitude, latitude and altitude of the track; the track playback information includes a track point sequence, lens data and a map control coefficient; the lens data is used to determine the playback angle of the track, and the map control coefficient is used to characterize the display ratio of the map;

The playing unit 1202 is used to play the movement trajectory in the map according to the trajectory playing information.

In a possible implementation manner, the determining unit 1201 is specifically configured to:

Determining the trajectory attributes of the motion trajectory according to the motion data; wherein the trajectory attributes include the position of the trajectory point, the altitude of the trajectory point, and the trajectory length;

The track playing information is determined according to the track attribute.

In a possible implementation, when the motion data includes a motion type, the trajectory attribute also includes the motion type.

In a possible implementation manner, the determining unit 1201 is specifically configured to:

Based on the trajectory point positions in the trajectory attributes, obtaining the trajectory point sequence;

The map control coefficient is determined according to at least one of the trajectory attributes; the map control coefficient includes a zoom ratio and an elevation coefficient; the elevation coefficient is used to characterize the relative change of the elevation in the map.

In a possible implementation manner, the determining unit 1201 is specifically configured to:

Determining the scaling ratio according to the trajectory length;

The elevation coefficient is determined according to the altitude of the trajectory point and the movement type; the elevation coefficient is positively correlated with the altitude difference of the trajectory point.

In a possible implementation manner, the determining unit 1201 is specifically configured to:

The lens data is determined according to the motion type; the lens data includes a lens angle.

In a possible implementation manner, the determining unit 1201 is specifically configured to:

The lens data is determined according to the position of the track point and the altitude of the track point; the lens data includes a camera path; and the camera path includes a lens angle and a camera position.

In a possible implementation manner, the determining unit 1201 is specifically configured to:

According to the positions of the trajectory points, an initial trajectory is obtained;

Extracting a plurality of trajectory points from the initial trajectory as camera visual focus according to a set trajectory point distance interval;

In the map, determining a track area corresponding to the initial track, and taking the highest point in the track area as an occlusion point;

The camera path is determined according to the camera visual focus and the occlusion point.

In a possible implementation manner, the determining unit 1201 is specifically configured to:

Determine the viewing angle area of the observation point according to the visual focus of the camera; the observation point is the position point of the camera when the visual focus of the camera coincides with the visual focus of the camera;

When the viewing angle area does not include the occlusion point, the position of the observation point and the lens angle of the observation point are used as the camera path.

In a possible implementation, the playback unit 1202 is specifically configured to:

adjusting the map according to the map control coefficient;

Setting the lens based on the lens data;

Based on the lens, a motion trajectory drawn according to the sequence of trajectory points is played in the adjusted map.

In a possible implementation, during the motion trajectory playback process, the playback unit 1202 is further configured to:

determining the track length of the drawn track and the altitude of the drawn track points;

Determining a zoom ratio of the map according to the track length of the drawn track;

Determining the elevation coefficient of the map according to the altitude of the drawn trajectory points;

The map is adjusted according to a zoom ratio of the map and an elevation factor of the map.

Based on the above embodiments, the present application also provides a computer program product, which includes: a computer program (also referred to as code, or instructions), which enables a computer to execute the method described in the embodiments of the present application when the computer program is executed.

Based on the above embodiments, the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the method described in the embodiments of the present application.

Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

The present application is described with reference to the flowchart and/or block diagram of the method, device (system), and computer program product according to the present application. It should be understood that each process and/or box in the flowchart and/or block diagram, as well as the combination of the process and/or box in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one process or multiple processes in the flowchart and/or one box or multiple boxes in the block diagram.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.

These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.

Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims (25)

1. A trajectory playing method, characterized by comprising:

   Determine the track playback information of the user's track according to the user's motion data; wherein the motion data includes the longitude, latitude and altitude of the track; the track playback information includes a track point sequence, lens data and a map control coefficient; the lens data is used to determine the playback viewing angle of the track, and the map control coefficient is used to characterize the display ratio of the map;

   The motion trajectory is played in the map according to the trajectory playing information.
2. The method according to claim 1, characterized in that determining the track playback information according to the user's motion data comprises:

   Determining the trajectory attributes of the motion trajectory according to the motion data; wherein the trajectory attributes include the position of the trajectory point, the altitude of the trajectory point, and the trajectory length;

   The track playing information is determined according to the track attribute.
3. The method according to claim 2 is characterized in that, when the motion data includes a motion type, the trajectory attribute also includes the motion type.
4. The method according to any one of claims 2 to 3, characterized in that determining the track playback information according to the track attribute comprises:

   Based on the trajectory point positions in the trajectory attributes, obtaining the trajectory point sequence;

   The map control coefficient is determined according to at least one of the trajectory attributes; the map control coefficient includes a zoom ratio and an elevation coefficient; the elevation coefficient is used to characterize the relative change of the elevation in the map.
5. The method according to claim 4, characterized in that the determining the map control coefficient according to at least one of the trajectory attributes comprises:

   Determining the scaling ratio according to the trajectory length;

   The elevation coefficient is determined according to the altitude of the trajectory point and the movement type; the elevation coefficient is positively correlated with the altitude difference of the trajectory point.
6. The method according to any one of claims 2 to 3, characterized in that determining the track playback information according to the track attribute comprises:

   The lens data is determined according to the motion type; the lens data includes a lens angle.
7. The method according to any one of claims 2 to 3, characterized in that determining the track playback information according to the track attribute comprises:

   The lens data is determined according to the position of the track point and the altitude of the track point; the lens data includes a camera path; and the camera path includes a lens angle and a camera position.
8. The method according to claim 7, characterized in that the step of determining the lens data according to the position of the trajectory point and the altitude of the trajectory point comprises:

   According to the positions of the trajectory points, an initial trajectory is obtained;

   Extracting a plurality of trajectory points from the initial trajectory as camera visual focus according to a set trajectory point distance interval;

   In the map, determining a track area corresponding to the initial track, and taking the highest point in the track area as an occlusion point;

   The camera path is determined according to the camera visual focus and the occlusion point.
9. The method according to claim 8, characterized in that the step of determining the camera path according to the camera visual focus and the occlusion point comprises:

   Determine the viewing angle area of the observation point according to the camera visual focus; wherein the observation point is the position point of the camera when the camera visual focus coincides with the camera visual focus;

   When the viewing angle area does not contain the occlusion point, the position of the viewing point and the lens angle of the viewing point are used as the relative Machine path.
10. The method according to any one of claims 1 to 9, characterized in that playing the motion trajectory in the map according to the trajectory playing information comprises:

    adjusting the map according to the map control coefficient;

    Setting the lens based on the lens data;

    Based on the lens, a motion trajectory drawn according to the sequence of trajectory points is played in the adjusted map.
11. The method according to claim 10, characterized in that, during the motion trajectory playback process, the method further comprises:

    determining the track length of the drawn track and the altitude of the drawn track points;

    Determining a zoom ratio of the map according to the track length of the drawn track;

    Determining the elevation coefficient of the map according to the altitude of the drawn trajectory points;

    The map is adjusted according to a zoom ratio of the map and an elevation factor of the map.
12. A track playback device, characterized by comprising:

    A determination unit, configured to determine the track playback information of the user's track according to the user's motion data; wherein the motion data includes the longitude, latitude and altitude of the track; the track playback information includes a track point sequence, lens data and a map control coefficient; the lens data is used to determine the playback viewing angle of the track, and the map control coefficient is used to characterize the display ratio of the map;

    A playback unit is used to play the motion trajectory in the map according to the trajectory playback information.
13. The device according to claim 12, characterized in that the determining unit is specifically used to:

    Determining the trajectory attributes of the motion trajectory according to the motion data; wherein the trajectory attributes include the position of the trajectory point, the altitude of the trajectory point, and the trajectory length;

    The track playing information is determined according to the track attribute.
14. The device according to claim 13 is characterized in that when the motion data includes a motion type, the trajectory attribute also includes the motion type.
15. The device according to claim 14, characterized in that the determining unit is specifically used to:

    Based on the trajectory point positions in the trajectory attributes, obtaining the trajectory point sequence;

    The map control coefficient is determined according to at least one of the trajectory attributes; the map control coefficient includes a zoom ratio and an elevation coefficient; the elevation coefficient is used to characterize the relative change of the elevation in the map.
16. The device according to claim 15, characterized in that the determining unit is specifically used to:

    Determining the scaling ratio according to the trajectory length;

    The elevation coefficient is determined according to the altitude of the trajectory point and the movement type; the elevation coefficient is positively correlated with the altitude difference of the trajectory point.
17. The device according to any one of claims 13-14, characterized in that the determining unit is specifically used to:

    The lens data is determined according to the motion type; the lens data includes a lens angle.
18. The device according to any one of claims 13-14, characterized in that the determining unit is specifically used to:

    The lens data is determined according to the position of the track point and the altitude of the track point; the lens data includes a camera path; and the camera path includes a lens angle and a camera position.
19. The device according to claim 18, wherein the determining unit is specifically configured to:

    According to the positions of the trajectory points, an initial trajectory is obtained;

    Extracting a plurality of trajectory points from the initial trajectory as camera visual focus according to a set trajectory point distance interval;

    In the map, determining a track area corresponding to the initial track, and taking the highest point in the track area as an occlusion point;

    The camera path is determined according to the camera visual focus and the occlusion point.
20. The device according to claim 19, wherein the determining unit is specifically configured to:

    Determine the viewing angle area of the observation point according to the visual focus of the camera; the observation point is the position point of the camera when the visual focus of the camera coincides with the visual focus of the camera;

    When the viewing angle area does not include the occlusion point, the position of the observation point and the lens angle of the observation point are used as the camera path.
21. The device according to any one of claims 12 to 20, wherein the playback unit is specifically used for:

    adjusting the map according to the map control coefficient;

    Setting the lens based on the lens data;

    Based on the lens, a motion trajectory drawn according to the sequence of trajectory points is played in the adjusted map.
22. The device according to claim 21, characterized in that, during the motion trajectory playback process, the playback unit is further used to:

    determining the track length of the drawn track and the altitude of the drawn track points;

    Determining a zoom ratio of the map according to the track length of the drawn track;

    Determining the elevation coefficient of the map according to the altitude of the drawn trajectory points;

    The map is adjusted according to a zoom ratio of the map and an elevation factor of the map.
23. A terminal device, characterized in that it comprises: one or more processors; one or more memories;

    The one or more memories are used to store one or more computer programs and data information; wherein the one or more computer programs include instructions;

    When the instructions are executed by the one or more processors, the terminal device executes the method according to any one of claims 1 to 11.
24. A computer-readable storage medium, characterized in that the computer-readable storage medium is used to store a computer program, and when the computer program is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 11.
25. A computer program product, characterized in that it comprises a computer program, and when the computer program is run on a computer, the computer is caused to execute the method as described in any one of claims 1 to 11 above.