WO2019105100A1

WO2019105100A1 - Augmented reality processing method and apparatus, and electronic device

Info

Publication number: WO2019105100A1
Application number: PCT/CN2018/105116
Authority: WO
Inventors: 汤锦鹏; 查俊莉
Original assignee: 广州市动景计算机科技有限公司
Priority date: 2017-12-01
Filing date: 2018-09-11
Publication date: 2019-06-06
Also published as: CN107918956A

Abstract

Augmented reality processing method and apparatus, and an electronic device, the method comprising: determining a current motion mode of a user, and creating a virtual scene which adapts to the current motion mode of the user; and acquiring motion data of the user in the current motion mode, and associating same with the virtual scene. The method and apparatus, and the electronic device can provide a richer user experience.

Description

Augmented reality processing method, device and electronic device

Technical field

The embodiments of the present invention relate to the field of software technologies, and in particular, to a processing method, device, and electronic device for augmented reality.

Background technique

With the rapid development of the Internet, Internet-based social functions are more colorful, such as instant messaging. At the same time, the rise of smart hardware devices has increased the means to achieve social functions. In some occasions, such as sports or physical exercise, it is often the user's individual actions, resulting in a boring exercise or exercise, lack of real-time, three-dimensional interaction with other users.

Summary of the invention

In view of this, one of the technical problems to be solved by the embodiments of the present invention is to provide an augmented reality processing method, apparatus, and electronic device for overcoming or alleviating the defects in the prior art.

The embodiment of the present application provides a processing method for augmented reality, which includes:

Determining a current motion mode of the user, creating a virtual scene that adapts the current motion mode of the user;

Acquiring motion data of the user in the current sport mode and associating it into the virtual scene.

Optionally, in any embodiment of the present invention, determining the current motion mode of the user includes:

Determining a motion mode configuration item of a third party application local to the electronic terminal;

The current motion mode of the user is determined by the motion mode configuration item.

The current motion mode of the user is determined according to the video stream of the camera and tracking analysis of the actions of the user in the video stream.

Optionally, in any embodiment of the present invention, the camera is activated by a webpage end or a third party application installed locally through the electronic terminal to perform capturing of the video stream.

Optionally, in any embodiment of the present invention, if the camera is launched by using a webpage end, creating a virtual scenario that adapts the current motion mode of the user includes: creating, by using WEBGL, the current user of the user Virtual scene of the sport mode;

Alternatively, if the camera is launched for a third party application installed locally through the electronic terminal, a virtual scene adapted to the current motion mode of the user is created by OPENGL.

Optionally, in any embodiment of the present invention, determining a current motion mode of the user, and creating a virtual scenario that adapts the current motion mode of the user includes:

Determining a current motion pattern of a plurality of different users, creating a same virtual scene that adapts the current motion patterns of the plurality of different users.

Optionally, in any embodiment of the present invention, acquiring the motion data of the user in the current motion mode and associating the data into the virtual scene includes:

Obtaining motion data of the user in the current motion mode and loading it onto the model of the user in the virtual scene.

Determining a dynamic change of the current motion mode of the user and a change of the motion data caused thereby, or determining a dynamic change of the motion data of the user in the same current motion mode, and correlating the motion data in the virtual scene Perform real-time updates.

Optionally, in any embodiment of the present invention, determining the change in the motion data comprises tracking the current motion state of the user for the selected feature point and using the feature point similarity.

Optionally, in any embodiment of the present invention, tracking the current motion state of the user by using the feature point similarity for the selected feature point comprises: performing position prediction on the selected feature point, and adopting The feature point similarity tracks the current motion state of the user.

The embodiment of the invention further provides an augmented reality processing device, which includes:

a first module, configured to determine a current motion mode of the user, and create a virtual scenario that adapts the current motion mode of the user;

And a second module, configured to acquire motion data of the user in the current motion mode and associate it into the virtual scene.

Optionally, in any embodiment of the present invention, the first module is further configured to:

Optionally, in any embodiment of the present invention, the first module is further configured to: determine, according to a video stream of the camera, and perform tracking analysis on a motion of the user in the video stream, to determine a current motion mode of the user. .

Optionally, in any embodiment of the present invention, if the camera is started by using a webpage, the first module is further configured to create a virtual scenario that adapts a current motion mode of the user, including: by using WEBGL Creating a virtual scene that adapts to the current motion mode of the user;

Alternatively, if the camera is activated by a third party application installed locally through the electronic terminal, the first module is further configured to create a virtual scene that adapts the current motion mode of the user by using OPENGL.

Optionally, in any embodiment of the present invention, the first module is further configured to: determine a current motion mode of multiple different users, and create a same virtual scenario that adapts a current motion mode of the multiple different users. .

Optionally, in any embodiment of the present invention, the second module is further configured to acquire motion data of the user in a current motion mode and load the model on the model of the user in the virtual scene. .

Optionally, in any embodiment of the present invention, the second module is further configured to: determine a dynamic change of a current motion mode of the user and a change of the motion data caused thereby, or determine the user The dynamic change of the motion data in the same current motion mode, and the motion data associated with the virtual scene is updated in real time.

Optionally, in any embodiment of the present invention, the second module is further configured to track the current motion state of the user by using the feature point similarity for the selected feature point.

Optionally, in any embodiment of the present invention, the second module is further configured to perform position prediction on the selected feature points, and track the current motion state of the user by using the feature point similarity.

The embodiment of the invention further provides an electronic device, which includes a processor, and the processor is configured with a module that performs the following technical processing:

Used to determine a current motion mode of the user, and create a virtual scene that adapts the current motion mode of the user;

And used to acquire the motion data of the user in the current motion mode and associate it into the virtual scene.

In the following embodiments of the present invention, a virtual scene that adapts the current motion mode of the user is created by determining a current motion mode of the user; and the motion data of the user in the current motion mode is acquired and associated with the In the virtual scene, the augmented reality processing of the motion scene can be realized, and the user experience can also be improved.

DRAWINGS

Some specific embodiments of the embodiments of the present application will be described in detail, by way of example, and not limitation, The same reference numbers in the drawings identify the same or similar parts. Those skilled in the art should understand that the drawings are not necessarily drawn to scale. In the figure:

1 is a schematic flowchart of a processing method of an augmented reality according to Embodiment 1 of the present invention;

2 is a schematic structural diagram of a processing device for augmented reality according to Embodiment 2 of the present invention;

FIG. 3 is a schematic structural diagram of an electronic device according to Embodiment 3 of the present invention.

Detailed ways

Any technical solution for implementing the embodiments of the present invention necessarily does not necessarily need to achieve all of the above advantages at the same time.

For a better understanding of the technical solutions in the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. The embodiments are only a part of the embodiments of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art should be within the scope of protection of the embodiments of the present invention based on the embodiments in the embodiments of the present invention.

In the following embodiments of the present invention, a virtual scene that adapts the current motion mode of the user is created by determining a current motion mode of the user; and the motion data of the user in the current motion mode is acquired and associated with the In the virtual scene, the augmented reality processing of the motion scene is realized, and the user experience is improved.

1 is a schematic flowchart of a processing method of an augmented reality according to Embodiment 1 of the present invention; as shown in FIG. 1, the method includes the following steps S101 to S104:

S101. Determine a motion mode configuration item of a third-party application local to the electronic terminal.

In this embodiment, a third-party application local to the electronic terminal, for example, may be a sports application installed on the smart phone, and read a motion mode configuration item selected by the user on the motion application, thereby determining a motion mode configuration item. Different motion mode configuration items have different numerical definitions, and different motion configuration items are defined by numerical differences. Sports modes such as running, aerobics, walking, etc.

Alternatively, in other embodiments, if the acceleration sensor is disposed on the electronic terminal, the motion data generated by the acceleration sensor in different motion modes may be statistically determined, and the amplitude range and the frequency range of the acceleration sensor output data. For an electronic terminal equipped with an acceleration sensor, its local third-party application reads the data output by the acceleration sensor and matches the previously measured amplitude range and frequency range. If it matches, the motion is accordingly Configuration items are defined.

Specifically, the noise in the output data of the acceleration sensor may be filtered by median filtering or high-pass filtering, and then the feature values, such as the peak interval feature value or the maximum composite vector feature value, may be further extracted, thereby extracting the feature value according to the extracted feature value. The determination of the motion mode is performed to determine the motion mode configuration item.

Similar to the above method of determining the motion mode by the motion data, in other embodiments, the determination of the motion mode may also be performed according to the range of heart rate in different motion modes. The electronic device capable of determining the exercise mode using the heart rate can be a smart phone, a smart earphone, or a smart wristband. Of course, the above acceleration sensor based solution is also applicable to smart bracelets, smart headphones, and the like. In general, any electronic device capable of capturing user motion data, such as an acceleration sensor, may be used, including smart clothing.

S102. Determine a current motion mode of the user according to a video stream of the camera and perform tracking analysis on a motion of the user in the video stream.

In this embodiment, the camera may specifically be an existing camera on the smart terminal or an ordinary camera or a smart camera externally connected through a wired or wireless data interface (such as a USB interface or wifi or Bluetooth). As mentioned above, the smart terminal can be, but is not limited to, a smart phone, a smart bracelet, a smart headset, and the like.

In this embodiment, the augmented reality processing is implemented based on the webpage end, and the camera is activated by the webpage end to capture the video stream.

Specifically, when the webpage is started by the webpage to capture the video stream, the API of the webcam can be pulled up by the API: get User Media() in WebRTC (Web Real-Time Communication), and then the camera captures the video stream. In addition, you can pull up the camera's API via another API (Navigator get User Media). When you pull up the camera's API, you can also configure the camera's parameters, such as resolution.

In this embodiment, when the video stream is captured in step S102, the video stream is divided into multiple frames of static pictures, and then each frame picture is compared with the background model according to the background model established for different motion scenes, if two The pixel difference between the two is greater than the set threshold, and the corresponding pixel belongs to the moving target, that is, the user who is in motion. Specifically, the background model may be an average of the previous plurality of still picture pixels in the video stream.

Alternatively, in other embodiments, the moving target may also be determined by thresholding processing based on the pixel difference value between adjacent frames, for example, if the pixel difference value is greater than a set threshold, the set variable is assigned 1, otherwise assigned a value of 0, thereby achieving thresholding.

After the moving target (ie, the user) is determined according to the background model or the difference between adjacent inter-frame pixels, the motion of the moving target is tracked and analyzed. Specifically, a plurality of feature points selected by the moving target positioned on the image may be selected, and the feature points may correspond to the arms and legs of the user's body, thereby tracking and analyzing the user actions by tracking the feature points. Further, the feature points are further matched based on a color histogram or a contour or a template, thereby implementing tracking and analysis of user actions.

In this embodiment, in order to analyze the user action, motion templates with different motion modes, such as running, aerobics, etc., are established in advance. For example, through the analysis of the user's body movements during running and aerobics, the motion template is established. When running, the left and right arms are staggered back and forth, and the corresponding feature points are changed in the image on the image. Therefore, the action template is adopted. The same feature points are matched to achieve the analysis of the motion action.

S103. Create, by using WEBGL, a virtual scenario that adapts a current motion mode of the user.

In this embodiment, for example, if there are two users A and B, the user A activates the camera on the smart terminal to perform the shooting of the video stream, and the user B moves in another place, and the user B needs to be performed. Synthesized into the scene where A moves.

In this embodiment, specifically, the image of the user B and its motion action are added to the real-time video stream corresponding to the user A, and are presented locally in the user A, thereby providing the user A and the B with a same motion scene. The experience of exercising in the middle. For another example, the image of the user A and its motion action may be added to the real-time video stream corresponding to the user B, and presented in the user B local.

To this end, in order to realize the creation of the above-mentioned virtual scene, in this embodiment, the creation and rendering of the three-dimensional model can be specifically performed through WEBGL. WEBGL-based model creation and rendering includes: creating an H5 canvas canvas to define the drawing area, and then drawing a 3D model in the canvas through JavaScript embedded GLSL ES, which includes the creation of the shader in detail, and attaches the shader to the Shader object, and then Finish rendering.

S104. Acquire motion data of the user in a current motion mode and associate it into the virtual scene.

In this embodiment, the creation of the virtual scene is completed by the above step S102, and the virtual object model is created in the virtual scene. Therefore, in this embodiment, the motion data of the user in the current motion mode is associated with the virtual The virtual object model in the scene can be implemented. In addition, when the foregoing is associated with the virtual scene, the motion data associated with the virtual scene may be updated in real time according to the continuous real-time change of the user motion data.

It should be noted that, in other embodiments, the motion data of multiple users may be associated with the same virtual scene, where the virtual scene may be a scene in which one user actually performs motion, and for other users, a virtual scene, It can also be a completely virtual scene for all users.

Corresponding to the above step S102, determining a current motion mode of a plurality of different users, and creating the same virtual scene that adapts the current motion modes of the plurality of different users.

In this embodiment, when the motion data is associated with the virtual scene, the corresponding motion data is associated with the location corresponding to the virtual object model, for example, the motion of the arm is associated with the arm of the virtual object model. In order to realize the association of the action data to the corresponding part of the virtual object model, when the actual motion data of the user is acquired, the relationship between the actual motion data and the moving part of the user body is established, and the moving part of the user body is further associated with the moving part of the virtual object model. Thereby, the dynamic association of the actual motion data to the corresponding part of the virtual object model is realized. Corresponding to determining a dynamic change of the current motion mode of the user and a change of the motion data caused thereby, or determining a dynamic change of the motion data of the user in the same current motion mode, associated with the virtual scene The motion data is updated in real time.

It should be noted that the association between the motion data and the motion part may be distinguished by establishing an identifier, and the motion data of different parts has different header identifiers.

It should be noted that, when determining the change of the motion data, the current motion state of the user may also be tracked only for the selected feature points and using the feature point similarity. Specifically, tracking the current feature state of the user by using the feature point similarity by using the feature point similarity includes: performing position prediction on the selected feature point, and using the similarity of the feature point to the current motion of the user Status is tracked.

In another embodiment, if the camera is launched for a third party application installed locally by the electronic terminal, a virtual scene adapted to the current motion mode of the user is created by OPENGL.

2 is a schematic structural diagram of a processing device for augmented reality according to Embodiment 2 of the present invention; as shown in FIG. 2, it includes:

The first module 201 is configured to determine a current motion mode of the user, and create a virtual scenario that adapts the current motion mode of the user;

The second module 202 is configured to acquire motion data of the user in the current motion mode and associate it into the virtual scene.

Optionally, in any embodiment of the present invention, the first module 201 is further configured to:

Optionally, in any embodiment of the present invention, the first module 201 is further configured to: determine, according to a video stream of the camera, and perform tracking analysis on a motion of the user in the video stream, to determine a current motion of the user. mode.

Optionally, in any embodiment of the present invention, if the camera is activated by using a webpage, the first module 201 is further configured to create a virtual scenario that adapts a current motion mode of the user, including: WEBGL creates a virtual scene that adapts to the current motion mode of the user;

Alternatively, if the camera is activated by a third-party application installed locally through the electronic terminal, the first module 201 is further configured to create a virtual scene that adapts the current motion mode of the user through the OPENGL.

Optionally, in any embodiment of the present invention, the first module 201 is further configured to: determine a current motion mode of multiple different users, and create a same virtual virtual current mode that is adapted to the multiple different users. Scenes.

Optionally, in any embodiment of the present invention, the second module 202 is further configured to acquire motion data of the user in a current motion mode and load the model into the user in the virtual scene. on.

Optionally, in any embodiment of the present invention, the second module 202 is further configured to: determine a dynamic change of a current motion mode of the user and a change of the motion data caused thereby, or determine the The user dynamically updates the motion data associated with the virtual scene in the same current motion mode.

Optionally, in any embodiment of the present invention, the second module 202 is further configured to track the current motion state of the user by using the feature point similarity for the selected feature points.

Optionally, in any embodiment of the present invention, the second module 202 is further configured to perform position prediction on the selected feature points, and track the current motion state of the user by using the feature point similarity.

It should be noted that, in the foregoing embodiment of FIG. 2, the first module and the second module may be multiplexed with each other. For this reason, in the embodiment of FIG. 2, the number of actual modules may be less than two.

In addition, the first module and the second module may be based on a distributed arrangement, for example, some modules are located at the front end, and some modules are located at the back end.

3 is a schematic structural diagram of an electronic device according to Embodiment 3 of the present invention; as shown in FIG. 3, it includes a processor 301, and the processor is configured with a program module 302 that performs the following technical processing:

In this embodiment, the program module 302 may include the foregoing first module and the second module performing relatively independent functions, or only one module may perform all the above functions.

In this embodiment, the electronic device may include, but is not limited to, a smart phone, a smart bracelet, a smart headset, and the like.

The embodiment of the present application further provides a storage medium, where the instruction for executing the function of the program module 302 is stored.

Throughout the specification, "one embodiment" means that a particular feature, structure, configuration, or feature described in this embodiment is included in at least one embodiment of the invention. Thus, the appearance of the phrase "in one embodiment", "the" Furthermore, the particular features, structures, configurations, or characteristics may be combined in any suitable manner in one or more embodiments.

The terms "generating," "in," "in," "in," and "in" as used herein may refer to the relative position relative to another layer. One layer "generates", "is", or "at" another layer or another layer that may be in direct contact with another layer or may have one or more intervening layers. A layer "on" layer may be in direct contact with the layer or may have one or more intervening layers.

Before the following detailed description, the definitions of certain words and phrases used throughout this patent document may be useful: the terms "include" and "comprise" and variations thereof mean The term "or" is inclusive, meaning and/or; the phrase "associated with" and "associated therewith" and variations thereof may be meant to include , included, "connected with", included, included, "connected to" or "connected to", "coupled to" or "coupled with", "communicable with" "cooperating with", interlaced, juxtaposed, close to, "constrained to" or "constrained with", possessed, "having a property of", etc.; and the term "controller" means controlling at least one operation Any device, system or component thereof, such device may be implemented in hardware, firmware or software, or in some combination of at least two of hardware, firmware and software. It should be noted that the functionality associated with any particular controller may be centralized or distributed locally or remotely. The definitions of certain words and phrases are provided throughout this patent document, and those skilled in the art will appreciate that in many cases, if not the most cases, such definitions apply to the prior art and to the words so defined. And the future use of phrases.

In the present disclosure, the expression "include" or "may include" refers to the existence of the corresponding function, operation or element, and does not limit one or more additional functions, operations or elements. In the present disclosure, terms such as "include" and / or "have" are understood to mean certain features, numbers, steps, operations, components, elements or combinations thereof, and are not to be construed as being excluded. The existence or additional possibility of one or more other characteristics, numbers, steps, operations, constituent elements, elements or combinations thereof.

In the present disclosure, the expression "A or B", "at least one of A or / and B" or "one or more of A or / and B" may include all possible combinations of the listed items. For example, the expression "A or B", "at least one of A and B" or "at least one of A or B" may include: (1) at least one A, (2) at least one B, or (3) at least One A and at least one B.

The expression "first", "second", "the first" or "the second" as used in the various embodiments of the present disclosure may modify various components regardless of order and/or importance. , but these statements do not limit the corresponding components. The above statements are only used for the purpose of distinguishing components from other components. For example, the first user device and the second user device represent different user devices, although both are user devices. For example, a first element could be termed a second element, and a second element could be termed a first element, without departing from the scope of the disclosure.

When an element (eg, a first element) is referred to as being "operably or communicably coupled" or "operably or communicably" coupled to another element (eg, a second element) An element (e.g., a second element) or "connected to" another element (e.g., a second element) is understood to mean that the one element is directly connected to the other element or the one element is via the other element (e.g., The third component is indirectly connected to the other component. Rather, it will be understood that when an element (e.g., a first element) is referred to as "directly connected" or "directly connected" to another element (the second element), then no element (e.g., the third element) is inserted in either Between the people.

The expression "configured to" as used herein may be used interchangeably with the following expressions: "suitable to", "capable of having", "designed as", "suitable", "manufactured as" or "capable of being able to" ". The phrase "configured to" does not necessarily mean "designed specifically" on hardware. Alternatively, in some cases, the expression "a device configured as" may mean that the device "can..." with other devices or components. For example, the phrase "a processor adapted to (or configured to) perform A, B, and C" may mean a dedicated processor (eg, an embedded processor) for performing only the corresponding operations or may be stored in the storage device by execution A general purpose processor (eg, a central processing unit (CPU) or an application processor (AP)) in which one or more software programs perform corresponding operations.

The device embodiments described above are merely illustrative, wherein the modules described as separate components may or may not be physically separate, and the components displayed as modules may or may not be physical modules, ie may be located A place, or it can be distributed to multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware. Based on such an understanding, portions of the above technical solutions that contribute substantially or to the prior art may be embodied in the form of a software product that may be stored in a computer readable storage medium, the computer readable record The medium includes any mechanism for storing or transmitting information in a form readable by a computer (eg, a computer). For example, a machine-readable medium includes read only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash storage media, electrical, optical, acoustic, or other forms of propagation signals (eg, carrier waves) , an infrared signal, a digital signal, etc., etc., the computer software product comprising instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the various embodiments or portions of the embodiments described Methods.

Finally, it should be noted that the above embodiments are only used to explain the technical solutions of the embodiments of the present application, and are not limited thereto; although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that The technical solutions described in the foregoing embodiments may be modified, or some of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the spirit of the technical solutions of the embodiments of the present application. range.

Those skilled in the art will appreciate that embodiments of the embodiments of the invention may be provided as a method, apparatus (device), or computer program product. Thus, embodiments of the invention may be in the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, embodiments of the invention may take the form of a computer program product embodied on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

Embodiments of the invention are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus, and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Claims

An augmented reality processing method, comprising:

Determining a current motion mode of the user, creating a virtual scene that adapts the current motion mode of the user;

Acquiring motion data of the user in the current sport mode and associating it into the virtual scene.
The method of claim 1 wherein determining the current mode of motion of the user comprises:

Determining a motion mode configuration item of a third party application local to the electronic terminal;

The current motion mode of the user is determined by the motion mode configuration item.
The method according to claim 1 or 2, wherein determining the current motion mode of the user comprises:

The current motion mode of the user is determined according to the video stream of the camera and tracking analysis of the actions of the user in the video stream.
The method according to any one of claims 1-3, wherein the camera is activated by a webpage or by a third party application installed locally by the electronic terminal to perform capture of the video stream.
The method according to any one of claims 1 to 4, wherein if the camera is activated by a webpage, creating a virtual scene that adapts the current motion mode of the user comprises: creating an adaptation by WEBGL a virtual scene of the current motion mode of the user;

Alternatively, if the camera is launched for a third party application installed locally through the electronic terminal, a virtual scene adapted to the current motion mode of the user is created by OPENGL.
The method according to any one of claims 1 to 5, wherein determining a current motion mode of the user and creating a virtual scene that adapts the current motion mode of the user comprises:

Determining a current motion pattern of a plurality of different users, creating a same virtual scene that adapts the current motion patterns of the plurality of different users.
The method according to any one of claims 1-6, wherein acquiring the motion data of the user in the current motion mode and associating it with the virtual scene comprises:

The motion data of the user in the current sport mode is obtained and loaded onto the model of the user in the virtual scene.
The method according to any one of claims 1 to 7, wherein acquiring the motion data of the user in the current motion mode and associating it with the virtual scene comprises:

Determining a dynamic change of the current motion mode of the user and a change of the motion data caused thereby, or determining a dynamic change of the motion data of the user in the same current motion mode, and correlating the motion data in the virtual scene Perform real-time updates.
The method according to any one of claims 1-8, wherein determining the change in the motion data comprises tracking the current motion state of the user for the selected feature point and using the feature point similarity.
The method according to any one of claims 1 to 9, wherein tracking the current motion state of the user with the selected feature point and using the feature point similarity comprises: performing the selected feature point Position prediction, and tracking the current motion state of the user by using feature point similarity.
An augmented reality processing device, comprising:

a first module, configured to determine a current motion mode of the user, and create a virtual scenario that adapts the current motion mode of the user;

And a second module, configured to acquire motion data of the user in a current motion mode and associate it into the virtual scene.
The apparatus according to claim 11, wherein said first module is further configured to:

Determining a motion mode configuration item of a third party application local to the electronic terminal;

The current motion mode of the user is determined by the motion mode configuration item.
The device according to claim 11 or 12, wherein the first module is further configured to: determine a current motion of the user according to a video stream of the camera and perform tracking analysis on a motion of the user in the video stream. mode.
The apparatus according to any one of claims 11 to 13, wherein the camera is activated by a webpage or by a third party application installed locally by the electronic terminal to perform capture of the video stream.
The apparatus according to any one of claims 11-14, wherein the first module is further configured to create a virtual adaptation of a current motion mode of the user if the camera is activated by a webpage end The scenario includes: creating, by the WEBGL, a virtual scene that adapts the current motion mode of the user;

Alternatively, if the camera is activated by a third party application installed locally through the electronic terminal, the first module is further configured to create a virtual scene that adapts the current motion mode of the user by using OPENGL.
The apparatus according to any one of claims 11 to 15, wherein the first module is further configured to: determine a current motion pattern of a plurality of different users, and create a current motion that adapts the plurality of different users The same virtual scene of the pattern.
The apparatus according to any one of claims 11 to 16, wherein the second module is further configured to acquire motion data of the user in a current motion mode and load the user to the virtual On the model in the scene.
The apparatus according to any one of claims 11-17, wherein the second module is further configured to: determine a dynamic change of a current motion pattern of the user and a change in motion data caused thereby, or And determining a dynamic change of the motion data of the user in the same current motion mode, and performing real-time update on the motion data associated with the virtual scene.
Apparatus according to any one of claims 11-18, wherein the second module is further for tracking a selected feature point and using a feature point similarity to track the current motion state of the user.
The apparatus according to any one of claims 11 to 19, wherein the second module is further configured to perform position prediction on the selected feature points and to use the similarity of the feature points to the current motion of the user Status is tracked.
An electronic device, comprising: a processor, wherein the processor is configured with a module that performs the following technical processing:

Used to determine a current motion mode of the user, and create a virtual scene that adapts the current motion mode of the user;

And used to acquire the motion data of the user in the current motion mode and associate it into the virtual scene.