CN117095023A

CN117095023A - Intelligent teaching method and device based on AR technology

Info

Publication number: CN117095023A
Application number: CN202311332399.9A
Authority: CN
Inventors: 高峰; 曹红雨
Original assignee: Langfang Zhenguigu Technology Co ltd; Tianjin Pinming Technology Co ltd
Current assignee: Langfang Zhenguigu Technology Co ltd; Tianjin Pinming Technology Co ltd
Priority date: 2023-10-16
Filing date: 2023-10-16
Publication date: 2023-11-21
Anticipated expiration: 2043-10-16
Also published as: CN117095023B

Abstract

The invention relates to the technical field of data processing, and discloses an intelligent teaching method and device based on an AR technology. The invention can set the service data of the service robot according to the real-time ball movement track, thereby realizing the intelligent control of the service robot and effectively improving the teaching quality and the teaching efficiency.

Description

Intelligent teaching method and device based on AR technology

Technical Field

The invention relates to the technical field of data processing, in particular to an intelligent teaching method and device based on an AR technology.

Background

Augmented reality (Augmented Reality, AR for short), which is a technology for calculating the position and angle of a camera image in real time and adding a corresponding image, is a new technology for integrating real world information and virtual world information in a 'seamless' manner, and aims to fit the virtual world around the real world on a screen and interact with the real world. Therefore, the AR technology is applied to daily teaching, the teaching effect can be effectively improved, the current ball games are deeply favored by wide sports enthusiasts, and meanwhile, the ball games have the advantages of fine requirements, high speed, various changes and the like, so that the ball games are popular in schools, and are important contents of school sports teaching. The physical training competition process often comprises massive real-time data, and through mining and analyzing the data, actual combat skills can be mastered efficiently and quickly, and a targeted training plan and combat strategies can be formulated according to the actual combat skills.

In sports training, in order to better implement training plans and combat strategies, a service robot is generally adopted to enable players to train for a long time without throwing balls by a service player, for example, a badminton service robot, a tennis service robot and the like, however, the traditional service robot is completely dependent on manual processing of professionals such as a coach and the like, and based on-site manual adjustment, the service robot has heavy tasks and low dimension, cannot accurately set and process service data of the service robot, and seriously reduces teaching quality and teaching efficiency.

Therefore, how to provide an intelligent teaching method and device based on AR technology is a technical problem to be solved at present.

Disclosure of Invention

The embodiment of the invention provides an intelligent teaching method and device based on an AR technology, which are used for solving the technical problems that in the prior art, intelligent control cannot be performed on a service robot according to training data, and the teaching quality cannot be improved.

In order to achieve the above object, the present invention provides an intelligent teaching method based on AR technology, the method comprising:

determining a target shooting area, shooting a first moving image based on the target shooting area, and shooting a plurality of images to be synthesized in a preset time;

Image synthesis is carried out on a plurality of images to be synthesized and the first moving image so as to generate a real-time ball motion track;

judging whether the real-time ball motion trail accords with a preset ball motion trail,

if yes, not controlling the ball dispenser;

if not, setting working state data of the ball dispenser according to the ball movement track;

and controlling the service robot based on the working state data.

In one embodiment, when image-compositing a plurality of images to be composited and the first moving image to generate a real-time ball game track, the method includes:

sequencing a plurality of images to be synthesized based on a shooting time node, and generating a first image set;

sequentially carrying out image analysis on images to be synthesized in the first image set to obtain a termination image in the first image set;

generating a second image set according to the termination image and an image to be synthesized before the termination image;

generating a third image set according to the images to be synthesized after the termination image;

and deleting the third image set, and generating the real-time ball motion trail according to the second image set and the first motion image.

In one embodiment, when setting the working state data of the service robot according to the ball motion track and the preset ball motion track, the method includes:

mapping the real-time ball motion trail to a pre-constructed coordinate graph to obtain a real-time ball motion trail line graph;

determining the highest point of the real-time ball motion track based on the real-time ball motion track line diagram, and determining a motion value A corresponding to the highest point;

and setting a ball serving angle and a ball serving speed of the ball serving machine according to the motion value A.

In one embodiment, when setting the launch angle and the launch speed of the launch machine according to the motion value a, the method includes:

presetting a motion value matrix B, and setting B (B1, B2, B3 and B4), wherein B1 is a first preset motion value, B2 is a second preset motion value, B3 is a third preset motion value, B4 is a fourth preset motion value, and B1 is more than B2 and less than B3 and less than B4;

presetting a ball serving angle matrix C of a ball serving machine, and setting C (C1, C2, C3, C4 and C5), wherein C1 is a first preset ball serving angle, C2 is a second preset ball serving angle, C3 is a third preset ball serving angle, C4 is a fourth preset ball serving angle, C5 is a fifth preset ball serving angle, and C1 is more than C2, C3 is more than C4 and less than C5;

Presetting a ball serving speed matrix D of a ball serving machine, and setting D (D1, D2, D3, D4 and D5), wherein D1 is a first preset ball serving speed, D2 is a second preset ball serving speed, D3 is a third preset ball serving speed, D4 is a fourth preset ball serving speed, D5 is a fifth preset ball serving speed, and D1 is more than D2 and less than D3 and less than D4 and less than D5;

setting a ball serving angle and a ball serving speed of the ball serving machine according to the relation between the motion value A and each preset motion value:

when A is smaller than B1, selecting the first preset ball serving angle C1 as a ball serving angle of the ball serving machine, and selecting the first preset ball serving speed D1 as a ball serving speed of the ball serving machine;

when B1 is less than or equal to A and less than B2, selecting the second preset ball serving angle C2 as a ball serving angle of the ball serving machine, and selecting the second preset ball serving speed D2 as a ball serving speed of the ball serving machine;

when B2 is less than or equal to A and less than B3, selecting the third preset ball serving angle C3 as a ball serving angle of the ball serving machine, and selecting the third preset ball serving speed D3 as a ball serving speed of the ball serving machine;

when B3 is less than or equal to A and less than B4, selecting the fourth preset ball serving angle C4 as a ball serving angle of the ball serving machine, and selecting the fourth preset ball serving speed D4 as a ball serving speed of the ball serving machine;

And when B4 is less than or equal to A, selecting the fifth preset ball serving angle C5 as a ball serving angle of the ball serving machine, and selecting the fifth preset ball serving speed D5 as a ball serving speed of the ball serving machine.

In one embodiment, after setting the launch angle and the launch speed of the ball dispenser according to the motion value a, the method further includes:

determining a first endpoint and a second endpoint on the real-time ball movement track line graph, and determining a distance value d between the first endpoint and the second endpoint;

and correcting the ball-serving angle and the ball-serving speed of the ball-serving machine according to the distance value d.

In one embodiment, when correcting the ball serving angle and the ball serving speed of the ball serving machine according to the distance value d, the method includes:

a preset distance value matrix G, setting G (G1, G2, G3 and G4), wherein G1 is a first preset distance value, G2 is a second preset distance value, G3 is a third preset distance value, G4 is a fourth preset distance value, and G1 is more than G2 and less than G3 and less than G4;

setting a ball serving angle correction coefficient matrix h of a preset ball serving machine, and setting h (h 1, h2, h3, h4 and h 5), wherein h1 is a first preset ball serving angle correction coefficient, h2 is a second preset ball serving angle correction coefficient, h3 is a third preset ball serving angle correction coefficient, h4 is a fourth preset ball serving angle correction coefficient, h5 is a fifth preset ball serving angle correction coefficient, and h1 is more than 0.8 and less than h2, h3 and less than h4 and less than h5 and less than 1.2;

Setting a ball serving speed correction coefficient matrix y of a preset ball serving machine, and setting y (y 1, y2, y3, y4 and y 5), wherein y1 is a first preset ball serving speed correction coefficient, y2 is a second preset ball serving speed correction coefficient, y3 is a third preset ball serving speed correction coefficient, y4 is a fourth preset ball serving speed correction coefficient, y5 is a fifth preset ball serving speed correction coefficient, and y1 is more than 0.8 and less than y2 and y3 and y4 is more than 0 and less than y5 and less than 1.2;

when the service angle and the service speed of the service machine are respectively set as an i-th preset service angle Ci and an i-th preset service speed Di, i=1, 2,3,4,5, and the service angle and the service speed of the service machine are corrected according to the relation between the distance value d and each preset distance value:

when d is smaller than G1, the first preset ball-serving angle correction coefficient h1 is selected to correct the ith preset ball-serving angle Ci, the ball-serving angle of the corrected ball-serving machine is Cixh 1, the first preset ball-serving speed correction coefficient y1 is selected to correct the ith preset ball-serving speed Di, and the ball-serving speed of the corrected ball-serving machine is Dixy 1;

when G1 is less than or equal to d and less than G2, the second preset ball-serving angle correction coefficient h2 is selected to correct the ith preset ball-serving angle Ci, the ball-serving angle of the corrected ball-serving machine is Cixh 2, the second preset ball-serving speed correction coefficient y2 is selected to correct the ith preset ball-serving speed Di, and the ball-serving speed of the corrected ball-serving machine is Dixy 2;

When G2 is less than or equal to d and less than G3, the third preset ball serving angle correction coefficient h3 is selected to correct the ith preset ball serving angle Ci, the ball serving angle of the corrected ball serving machine is Cixh 3, the third preset ball serving speed correction coefficient y3 is selected to correct the ith preset ball serving speed Di, and the ball serving speed of the corrected ball serving machine is Dixy 3;

when G3 is less than or equal to d and less than G4, the fourth preset ball serving angle correction coefficient h4 is selected to correct the ith preset ball serving angle Ci, the ball serving angle of the corrected ball serving machine is Cixh 4, the fourth preset ball serving speed correction coefficient y4 is selected to correct the ith preset ball serving speed Di, and the ball serving speed of the corrected ball serving machine is Dixy 4;

when G4 is less than or equal to d, the fifth preset ball-serving angle correction coefficient h5 is selected to correct the ith preset ball-serving angle Ci, the ball-serving angle of the corrected ball-serving machine is Cixh 5, the fifth preset ball-serving speed correction coefficient y5 is selected to correct the ith preset ball-serving speed Di, and the ball-serving speed of the corrected ball-serving machine is Dixy 5.

In one embodiment, after controlling the service robot based on the operating state data, the method further comprises:

Acquiring a service frequency P of the service robot;

acquiring current sign data of a ball receiver, and calculating a fatigue degree value W of the ball receiver according to the current sign data, wherein the current sign data are heart rate indexes of the ball receiver, the number of lost balls of the ball receiver and training time of the ball receiver;

and adjusting the service frequency P of the service robot according to the fatigue degree value W.

acquiring a service frequency P of the service robot;

In one embodiment, when adjusting the service frequency P of the service robot according to the fatigue degree value W, the method includes:

presetting a fatigue degree value matrix R, and setting R (R1, R2, R3 and R4), wherein R1 is a first preset fatigue degree value, R2 is a second preset fatigue degree value, R3 is a third preset fatigue degree value, R4 is a fourth preset fatigue degree value, and R1 is more than R2 and less than R3 and less than R4;

Setting a matrix n of ball serving frequency adjustment coefficients of a preset ball serving machine, wherein n (n 1, n2, n3, n4, n 5) is set, n1 is a first preset ball serving frequency adjustment coefficient, n2 is a second preset ball serving frequency adjustment coefficient, n3 is a third preset ball serving frequency adjustment coefficient, n4 is a fourth preset ball serving frequency adjustment coefficient, n5 is a fifth preset ball serving frequency adjustment coefficient, and n1 is more than 0.7 and less than n2 and n3 and n4 and less than n5 and less than 1;

adjusting the service frequency P of the service robot according to the relation between the fatigue degree value W and each preset fatigue degree value:

when W is smaller than R1, selecting the first preset service frequency adjusting coefficient n1 to adjust the service frequency P of the service machine, wherein the service frequency of the service machine after adjustment is P multiplied by n1;

when R1 is less than or equal to W and less than R2, selecting the second preset service frequency adjusting coefficient n2 to adjust the service frequency P of the service machine, wherein the service frequency of the service machine after adjustment is P multiplied by n2;

when R2 is less than or equal to W and less than R3, selecting the third preset service frequency adjusting coefficient n3 to adjust the service frequency P of the service machine, wherein the service frequency of the service machine after adjustment is P multiplied by n3;

when R3 is less than or equal to W and less than R4, selecting the fourth preset service frequency adjusting coefficient n4 to adjust the service frequency P of the service machine, wherein the service frequency of the service machine after adjustment is P multiplied by n4;

And when R4 is less than or equal to W, selecting the fifth preset service frequency adjusting coefficient n5 to adjust the service frequency P of the service machine, wherein the service frequency of the service machine after adjustment is P multiplied by n5.

In order to achieve the above object, the present invention provides an intelligent teaching device based on AR technology, using an intelligent teaching method based on AR technology as described in any one of the above, the device comprising:

the shooting module is used for determining a target shooting area, shooting a first moving image based on the target shooting area and shooting a plurality of images to be synthesized within preset time;

the generation module is connected with the shooting module and is used for carrying out image synthesis on a plurality of images to be synthesized and the first moving image so as to generate a real-time ball movement track;

the judging module is connected with the generating module and is used for judging whether the real-time ball motion trail accords with a preset ball motion trail or not, and if yes, the ball dispenser is not controlled; if not, setting working state data of the ball dispenser according to the ball movement track;

and the control module is connected with the judging module and used for controlling the service robot based on the working state data.

The invention provides an intelligent teaching method and device based on an AR technology, which has the following beneficial effects compared with the prior art:

the invention discloses an intelligent teaching method and device based on an AR technology, which are characterized in that a target shooting area is determined, a first moving image is shot based on the target shooting area, a plurality of images to be synthesized are shot in a preset time, the images to be synthesized and the first moving image are synthesized to generate a real-time ball motion track, whether the real-time ball motion track accords with the preset ball motion track is judged, if yes, a ball dispenser is not controlled, if not, working state data of the ball dispenser is set according to the ball motion track, and the ball dispenser is controlled based on the working state data. The invention can set the service data of the service robot according to the real-time ball movement track, thereby realizing the intelligent control of the service robot and effectively improving the teaching quality and the teaching efficiency.

Drawings

FIG. 1 shows a schematic flow chart of an intelligent teaching method based on AR technology in an embodiment of the invention;

FIG. 2 illustrates a real-time ball game trajectory ray diagram in an embodiment of the invention;

fig. 3 shows a schematic structural diagram of an intelligent teaching device based on AR technology in an embodiment of the present invention.

Detailed Description

The following describes in further detail the embodiments of the present application with reference to the drawings and examples. The following examples are illustrative of the application and are not intended to limit the scope of the application.

In the description of the present application, it should be understood that the terms "center," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like indicate orientations or positional relationships based on the orientation or positional relationships shown in the drawings, merely to facilitate describing the present application and simplify the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present application.

The terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present application, unless otherwise indicated, the meaning of "a plurality" is two or more.

In the description of the present application, it should be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present application will be understood in specific cases by those of ordinary skill in the art.

The following is a description of preferred embodiments of the application, taken in conjunction with the accompanying drawings.

As shown in fig. 1, an embodiment of the present application discloses an intelligent teaching method based on AR technology, which includes:

s110: determining a target shooting area, shooting a first moving image based on the target shooting area, and shooting a plurality of images to be synthesized in a preset time;

s120: image synthesis is carried out on a plurality of images to be synthesized and the first moving image so as to generate a real-time ball motion track;

in some embodiments of the present application, when image-compositing a plurality of images to be composited and the first moving image to generate a real-time ball game track, the method includes:

In the embodiment, shooting is performed on a target shooting area based on the shooting equipment, the shooting area is sent to a computer host, and the computer host operates AR equipment to analyze a received image;

in this embodiment, the first moving image refers to a start image, that is, an image of a service robot during service;

in this embodiment, the shooting time node may be set according to the actual situation, and if the preset time is 10 seconds, the shooting time node may be 2 seconds;

in this embodiment, the termination image refers to an image when the emitted sphere falls on the ground;

in this embodiment, when a second image set is generated according to the termination image and the image to be synthesized before the termination image, if 5 images are shot altogether, the termination image is the 3 rd image, and the second image set includes the 1 st image, the 2 nd image and the termination image;

The beneficial effects of the technical scheme are as follows: according to the application, the movement track of the ball body can be accurately determined through the shooting equipment and the AR equipment, so that a reliable judgment basis can be provided for judging whether the current ball movement track accords with the preset ball movement track.

S130: judging whether the real-time ball motion trail accords with a preset ball motion trail,

if yes, not controlling the ball dispenser;

as shown in fig. 2, in some embodiments of the present application, when setting the working state data of the service robot according to the ball motion trajectory and the preset ball motion trajectory, the method includes:

In the embodiment, mapping a real-time ball motion track to a coordinate graph constructed in advance to obtain a real-time ball motion track line graph, and determining the highest point of the real-time ball motion track according to the real-time ball motion track line graph;

In this embodiment, the highest point (Y point in the figure) of the real-time ball motion trajectory refers to the highest point on the real-time ball motion trajectory line diagram;

the technical scheme has the beneficial effects that: when a certain tactic is required to be trained repeatedly, a fixed service point is required to be set so that a ball receiver can receive balls repeatedly, therefore, the application can enable the ball receiver to meet the preset service track every time the ball receiver plays balls by setting the service angle and the service speed of the ball receiver, meet the teaching requirement and improve the teaching quality.

In some embodiments of the present application, when setting a launch angle and a launch speed of the ball dispenser according to the motion value a, the method includes:

The technical scheme has the beneficial effects that: according to the relation between the motion value A and each preset motion value, the ball serving angle and the ball serving speed of the ball serving machine are set, and the ball serving angle and the ball serving speed of the ball serving machine are set, so that errors caused by manual setting can be avoided, ball serving data of the ball serving machine can be ensured, and further, the ball serving track of the ball serving machine can meet preset requirements.

In some embodiments of the present application, after setting the launch angle and the launch speed of the ball dispenser according to the motion value a, the method further includes:

In some embodiments of the present application, when correcting the ball serving angle and the ball serving speed of the ball serving machine according to the distance value d, the method includes:

In this embodiment, the first endpoint refers to a point corresponding to the first moving image on the real-time ball motion trajectory line graph, and the second endpoint refers to a point corresponding to the termination image on the real-time ball motion trajectory line graph;

the technical scheme has the beneficial effects that: when the ball serving angle and the ball serving speed of the ball serving machine are respectively set to be the i < th > preset ball serving angle Ci and the i < th > preset ball serving speed Di, i=1, 2,3,4,5, and the ball serving angle and the ball serving speed of the ball serving machine are corrected according to the relation between the distance value d and each preset distance value.

S140: and controlling the service robot based on the working state data.

In some embodiments of the application, after controlling the service robot based on the operational status data, further comprising:

acquiring a service frequency P of the service robot;

Calculating the fatigue level value of the ball receiver according to the following formula:

W=JⅩα+KⅩβ+MⅩr；

wherein, W is the fatigue degree value of the ball receiver, J is the heart rate index of the ball receiver, K is the number of lost balls of the ball receiver, M is the training time of the ball receiver, alpha, beta and r are coefficients, and alpha+beta+r=1.

In this embodiment, the service frequency P of the service machine refers to the service frequency P of the service machine when the service machine service the ball within a specified time, if the service machine service the ball 6 times within 30 seconds, the service frequency P is the service frequency 6 times;

in this embodiment, the number of lost balls refers to the number of balls that the ball receiver does not receive;

in some embodiments of the present application, adjusting the service frequency P of the service robot according to the fatigue level value W includes:

The beneficial effects of the technical scheme are as follows: according to the fatigue degree value W and the relation between the fatigue degree values, the ball serving frequency P of the ball serving machine is adjusted.

In order to further explain the technical idea of the application, the technical scheme of the application is described with specific application scenarios.

Correspondingly, as shown in fig. 3, the application also provides an intelligent teaching device based on the AR technology, which comprises:

In the description of the above embodiments, particular features, structures, materials, or characteristics may be combined in any suitable manner in any one or more embodiments or examples.

Although the invention has been described hereinabove with reference to embodiments, various modifications thereof may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In particular, the features of the disclosed embodiments may be combined with each other in any manner as long as there is no structural conflict, and the entire description of these combinations is not made in the present specification merely for the sake of omitting the descriptions and saving resources. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed, but that the invention will include all embodiments falling within the scope of the appended claims.

Those of ordinary skill in the art will appreciate that: the above is only a preferred embodiment of the present invention, and the present invention is not limited thereto, but it is to be understood that the present invention is described in detail with reference to the foregoing embodiments, and modifications and equivalents of some of the technical features described in the foregoing embodiments may be made by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. An intelligent teaching method based on AR technology, which is characterized by comprising the following steps:

if yes, not controlling the ball dispenser;

and controlling the service robot based on the working state data.

2. The AR technology-based intelligent teaching method according to claim 1, wherein when image-compositing a plurality of images to be composited with the first moving image to generate a real-time ball motion trajectory, comprising:

3. The AR technology-based intelligent teaching method according to claim 1, wherein when setting the working state data of the ball dispenser according to the ball movement trajectory and the preset ball movement trajectory, comprising:

4. The AR technology-based intelligent teaching method according to claim 3, wherein when setting a ball serving angle and a ball serving speed of the ball serving machine according to the motion value a, comprising:

5. The AR technology-based intelligent teaching method according to claim 4, further comprising, after setting the launch angle and the launch speed of the launch machine according to the motion value a:

6. The AR technology-based intelligent teaching method according to claim 5, wherein when correcting the tee angle and tee speed of the tee machine according to the distance value d, comprising:

7. The AR technology-based intelligent teaching method according to claim 1, further comprising, after controlling the service robot based on the operating state data:

acquiring a service frequency P of the service robot;

8. The AR technology-based intelligent teaching method of claim 7,

；

9. The intelligent teaching method based on AR technology according to claim 8, wherein when adjusting the service frequency P of the service robot according to the fatigue degree value W, the method comprises:

10. An intelligent teaching apparatus based on AR technology, using the intelligent teaching method based on AR technology according to any one of claims 1-9, said apparatus comprising: