CN113903197A - Quilt folding teaching device and method for autistic children life education - Google Patents
Quilt folding teaching device and method for autistic children life education Download PDFInfo
- Publication number
- CN113903197A CN113903197A CN202111232127.2A CN202111232127A CN113903197A CN 113903197 A CN113903197 A CN 113903197A CN 202111232127 A CN202111232127 A CN 202111232127A CN 113903197 A CN113903197 A CN 113903197A
- Authority
- CN
- China
- Prior art keywords
- quilt
- stage
- teaching
- folding
- msg
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 230000008569 process Effects 0.000 claims abstract description 26
- 241000283973 Oryctolagus cuniculus Species 0.000 claims abstract description 8
- 208000020706 Autistic disease Diseases 0.000 claims description 39
- 206010003805 Autism Diseases 0.000 claims description 38
- 238000004088 simulation Methods 0.000 claims description 20
- 230000000694 effects Effects 0.000 claims description 10
- 238000001514 detection method Methods 0.000 claims description 9
- 238000004891 communication Methods 0.000 claims description 6
- 230000002787 reinforcement Effects 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 4
- 239000003086 colorant Substances 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims description 3
- 238000007689 inspection Methods 0.000 claims description 3
- 230000002093 peripheral effect Effects 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- 238000012216 screening Methods 0.000 claims description 3
- 238000012549 training Methods 0.000 abstract description 16
- 230000003993 interaction Effects 0.000 abstract description 4
- 238000012546 transfer Methods 0.000 abstract description 4
- 238000002474 experimental method Methods 0.000 description 8
- 238000004458 analytical method Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 3
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 3
- 208000012202 Pervasive developmental disease Diseases 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 208000029560 autism spectrum disease Diseases 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000009191 jumping Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000003997 social interaction Effects 0.000 description 2
- 241000112598 Pseudoblennius percoides Species 0.000 description 1
- 206010042008 Stereotypy Diseases 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000009098 adjuvant therapy Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000008131 children development Effects 0.000 description 1
- 208000030251 communication disease Diseases 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000035475 disorder Diseases 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000008140 language development Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/067—Combinations of audio and projected visual presentation, e.g. film, slides
Abstract
The invention belongs to the technical field of multimedia education, and discloses a quilt folding teaching device and method for autistic children life education based on desktop projection, wherein the teaching device comprises a computer, a projector, a camera, a tablet personal computer, a rabbit doll, a mini pillow with the size of 17X 13cm, a mini quilt with the size of 45X 25cm, a quilt (common size) with the size of 106X 72cm and a white-bottom desktop; the projector is connected with the computer and is used for displaying all animations related to the process; the camera is connected with the computer and used for carrying out image recognition in the formal teaching part and checking whether the result obtained in the step is correct or not. The desktop interaction mode adopted by the invention enables the autistic children to be more interested in the learning process; the teaching mode adopted in the first stage of the invention has performability; the training to practice method of the invention can help the autistic children to transfer knowledge.
Description
Technical Field
The invention belongs to the technical field of multimedia education, and particularly relates to a quilt folding teaching device and method for autistic children life education based on desktop projection.
Background
Autism (autism), also known as autism or autism disorder (autistic disorder), and the like, is a representative disease of Pervasive Developmental Disorder (PDD). The clinical manifestations are mainly three main types of core symptoms, namely: social interaction disorders, communication disorders, narrow interests, and stereotyped repetitive patterns of behavior. For the infant suffering from autism, the earlier the child performs rehabilitation training, the better the recovery effect of the life self-care and social interaction functions is. Of course, the training emphasis is different for different stages. Generally, the 2-6 years old is the key stage of rehabilitation training of the sick children, so that the training of the self-care ability of life, language development and correction of stereotypy behaviors can have a good effect, and after the 6 years old, the training is more emphasized on the training of social skills and the control of aggressive and dangerous behaviors. Therefore, the development and research of a device for effective intervention on autism is applied to the adjuvant therapy of autistic children as early as possible, so that the autistic children can not only acquire knowledge and skills through education as common children, but also grasp the ability of independent life and finally integrate into the society.
Education of life is a key goal for child development, and quilt folding among them is also an important skill that needs to be mastered by autistic children. However, for this part of learning, the conventional way is to teach by parents at home, because of life education, it is desirable to make children stand for practical operation to deepen impression after learning. For a special education institution, the special education institution is often not convenient to prepare at home, and the application scene is not real at home. Therefore, life education is generally completed by parents at home in early stage. The parents who are close contacts of the children with the autism for a long time are sensitive to the abnormal conditions of the children, seek medical advice in time, learn and learn some professional treatment methods, but some education methods are not suitable for the children with the autism due to the lack of practice in the early stage and the influence of other factors. For the study of the folded quilt, the traditional mode-simulation teaching can finally enable the child to learn through the parent's multi-turn teaching, but the process is generally boring. However, through the application of the electronic device, such as the study of cartoon, although the attention of children can be attracted, the children may be attracted by things except the study subject, so that the study target cannot be reached.
Through the above analysis, the problems and defects of the prior art are as follows:
(1) the quilt folding teaching is inconvenient for a special teaching organization to operate;
(2) aiming at quilt folding teaching, the traditional education mode makes the teaching process be boring and uninteresting, so that the learning of the autism children is more strenuous;
(3) the children can be attracted by things except for the learning theme by learning in a mode of watching the electronic screen, so that the children cannot reach the learning target;
the significance of solving the problems and the defects is as follows:
the method has the advantages that the interactivity is stronger in the mode of combining a real object with desktop projection, the mode of combining a story enables autism children to generate immersion, and the learning goal is achieved while the whole process feels pleasure. And through providing an autism children quilt folding teaching device, provide a new education visual angle for autism children's life education to can satisfy autism children's interest in learning and study demand more.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a quilt folding teaching device for autism children life education based on desktop projection.
The invention is realized in this way, a quilt folding teaching device of autism children's life education based on desktop projection includes:
the multifunctional toy comprises a computer, a projector, a camera, a tablet personal computer, a rabbit doll, a mini pillow with the size of 17 x 13cm, a mini quilt with the size of 45 x 25cm, a quilt with the size of 106 x 72cm and a white-bottom desktop.
The projector is connected with the computer and used for displaying all animations related to the process and helping the autistic children to finish the learning process of folding the quilt.
The camera is connected with the computer and used for carrying out image recognition in the formal teaching part and checking whether the result obtained in each step of overlaying quilt is correct.
The tablet computer is used for the formal teaching part, and before each step is carried out, a participant needs to watch demonstration animation of the step on the tablet computer and then carry out actual operation.
The rabbit doll, a mini pillow with the size of 17 × 13cm, a mini quilt with the size of 45 × 25cm and a quilt with the size of 106 × 72cm (common size) are objects actually operated in training of participants.
Further, the projector is connected with the computer through an HDMI interface.
Further, the camera is connected with the computer through a USB. After the camera position is fixed, an external camera is called in a Python identification script by utilizing an Opencv library function, and pictures shot by the camera are acquired frame by frame for identification.
Another objective of the present invention is to provide a quilt folding teaching method for autism children life education based on desktop projection, which comprises:
the first stage simulation is the first stage of guide of projection animation and sound effect. This phase guides the participants through the course by using a story, the approximate story line being: when the night comes, the little rabbit can sleep and needs the participant to cover the quilt. The next day, the sun rises and the bunny gets up, requiring the participants to help it fold the quilt. The process from laying out the mini quilt to folding the mini quilt is divided into 5 steps, and the participants need to repeat 2 rounds of learning according to the 5 steps. Before proceeding with each step, the participants need to view the demonstration animations of this step on the tablet, each animation being about 5 s. Then, the projector will project the specific folding direction and the folding part of the current step onto the mini quilt, and the participants need to fold the mini quilt according to the projection prompt. When the participants correctly complete the operation steps, the fireworks animation projected on the desktop gives encouragement. After completing the first phase, the participant may proceed to the second phase. The animation and sound effects related to the stage are collected by the computer, finished through the Unity game engine of the computer and played through the projector. When the child is overlaid with the sub-teaching part, the camera detects that the result presented by the step can be placed in the area with the specified size within the allowable error range every time the child completes the step, and the next step is carried out only when the result is correct. The specific identification part is completed through a Python language and an Opencv computer vision software library, the Python identifies the size of a square through color and shape, then calculates the distance between a quilt and a camera and the area of the quilt in a picture, then compares the calculated area with the area set in advance, and judges whether the mini quilt is successfully folded or not within a set error. Then through the C/S mode, communication between Python and unity3D is established, information is sent to unity3D, and if the participants finish the operation steps correctly, the firework special effect displayed is given to encouragement.
Specifically, the relevant core technical procedures are as follows:
python (identify image, send data):
inputting: video streaming (real-time camera capture)
And (3) outputting: a recognition result msg;
initializing information for storing data;
connected to unity3D using CS communication;
circularly acquiring each frame of image;
converting the RGB model into an HSV model;
screening according to target colors:
if the image value of the current pixel point is within the threshold value of the target color, the image value is maximized;
otherwise, the pixel point value is 0;
median filtering processing;
detecting the peripheral outline by pixel point value bitwise OR operation;
identified contour region size:
if the area size meets 1 st off, msg is 1;
if the area size is in accordance with 2 nd gate, msg is 2;
if the area size is in accordance with the 3 rd off, msg is equal to 3';
if the area size is in accordance with the 4 th gate, msg is 4;
if the area size is consistent with 5 th gate, msg is 5;
otherwise msg is empty;
ending, sending msg to Unity;
unity (receive data, switch level content)
Inputting: result of recognition msg
And (3) outputting: level contents
Judging msg:
if currently 1 st off, and msg is "1"; switching to the level 2;
if it is currently off 2, and msg is "2"; switching to the level 3;
if it is currently off 3, and msg is "3"; switching to the level 4;
if it is currently off 4, and msg is "4"; switching to the level 5;
if it is currently off 5, and msg is "5"; turning to the end animation;
otherwise, keeping the state unchanged;
and the second stage of simulation, namely, learning results of small mini quilt inspection participants are utilized. After the first stage is completed, the participants need to independently fold the mini-quilts by using the quilt folding method learned in the first stage without direct prompt. After 5 steps of folding the quilt are completed, the participant needs to put the folded mini quilt in a prompt box projected on a desktop and wait for a detection result of the device. When the participants correctly complete the operation steps, the fireworks animation projected on the desktop gives encouragement. The detection method used in the second stage is identical to the detection method used in the first stage. Participants will get some reinforcement as encouragement after completing the task.
And (3) simulating in the third stage, wherein the learning achievement of the participants is tested by using a quilt with a common size. In the stage, the participants are required to fold the quilts with the common sizes by using the method for folding the quilts learned in the first stage under the condition of no direct prompt. The participant is limited to completing the task within 3 minutes and if the participant appears to have forgotten or otherwise used a quilt folding method that is not the present teaching, the staff will again guide the participant back to the first stage for learning until the participant is able to complete the present stage. Participants will get some reinforcement as encouragement after completing the task.
It is a further object of the invention to provide a computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the fold sub-teaching method of desktop projection based autism childhood life education.
It is another object of the present invention to provide a computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to execute the fold sub-teaching method of the desktop projection-based autism children's life education.
By combining all the technical schemes, the invention has the advantages and positive effects that:
1. the desktop interaction mode utilized by the invention can make autistic children more pleasant in the learning process. Through analysis of video key frames of the experimental process, we found that 9 children showed positive emotions in the experimental process, and 4 children also had limb movements of clapping hands and jumping when completing the task. In addition, during the interview, parents explicitly mention their children's liking of the learning process, and the whole learning process, including the series training phase in the form of story telling, is very liked by the parents.
2. The teaching mode adopted in the first stage of the invention has performability. By viewing the first stage of the experimental video, we found that the child completed less time in the second round of the fold sub teaching than in the first round of the teaching (an average time usage reduction of 43.16%). In the second round of teaching process, 4 children can complete the task without watching the demonstration animation, 5 children need to watch the demonstration animation intermittently, and only 1 child with low functional autism needs the assistance of demonstrating the animation.
3. The training to practice approach utilized by the present invention can assist in the transfer of knowledge in autistic children. According to the interview result, parents and therapists show that when they teach children to fold quilts, the children often need to carry out 5-10 times of teaching in a teaching simulation mode, and can independently fold quilts. Through the experiment, all children can successfully complete the second stage after 1 time of learning in the first stage, and 4 children successfully fold quilts with common sizes in the subsequent third stage. The remaining 6 children were able to successfully complete the third stage after an additional 1-2 first stage studies.
4. The invention adds proper reinforcement from the aspects of vision, hearing and physical object according to the rehabilitation training method of the children with the autism, so that the children can obtain great progress, and the intrinsic enthusiasm of the children with the autism is promoted to be improved.
5. The invention is convenient for inviting parents to study with autistic children. The child training device is used as a long-term close contact person of the autism child, trains with the child, is convenient for parents to grasp new problems in time, finds the problems at any time and deals with the problems in time.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained from the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a child folding teaching device for autism children life education based on desktop projection according to an embodiment of the present invention.
Fig. 2 is a flowchart of a sub-teaching method for demonstrating autism children life education based on desktop projection according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail with reference to the following embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Aiming at the problems in the prior art, the invention provides a quilt folding teaching device for autism children life education based on desktop projection, and the invention is described in detail below with reference to the accompanying drawings.
As shown in fig. 1, the invention provides a quilt folding teaching device for autism children life education based on desktop projection, which comprises a computer (1), a projector (2), a camera (3), a tablet computer (4), a rabbit doll (5), a mini pillow (6) with the size of 17 x 13cm, a mini quilt (7) with the size of 45 x 25cm, a quilt (8) with the size of 106 x 72cm and a white bottom desktop (9).
The projector is connected with the computer and used for displaying all animations related to the process and helping the autistic children to finish the learning process of folding the quilt.
The camera is connected with the computer and used for carrying out image recognition in the formal teaching part and checking whether the result obtained in each step of overlaying quilt is correct.
The tablet computer is used for the formal teaching part, and before each step is carried out, a participant needs to watch demonstration animation of the step on the tablet computer and then carry out actual operation.
The rabbit doll, a mini pillow with the size of 17 × 13cm, a mini quilt with the size of 45 × 25cm and a quilt with the size of 106 × 72cm (common size) are objects actually operated in training of participants.
In an embodiment of the present invention, the projector is connected to the computer through an HDMI interface. For displaying all animations involved in the process.
In an embodiment of the present invention, the camera is connected to the computer through a USB. The image recognition is mainly carried out in the formal teaching part, and whether the result obtained in the step is correct is checked.
The working principle of the invention is as follows:
the animation and sound effect related to the whole device are gathered by the computer, specifically, finished by a Unity game engine, and then played by the projector.
When the child is overlaid with the sub-teaching part, the camera detects that the result presented by the step can be placed in the area with the specified size within the allowable error range every time the child completes the step, and the next step is carried out only when the result is correct. The specific identification part is completed through a Python language and an Opencv computer vision software library, the Python identifies the size of a square through color and shape, then calculates the distance between a quilt and a camera and the area of the quilt in a picture, then compares the calculated area with the area set in advance, and judges whether the mini quilt is successfully folded or not within a set error. Then through the C/S mode, communication between Python and unity3D is established, information is sent to unity3D, and if the participants finish the operation steps correctly, the firework special effect displayed is given to encouragement.
In order to verify whether the invention can help the autistic children to more effectively learn the quilt folding, the invention designs and implements an experiment. A total of ten participants were invited to perform the experiment, each round consisting of one participant and its parents. Although individual children already fold quilts before, the quilt folding mode is different from the experiment.
The experiment was divided into three stages.
The first stage simulation is the first stage of guide of projection animation and sound effect. This phase guides the participants through the course by using a story. The process from laying out the mini quilt to folding the mini quilt is divided into 5 steps, and the participants need to repeat 2 rounds of learning according to the 5 steps. Before proceeding with each step, the participants need to view the demonstration animations of this step on the tablet, each animation being about 5 s. Then, the projector will project the specific folding direction and the folding part of the current step onto the mini quilt, and the participants need to fold the mini quilt according to the projection prompt. When the participants correctly complete the operation steps, the fireworks animation projected on the desktop gives encouragement. After completing the first phase, the participant may proceed to the second phase.
Specifically, the procedure is as follows:
python (identify image, send data):
inputting: video streaming (real-time camera capture)
And (3) outputting: a recognition result msg;
initializing information for storing data;
connected to unity3D using CS communication;
circularly acquiring each frame of image;
converting the RGB model into an HSV model;
screening according to target colors:
if the image value of the current pixel point is within the threshold value of the target color, the image value is maximized;
otherwise, the pixel point value is 0;
median filtering processing;
detecting the peripheral outline by pixel point value bitwise OR operation;
identified contour region size:
if the area size meets 1 st off, msg is 1;
if the area size is in accordance with 2 nd gate, msg is 2;
if the area size is in accordance with the 3 rd off, msg is equal to 3';
if the area size is in accordance with the 4 th gate, msg is 4;
if the area size is consistent with 5 th gate, msg is 5;
otherwise msg is empty;
ending, sending msg to Unity;
unity (receive data, switch level content)
Inputting: result of recognition msg
And (3) outputting: level contents
Judging msg:
if currently 1 st off, and msg is "1"; switching to the level 2;
if it is currently off 2, and msg is "2"; switching to the level 3;
if it is currently off 3, and msg is "3"; switching to the level 4;
if it is currently off 4, and msg is "4"; switching to the level 5;
if it is currently off 5, and msg is "5"; turning to the end animation;
otherwise it remains unchanged.
And the second stage of simulation, namely, learning results of small mini quilt inspection participants are utilized. After the first stage is completed, the participants need to independently fold the mini-quilts by using the quilt folding method learned in the first stage without direct prompt.
In the second stage of simulation, after 5 steps of folding the quilt are completed, the participant needs to put the folded mini quilt in a prompt box projected on a desktop and wait for a detection result of the device. When the participants correctly complete the operation steps, the fireworks animation projected on the desktop gives encouragement. The detection method used in the second stage is identical to the detection method used in the first stage. Participants will get some reinforcement as encouragement after completing the task.
And (3) simulating in the third stage, wherein the learning achievement of the participants is tested by using a quilt with a common size. In the stage, the participants are required to fold the quilts with the common sizes by using the method for folding the quilts learned in the first stage under the condition of no direct prompt. The participants are limited to completing the task within 3 minutes and if the participants appear to forget or use other methods of folding the child that are not the present teaching, the researcher will again direct the participants back to the first stage for learning until the participants are able to complete the present stage.
The successful completion of each stage in the three stages is rewarded by the reinforcement of the entity.
After the experiment was completed, interviews were conducted with the parents of the participants and the professional therapists.
According to the performance of participants and the feedback of parents, results show that the desktop interaction mode adopted by the invention can make autistic children more interested in the learning process; the teaching mode adopted in the first stage of the invention has performability; the training to practice method of the invention can help the autistic children to transfer knowledge.
The technical solution of the present invention will be further described with reference to specific experiments.
The desktop interaction mode adopted by the invention can make autistic children more pleasant in the learning process. Through analysis of video key frames in the experimental process, 9 children were found to show positive emotions in the experimental process, and 4 children also had limb movements of clapping hands and jumping when completing the task. In addition, during the interview, parents explicitly mention their children's liking of the learning process, and the whole learning process, including the series training phase in the form of story telling, is very liked by the parents.
The teaching mode adopted in the first stage of the invention has performability. By viewing the first stage of the experimental video, we found that the child completed less time in the second round of the fold sub teaching than in the first round of the teaching (an average time usage reduction of 43.16%). In the second round of teaching process, 4 children can complete the task without watching the demonstration animation, 5 children need to watch the demonstration animation intermittently, and only 1 child with low functional autism needs the assistance of demonstrating the animation.
The training to practice method of the invention can help the autistic children to transfer knowledge. According to the interview result, parents and therapists show that when they teach children to fold quilts, the children often need to carry out 5-10 times of teaching in a teaching simulation mode, and can independently fold quilts. Through the experiment, all children can successfully complete the second stage after 1 time of learning in the first stage, and 4 children successfully fold quilts with common sizes in the subsequent third stage. The remaining 6 children were able to successfully complete the third stage after an additional 1-2 first stage studies.
In the description of the present invention, "a plurality" means two or more unless otherwise specified; the terms "upper", "lower", "left", "right", "inner", "outer", "front", "rear", "head", "tail", and the like, indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, are only for convenience in describing and simplifying the description, and do not indicate or imply that the device or element referred to must have a particular orientation, be constructed in a particular orientation, and be operated, and thus, should not be construed as limiting the invention. Furthermore, the terms "first," "second," "third," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
It should be noted that the embodiments of the present invention can be realized by hardware, software, or a combination of software and hardware. The hardware portion may be implemented using dedicated logic; the software portions may be stored in a memory and executed by a suitable instruction execution system, such as a microprocessor or specially designed hardware. Those skilled in the art will appreciate that the apparatus and methods described above may be implemented using computer executable instructions and/or embodied in processor control code, such code being provided on a carrier medium such as a disk, CD-or DVD-ROM, programmable memory such as read only memory (firmware), or a data carrier such as an optical or electronic signal carrier, for example. The apparatus and its modules of the present invention may be implemented by hardware circuits such as very large scale integrated circuits or gate arrays, semiconductors such as logic chips, transistors, or programmable hardware devices such as field programmable gate arrays, programmable logic devices, etc., or by software executed by various types of processors, or by a combination of hardware circuits and software, e.g., firmware.
The above description is only for the purpose of illustrating the present invention and the appended claims are not to be construed as limiting the scope of the invention, which is intended to cover all modifications, equivalents and improvements that are within the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A quilt folding teaching method of autism children life education based on desktop projection is characterized by comprising the following steps:
the simulation of the first stage is to simulate a plurality of steps divided from paving the mini quilt to stacking the mini quilt, and the participants repeatedly perform a plurality of rounds of learning according to the steps; before each step, the participant acquires the demonstration animation of the current step on the flat plate; then, the projector projects the specific folding direction and the folding part of the current step onto the mini quilt, and the participants fold the mini quilt according to the projection prompt; after the participants correctly finish the operation steps, the firework animation projected on the desktop gives encouragement; after the first stage is finished, entering a second stage;
the second stage of simulation, namely, the learning achievement of the small mini quilt inspection participants is utilized; after the first stage is finished, the participants need to independently fold the mini quilts by using the quilt folding method learned in the first stage under the condition of no direct prompt;
and (3) simulating in the third stage, wherein the learning achievement of the participants is tested by using a quilt with a common size.
2. The quilt folding teaching method of autism children's life education based on desktop projection as claimed in claim 1, wherein in the first stage simulation, the simulation of projection animation and sound effect is performed, and a course is completed by combining a story telling guide program; the method specifically comprises the following steps: the computer is used for gathering, the Unity game engine of the computer is used for completing the gathering, and then the projector is used for playing;
in the first-stage simulation, when the child is folded by the sub-teaching part, the camera detects each time the child finishes one step, whether the presented result can be placed in an area with a specified size within an allowable error range is detected, and the next step is carried out only when the result is correct;
the camera performs image recognition Python through a Python language and an Opencv computer vision software library to recognize the size of a square through color and shape, then calculates the distance between the quilt and the camera and the area of the quilt in a picture, then compares the calculated area with the area set in advance, and judges whether the mini quilt is successfully folded or not within a set error; then through the C/S mode, communication between Python and unity3D is established, information is sent to unity3D, and if the participants finish the operation steps correctly, the displayed firework special effect gives encouragement.
3. The method for overlaying a sub-teaching of autism children's life education based on desktop projection as claimed in claim 1, wherein the simulation procedure of the first stage simulation comprises:
recognizing the image, sending data:
inputting: video streaming (camera capture in real time);
and (3) outputting: a recognition result msg;
initializing information for storing data;
connected to unity3D using CS communication;
circularly acquiring each frame of image;
converting the RGB model into an HSV model;
screening according to target colors:
if the image value of the current pixel point is within the threshold value of the target color, the image value is maximized;
otherwise, the pixel point value is 0;
median filtering processing;
detecting the peripheral outline by pixel point value bitwise OR operation;
identified contour region size:
if the area size meets 1 st off, msg is 1;
if the area size meets the 2 nd gate, msg is 2;
if the area size is consistent with 3 rd off, msg is 3;
if the area size is consistent with the 4 th switch, msg is 4;
if the area size is consistent with 5 th gate, msg is 5;
otherwise msg is empty;
ending, sending msg to Unity;
receiving data, switching the level content:
inputting: the result of the identification msg;
and (3) outputting: level contents;
judging msg:
if the current is 1 st off, and msg is 1; switching to the level 2;
if the current is 2 nd off, and msg is 2; switching to the level 3;
if the current is 3 rd off, and msg is 3; switching to the level 4;
if the current is 4 th off, and msg is 4; switching to the level 5;
if the current is off 5, and msg is 5; turning to the end animation;
otherwise it remains unchanged.
4. The quilt folding teaching method for autism children life education based on desktop projection as claimed in claim 1, wherein in the second stage of simulation, after completing the steps of folding the quilt, the participant puts the folded mini quilt in the prompting frame projected on the desktop and waits for the detection result of the device; when the participator completes the operation steps correctly, the firework animation projected on the desktop gives encouragement; the detection method used in the second stage is consistent with the detection method used in the first stage; participants received some reinforcement as encouragement after completing the task.
5. The quilt folding teaching method of autism children's life education based on desktop projection as claimed in claim 1, wherein in the third stage simulation, the participants perform folding simulation of the quilt of ordinary size without direct prompting by using the method of folding the quilt learned in the first stage.
6. The quilt folding teaching method for autism children life education based on desktop projection as claimed in claim 1, wherein in the third stage simulation, if the participant forgets or uses other quilt folding methods not in the current teaching, the participant is guided back to the first stage again for learning until the participant can complete the simulation operation procedure in the current stage.
7. A quilt folding teaching apparatus for teaching child autism life based on desktop projection, which implements the method for teaching quilt folding of child autism life based on desktop projection according to any one of claims 1 to 6, wherein the apparatus for teaching quilt folding of child autism life based on desktop projection comprises: a computer, a projector, a camera, a tablet computer, a rabbit doll, a mini pillow, a mini quilt, a quilt of common size and a desktop;
the projector is connected with the computer and is used for displaying all animations related to the process;
the camera is connected with the computer and used for carrying out image recognition in the formal teaching part and checking whether the result obtained in the step is correct or not.
The tablet personal computer is used for providing demonstration animation of each sub-folding step for the autistic children in the formal teaching part;
the rabbit doll, the mini pillow, the mini quilt and the quilt with the common size are all placed on a table top.
8. The desktop projection-based children's education for folding quilt teaching device according to claim 7, wherein the projector is connected to the computer through an HDMI interface;
the camera is connected with the computer through a USB interface.
9. A computer device comprising a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform the fold sub teaching method of desktop projection based autism childhood life education of any one of claims 1-6.
10. A computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to perform the fold sub-teaching method of the desktop projection based autism childhood life education of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111232127.2A CN113903197B (en) | 2021-10-22 | 2021-10-22 | Quilt folding teaching device and method for autism children life education |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111232127.2A CN113903197B (en) | 2021-10-22 | 2021-10-22 | Quilt folding teaching device and method for autism children life education |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113903197A true CN113903197A (en) | 2022-01-07 |
| CN113903197B CN113903197B (en) | 2023-05-26 |
Family
ID=79026038
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111232127.2A Active CN113903197B (en) | 2021-10-22 | 2021-10-22 | Quilt folding teaching device and method for autism children life education |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113903197B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114783217A (en) * | 2022-02-16 | 2022-07-22 | 杭州超乎智能科技有限公司 | Teaching equipment and system based on multi-mode interaction |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0462802A1 (en) * | 1990-06-19 | 1991-12-27 | Stephen Robert Ketch | Method and apparatus for teaching children how to fold clothes and other objects |
| CN2307322Y (en) * | 1997-08-08 | 1999-02-10 | 董慧君 | Teachig-aid for infant studying |
| JP3044219B1 (en) * | 1999-04-30 | 2000-05-22 | 株式会社ワコール | Children's clothing |
| US20080113323A1 (en) * | 2006-11-09 | 2008-05-15 | Mcelhoe Janice Sweet | Learning/Play Quilt for development of toddlers' fine motor skills (dexterity): zipping, tying, buttoning, lacing, snapping, hooking, use of Velcro, buckling, and identification of numbers, letters, words and containing pockets for storing small toys in addition to being used as a blanket |
| JP2013143853A (en) * | 2012-01-11 | 2013-07-22 | Mitsuba Corp | Terminal unit, and electric motor |
| CN203511018U (en) * | 2013-06-28 | 2014-04-02 | 王亚东 | Book with projection function |
| WO2014179870A1 (en) * | 2013-05-09 | 2014-11-13 | Mitchell Gail Joyce | System and method for facilitating emergent learning in relation to knowledge content |
| CN207264748U (en) * | 2017-09-01 | 2018-04-20 | 成都信息工程大学 | A kind of new media projection artistic system of tangible interaction |
| CN108062796A (en) * | 2017-11-24 | 2018-05-22 | 山东大学 | Hand work and virtual reality experience system and method based on mobile terminal |
| US20190340434A1 (en) * | 2018-05-07 | 2019-11-07 | Medtronic Minimed, Inc. | Proactive patient guidance using augmented reality |
| CN209789326U (en) * | 2019-05-05 | 2019-12-17 | 王后家纺科技有限公司 | Interesting teaching quilt cover |
| CN111292567A (en) * | 2020-02-28 | 2020-06-16 | 桂林师范高等专科学校 | Artificial intelligence-based children mathematical thinking innovation training device and using method thereof |
| CN211568443U (en) * | 2019-12-31 | 2020-09-25 | 深圳市圆梦精密技术研究院 | Wrapping and folding cloth forming device and automatic cloth wrapping equipment for anesthesia bag |
| JP6877069B1 (en) * | 2020-09-25 | 2021-05-26 | 合同会社 吉 | Educational goods |
-
2021
- 2021-10-22 CN CN202111232127.2A patent/CN113903197B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0462802A1 (en) * | 1990-06-19 | 1991-12-27 | Stephen Robert Ketch | Method and apparatus for teaching children how to fold clothes and other objects |
| CN2307322Y (en) * | 1997-08-08 | 1999-02-10 | 董慧君 | Teachig-aid for infant studying |
| JP3044219B1 (en) * | 1999-04-30 | 2000-05-22 | 株式会社ワコール | Children's clothing |
| US20080113323A1 (en) * | 2006-11-09 | 2008-05-15 | Mcelhoe Janice Sweet | Learning/Play Quilt for development of toddlers' fine motor skills (dexterity): zipping, tying, buttoning, lacing, snapping, hooking, use of Velcro, buckling, and identification of numbers, letters, words and containing pockets for storing small toys in addition to being used as a blanket |
| JP2013143853A (en) * | 2012-01-11 | 2013-07-22 | Mitsuba Corp | Terminal unit, and electric motor |
| WO2014179870A1 (en) * | 2013-05-09 | 2014-11-13 | Mitchell Gail Joyce | System and method for facilitating emergent learning in relation to knowledge content |
| CN203511018U (en) * | 2013-06-28 | 2014-04-02 | 王亚东 | Book with projection function |
| CN207264748U (en) * | 2017-09-01 | 2018-04-20 | 成都信息工程大学 | A kind of new media projection artistic system of tangible interaction |
| CN108062796A (en) * | 2017-11-24 | 2018-05-22 | 山东大学 | Hand work and virtual reality experience system and method based on mobile terminal |
| US20190340434A1 (en) * | 2018-05-07 | 2019-11-07 | Medtronic Minimed, Inc. | Proactive patient guidance using augmented reality |
| CN209789326U (en) * | 2019-05-05 | 2019-12-17 | 王后家纺科技有限公司 | Interesting teaching quilt cover |
| CN211568443U (en) * | 2019-12-31 | 2020-09-25 | 深圳市圆梦精密技术研究院 | Wrapping and folding cloth forming device and automatic cloth wrapping equipment for anesthesia bag |
| CN111292567A (en) * | 2020-02-28 | 2020-06-16 | 桂林师范高等专科学校 | Artificial intelligence-based children mathematical thinking innovation training device and using method thereof |
| JP6877069B1 (en) * | 2020-09-25 | 2021-05-26 | 合同会社 吉 | Educational goods |
Non-Patent Citations (1)
| Title |
|---|
| 李鸿灿: "实施优质教育 促进学生个性发展" * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114783217A (en) * | 2022-02-16 | 2022-07-22 | 杭州超乎智能科技有限公司 | Teaching equipment and system based on multi-mode interaction |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113903197B (en) | 2023-05-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102061786B1 (en) | Method for Educating Code Using Block Kit | |
| Grover et al. | Multimodal analytics to study collaborative problem solving in pair programming | |
| Lewis | The importance of students' attention to program state: a case study of debugging behavior | |
| CN108919950A (en) | Autism children based on Kinect interact device for image and method | |
| US20140272869A1 (en) | Platforms, systems, software, and methods for online cpr training and certification | |
| CN109637286A (en) | A kind of Oral Training method and private tutor's equipment based on image recognition | |
| KR101959281B1 (en) | Image processing device and experience system for motion recognition type augmented reality including the same | |
| WO2020051999A1 (en) | Language learning method based on image recognition, electronic device and storage medium | |
| JP2011227365A (en) | Learning support device for healthcare and nursing skills and learning method for healthcare and nursing skills | |
| CN110930780A (en) | Virtual autism teaching system, method and equipment based on virtual reality technology | |
| KR101700120B1 (en) | Apparatus and method for object recognition, and system inculding the same | |
| CN113903197A (en) | Quilt folding teaching device and method for autistic children life education | |
| CN106205237A (en) | Based on movement response and the training method of the second mother tongue of drawing reaction and device | |
| Vollmer et al. | A user study on robot skill learning without a cost function: Optimization of dynamic movement primitives via naive user feedback | |
| TWI687904B (en) | Interactive training and testing apparatus | |
| CN110957021A (en) | Logic thinking ability training method and system for autism patient | |
| TWI720977B (en) | Education learning method and computer program thereof | |
| Barioni et al. | BalletVR: a Virtual Reality System for Ballet Arm Positions Training | |
| Križnar et al. | Use of Computer Vision Based Hand Tracking in Educational Environments | |
| CN116434253A (en) | Image processing method, device, equipment, storage medium and product | |
| Tung et al. | Pianow-piano self-learning assistant in mixed reality | |
| CN113741689B (en) | Kinect-based human body contour recognition interaction display system | |
| Wicaksono et al. | 3D Geometric Shape and Colors Interactive Learning Media using Raspberry Pi, OpenCV, and TensorFlow Lite. | |
| CN116884279A (en) | Autism child clothing wearing teaching method and device based on desktop projection | |
| CN116895265A (en) | Multimedia data processing method, device, enhancement realization equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240204 Address after: 610225, No. 24, Section 1, Xuefu Road, Southwest Economic Development Zone, Chengdu, Sichuan Patentee after: CHENGDU University OF INFORMATION TECHNOLOGY Country or region after: China Patentee after: Beijing Beishan Medical Technology Co.,Ltd. Address before: 610225, No. 24, Section 1, Xuefu Road, Southwest Economic Development Zone, Chengdu, Sichuan Patentee before: CHENGDU University OF INFORMATION TECHNOLOGY Country or region before: China Patentee before: Chengdu Jingyu Interactive Technology Co.,Ltd. |