CN111564064A - Intelligent education system and method based on game interaction - Google Patents

Intelligent education system and method based on game interaction Download PDF

Info

Publication number
CN111564064A
CN111564064A CN202010458630.9A CN202010458630A CN111564064A CN 111564064 A CN111564064 A CN 111564064A CN 202010458630 A CN202010458630 A CN 202010458630A CN 111564064 A CN111564064 A CN 111564064A
Authority
CN
China
Prior art keywords
education
sound
data
course
scene
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010458630.9A
Other languages
Chinese (zh)
Inventor
王鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Yixue Education Technology Co Ltd
Original Assignee
Shanghai Yixue Education Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Yixue Education Technology Co Ltd filed Critical Shanghai Yixue Education Technology Co Ltd
Priority to CN202010458630.9A priority Critical patent/CN111564064A/en
Publication of CN111564064A publication Critical patent/CN111564064A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/02Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/52Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/55Controlling game characters or game objects based on the game progress
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/04Electrically-operated educational appliances with audible presentation of the material to be studied
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention provides an intelligent education system and method based on game interaction, which can design an education interactive game scene according to corresponding course education data in a targeted manner so as to facilitate course teaching in the education interactive game scene, thereby improving the teaching interest of related courses, and can detect dynamic information of a game interactive object in the course education process in real time so as to adjust the education interactive game scene in an adaptive manner, thereby being beneficial to improving the execution quality and efficiency of intelligent education.

Description

Intelligent education system and method based on game interaction
Technical Field
The invention relates to the technical field of intelligent education, in particular to an intelligent education system and method based on game interaction.
Background
The intelligent education is considered as the mainstream direction of the development of the future education mode, the implementation mode and the data processing mode of the intelligent education are different from the traditional education, the intelligent education fully utilizes the intelligent data processing modes such as the neural network model and the like to analyze and process the education big data, and the corresponding course education is implemented through different intelligent recognition modes such as different voice recognition modes, action recognition modes and the like. However, the intelligent education in the prior art only focuses on the aspects of education data processing and education course presentation, and does not improve the interactivity and the course interest of related personnel in the course education process in other ways, which is not beneficial to improving the execution quality and efficiency of the intelligent education.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides an intelligent education system and method based on game interaction, wherein the intelligent education system and method based on game interaction are used for obtaining course education data related to a certain subject, generating corresponding education related image data and/or education related sound data according to the course education data, designing and obtaining an education interaction game scene matched with the certain subject according to the education related image data and the education related sound data, and acquiring dynamic information related to a game interaction object in the operation process of the education interaction game scene so as to adjust the interaction presentation state of the education interaction game scene according to the dynamic information; therefore, the intelligent education system and the intelligent education method based on the game interaction can design the education interactive game scene in a targeted manner according to the corresponding course education data so as to facilitate course teaching in the education interactive game scene, thereby improving the teaching interestingness of related courses, and can detect the dynamic information of a game interactive object in the course education process in real time so as to adjust the education interactive game scene adaptively, thereby being beneficial to improving the execution quality and efficiency of intelligent education.
The invention provides an intelligent education system based on game interaction, which is characterized in that:
the intelligent education system based on game interaction comprises an education related data generation module, an education interaction game scene design module, a dynamic information generation module and an education interaction game scene adjustment module; wherein,
the education related data generation module is used for generating corresponding education related image data and/or education related sound data according to course education data related to a certain subject;
the education interactive game scene design module is used for designing and obtaining an education interactive game scene matched with the certain subject according to the education related image data and the education related sound data;
the dynamic information generation module is used for generating dynamic information about a game interaction object in the running process of the education interaction game scene;
the education interactive game scene adjusting module is used for adjusting the interactive presenting state of the education interactive game scene according to the dynamic information;
further, the education related data generation module comprises a course education data submodule, a noise reduction preprocessing submodule, a first combination processing submodule and a second combination processing submodule; wherein,
the course education data submodule is used for acquiring course education text data, course education picture data and course education sound data related to a certain subject;
the noise reduction preprocessing submodule is used for carrying out noise reduction preprocessing on the course education text data, the course education picture data and the course education sound data;
the first combined processing submodule is used for performing character-picture superposition processing and picture coherent combination processing on the course character data and the course education picture data subjected to the noise reduction preprocessing so as to obtain the education-related image data;
the second combination processing sub-module is used for respectively carrying out sound coherent combination processing on the course sound data subjected to the noise reduction processing so as to obtain the education related sound data;
further, the educational interactive game scene design module comprises a play time axis determining submodule, an initial game scene forming submodule and an educational interactive game scene generating submodule; wherein,
the playing time axis determining submodule is used for carrying out time cooperative processing on the image components in the education-related image data and the sound components in the education-related sound data so as to determine a playing time axis between the education-related image data and the education-related sound data;
the initial game scene forming submodule is used for combining the education related image data and the education related sound data according to the playing time axis so as to obtain an initial game scene;
the education interactive game scene generation submodule is used for performing scene color rendering processing and virtual three-dimensional conversion processing on the initial game scene so as to form the education interactive game scene;
further, the dynamic information generation module comprises an image shooting submodule, a sound acquisition submodule, a first dynamic information forming submodule and a second dynamic information forming submodule; wherein,
the image shooting submodule is used for shooting the multi-angle image of the game interaction object in the running process of the education interaction game scene;
the sound acquisition submodule is used for acquiring sound of the game interaction object in multiple directions in the operation process of the education interaction game scene;
the first dynamic information forming sub-module is used for identifying and extracting a face area and/or a limb area of a dynamic image obtained by image shooting, so as to correspondingly generate face dynamic change information and/or limb dynamic change information as part of the dynamic information;
the second dynamic information forming submodule is used for identifying and extracting sound intensity and/or tone of the sound signal obtained by sound collection, so that sound intensity change information and/or tone change information are correspondingly generated to serve as part of the dynamic information;
further, the educational interactive game scene adjusting module comprises a first scene adjusting submodule and a second scene adjusting submodule; wherein,
the first scene adjusting submodule is used for adjusting the virtual scene image updating speed and/or the virtual scene brightness of the education interactive game scene according to the dynamic face change information and/or the dynamic limb change information corresponding to the game interactive object in the dynamic information;
and the second scene adjusting submodule is used for adjusting the scene background sound intensity and/or the scene background music style type of the education interactive game scene according to the sound intensity change information and/or the tone change information corresponding to the game interactive object in the dynamic information.
The invention also provides an intelligent education method based on game interaction, which is characterized by comprising the following steps:
step S1, obtaining course education data about a certain subject, and generating corresponding education related image data and/or education related sound data according to the course education data;
step S2, according to the education-related image data and the education-related sound data, an education interactive game scene matched with the certain subject is designed;
step S3, collecting dynamic information about game interaction objects in the operation process of the education interaction game scene;
step S4, adjusting the interactive presenting state of the education interactive game scene according to the dynamic information;
further, the step S1 of obtaining the course education material related to a certain subject and generating the corresponding education-related image data and/or education-related sound data according to the course education material specifically includes,
step S101, obtaining course education text data, course education picture data and course education sound data of a certain subject, and performing noise reduction pretreatment on the course education text data, the course education picture data and the course education sound data;
step S102, the course text data and the course education picture data which are processed by the noise reduction pretreatment are subjected to text-picture superposition processing and picture coherent combination processing so as to obtain the education-related image data, and the picture superposition value of the course text data and the course education picture data which are subjected to the noise reduction pretreatment are subjected to the text-picture superposition processing and the picture coherent combination processing is obtained by using the following formula (1)
Figure BDA0002510168450000041
In the above formula (1), t (t) represents a picture superimposition value at the t-th time instant, ai(t) denotes an ith matrix point of the image matrix of the course education picture at the t-th time instant, i denotes an ith matrix point of the image matrix of the course education picture, and m denotes a total number of matrix points of the image matrix of the course education picture. Δ tsIs expressed at Δ tsWithin a time (and at Δ t)sThe course text data and the course education picture preprocessed by noise reduction in each time are all within the t-delta tsThe lesson text data subjected to noise reduction preprocessing at each time moment is the same as a lesson education picture) s represents the lesson education picture subjected to noise reduction preprocessing at the s th time moment;
when T (t)<When 0, adding the characters of the chapter a into the picture according to the sequence of the character chapters of the course character data from the superposition value of the t-th time of the picture from small to large, and when T (t) appears>When 0, according to the character chapter sequence of the course character data the characters in chapter a +1 are divided into the characters from the t + delta tsAdding the superposition value of each time into the picture in the order from small to large, adding the chapters in sequence according to the step until the characters of all the chapters are added into the picture (wherein a represents the a-th chapter of the characters of the course character data, and when a is 1, t is 0), and then performing secondary superposition processing on the picture according to the sequence of the character chapters of the character data to finally obtain the education related image data;
step S103, respectively carrying out sound consecutive combination processing on the course sound data subjected to the noise reduction processing so as to obtain the education-related sound data, and utilizing the following formula (2) to match values of head and tail audios of all the course sound data subjected to the noise reduction processing
Figure BDA0002510168450000051
In the above-mentioned formula (2),
Figure BDA0002510168450000052
a matching value representing a tail sound matrix of the p-th sound and a head sound matrix of the q-th sound in the lesson sound data subjected to the noise reduction processing,
Figure BDA0002510168450000053
a j-th matrix point of a tail sound matrix representing a p-th sound in the lesson sound data subjected to the noise reduction processing,
Figure BDA0002510168450000054
j matrix point of the head sound matrix of the q sound in the curriculum sound material after the noise reduction processing;
sorting the matching values of the head and tail audio frequencies of all the course sound data subjected to the noise reduction treatment from small to large, and connecting the tail sound of the corresponding p-th sound and the head sound of the q-th sound according to the minimum value to obtain sound coherent combination so as to obtain the education related sound data;
further, in the step S2, designing an educational interactive game scene matching the subject based on the educational related image data and the educational related sound data may specifically include,
step S201 of performing time-collaborative processing on an image component in the education-related video data and a sound component in the education-related sound data to determine a playback time axis between the education-related video data and the education-related sound data, and determining a playback time axis between the education-related video data and the education-related sound data using the following formula (3)
Figure BDA0002510168450000061
In the above formula (3), QsRepresenting the course education picture time of the s-th noise reduction pre-process in the education-related image data and the course education picture time in the education-related sound dataA similarity value of initial time of sound components, T representing a sound time of a first sound material of sound components in the education-related sound data;
when Q issWhen 0, representing the course education picture time of the s-th noise reduction pre-processing and the sound time of the first sound data of the sound component in the education-related sound data, overlapping the first sound data of the sound component in the education-related sound data and the course education picture of the s-th noise reduction pre-processing to determine a playing time axis between the education-related image data and the education-related sound data;
step S202, combining the education related image data and the education related sound data according to the playing time axis to obtain an initial game scene;
step S203, performing scene color rendering processing and virtual three-dimensional conversion processing on the initial game scene to form the education interactive game scene;
further, in step S3, the collecting dynamic information about the game interaction object during the operation of the educational interactive game scene specifically includes,
step S301, in the operation process of the education interactive game scene, carrying out multi-angle image shooting and multi-directional sound acquisition on the game interactive object;
step S302, identifying and extracting a face area and/or a limb area of a dynamic image obtained by image shooting, and accordingly generating face dynamic change information and/or limb dynamic change information as part of the dynamic information;
step S303, identifying and extracting the sound intensity and/or tone of the sound signal acquired by sound acquisition, and accordingly generating sound intensity change information and/or tone change information as a part of the dynamic information;
further, in the step S4, the adjusting the interactive presentation status of the educational interactive game scene according to the dynamic information specifically includes,
step S401, adjusting the virtual scene image updating speed and/or the virtual scene brightness of the education interactive game scene according to the dynamic face change information and/or the dynamic limb change information corresponding to the game interactive object in the dynamic information;
step S402, adjusting the scene background sound intensity and/or the scene background music style type of the education interactive game scene according to the sound intensity change information and/or the tone change information corresponding to the game interactive object in the dynamic information.
Compared with the prior art, the game interaction-based intelligent education system and method have the advantages that the course education data about a certain subject are obtained, the corresponding education-related image data and/or education-related sound data are generated according to the course education data, the education interaction game scene matched with the certain subject is designed according to the education-related image data and the education-related sound data, and then the dynamic information about the game interaction object is collected in the operation process of the education interaction game scene, so that the interaction presenting state of the education interaction game scene is adjusted according to the dynamic information; therefore, the intelligent education system and the intelligent education method based on the game interaction can design the education interactive game scene in a targeted manner according to the corresponding course education data so as to facilitate course teaching in the education interactive game scene, thereby improving the teaching interestingness of related courses, and can detect the dynamic information of a game interactive object in the course education process in real time so as to adjust the education interactive game scene adaptively, thereby being beneficial to improving the execution quality and efficiency of intelligent education.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an intelligent education system based on game interaction according to the present invention.
FIG. 2 is a schematic flow chart of the game interaction-based intelligent education method provided by the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a schematic structural diagram of an intelligent education system based on game interaction according to an embodiment of the present invention is shown. The intelligent education system based on game interaction comprises an education related data generation module, an education interaction game scene design module, a dynamic information generation module and an education interaction game scene adjustment module; wherein,
the education related data generation module is used for generating corresponding education related image data and/or education related sound data according to course education data related to a certain subject;
the education interactive game scene design module is used for designing and obtaining an education interactive game scene matched with a certain subject according to the education related image data and the education related sound data;
the dynamic information generation module is used for generating dynamic information about a game interaction object in the running process of the education interaction game scene;
the education interactive game scene adjusting module is used for adjusting the interactive presenting state of the education interactive game scene according to the dynamic information.
This intelligent education system based on game interaction realizes corresponding course education through education interactive game scene, and it not only can improve the interactive and interesting of course education process to can also improve the quality and the efficiency of course education, this system can also carry out the adjustment of interactive presentation state according to the real-time dynamic information of different recreation interactive object in course education process simultaneously, thereby improve this system and to the adaptability of different grade type recreation interactive object and realize the optimization of intelligent education effect.
Preferably, the education related data generation module comprises a course education material sub-module, a noise reduction pre-processing sub-module, a first combined processing sub-module and a second combined processing sub-module; wherein,
the course education data submodule is used for acquiring course education text data, course education picture data and course education sound data related to a certain subject;
the noise reduction preprocessing submodule is used for carrying out noise reduction preprocessing on the course education text data, the course education picture data and the course education sound data;
the first combined processing submodule is used for carrying out character-picture superposition processing and picture coherent combination processing on the course character data and the course education picture data subjected to the noise reduction preprocessing so as to obtain education-related image data;
the second combination processing sub-module is used for respectively carrying out sound coherent combination processing on the course sound data subjected to the noise reduction processing so as to obtain the education related sound data.
The education related data generation module can restore and map all education related data of a certain subject to the maximum extent by performing superposition and coherent combination processing on course education text data and course education picture data and performing coherent combination processing on course education sound data, so that the subsequently formed education interactive game scene can truly and completely reflect the education data of the certain subject and the education effectiveness of the education interactive game scene is improved.
Preferably, the educational interactive game scene design module comprises a play time axis determining submodule, an initial game scene forming submodule and an educational interactive game scene generating submodule; wherein,
the playing time axis determining submodule is used for carrying out time cooperative processing on the image component in the education-related image data and the sound component in the education-related sound data so as to determine a playing time axis between the education-related image data and the education-related sound data;
the initial game scene forming submodule is used for combining the education related image data and the education related sound data according to the playing time axis so as to obtain an initial game scene;
the education interactive game scene generation submodule is used for carrying out scene color rendering processing and virtual three-dimensional conversion processing on the initial game scene so as to form the education interactive game scene.
The education interactive game scene design module can ensure that the two data can be kept consistent on a time axis after being combined by carrying out time cooperative processing on the image component in the education related image data and the sound component in the education related sound data, so that the subsequently formed education interactive game scene has good audio-visual impression; in addition, the aesthetic property and the realistic feeling of the educational interactive game scene can be optimized through the processing mode of scene color rendering and virtual three-dimensional conversion, so that the scene immersion feeling of the game interactive object is improved.
Preferably, the dynamic information generation module comprises an image shooting submodule, a sound acquisition submodule, a first dynamic information forming submodule and a second dynamic information forming submodule; wherein,
the image shooting submodule is used for shooting the multi-angle image of the game interaction object in the operation process of the education interaction game scene;
the sound acquisition submodule is used for acquiring sound of the game interaction object in multiple directions in the operation process of the education interaction game scene;
the first dynamic information forming sub-module is used for identifying and extracting a face area and/or a limb area of a dynamic image obtained by image shooting, so as to correspondingly generate face dynamic change information and/or limb dynamic change information as part of the dynamic information;
the second dynamic information forming sub-module is used for identifying and extracting sound intensity and/or tone of the sound signal obtained by sound collection, and accordingly generating sound intensity change information and/or tone change information as a part of the dynamic information.
The dynamic information generation module can accurately monitor the dynamic information of the face, the limbs and the sounds of the game interaction object in a multi-angle image shooting and multi-azimuth sound collecting mode, so that the game interaction object can be monitored comprehensively, the real-time sensory state of the game interaction object in the education game interaction scene can be acquired truly and completely, and the accuracy of subsequent adjustment of the education game interaction scene is improved.
Preferably, the educational interactive game scene adjusting module comprises a first scene adjusting submodule and a second scene adjusting submodule; wherein,
the first scene adjusting submodule is used for adjusting the virtual scene image updating speed and/or the virtual scene brightness of the education interactive game scene according to the dynamic face change information and/or the dynamic limb change information corresponding to the game interactive object in the dynamic information;
the second scene adjusting submodule is used for adjusting the scene background sound intensity and/or the scene background music style type of the education interactive game scene according to the sound intensity change information and/or the tone change information corresponding to the game interactive object in the dynamic information.
The educational interactive game scene adjusting module can ensure that the educational interactive game scene can timely adapt to the requirement of the game interactive object by performing visual sensory adjustment on the virtual scene image updating speed and/or the virtual scene brightness and auditory sensory adjustment on the scene background sound intensity and/or the scene background music style type on the educational interactive game scene, thereby improving the teaching interestingness of related courses and improving the execution quality and efficiency of intelligent education.
Fig. 2 is a schematic flow chart of an intelligent education method based on game interaction according to an embodiment of the present invention. The intelligent education method based on game interaction comprises the following steps:
step S1, obtaining course education data about a certain subject, and generating corresponding education related image data and/or education related sound data according to the course education data;
step S2, designing and obtaining an education interactive game scene matched with a certain subject according to the education related image data and the education related sound data;
step S3, collecting dynamic information about game interactive objects in the course of the operation of the education interactive game scene;
and step S4, adjusting the interactive display state of the educational interactive game scene according to the dynamic information.
The intelligent education method based on game interaction realizes corresponding course education through the education interactive game scene, can improve the interactivity and interestingness of the course education process, can also improve the quality and efficiency of the course education, and can adjust the interactive presentation state of the education interactive game scene according to the real-time dynamic information of different game interactive objects in the course education process, so that the adaptability of the method to different types of game interactive objects is improved, and the optimization of the intelligent education effect is realized.
Preferably, the step S1 of acquiring the course education material regarding a certain subject and generating corresponding education-related image data and/or education-related sound data based on the course education material includes,
step S101, obtaining course education text data, course education picture data and course education sound data of a certain subject, and performing noise reduction pretreatment on the course education text data, the course education picture data and the course education sound data;
step S102, the text data and the course education picture data after the noise reduction pretreatment are subjected to text-picture superposition processing and picture coherent combination processing to obtain the education-related image data, and the picture superposition value obtained by the text data and the course education picture data after the noise reduction pretreatment and the picture coherent combination processing is obtained by using the following formula (1)
Figure BDA0002510168450000121
In the above formula (1), t (t) represents a picture superimposition value at the t-th time instant, ai(t) denotes an ith matrix point of the image matrix of the course education picture at the t-th time instant, i denotes an ith matrix point of the image matrix of the course education picture, and m denotes a total number of matrix points of the image matrix of the course education picture. Δ tsIs expressed at Δ tsWithin a time (and at Δ t)sThe text data and educational pictures of the course are processed within the time intervalsThe lesson text data subjected to noise reduction preprocessing at each time instant is the same as the lesson education picture) s represents the lesson education picture subjected to noise reduction preprocessing at the s th time instant;
when T (t)<When 0, adding the characters of the chapter a into the picture according to the sequence of the character chapters of the course character data from the superposition value of the t-th time of the picture from small to large, and when T (t) appears>When 0, the characters in chapter a +1 are arranged from the t + delta t according to the character chapter sequence of the course character datasAdding the superposition value of each time into the picture in the order from small to large, adding the chapters in sequence according to the step until the characters of all chapters are added into the picture (wherein a represents the a-th chapter of the characters of the course character material, and when a is 1, t is 0), and then chapter according to the characters of the character materialSequentially carrying out secondary superposition processing on the pictures to finally obtain the education related image data;
step S103, the voice data of the lesson processed by the noise reduction are respectively processed by voice coherent combination to obtain the education related voice data, and the matching value of the beginning and the end voice frequency of all the lesson voice data processed by the noise reduction is obtained by using the following formula (2)
Figure BDA0002510168450000131
In the above-mentioned formula (2),
Figure BDA0002510168450000132
a matching value of a tail sound matrix representing the p-th sound and a head sound matrix representing the q-th sound in the lesson sound data subjected to the noise reduction processing,
Figure BDA0002510168450000133
a j-th matrix point of the tail sound matrix representing the p-th sound in the lesson sound data subjected to the noise reduction processing,
Figure BDA0002510168450000134
j matrix point of the head sound matrix of the q sound in the course sound data after the noise reduction processing;
and sequencing the matching values of the head and tail audio frequencies of all the course sound data subjected to the noise reduction treatment from small to large, and connecting the tail sound of the corresponding p-th sound and the head sound of the q-th sound according to the minimum value to obtain sound coherent combination so as to obtain the education related sound data.
The course education text data and the course education picture data are superposed and coherently combined, and the course education sound data are coherently combined, so that all education related data of a certain subject can be restored and mapped to the maximum extent, and the subsequently formed education interactive game scene can truly and completely reflect the education data of the certain subject and improve the education effectiveness of the education interactive game scene, in addition, the course text data and the course education picture data subjected to the noise reduction preprocessing are subjected to text-picture superposition processing and picture coherently combined through a formula (1), the superposition problem of different elements is solved, the superposition accuracy is improved, and the sound files can be accurately linked through matching by a formula (2) in a mode of comparing matching values, thereby accurately obtaining the education-related sound data.
Preferably, in the step S2, designing an educational interactive game scenario matching the subject based on the educational related image data and the educational related sound data specifically includes,
step S201, performing time cooperative processing on the image component in the education-related image data and the sound component in the education-related sound data to determine the playing time axis between the education-related image data and the education-related sound data, and determining the playing time axis between the education-related image data and the education-related sound data by using the following formula (3)
Figure BDA0002510168450000141
In the above formula (3), QsA similarity value representing the time of the lesson education picture subjected to the s-th noise reduction preprocessing in the education-related image data and the initial time of the sound component in the education-related sound data, wherein T represents the sound time of the first sound data of the sound component in the education-related sound data;
when Q issWhen the time is 0, the time represents the course education picture time of the s-th noise reduction pre-processing and the sound time of the first sound data of the sound component in the education-related sound data, overlapping the first sound data of the sound component in the education-related sound data and the course education picture of the s-th noise reduction pre-processing so as to determine the playing time axis between the education-related image data and the education-related sound data;
step S202, according to the playing time axis, combining the education related image data and the education related sound data to obtain an initial game scene;
step S203, performing scene color rendering processing and virtual three-dimensional conversion processing on the initial game scene to form the educational interactive game scene.
The image components in the education-related image data and the sound components in the education-related sound data are subjected to time cooperative processing, so that the two data can be kept consistent on a time axis after being combined, and the subsequently formed education interactive game scene has good audio-visual impression; in addition, the processing mode of scene color rendering and virtual three-dimensional conversion can optimize the aesthetic property and the realistic sense of the scene of the education interactive game, thereby improving the scene immersion sense of the game interactive object, and in addition, the playing time axis between the education related video data and the education related sound data is determined by using the formula (3), so that the accuracy and the reliability of the correspondence between the image components in the education related video data and the sound components in the education related sound data can be ensured.
Preferably, in the step S3, the collecting dynamic information about the game interaction object during the operation of the educational interactive game scene specifically includes,
step S301, in the operation process of the educational interactive game scene, multi-angle image shooting and multi-azimuth sound collection are carried out on the game interactive object;
step S302, identifying and extracting the face area and/or the limb area of the dynamic image obtained by shooting the image, and accordingly generating face dynamic change information and/or limb dynamic change information as part of the dynamic information;
in step S303, the sound signal obtained by sound collection is identified and extracted according to the sound intensity and/or tone, so as to generate the sound intensity variation information and/or tone variation information accordingly as a part of the dynamic information.
The dynamic information of the face, the limbs and the sounds of the game interaction object can be accurately obtained in a multi-angle image shooting and multi-direction sound collecting mode, the game interaction object can be comprehensively monitored, the real-time sensory state of the game interaction object in the education game interaction scene can be truly and completely obtained, and the accuracy of subsequent adjustment of the education game interaction scene is improved.
Preferably, in the step S4, the adjusting the interactive presentation status of the educational interactive game scenario according to the dynamic information specifically includes,
step S401, according to the dynamic change information of the face and/or the dynamic change information of the limbs corresponding to the game interaction object in the dynamic information, adjusting the virtual scene image updating speed and/or the virtual scene brightness of the education interaction game scene;
step S402, according to the sound intensity change information and/or tone change information corresponding to the game interaction object in the dynamic information, adjusting the scene background sound intensity and/or scene background music style type of the education interaction game scene.
By carrying out visual sensory adjustment on the image updating speed of the virtual scene and/or the brightness of the virtual scene and carrying out auditory sensory adjustment on the background sound intensity and/or the background music style type of the scene on the educational interactive game scene, the educational interactive game scene can be ensured to be capable of timely adapting to the requirement of a game interactive object, thereby improving the teaching interestingness of related courses and improving the execution quality and efficiency of intelligent education.
As can be seen from the above description of the embodiments, the intelligent education system and method based on game interaction are configured to obtain course education data about a certain subject, generate corresponding education-related image data and/or education-related sound data according to the course education data, design an education interaction game scene matching the certain subject according to the education-related image data and the education-related sound data, and acquire dynamic information about a game interaction object during the operation of the education interaction game scene, so as to adjust an interaction presentation state of the education interaction game scene according to the dynamic information; therefore, the intelligent education system and the intelligent education method based on the game interaction can design the education interactive game scene in a targeted manner according to the corresponding course education data so as to facilitate course teaching in the education interactive game scene, thereby improving the teaching interestingness of related courses, and can detect the dynamic information of a game interactive object in the course education process in real time so as to adjust the education interactive game scene adaptively, thereby being beneficial to improving the execution quality and efficiency of intelligent education.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (10)

1. Intelligent education system based on game interaction, its characterized in that:
the intelligent education system based on game interaction comprises an education related data generation module, an education interaction game scene design module, a dynamic information generation module and an education interaction game scene adjustment module; wherein,
the education related data generation module is used for generating corresponding education related image data and/or education related sound data according to course education data related to a certain subject;
the education interactive game scene design module is used for designing and obtaining an education interactive game scene matched with the certain subject according to the education related image data and the education related sound data;
the dynamic information generation module is used for generating dynamic information about a game interaction object in the running process of the education interaction game scene;
and the education interactive game scene adjusting module is used for adjusting the interactive presenting state of the education interactive game scene according to the dynamic information.
2. An intelligent educational system based on game interaction, according to claim 1, wherein:
the education related data generation module comprises a course education data submodule, a noise reduction preprocessing submodule, a first combination processing submodule and a second combination processing submodule; wherein,
the course education data submodule is used for acquiring course education text data, course education picture data and course education sound data related to a certain subject;
the noise reduction preprocessing submodule is used for carrying out noise reduction preprocessing on the course education text data, the course education picture data and the course education sound data;
the first combined processing submodule is used for performing character-picture superposition processing and picture coherent combination processing on the course character data and the course education picture data subjected to the noise reduction preprocessing so as to obtain the education-related image data;
the second combination processing sub-module is used for respectively carrying out sound coherent combination processing on the course sound data subjected to the noise reduction processing so as to obtain the education related sound data.
3. An intelligent educational system based on game interaction, according to claim 1, wherein:
the educational interactive game scene design module comprises a play time axis determining submodule, an initial game scene forming submodule and an educational interactive game scene generating submodule; wherein,
the playing time axis determining submodule is used for carrying out time cooperative processing on the image components in the education-related image data and the sound components in the education-related sound data so as to determine a playing time axis between the education-related image data and the education-related sound data;
the initial game scene forming submodule is used for combining the education related image data and the education related sound data according to the playing time axis so as to obtain an initial game scene;
and the education interactive game scene generation submodule is used for performing scene color rendering processing and virtual three-dimensional conversion processing on the initial game scene so as to form the education interactive game scene.
4. An intelligent educational system based on game interaction, according to claim 1, wherein:
the dynamic information generation module comprises an image shooting submodule, a sound acquisition submodule, a first dynamic information forming submodule and a second dynamic information forming submodule; wherein,
the image shooting submodule is used for shooting the multi-angle image of the game interaction object in the running process of the education interaction game scene;
the sound acquisition submodule is used for acquiring sound of the game interaction object in multiple directions in the operation process of the education interaction game scene;
the first dynamic information forming sub-module is used for identifying and extracting a face area and/or a limb area of a dynamic image obtained by image shooting, so as to correspondingly generate face dynamic change information and/or limb dynamic change information as part of the dynamic information;
the second dynamic information forming submodule is used for identifying and extracting sound intensity and/or tone of the sound signal obtained by sound collection, and accordingly generating sound intensity change information and/or tone change information as part of the dynamic information.
5. An intelligent educational system based on game interaction, according to claim 1, wherein:
the educational interactive game scene adjusting module comprises a first scene adjusting submodule and a second scene adjusting submodule; wherein,
the first scene adjusting submodule is used for adjusting the virtual scene image updating speed and/or the virtual scene brightness of the education interactive game scene according to the dynamic face change information and/or the dynamic limb change information corresponding to the game interactive object in the dynamic information;
and the second scene adjusting submodule is used for adjusting the scene background sound intensity and/or the scene background music style type of the education interactive game scene according to the sound intensity change information and/or the tone change information corresponding to the game interactive object in the dynamic information.
6. The intelligent education method based on game interaction is characterized by comprising the following steps of:
step S1, obtaining course education data about a certain subject, and generating corresponding education related image data and/or education related sound data according to the course education data;
step S2, according to the education-related image data and the education-related sound data, an education interactive game scene matched with the certain subject is designed;
step S3, collecting dynamic information about game interaction objects in the operation process of the education interaction game scene;
and step S4, adjusting the interactive presenting state of the education interactive game scene according to the dynamic information.
7. An intelligent educational method based on game interaction according to claim 6, wherein:
in the step S1, the step of obtaining the course education material related to a certain subject and generating the corresponding education-related image data and/or education-related sound data according to the course education material specifically includes,
step S101, obtaining course education text data, course education picture data and course education sound data of a certain subject, and performing noise reduction pretreatment on the course education text data, the course education picture data and the course education sound data;
step S102, the course text data and the course education picture data which are processed by the noise reduction pretreatment are subjected to text-picture superposition processing and picture coherent combination processing so as to obtain the education-related image data, and the picture superposition value of the course text data and the course education picture data which are subjected to the noise reduction pretreatment are subjected to the text-picture superposition processing and the picture coherent combination processing is obtained by using the following formula (1)
Figure FDA0002510168440000041
In the above formula (1), t (t) represents a picture superimposition value at the t-th time instant, ai(t) denotes an ith matrix point of the image matrix of the course education picture at the t-th time instant, i denotes an ith matrix point of the image matrix of the course education picture, and m denotes a total number of matrix points of the image matrix of the course education picture. Δ tsIs expressed at Δ tsWithin a time (and at Δ t)sThe course text data and the course education picture preprocessed by noise reduction in each time are all within the t-delta tsThe lesson text data subjected to noise reduction preprocessing at each time moment is the same as a lesson education picture) s represents the lesson education picture subjected to noise reduction preprocessing at the s th time moment;
when T (t)<When 0, adding the characters of the chapter a into the picture according to the sequence of the character chapters of the course character data from the superposition value of the t-th time of the picture from small to large, and when T (t) appears>When 0, according to the character chapter sequence of the course character data the characters in chapter a +1 are divided into the characters from the t + delta tsAdding the superposition value of each time into the picture in the order from small to large, adding the chapters in sequence according to the step until the characters of all the chapters are added into the picture (wherein a represents the a-th chapter of the characters of the course character data, and when a is 1, t is 0), and then performing secondary superposition processing on the picture according to the sequence of the character chapters of the character data to finally obtain the education related image data;
step S103, respectively carrying out sound consecutive combination processing on the course sound data subjected to the noise reduction processing so as to obtain the education-related sound data, and utilizing the following formula (2) to match values of head and tail audios of all the course sound data subjected to the noise reduction processing
Figure FDA0002510168440000051
In the above-mentioned formula (2),
Figure FDA0002510168440000052
a matching value representing a tail sound matrix of the p-th sound and a head sound matrix of the q-th sound in the lesson sound data subjected to the noise reduction processing,
Figure FDA0002510168440000053
a j-th matrix point of a tail sound matrix representing a p-th sound in the lesson sound data subjected to the noise reduction processing,
Figure FDA0002510168440000054
j matrix point of the head sound matrix of the q sound in the curriculum sound material after the noise reduction processing;
and sequencing the matching values of the head and tail audio frequencies of all the course sound data subjected to the noise reduction treatment from small to large, and connecting the tail sound of the corresponding p-th sound and the head sound of the q-th sound according to the minimum value to obtain sound coherent combination so as to obtain the education related sound data.
8. An intelligent educational method based on game interaction according to claim 6, wherein:
in step S2, the step of designing an educational interactive game scenario matching the subject based on the educational related image data and the educational related sound data may include,
step S201 of performing time-collaborative processing on an image component in the education-related video data and a sound component in the education-related sound data to determine a playback time axis between the education-related video data and the education-related sound data, and determining a playback time axis between the education-related video data and the education-related sound data using the following formula (3)
Figure FDA0002510168440000061
In the above formula (3), QsA similarity value representing the time of the lesson education picture of the s-th noise reduction pre-process in the education-related image data and the initial time of the sound component in the education-related sound data, T representing the sound time of the first sound material of the sound component in the education-related sound data;
when Q issWhen 0, representing the course education picture time of the s-th noise reduction pre-processing and the sound time of the first sound data of the sound component in the education-related sound data, overlapping the first sound data of the sound component in the education-related sound data and the course education picture of the s-th noise reduction pre-processing to determine a playing time axis between the education-related image data and the education-related sound data;
step S202, combining the education related image data and the education related sound data according to the playing time axis to obtain an initial game scene;
step S203, performing scene color rendering processing and virtual three-dimensional conversion processing on the initial game scene to form the education interactive game scene.
9. An intelligent educational method based on game interaction according to claim 6, wherein:
in step S3, the collecting dynamic information about the game interaction object during the operation of the educational interactive game scene specifically includes,
step S301, in the operation process of the education interactive game scene, carrying out multi-angle image shooting and multi-directional sound acquisition on the game interactive object;
step S302, identifying and extracting a face area and/or a limb area of a dynamic image obtained by image shooting, and accordingly generating face dynamic change information and/or limb dynamic change information as part of the dynamic information;
step S303, performing recognition and extraction on the sound intensity and/or tone of the sound signal obtained by sound collection, so as to generate sound intensity variation information and/or tone variation information accordingly as a part of the dynamic information.
10. An intelligent educational method based on game interaction according to claim 6, wherein:
in step S4, the adjusting the interactive presentation status of the educational interactive game scene according to the dynamic information specifically includes,
step S401, adjusting the virtual scene image updating speed and/or the virtual scene brightness of the education interactive game scene according to the dynamic face change information and/or the dynamic limb change information corresponding to the game interactive object in the dynamic information;
step S402, adjusting the scene background sound intensity and/or the scene background music style type of the education interactive game scene according to the sound intensity change information and/or the tone change information corresponding to the game interactive object in the dynamic information.
CN202010458630.9A 2020-05-27 2020-05-27 Intelligent education system and method based on game interaction Pending CN111564064A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010458630.9A CN111564064A (en) 2020-05-27 2020-05-27 Intelligent education system and method based on game interaction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010458630.9A CN111564064A (en) 2020-05-27 2020-05-27 Intelligent education system and method based on game interaction

Publications (1)

Publication Number Publication Date
CN111564064A true CN111564064A (en) 2020-08-21

Family

ID=72073607

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010458630.9A Pending CN111564064A (en) 2020-05-27 2020-05-27 Intelligent education system and method based on game interaction

Country Status (1)

Country Link
CN (1) CN111564064A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112017496A (en) * 2020-08-30 2020-12-01 上海松鼠课堂人工智能科技有限公司 Student computing power analysis method based on game learning
CN114733195A (en) * 2022-04-07 2022-07-12 平安科技(深圳)有限公司 Game resource allocation method, device, equipment and medium based on bilateral adaptation

Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100092930A1 (en) * 2008-10-15 2010-04-15 Martin Fletcher System and method for an interactive storytelling game
CN101719326A (en) * 2009-12-31 2010-06-02 博采林电子科技(深圳)有限公司 Game type learning system and method
CN102567626A (en) * 2011-12-09 2012-07-11 江苏矽岸信息技术有限公司 Interactive language studying system in mother language study type teaching mode
TW201333902A (en) * 2012-02-07 2013-08-16 Univ Nat Chiao Tung An educational gaming device for learning evolution
CN104575132A (en) * 2015-01-14 2015-04-29 蝶恋花动漫(天津)有限公司 Interaction education method and system based on natural image recognition and reality augmentation technology
CN105810035A (en) * 2016-03-16 2016-07-27 深圳市育成科技有限公司 Situational interactive cognitive teaching system and teaching method thereof
CN106502402A (en) * 2016-10-25 2017-03-15 四川农业大学 A kind of Three-Dimensional Dynamic Scene Teaching system and method
CN107102726A (en) * 2017-03-14 2017-08-29 深圳市吉美文化科技有限公司 A kind of preschool education system based on AR
CN107731038A (en) * 2017-11-17 2018-02-23 浙江建设职业技术学院 A kind of interactive game tutoring system and method
CN108538117A (en) * 2018-03-29 2018-09-14 华中师范大学 A kind of body feeling interaction method and system for Informalized teaching
CN108597279A (en) * 2018-04-13 2018-09-28 广东蓝盾乐庚技术信息有限公司 A kind of integrated form safety of student emergency education system
CN108961881A (en) * 2018-08-06 2018-12-07 林墨嘉 A kind of the intelligent scene building and system of real-time interactive
CN110069139A (en) * 2019-05-08 2019-07-30 上海优谦智能科技有限公司 VR technology realizes the experiencing system of Tourism teaching practice
CN110264826A (en) * 2019-06-11 2019-09-20 西安电子科技大学 Attending classes system and method based on virtual reality
CN110751867A (en) * 2019-11-27 2020-02-04 上海乂学教育科技有限公司 English teaching system
CN110767005A (en) * 2019-09-26 2020-02-07 北京光年无限科技有限公司 Data processing method and system based on intelligent equipment special for children
CN110867106A (en) * 2019-12-03 2020-03-06 上海乂学教育科技有限公司 Chinese teaching system
CN110908518A (en) * 2019-12-03 2020-03-24 上海乂学教育科技有限公司 Mathematical teaching system based on virtual reality
CN111145316A (en) * 2019-12-26 2020-05-12 上海乂学教育科技有限公司 Teaching animation production system

Patent Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100092930A1 (en) * 2008-10-15 2010-04-15 Martin Fletcher System and method for an interactive storytelling game
CN101719326A (en) * 2009-12-31 2010-06-02 博采林电子科技(深圳)有限公司 Game type learning system and method
CN102567626A (en) * 2011-12-09 2012-07-11 江苏矽岸信息技术有限公司 Interactive language studying system in mother language study type teaching mode
TW201333902A (en) * 2012-02-07 2013-08-16 Univ Nat Chiao Tung An educational gaming device for learning evolution
CN104575132A (en) * 2015-01-14 2015-04-29 蝶恋花动漫(天津)有限公司 Interaction education method and system based on natural image recognition and reality augmentation technology
CN105810035A (en) * 2016-03-16 2016-07-27 深圳市育成科技有限公司 Situational interactive cognitive teaching system and teaching method thereof
CN106502402A (en) * 2016-10-25 2017-03-15 四川农业大学 A kind of Three-Dimensional Dynamic Scene Teaching system and method
CN107102726A (en) * 2017-03-14 2017-08-29 深圳市吉美文化科技有限公司 A kind of preschool education system based on AR
CN107731038A (en) * 2017-11-17 2018-02-23 浙江建设职业技术学院 A kind of interactive game tutoring system and method
CN108538117A (en) * 2018-03-29 2018-09-14 华中师范大学 A kind of body feeling interaction method and system for Informalized teaching
CN108597279A (en) * 2018-04-13 2018-09-28 广东蓝盾乐庚技术信息有限公司 A kind of integrated form safety of student emergency education system
CN108961881A (en) * 2018-08-06 2018-12-07 林墨嘉 A kind of the intelligent scene building and system of real-time interactive
CN110069139A (en) * 2019-05-08 2019-07-30 上海优谦智能科技有限公司 VR technology realizes the experiencing system of Tourism teaching practice
CN110264826A (en) * 2019-06-11 2019-09-20 西安电子科技大学 Attending classes system and method based on virtual reality
CN110767005A (en) * 2019-09-26 2020-02-07 北京光年无限科技有限公司 Data processing method and system based on intelligent equipment special for children
CN110751867A (en) * 2019-11-27 2020-02-04 上海乂学教育科技有限公司 English teaching system
CN110867106A (en) * 2019-12-03 2020-03-06 上海乂学教育科技有限公司 Chinese teaching system
CN110908518A (en) * 2019-12-03 2020-03-24 上海乂学教育科技有限公司 Mathematical teaching system based on virtual reality
CN111145316A (en) * 2019-12-26 2020-05-12 上海乂学教育科技有限公司 Teaching animation production system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
卜新章: "全媒体融合报道虚拟仿真实验教学项目的建设探索", 《实验室研究与探索》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112017496A (en) * 2020-08-30 2020-12-01 上海松鼠课堂人工智能科技有限公司 Student computing power analysis method based on game learning
CN114733195A (en) * 2022-04-07 2022-07-12 平安科技(深圳)有限公司 Game resource allocation method, device, equipment and medium based on bilateral adaptation

Similar Documents

Publication Publication Date Title
Ginosar et al. Learning individual styles of conversational gesture
EP4184927A1 (en) Sound effect adjusting method and apparatus, device, storage medium, and computer program product
Arandjelovic et al. Look, listen and learn
WO2021114881A1 (en) Intelligent commentary generation method, apparatus and device, intelligent commentary playback method, apparatus and device, and computer storage medium
CN111970568B (en) Method and system for interactive video playing
CN105632263A (en) Augmented reality-based music enlightenment learning device and method
CN110652726B (en) Game auxiliary system based on image recognition and audio recognition
CN111147871B (en) Singing recognition method and device in live broadcast room, server and storage medium
Ghose et al. Foleygan: Visually guided generative adversarial network-based synchronous sound generation in silent videos
CN111564064A (en) Intelligent education system and method based on game interaction
CN106982357A (en) A kind of intelligent camera system based on distribution clouds
US20230039540A1 (en) Automated pipeline selection for synthesis of audio assets
CN114007064B (en) Special effect synchronous evaluation method, device, equipment and storage medium
Sexton et al. Automatic CNN-based enhancement of 360° video experience with multisensorial effects
CN117079501A (en) Virtual person self-adjusting teaching cloud platform, system, method and related equipment
CN107888974A (en) A kind of instant video synthetic method and system based on scene or special object
CN114117096B (en) Multimedia data processing method and related equipment
CN111768729A (en) VR scene automatic explanation method, system and storage medium
CN115455230A (en) Dance generation method and system
CN108429932A (en) Method for processing video frequency and device
CN116561294A (en) Sign language video generation method and device, computer equipment and storage medium
CN115604529A (en) Audio-driven motion synthesis method and device
CN114697741A (en) Multimedia information playing control method and related equipment
Abdelnour et al. From visual to acoustic question answering
CN117592384B (en) Active sound wave generation method based on generation countermeasure network

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 200237 9 / F and 10 / F, building 2, No. 188, Yizhou Road, Xuhui District, Shanghai

Applicant after: Shanghai squirrel classroom Artificial Intelligence Technology Co.,Ltd.

Address before: 200237 9 / F and 10 / F, building 2, No. 188, Yizhou Road, Xuhui District, Shanghai

Applicant before: SHANGHAI YIXUE EDUCATION TECHNOLOGY Co.,Ltd.

CB02 Change of applicant information
AD01 Patent right deemed abandoned

Effective date of abandoning: 20221206

AD01 Patent right deemed abandoned