CN113436489A - Study leaving experience system and method based on virtual reality - Google Patents

Study leaving experience system and method based on virtual reality Download PDF

Info

Publication number
CN113436489A
CN113436489A CN202110642263.2A CN202110642263A CN113436489A CN 113436489 A CN113436489 A CN 113436489A CN 202110642263 A CN202110642263 A CN 202110642263A CN 113436489 A CN113436489 A CN 113436489A
Authority
CN
China
Prior art keywords
user
study
data
virtual reality
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110642263.2A
Other languages
Chinese (zh)
Inventor
李静
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen University
Original Assignee
Shenzhen University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen University filed Critical Shenzhen University
Priority to CN202110642263.2A priority Critical patent/CN113436489A/en
Publication of CN113436489A publication Critical patent/CN113436489A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes

Abstract

The invention discloses a study leaving experience system and a study leaving experience method based on virtual reality, wherein the system comprises virtual reality wearing equipment, intelligent sensing equipment, audio input equipment, audio output equipment, meteorological simulation equipment and a virtual reality database; the intelligent sensing equipment is used for acquiring action data of a user; the audio input equipment is used for acquiring voice data of a user; the audio output equipment is used for outputting the acquired voice to a user; the meteorological simulation equipment is used for simulating corresponding meteorological data according to the data selected by the user for reservation; the virtual reality wearing equipment is used for acquiring the study reservation data selected by the user and the action data of the user and displaying the corresponding virtual reality scene; and the virtual reality database is used for storing all object models in virtual reality. The embodiment of the invention can realize the study leaving experience without going out of the country, can be beneficial to improving the language and foreign adaptation capability of the user and provides help for the study leaving of the user.

Description

Study leaving experience system and method based on virtual reality
Technical Field
The invention relates to the technical field of virtual reality, in particular to a study leaving experience system and a study leaving experience method based on virtual reality.
Background
In the current world with the continuous development of economic globalization and increasingly frequent international communication, people have increasing needs for study reservation in order to accept foreign education and improve education level. Due to the problems of study-reserving cost, space distance and foreign adaptability, many people cannot go to foreign countries for study-reserving and cannot obtain study-reserving experience, and a study-reserving mechanism also needs to provide preliminary experience for students who intend to study-reserving.
Existing ways of providing a retention experience include at least two: firstly, the user can listen to and watch the foreign scenes through the existing audio and video and communication means or communicate with specific foreign education. This approach does not provide an immersive experience, has limited scenes that can be experienced, and has a limited degree of user interaction with the scenes during the process. The other is to physically reproduce a specific foreign scene in the modes of clothing, scenery, props and the like and enable workers to play characters in the scene so as to achieve the purpose of study-keeping experience. This approach is very costly and has poor flexibility.
Accordingly, the prior art is yet to be improved and developed.
Disclosure of Invention
In view of the defects of the prior art, the invention aims to provide a study leaving experience system and a study leaving experience method based on virtual reality, and aims to solve the problems that in the prior art, due to higher study leaving cost, high spatial distance and foreign adaptation capability, many people cannot go to foreign countries for study leaving and cannot carry out study leaving experience on the spot, and the existing simulation study leaving experience mode often has the problems of insufficient immersion feeling, limited scenes, poor flexibility, higher cost and the like.
The technical scheme of the invention is as follows:
a study leaving experience system based on virtual reality comprises virtual reality wearing equipment, intelligent sensing equipment, audio input equipment, audio output equipment, meteorological simulation equipment and a virtual reality database, wherein the virtual reality wearing equipment is respectively connected with the sensing equipment, the audio input equipment, the audio output equipment, the weather simulation equipment and the virtual reality database;
the intelligent sensing equipment is used for acquiring action data of a user;
the audio input equipment is used for acquiring voice data of a user;
the audio output equipment is used for outputting the acquired voice to a user;
the meteorological simulation equipment is used for simulating corresponding meteorological data according to the data selected by the user for study;
the virtual reality wearing equipment is used for acquiring the study reservation data selected by the user and the action data of the user and displaying the corresponding virtual reality scene;
and the virtual reality database is used for storing all object models in virtual reality.
Furthermore, the virtual reality wearable device is further used for obtaining the study-reserving language, study-reserving countries, cities, blocks and streets selected by the user, displaying the corresponding 3D street scenes, detecting the action data of the user and displaying the corresponding mobile scenes.
Further preferably, the intelligent sensing device comprises a limb sensing module,
the limb induction module is used for collecting limb data of a user and acquiring instructions corresponding to the limb data.
Preferably, the virtual reality database is further configured to match a target user of the study-reserving country according to the study-reserving language and the study-reserving country selected by the user, acquire voice data of the user through an audio input device, acquire dialogue data output by the target user, and output the dialogue data through an audio output device, so that real-time interconnection between the target user and the current user is achieved.
Preferably, the system further comprises an AI voice database,
the AI voice database is used for generating virtual characters according to artificial intelligence, collecting voice data of a user through an audio input device, controlling the virtual characters to output corresponding conversation data, and outputting the conversation data through an audio output device.
Furthermore, the AI voice database also comprises a vocabulary database, a customized dialogue database and an intelligent question-answering database;
the vocabulary database is used for providing selected professional vocabularies, application vocabularies and common sentences for the virtual roles to select;
the customized dialogue database is used for quickly extracting effective information from long document sentences, making a response and completing the dialogue;
the intelligent question-answer database is used for enabling the virtual character to make coherent and intelligent dialogue data by means of statement context.
Another embodiment of the present invention further provides an academic experience method based on the above-mentioned academic experience system based on virtual reality, and the method includes:
detecting a study reservation experience request of a user, and acquiring study reservation data of the user;
analyzing the study reservation data, generating a corresponding virtual reality scene according to the study reservation data, and simulating meteorological data of a study reservation destination according to the study reservation data;
and acquiring user action data, changing the virtual reality scene according to the data of leaving study and the action data selected by the user, and displaying the changed virtual reality scene to the user.
Further, the analyzing the data of leaving study and generating a corresponding virtual reality scene according to the data of leaving study includes:
analyzing the study reservation data to obtain study reservation languages, study reservation countries, cities, blocks and street data corresponding to study reservation destinations;
and generating corresponding virtual reality scene data according to the study reservation language, study reservation country, city, block and street data corresponding to the study reservation destination.
Furthermore, after analyzing the data of leaving school, generating a corresponding virtual reality scene according to the data of leaving school, and simulating meteorological data of a destination of leaving school according to the data of leaving school, the method comprises the following steps:
matching the target user with the attribution being the study reservation destination from the virtual reality database according to the study reservation data, and judging whether the matching is successful;
and if the matching is successful, constructing a virtual reality scene of the user and the target user in the same scene, and acquiring the dialogue data of the user and the target user.
Further, the matching, according to the study record data, the target user whose attribution is the study record destination from the virtual reality database, and after judging whether the matching is successful, the method further includes:
if the matching fails, generating a virtual role through an AI database;
and constructing a virtual reality scene in which the user and the virtual character are in the same scene, and collecting the dialogue data between the user and the virtual character.
Has the advantages that: the embodiment of the invention can realize the study leaving experience without going out of the country, can be beneficial to improving the language and foreign adaptation capability of the user and provides help for the study leaving of the user.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
FIG. 1 is a functional block diagram of a preferred embodiment of a virtual reality-based retention experience system according to the present invention;
FIG. 2 is a flowchart of an embodiment of an experience-leaving method of an experience-leaving system based on virtual reality.
Detailed Description
In order to make the objects, technical solutions and effects of the present invention clearer and clearer, the present invention is described in further detail below. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Embodiments of the present invention will be described below with reference to the accompanying drawings.
An embodiment of the present invention provides a study leaving experience system based on virtual reality, please refer to fig. 1, where fig. 1 is a functional structure diagram of a preferred embodiment of a study leaving experience system based on virtual reality. As shown in fig. 1, the intelligent weather simulation system comprises a virtual reality wearable device, an intelligent sensing device, an audio input device, an audio output device, a weather simulation device and a virtual reality database, wherein the virtual reality wearable device is respectively connected with the sensing device, the audio input device, the audio output device, the weather simulation device and the virtual reality database;
the intelligent sensing equipment is used for acquiring action data of a user;
the audio input equipment is used for acquiring voice data of a user;
the audio output equipment is used for outputting the acquired voice to a user;
the meteorological simulation equipment is used for simulating corresponding meteorological data according to the data selected by the user for reservation;
the virtual reality wearing equipment is used for acquiring the study reservation data selected by the user and the action data of the user and displaying the corresponding virtual reality scene;
and the virtual reality database is used for storing all object models in virtual reality.
In specific implementation, the virtual reality wearable device in the embodiment of the invention adopts VR glasses, and the audio input device can adopt a radio microphone to collect the sound of a user. The audio output device can be realized by adopting an earphone. The intelligent induction device is realized by adopting a body sensing ring. The virtual reality database stores a GPS real-time map, an immersive 3D scene can be constructed through VR glasses, and meanwhile, the meteorological simulation equipment can also synchronize corresponding real-time meteorological conditions according to a reservation destination selected by a user.
The virtual reality terminal is connected through the glasses, the earphone, the radio microphone and the somatosensory ring. The glasses provide a truly simulated street view for the user, and a three-dimensional architectural image is presented; the earphone and the microphone are convenient for a user to finish communication through listening and speaking; the motion state of the user is monitored and transmitted by the motion sensing ring. The four devices are worn at the same time, so that the user can be assisted to obtain virtual study-keeping experience better.
The study leaving experience system of the embodiment of the invention is an urban scene reproduction system combining a real-time environment and virtual reality, and aims to help a user to get rid of the restriction of time and space, conveniently obtain the full-true simulation experience of study leaving life and realize multiple effects of self-evaluation, language learning and pre-adaptation.
Furthermore, the virtual reality wearable device is further used for obtaining study-reserving languages, study-reserving countries, cities, blocks and streets selected by the user, displaying corresponding 3D street scenes, detecting action data of the user and displaying corresponding mobile scenes.
During specific implementation, the virtual reality wearable device can acquire study reservation data input by a user or input by a voice command, selects languages, countries, cities, blocks and streets in the study reservation data, constructs an immersive 3D scene and a synchronous real-time meteorological condition through a GPS real-time map, and enhances the reality degree of experience by using an overlapped embedding space.
Furthermore, the intelligent sensing equipment comprises a limb sensing module, and the limb sensing module is used for acquiring limb data of the user and acquiring an instruction corresponding to the limb data.
In specific implementation, the indication action of the user can be embodied in a virtual scene by means of the induction system, and intelligent interaction experience of walking shuttle and greeting communication is realized. The intelligent sensing equipment comprises a limb sensing module, wherein the limb sensing module is used for acquiring limb data of a user and acquiring an instruction corresponding to the limb data. The limb induction module comprises a step induction unit and a body part action induction unit. The step sensing unit indicates that the static or walking state (including the step indication actions such as forward, backward, left turn, right turn) of the user can be recorded, transmitted and displayed in the virtual reality scene of the system by the sensing system. The mobile scenario can load an accurate route planner with travel route instructions. The body part motion sensing unit indicates that hand motions (such as lifting, waving, pushing forward and the like) of a user can be transmitted to the system through the sensing device of the motion sensing ring, and the user images of the motions in the virtual scene are displayed through motion data analysis. The intelligent sensing system is beneficial to users to obtain more real environment experience, enhances the sense of immersion and promotes the participation degree of study-leaving life experience. The body part induction realizes the limb communication, and the user can improve the spoken language ability and the study-staying living standard in a full-true simulation conversation and communication mode through multi-level and all-around interpersonal communication.
Furthermore, the body sensing ring is provided with a sensing device comprising a force-sensitive resistor, when the motion of the hand changes, the shape of the ring changes correspondingly due to the actions of pushing, pulling, swinging, surrounding and the like, the stretching, squeezing, space displacement change (overturning, shaking and the like) of the ring can enable the sensor to generate corresponding analog signals and transmit the analog signals to the handle, and the handle transmits the wireless signals to the host. The leg action is detected by the gyroscope of the motion sensing ring according to the state and the angle vertical to/parallel to the ground, and further transmitted to the handle and the host. The user's walking and stillness, forward and backward can be transmitted by the system, displayed in the virtual user state. Therefore, on the premise of being provided with the motion sensing ring, the user does not need to be restricted by special environment.
Furthermore, the virtual reality database is also used for matching a target user of the study-reserving country according to the study-reserving language and the study-reserving country selected by the user, acquiring voice data of the user through audio input equipment, acquiring dialogue data output by the target user, and outputting the dialogue data through the audio output equipment to realize real-time interconnection between the target user and the current user.
In specific implementation, users at home and abroad can be interconnected online in real time by means of platforms built by the system to play different roles, and live-action conversation and mutual learning are carried out in each virtual reality scene, so that the reasonable utilization of resources is realized.
Further, the system also comprises an AI voice database,
and the AI voice database is used for generating a virtual character according to artificial intelligence, acquiring voice data of a user through the audio input equipment, controlling the virtual character to output corresponding conversation data and outputting the conversation data through the audio output equipment.
In specific implementation, the system also introduces artificial intelligence based on an AI voice database to play a virtual role in consideration of the time difference problem of the time zone in which the user is positioned and the problem of unbalanced quantity and quality of online users in different areas. Various fields and service models can be used as theoretical support for building and introducing an AI voice database. Based on the field model customization, the language processing platform can help the artificial intelligence to realize the functions of text classification, grammar analysis, information extraction, emotion recognition and the like, and the practical application of the artificial intelligence is quickly realized through automatic modeling and model training. The domain ontology construction based on the semantic dictionary can refer to the relations among the narrative words, organize and integrate the relations in the domain ontology, add examples to concepts, further clarify professional terms and promote sharing between users and virtual roles.
Furthermore, the AI voice database also comprises a vocabulary database, a customized dialogue database and an intelligent question-answer database;
the vocabulary database is used for providing selected professional vocabularies, application vocabularies and common sentences for the virtual roles to select;
the customized dialogue database is used for quickly extracting effective information from the long document sentence, making a response and completing the dialogue;
the intelligent question-answer database is used for enabling the virtual character to make coherent and intelligent dialogue data by means of statement context.
When the system is implemented specifically, the vocabulary database can provide professional vocabularies, application vocabularies and common sentences for artificial intelligence, and help virtual roles to cooperate with users to complete scene communication. The conversation flow is driven by a natural language understanding technology (NLU), so that the language expression of a user can be immediately understood without the limitation of places and spaces, effective information can be quickly extracted from long-document sentences, a response is made, and the conversation is completed. In a custom dialog system, artificial intelligence can learn from the dialog flow, becoming more intelligent by talking to the user, improving the ability of the virtual character to make personalized responses. In the autonomous learning process, artificial intelligence can improve the humanization of conversation and realize the insertion and circulation of complex topics by dynamically generating dialogues. The intelligent question-answering system with the effective short-term memory capacity is implanted, so that the virtual character can make a coherent and intelligent response by means of the context of the statement. The knowledge service system model can bring better experience and experience of spoken language practice and language learning to the user through knowledge acquisition, construction, service and innovation.
After the user logs in the study-reserving environment experience system, the user can store personal login information, and grade promotion is achieved according to activity frequency and the conversation completion degree of the life scene. After the activities of every day are finished, the user can select whether to key in or export the language points in the personal study reservation database, and the arrangement and summary of the virtual study reservation data can be quickly finished. In the virtual world, after the user reaches a certain level in the non-native language target language map, the user can apply the corresponding job position by completing the professional language examination. Through the online conversation interconnection with the native language learner, the archiving and exporting of the language points and the training of the professional examination of the foreign language, the user can really realize the improvement of the language level and the improvement of the study-leaving ability in the study-leaving environment experience system.
Referring to fig. 2, fig. 2 is a flowchart of a preferred embodiment of an academic experience method of an academic experience system based on virtual reality. The method comprises the following steps:
s100, detecting a study leaving experience request of a user, and acquiring study leaving data of the user;
s200, analyzing the study reservation data, generating a corresponding virtual reality scene according to the study reservation data, and simulating meteorological data of a study reservation destination according to the study reservation data;
and S300, acquiring user action data, changing the virtual reality scene according to the study reservation data and the action data selected by the user, and displaying the changed virtual reality scene to the user.
During concrete implementation, a user enters the study reservation experience system based on virtual reality through login, when the user needs to carry out study reservation experience, study reservation data such as study reservation languages, study reservation countries and the like which need to be experienced can be selected according to own needs, the system can analyze study reservation destinations according to the study reservation data, corresponding 3D maps are loaded, real-time meteorological data of the study reservation destinations are obtained through a network, corresponding real-time meteorological data are simulated, and immersive experience is generated. The user can move forward or backward as required, the system obtains instructions such as forward or backward, the instructions are converted into corresponding moving distances according to destination data and action data selected by the user, the instructions are changed in the virtual reality scene, and the changed virtual scene is displayed to the user.
Furthermore, analyzing the study reservation data, and generating a corresponding virtual reality scene according to the study reservation data, comprising:
analyzing the study reservation data to obtain study reservation languages, study reservation countries, cities, blocks and street data corresponding to study reservation destinations;
and generating corresponding virtual reality scene data according to the study reservation language, study reservation country, city, block and street data corresponding to the study reservation destination.
During specific implementation, languages, countries, cities, blocks and streets in the study reservation data are selected, the immersion type 3D scene is built through the GPS real-time map, and the reality sense of experience is increased for the user.
Furthermore, after analyzing the study reservation data, generating a corresponding virtual reality scene according to the study reservation data, and simulating meteorological data of a study reservation destination according to the study reservation data, the method comprises the following steps:
matching the target user with the attribution being the study reservation destination from the virtual reality database according to the study reservation data, and judging whether the matching is successful;
and if the matching is successful, constructing a virtual reality scene of the user and the target user in the same scene, and acquiring the dialogue data of the user and the target user.
In specific implementation, users at home and abroad can be interconnected online in real time by means of platforms built by the system to play different roles, and live-action conversation and mutual learning are carried out in each virtual reality scene, so that the reasonable utilization of resources is realized.
Further, matching the target user whose attribution is the study reservation destination from the virtual reality database according to the study reservation data, and after judging whether the matching is successful, the method further comprises the following steps:
if the matching fails, generating a virtual role through an AI database;
and constructing a virtual reality scene in which the user and the virtual character are in the same scene, and collecting the dialogue data between the user and the virtual character.
In specific implementation, the system also introduces artificial intelligence based on an AI voice database to play a virtual role in consideration of the time difference problem of the time zone in which the user is positioned and the problem of unbalanced quantity and quality of online users in different areas. The virtual reality scene that the user and the virtual character are in the same scene is established, the dialogue data between the user and the virtual character are collected, the dialogue between the user and the virtual character is realized, and convenience is provided for the user to experience the related scene.
The invention also provides a first embodiment of the study leaving experience method of the study leaving experience system based on the virtual reality, which takes the study leaving experience system based on the virtual reality as a study leaving environment experience classroom as an example, and the implementation mode is as follows:
and the user A enters a study-leaving environment experience classroom, completes wearing of the 3D glasses, the microphone and the motion sensing ring, inputs an exclusive account number and a password and logs in the system. The system displays user a ratings (e.g., medium). The user A selects a native language map, inputs a target province city, region and street (such as a south-mountain region south-sea road in Shenzhen city in Guangdong province of China) according to the GPS real-time 3D map, enters a selected scene, and the system displays the real-time meteorological conditions (such as cloudy) on the same day. After the user A selects the pace, the user A starts to travel until the user enters a certain workplace to play a role of working (such as a counter of a branch bank of China Bank). The user A communicates with the user B with the non-native language by using the native language and waves the sign to successfully handle the service for the user A. After X1 minutes, UserA received a gold award. The user A exits the native language map, and the system displays that the user A has worked in the native language map for X2 days, earns gold X3 and has been upgraded X4.
The invention also provides a second embodiment of the study leaving experience method of the study leaving experience system based on the virtual reality, which comprises the following steps:
user a enters the system home page, selects a target language map, inputs the target country, province, region, street (e.g., call portalla, Madrid,
Figure BDA0003108415880000111
) Entering a selected scene, and displaying the real-time weather conditions of the day by the system (such as: clear). The user A starts to travel after selecting the pace until the user A moves to a cardio instrument place (such as BAR Alkala Nahar) and makes a door-pushing gesture for entering. And the user A communicates with the native language user C by using the target language, and successfully purchases the goods A by using the gold coins. In order to apply the scene work role, the user A participates in a non-native language map work professional language examination (such as a Spanish restaurant service role language examination), goes on post smoothly, communicates with a non-native language user D by using a target language, and obtains a gold coin reward after working for X5 minutes. The user A exits the target language map, the system displays that the user A has worked in the target language map for X6 days, the life element completion degree is X7, the gold coin spent is X8, the gold coin earned is X9, and the grade is increased by X10.
The user A is prepared to quit the system, the dialogue records in the target language map are screened, partial sentences and vocabularies are filed and enter a personal record library, and personalized learning records are exported. User a exits the system leaving the study-reserving environment experience classroom.
From the above embodiments, the invention provides an academic experience method of the academic experience system based on virtual reality, and a user can select an environment by screening languages, countries, cities, blocks and streets, and complete the connection of the virtual reality terminal through glasses, earphones, a radio microphone and a somatosensory ring. The glasses provide a truly simulated street view for the user, and a three-dimensional architectural image is presented; the earphone and the microphone are convenient for a user to finish communication through listening and speaking; the motion state of the user is monitored and transmitted by the motion sensing ring. The four devices are worn at the same time, so that the user can be assisted to obtain virtual study-keeping experience better.
The above described embodiments are merely illustrative, wherein elements illustrated as separate components may or may not be physically separate, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the embodiment.
Through the above description of the embodiments, those skilled in the art can clearly understand that the embodiments can be implemented by means of software and a general hardware platform. Based on such understanding, the above technical solutions essentially or contributing to the related art can be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of the various embodiments or some parts of the embodiments.
Conditional language such as "can," "might," or "may" is generally intended to convey that a particular embodiment can include (yet other embodiments do not include) particular features, elements, and/or operations, among others, unless specifically stated otherwise or otherwise understood within the context as used. Thus, such conditional language is also generally intended to imply that features, elements, and/or operations are in any way required for one or more embodiments or that one or more embodiments must include logic for deciding, with or without input or prompting, whether such features, elements, and/or operations are included or are to be performed in any particular embodiment.
What has been described herein in this specification and the drawings includes examples that can provide a virtual reality based retention experience system. It will, of course, not be possible to describe every conceivable combination of components and/or methodologies for purposes of describing the various features of the disclosure, but it can be appreciated that many further combinations and permutations of the disclosed features are possible. It is therefore evident that various modifications can be made to the disclosure without departing from the scope or spirit thereof. In addition, or in the alternative, other embodiments of the disclosure may be apparent from consideration of the specification and drawings and from practice of the disclosure as presented herein. It is intended that the examples set forth in this specification and the drawings be considered in all respects as illustrative and not restrictive. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

Claims (10)

1. A study leaving experience system based on virtual reality is characterized by comprising virtual reality wearing equipment, intelligent sensing equipment, audio input equipment, audio output equipment, meteorological simulation equipment and a virtual reality database, wherein the virtual reality wearing equipment is respectively connected with the sensing equipment, the audio input equipment, the audio output equipment, the weather simulation equipment and the virtual reality database;
the intelligent sensing equipment is used for acquiring action data of a user;
the audio input equipment is used for acquiring voice data of a user;
the audio output equipment is used for outputting the acquired voice to a user;
the meteorological simulation equipment is used for simulating corresponding meteorological data according to the data selected by the user for study;
the virtual reality wearing equipment is used for acquiring the study reservation data selected by the user and the action data of the user and displaying the corresponding virtual reality scene;
and the virtual reality database is used for storing all object models in virtual reality.
2. The system of claim 1, wherein the virtual reality wearing device is further configured to obtain a study language, a study country, a city, a block, and a street selected by the user, display a corresponding 3D street scene, detect motion data of the user, and display a corresponding mobile scene.
3. The virtual reality based leaving school experience system according to claim 2, wherein said smart sensory device comprises a limb sensing module,
the limb induction module is used for collecting limb data of a user and acquiring instructions corresponding to the limb data.
4. The system of claim 3, wherein the virtual reality database is further configured to match a target user of the study-reserving country according to the study-reserving language and the study-reserving country selected by the user, acquire voice data of the user through an audio input device, obtain dialogue data output by the target user, and output the dialogue data through an audio output device, thereby realizing real-time interconnection between the target user and the current user.
5. The virtual reality based leaving experience system of claim 4, further comprising an AI voice database,
the AI voice database is used for generating virtual characters according to artificial intelligence, collecting voice data of a user through an audio input device, controlling the virtual characters to output corresponding conversation data, and outputting the conversation data through an audio output device.
6. The virtual reality-based leaving study experience system of claim 5, wherein the AI voice database further comprises a vocabulary database, a custom dialog database, an intelligent question-answer database;
the vocabulary database is used for providing selected professional vocabularies, application vocabularies and common sentences for the virtual roles to select;
the customized dialogue database is used for quickly extracting effective information from long document sentences, making a response and completing the dialogue;
the intelligent question-answer database is used for enabling the virtual character to make coherent and intelligent dialogue data by means of statement context.
7. An academic experience method of the virtual reality based academic experience system according to any one of claims 1-6, wherein the method comprises:
detecting a study reservation experience request of a user, and acquiring study reservation data of the user;
analyzing the study reservation data, generating a corresponding virtual reality scene according to the study reservation data, and simulating meteorological data of a study reservation destination according to the study reservation data;
and acquiring user action data, changing the virtual reality scene according to the data of leaving study and the action data selected by the user, and displaying the changed virtual reality scene to the user.
8. The study-leaving experience method of the virtual reality-based study-leaving experience system according to claim 7, wherein the analyzing the study-leaving data and generating the corresponding virtual reality scene according to the study-leaving data comprises:
analyzing the study reservation data to obtain study reservation languages, study reservation countries, cities, blocks and street data corresponding to study reservation destinations;
and generating corresponding virtual reality scene data according to the study reservation language, study reservation country, city, block and street data corresponding to the study reservation destination.
9. The method for studying and experiencing the virtual reality-based studying and experiencing system according to claim 8, wherein the analyzing the studying data, generating the corresponding virtual reality scene according to the studying data, and simulating the meteorological data of the studying destination according to the studying data comprises:
matching the target user with the attribution being the study reservation destination from the virtual reality database according to the study reservation data, and judging whether the matching is successful;
and if the matching is successful, constructing a virtual reality scene of the user and the target user in the same scene, and acquiring the dialogue data of the user and the target user.
10. The study-leaving experience method of the virtual reality-based study-leaving experience system according to claim 9, wherein the step of matching the target user who belongs to the study-leaving destination from the virtual reality database according to the study-leaving data and after judging whether the matching is successful further comprises:
if the matching fails, generating a virtual role through an AI database;
and constructing a virtual reality scene in which the user and the virtual character are in the same scene, and collecting the dialogue data between the user and the virtual character.
CN202110642263.2A 2021-06-09 2021-06-09 Study leaving experience system and method based on virtual reality Pending CN113436489A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110642263.2A CN113436489A (en) 2021-06-09 2021-06-09 Study leaving experience system and method based on virtual reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110642263.2A CN113436489A (en) 2021-06-09 2021-06-09 Study leaving experience system and method based on virtual reality

Publications (1)

Publication Number Publication Date
CN113436489A true CN113436489A (en) 2021-09-24

Family

ID=77755568

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110642263.2A Pending CN113436489A (en) 2021-06-09 2021-06-09 Study leaving experience system and method based on virtual reality

Country Status (1)

Country Link
CN (1) CN113436489A (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002269223A (en) * 2001-03-14 2002-09-20 Sony Corp Study-abroad support system
CN104115182A (en) * 2011-12-06 2014-10-22 韦俊诚 Foreign language acquisition and learning service providing method based on context-aware using smart device
CN104641399A (en) * 2012-02-23 2015-05-20 查尔斯·D·休斯顿 System and method for creating an environment and for sharing a location based experience in an environment
US20160012538A1 (en) * 2014-07-14 2016-01-14 Rerankable LLC Educational Decision-Making Tool
CN106648111A (en) * 2017-01-03 2017-05-10 京东方科技集团股份有限公司 Virtual reality device
CN106648048A (en) * 2016-09-18 2017-05-10 三峡大学 Virtual reality-based foreign language learning method and system
CN106774891A (en) * 2016-12-15 2017-05-31 北京小鸟看看科技有限公司 The audio effect generating method of virtual reality scenario, equipment and virtual reality device
CN107315470A (en) * 2017-05-25 2017-11-03 腾讯科技(深圳)有限公司 Graphic processing method, processor and virtual reality system
CN107403011A (en) * 2017-08-01 2017-11-28 三星电子(中国)研发中心 Reality environment language learning implementation method and automatic recording control method
CN108170262A (en) * 2016-12-08 2018-06-15 意美森公司 Tactile is around function
CN110633006A (en) * 2018-06-25 2019-12-31 意美森公司 Real world haptic interaction for virtual reality users

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002269223A (en) * 2001-03-14 2002-09-20 Sony Corp Study-abroad support system
CN104115182A (en) * 2011-12-06 2014-10-22 韦俊诚 Foreign language acquisition and learning service providing method based on context-aware using smart device
US20150010889A1 (en) * 2011-12-06 2015-01-08 Joon Sung Wee Method for providing foreign language acquirement studying service based on context recognition using smart device
CN104641399A (en) * 2012-02-23 2015-05-20 查尔斯·D·休斯顿 System and method for creating an environment and for sharing a location based experience in an environment
US20160012538A1 (en) * 2014-07-14 2016-01-14 Rerankable LLC Educational Decision-Making Tool
CN106648048A (en) * 2016-09-18 2017-05-10 三峡大学 Virtual reality-based foreign language learning method and system
CN108170262A (en) * 2016-12-08 2018-06-15 意美森公司 Tactile is around function
CN106774891A (en) * 2016-12-15 2017-05-31 北京小鸟看看科技有限公司 The audio effect generating method of virtual reality scenario, equipment and virtual reality device
CN106648111A (en) * 2017-01-03 2017-05-10 京东方科技集团股份有限公司 Virtual reality device
CN107315470A (en) * 2017-05-25 2017-11-03 腾讯科技(深圳)有限公司 Graphic processing method, processor and virtual reality system
CN107403011A (en) * 2017-08-01 2017-11-28 三星电子(中国)研发中心 Reality environment language learning implementation method and automatic recording control method
CN110633006A (en) * 2018-06-25 2019-12-31 意美森公司 Real world haptic interaction for virtual reality users

Similar Documents

Publication Publication Date Title
Shawai et al. Malay language mobile learning system (MLMLS) using NFC technology
CN111277706B (en) Application recommendation method and device, storage medium and electronic equipment
CN108536672A (en) Intelligent robot Training Methodology, device, computer equipment and storage medium
CN108897848A (en) Robot interactive approach, device and equipment
CN109275039B (en) Remote video interaction system and method
CN107300970A (en) Virtual reality exchange method and device
CN106200886A (en) A kind of intelligent movable toy manipulated alternately based on language and toy using method
CN109637207A (en) A kind of preschool education interactive teaching device and teaching method
JP2021071723A (en) Foreign language learning device, foreign language learning service providing method, and computer program
CN110598576A (en) Sign language interaction method and device and computer medium
CN111027486A (en) Auxiliary analysis and evaluation system and method for big data of teaching effect of primary and secondary school classroom
KR102258234B1 (en) personalized and adaptive learning method using artificial intelligence (AI) tutor interface, and system
CN111327772A (en) Method, device, equipment and storage medium for automatic voice response processing
CN112070865A (en) Classroom interaction method and device, storage medium and electronic equipment
CN113205569A (en) Image drawing method and device, computer readable medium and electronic device
CN106372203A (en) Information response method and device for smart terminal and smart terminal
CN113436489A (en) Study leaving experience system and method based on virtual reality
Kalatha et al. Cultural heritage engagement via serious games: the ARCADE augmented reality, context-aware, linked open data personalized ecosystem
CN103942991A (en) Real-world teaching method and system
Lahav et al. Virtual environment support orientation skills of newly blind
Uchiya et al. Design and implementation of open-campus event system with voice interaction agent
KR20010095941A (en) Interactive Language Teaching System consisted of Dolls and Voice Recognizing Computer
KR102535936B1 (en) System for providing metaverse based language education service
Cheng et al. The Discussion of Interactive Outdoor Guidance and Appliance on Smart Glasses from the Aspect of Human Computer Interaction: Taking Dihua Street for Example
Swobodzinski et al. Seamless Wayfinding by a Deafblind Adult on an Urban College Campus: A Case Study on Wayfinding Performance, Information Preferences, and Technology Requirements

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination