CN112215933B - Three-dimensional solid geometry drawing system based on pen type interaction and voice interaction - Google Patents
Three-dimensional solid geometry drawing system based on pen type interaction and voice interaction Download PDFInfo
- Publication number
- CN112215933B CN112215933B CN202011119060.7A CN202011119060A CN112215933B CN 112215933 B CN112215933 B CN 112215933B CN 202011119060 A CN202011119060 A CN 202011119060A CN 112215933 B CN112215933 B CN 112215933B
- Authority
- CN
- China
- Prior art keywords
- module
- geometric
- user
- interaction
- recognition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 82
- 239000007787 solid Substances 0.000 title claims abstract description 44
- 238000006243 chemical reaction Methods 0.000 claims abstract description 4
- 238000000034 method Methods 0.000 claims description 10
- 238000012549 training Methods 0.000 claims description 9
- 238000009877 rendering Methods 0.000 claims description 6
- 238000010276 construction Methods 0.000 claims description 5
- 230000000007 visual effect Effects 0.000 claims description 4
- 238000005259 measurement Methods 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 230000002452 interceptive effect Effects 0.000 abstract 1
- 230000006870 function Effects 0.000 description 9
- 230000000694 effects Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/32—Digital ink
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- Health & Medical Sciences (AREA)
- Computer Graphics (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- General Business, Economics & Management (AREA)
- Computational Linguistics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Economics (AREA)
- Acoustics & Sound (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses a three-dimensional solid geometry drawing system based on pen type interaction and voice interaction, which comprises: the system comprises a user interaction module, an identification module, a command module and a geometric module; the user interaction module comprises an operation module and a display module; the operation module is used for acquiring the operation content of a user; the display module is used for displaying the identification result, the command conversion result and the three-dimensional solid geometry generation result of the user operation content in real time; the identification module is used for identifying the operation content of the user; the command module is used for converting the identification result of the operation content of the user into an executable command; the geometric module is used for constructing or modifying the three-dimensional solid geometric figure according to the executable command converted by the command module. The invention can keep the use habit of the traditional classroom teaching to the maximum extent, improves the interactive efficiency of the system, has strong operability and practicability, is beneficial to students to improve the space imagination capability, and stimulates the students to independently explore the learning interest.
Description
Technical Field
The invention relates to the technical field of solid geometry drawing, in particular to a three-dimensional solid geometry drawing system based on pen type interaction and voice interaction.
Background
The scholars ston Li Yaer pointed out that mathematical education is closely related to the experimental activities related to mathematics, and the best teaching effect can be achieved by combining experimental operation and observation verification. The solid geometry is accompanied with the requirement of space imagination with quite high difficulty, and becomes a knowledge point which is difficult for a plurality of students to understand and learn. In conventional solid geometry education, a teacher usually uses a combination of blackboard drawing and a physical model to display solid geometry, and it is difficult for students to observe the whole appearance of the solid geometry or to operate the models by hands. If the software mode is adopted, the stereoscopic figures are displayed in a three-dimensional mode, meanwhile, students can freely operate the stereoscopic figures, and the students can more deeply understand related stereoscopic geometric knowledge in the interaction process with the software.
The important role of space and graphics in the obligation education process is clearly pointed out in the education department of China. At the same time, information technology is also recommended to improve the relationship between teaching and learning, so that students can understand and solve the actual problems in the exploration process. There are several solid geometry teaching software such as geometry drawing board and GeoGebra on the market. The geometric drawing board is manufactured by Key Curriculum Press company in the United states and is suitable for a dynamic geometric education tool for plane geometry, physical vector analysis and function drawing. The geometric drawing board can be used for drawing accurate geometric figures, measuring and displaying the length, the area and the angle, researching function images, drawing dynamic tracks and the like, is convenient for teaching and understanding by students, but has higher learning cost, and has complex steps when realizing complex figures such as a rotating body in solid geometry, and the solid geometric figures of the geometric drawing board can only be rotated by making cartoons to fix the axis and cannot be observed at any angle. GeoGebra the two main subjects of algebra and geometry are combined, and basic graphics such as points, lines, vectors, polygons and the like can be made by using a drawing tool, and corresponding graphics can be obtained by directly inputting algebraic expressions in command columns. GeoGebra can perform derivative and integral on functions, extremum and inflection point on polynomial functions and the like in plane geometry, but when drawing a stereoscopic table, geoGebra cannot quickly construct a graph according to constraint conditions, long time is needed to learn drawing when the graph is used, and meanwhile, geoGebra cannot hide external dotted lines and surfaces, so that the graph structure of the internal line and surface of the geometric body is not beneficial to understanding. Cabri 3D is three-dimensional geometric model software developed by national research center in France, can help users to quickly construct solid geometry, can control and view various three-dimensional space graphics, provides dynamic and static graphics, and can also measure length, area, volume, angle and the like. However, cabri D is very dependent on the mouse and keyboard and lacks the important function of identifying the geometric points by letters, which is disadvantageous for teachers to use in teaching. Meanwhile, cabri D cannot construct a stereoscopic graph according to a given constraint condition.
In view of the functional deficiency of the solid geometry teaching software in the current middle school mathematics field, the requirement in actual teaching cannot be met, and the solid geometry teaching software capable of being conveniently and rapidly operated is necessary to be provided, so that the requirement of students on quick hand-up operation can be met, and the learning interest of the students can be improved; meanwhile, in the classroom teaching, teachers need to complete teaching within a limited classroom time, so that software is required to have higher interaction efficiency.
Disclosure of Invention
The invention aims to provide a three-dimensional solid geometry drawing system based on pen type interaction and voice interaction, which solves the technical problems existing in the prior art, can keep the use habit of the traditional classroom teaching to the maximum extent, improves the interaction efficiency of the system, and has strong operability and practicability.
In order to achieve the above object, the present invention provides the following solutions: the invention provides a three-dimensional solid geometry drawing system based on pen type interaction and voice interaction, which comprises a user interaction module, an identification module, a command module and a geometry module;
the user interaction module comprises an operation module and a display module; the operation module is used for acquiring the operation content of a user; the display module is used for displaying the identification result, the command conversion result and the three-dimensional solid geometry generation result of the user operation content in real time;
The identification module is used for identifying the operation content of the user;
the command module is used for converting the identification result of the operation content of the user into an executable command;
The geometric module is used for constructing or modifying the three-dimensional solid geometric figure according to the executable command converted by the command module.
Preferably, the operation module comprises a pen-type interaction module and a voice interaction module, and the pen-type interaction module and the voice interaction module are respectively connected with the identification module; the pen-type interaction module is used for acquiring handwriting operation content of a user and storing the acquired operation content in a coordinate point sequence mode; the voice interaction module is used for acquiring operation content sent by a user through voice.
Preferably, the recognition module comprises a handwriting recognition module and a voice recognition module; the handwriting recognition module is connected with the pen-type interaction module and is used for recognizing pen-type interaction content of a user; the voice recognition module is connected with the voice interaction module and is used for recognizing voice interaction content of a user.
Preferably, the handwriting recognition module adopts a hundred-degree cloud handwriting recognition application program interface API.
Preferably, the result field returned by the hundred-degree cloud handwriting recognition API includes position information of the characters and a candidate character list, and the character with the highest recognition probability in the candidate characters is used as the current recognition result and is displayed in the display module.
Preferably, the voice recognition module adopts an improved hundred-degree cloud voice recognition API, and the improved hundred-degree cloud voice recognition API is obtained through voice recognition lexicon file training.
Preferably, the method for generating the speech recognition word stock file comprises the following steps:
Selecting English letters as vertex marking letters, and replacing letter markers in the command module;
and replacing the vertex letters in the command module by utilizing the relation of the sequence and the non-sequence of English letters.
Preferably, the operation contents of the user include a construction condition operation, an auxiliary graphic operation, a measurement condition operation, rotation of the plane graphic, and expansion of the rotator.
Preferably, the command module performs fuzzy processing on the recognition result of the recognition module.
Preferably, the geometric module comprises a geometric model, a geometric state module and a camera system;
The geometric model is used for determining the vertex positions of the three-dimensional geometric figures and adding and deleting points, edges and faces of the three-dimensional geometric figure elements;
The camera system comprises a plurality of cameras; the camera system is used for rendering the three-dimensional geometric figure, controlling the lens position and visual angle transformation of the camera and drawing a depth map of a virtual solid line for calculating edges;
the geometric state module is used for storing the current state of the three-dimensional geometric figure; the geometric state module is also used for storing interaction response events corresponding to the states of the three-dimensional solid geometric figure.
The invention discloses the following technical effects:
(1) The user interaction module comprises a pen type interaction module and a voice interaction module, and through pen type interaction, the use habit of the traditional classroom teaching can be maintained to the maximum extent, and the students can be stimulated to explore the learning interests autonomously; the interaction efficiency of the system can be remarkably improved through voice interaction; meanwhile, through a multi-mode interaction mode, the operability and practicability of the three-dimensional solid geometry drawing system in an actual teaching environment are effectively enhanced.
(2) According to the invention, the command module is used for converting the operation content input by the user into the command which can be executed by the system, so that all operation commands in teaching are covered, besides the common functions of dot line and plane drawing and the like, dynamic real-time construction and section display of the rotating body can be performed, the problems of mapping relation from 2D graphics to 3D graphics, difficult understanding of solid geometry space relation and the like in solid geometry teaching are solved, and the improvement of space imagination capability of students is facilitated.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the drawings that are needed in the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a three-dimensional geometry rendering system based on pen-type interaction and voice interaction according to the present invention;
fig. 2 is a schematic diagram of a recognition flow of a handwriting recognition module in an embodiment of the invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.
Referring to fig. 1, the embodiment provides a three-dimensional geometry drawing system based on pen-type interaction and voice interaction, which comprises a user interaction module, an identification module, a command module and a geometry module;
The user interaction module comprises an operation module and a display module; the operation module is used for acquiring the operation content of a user; the operation module comprises a pen-type interaction module and a voice interaction module, and the pen-type interaction module and the voice interaction module are respectively connected with the identification module; the pen-type interaction module is used for acquiring handwriting operation content of a user and storing the acquired operation content in a coordinate point sequence mode; the pen type interaction module divides input handwriting by a time threshold value, and when the pen lifting time is greater than a preset threshold value, a primary recognition request is triggered; the voice interaction module is used for acquiring operation content sent by a user through voice.
In this embodiment, the operation module further includes a UI (user interface) interaction module, configured to send an instruction according to a function on a self-contained operation interface of the system, where the UI interaction module is connected to the geometry module.
The display module is used for displaying the identification result, the command conversion result and the three-dimensional solid geometry generation result of the user operation content in real time.
The identification module is used for identifying the operation content of the user; the recognition module comprises a handwriting recognition module and a voice recognition module, and the operability and the practicability of the three-dimensional solid geometry drawing system in an actual teaching environment are effectively enhanced through a multi-mode interaction mode; the recognition module is also used for analyzing the recognition result, converting characters or voices into corresponding commands through analysis, and carrying out self-defining operation on the three-dimensional solid geometry through the commands.
The handwriting recognition module is used for recognizing pen-type interaction content of a user; in this embodiment, the handwriting recognition module is implemented based on a hundred degree cloud handwriting recognition API (Application Programming Interface, application program interface); the specific recognition flow of the handwriting recognition module is shown in fig. 2, and comprises three parts of handwriting acquisition, request structure and command analysis recognition; the result field returned by the hundred-degree cloud handwriting recognition API comprises character position information and a candidate character list, and the character with the highest recognition probability in the candidate characters is used as the current recognition result and is displayed in the display module.
The voice recognition is used for recognizing voice interaction content of the user; the voice recognition module is realized based on an improved hundred-degree cloud voice recognition API;
After acquiring a user voice file, the hundred-degree cloud voice recognition API firstly converts the voice file into PCM16 coded data, uploads the PCM16 coded data to the API to obtain a recognition result in a JSON format, takes the character with the highest recognition probability of the candidate characters as the current recognition result, and displays the character in the display module. However, the hundred-degree cloud speech recognition API has low recognition accuracy for specific commands in the mathematical field, and particularly has poor recognition effect for mixed letter marks in the commands, so that the requirements of three-dimensional solid geometry drawing cannot be met.
The content of the speech recognition word stock file used for platform training is important for the recognition effect after model training, and the improved speech recognition word stock of the hundred-degree cloud speech recognition API is added with the mathematic related word stock file provided by the dog search input method, so that basic mathematics words, common mathematics words and professional mathematics words are covered, and the training effect of the model on the logarithmic words is improved; meanwhile, since the hundred-degree cloud speech recognition API tends to recognize English letters in speech as Chinese characters with similar pronunciation, for example, letter B is recognized as Chinese character "ratio" and letter I is recognized as Chinese character "love", the embodiment self-defines and constructs a large number of commands which can be recognized by software and adds the commands into a speech recognition word stock file, and the specific method for generating the speech recognition word stock file is as follows:
firstly, selecting English letters as vertex marking letters, and replacing letter markers in a command module;
The generation of the speech recognition word stock file is a process of matching and replacing a character string, if the character string is replaced without limitation, the finally generated speech recognition word stock file can be expanded rapidly and contains a large number of invalid training sentences; in the embodiment, among 26 English letters from A to Z, the common 17 English letters are selected as vertex marking letters to replace, so that the scale of the letters needing to be replaced is reduced.
Secondly, replacing vertex letters in the command module by utilizing a relation between the sequence and the non-sequence of English letters;
In the mathematical command, for example, "make middle point F in AB", there is dictionary sequence and non-sequence of letters between front and back between english letters, for example, "make middle point F in AB" there is incremental dictionary sequence of english letters at A, B position in command, and there is no sequence between letter at F position and A, B, so this embodiment uses the sequence and non-sequence relationship between english letters, a great number of texts usable for training are generated by substitution, and put them into speech recognition lexicon file; the hundred-degree cloud voice recognition API performs continuous incremental learning through a large number of training texts, and can obtain a good recognition result according to the influence of high frequency of occurrence of keywords and letters in the texts on a model even if a command to be recognized is not in a voice recognition word stock file.
In order to verify the training effect of the speech recognition word stock file, 64 speech samples are collected, and an existing hundred-degree cloud speech recognition API and an improved hundred-degree cloud speech recognition API are adopted respectively, so that a comparison experiment is carried out in a real scene, wherein the real scene is a scene with unclear pronunciation or noisy environment; under the condition of first recognition errors, performing a second experiment to obtain single recognition accuracy and secondary recognition accuracy, and considering that the recognition is successful if the voice recognition result is identical to the command content, or else, considering that the recognition is failed; the experimental results are shown in table 1; after the hundred-degree cloud speech recognition API is trained by using the speech recognition word library file, the single recognition accuracy is improved from 35.94% to 78.13%, and the secondary recognition accuracy is improved from 42.19% to 84.38%.
TABLE 1
The command module is used for converting the identification result of the operation content of the user into an executable command; by means of executable commands, three-dimensional solid geometry can be constructed or modified; the operation content of the user includes various operation types, the operation types include construction condition operation, auxiliary graph operation (such as center, gravity center and auxiliary plane), measurement condition operation (such as line segment length, included angle and plane area), rotation of plane graph, and expansion of rotator (such as cylinder and cone), and in this embodiment, the identification result of the operation content of the user is converted into an executable command as shown in table 2:
TABLE 2
Wherein the contents in brackets of table 2 are optional inputs.
In this embodiment, considering the randomness of natural language and the difficulty of the voice recognition interface in recognizing homophones, the command module performs fuzzy processing on the recognition result of the recognition module, that is, performs equivalent processing on the related command when the command is segmented, for example, regarding "fetch" as "act", "end point" is equivalent to "middle point".
The geometric module is used for constructing or modifying a three-dimensional solid geometric figure according to the executable command converted by the command module; the geometric module can also construct or modify a three-dimensional solid geometric figure according to the command sent by the UI interaction module;
the geometric module comprises a geometric model, a geometric state module and a camera system;
The geometric model is used for determining the vertex positions of the three-dimensional geometric figures and adding and deleting points, edges and faces of the three-dimensional geometric figure elements so as to realize data processing and logic behaviors of the three-dimensional geometric figure;
the camera system comprises a plurality of cameras; the camera system is used for rendering the three-dimensional geometric figure, controlling the lens position and visual angle transformation of the camera and drawing a depth map of a virtual solid line for calculating edges; in this embodiment, the camera system includes two cameras, one for drawing a graphical interface in the UI interaction module, including a button and an input box for drawing a depth fixation in the graphical interface; and the other is used for drawing the generation result of the three-dimensional solid geometry in the display module.
The geometric state module is used for storing the current state of the three-dimensional geometric figure, such as user-defined operation of points, lines and faces; the geometric state module is further used for storing interaction response events corresponding to the states of the three-dimensional solid geometric figure, for example, viewing of the three-dimensional solid geometric figure interface.
In order to further verify the effectiveness of the three-dimensional solid geometry drawing system based on pen type interaction and voice interaction, the embodiment uses a mathematical problem as an example to draw the three-dimensional solid geometry.
The title requirements are: calculating the volume of a geometric body by rotating an isosceles right triangle around a right angle side for one circle.
Step one: inputting an isosceles triangle drawing through a pen-type interaction module, and converting a command module into a regular graphic command after the isosceles triangle drawing is recognized by a recognition module;
Step two: the voice interaction module inputs a rotation instruction, the geometric module defaults to rotate by taking the y axis as a rotation axis after passing through the recognition module and the command module, and the rotation process is displayed in real time through the display module, so that students can intuitively feel the generation process of 2D to 3D images;
Step three: the user interface module clicks the function icon of calculating the surface area and volume, and the surface area and volume of the rotator is checked on the display module.
Therefore, the three-dimensional solid geometry drawing system based on pen type interaction and voice interaction can simply and quickly complete the construction from a 2D graph to a 3D graph, simultaneously, the function of unfolding the rotator is supported, visual representation is provided for understanding the corresponding relation between the plane graph and the solid graph and calculating the volume of the rotator, and the improvement of space imagination capability of students is facilitated; meanwhile, by means of a pen-type interaction and voice interaction multi-mode interaction mode, students can independently create any three-dimensional graph, and operability and practicability of the three-dimensional solid geometry drawing system in an actual teaching environment are effectively improved.
Claims (3)
1. The three-dimensional solid geometry drawing system based on pen type interaction and voice interaction is characterized by comprising a user interaction module, an identification module, a command module and a geometry module;
the user interaction module comprises an operation module and a display module; the operation module is used for acquiring the operation content of a user; the display module is used for displaying the identification result, the command conversion result and the three-dimensional solid geometry generation result of the user operation content in real time;
The identification module is used for identifying the operation content of the user;
the command module is used for converting the identification result of the operation content of the user into an executable command;
The geometric module is used for constructing or modifying a three-dimensional solid geometric figure according to the executable command converted by the command module;
the operation module comprises a pen-type interaction module and a voice interaction module, and the pen-type interaction module and the voice interaction module are respectively connected with the identification module; the pen-type interaction module is used for acquiring handwriting operation content of a user and storing the acquired operation content in a coordinate point sequence mode; the voice interaction module is used for acquiring operation content sent by a user through voice;
the recognition module comprises a handwriting recognition module and a voice recognition module; the handwriting recognition module is connected with the pen-type interaction module and is used for recognizing pen-type interaction content of a user; the voice recognition module is connected with the voice interaction module and is used for recognizing voice interaction content of a user;
the handwriting recognition module adopts a hundred-degree cloud handwriting recognition application program interface API;
The result field returned by the hundred-degree cloud handwriting recognition API comprises character position information and a candidate character list, and the character with the highest recognition probability in the candidate characters is used as the current recognition result and is displayed in the display module;
the voice recognition module adopts an improved hundred-degree cloud voice recognition API, and the improved hundred-degree cloud voice recognition API is obtained through training of a voice recognition word stock file;
the method for generating the speech recognition word stock file comprises the following steps:
Selecting English letters as vertex marking letters, and replacing letter markers in the command module;
Replacing vertex letters in the command module by utilizing a relation between the sequence and the non-sequence of English letters;
the geometric module comprises a geometric model, a geometric state module and a camera system;
The geometric model is used for determining the vertex positions of the three-dimensional geometric figures and adding and deleting points, edges and faces of the three-dimensional geometric figure elements;
The camera system comprises a plurality of cameras; the camera system is used for rendering the three-dimensional geometric figure, controlling the lens position and visual angle transformation of the camera and drawing a depth map of a virtual solid line for calculating edges;
the geometric state module is used for storing the current state of the three-dimensional geometric figure; the geometric state module is also used for storing interaction response events corresponding to the states of the three-dimensional solid geometric figure.
2. The three-dimensional geometry rendering system of claim 1, wherein the user's operation includes a construction condition operation, an auxiliary graphic operation, a measurement condition operation, a rotation of a plane graphic, and a deployment of a rotator.
3. The three-dimensional geometry rendering system of claim 1, wherein the command module blur the recognition result of the recognition module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011119060.7A CN112215933B (en) | 2020-10-19 | 2020-10-19 | Three-dimensional solid geometry drawing system based on pen type interaction and voice interaction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011119060.7A CN112215933B (en) | 2020-10-19 | 2020-10-19 | Three-dimensional solid geometry drawing system based on pen type interaction and voice interaction |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112215933A CN112215933A (en) | 2021-01-12 |
| CN112215933B true CN112215933B (en) | 2024-04-30 |
Family
ID=74055802
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011119060.7A Active CN112215933B (en) | 2020-10-19 | 2020-10-19 | Three-dimensional solid geometry drawing system based on pen type interaction and voice interaction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112215933B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114973876B (en) * | 2022-06-16 | 2023-07-25 | 齐齐哈尔大学 | Teaching drawing method and system for unfolding chart of solid geometric model |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6549201B1 (en) * | 1999-11-23 | 2003-04-15 | Center For Advanced Science And Technology Incubation, Ltd. | Method for constructing a 3D polygonal surface from a 2D silhouette by using computer, apparatus thereof and storage medium |
| CN1747559A (en) * | 2005-07-29 | 2006-03-15 | 北京大学 | Three-dimensional geometric mode building system and method |
| CN102163262A (en) * | 2011-04-15 | 2011-08-24 | 华中师范大学 | Middle school solid geometry intelligent teaching system applied to electronic double plate |
| EP2568355A2 (en) * | 2011-09-12 | 2013-03-13 | Palo Alto Research Center Incorporated | Combined stereo camera and stereo display interaction |
| CN104641400A (en) * | 2012-07-19 | 2015-05-20 | 戈拉夫·瓦茨 | User-controlled 3D simulation for providing realistic and enhanced digital object viewing and interaction experience |
| CN106297441A (en) * | 2016-11-02 | 2017-01-04 | 新乡学院 | A kind of art teaching system |
| CN107195210A (en) * | 2017-07-03 | 2017-09-22 | 北京大生在线科技有限公司 | Two dimension and the three-dimensional teleeducation system combined and control method |
| CN107818597A (en) * | 2017-09-29 | 2018-03-20 | 镇江睿泰教育科技有限公司 | Intelligent tutoring system for solid geometry |
| CN109284000A (en) * | 2018-08-10 | 2019-01-29 | 西交利物浦大学 | Three-dimensional geometry object visualization method and system under a kind of reality environment |
| CN110889161A (en) * | 2019-12-11 | 2020-03-17 | 清华大学 | Three-dimensional display system and method for sound control building information model |
| CN111383505A (en) * | 2020-03-04 | 2020-07-07 | 南京大学 | Circuit teaching system and method based on pen interaction |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190027054A1 (en) * | 2016-11-23 | 2019-01-24 | SparxTeq Inc. | Systems and methods for a selective visual display system to facilitate geometric shape-based assessments |
-
2020
- 2020-10-19 CN CN202011119060.7A patent/CN112215933B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6549201B1 (en) * | 1999-11-23 | 2003-04-15 | Center For Advanced Science And Technology Incubation, Ltd. | Method for constructing a 3D polygonal surface from a 2D silhouette by using computer, apparatus thereof and storage medium |
| CN1747559A (en) * | 2005-07-29 | 2006-03-15 | 北京大学 | Three-dimensional geometric mode building system and method |
| CN102163262A (en) * | 2011-04-15 | 2011-08-24 | 华中师范大学 | Middle school solid geometry intelligent teaching system applied to electronic double plate |
| EP2568355A2 (en) * | 2011-09-12 | 2013-03-13 | Palo Alto Research Center Incorporated | Combined stereo camera and stereo display interaction |
| CN104641400A (en) * | 2012-07-19 | 2015-05-20 | 戈拉夫·瓦茨 | User-controlled 3D simulation for providing realistic and enhanced digital object viewing and interaction experience |
| CN106297441A (en) * | 2016-11-02 | 2017-01-04 | 新乡学院 | A kind of art teaching system |
| CN107195210A (en) * | 2017-07-03 | 2017-09-22 | 北京大生在线科技有限公司 | Two dimension and the three-dimensional teleeducation system combined and control method |
| CN107818597A (en) * | 2017-09-29 | 2018-03-20 | 镇江睿泰教育科技有限公司 | Intelligent tutoring system for solid geometry |
| CN109284000A (en) * | 2018-08-10 | 2019-01-29 | 西交利物浦大学 | Three-dimensional geometry object visualization method and system under a kind of reality environment |
| CN110889161A (en) * | 2019-12-11 | 2020-03-17 | 清华大学 | Three-dimensional display system and method for sound control building information model |
| CN111383505A (en) * | 2020-03-04 | 2020-07-07 | 南京大学 | Circuit teaching system and method based on pen interaction |
Non-Patent Citations (3)
| Title |
|---|
| Prelude:手写谱曲系统的交互方法;冯桂焕等;计算机辅助设计与图形学学报;20160815;全文 * |
| Semantic sketch-based 3D model retrieval;Bo Li等;2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW);20130719;全文 * |
| 手绘输入的三维建模和编辑技术;韩丽等;计算机辅助设计与图形学学报;参见正文第1-2节、图1 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112215933A (en) | 2021-01-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Taele et al. | Lamps: A sketch recognition-based teaching tool for mandarin phonetic symbols i | |
| CN112215933B (en) | Three-dimensional solid geometry drawing system based on pen type interaction and voice interaction | |
| Panessai | Usefulness of augmented reality as a tool to support online learning | |
| Kryvonos et al. | Human hand motion parametrization for dactilemes modeling | |
| KR20120075587A (en) | Studying system and method using a recognition of handwriting mathematical expression | |
| Lee et al. | Newtons pen ii: an intelligent, sketch-based tutoring system and its sketch processing techniques | |
| Güyer | Computer algebra systems as the mathematics teaching tool | |
| Krämer | Why notational iconicity is a form of operational iconicity | |
| Slobodsky et al. | Using the universal math environment Math-XPress for teaching and assessment of math courses | |
| Pollanen et al. | Xpress: a novice interface for the real-time communication of mathematical expressions | |
| Fernando et al. | A computer aided drawing system evaluation with early and late blind users | |
| Krak et al. | Interactive systems for sign language learning | |
| Goncu et al. | Generation of accessible graphics | |
| Holden et al. | The graphical translation of English text into signed English in the hand sign translator system | |
| Kim | Analysis of children's sketches to improve recognition accuracy in sketch-based applications | |
| Bhatti et al. | Text to animation for sign language of Urdu and Sindhi | |
| Taele | Freehand sketch recognition for computer-assisted language learning of written east asian languages | |
| Schwarz et al. | Interface for Automatic Tactile Display of Data Plots | |
| Hayati et al. | DEVELOPING STUDENTS’MATHEMATICAL UNDERSTANDING USING GEOGEBRA SOFTWARE | |
| Cao et al. | A novel augmented reality guidance system for future informatization experimental teaching | |
| Lee | A Pen Based Statics Tutoring System | |
| Young et al. | I Can't See That! Considering the Readability of Small Objects in Virtual Environments | |
| Stahovich et al. | Using lexical properties of handwritten equations to estimate the correctness of students’ solutions to engineering problems | |
| Maschietto et al. | Visual representations in the construction of mathematical meanings | |
| CN107609029A (en) | A kind of multi-function Chinese character is given financial aid to students system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |